2024-09-12T02:25:52.694 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T02:25:52.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:25:52.931 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901629 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/blogbench}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901629' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFRJV2OEKZgEygtO8yP2LpeEf6akSHhnZCXWmOVJSGNodEv4/Jrl0DKAooxkhCE3vra/XwU+YpQTcarDehr54QE= smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCxHFGV4UqaP5pULwA8FzSNW9hp0aMPFgcCzdMZgcEw+QxQqhTtkPTv39xL4GdX/Ka0NblKdKifVaYsAh21dn5o= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEE4qdVuhlc1Id9rCcp0B0qn6F20mF+6eAcyoZds8FTmtjc6x0Zy6P7YgPA89TabkIkaCjMIePWJETCpUyzfKVY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T02:25:52.931 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T02:25:52.932 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T02:25:52.932 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T02:25:52.933 INFO:teuthology.task.internal:Checking packages... 2024-09-12T02:25:52.956 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T02:25:52.956 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T02:25:52.956 INFO:teuthology.packaging:ref: None 2024-09-12T02:25:52.956 INFO:teuthology.packaging:tag: None 2024-09-12T02:25:52.956 INFO:teuthology.packaging:branch: squid 2024-09-12T02:25:52.956 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:25:52.956 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T02:25:53.190 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T02:25:53.192 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T02:25:53.202 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T02:25:53.203 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T02:25:53.211 INFO:teuthology.task.internal:Saving configuration 2024-09-12T02:25:53.234 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T02:25:53.241 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T02:25:53.263 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901629', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:21:02.071643', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFRJV2OEKZgEygtO8yP2LpeEf6akSHhnZCXWmOVJSGNodEv4/Jrl0DKAooxkhCE3vra/XwU+YpQTcarDehr54QE='} 2024-09-12T02:25:53.284 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901629', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:21:02.073025', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCxHFGV4UqaP5pULwA8FzSNW9hp0aMPFgcCzdMZgcEw+QxQqhTtkPTv39xL4GdX/Ka0NblKdKifVaYsAh21dn5o='} 2024-09-12T02:25:53.308 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901629', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:21:02.069866', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEE4qdVuhlc1Id9rCcp0B0qn6F20mF+6eAcyoZds8FTmtjc6x0Zy6P7YgPA89TabkIkaCjMIePWJETCpUyzfKVY='} 2024-09-12T02:25:53.309 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T02:25:53.314 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-12T02:25:53.315 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-12T02:25:53.315 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-12T02:25:53.315 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T02:25:53.399 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f774fc5bbe0>, signals=[15]) 2024-09-12T02:25:53.399 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T02:25:53.405 INFO:teuthology.task.internal:Opening connections... 2024-09-12T02:25:53.405 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2024-09-12T02:25:53.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:25:53.486 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T02:25:53.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:25:53.564 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2024-09-12T02:25:53.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:25:53.636 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T02:25:53.643 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-09-12T02:25:53.661 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-09-12T02:25:53.662 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-09-12T02:25:53.718 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2024-09-12T02:25:53.719 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2024-09-12T02:25:53.719 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2024-09-12T02:25:53.719 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:25:53.719 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2024-09-12T02:25:53.719 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:25:53.719 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:25:53.719 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2024-09-12T02:25:53.719 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:25:53.719 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:25:53.719 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:25:53.720 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:25:53.720 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:25:53.720 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:25:53.720 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-09-12T02:25:53.746 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-09-12T02:25:53.765 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-09-12T02:25:53.765 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-09-12T02:25:53.823 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2024-09-12T02:25:53.823 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2024-09-12T02:25:53.823 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2024-09-12T02:25:53.823 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:25:53.823 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2024-09-12T02:25:53.823 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:25:53.823 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:25:53.824 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2024-09-12T02:25:53.824 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:25:53.824 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:25:53.824 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:25:53.824 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:25:53.824 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:25:53.824 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:25:53.824 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-09-12T02:25:53.847 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2024-09-12T02:25:53.866 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2024-09-12T02:25:53.866 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2024-09-12T02:25:53.923 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2024-09-12T02:25:53.923 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9" 2024-09-12T02:25:53.923 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2024-09-12T02:25:53.923 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:25:53.923 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9" 2024-09-12T02:25:53.924 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:25:53.924 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:25:53.924 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2024-09-12T02:25:53.924 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:25:53.924 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:25:53.924 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:25:53.924 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:25:53.924 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:25:53.924 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:25:53.924 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2024-09-12T02:25:53.946 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T02:25:53.957 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T02:25:53.962 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T02:25:53.962 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:25:53.965 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:25:53.967 DEBUG:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:25:53.984 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T02:25:53.990 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T02:25:53.991 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:25:54.022 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:25:54.025 DEBUG:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:25:54.130 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T02:25:54.206 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T02:25:54.220 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T02:25:54.220 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-12T02:25:54.220 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-12T02:25:54.220 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:25:54.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:25:54.238 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-12T02:25:54.396 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T02:25:54.396 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-12T02:25:54.396 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-12T02:25:54.414 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-503.el9.x86_64 2024-09-12T02:25:54.414 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T02:25:54.415 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-12T02:25:54.415 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum upgrade -y linux-firmware 2024-09-12T02:25:57.731 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.2 MB 00:01 2024-09-12T02:26:02.849 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 5.1 MB/s | 20 MB 00:03 2024-09-12T02:26:08.432 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-12T02:26:09.924 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 19 kB 00:00 2024-09-12T02:26:10.987 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-12T02:26:16.709 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T02:26:18.900 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-12T02:26:18.901 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-09-12T02:26:18.901 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-12T02:26:19.004 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-12T02:26:19.005 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T02:26:19.149 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-12T02:26:19.150 DEBUG:teuthology.orchestra.run.smithi018:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-12T02:26:19.152 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi018.front.sepia.ceph.com to complete... 2024-09-12T02:26:28.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12 02:26:28 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-12T02:26:28.546 INFO:teuthology.orchestra.run.smithi018.stderr:FINISHED --2024-09-12 02:26:28-- 2024-09-12T02:26:28.546 INFO:teuthology.orchestra.run.smithi018.stderr:Total wall clock time: 9.4s 2024-09-12T02:26:28.546 INFO:teuthology.orchestra.run.smithi018.stderr:Downloaded: 1 files, 343M in 9.1s (37.8 MB/s) 2024-09-12T02:26:28.549 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-12T02:26:28.549 DEBUG:teuthology.orchestra.run.smithi018:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-12T02:26:30.751 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying... ######################################## 2024-09-12T02:26:30.902 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing... ######################################## 2024-09-12T02:26:31.034 INFO:teuthology.orchestra.run.smithi018.stdout:Updating / installing... 2024-09-12T02:26:39.376 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-12T02:27:19.537 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi018.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-12T02:27:19.537 DEBUG:teuthology.orchestra.run.smithi018:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-12T02:27:19.631 INFO:teuthology.orchestra.run.smithi018.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:27:19.631 INFO:teuthology.orchestra.run.smithi018.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:27:19.631 INFO:teuthology.orchestra.run.smithi018.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:27:19.631 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:27:19.632 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-12T02:27:19.632 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-12T02:27:19.632 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-12T02:27:19.632 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-12T02:27:19.632 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-12T02:27:19.632 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-12T02:27:19.632 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-12T02:27:19.632 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-12T02:27:19.632 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-12T02:27:19.632 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-12T02:27:19.632 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-12T02:27:19.632 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-12T02:27:19.633 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-12T02:27:19.633 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-12T02:27:19.633 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-12T02:27:19.633 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-12T02:27:19.633 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-12T02:27:19.633 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-12T02:27:19.633 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-12T02:27:19.633 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-12T02:27:19.633 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-12T02:27:19.633 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-12T02:27:19.633 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-12T02:27:19.633 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-12T02:27:19.633 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-12T02:27:19.634 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-12T02:27:19.634 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-12T02:27:19.634 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-12T02:27:19.634 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-12T02:27:19.634 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-12T02:27:19.634 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-12T02:27:19.634 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-12T02:27:19.634 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-12T02:27:19.634 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-12T02:27:19.634 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-12T02:27:19.634 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-12T02:27:19.634 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-12T02:27:19.635 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-12T02:27:19.635 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-12T02:27:19.635 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-12T02:27:19.635 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-12T02:27:19.635 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-12T02:27:19.635 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-12T02:27:19.635 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-12T02:27:19.635 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-12T02:27:19.635 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-12T02:27:19.635 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-12T02:27:19.635 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-12T02:27:19.635 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-12T02:27:19.635 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-12T02:27:19.636 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-12T02:27:19.636 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-12T02:27:19.636 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-12T02:27:19.636 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-12T02:27:19.636 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-12T02:27:19.636 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-12T02:27:19.636 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-12T02:27:19.636 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-12T02:27:19.636 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-12T02:27:19.636 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-12T02:27:19.636 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-12T02:27:19.636 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-12T02:27:19.636 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-12T02:27:19.637 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-12T02:27:19.637 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-12T02:27:19.637 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-12T02:27:19.637 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-12T02:27:19.637 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-12T02:27:19.637 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-12T02:27:19.637 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-12T02:27:19.637 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-12T02:27:19.637 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-12T02:27:19.637 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-12T02:27:19.637 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-12T02:27:19.637 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-12T02:27:19.637 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-12T02:27:19.638 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-12T02:27:19.638 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-12T02:27:19.638 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-12T02:27:19.638 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-12T02:27:19.638 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-12T02:27:19.638 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-12T02:27:19.638 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-12T02:27:19.638 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-12T02:27:19.638 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-12T02:27:19.638 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-12T02:27:19.638 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-12T02:27:19.638 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-12T02:27:19.638 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-12T02:27:19.639 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-12T02:27:19.639 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-12T02:27:19.639 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-12T02:27:19.639 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-12T02:27:19.639 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-12T02:27:19.639 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-12T02:27:19.639 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-12T02:27:19.639 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-12T02:27:19.639 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-12T02:27:19.639 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-12T02:27:19.639 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-12T02:27:19.639 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-12T02:27:19.639 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-12T02:27:19.639 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-12T02:27:19.640 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-12T02:27:19.640 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-12T02:27:19.640 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-12T02:27:19.640 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-12T02:27:19.640 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-12T02:27:19.640 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-12T02:27:19.640 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-12T02:27:19.640 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-12T02:27:19.640 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-12T02:27:19.640 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-12T02:27:19.640 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-12T02:27:19.640 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-12T02:27:19.640 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-12T02:27:19.641 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-12T02:27:19.641 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-12T02:27:19.641 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-12T02:27:19.641 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-12T02:27:19.641 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-12T02:27:19.641 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-12T02:27:19.641 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-12T02:27:19.641 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-12T02:27:19.641 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-12T02:27:19.641 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-12T02:27:19.641 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-12T02:27:19.641 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-12T02:27:19.642 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-12T02:27:19.642 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-12T02:27:19.642 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-12T02:27:19.642 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-12T02:27:19.642 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-12T02:27:19.642 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-12T02:27:19.642 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-12T02:27:19.642 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-12T02:27:19.642 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-12T02:27:19.642 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-12T02:27:19.642 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-12T02:27:19.642 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-12T02:27:19.642 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-12T02:27:19.642 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-12T02:27:19.643 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-12T02:27:19.643 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-12T02:27:19.643 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-12T02:27:19.643 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-12T02:27:19.643 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-12T02:27:19.643 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-12T02:27:19.643 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-12T02:27:19.643 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-12T02:27:19.643 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-12T02:27:19.643 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-12T02:27:19.643 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-12T02:27:19.643 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-12T02:27:19.643 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-12T02:27:19.644 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-12T02:27:19.644 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-12T02:27:19.644 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-12T02:27:19.644 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-12T02:27:19.644 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-12T02:27:19.644 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-12T02:27:19.644 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-12T02:27:19.644 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-12T02:27:19.644 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-12T02:27:19.644 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-12T02:27:19.644 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-12T02:27:19.644 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-12T02:27:19.644 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-12T02:27:19.644 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-12T02:27:19.645 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-12T02:27:19.645 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-12T02:27:19.645 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-12T02:27:19.645 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-12T02:27:19.645 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-12T02:27:19.645 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-12T02:27:19.645 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-12T02:27:19.645 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-12T02:27:19.645 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-12T02:27:19.645 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-12T02:27:19.645 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-12T02:27:19.645 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-12T02:27:19.645 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-12T02:27:19.646 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-12T02:27:19.646 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-12T02:27:19.646 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-12T02:27:19.646 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-12T02:27:19.646 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-12T02:27:19.646 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-12T02:27:19.646 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-12T02:27:19.646 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-12T02:27:19.646 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-12T02:27:19.646 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-12T02:27:19.646 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-12T02:27:19.646 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-12T02:27:19.646 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-12T02:27:19.646 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-12T02:27:19.647 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-12T02:27:19.647 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-12T02:27:19.647 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-12T02:27:19.647 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-12T02:27:19.647 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-12T02:27:19.647 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-12T02:27:19.647 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-12T02:27:19.647 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-12T02:27:19.647 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-12T02:27:19.647 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-12T02:27:19.647 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-12T02:27:19.647 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-12T02:27:19.647 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-12T02:27:19.648 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-12T02:27:19.648 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-12T02:27:19.648 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-12T02:27:19.648 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-12T02:27:19.648 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-12T02:27:19.648 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-12T02:27:19.648 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-12T02:27:19.648 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-12T02:27:19.648 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-12T02:27:19.648 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-12T02:27:19.648 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-12T02:27:19.648 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-12T02:27:19.649 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-12T02:27:19.649 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-12T02:27:19.649 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-12T02:27:19.649 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-12T02:27:19.649 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-12T02:27:19.649 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-12T02:27:19.649 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-12T02:27:19.649 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-12T02:27:19.649 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-12T02:27:19.649 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-12T02:27:19.649 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-12T02:27:19.649 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-12T02:27:19.649 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-12T02:27:19.650 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-12T02:27:19.650 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-12T02:27:19.650 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-12T02:27:19.650 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-12T02:27:19.650 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-12T02:27:19.650 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-12T02:27:19.650 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-12T02:27:19.650 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-12T02:27:19.650 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-12T02:27:19.650 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-12T02:27:19.650 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-12T02:27:19.650 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-12T02:27:19.650 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-12T02:27:19.650 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-12T02:27:19.650 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-12T02:27:19.651 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-12T02:27:19.651 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-12T02:27:19.651 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-12T02:27:19.651 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-12T02:27:19.651 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-12T02:27:19.651 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-12T02:27:19.651 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-12T02:27:19.651 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-12T02:27:19.651 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-12T02:27:19.651 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-12T02:27:19.651 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-12T02:27:19.651 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-12T02:27:19.651 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-12T02:27:19.651 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-12T02:27:19.652 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-12T02:27:19.652 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-12T02:27:19.652 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-12T02:27:19.652 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-12T02:27:19.652 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-12T02:27:19.652 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-12T02:27:19.652 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-12T02:27:19.652 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-12T02:27:19.652 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-12T02:27:19.652 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-12T02:27:19.652 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-12T02:27:19.652 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-12T02:27:19.652 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-12T02:27:19.652 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-12T02:27:19.653 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-12T02:27:19.653 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-12T02:27:19.653 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-12T02:27:19.653 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-12T02:27:19.653 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-12T02:27:19.653 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-12T02:27:19.653 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-12T02:27:19.653 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-12T02:27:19.653 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-12T02:27:19.653 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-12T02:27:19.653 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-12T02:27:19.653 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-12T02:27:19.653 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-12T02:27:19.653 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-12T02:27:19.654 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-12T02:27:19.654 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-12T02:27:19.654 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-12T02:27:19.654 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-12T02:27:19.654 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-12T02:27:19.654 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-12T02:27:19.654 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-12T02:27:19.654 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-12T02:27:19.654 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-12T02:27:19.654 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-12T02:27:19.654 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-12T02:27:19.654 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-12T02:27:19.655 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-12T02:27:19.655 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-12T02:27:19.655 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-12T02:27:19.655 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-12T02:27:19.655 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-12T02:27:19.655 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-12T02:27:19.655 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-12T02:27:19.655 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-12T02:27:19.655 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-12T02:27:19.655 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-12T02:27:19.655 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-12T02:27:19.655 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-12T02:27:19.655 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-12T02:27:19.655 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-12T02:27:19.655 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-12T02:27:19.656 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-12T02:27:19.656 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-12T02:27:19.656 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-12T02:27:19.656 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-12T02:27:19.656 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-12T02:27:19.656 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-12T02:27:19.656 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-12T02:27:19.656 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-12T02:27:19.656 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-12T02:27:19.656 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-12T02:27:19.656 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-12T02:27:19.656 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-12T02:27:19.656 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-12T02:27:19.657 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-12T02:27:19.657 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-12T02:27:19.657 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-12T02:27:19.657 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-12T02:27:19.657 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-12T02:27:19.657 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-12T02:27:19.657 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-12T02:27:19.657 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-12T02:27:19.657 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-12T02:27:19.657 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-12T02:27:19.657 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-12T02:27:19.657 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-12T02:27:19.658 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-12T02:27:19.658 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-12T02:27:19.658 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-12T02:27:19.658 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-12T02:27:19.658 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-12T02:27:19.658 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-12T02:27:19.658 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-12T02:27:19.658 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-12T02:27:19.658 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-12T02:27:19.658 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-12T02:27:19.659 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-12T02:27:19.659 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-12T02:27:19.659 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-12T02:27:19.659 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-12T02:27:19.659 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-12T02:27:19.659 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-12T02:27:19.659 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-12T02:27:19.659 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-12T02:27:19.659 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-12T02:27:19.659 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-12T02:27:19.659 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-12T02:27:19.659 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-12T02:27:19.659 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-12T02:27:19.660 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-12T02:27:19.660 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-12T02:27:19.660 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-12T02:27:19.660 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-12T02:27:19.660 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-12T02:27:19.660 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-12T02:27:19.660 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-12T02:27:19.660 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-12T02:27:19.660 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-12T02:27:19.660 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-12T02:27:19.660 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-12T02:27:19.660 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-12T02:27:19.660 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-12T02:27:19.661 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-12T02:27:19.661 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-12T02:27:19.661 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-12T02:27:19.661 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-12T02:27:19.661 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-12T02:27:19.661 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-12T02:27:19.661 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-12T02:27:19.661 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-12T02:27:19.661 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-12T02:27:19.661 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-12T02:27:19.661 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-12T02:27:19.661 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-12T02:27:19.662 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-12T02:27:19.662 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-12T02:27:19.662 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-12T02:27:19.662 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-12T02:27:19.662 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-12T02:27:19.662 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-12T02:27:19.662 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-12T02:27:19.662 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-12T02:27:19.662 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-12T02:27:19.662 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-12T02:27:19.662 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-12T02:27:19.662 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-12T02:27:19.662 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-12T02:27:19.662 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-12T02:27:19.663 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-12T02:27:19.663 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-12T02:27:19.663 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-12T02:27:19.663 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-12T02:27:19.663 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-12T02:27:19.663 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-12T02:27:19.663 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-12T02:27:19.663 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-12T02:27:19.663 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-12T02:27:19.663 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-12T02:27:19.663 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-12T02:27:19.663 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-12T02:27:19.663 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-12T02:27:19.663 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-12T02:27:19.664 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-12T02:27:19.664 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-12T02:27:19.664 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-12T02:27:19.664 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-12T02:27:19.664 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-12T02:27:19.664 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-12T02:27:19.664 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-12T02:27:19.664 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-12T02:27:19.664 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-12T02:27:19.664 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-12T02:27:19.664 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-12T02:27:19.664 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-12T02:27:19.664 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-12T02:27:19.665 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-12T02:27:19.665 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-12T02:27:19.665 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-12T02:27:19.665 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-12T02:27:19.665 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-12T02:27:19.665 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-12T02:27:19.665 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-12T02:27:19.665 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-12T02:27:19.665 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-12T02:27:19.665 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-12T02:27:19.665 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-12T02:27:19.665 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-12T02:27:19.665 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-12T02:27:19.666 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-12T02:27:19.666 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-12T02:27:19.666 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-12T02:27:19.666 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-12T02:27:19.666 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-12T02:27:19.666 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-12T02:27:19.666 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-12T02:27:19.666 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-12T02:27:19.666 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-12T02:27:19.666 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-12T02:27:19.666 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-12T02:27:19.666 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-12T02:27:19.666 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-12T02:27:19.666 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-12T02:27:19.667 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-12T02:27:19.667 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-12T02:27:19.667 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-12T02:27:19.667 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-12T02:27:19.667 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-12T02:27:19.667 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-12T02:27:19.667 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-12T02:27:19.667 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-12T02:27:19.667 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-12T02:27:19.667 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-12T02:27:19.667 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-12T02:27:19.667 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-12T02:27:19.667 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-12T02:27:19.668 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-12T02:27:19.668 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-12T02:27:19.668 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-12T02:27:19.668 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-12T02:27:19.668 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-12T02:27:19.668 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-12T02:27:19.668 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-12T02:27:19.668 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-12T02:27:19.668 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-12T02:27:19.668 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-12T02:27:19.668 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-12T02:27:19.668 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-12T02:27:19.668 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-12T02:27:19.669 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-12T02:27:19.669 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-12T02:27:19.669 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-12T02:27:19.669 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-12T02:27:19.669 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-12T02:27:19.669 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-12T02:27:19.669 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-12T02:27:19.669 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-12T02:27:19.669 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-12T02:27:19.669 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-12T02:27:19.669 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-12T02:27:19.669 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-12T02:27:19.669 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-12T02:27:19.670 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-12T02:27:19.670 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-12T02:27:19.670 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-12T02:27:19.670 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-12T02:27:19.670 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-12T02:27:19.670 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-12T02:27:19.670 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-12T02:27:19.670 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-12T02:27:19.670 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-12T02:27:19.670 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-12T02:27:19.670 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-12T02:27:19.670 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-12T02:27:19.670 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-12T02:27:19.670 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-12T02:27:19.671 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-12T02:27:19.671 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-12T02:27:19.671 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-12T02:27:19.671 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-12T02:27:19.671 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-12T02:27:19.671 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-12T02:27:19.671 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-12T02:27:19.671 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-12T02:27:19.671 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-12T02:27:19.671 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-12T02:27:19.671 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-12T02:27:19.671 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-12T02:27:19.671 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-12T02:27:19.672 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-12T02:27:19.672 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-12T02:27:19.672 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-12T02:27:19.672 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-12T02:27:19.672 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-12T02:27:19.672 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-12T02:27:19.672 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-12T02:27:19.672 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-12T02:27:19.672 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-12T02:27:19.672 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-12T02:27:19.672 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-12T02:27:19.672 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-12T02:27:19.672 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-12T02:27:19.672 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-12T02:27:19.673 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-12T02:27:19.673 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-12T02:27:19.673 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-12T02:27:19.673 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-12T02:27:19.673 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-12T02:27:19.673 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-12T02:27:19.673 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-12T02:27:19.673 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-12T02:27:19.673 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-12T02:27:19.673 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-12T02:27:19.673 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-12T02:27:19.673 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-12T02:27:19.673 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-12T02:27:19.674 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-12T02:27:19.674 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-12T02:27:19.674 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-12T02:27:19.674 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-12T02:27:19.674 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-12T02:27:19.674 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-12T02:27:19.674 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-12T02:27:19.674 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-12T02:27:19.674 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-12T02:27:19.674 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-12T02:27:19.674 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-12T02:27:19.674 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-12T02:27:19.674 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-12T02:27:19.675 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-12T02:27:19.675 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-12T02:27:19.675 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-12T02:27:19.675 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-12T02:27:19.675 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-12T02:27:19.675 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-12T02:27:19.675 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-12T02:27:19.675 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-12T02:27:19.675 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-12T02:27:19.675 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-12T02:27:19.675 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-12T02:27:19.675 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-12T02:27:19.675 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-12T02:27:19.675 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-12T02:27:19.676 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-12T02:27:19.676 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-12T02:27:19.676 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-12T02:27:19.676 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-12T02:27:19.676 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-12T02:27:19.676 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-12T02:27:19.676 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-12T02:27:19.676 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-12T02:27:19.676 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-12T02:27:19.676 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-12T02:27:19.676 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-12T02:27:19.676 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-12T02:27:19.676 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-12T02:27:19.677 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-12T02:27:19.677 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-12T02:27:19.677 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-12T02:27:19.677 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-12T02:27:19.677 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-12T02:27:19.677 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-12T02:27:19.677 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-12T02:27:19.677 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-12T02:27:19.677 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-12T02:27:19.677 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-12T02:27:19.677 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-12T02:27:19.677 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-12T02:27:19.677 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-12T02:27:19.678 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-12T02:27:19.678 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-12T02:27:19.678 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-12T02:27:19.678 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-12T02:27:19.678 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-12T02:27:19.678 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-12T02:27:19.678 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-12T02:27:19.678 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-12T02:27:19.678 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-12T02:27:19.678 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-12T02:27:19.678 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-12T02:27:19.678 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-12T02:27:19.678 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-12T02:27:19.679 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-12T02:27:19.679 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-12T02:27:19.679 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-12T02:27:19.679 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-12T02:27:19.679 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-12T02:27:19.679 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-12T02:27:19.679 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-12T02:27:19.679 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-12T02:27:19.679 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-12T02:27:19.679 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-12T02:27:19.679 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-12T02:27:19.679 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-12T02:27:19.679 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-12T02:27:19.679 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-12T02:27:19.680 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-12T02:27:19.680 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-12T02:27:19.680 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-12T02:27:19.680 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-12T02:27:19.680 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-12T02:27:19.680 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-12T02:27:19.680 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-12T02:27:19.680 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-12T02:27:19.680 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-12T02:27:19.680 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-12T02:27:19.680 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-12T02:27:19.680 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-12T02:27:19.680 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-12T02:27:19.681 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-12T02:27:19.681 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-12T02:27:19.681 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-12T02:27:19.681 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-12T02:27:19.681 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-12T02:27:19.681 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-12T02:27:19.681 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-12T02:27:19.681 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-12T02:27:19.681 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-12T02:27:19.681 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-12T02:27:19.681 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-12T02:27:19.681 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-12T02:27:19.681 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-12T02:27:19.682 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-12T02:27:19.682 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-12T02:27:19.682 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-12T02:27:19.682 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-12T02:27:19.682 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-12T02:27:19.682 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-12T02:27:19.682 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-12T02:27:19.682 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-12T02:27:19.682 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-12T02:27:19.682 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-12T02:27:19.682 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-12T02:27:19.682 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-12T02:27:19.682 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-12T02:27:19.683 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-12T02:27:19.683 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-12T02:27:19.683 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-12T02:27:19.683 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-12T02:27:19.683 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-12T02:27:19.683 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-12T02:27:19.683 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-12T02:27:19.683 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-12T02:27:19.683 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-12T02:27:19.683 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-12T02:27:19.683 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-12T02:27:19.683 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-12T02:27:19.683 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-12T02:27:19.684 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-12T02:27:19.684 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-12T02:27:19.684 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-12T02:27:19.684 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-12T02:27:19.684 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-12T02:27:19.684 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-12T02:27:19.684 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-12T02:27:19.684 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-12T02:27:19.684 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-12T02:27:19.684 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-12T02:27:19.684 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-12T02:27:19.684 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-12T02:27:19.684 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-12T02:27:19.684 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-12T02:27:19.684 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-12T02:27:19.685 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-12T02:27:19.685 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-12T02:27:19.685 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-12T02:27:19.685 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-12T02:27:19.685 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-12T02:27:19.685 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-12T02:27:19.685 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-12T02:27:19.685 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-12T02:27:19.685 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-12T02:27:19.685 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-12T02:27:19.685 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-12T02:27:19.685 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-12T02:27:19.686 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-12T02:27:19.686 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-12T02:27:19.686 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-12T02:27:19.686 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-12T02:27:19.686 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-12T02:27:19.686 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-12T02:27:19.686 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-12T02:27:19.686 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-12T02:27:19.686 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-12T02:27:19.686 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-12T02:27:19.686 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-12T02:27:19.686 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-12T02:27:19.686 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-12T02:27:19.686 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-12T02:27:19.687 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-12T02:27:19.687 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-12T02:27:19.687 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-12T02:27:19.687 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-12T02:27:19.687 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-12T02:27:19.687 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-12T02:27:19.687 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-12T02:27:19.687 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-12T02:27:19.687 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-12T02:27:19.687 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-12T02:27:19.687 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-12T02:27:19.687 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-12T02:27:19.687 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-12T02:27:19.687 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-12T02:27:19.688 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-12T02:27:19.688 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-12T02:27:19.688 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-12T02:27:19.688 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-12T02:27:19.688 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-12T02:27:19.688 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-12T02:27:19.688 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-12T02:27:19.688 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-12T02:27:19.688 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-12T02:27:19.688 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-12T02:27:19.688 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-12T02:27:19.688 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-12T02:27:19.688 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-12T02:27:19.688 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-12T02:27:19.689 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-12T02:27:19.689 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-12T02:27:19.689 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-12T02:27:19.689 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-12T02:27:19.689 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-12T02:27:19.689 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-12T02:27:19.689 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-12T02:27:19.689 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-12T02:27:19.689 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-12T02:27:19.689 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-12T02:27:19.689 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-12T02:27:19.689 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-12T02:27:19.689 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-12T02:27:19.690 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-12T02:27:19.690 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-12T02:27:19.690 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-12T02:27:19.690 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-12T02:27:19.690 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-12T02:27:19.690 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-12T02:27:19.690 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-12T02:27:19.690 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-12T02:27:19.690 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-12T02:27:19.690 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-12T02:27:19.690 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-12T02:27:19.690 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-12T02:27:19.690 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-12T02:27:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-12T02:27:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-12T02:27:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-12T02:27:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-12T02:27:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-12T02:27:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-12T02:27:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-12T02:27:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-12T02:27:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-12T02:27:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-12T02:27:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-12T02:27:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-12T02:27:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-12T02:27:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-12T02:27:19.692 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-12T02:27:19.692 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-12T02:27:19.692 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-12T02:27:19.692 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-12T02:27:19.692 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-12T02:27:19.692 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-12T02:27:19.692 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-12T02:27:19.692 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-12T02:27:19.692 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-12T02:27:19.692 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-12T02:27:19.692 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-12T02:27:19.692 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-12T02:27:19.692 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-12T02:27:19.693 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-12T02:27:19.693 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-12T02:27:19.693 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-12T02:27:19.693 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-12T02:27:19.693 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-12T02:27:19.693 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-12T02:27:19.693 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-12T02:27:19.693 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-12T02:27:19.693 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-12T02:27:19.693 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-12T02:27:19.693 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-12T02:27:19.693 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-12T02:27:19.693 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-12T02:27:19.693 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-12T02:27:19.694 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-12T02:27:19.694 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-12T02:27:19.694 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-12T02:27:19.694 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-12T02:27:19.694 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-12T02:27:19.694 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-12T02:27:19.694 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-12T02:27:19.694 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-12T02:27:19.694 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-12T02:27:19.694 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-12T02:27:19.694 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-12T02:27:19.694 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-12T02:27:19.694 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-12T02:27:19.694 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-12T02:27:19.695 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-12T02:27:19.695 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-12T02:27:19.695 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-12T02:27:19.695 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-12T02:27:19.695 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-12T02:27:19.695 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-12T02:27:19.695 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-12T02:27:19.695 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-12T02:27:19.695 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-12T02:27:19.695 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-12T02:27:19.695 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-12T02:27:19.695 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-12T02:27:19.695 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-12T02:27:19.695 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-12T02:27:19.696 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-12T02:27:19.696 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-12T02:27:19.696 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-12T02:27:19.696 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-12T02:27:19.696 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-12T02:27:19.696 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-12T02:27:19.696 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-12T02:27:19.696 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-12T02:27:19.696 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-12T02:27:19.696 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-12T02:27:19.696 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-12T02:27:19.696 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-12T02:27:19.696 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-12T02:27:19.697 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-12T02:27:19.697 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-12T02:27:19.697 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-12T02:27:19.697 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-12T02:27:19.697 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-12T02:27:19.697 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-12T02:27:19.697 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-12T02:27:19.697 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-12T02:27:19.697 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-12T02:27:19.697 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-12T02:27:19.697 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-12T02:27:19.697 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-12T02:27:19.697 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-12T02:27:19.698 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-12T02:27:19.698 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-12T02:27:19.698 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-12T02:27:19.698 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-12T02:27:19.698 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-12T02:27:19.698 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-12T02:27:19.698 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-12T02:27:19.698 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-12T02:27:19.698 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-12T02:27:19.698 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-12T02:27:19.698 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-12T02:27:19.698 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-12T02:27:19.698 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-12T02:27:19.698 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-12T02:27:19.699 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-12T02:27:19.699 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-12T02:27:19.699 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-12T02:27:19.699 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-12T02:27:19.699 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-12T02:27:19.699 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-12T02:27:19.699 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-12T02:27:19.699 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-12T02:27:19.699 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-12T02:27:19.699 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-12T02:27:19.699 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-12T02:27:19.699 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-12T02:27:19.699 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-12T02:27:19.699 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-12T02:27:19.700 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-12T02:27:19.700 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-12T02:27:19.700 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-12T02:27:19.700 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-12T02:27:19.700 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-12T02:27:19.700 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-12T02:27:19.700 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-12T02:27:19.700 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-12T02:27:19.700 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-12T02:27:19.700 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-12T02:27:19.700 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-12T02:27:19.700 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-12T02:27:19.700 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-12T02:27:19.701 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-12T02:27:19.701 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-12T02:27:19.701 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-12T02:27:19.701 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-12T02:27:19.701 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-12T02:27:19.701 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-12T02:27:19.701 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-12T02:27:19.701 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-12T02:27:19.701 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-12T02:27:19.701 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-12T02:27:19.701 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-12T02:27:19.701 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-12T02:27:19.701 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-12T02:27:19.701 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-12T02:27:19.702 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-12T02:27:19.702 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-12T02:27:19.702 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-12T02:27:19.702 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-12T02:27:19.702 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-12T02:27:19.702 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-12T02:27:19.702 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-12T02:27:19.702 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-12T02:27:19.702 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-12T02:27:19.702 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-12T02:27:19.702 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-12T02:27:19.702 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-12T02:27:19.702 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-12T02:27:19.702 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-12T02:27:19.703 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-12T02:27:19.703 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-12T02:27:19.703 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-12T02:27:19.703 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-12T02:27:19.703 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-12T02:27:19.703 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-12T02:27:19.703 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-12T02:27:19.703 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-12T02:27:19.703 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-12T02:27:19.703 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-12T02:27:19.703 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-12T02:27:19.703 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-12T02:27:19.703 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-12T02:27:19.703 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-12T02:27:19.704 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-12T02:27:19.704 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-12T02:27:19.704 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-12T02:27:19.704 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-12T02:27:19.704 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-12T02:27:19.704 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-12T02:27:19.704 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-12T02:27:19.704 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-12T02:27:19.704 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-12T02:27:19.704 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-12T02:27:19.704 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-12T02:27:19.704 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-12T02:27:19.704 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-12T02:27:19.705 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-12T02:27:19.705 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-12T02:27:19.705 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-12T02:27:19.705 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-12T02:27:19.705 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-12T02:27:19.705 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-12T02:27:19.705 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-12T02:27:19.705 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-12T02:27:19.705 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-12T02:27:19.705 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-12T02:27:19.705 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-12T02:27:19.705 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-12T02:27:19.705 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-12T02:27:19.705 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-12T02:27:19.706 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-12T02:27:19.706 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-12T02:27:19.706 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-12T02:27:19.706 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-12T02:27:19.706 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-12T02:27:19.706 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-12T02:27:19.706 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-12T02:27:19.706 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-12T02:27:19.706 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-12T02:27:19.706 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-12T02:27:19.706 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-12T02:27:19.706 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-12T02:27:19.706 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-12T02:27:19.706 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-12T02:27:19.707 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-12T02:27:19.707 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-12T02:27:19.707 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-12T02:27:19.707 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-12T02:27:19.707 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-12T02:27:19.707 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-12T02:27:19.707 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-12T02:27:19.707 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-12T02:27:19.707 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-12T02:27:19.707 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-12T02:27:19.707 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-12T02:27:19.707 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-12T02:27:19.707 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-12T02:27:19.707 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-12T02:27:19.708 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-12T02:27:19.708 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-12T02:27:19.708 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-12T02:27:19.708 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-12T02:27:19.708 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-12T02:27:19.708 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-12T02:27:19.708 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-12T02:27:19.708 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-12T02:27:19.708 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-12T02:27:19.708 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-12T02:27:19.708 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-12T02:27:19.708 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-12T02:27:19.708 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-12T02:27:19.708 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-12T02:27:19.709 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-12T02:27:19.709 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-12T02:27:19.709 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-12T02:27:19.709 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-12T02:27:19.709 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-12T02:27:19.709 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-12T02:27:19.709 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-12T02:27:19.709 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-12T02:27:19.709 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-12T02:27:19.709 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-12T02:27:19.709 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-12T02:27:19.709 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-12T02:27:19.709 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-12T02:27:19.709 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-12T02:27:19.710 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-12T02:27:19.710 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-12T02:27:19.710 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-12T02:27:19.710 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-12T02:27:19.710 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-12T02:27:19.710 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-12T02:27:19.710 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-12T02:27:19.710 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-12T02:27:19.710 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-12T02:27:19.710 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-12T02:27:19.710 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-12T02:27:19.710 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-12T02:27:19.710 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-12T02:27:19.710 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-12T02:27:19.711 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-12T02:27:19.711 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-12T02:27:19.711 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-12T02:27:19.711 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-12T02:27:19.711 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-12T02:27:19.711 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-12T02:27:19.711 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-12T02:27:19.711 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-12T02:27:19.711 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-12T02:27:19.711 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-12T02:27:19.711 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-12T02:27:19.711 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-12T02:27:19.711 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-12T02:27:19.711 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-12T02:27:19.712 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-12T02:27:19.712 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-12T02:27:19.712 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-12T02:27:19.712 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-12T02:27:19.712 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-12T02:27:19.712 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-12T02:27:19.712 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-12T02:27:19.712 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-12T02:27:19.712 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-12T02:27:19.712 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-12T02:27:19.712 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-12T02:27:19.712 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-12T02:27:19.712 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-12T02:27:19.713 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-12T02:27:19.713 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-12T02:27:19.713 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-12T02:27:19.713 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-12T02:27:19.713 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-12T02:27:19.713 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-12T02:27:19.713 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-12T02:27:19.713 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-12T02:27:19.713 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-12T02:27:19.713 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-12T02:27:19.713 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-12T02:27:19.713 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-12T02:27:19.713 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-12T02:27:19.713 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-12T02:27:19.714 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-12T02:27:19.714 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-12T02:27:19.714 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-12T02:27:19.714 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-12T02:27:19.714 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-12T02:27:19.714 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-12T02:27:19.714 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-12T02:27:19.714 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-12T02:27:19.714 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-12T02:27:19.714 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-12T02:27:19.714 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-12T02:27:19.714 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-12T02:27:19.714 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-12T02:27:19.714 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-12T02:27:19.714 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-12T02:27:19.715 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-12T02:27:19.715 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-12T02:27:19.715 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-12T02:27:19.715 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-12T02:27:19.715 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-12T02:27:19.715 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-12T02:27:19.715 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-12T02:27:19.715 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-12T02:27:19.715 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-12T02:27:19.715 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-12T02:27:19.715 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-12T02:27:19.715 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-12T02:27:19.715 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-12T02:27:19.716 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-12T02:27:19.716 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-12T02:27:19.716 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-12T02:27:19.716 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-12T02:27:19.716 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-12T02:27:19.716 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-12T02:27:19.716 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-12T02:27:19.716 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-12T02:27:19.716 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-12T02:27:19.716 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-12T02:27:19.716 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-12T02:27:19.716 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-12T02:27:19.716 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-12T02:27:19.716 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-12T02:27:19.717 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-12T02:27:19.717 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-12T02:27:19.717 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-12T02:27:19.717 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-12T02:27:19.717 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-12T02:27:19.717 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-12T02:27:19.717 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-12T02:27:19.717 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-12T02:27:19.717 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-12T02:27:19.717 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-12T02:27:19.717 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-12T02:27:19.717 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-12T02:27:19.717 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-12T02:27:19.717 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-12T02:27:19.718 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-12T02:27:19.718 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-12T02:27:19.718 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-12T02:27:19.718 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-12T02:27:19.718 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-12T02:27:19.718 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-12T02:27:19.718 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-12T02:27:19.718 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-12T02:27:19.718 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-12T02:27:19.718 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-12T02:27:19.718 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-12T02:27:19.718 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-12T02:27:19.718 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-12T02:27:19.718 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-12T02:27:19.719 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-12T02:27:19.719 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-12T02:27:19.719 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-12T02:27:19.719 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-12T02:27:19.719 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-12T02:27:19.719 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-12T02:27:19.719 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-12T02:27:19.719 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-12T02:27:19.719 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-12T02:27:19.719 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-12T02:27:19.719 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-12T02:27:19.719 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-12T02:27:19.719 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-12T02:27:19.719 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-12T02:27:19.720 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-12T02:27:19.720 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-12T02:27:19.720 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-12T02:27:19.720 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-12T02:27:19.720 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-12T02:27:19.720 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-12T02:27:19.720 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-12T02:27:19.720 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-12T02:27:19.720 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-12T02:27:19.720 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-12T02:27:19.720 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-12T02:27:19.720 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-12T02:27:19.720 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-12T02:27:19.721 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-12T02:27:19.721 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-12T02:27:19.721 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-12T02:27:19.721 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-12T02:27:19.721 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-12T02:27:19.721 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-12T02:27:19.721 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-12T02:27:19.721 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-12T02:27:19.721 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-12T02:27:19.721 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-12T02:27:19.721 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-12T02:27:19.721 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-12T02:27:19.721 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-12T02:27:19.721 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-12T02:27:19.722 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-12T02:27:19.722 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-12T02:27:19.722 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-12T02:27:19.722 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-12T02:27:19.722 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-12T02:27:19.722 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-12T02:27:19.722 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-12T02:27:19.722 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-12T02:27:19.722 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-12T02:27:19.722 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-12T02:27:19.722 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-12T02:27:19.722 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-12T02:27:19.722 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-12T02:27:19.722 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-12T02:27:19.723 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-12T02:27:19.723 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-12T02:27:19.723 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-12T02:27:19.723 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-12T02:27:19.723 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-12T02:27:19.723 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-12T02:27:19.723 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-12T02:27:19.723 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-12T02:27:19.723 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-12T02:27:19.723 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-12T02:27:19.723 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-12T02:27:19.723 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-12T02:27:19.723 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-12T02:27:19.723 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-12T02:27:19.724 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-12T02:27:19.724 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-12T02:27:19.724 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-12T02:27:19.724 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-12T02:27:19.724 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-12T02:27:19.724 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-12T02:27:19.724 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-12T02:27:19.724 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-12T02:27:19.724 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-12T02:27:19.725 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-12T02:27:19.725 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-12T02:27:19.725 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-12T02:27:19.725 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-12T02:27:19.725 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-12T02:27:19.725 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-12T02:27:19.725 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-12T02:27:19.725 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-12T02:27:19.725 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-12T02:27:19.725 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-12T02:27:19.725 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-12T02:27:19.725 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-12T02:27:19.725 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-12T02:27:19.726 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-12T02:27:19.726 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-12T02:27:19.726 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-12T02:27:19.726 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-12T02:27:19.726 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-12T02:27:19.726 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-12T02:27:19.726 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-12T02:27:19.726 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-12T02:27:19.726 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-12T02:27:19.726 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-12T02:27:19.726 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-12T02:27:19.726 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-12T02:27:19.726 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-12T02:27:19.726 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-12T02:27:19.726 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-12T02:27:19.727 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-12T02:27:19.727 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-12T02:27:19.727 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-12T02:27:19.727 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-12T02:27:19.727 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-12T02:27:19.727 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-12T02:27:19.727 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-12T02:27:19.727 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-12T02:27:19.727 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-12T02:27:19.727 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-12T02:27:19.727 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-12T02:27:19.727 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-12T02:27:19.727 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-12T02:27:19.728 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-12T02:27:19.728 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-12T02:27:19.728 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-12T02:27:19.728 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-12T02:27:19.728 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-12T02:27:19.728 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-12T02:27:19.728 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-12T02:27:19.728 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-12T02:27:19.728 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-12T02:27:19.728 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-12T02:27:19.728 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-12T02:27:19.728 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-12T02:27:19.728 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-12T02:27:19.729 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-12T02:27:19.729 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-12T02:27:19.729 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-12T02:27:19.729 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-12T02:27:19.729 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-12T02:27:19.729 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-12T02:27:19.729 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-12T02:27:19.729 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-12T02:27:19.729 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-12T02:27:19.729 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-12T02:27:19.729 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-12T02:27:19.729 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-12T02:27:19.730 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-12T02:27:19.730 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-12T02:27:19.730 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-12T02:27:19.730 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-12T02:27:19.730 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-12T02:27:19.730 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-12T02:27:19.730 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-12T02:27:19.730 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-12T02:27:19.730 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-12T02:27:19.730 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-12T02:27:19.730 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-12T02:27:19.730 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-12T02:27:19.730 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-12T02:27:19.730 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-12T02:27:19.731 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-12T02:27:19.731 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-12T02:27:19.731 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-12T02:27:19.731 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-12T02:27:19.731 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-12T02:27:19.731 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-12T02:27:19.731 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-12T02:27:19.731 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-12T02:27:19.731 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-12T02:27:19.731 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-12T02:27:19.731 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-12T02:27:19.731 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-12T02:27:19.731 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-12T02:27:19.732 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-12T02:27:19.732 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-12T02:27:19.732 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-12T02:27:19.732 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-12T02:27:19.732 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-12T02:27:19.732 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-12T02:27:19.732 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-12T02:27:19.732 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-12T02:27:19.732 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-12T02:27:19.732 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-12T02:27:19.732 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-12T02:27:19.732 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-12T02:27:19.732 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-12T02:27:19.732 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-12T02:27:19.733 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-12T02:27:19.733 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-12T02:27:19.733 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-12T02:27:19.733 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-12T02:27:19.733 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-12T02:27:19.733 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-12T02:27:19.733 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-12T02:27:19.733 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-12T02:27:19.733 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-12T02:27:19.733 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-12T02:27:19.733 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-12T02:27:19.733 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-12T02:27:19.733 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-12T02:27:19.734 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-12T02:27:19.734 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-12T02:27:19.734 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-12T02:27:19.734 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-12T02:27:19.734 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-12T02:27:19.734 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-12T02:27:19.734 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-12T02:27:19.734 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-12T02:27:19.734 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-12T02:27:19.734 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-12T02:27:19.734 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-12T02:27:19.734 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-12T02:27:19.734 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-12T02:27:19.734 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-12T02:27:19.735 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-12T02:27:19.735 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-12T02:27:19.735 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-12T02:27:19.735 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-12T02:27:19.735 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-12T02:27:19.735 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-12T02:27:19.735 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-12T02:27:19.735 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-12T02:27:19.735 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-12T02:27:19.735 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-12T02:27:19.735 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-12T02:27:19.735 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-12T02:27:19.735 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-12T02:27:19.735 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-12T02:27:19.736 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-12T02:27:19.736 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-12T02:27:19.736 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-12T02:27:19.736 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-12T02:27:19.736 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-12T02:27:19.736 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-12T02:27:19.736 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-12T02:27:19.736 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-12T02:27:19.736 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-12T02:27:19.736 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-12T02:27:19.736 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-12T02:27:19.736 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-12T02:27:19.736 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-12T02:27:19.736 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-12T02:27:19.737 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-12T02:27:19.737 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-12T02:27:19.737 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-12T02:27:19.737 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-12T02:27:19.737 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-12T02:27:19.737 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-12T02:27:19.737 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-12T02:27:19.737 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-12T02:27:19.737 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-12T02:27:19.737 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-12T02:27:19.737 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-12T02:27:19.737 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-12T02:27:19.737 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-12T02:27:19.737 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-12T02:27:19.738 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-12T02:27:19.738 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-12T02:27:19.738 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-12T02:27:19.738 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-12T02:27:19.738 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-12T02:27:19.738 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-12T02:27:19.738 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-12T02:27:19.738 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-12T02:27:19.738 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-12T02:27:19.738 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-12T02:27:19.738 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-12T02:27:19.738 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-12T02:27:19.738 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-12T02:27:19.738 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-12T02:27:19.739 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-12T02:27:19.739 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-12T02:27:19.739 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-12T02:27:19.739 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-12T02:27:19.739 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-12T02:27:19.739 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-12T02:27:19.739 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-12T02:27:19.739 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-12T02:27:19.739 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-12T02:27:19.739 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-12T02:27:19.739 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-12T02:27:19.739 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-12T02:27:19.739 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-12T02:27:19.739 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-12T02:27:19.740 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-12T02:27:19.740 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-12T02:27:19.740 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-12T02:27:19.740 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-12T02:27:19.740 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-12T02:27:19.740 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-12T02:27:19.740 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-12T02:27:19.740 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-12T02:27:19.740 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-12T02:27:19.740 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-12T02:27:19.740 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-12T02:27:19.740 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-12T02:27:19.740 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-12T02:27:19.741 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-12T02:27:19.741 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-12T02:27:19.741 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-12T02:27:19.741 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-12T02:27:19.741 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-12T02:27:19.741 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-12T02:27:19.741 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-12T02:27:19.741 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-12T02:27:19.741 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-12T02:27:19.741 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-12T02:27:19.741 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-12T02:27:19.741 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-12T02:27:19.741 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-12T02:27:19.741 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-12T02:27:19.742 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-12T02:27:19.742 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-12T02:27:19.742 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-12T02:27:19.742 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-12T02:27:19.742 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-12T02:27:19.742 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-12T02:27:19.742 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-12T02:27:19.742 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-12T02:27:19.742 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-12T02:27:19.742 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-12T02:27:19.742 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-12T02:27:19.742 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-12T02:27:19.742 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-12T02:27:19.743 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-12T02:27:19.743 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-12T02:27:19.743 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-12T02:27:19.743 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-12T02:27:19.743 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-12T02:27:19.743 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-12T02:27:19.743 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-12T02:27:19.743 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-12T02:27:19.743 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-12T02:27:19.743 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-12T02:27:19.743 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-12T02:27:19.743 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-12T02:27:19.743 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-12T02:27:19.743 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-12T02:27:19.744 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-12T02:27:19.744 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-12T02:27:19.744 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-12T02:27:19.744 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-12T02:27:19.744 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-12T02:27:19.744 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-12T02:27:19.744 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-12T02:27:19.744 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-12T02:27:19.744 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-12T02:27:19.744 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-12T02:27:19.744 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-12T02:27:19.744 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-12T02:27:19.744 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-12T02:27:19.745 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-12T02:27:19.745 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-12T02:27:19.745 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-12T02:27:19.745 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-12T02:27:19.745 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-12T02:27:19.745 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-12T02:27:19.745 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-12T02:27:19.745 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-12T02:27:19.745 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-12T02:27:19.745 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-12T02:27:19.745 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-12T02:27:19.745 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-12T02:27:19.745 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-12T02:27:19.745 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-12T02:27:19.746 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-12T02:27:19.746 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-12T02:27:19.746 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-12T02:27:19.746 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-12T02:27:19.746 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-12T02:27:19.746 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-12T02:27:19.746 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-12T02:27:19.746 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-12T02:27:19.746 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-12T02:27:19.746 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-12T02:27:19.746 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-12T02:27:19.746 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-12T02:27:19.746 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-12T02:27:19.747 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-12T02:27:19.747 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-12T02:27:19.747 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-12T02:27:19.747 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-12T02:27:19.747 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-12T02:27:19.747 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-12T02:27:19.747 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-12T02:27:19.747 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-12T02:27:19.747 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-12T02:27:19.747 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-12T02:27:19.747 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-12T02:27:19.747 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-12T02:27:19.747 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-12T02:27:19.747 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-12T02:27:19.748 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-12T02:27:19.748 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-12T02:27:19.748 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-12T02:27:19.748 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-12T02:27:19.748 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-12T02:27:19.748 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-12T02:27:19.748 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-12T02:27:19.748 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-12T02:27:19.748 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-12T02:27:19.748 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-12T02:27:19.748 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-12T02:27:19.748 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-12T02:27:19.748 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-12T02:27:19.748 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-12T02:27:19.749 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-12T02:27:19.749 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-12T02:27:19.749 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-12T02:27:19.749 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-12T02:27:19.749 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-12T02:27:19.749 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-12T02:27:19.749 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-12T02:27:19.749 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-12T02:27:19.750 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-12T02:27:19.750 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-12T02:27:19.750 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-12T02:27:19.750 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-12T02:27:19.750 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-12T02:27:19.750 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-12T02:27:19.750 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-12T02:27:19.750 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-12T02:27:19.750 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-12T02:27:19.750 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-12T02:27:19.750 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-12T02:27:19.750 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-12T02:27:19.750 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-12T02:27:19.751 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-12T02:27:19.751 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-12T02:27:19.751 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-12T02:27:19.751 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-12T02:27:19.751 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-12T02:27:19.751 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-12T02:27:19.751 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-12T02:27:19.751 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-12T02:27:19.751 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-12T02:27:19.751 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-12T02:27:19.751 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-12T02:27:19.751 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-12T02:27:19.752 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-12T02:27:19.752 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-12T02:27:19.752 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-12T02:27:19.752 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-12T02:27:19.752 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-12T02:27:19.752 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-12T02:27:19.752 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-12T02:27:19.752 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-12T02:27:19.752 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-12T02:27:19.752 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-12T02:27:19.752 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-12T02:27:19.753 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-12T02:27:19.753 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-12T02:27:19.753 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-12T02:27:19.753 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-12T02:27:19.753 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-12T02:27:19.753 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-12T02:27:19.753 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-12T02:27:19.753 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-12T02:27:19.753 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-12T02:27:19.753 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-12T02:27:19.753 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-12T02:27:19.753 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-12T02:27:19.754 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-12T02:27:19.754 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-12T02:27:19.754 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-12T02:27:19.754 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-12T02:27:19.754 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-12T02:27:19.754 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-12T02:27:19.754 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-12T02:27:19.754 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-12T02:27:19.754 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-12T02:27:19.754 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-12T02:27:19.754 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-12T02:27:19.754 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-12T02:27:19.755 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-12T02:27:19.755 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-12T02:27:19.755 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-12T02:27:19.755 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-12T02:27:19.755 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-12T02:27:19.755 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-12T02:27:19.755 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-12T02:27:19.755 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-12T02:27:19.755 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-12T02:27:19.755 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-12T02:27:19.756 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-12T02:27:19.756 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-12T02:27:19.756 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-12T02:27:19.756 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-12T02:27:19.756 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-12T02:27:19.756 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-12T02:27:19.756 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-12T02:27:19.756 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-12T02:27:19.756 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-12T02:27:19.756 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-12T02:27:19.756 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-12T02:27:19.756 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-12T02:27:19.757 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-12T02:27:19.757 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-12T02:27:19.757 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-12T02:27:19.757 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-12T02:27:19.757 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-12T02:27:19.757 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-12T02:27:19.757 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-12T02:27:19.757 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-12T02:27:19.757 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-12T02:27:19.757 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-12T02:27:19.757 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-12T02:27:19.757 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-12T02:27:19.758 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-12T02:27:19.758 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-12T02:27:19.758 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-12T02:27:19.758 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-12T02:27:19.758 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-12T02:27:19.758 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-12T02:27:19.758 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-12T02:27:19.758 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-12T02:27:19.758 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-12T02:27:19.758 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-12T02:27:19.758 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-12T02:27:19.758 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-12T02:27:19.759 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-12T02:27:19.759 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-12T02:27:19.759 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-12T02:27:19.759 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-12T02:27:19.759 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-12T02:27:19.759 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-12T02:27:19.759 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-12T02:27:19.759 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-12T02:27:19.759 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-12T02:27:19.759 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-12T02:27:19.759 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-12T02:27:19.759 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-12T02:27:19.759 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-12T02:27:19.759 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-12T02:27:19.760 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-12T02:27:19.760 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-12T02:27:19.760 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-12T02:27:19.760 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-12T02:27:19.760 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-12T02:27:19.760 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-12T02:27:19.760 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-12T02:27:19.760 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-12T02:27:19.760 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-12T02:27:19.760 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-12T02:27:19.760 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-12T02:27:19.760 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-12T02:27:19.761 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-12T02:27:19.761 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-12T02:27:19.761 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-12T02:27:19.761 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-12T02:27:19.761 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-12T02:27:19.761 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-12T02:27:19.761 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-12T02:27:19.761 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-12T02:27:19.761 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-12T02:27:19.761 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-12T02:27:19.761 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-12T02:27:19.761 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-12T02:27:19.761 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-12T02:27:19.762 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-12T02:27:19.762 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-12T02:27:19.762 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-12T02:27:19.762 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-12T02:27:19.762 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-12T02:27:19.762 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-12T02:27:19.762 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-12T02:27:19.762 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-12T02:27:19.762 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-12T02:27:19.762 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-12T02:27:19.762 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-12T02:27:19.762 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-12T02:27:19.762 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-12T02:27:19.763 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-12T02:27:19.763 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-12T02:27:19.763 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-12T02:27:19.763 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-12T02:27:19.763 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-12T02:27:19.763 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-12T02:27:19.763 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-12T02:27:19.763 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-12T02:27:19.763 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-12T02:27:19.763 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-12T02:27:19.763 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-12T02:27:19.763 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-12T02:27:19.763 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-12T02:27:19.763 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-12T02:27:19.764 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-12T02:27:19.764 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-12T02:27:19.764 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-12T02:27:19.764 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-12T02:27:19.764 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-12T02:27:19.764 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-12T02:27:19.764 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-12T02:27:19.764 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-12T02:27:19.764 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-12T02:27:19.764 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-12T02:27:19.764 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-12T02:27:19.764 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-12T02:27:19.764 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-12T02:27:19.765 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-12T02:27:19.765 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-12T02:27:19.765 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-12T02:27:19.765 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-12T02:27:19.765 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-12T02:27:19.765 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-12T02:27:19.765 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-12T02:27:19.765 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-12T02:27:19.765 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-12T02:27:19.765 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-12T02:27:19.765 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-12T02:27:19.765 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-12T02:27:19.765 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-12T02:27:19.766 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-12T02:27:19.766 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-12T02:27:19.766 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-12T02:27:19.766 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-12T02:27:19.766 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-12T02:27:19.766 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-12T02:27:19.766 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-12T02:27:19.766 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-12T02:27:19.766 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-12T02:27:19.766 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-12T02:27:19.766 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-12T02:27:19.766 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-12T02:27:19.767 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-12T02:27:19.767 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-12T02:27:19.767 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-12T02:27:19.767 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-12T02:27:19.767 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-12T02:27:19.767 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-12T02:27:19.767 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-12T02:27:19.767 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-12T02:27:19.767 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-12T02:27:19.767 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-12T02:27:19.767 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-12T02:27:19.767 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-12T02:27:19.767 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-12T02:27:19.768 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-12T02:27:19.768 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-12T02:27:19.768 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-12T02:27:19.768 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-12T02:27:19.768 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-12T02:27:19.768 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-12T02:27:19.768 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-12T02:27:19.768 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-12T02:27:19.768 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-12T02:27:19.768 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-12T02:27:19.768 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-12T02:27:19.768 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-12T02:27:19.768 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-12T02:27:19.769 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-12T02:27:19.769 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-12T02:27:19.769 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-12T02:27:19.769 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-12T02:27:19.769 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-12T02:27:19.769 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-12T02:27:19.769 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-12T02:27:19.769 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-12T02:27:19.769 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-12T02:27:19.769 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-12T02:27:19.769 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-12T02:27:19.769 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-12T02:27:19.769 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-12T02:27:19.770 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-12T02:27:19.770 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-12T02:27:19.770 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-12T02:27:19.770 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-12T02:27:19.770 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-12T02:27:19.770 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-12T02:27:19.770 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-12T02:27:19.770 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-12T02:27:19.770 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-12T02:27:19.770 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-12T02:27:19.770 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-12T02:27:19.770 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-12T02:27:19.770 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-12T02:27:19.771 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-12T02:27:19.771 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-12T02:27:19.771 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-12T02:27:19.771 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-12T02:27:19.771 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-12T02:27:19.771 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-12T02:27:19.771 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-12T02:27:19.771 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-12T02:27:19.771 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-12T02:27:19.771 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-12T02:27:19.771 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-12T02:27:19.771 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-12T02:27:19.771 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-12T02:27:19.772 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-12T02:27:19.772 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-12T02:27:19.772 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-12T02:27:19.772 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-12T02:27:19.772 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-12T02:27:19.772 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-12T02:27:19.772 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-12T02:27:19.772 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-12T02:27:19.772 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-12T02:27:19.772 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-12T02:27:19.772 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-12T02:27:19.772 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-12T02:27:19.772 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-12T02:27:19.773 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-12T02:27:19.773 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-12T02:27:19.773 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-12T02:27:19.773 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-12T02:27:19.773 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-12T02:27:19.773 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-12T02:27:19.773 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-12T02:27:19.773 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-12T02:27:19.773 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-12T02:27:19.773 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-12T02:27:19.773 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-12T02:27:19.773 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-12T02:27:19.773 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-12T02:27:19.774 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-12T02:27:19.774 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-12T02:27:19.774 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-12T02:27:19.774 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-12T02:27:19.774 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-12T02:27:19.774 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-12T02:27:19.774 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-12T02:27:19.774 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-12T02:27:19.774 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-12T02:27:19.774 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-12T02:27:19.774 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-12T02:27:19.774 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-12T02:27:19.774 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-12T02:27:19.775 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-12T02:27:19.775 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-12T02:27:19.775 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-12T02:27:19.775 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-12T02:27:19.775 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-12T02:27:19.775 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-12T02:27:19.775 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-12T02:27:19.775 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-12T02:27:19.775 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-12T02:27:19.775 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-12T02:27:19.775 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-12T02:27:19.775 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-12T02:27:19.776 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-12T02:27:19.776 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-12T02:27:19.776 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-12T02:27:19.776 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-12T02:27:19.776 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-12T02:27:19.776 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-12T02:27:19.776 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-12T02:27:19.776 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-12T02:27:19.776 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-12T02:27:19.776 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-12T02:27:19.776 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-12T02:27:19.776 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-12T02:27:19.777 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-12T02:27:19.777 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-12T02:27:19.777 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-12T02:27:19.777 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-12T02:27:19.777 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-12T02:27:19.777 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-12T02:27:19.777 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-12T02:27:19.777 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-12T02:27:19.777 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-12T02:27:19.777 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-12T02:27:19.777 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-12T02:27:19.777 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-12T02:27:19.777 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-12T02:27:19.778 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-12T02:27:19.778 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-12T02:27:19.778 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-12T02:27:19.778 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-12T02:27:19.778 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-12T02:27:19.778 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-12T02:27:19.778 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-12T02:27:19.778 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-12T02:27:19.778 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-12T02:27:19.778 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-12T02:27:19.778 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-12T02:27:19.778 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-12T02:27:19.779 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-12T02:27:19.779 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-12T02:27:19.779 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-12T02:27:19.779 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-12T02:27:19.779 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-12T02:27:19.779 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-12T02:27:19.779 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-12T02:27:19.779 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-12T02:27:19.779 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-12T02:27:19.779 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-12T02:27:19.779 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-12T02:27:19.783 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:27:19.783 DEBUG:teuthology.orchestra.run.smithi018:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-12T02:27:19.806 INFO:teuthology.orchestra.run.smithi018.stdout:postinstall scriptlet (using /bin/sh): 2024-09-12T02:27:19.806 INFO:teuthology.orchestra.run.smithi018.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-12T02:27:19.807 INFO:teuthology.orchestra.run.smithi018.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-12T02:27:19.807 INFO:teuthology.orchestra.run.smithi018.stdout:fi 2024-09-12T02:27:19.807 INFO:teuthology.orchestra.run.smithi018.stdout:for file in vmlinuz System.map config; do 2024-09-12T02:27:19.807 INFO:teuthology.orchestra.run.smithi018.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-12T02:27:19.807 INFO:teuthology.orchestra.run.smithi018.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T02:27:19.807 INFO:teuthology.orchestra.run.smithi018.stdout: fi 2024-09-12T02:27:19.807 INFO:teuthology.orchestra.run.smithi018.stdout:done 2024-09-12T02:27:19.807 INFO:teuthology.orchestra.run.smithi018.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-12T02:27:19.807 INFO:teuthology.orchestra.run.smithi018.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-12T02:27:19.807 INFO:teuthology.orchestra.run.smithi018.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T02:27:19.807 INFO:teuthology.orchestra.run.smithi018.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T02:27:19.808 INFO:teuthology.orchestra.run.smithi018.stdout:fi 2024-09-12T02:27:19.808 INFO:teuthology.orchestra.run.smithi018.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-12T02:27:19.808 INFO:teuthology.orchestra.run.smithi018.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:27:19.808 INFO:teuthology.orchestra.run.smithi018.stdout:fi 2024-09-12T02:27:19.808 INFO:teuthology.orchestra.run.smithi018.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-12T02:27:19.808 INFO:teuthology.orchestra.run.smithi018.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-12T02:27:19.808 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:27:19.808 INFO:teuthology.orchestra.run.smithi018.stdout:fi 2024-09-12T02:27:19.809 DEBUG:teuthology.orchestra.run.smithi018:> sudo rpm -qi grub2-tools 2024-09-12T02:27:19.881 INFO:teuthology.orchestra.run.smithi018.stdout:Name : grub2-tools 2024-09-12T02:27:19.881 INFO:teuthology.orchestra.run.smithi018.stdout:Epoch : 1 2024-09-12T02:27:19.881 INFO:teuthology.orchestra.run.smithi018.stdout:Version : 2.06 2024-09-12T02:27:19.881 INFO:teuthology.orchestra.run.smithi018.stdout:Release : 82.el9 2024-09-12T02:27:19.882 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: x86_64 2024-09-12T02:27:19.882 INFO:teuthology.orchestra.run.smithi018.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T02:27:19.882 INFO:teuthology.orchestra.run.smithi018.stdout:Group : Unspecified 2024-09-12T02:27:19.882 INFO:teuthology.orchestra.run.smithi018.stdout:Size : 8274670 2024-09-12T02:27:19.882 INFO:teuthology.orchestra.run.smithi018.stdout:License : GPLv3+ 2024-09-12T02:27:19.882 INFO:teuthology.orchestra.run.smithi018.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T02:27:19.882 INFO:teuthology.orchestra.run.smithi018.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T02:27:19.882 INFO:teuthology.orchestra.run.smithi018.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T02:27:19.882 INFO:teuthology.orchestra.run.smithi018.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T02:27:19.882 INFO:teuthology.orchestra.run.smithi018.stdout:Packager : builder@centos.org 2024-09-12T02:27:19.882 INFO:teuthology.orchestra.run.smithi018.stdout:Vendor : CentOS 2024-09-12T02:27:19.883 INFO:teuthology.orchestra.run.smithi018.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T02:27:19.883 INFO:teuthology.orchestra.run.smithi018.stdout:Summary : Support tools for GRUB. 2024-09-12T02:27:19.883 INFO:teuthology.orchestra.run.smithi018.stdout:Description : 2024-09-12T02:27:19.883 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:27:19.883 INFO:teuthology.orchestra.run.smithi018.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T02:27:19.883 INFO:teuthology.orchestra.run.smithi018.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T02:27:19.883 INFO:teuthology.orchestra.run.smithi018.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T02:27:19.883 INFO:teuthology.orchestra.run.smithi018.stdout:hardware devices. 2024-09-12T02:27:19.883 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:27:19.883 INFO:teuthology.orchestra.run.smithi018.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T02:27:19.884 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T02:27:19.884 INFO:teuthology.task.kernel:Updating grub on smithi018 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:27:19.884 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T02:27:20.395 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2024-09-12T02:27:21.783 INFO:teuthology.orchestra.run.smithi018.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T02:27:21.819 INFO:teuthology.orchestra.run.smithi018.stderr:done 2024-09-12T02:27:21.820 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-09-12T02:27:21.836 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.wZXu8TSLXA 2024-09-12T02:27:21.836 DEBUG:teuthology.orchestra.run.smithi018:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wZXu8TSLXA 2024-09-12T02:27:21.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.wZXu8TSLXA 2024-09-12T02:27:22.049 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.wZXu8TSLXA is 6KB 2024-09-12T02:27:22.100 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.wZXu8TSLXA 2024-09-12T02:27:22.115 DEBUG:teuthology.orchestra.run.smithi018:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T02:27:22.177 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T02:27:22.177 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T02:27:22.177 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T02:27:22.177 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-12T02:27:22.179 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:27:22.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo shutdown -r now 2024-09-12T02:27:52.340 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T02:27:52.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-12T02:27:52.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:28:10.685 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-09-12T02:28:19.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-12T02:28:19.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:29:19.690 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T02:29:31.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-12T02:29:31.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:29:32.049 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-12T02:29:32.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-12T02:29:32.513 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-12T02:29:32.513 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-12T02:29:32.547 INFO:teuthology.orchestra.run.smithi018.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:29:32.547 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:29:32.547 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T02:29:32.548 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T02:29:33.549 DEBUG:teuthology.parallel:result is None 2024-09-12T02:29:33.549 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T02:29:33.598 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T02:29:33.598 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:29:33.604 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:29:33.607 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:29:33.636 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T02:29:33.643 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T02:29:33.649 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T02:29:33.649 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:29:33.681 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:29:33.683 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:29:33.785 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T02:29:33.791 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T02:29:33.791 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:29:33.808 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:29:33.809 DEBUG:teuthology.orchestra.run.smithi176:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:29:33.826 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:29:33.826 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:29:33.830 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:29:33.851 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:29:33.908 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:29:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:29:33.926 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:29:33.933 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:29:33.941 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:29:33.961 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:29:33.964 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T02:29:33.971 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T02:29:33.971 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:29:33.976 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:29:33.978 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:29:34.029 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T02:29:34.038 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T02:29:34.038 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:29:34.041 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:29:34.047 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:29:34.072 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:29:34.176 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:29:34.256 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:29:34.319 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:29:34.390 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:29:34.390 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:29:34.445 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:29:34.489 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:29:34.540 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:29:34.625 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:29:34.670 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T02:29:34.670 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:29:34.738 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:29:34.784 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:29:34.844 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:29:34.888 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:29:34.929 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T02:29:34.930 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:29:34.996 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2024-09-12T02:29:35.000 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-09-12T02:29:35.002 DEBUG:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2024-09-12T02:29:35.041 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:29:35.073 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:29:35.075 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:29:35.406 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T02:29:35.413 INFO:teuthology.task.internal:Starting timer... 2024-09-12T02:29:35.413 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T02:29:35.424 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T02:29:35.432 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-12T02:29:35.432 DEBUG:teuthology.orchestra.run.smithi018:> sudo service auditd rotate 2024-09-12T02:29:35.514 INFO:teuthology.orchestra.run.smithi018.stdout:Rotating logs: 2024-09-12T02:29:35.517 DEBUG:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2024-09-12T02:29:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: 2024-09-12T02:29:35.571 DEBUG:teuthology.orchestra.run.smithi176:> sudo service auditd rotate 2024-09-12T02:29:35.618 INFO:teuthology.orchestra.run.smithi176.stdout:Rotating logs: 2024-09-12T02:29:35.620 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T02:29:35.621 DEBUG:teuthology.orchestra.run.smithi018:> /usr/sbin/getenforce 2024-09-12T02:29:35.663 INFO:teuthology.orchestra.run.smithi018.stdout:Permissive 2024-09-12T02:29:35.663 DEBUG:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2024-09-12T02:29:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2024-09-12T02:29:35.686 DEBUG:teuthology.orchestra.run.smithi176:> /usr/sbin/getenforce 2024-09-12T02:29:35.706 INFO:teuthology.orchestra.run.smithi176.stdout:Permissive 2024-09-12T02:29:35.707 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi018.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi062.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi176.front.sepia.ceph.com': 'permissive'} 2024-09-12T02:29:35.707 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:29:35.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:29:35.765 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:29:35.796 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:29:35.797 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:29:35.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:29:35.823 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T02:29:35.823 DEBUG:teuthology.orchestra.run.smithi018:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:29:35.889 DEBUG:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:29:35.926 DEBUG:teuthology.orchestra.run.smithi176:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:29:35.953 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T02:29:35.963 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T02:29:35.966 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T02:29:36.086 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T02:29:36.098 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T02:29:36.099 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi018.front.sepia.ceph.com,smithi062.front.sepia.ceph.com,smithi176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T02:34:17.733 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi176.front.sepia.ceph.com')] 2024-09-12T02:34:17.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-12T02:34:17.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:34:17.825 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-12T02:34:17.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-12T02:34:17.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T02:34:17.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:34:18.021 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-09-12T02:34:18.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T02:34:18.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-12T02:34:18.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:34:18.177 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-09-12T02:34:18.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-12T02:34:18.257 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T02:34:18.269 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T02:34:18.270 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:34:18.270 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:34:18.275 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:34:18.275 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:34:18.277 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:34:18.278 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:34:18.310 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:34:18.326 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:34:18.326 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:34:18.335 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:34:18.340 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:34:18.353 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: ntpd: command not found 2024-09-12T02:34:18.365 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: ntpd: command not found 2024-09-12T02:34:18.365 INFO:teuthology.orchestra.run.smithi062.stdout:506 Cannot talk to daemon 2024-09-12T02:34:18.367 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:34:18.375 INFO:teuthology.orchestra.run.smithi176.stdout:506 Cannot talk to daemon 2024-09-12T02:34:18.380 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:34:18.390 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:34:18.396 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:34:18.403 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:34:18.417 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: ntpd: command not found 2024-09-12T02:34:18.441 INFO:teuthology.orchestra.run.smithi018.stdout:506 Cannot talk to daemon 2024-09-12T02:34:18.457 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:34:18.461 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:34:18.461 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-09-12T02:34:18.461 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:34:18.461 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:34:18.461 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:34:18.461 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:34:18.464 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:34:18.468 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:34:18.468 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-09-12T02:34:18.468 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:34:18.468 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:34:18.468 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:34:18.468 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:34:18.471 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:34:18.501 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:34:18.596 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:34:18.603 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:34:18.603 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-12T02:34:18.603 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:34:18.603 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:34:18.603 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:34:18.604 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:34:18.605 INFO:teuthology.run_tasks:Running task install... 2024-09-12T02:34:18.613 DEBUG:teuthology.task.install:project ceph 2024-09-12T02:34:18.613 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T02:34:18.613 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T02:34:18.613 INFO:teuthology.task.install:Using flavor: default 2024-09-12T02:34:18.619 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T02:34:18.619 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T02:34:18.619 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:34:18.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:34:18.622 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:34:18.622 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:34:18.623 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:34:18.623 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:34:18.776 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:34:18.776 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:34:18.779 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:34:18.780 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:34:18.787 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:34:18.787 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:34:18.887 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:34:18.887 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T02:34:18.887 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:34:18.898 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:34:18.898 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:34:18.898 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:34:18.901 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:34:18.901 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T02:34:18.902 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:34:18.914 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:34:18.914 DEBUG:teuthology.orchestra.run.smithi176:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:34:18.930 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:34:18.930 DEBUG:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:34:18.959 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:34:18.959 DEBUG:teuthology.orchestra.run.smithi018:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:34:18.979 DEBUG:teuthology.orchestra.run.smithi176:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:34:18.999 DEBUG:teuthology.orchestra.run.smithi062:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:34:19.055 DEBUG:teuthology.orchestra.run.smithi176:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:34:19.056 DEBUG:teuthology.orchestra.run.smithi018:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:34:19.078 DEBUG:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:34:19.119 INFO:teuthology.orchestra.run.smithi176.stdout:check_obsoletes = 1 2024-09-12T02:34:19.120 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum clean all 2024-09-12T02:34:19.134 DEBUG:teuthology.orchestra.run.smithi018:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:34:19.143 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2024-09-12T02:34:19.146 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum clean all 2024-09-12T02:34:19.189 INFO:teuthology.orchestra.run.smithi018.stdout:check_obsoletes = 1 2024-09-12T02:34:19.193 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum clean all 2024-09-12T02:34:19.344 INFO:teuthology.orchestra.run.smithi176.stdout:45 files removed 2024-09-12T02:34:19.371 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:34:19.381 INFO:teuthology.orchestra.run.smithi062.stdout:45 files removed 2024-09-12T02:34:19.408 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:34:19.474 INFO:teuthology.orchestra.run.smithi018.stdout:45 files removed 2024-09-12T02:34:19.507 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:34:19.924 INFO:teuthology.orchestra.run.smithi176.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-12T02:34:19.969 INFO:teuthology.orchestra.run.smithi062.stdout:ceph packages for x86_64 303 kB/s | 84 kB 00:00 2024-09-12T02:34:20.224 INFO:teuthology.orchestra.run.smithi176.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-12T02:34:20.230 INFO:teuthology.orchestra.run.smithi018.stdout:ceph packages for x86_64 264 kB/s | 84 kB 00:00 2024-09-12T02:34:20.253 INFO:teuthology.orchestra.run.smithi062.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T02:34:20.491 INFO:teuthology.orchestra.run.smithi176.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-12T02:34:20.520 INFO:teuthology.orchestra.run.smithi062.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-12T02:34:20.557 INFO:teuthology.orchestra.run.smithi018.stdout:ceph noarch packages 42 kB/s | 12 kB 00:00 2024-09-12T02:34:20.840 INFO:teuthology.orchestra.run.smithi018.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-12T02:34:21.188 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-12T02:34:21.616 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-12T02:34:22.333 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-09-12T02:34:24.430 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 20 MB 00:02 2024-09-12T02:34:27.366 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-12T02:34:31.180 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.5 MB 00:02 2024-09-12T02:34:32.051 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-12T02:34:32.808 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 19 kB 00:00 2024-09-12T02:34:33.660 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-12T02:34:33.852 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-12T02:34:34.614 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T02:34:39.741 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T02:34:40.190 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:16 2024-09-12T02:34:41.161 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-12T02:34:42.119 INFO:teuthology.orchestra.run.smithi062.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:34:42.120 INFO:teuthology.orchestra.run.smithi062.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:34:42.133 INFO:teuthology.orchestra.run.smithi062.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:34:42.133 INFO:teuthology.orchestra.run.smithi062.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:34:42.134 INFO:teuthology.orchestra.run.smithi062.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:34:42.135 INFO:teuthology.orchestra.run.smithi062.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:34:42.137 INFO:teuthology.orchestra.run.smithi062.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:34:42.140 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:34:42.140 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:34:42.209 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-09-12T02:34:42.236 INFO:teuthology.orchestra.run.smithi062.stdout:====================================================================================== 2024-09-12T02:34:42.236 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-09-12T02:34:42.236 INFO:teuthology.orchestra.run.smithi062.stdout:====================================================================================== 2024-09-12T02:34:42.236 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-09-12T02:34:42.236 INFO:teuthology.orchestra.run.smithi062.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:34:42.236 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:34:42.236 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:34:42.236 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:34:42.236 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:34:42.236 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:34:42.237 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:34:42.237 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:34:42.237 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:34:42.237 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:34:42.237 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:34:42.237 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:34:42.237 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:34:42.237 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:34:42.237 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:34:42.237 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:34:42.237 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:34:42.237 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:34:42.238 INFO:teuthology.orchestra.run.smithi062.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:34:42.238 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:34:42.238 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:34:42.238 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:34:42.238 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:34:42.238 INFO:teuthology.orchestra.run.smithi062.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:34:42.238 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:34:42.238 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:34:42.238 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:34:42.238 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:34:42.238 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:34:42.238 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:34:42.238 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:34:42.239 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:34:42.239 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:34:42.239 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:34:42.239 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:34:42.239 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:34:42.239 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:34:42.239 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2024-09-12T02:34:42.239 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:34:42.239 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:34:42.239 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:34:42.239 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:34:42.239 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:34:42.239 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:34:42.240 INFO:teuthology.orchestra.run.smithi062.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:34:42.240 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:34:42.240 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-09-12T02:34:42.240 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:34:42.240 INFO:teuthology.orchestra.run.smithi062.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:34:42.240 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:34:42.240 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:34:42.240 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:34:42.240 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:34:42.240 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:34:42.240 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:34:42.240 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:34:42.240 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:34:42.241 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:34:42.241 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:34:42.241 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:34:42.241 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:34:42.241 INFO:teuthology.orchestra.run.smithi062.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:34:42.241 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:34:42.241 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:34:42.241 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:34:42.241 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:34:42.241 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:34:42.241 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:34:42.241 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:34:42.241 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:34:42.242 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:34:42.242 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:34:42.242 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:34:42.242 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:34:42.242 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:34:42.242 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:34:42.242 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:34:42.242 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:34:42.242 INFO:teuthology.orchestra.run.smithi062.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:34:42.242 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:34:42.242 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:34:42.242 INFO:teuthology.orchestra.run.smithi062.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:34:42.242 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:34:42.242 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:34:42.243 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:34:42.243 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:34:42.243 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:34:42.243 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:34:42.243 INFO:teuthology.orchestra.run.smithi062.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:34:42.243 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:34:42.243 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:34:42.243 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:34:42.243 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:34:42.243 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:34:42.243 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:34:42.244 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:34:42.244 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:34:42.244 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:34:42.244 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:34:42.244 INFO:teuthology.orchestra.run.smithi062.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:34:42.244 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:34:42.244 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:34:42.244 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:34:42.244 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:34:42.244 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:34:42.244 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:34:42.244 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:34:42.244 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:34:42.245 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:34:42.245 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:34:42.245 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:34:42.245 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:34:42.245 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:34:42.245 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:34:42.245 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:34:42.245 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:34:42.245 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:34:42.245 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:34:42.245 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:34:42.245 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:34:42.245 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:34:42.246 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:34:42.246 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:34:42.246 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:34:42.246 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:34:42.246 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:34:42.246 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:34:42.246 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:34:42.246 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:34:42.246 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:34:42.246 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:34:42.246 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:34:42.246 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:34:42.246 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:34:42.246 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:34:42.247 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:34:42.247 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:34:42.247 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:34:42.247 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:34:42.247 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:34:42.247 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:34:42.247 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:34:42.247 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:34:42.247 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:34:42.247 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:34:42.247 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:34:42.247 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:34:42.247 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:34:42.248 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:34:42.248 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:34:42.248 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:34:42.248 INFO:teuthology.orchestra.run.smithi062.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:34:42.248 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:34:42.248 INFO:teuthology.orchestra.run.smithi062.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:34:42.248 INFO:teuthology.orchestra.run.smithi062.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:34:42.248 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:34:42.248 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:34:42.248 INFO:teuthology.orchestra.run.smithi062.stdout:Installing weak dependencies: 2024-09-12T02:34:42.248 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:34:42.248 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:34:42.248 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-09-12T02:34:42.249 INFO:teuthology.orchestra.run.smithi062.stdout:====================================================================================== 2024-09-12T02:34:42.249 INFO:teuthology.orchestra.run.smithi062.stdout:Install 148 Packages 2024-09-12T02:34:42.249 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 8 Packages 2024-09-12T02:34:42.249 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:34:42.249 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 226 M 2024-09-12T02:34:42.249 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-09-12T02:34:43.326 INFO:teuthology.orchestra.run.smithi062.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-12T02:34:43.526 INFO:teuthology.orchestra.run.smithi062.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.4 MB/s | 897 kB 00:00 2024-09-12T02:34:43.651 INFO:teuthology.orchestra.run.smithi062.stdout:(3/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-12T02:34:43.676 INFO:teuthology.orchestra.run.smithi062.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 966 kB/s | 145 kB 00:00 2024-09-12T02:34:43.733 INFO:teuthology.orchestra.run.smithi018.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:34:43.734 INFO:teuthology.orchestra.run.smithi018.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:34:43.747 INFO:teuthology.orchestra.run.smithi018.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:34:43.748 INFO:teuthology.orchestra.run.smithi018.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:34:43.749 INFO:teuthology.orchestra.run.smithi018.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:34:43.750 INFO:teuthology.orchestra.run.smithi018.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:34:43.751 INFO:teuthology.orchestra.run.smithi018.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:34:43.754 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:34:43.755 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:34:43.769 INFO:teuthology.orchestra.run.smithi062.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 20 MB/s | 2.4 MB 00:00 2024-09-12T02:34:43.825 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-12T02:34:43.840 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-12T02:34:43.841 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-12T02:34:43.841 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-12T02:34:43.841 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-12T02:34:43.841 INFO:teuthology.orchestra.run.smithi018.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:34:43.841 INFO:teuthology.orchestra.run.smithi018.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:34:43.841 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:34:43.841 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:34:43.841 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:34:43.841 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:34:43.841 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:34:43.841 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:34:43.841 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:34:43.842 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:34:43.842 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:34:43.842 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:34:43.842 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:34:43.842 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:34:43.842 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:34:43.842 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:34:43.842 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:34:43.842 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:34:43.842 INFO:teuthology.orchestra.run.smithi018.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:34:43.842 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:34:43.842 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:34:43.842 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:34:43.843 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:34:43.843 INFO:teuthology.orchestra.run.smithi018.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:34:43.843 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:34:43.843 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:34:43.843 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:34:43.843 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:34:43.843 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:34:43.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:34:43.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:34:43.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:34:43.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:34:43.844 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:34:43.844 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:34:43.844 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:34:43.844 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:34:43.844 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrading: 2024-09-12T02:34:43.844 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:34:43.844 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:34:43.844 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:34:43.844 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:34:43.844 INFO:teuthology.orchestra.run.smithi018.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:34:43.844 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:34:43.844 INFO:teuthology.orchestra.run.smithi018.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:34:43.845 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:34:43.845 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-12T02:34:43.845 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:34:43.845 INFO:teuthology.orchestra.run.smithi018.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:34:43.845 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:34:43.845 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:34:43.845 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:34:43.845 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:34:43.845 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:34:43.845 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:34:43.845 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:34:43.845 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:34:43.846 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:34:43.846 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:34:43.846 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:34:43.846 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:34:43.846 INFO:teuthology.orchestra.run.smithi018.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:34:43.846 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:34:43.846 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:34:43.846 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:34:43.846 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:34:43.846 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:34:43.846 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:34:43.846 INFO:teuthology.orchestra.run.smithi018.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:34:43.846 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:34:43.846 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:34:43.847 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:34:43.847 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:34:43.847 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:34:43.847 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:34:43.847 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:34:43.847 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:34:43.847 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:34:43.847 INFO:teuthology.orchestra.run.smithi018.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:34:43.847 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:34:43.847 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:34:43.847 INFO:teuthology.orchestra.run.smithi018.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:34:43.847 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:34:43.848 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:34:43.848 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:34:43.848 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:34:43.848 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:34:43.848 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:34:43.848 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:34:43.848 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:34:43.848 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:34:43.848 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:34:43.848 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:34:43.848 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:34:43.848 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:34:43.849 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:34:43.849 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:34:43.849 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:34:43.849 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:34:43.849 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:34:43.849 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:34:43.849 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:34:43.849 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:34:43.849 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:34:43.849 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:34:43.849 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:34:43.849 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:34:43.849 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:34:43.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:34:43.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:34:43.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:34:43.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:34:43.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:34:43.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:34:43.851 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:34:43.851 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:34:43.851 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:34:43.851 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:34:43.851 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:34:43.851 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:34:43.851 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:34:43.851 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:34:43.851 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:34:43.851 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:34:43.851 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:34:43.851 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:34:43.852 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:34:43.852 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:34:43.852 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:34:43.852 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:34:43.852 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:34:43.852 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:34:43.852 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:34:43.852 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:34:43.852 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:34:43.852 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:34:43.852 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:34:43.852 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:34:43.852 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:34:43.853 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:34:43.853 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:34:43.853 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:34:43.853 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:34:43.853 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:34:43.853 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:34:43.853 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:34:43.853 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:34:43.853 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:34:43.853 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:34:43.854 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:34:43.854 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:34:43.854 INFO:teuthology.orchestra.run.smithi018.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:34:43.854 INFO:teuthology.orchestra.run.smithi018.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:34:43.854 INFO:teuthology.orchestra.run.smithi018.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:34:43.854 INFO:teuthology.orchestra.run.smithi018.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:34:43.854 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:34:43.854 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:34:43.854 INFO:teuthology.orchestra.run.smithi018.stdout:Installing weak dependencies: 2024-09-12T02:34:43.854 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:34:43.854 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:34:43.854 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-12T02:34:43.854 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-12T02:34:43.855 INFO:teuthology.orchestra.run.smithi018.stdout:Install 148 Packages 2024-09-12T02:34:43.855 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrade 8 Packages 2024-09-12T02:34:43.855 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:34:43.855 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 226 M 2024-09-12T02:34:43.855 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-12T02:34:43.910 INFO:teuthology.orchestra.run.smithi062.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 6.5 MB/s | 1.5 MB 00:00 2024-09-12T02:34:44.019 INFO:teuthology.orchestra.run.smithi062.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 19 MB/s | 4.7 MB 00:00 2024-09-12T02:34:44.444 INFO:teuthology.orchestra.run.smithi062.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 17 MB/s | 21 MB 00:01 2024-09-12T02:34:44.486 INFO:teuthology.orchestra.run.smithi062.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 607 kB/s | 25 kB 00:00 2024-09-12T02:34:44.611 INFO:teuthology.orchestra.run.smithi062.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 18 MB/s | 11 MB 00:00 2024-09-12T02:34:44.662 INFO:teuthology.orchestra.run.smithi062.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-12T02:34:44.713 INFO:teuthology.orchestra.run.smithi018.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 37 kB/s | 6.5 kB 00:00 2024-09-12T02:34:44.729 INFO:teuthology.orchestra.run.smithi062.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 405 kB/s | 27 kB 00:00 2024-09-12T02:34:44.812 INFO:teuthology.orchestra.run.smithi062.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 382 kB/s | 32 kB 00:00 2024-09-12T02:34:45.105 INFO:teuthology.orchestra.run.smithi018.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 2.2 MB/s | 897 kB 00:00 2024-09-12T02:34:45.121 INFO:teuthology.orchestra.run.smithi062.stdout:(14/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 14 MB/s | 17 MB 00:01 2024-09-12T02:34:45.155 INFO:teuthology.orchestra.run.smithi062.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 2.1 MB/s | 752 kB 00:00 2024-09-12T02:34:45.172 INFO:teuthology.orchestra.run.smithi018.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.1 MB/s | 145 kB 00:00 2024-09-12T02:34:45.212 INFO:teuthology.orchestra.run.smithi062.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.8 MB/s | 163 kB 00:00 2024-09-12T02:34:45.238 INFO:teuthology.orchestra.run.smithi062.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.5 MB/s | 127 kB 00:00 2024-09-12T02:34:45.289 INFO:teuthology.orchestra.run.smithi062.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 6.5 MB/s | 506 kB 00:00 2024-09-12T02:34:45.364 INFO:teuthology.orchestra.run.smithi062.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 602 kB/s | 45 kB 00:00 2024-09-12T02:34:45.464 INFO:teuthology.orchestra.run.smithi062.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.3 MB/s | 136 kB 00:00 2024-09-12T02:34:45.548 INFO:teuthology.orchestra.run.smithi062.stdout:(21/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 17 MB/s | 5.3 MB 00:00 2024-09-12T02:34:45.573 INFO:teuthology.orchestra.run.smithi062.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.5 MB/s | 162 kB 00:00 2024-09-12T02:34:45.607 INFO:teuthology.orchestra.run.smithi062.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 5.4 MB/s | 321 kB 00:00 2024-09-12T02:34:45.632 INFO:teuthology.orchestra.run.smithi062.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.0 MB/s | 301 kB 00:00 2024-09-12T02:34:45.657 INFO:teuthology.orchestra.run.smithi062.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T02:34:45.681 INFO:teuthology.orchestra.run.smithi018.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 4.7 MB/s | 5.4 MB 00:01 2024-09-12T02:34:45.682 INFO:teuthology.orchestra.run.smithi062.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T02:34:45.766 INFO:teuthology.orchestra.run.smithi062.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-12T02:34:45.772 INFO:teuthology.orchestra.run.smithi018.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 4.0 MB/s | 2.4 MB 00:00 2024-09-12T02:34:45.817 INFO:teuthology.orchestra.run.smithi062.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 20 MB/s | 3.1 MB 00:00 2024-09-12T02:34:45.842 INFO:teuthology.orchestra.run.smithi062.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 424 kB/s | 32 kB 00:00 2024-09-12T02:34:45.876 INFO:teuthology.orchestra.run.smithi062.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.4 MB/s | 146 kB 00:00 2024-09-12T02:34:45.948 INFO:teuthology.orchestra.run.smithi018.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 5.7 MB/s | 1.5 MB 00:00 2024-09-12T02:34:46.134 INFO:teuthology.orchestra.run.smithi062.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 12 MB/s | 3.6 MB 00:00 2024-09-12T02:34:46.210 INFO:teuthology.orchestra.run.smithi062.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.2 MB/s | 249 kB 00:00 2024-09-12T02:34:46.327 INFO:teuthology.orchestra.run.smithi062.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 16 MB/s | 7.4 MB 00:00 2024-09-12T02:34:46.352 INFO:teuthology.orchestra.run.smithi062.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 347 kB/s | 49 kB 00:00 2024-09-12T02:34:46.386 INFO:teuthology.orchestra.run.smithi062.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 283 kB/s | 16 kB 00:00 2024-09-12T02:34:46.420 INFO:teuthology.orchestra.run.smithi062.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.2 MB/s | 285 kB 00:00 2024-09-12T02:34:46.461 INFO:teuthology.orchestra.run.smithi062.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 9.9 MB/s | 765 kB 00:00 2024-09-12T02:34:46.487 INFO:teuthology.orchestra.run.smithi062.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 272 kB/s | 18 kB 00:00 2024-09-12T02:34:46.596 INFO:teuthology.orchestra.run.smithi062.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 597 kB/s | 80 kB 00:00 2024-09-12T02:34:46.688 INFO:teuthology.orchestra.run.smithi062.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-12T02:34:46.713 INFO:teuthology.orchestra.run.smithi062.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-12T02:34:46.755 INFO:teuthology.orchestra.run.smithi062.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-12T02:34:46.756 INFO:teuthology.orchestra.run.smithi018.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 4.8 MB/s | 4.7 MB 00:00 2024-09-12T02:34:46.814 INFO:teuthology.orchestra.run.smithi062.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-09-12T02:34:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-12T02:34:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-12T02:34:46.889 INFO:teuthology.orchestra.run.smithi062.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T02:34:46.915 INFO:teuthology.orchestra.run.smithi062.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-12T02:34:47.290 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.5 MB 00:03 2024-09-12T02:34:47.357 INFO:teuthology.orchestra.run.smithi062.stdout:(48/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 17 MB/s | 49 MB 00:02 2024-09-12T02:34:47.440 INFO:teuthology.orchestra.run.smithi018.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 7.3 MB/s | 21 MB 00:02 2024-09-12T02:34:47.465 INFO:teuthology.orchestra.run.smithi062.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 990 kB/s | 107 kB 00:00 2024-09-12T02:34:47.490 INFO:teuthology.orchestra.run.smithi018.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 508 kB/s | 25 kB 00:00 2024-09-12T02:34:47.499 INFO:teuthology.orchestra.run.smithi062.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 1.1 MB/s | 689 kB 00:00 2024-09-12T02:34:47.524 INFO:teuthology.orchestra.run.smithi062.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 372 kB/s | 22 kB 00:00 2024-09-12T02:34:47.550 INFO:teuthology.orchestra.run.smithi062.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-12T02:34:47.575 INFO:teuthology.orchestra.run.smithi062.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 649 kB/s | 33 kB 00:00 2024-09-12T02:34:47.617 INFO:teuthology.orchestra.run.smithi062.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 1.3 MB/s | 943 kB 00:00 2024-09-12T02:34:47.642 INFO:teuthology.orchestra.run.smithi062.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-09-12T02:34:47.667 INFO:teuthology.orchestra.run.smithi062.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-12T02:34:47.709 INFO:teuthology.orchestra.run.smithi062.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-12T02:34:47.743 INFO:teuthology.orchestra.run.smithi062.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-12T02:34:47.818 INFO:teuthology.orchestra.run.smithi062.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-09-12T02:34:47.860 INFO:teuthology.orchestra.run.smithi062.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 588 kB/s | 24 kB 00:00 2024-09-12T02:34:47.874 INFO:teuthology.orchestra.run.smithi018.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 8.8 MB/s | 17 MB 00:01 2024-09-12T02:34:47.902 INFO:teuthology.orchestra.run.smithi062.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-12T02:34:47.924 INFO:teuthology.orchestra.run.smithi018.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-12T02:34:47.935 INFO:teuthology.orchestra.run.smithi062.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 3.0 MB/s | 581 kB 00:00 2024-09-12T02:34:47.974 INFO:teuthology.orchestra.run.smithi018.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 542 kB/s | 27 kB 00:00 2024-09-12T02:34:48.003 INFO:teuthology.orchestra.run.smithi062.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 292 kB 00:00 2024-09-12T02:34:48.025 INFO:teuthology.orchestra.run.smithi018.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 635 kB/s | 32 kB 00:00 2024-09-12T02:34:48.028 INFO:teuthology.orchestra.run.smithi062.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-12T02:34:48.053 INFO:teuthology.orchestra.run.smithi062.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-12T02:34:48.125 INFO:teuthology.orchestra.run.smithi018.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 7.4 MB/s | 752 kB 00:00 2024-09-12T02:34:48.275 INFO:teuthology.orchestra.run.smithi018.stdout:(15/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 7.0 MB/s | 11 MB 00:01 2024-09-12T02:34:48.295 INFO:teuthology.orchestra.run.smithi062.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.0 MB/s | 3.0 MB 00:00 2024-09-12T02:34:48.300 INFO:teuthology.orchestra.run.smithi018.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 934 kB/s | 163 kB 00:00 2024-09-12T02:34:48.326 INFO:teuthology.orchestra.run.smithi018.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.5 MB/s | 127 kB 00:00 2024-09-12T02:34:48.376 INFO:teuthology.orchestra.run.smithi018.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 6.6 MB/s | 506 kB 00:00 2024-09-12T02:34:48.434 INFO:teuthology.orchestra.run.smithi018.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 777 kB/s | 45 kB 00:00 2024-09-12T02:34:48.485 INFO:teuthology.orchestra.run.smithi018.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.7 MB/s | 136 kB 00:00 2024-09-12T02:34:48.535 INFO:teuthology.orchestra.run.smithi018.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 3.2 MB/s | 162 kB 00:00 2024-09-12T02:34:48.617 INFO:teuthology.orchestra.run.smithi018.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 321 kB 00:00 2024-09-12T02:34:48.677 INFO:teuthology.orchestra.run.smithi018.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 4.9 MB/s | 301 kB 00:00 2024-09-12T02:34:48.728 INFO:teuthology.orchestra.run.smithi018.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 2.0 MB/s | 100 kB 00:00 2024-09-12T02:34:48.728 INFO:teuthology.orchestra.run.smithi062.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-09-12T02:34:48.778 INFO:teuthology.orchestra.run.smithi018.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T02:34:48.987 INFO:teuthology.orchestra.run.smithi062.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 3.4 MB/s | 910 kB 00:00 2024-09-12T02:34:49.011 INFO:teuthology.orchestra.run.smithi018.stdout:(26/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 7.8 MB/s | 5.3 MB 00:00 2024-09-12T02:34:49.066 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-12T02:34:49.071 INFO:teuthology.orchestra.run.smithi062.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-12T02:34:49.078 INFO:teuthology.orchestra.run.smithi018.stdout:(27/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 10 MB/s | 3.1 MB 00:00 2024-09-12T02:34:49.104 INFO:teuthology.orchestra.run.smithi018.stdout:(28/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 1.8 MB/s | 171 kB 00:00 2024-09-12T02:34:49.129 INFO:teuthology.orchestra.run.smithi018.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 636 kB/s | 32 kB 00:00 2024-09-12T02:34:49.155 INFO:teuthology.orchestra.run.smithi018.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.8 MB/s | 146 kB 00:00 2024-09-12T02:34:49.196 INFO:teuthology.orchestra.run.smithi062.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.9 MB/s | 4.4 MB 00:01 2024-09-12T02:34:49.405 INFO:teuthology.orchestra.run.smithi018.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 13 MB/s | 3.6 MB 00:00 2024-09-12T02:34:49.455 INFO:teuthology.orchestra.run.smithi018.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.9 MB/s | 249 kB 00:00 2024-09-12T02:34:49.472 INFO:teuthology.orchestra.run.smithi062.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.4 MB/s | 4.9 MB 00:01 2024-09-12T02:34:49.505 INFO:teuthology.orchestra.run.smithi018.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 996 kB/s | 49 kB 00:00 2024-09-12T02:34:49.530 INFO:teuthology.orchestra.run.smithi062.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.0 MB/s | 1.0 MB 00:00 2024-09-12T02:34:49.555 INFO:teuthology.orchestra.run.smithi062.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-12T02:34:49.556 INFO:teuthology.orchestra.run.smithi018.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 328 kB/s | 16 kB 00:00 2024-09-12T02:34:49.598 INFO:teuthology.orchestra.run.smithi062.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-12T02:34:49.606 INFO:teuthology.orchestra.run.smithi018.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.6 MB/s | 285 kB 00:00 2024-09-12T02:34:49.689 INFO:teuthology.orchestra.run.smithi062.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-12T02:34:49.698 INFO:teuthology.orchestra.run.smithi018.stdout:(36/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 8.2 MB/s | 765 kB 00:00 2024-09-12T02:34:49.757 INFO:teuthology.orchestra.run.smithi018.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 313 kB/s | 18 kB 00:00 2024-09-12T02:34:49.781 INFO:teuthology.orchestra.run.smithi062.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.7 MB/s | 248 kB 00:00 2024-09-12T02:34:49.823 INFO:teuthology.orchestra.run.smithi062.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 615 kB/s | 26 kB 00:00 2024-09-12T02:34:49.865 INFO:teuthology.orchestra.run.smithi062.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 460 kB/s | 19 kB 00:00 2024-09-12T02:34:49.937 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-12T02:34:49.940 INFO:teuthology.orchestra.run.smithi062.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-12T02:34:49.974 INFO:teuthology.orchestra.run.smithi018.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 9.0 MB/s | 7.4 MB 00:00 2024-09-12T02:34:49.982 INFO:teuthology.orchestra.run.smithi062.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 832 kB/s | 35 kB 00:00 2024-09-12T02:34:50.216 INFO:teuthology.orchestra.run.smithi018.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 174 kB/s | 80 kB 00:00 2024-09-12T02:34:50.516 INFO:teuthology.orchestra.run.smithi018.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 637 kB/s | 191 kB 00:00 2024-09-12T02:34:50.808 INFO:teuthology.orchestra.run.smithi062.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 3.3 MB/s | 5.8 MB 00:01 2024-09-12T02:34:50.900 INFO:teuthology.orchestra.run.smithi062.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-12T02:34:51.000 INFO:teuthology.orchestra.run.smithi062.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-12T02:34:51.042 INFO:teuthology.orchestra.run.smithi018.stdout:(41/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 14 MB/s | 49 MB 00:03 2024-09-12T02:34:51.058 INFO:teuthology.orchestra.run.smithi062.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T02:34:51.097 INFO:teuthology.orchestra.run.smithi018.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 436 kB/s | 253 kB 00:00 2024-09-12T02:34:51.100 INFO:teuthology.orchestra.run.smithi062.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-12T02:34:51.134 INFO:teuthology.orchestra.run.smithi018.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 691 kB/s | 801 kB 00:01 2024-09-12T02:34:51.201 INFO:teuthology.orchestra.run.smithi062.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-12T02:34:51.209 INFO:teuthology.orchestra.run.smithi018.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 958 kB/s | 106 kB 00:00 2024-09-12T02:34:51.242 INFO:teuthology.orchestra.run.smithi018.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-12T02:34:51.276 INFO:teuthology.orchestra.run.smithi062.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-12T02:34:51.326 INFO:teuthology.orchestra.run.smithi018.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-12T02:34:51.360 INFO:teuthology.orchestra.run.smithi018.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-12T02:34:51.384 INFO:teuthology.orchestra.run.smithi062.stdout:(88/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.2 MB/s | 6.0 MB 00:01 2024-09-12T02:34:51.427 INFO:teuthology.orchestra.run.smithi062.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-12T02:34:51.460 INFO:teuthology.orchestra.run.smithi062.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-09-12T02:34:51.485 INFO:teuthology.orchestra.run.smithi062.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 917 kB/s | 54 kB 00:00 2024-09-12T02:34:51.569 INFO:teuthology.orchestra.run.smithi062.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.2 MB/s | 5.1 MB 00:01 2024-09-12T02:34:51.617 INFO:teuthology.orchestra.run.smithi062.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 316 kB/s | 42 kB 00:00 2024-09-12T02:34:51.618 INFO:teuthology.orchestra.run.smithi018.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-12T02:34:51.644 INFO:teuthology.orchestra.run.smithi062.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 588 kB/s | 44 kB 00:00 2024-09-12T02:34:51.686 INFO:teuthology.orchestra.run.smithi062.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 862 kB/s | 36 kB 00:00 2024-09-12T02:34:51.702 INFO:teuthology.orchestra.run.smithi018.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 943 kB 00:00 2024-09-12T02:34:51.727 INFO:teuthology.orchestra.run.smithi018.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 986 kB/s | 107 kB 00:00 2024-09-12T02:34:51.728 INFO:teuthology.orchestra.run.smithi062.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.9 MB/s | 221 kB 00:00 2024-09-12T02:34:51.754 INFO:teuthology.orchestra.run.smithi062.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-09-12T02:34:51.769 INFO:teuthology.orchestra.run.smithi018.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 325 kB/s | 22 kB 00:00 2024-09-12T02:34:51.796 INFO:teuthology.orchestra.run.smithi062.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-12T02:34:51.845 INFO:teuthology.orchestra.run.smithi018.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 437 kB/s | 33 kB 00:00 2024-09-12T02:34:51.862 INFO:teuthology.orchestra.run.smithi062.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.2 MB/s | 304 kB 00:00 2024-09-12T02:34:51.870 INFO:teuthology.orchestra.run.smithi018.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.2 MB/s | 313 kB 00:00 2024-09-12T02:34:51.888 INFO:teuthology.orchestra.run.smithi062.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.0 MB/s | 96 kB 00:00 2024-09-12T02:34:51.922 INFO:teuthology.orchestra.run.smithi062.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-12T02:34:51.937 INFO:teuthology.orchestra.run.smithi018.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 274 kB/s | 18 kB 00:00 2024-09-12T02:34:51.947 INFO:teuthology.orchestra.run.smithi062.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 765 kB/s | 45 kB 00:00 2024-09-12T02:34:51.970 INFO:teuthology.orchestra.run.smithi018.stdout:(55/156): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-12T02:34:52.012 INFO:teuthology.orchestra.run.smithi018.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 149 kB/s | 11 kB 00:00 2024-09-12T02:34:52.063 INFO:teuthology.orchestra.run.smithi018.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-12T02:34:52.072 INFO:teuthology.orchestra.run.smithi062.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-09-12T02:34:52.131 INFO:teuthology.orchestra.run.smithi062.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T02:34:52.171 INFO:teuthology.orchestra.run.smithi018.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 285 kB/s | 45 kB 00:00 2024-09-12T02:34:52.173 INFO:teuthology.orchestra.run.smithi062.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-09-12T02:34:52.190 INFO:teuthology.orchestra.run.smithi062.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-12T02:34:52.248 INFO:teuthology.orchestra.run.smithi062.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.8 MB/s | 863 kB 00:00 2024-09-12T02:34:52.272 INFO:teuthology.orchestra.run.smithi018.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-12T02:34:52.282 INFO:teuthology.orchestra.run.smithi062.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 782 kB/s | 26 kB 00:00 2024-09-12T02:34:52.339 INFO:teuthology.orchestra.run.smithi018.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 3.4 MB/s | 581 kB 00:00 2024-09-12T02:34:52.349 INFO:teuthology.orchestra.run.smithi062.stdout:(109/156): libarrow-9.0.0-11.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-12T02:34:52.382 INFO:teuthology.orchestra.run.smithi062.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 582 kB/s | 49 kB 00:00 2024-09-12T02:34:52.391 INFO:teuthology.orchestra.run.smithi062.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-12T02:34:52.414 INFO:teuthology.orchestra.run.smithi018.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 634 kB/s | 47 kB 00:00 2024-09-12T02:34:52.417 INFO:teuthology.orchestra.run.smithi062.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-12T02:34:52.459 INFO:teuthology.orchestra.run.smithi062.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-12T02:34:52.464 INFO:teuthology.orchestra.run.smithi018.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 127 kB/s | 24 kB 00:00 2024-09-12T02:34:52.484 INFO:teuthology.orchestra.run.smithi062.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T02:34:52.517 INFO:teuthology.orchestra.run.smithi062.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-09-12T02:34:52.543 INFO:teuthology.orchestra.run.smithi062.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 551 kB/s | 32 kB 00:00 2024-09-12T02:34:52.548 INFO:teuthology.orchestra.run.smithi018.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-12T02:34:52.568 INFO:teuthology.orchestra.run.smithi062.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-12T02:34:52.573 INFO:teuthology.orchestra.run.smithi018.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-09-12T02:34:52.593 INFO:teuthology.orchestra.run.smithi062.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T02:34:52.619 INFO:teuthology.orchestra.run.smithi062.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-12T02:34:52.644 INFO:teuthology.orchestra.run.smithi062.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-12T02:34:52.665 INFO:teuthology.orchestra.run.smithi018.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 329 kB/s | 38 kB 00:00 2024-09-12T02:34:52.669 INFO:teuthology.orchestra.run.smithi062.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T02:34:52.703 INFO:teuthology.orchestra.run.smithi062.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T02:34:52.728 INFO:teuthology.orchestra.run.smithi062.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-12T02:34:52.754 INFO:teuthology.orchestra.run.smithi062.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-12T02:34:52.779 INFO:teuthology.orchestra.run.smithi062.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 936 kB/s | 23 kB 00:00 2024-09-12T02:34:52.804 INFO:teuthology.orchestra.run.smithi062.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-12T02:34:52.829 INFO:teuthology.orchestra.run.smithi062.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-12T02:34:52.888 INFO:teuthology.orchestra.run.smithi062.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-12T02:34:52.896 INFO:teuthology.orchestra.run.smithi018.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-12T02:34:52.922 INFO:teuthology.orchestra.run.smithi062.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-12T02:34:52.947 INFO:teuthology.orchestra.run.smithi062.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T02:34:52.981 INFO:teuthology.orchestra.run.smithi062.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-12T02:34:53.006 INFO:teuthology.orchestra.run.smithi062.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 987 kB/s | 58 kB 00:00 2024-09-12T02:34:53.031 INFO:teuthology.orchestra.run.smithi062.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-12T02:34:53.056 INFO:teuthology.orchestra.run.smithi062.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-12T02:34:53.083 INFO:teuthology.orchestra.run.smithi062.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-12T02:34:53.099 INFO:teuthology.orchestra.run.smithi062.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 674 kB/s | 28 kB 00:00 2024-09-12T02:34:53.116 INFO:teuthology.orchestra.run.smithi062.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 918 kB/s | 31 kB 00:00 2024-09-12T02:34:53.141 INFO:teuthology.orchestra.run.smithi062.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2024-09-12T02:34:53.158 INFO:teuthology.orchestra.run.smithi062.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-12T02:34:53.175 INFO:teuthology.orchestra.run.smithi062.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-12T02:34:53.200 INFO:teuthology.orchestra.run.smithi062.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-12T02:34:53.225 INFO:teuthology.orchestra.run.smithi062.stdout:(142/156): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-12T02:34:53.251 INFO:teuthology.orchestra.run.smithi062.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T02:34:53.276 INFO:teuthology.orchestra.run.smithi062.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 808 kB/s | 20 kB 00:00 2024-09-12T02:34:53.301 INFO:teuthology.orchestra.run.smithi062.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-12T02:34:53.349 INFO:teuthology.orchestra.run.smithi018.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.5 MB/s | 1.6 MB 00:00 2024-09-12T02:34:53.360 INFO:teuthology.orchestra.run.smithi062.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-12T02:34:53.410 INFO:teuthology.orchestra.run.smithi062.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T02:34:53.566 INFO:teuthology.orchestra.run.smithi018.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 4.1 MB/s | 910 kB 00:00 2024-09-12T02:34:53.633 INFO:teuthology.orchestra.run.smithi018.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-12T02:34:53.652 INFO:teuthology.orchestra.run.smithi062.stdout:(148/156): librados2-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-12T02:34:53.702 INFO:teuthology.orchestra.run.smithi018.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.3 MB/s | 4.4 MB 00:01 2024-09-12T02:34:53.719 INFO:teuthology.orchestra.run.smithi062.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-12T02:34:53.876 INFO:teuthology.orchestra.run.smithi018.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.8 MB/s | 4.9 MB 00:01 2024-09-12T02:34:53.955 INFO:teuthology.orchestra.run.smithi018.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-12T02:34:53.961 INFO:teuthology.orchestra.run.smithi062.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 7.5 MB/s | 2.3 MB 00:00 2024-09-12T02:34:53.993 INFO:teuthology.orchestra.run.smithi018.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.4 MB/s | 1.0 MB 00:00 2024-09-12T02:34:54.003 INFO:teuthology.orchestra.run.smithi062.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 6.4 MB/s | 1.8 MB 00:00 2024-09-12T02:34:54.028 INFO:teuthology.orchestra.run.smithi062.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 609 kB/s | 41 kB 00:00 2024-09-12T02:34:54.051 INFO:teuthology.orchestra.run.smithi018.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-12T02:34:54.054 INFO:teuthology.orchestra.run.smithi062.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 4.8 MB/s | 249 kB 00:00 2024-09-12T02:34:54.096 INFO:teuthology.orchestra.run.smithi062.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-12T02:34:54.143 INFO:teuthology.orchestra.run.smithi018.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-12T02:34:54.163 INFO:teuthology.orchestra.run.smithi062.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-12T02:34:54.227 INFO:teuthology.orchestra.run.smithi018.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-12T02:34:54.277 INFO:teuthology.orchestra.run.smithi018.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-12T02:34:54.336 INFO:teuthology.orchestra.run.smithi018.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 329 kB/s | 19 kB 00:00 2024-09-12T02:34:54.397 INFO:teuthology.orchestra.run.smithi018.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 172 kB 00:00 2024-09-12T02:34:54.463 INFO:teuthology.orchestra.run.smithi018.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 523 kB/s | 35 kB 00:00 2024-09-12T02:34:54.646 INFO:teuthology.orchestra.run.smithi062.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.1 MB/s | 16 MB 00:03 2024-09-12T02:34:54.651 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:34:54.651 INFO:teuthology.orchestra.run.smithi062.stdout:Total 18 MB/s | 226 MB 00:12 2024-09-12T02:34:54.669 INFO:teuthology.orchestra.run.smithi018.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 5.6 MB/s | 5.8 MB 00:01 2024-09-12T02:34:54.731 INFO:teuthology.orchestra.run.smithi018.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.9 MB/s | 250 kB 00:00 2024-09-12T02:34:54.790 INFO:teuthology.orchestra.run.smithi018.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-12T02:34:54.907 INFO:teuthology.orchestra.run.smithi018.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 661 kB/s | 77 kB 00:00 2024-09-12T02:34:54.957 INFO:teuthology.orchestra.run.smithi018.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 850 kB/s | 42 kB 00:00 2024-09-12T02:34:55.046 INFO:teuthology.orchestra.run.smithi018.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 3.0 MB/s | 269 kB 00:00 2024-09-12T02:34:55.125 INFO:teuthology.orchestra.run.smithi018.stdout:(87/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-12T02:34:55.158 INFO:teuthology.orchestra.run.smithi018.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-12T02:34:55.217 INFO:teuthology.orchestra.run.smithi018.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-09-12T02:34:55.242 INFO:teuthology.orchestra.run.smithi018.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 610 kB/s | 51 kB 00:00 2024-09-12T02:34:55.292 INFO:teuthology.orchestra.run.smithi018.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-09-12T02:34:55.343 INFO:teuthology.orchestra.run.smithi018.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 833 kB/s | 42 kB 00:00 2024-09-12T02:34:55.434 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-09-12T02:34:55.576 INFO:teuthology.orchestra.run.smithi018.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.6 MB/s | 5.1 MB 00:01 2024-09-12T02:34:55.601 INFO:teuthology.orchestra.run.smithi018.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 171 kB/s | 44 kB 00:00 2024-09-12T02:34:55.652 INFO:teuthology.orchestra.run.smithi018.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 720 kB/s | 36 kB 00:00 2024-09-12T02:34:55.702 INFO:teuthology.orchestra.run.smithi018.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-12T02:34:55.752 INFO:teuthology.orchestra.run.smithi018.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 473 kB/s | 47 kB 00:00 2024-09-12T02:34:55.803 INFO:teuthology.orchestra.run.smithi018.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.0 MB/s | 304 kB 00:00 2024-09-12T02:34:55.828 INFO:teuthology.orchestra.run.smithi018.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 769 kB/s | 58 kB 00:00 2024-09-12T02:34:55.853 INFO:teuthology.orchestra.run.smithi018.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-12T02:34:55.878 INFO:teuthology.orchestra.run.smithi018.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T02:34:55.901 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-09-12T02:34:55.904 INFO:teuthology.orchestra.run.smithi018.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 888 kB/s | 45 kB 00:00 2024-09-12T02:34:55.996 INFO:teuthology.orchestra.run.smithi018.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-12T02:34:56.054 INFO:teuthology.orchestra.run.smithi018.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T02:34:56.064 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-09-12T02:34:56.064 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-09-12T02:34:56.106 INFO:teuthology.orchestra.run.smithi018.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 5.9 MB/s | 309 kB 00:00 2024-09-12T02:34:56.138 INFO:teuthology.orchestra.run.smithi018.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 613 kB/s | 19 kB 00:00 2024-09-12T02:34:56.180 INFO:teuthology.orchestra.run.smithi018.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-09-12T02:34:56.231 INFO:teuthology.orchestra.run.smithi018.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-09-12T02:34:56.256 INFO:teuthology.orchestra.run.smithi018.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T02:34:56.281 INFO:teuthology.orchestra.run.smithi018.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-12T02:34:56.315 INFO:teuthology.orchestra.run.smithi018.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-12T02:34:56.365 INFO:teuthology.orchestra.run.smithi018.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 17 MB/s | 839 kB 00:00 2024-09-12T02:34:56.416 INFO:teuthology.orchestra.run.smithi018.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-12T02:34:56.466 INFO:teuthology.orchestra.run.smithi018.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 872 kB/s | 43 kB 00:00 2024-09-12T02:34:56.533 INFO:teuthology.orchestra.run.smithi018.stdout:(115/156): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-12T02:34:56.567 INFO:teuthology.orchestra.run.smithi018.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 321 kB/s | 32 kB 00:00 2024-09-12T02:34:56.592 INFO:teuthology.orchestra.run.smithi018.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-09-12T02:34:56.617 INFO:teuthology.orchestra.run.smithi018.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T02:34:56.643 INFO:teuthology.orchestra.run.smithi018.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-12T02:34:56.668 INFO:teuthology.orchestra.run.smithi018.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-12T02:34:56.693 INFO:teuthology.orchestra.run.smithi018.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T02:34:56.718 INFO:teuthology.orchestra.run.smithi018.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T02:34:56.744 INFO:teuthology.orchestra.run.smithi018.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-12T02:34:56.777 INFO:teuthology.orchestra.run.smithi018.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 534 kB/s | 18 kB 00:00 2024-09-12T02:34:56.828 INFO:teuthology.orchestra.run.smithi018.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-12T02:34:56.853 INFO:teuthology.orchestra.run.smithi018.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 776 kB/s | 19 kB 00:00 2024-09-12T02:34:56.882 INFO:teuthology.orchestra.run.smithi018.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 690 kB/s | 20 kB 00:00 2024-09-12T02:34:56.937 INFO:teuthology.orchestra.run.smithi018.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 19 MB/s | 1.0 MB 00:00 2024-09-12T02:34:56.964 INFO:teuthology.orchestra.run.smithi018.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T02:34:56.988 INFO:teuthology.orchestra.run.smithi018.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T02:34:57.030 INFO:teuthology.orchestra.run.smithi018.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.6 MB/s | 2.0 MB 00:00 2024-09-12T02:34:57.055 INFO:teuthology.orchestra.run.smithi018.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 860 kB/s | 58 kB 00:00 2024-09-12T02:34:57.080 INFO:teuthology.orchestra.run.smithi018.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 668 kB/s | 16 kB 00:00 2024-09-12T02:34:57.105 INFO:teuthology.orchestra.run.smithi018.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T02:34:57.131 INFO:teuthology.orchestra.run.smithi018.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-12T02:34:57.181 INFO:teuthology.orchestra.run.smithi018.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 373 kB/s | 28 kB 00:00 2024-09-12T02:34:57.207 INFO:teuthology.orchestra.run.smithi018.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-09-12T02:34:57.232 INFO:teuthology.orchestra.run.smithi018.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T02:34:57.257 INFO:teuthology.orchestra.run.smithi018.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-12T02:34:57.283 INFO:teuthology.orchestra.run.smithi018.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-12T02:34:57.308 INFO:teuthology.orchestra.run.smithi018.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T02:34:57.333 INFO:teuthology.orchestra.run.smithi018.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T02:34:57.359 INFO:teuthology.orchestra.run.smithi018.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-12T02:34:57.384 INFO:teuthology.orchestra.run.smithi018.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-12T02:34:57.426 INFO:teuthology.orchestra.run.smithi018.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-12T02:34:57.451 INFO:teuthology.orchestra.run.smithi018.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-09-12T02:34:57.535 INFO:teuthology.orchestra.run.smithi018.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T02:34:57.755 INFO:teuthology.orchestra.run.smithi176.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:34:57.756 INFO:teuthology.orchestra.run.smithi176.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:34:57.770 INFO:teuthology.orchestra.run.smithi176.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:34:57.771 INFO:teuthology.orchestra.run.smithi176.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:34:57.772 INFO:teuthology.orchestra.run.smithi176.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:34:57.773 INFO:teuthology.orchestra.run.smithi176.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:34:57.775 INFO:teuthology.orchestra.run.smithi176.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:34:57.781 INFO:teuthology.orchestra.run.smithi176.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:34:57.781 INFO:teuthology.orchestra.run.smithi176.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:34:57.842 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-12T02:34:57.844 INFO:teuthology.orchestra.run.smithi018.stdout:(148/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-12T02:34:57.862 INFO:teuthology.orchestra.run.smithi176.stdout:====================================================================================== 2024-09-12T02:34:57.862 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-12T02:34:57.862 INFO:teuthology.orchestra.run.smithi176.stdout:====================================================================================== 2024-09-12T02:34:57.862 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-12T02:34:57.862 INFO:teuthology.orchestra.run.smithi176.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:34:57.862 INFO:teuthology.orchestra.run.smithi176.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:34:57.862 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:34:57.862 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:34:57.862 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:34:57.862 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:34:57.862 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:34:57.862 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:34:57.863 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:34:57.863 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:34:57.863 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:34:57.863 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:34:57.863 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:34:57.863 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:34:57.863 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:34:57.863 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:34:57.863 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:34:57.863 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:34:57.863 INFO:teuthology.orchestra.run.smithi176.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:34:57.863 INFO:teuthology.orchestra.run.smithi176.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:34:57.863 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:34:57.864 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:34:57.864 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:34:57.864 INFO:teuthology.orchestra.run.smithi176.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:34:57.864 INFO:teuthology.orchestra.run.smithi176.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:34:57.864 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:34:57.864 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:34:57.864 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:34:57.864 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:34:57.864 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:34:57.864 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:34:57.864 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:34:57.865 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:34:57.865 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:34:57.865 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:34:57.865 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:34:57.865 INFO:teuthology.orchestra.run.smithi176.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:34:57.865 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrading: 2024-09-12T02:34:57.865 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:34:57.865 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:34:57.865 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:34:57.865 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:34:57.865 INFO:teuthology.orchestra.run.smithi176.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:34:57.865 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:34:57.866 INFO:teuthology.orchestra.run.smithi176.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:34:57.866 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:34:57.866 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-12T02:34:57.866 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:34:57.866 INFO:teuthology.orchestra.run.smithi176.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:34:57.866 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:34:57.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:34:57.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:34:57.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:34:57.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:34:57.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:34:57.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:34:57.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:34:57.866 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:34:57.867 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:34:57.867 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:34:57.867 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:34:57.867 INFO:teuthology.orchestra.run.smithi176.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:34:57.867 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:34:57.867 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:34:57.867 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:34:57.867 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:34:57.867 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:34:57.867 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:34:57.867 INFO:teuthology.orchestra.run.smithi176.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:34:57.867 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:34:57.867 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:34:57.868 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:34:57.868 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:34:57.868 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:34:57.868 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:34:57.868 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:34:57.868 INFO:teuthology.orchestra.run.smithi176.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:34:57.868 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:34:57.868 INFO:teuthology.orchestra.run.smithi176.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:34:57.868 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:34:57.868 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:34:57.868 INFO:teuthology.orchestra.run.smithi176.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:34:57.868 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:34:57.868 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:34:57.868 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:34:57.869 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:34:57.869 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:34:57.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:34:57.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:34:57.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:34:57.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:34:57.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:34:57.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:34:57.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:34:57.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:34:57.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:34:57.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:34:57.869 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:34:57.870 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:34:57.870 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:34:57.870 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:34:57.870 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:34:57.870 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:34:57.870 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:34:57.870 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:34:57.870 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:34:57.870 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:34:57.870 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:34:57.870 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:34:57.870 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:34:57.870 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:34:57.871 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:34:57.871 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:34:57.871 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:34:57.871 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:34:57.871 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:34:57.871 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:34:57.871 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:34:57.871 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:34:57.871 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:34:57.871 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:34:57.871 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:34:57.871 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:34:57.871 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:34:57.872 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:34:57.872 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:34:57.872 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:34:57.872 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:34:57.872 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:34:57.872 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:34:57.872 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:34:57.872 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:34:57.872 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:34:57.872 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:34:57.872 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:34:57.872 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:34:57.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:34:57.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:34:57.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:34:57.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:34:57.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:34:57.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:34:57.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:34:57.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:34:57.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:34:57.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:34:57.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:34:57.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:34:57.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:34:57.874 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:34:57.874 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:34:57.874 INFO:teuthology.orchestra.run.smithi176.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:34:57.874 INFO:teuthology.orchestra.run.smithi176.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:34:57.874 INFO:teuthology.orchestra.run.smithi176.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:34:57.874 INFO:teuthology.orchestra.run.smithi176.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:34:57.874 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:34:57.874 INFO:teuthology.orchestra.run.smithi176.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:34:57.874 INFO:teuthology.orchestra.run.smithi176.stdout:Installing weak dependencies: 2024-09-12T02:34:57.875 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:34:57.875 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:34:57.875 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-12T02:34:57.875 INFO:teuthology.orchestra.run.smithi176.stdout:====================================================================================== 2024-09-12T02:34:57.875 INFO:teuthology.orchestra.run.smithi176.stdout:Install 148 Packages 2024-09-12T02:34:57.875 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrade 8 Packages 2024-09-12T02:34:57.875 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:34:57.875 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 226 M 2024-09-12T02:34:57.876 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-12T02:34:57.919 INFO:teuthology.orchestra.run.smithi018.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 7.3 MB/s | 3.4 MB 00:00 2024-09-12T02:34:57.958 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-09-12T02:34:57.958 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-09-12T02:34:58.452 INFO:teuthology.orchestra.run.smithi176.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 47 kB/s | 6.5 kB 00:00 2024-09-12T02:34:58.627 INFO:teuthology.orchestra.run.smithi176.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 5.0 MB/s | 897 kB 00:00 2024-09-12T02:34:58.719 INFO:teuthology.orchestra.run.smithi176.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.5 MB/s | 145 kB 00:00 2024-09-12T02:34:58.769 INFO:teuthology.orchestra.run.smithi018.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 2.5 MB/s | 2.3 MB 00:00 2024-09-12T02:34:58.803 INFO:teuthology.orchestra.run.smithi176.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-12T02:34:58.878 INFO:teuthology.orchestra.run.smithi018.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 375 kB/s | 41 kB 00:00 2024-09-12T02:34:58.903 INFO:teuthology.orchestra.run.smithi176.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 15 MB/s | 1.5 MB 00:00 2024-09-12T02:34:58.962 INFO:teuthology.orchestra.run.smithi018.stdout:(152/156): NetworkManager-libnm-1.49.90-1.el9.x 1.7 MB/s | 1.8 MB 00:01 2024-09-12T02:34:58.962 INFO:teuthology.orchestra.run.smithi176.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 9.9 MB/s | 2.4 MB 00:00 2024-09-12T02:34:59.006 INFO:teuthology.orchestra.run.smithi018.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 1.9 MB/s | 249 kB 00:00 2024-09-12T02:34:59.103 INFO:teuthology.orchestra.run.smithi018.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 9.6 MB/s | 1.4 MB 00:00 2024-09-12T02:34:59.179 INFO:teuthology.orchestra.run.smithi176.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-12T02:34:59.488 INFO:teuthology.orchestra.run.smithi176.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 18 MB/s | 21 MB 00:01 2024-09-12T02:34:59.538 INFO:teuthology.orchestra.run.smithi176.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 506 kB/s | 25 kB 00:00 2024-09-12T02:34:59.712 INFO:teuthology.orchestra.run.smithi018.stdout:(155/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.6 MB/s | 16 MB 00:04 2024-09-12T02:34:59.863 INFO:teuthology.orchestra.run.smithi176.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 19 MB/s | 17 MB 00:00 2024-09-12T02:34:59.913 INFO:teuthology.orchestra.run.smithi176.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-12T02:34:59.972 INFO:teuthology.orchestra.run.smithi176.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 463 kB/s | 27 kB 00:00 2024-09-12T02:35:00.022 INFO:teuthology.orchestra.run.smithi176.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 639 kB/s | 32 kB 00:00 2024-09-12T02:35:00.112 INFO:teuthology.orchestra.run.smithi018.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.2 MB/s | 2.4 MB 00:01 2024-09-12T02:35:00.117 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:35:00.118 INFO:teuthology.orchestra.run.smithi018.stdout:Total 14 MB/s | 226 MB 00:16 2024-09-12T02:35:00.122 INFO:teuthology.orchestra.run.smithi176.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 7.3 MB/s | 752 kB 00:00 2024-09-12T02:35:00.181 INFO:teuthology.orchestra.run.smithi176.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 163 kB 00:00 2024-09-12T02:35:00.248 INFO:teuthology.orchestra.run.smithi176.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 127 kB 00:00 2024-09-12T02:35:00.323 INFO:teuthology.orchestra.run.smithi176.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 6.6 MB/s | 506 kB 00:00 2024-09-12T02:35:00.607 INFO:teuthology.orchestra.run.smithi176.stdout:(18/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 19 MB/s | 5.3 MB 00:00 2024-09-12T02:35:00.716 INFO:teuthology.orchestra.run.smithi176.stdout:(19/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 6.9 MB/s | 11 MB 00:01 2024-09-12T02:35:00.741 INFO:teuthology.orchestra.run.smithi176.stdout:(20/156): python3-ceph-argparse-19.1.1-298.gb53 338 kB/s | 45 kB 00:00 2024-09-12T02:35:00.766 INFO:teuthology.orchestra.run.smithi176.stdout:(21/156): python3-ceph-common-19.1.1-298.gb53b6 2.6 MB/s | 136 kB 00:00 2024-09-12T02:35:00.791 INFO:teuthology.orchestra.run.smithi176.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 3.1 MB/s | 162 kB 00:00 2024-09-12T02:35:00.817 INFO:teuthology.orchestra.run.smithi176.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 6.2 MB/s | 321 kB 00:00 2024-09-12T02:35:00.842 INFO:teuthology.orchestra.run.smithi176.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.9 MB/s | 301 kB 00:00 2024-09-12T02:35:00.867 INFO:teuthology.orchestra.run.smithi176.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T02:35:00.892 INFO:teuthology.orchestra.run.smithi176.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T02:35:00.943 INFO:teuthology.orchestra.run.smithi176.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 3.4 MB/s | 171 kB 00:00 2024-09-12T02:35:01.018 INFO:teuthology.orchestra.run.smithi176.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 424 kB/s | 32 kB 00:00 2024-09-12T02:35:01.093 INFO:teuthology.orchestra.run.smithi176.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.9 MB/s | 146 kB 00:00 2024-09-12T02:35:01.143 INFO:teuthology.orchestra.run.smithi176.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-12T02:35:01.628 INFO:teuthology.orchestra.run.smithi176.stdout:(31/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 23 MB/s | 49 MB 00:02 2024-09-12T02:35:01.695 INFO:teuthology.orchestra.run.smithi176.stdout:(32/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 5.9 MB/s | 3.6 MB 00:00 2024-09-12T02:35:01.720 INFO:teuthology.orchestra.run.smithi176.stdout:(33/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.7 MB/s | 249 kB 00:00 2024-09-12T02:35:01.745 INFO:teuthology.orchestra.run.smithi176.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 986 kB/s | 49 kB 00:00 2024-09-12T02:35:01.771 INFO:teuthology.orchestra.run.smithi176.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 328 kB/s | 16 kB 00:00 2024-09-12T02:35:01.796 INFO:teuthology.orchestra.run.smithi176.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.6 MB/s | 285 kB 00:00 2024-09-12T02:35:01.829 INFO:teuthology.orchestra.run.smithi176.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 13 MB/s | 765 kB 00:00 2024-09-12T02:35:01.855 INFO:teuthology.orchestra.run.smithi176.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 312 kB/s | 18 kB 00:00 2024-09-12T02:35:01.988 INFO:teuthology.orchestra.run.smithi176.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 8.8 MB/s | 7.4 MB 00:00 2024-09-12T02:35:02.223 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-12T02:35:02.422 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-12T02:35:02.422 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-12T02:35:02.572 INFO:teuthology.orchestra.run.smithi176.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 108 kB/s | 80 kB 00:00 2024-09-12T02:35:02.722 INFO:teuthology.orchestra.run.smithi176.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 260 kB/s | 191 kB 00:00 2024-09-12T02:35:02.873 INFO:teuthology.orchestra.run.smithi176.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 787 kB/s | 801 kB 00:01 2024-09-12T02:35:03.406 INFO:teuthology.orchestra.run.smithi176.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 304 kB/s | 253 kB 00:00 2024-09-12T02:35:03.531 INFO:teuthology.orchestra.run.smithi176.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 162 kB/s | 106 kB 00:00 2024-09-12T02:35:03.682 INFO:teuthology.orchestra.run.smithi176.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-12T02:35:04.098 INFO:teuthology.orchestra.run.smithi176.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 195 kB/s | 135 kB 00:00 2024-09-12T02:35:04.232 INFO:teuthology.orchestra.run.smithi176.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 178 kB/s | 125 kB 00:00 2024-09-12T02:35:04.299 INFO:teuthology.orchestra.run.smithi176.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-09-12T02:35:04.341 INFO:teuthology.orchestra.run.smithi176.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-12T02:35:04.383 INFO:teuthology.orchestra.run.smithi176.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 520 kB/s | 22 kB 00:00 2024-09-12T02:35:04.416 INFO:teuthology.orchestra.run.smithi176.stdout:(51/156): python3-urllib3-1.26.5-6.el9.noarch.r 292 kB/s | 215 kB 00:00 2024-09-12T02:35:04.450 INFO:teuthology.orchestra.run.smithi176.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-09-12T02:35:04.475 INFO:teuthology.orchestra.run.smithi176.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-12T02:35:04.517 INFO:teuthology.orchestra.run.smithi176.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 327 kB/s | 33 kB 00:00 2024-09-12T02:35:04.542 INFO:teuthology.orchestra.run.smithi176.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-12T02:35:04.568 INFO:teuthology.orchestra.run.smithi176.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-12T02:35:04.593 INFO:teuthology.orchestra.run.smithi176.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-12T02:35:04.651 INFO:teuthology.orchestra.run.smithi176.stdout:(58/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-09-12T02:35:04.668 INFO:teuthology.orchestra.run.smithi176.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-09-12T02:35:04.670 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-09-12T02:35:04.702 INFO:teuthology.orchestra.run.smithi176.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 11 MB/s | 581 kB 00:00 2024-09-12T02:35:04.727 INFO:teuthology.orchestra.run.smithi176.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-12T02:35:04.752 INFO:teuthology.orchestra.run.smithi176.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-12T02:35:04.778 INFO:teuthology.orchestra.run.smithi176.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-12T02:35:04.784 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:35:04.803 INFO:teuthology.orchestra.run.smithi176.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-12T02:35:04.822 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:35:04.828 INFO:teuthology.orchestra.run.smithi176.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 765 kB/s | 38 kB 00:00 2024-09-12T02:35:04.862 INFO:teuthology.orchestra.run.smithi176.stdout:(66/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-12T02:35:04.871 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-12T02:35:04.872 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-12T02:35:04.876 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:35:04.910 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:35:04.935 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:35:04.946 INFO:teuthology.orchestra.run.smithi176.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-12T02:35:04.978 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:35:05.012 INFO:teuthology.orchestra.run.smithi176.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 24 MB/s | 4.9 MB 00:00 2024-09-12T02:35:05.046 INFO:teuthology.orchestra.run.smithi176.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-12T02:35:05.071 INFO:teuthology.orchestra.run.smithi176.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-12T02:35:05.105 INFO:teuthology.orchestra.run.smithi176.stdout:(71/156): postgresql-13.16-1.el9.x86_64.rpm 6.5 MB/s | 1.6 MB 00:00 2024-09-12T02:35:05.147 INFO:teuthology.orchestra.run.smithi176.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-12T02:35:05.181 INFO:teuthology.orchestra.run.smithi176.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-12T02:35:05.223 INFO:teuthology.orchestra.run.smithi176.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-12T02:35:05.298 INFO:teuthology.orchestra.run.smithi176.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-12T02:35:05.323 INFO:teuthology.orchestra.run.smithi176.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-12T02:35:05.335 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:35:05.348 INFO:teuthology.orchestra.run.smithi176.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-12T02:35:05.374 INFO:teuthology.orchestra.run.smithi176.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 509 kB/s | 26 kB 00:00 2024-09-12T02:35:05.399 INFO:teuthology.orchestra.run.smithi176.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-12T02:35:05.424 INFO:teuthology.orchestra.run.smithi176.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-12T02:35:05.449 INFO:teuthology.orchestra.run.smithi176.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-12T02:35:05.460 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:35:05.525 INFO:teuthology.orchestra.run.smithi176.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-12T02:35:05.550 INFO:teuthology.orchestra.run.smithi176.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-12T02:35:05.575 INFO:teuthology.orchestra.run.smithi176.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-12T02:35:05.585 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:35:05.600 INFO:teuthology.orchestra.run.smithi176.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-12T02:35:05.626 INFO:teuthology.orchestra.run.smithi176.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-12T02:35:05.628 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:35:05.651 INFO:teuthology.orchestra.run.smithi176.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-12T02:35:05.677 INFO:teuthology.orchestra.run.smithi176.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-12T02:35:05.710 INFO:teuthology.orchestra.run.smithi176.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-12T02:35:05.729 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:35:05.735 INFO:teuthology.orchestra.run.smithi176.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-09-12T02:35:05.758 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:35:05.760 INFO:teuthology.orchestra.run.smithi176.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T02:35:05.836 INFO:teuthology.orchestra.run.smithi176.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-12T02:35:05.861 INFO:teuthology.orchestra.run.smithi176.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-12T02:35:05.886 INFO:teuthology.orchestra.run.smithi176.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-12T02:35:05.911 INFO:teuthology.orchestra.run.smithi176.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T02:35:05.914 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:35:05.937 INFO:teuthology.orchestra.run.smithi176.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-12T02:35:05.962 INFO:teuthology.orchestra.run.smithi176.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-12T02:35:05.972 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:35:05.987 INFO:teuthology.orchestra.run.smithi176.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T02:35:05.999 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:35:06.012 INFO:teuthology.orchestra.run.smithi176.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T02:35:06.046 INFO:teuthology.orchestra.run.smithi176.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-12T02:35:06.063 INFO:teuthology.orchestra.run.smithi176.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T02:35:06.080 INFO:teuthology.orchestra.run.smithi176.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-12T02:35:06.105 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:35:06.134 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:35:06.196 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:35:06.218 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:35:06.242 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:35:06.297 INFO:teuthology.orchestra.run.smithi176.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-12T02:35:06.356 INFO:teuthology.orchestra.run.smithi176.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T02:35:06.381 INFO:teuthology.orchestra.run.smithi176.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-12T02:35:06.406 INFO:teuthology.orchestra.run.smithi176.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-12T02:35:06.428 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:35:06.506 INFO:teuthology.orchestra.run.smithi176.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 44 MB/s | 4.4 MB 00:00 2024-09-12T02:35:06.532 INFO:teuthology.orchestra.run.smithi176.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-12T02:35:06.549 INFO:teuthology.orchestra.run.smithi176.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-12T02:35:06.568 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:35:06.574 INFO:teuthology.orchestra.run.smithi176.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T02:35:06.599 INFO:teuthology.orchestra.run.smithi176.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T02:35:06.633 INFO:teuthology.orchestra.run.smithi176.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-12T02:35:06.667 INFO:teuthology.orchestra.run.smithi176.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-12T02:35:06.692 INFO:teuthology.orchestra.run.smithi176.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T02:35:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:35:06.717 INFO:teuthology.orchestra.run.smithi176.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T02:35:06.742 INFO:teuthology.orchestra.run.smithi176.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 571 kB/s | 14 kB 00:00 2024-09-12T02:35:06.769 INFO:teuthology.orchestra.run.smithi176.stdout:(117/156): lua-devel-5.4.4-4.el9.x86_64.rpm 32 kB/s | 22 kB 00:00 2024-09-12T02:35:06.801 INFO:teuthology.orchestra.run.smithi176.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-12T02:35:06.805 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:35:06.835 INFO:teuthology.orchestra.run.smithi176.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 9.4 MB/s | 303 kB 00:00 2024-09-12T02:35:06.851 INFO:teuthology.orchestra.run.smithi176.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 13 MB/s | 220 kB 00:00 2024-09-12T02:35:06.876 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:35:06.877 INFO:teuthology.orchestra.run.smithi176.stdout:(121/156): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-09-12T02:35:06.902 INFO:teuthology.orchestra.run.smithi176.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T02:35:06.927 INFO:teuthology.orchestra.run.smithi176.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-12T02:35:06.953 INFO:teuthology.orchestra.run.smithi176.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-12T02:35:06.978 INFO:teuthology.orchestra.run.smithi176.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-12T02:35:07.003 INFO:teuthology.orchestra.run.smithi176.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-12T02:35:07.028 INFO:teuthology.orchestra.run.smithi176.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 793 kB/s | 20 kB 00:00 2024-09-12T02:35:07.079 INFO:teuthology.orchestra.run.smithi176.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-12T02:35:07.104 INFO:teuthology.orchestra.run.smithi176.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T02:35:07.105 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:35:07.129 INFO:teuthology.orchestra.run.smithi176.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T02:35:07.155 INFO:teuthology.orchestra.run.smithi176.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T02:35:07.188 INFO:teuthology.orchestra.run.smithi176.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-12T02:35:07.205 INFO:teuthology.orchestra.run.smithi176.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 1.0 MB/s | 16 kB 00:00 2024-09-12T02:35:07.229 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:35:07.231 INFO:teuthology.orchestra.run.smithi176.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T02:35:07.247 INFO:teuthology.orchestra.run.smithi176.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-09-12T02:35:07.273 INFO:teuthology.orchestra.run.smithi176.stdout:(136/156): protobuf-compiler-3.14.0-13.el9.x86_ 724 kB/s | 863 kB 00:01 2024-09-12T02:35:07.298 INFO:teuthology.orchestra.run.smithi176.stdout:(137/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-12T02:35:07.323 INFO:teuthology.orchestra.run.smithi176.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 413 kB/s | 31 kB 00:00 2024-09-12T02:35:07.330 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:35:07.357 INFO:teuthology.orchestra.run.smithi176.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-12T02:35:07.359 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:35:07.382 INFO:teuthology.orchestra.run.smithi176.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-12T02:35:07.403 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:35:07.408 INFO:teuthology.orchestra.run.smithi176.stdout:(141/156): python3-rsa-4.9-2.el9.noarch.rpm 543 kB/s | 59 kB 00:00 2024-09-12T02:35:07.433 INFO:teuthology.orchestra.run.smithi176.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 1.0 MB/s | 74 kB 00:00 2024-09-12T02:35:07.458 INFO:teuthology.orchestra.run.smithi176.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-12T02:35:07.483 INFO:teuthology.orchestra.run.smithi176.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-12T02:35:07.486 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:35:07.509 INFO:teuthology.orchestra.run.smithi176.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-12T02:35:07.534 INFO:teuthology.orchestra.run.smithi176.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T02:35:07.537 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:35:07.568 INFO:teuthology.orchestra.run.smithi176.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-12T02:35:07.577 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:35:07.610 INFO:teuthology.orchestra.run.smithi176.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T02:35:07.621 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:35:07.653 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:35:07.697 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:35:07.768 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:35:07.821 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:35:07.842 INFO:teuthology.orchestra.run.smithi176.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-12T02:35:07.859 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:35:07.895 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:35:07.902 INFO:teuthology.orchestra.run.smithi176.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 9.5 MB/s | 3.2 MB 00:00 2024-09-12T02:35:07.973 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:35:08.005 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:35:08.049 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:35:08.077 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:35:08.149 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:35:08.201 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:35:08.286 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:35:08.439 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:35:08.468 INFO:teuthology.orchestra.run.smithi176.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 72 kB/s | 41 kB 00:00 2024-09-12T02:35:08.503 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:35:08.627 INFO:teuthology.orchestra.run.smithi176.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 2.3 MB/s | 2.3 MB 00:01 2024-09-12T02:35:08.902 INFO:teuthology.orchestra.run.smithi176.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 1.7 MB/s | 1.8 MB 00:01 2024-09-12T02:35:09.058 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:35:09.141 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:35:09.177 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:35:09.220 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:35:09.258 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:35:09.300 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:35:09.336 INFO:teuthology.orchestra.run.smithi176.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 287 kB/s | 249 kB 00:00 2024-09-12T02:35:09.460 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:35:09.520 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:35:09.576 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:35:09.658 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:35:09.694 INFO:teuthology.orchestra.run.smithi176.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.3 MB/s | 1.4 MB 00:01 2024-09-12T02:35:09.704 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:35:09.740 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:35:09.796 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:35:09.831 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:35:09.875 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:35:09.917 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:35:09.927 INFO:teuthology.orchestra.run.smithi176.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-09-12T02:35:09.935 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:35:09.935 INFO:teuthology.orchestra.run.smithi176.stdout:Total 19 MB/s | 226 MB 00:12 2024-09-12T02:35:10.057 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:35:10.101 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:35:10.143 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:35:10.257 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:35:10.536 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:35:10.610 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:35:10.645 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:35:10.675 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:35:10.759 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:35:10.892 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:35:10.932 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:35:10.960 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:35:10.995 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:35:11.034 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:35:11.065 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:35:11.095 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:35:11.125 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-12T02:35:11.138 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:35:11.180 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:35:11.222 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:35:11.256 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:35:11.276 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-12T02:35:11.276 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-12T02:35:11.345 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:35:11.395 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:35:11.434 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:35:11.549 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:35:11.603 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:35:12.036 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-12T02:35:12.267 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:35:12.361 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:35:12.416 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:35:12.450 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:35:12.552 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:35:12.591 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:35:12.613 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:35:12.658 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:35:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:35:12.748 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:35:12.779 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:35:12.810 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:35:12.836 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:35:12.867 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:35:13.093 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-12T02:35:13.093 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-12T02:35:13.204 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:35:13.241 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:35:13.264 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:35:13.322 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:35:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:35:13.543 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:35:13.578 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:35:13.726 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:35:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:35:13.976 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:35:14.001 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:35:14.056 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:35:14.082 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:35:14.142 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:35:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:35:14.250 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:35:14.334 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:35:14.385 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:35:14.432 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:35:14.829 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:35:15.048 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:35:15.234 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:35:15.366 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:35:15.438 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:35:15.522 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:35:15.526 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:35:15.550 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:35:15.583 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:35:15.817 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:35:15.912 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:35:15.954 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:35:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:35:16.046 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:35:16.076 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:35:16.081 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:35:16.112 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:35:16.149 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:35:16.195 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:35:16.279 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:35:16.331 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:35:16.371 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:35:16.424 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:35:16.462 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:35:16.521 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:35:16.613 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:35:16.619 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:35:16.649 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:35:16.674 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:35:16.708 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:35:16.719 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:35:16.755 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:35:16.758 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:35:16.847 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:35:16.887 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:35:16.932 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:35:16.967 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:35:17.062 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:35:17.121 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:35:17.219 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:35:17.401 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:35:17.478 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:35:18.152 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:35:18.255 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:35:18.305 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:35:18.357 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:35:18.396 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:35:18.449 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:35:18.662 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:35:18.724 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:35:18.794 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:35:18.889 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:35:18.941 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:35:19.011 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:35:19.070 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:35:19.111 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:35:19.157 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:35:19.163 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:35:19.197 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:35:19.207 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:35:19.337 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-12T02:35:19.386 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:35:19.441 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:35:19.456 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:35:19.482 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:35:19.563 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:35:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:35:19.692 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:35:19.742 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:35:19.756 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:35:19.771 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:35:19.773 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:35:19.796 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:35:19.799 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:35:19.817 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:35:19.824 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:35:19.876 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:35:19.891 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:35:19.891 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:35:19.892 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:35:19.892 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:35:19.909 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:35:19.927 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:35:20.071 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:35:20.121 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:35:20.158 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:35:20.202 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:35:20.206 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:35:20.250 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:35:20.289 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:35:20.317 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:35:20.326 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:35:20.360 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:35:20.419 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:35:20.437 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:35:20.468 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:35:20.479 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:35:20.511 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:35:20.551 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:35:20.581 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:35:20.614 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:35:20.671 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:35:20.707 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:35:20.727 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:35:20.786 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:35:20.814 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:35:20.860 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:35:20.917 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:35:20.930 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:35:20.940 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:35:21.002 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:35:21.024 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:35:21.047 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:35:21.242 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:35:21.390 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:35:21.539 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:35:21.631 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:35:21.707 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:35:21.870 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:35:21.922 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:35:21.932 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:35:21.956 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:35:22.036 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:35:22.077 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:35:22.131 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:35:22.149 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:35:22.162 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:35:22.205 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:35:22.228 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:35:22.269 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:35:22.317 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:35:22.336 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:35:22.349 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:35:22.376 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:35:22.393 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:35:22.437 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:35:22.462 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:35:22.529 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:35:22.592 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:35:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:35:22.623 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:35:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:35:22.658 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:35:22.734 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:35:22.756 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:35:22.770 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:35:22.813 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:35:22.842 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:35:22.910 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:35:22.972 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:35:23.055 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:35:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:35:23.258 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:35:23.615 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:35:23.765 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:35:23.775 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:35:23.861 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:35:23.900 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:35:23.943 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:35:23.981 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:35:24.022 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:35:24.168 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:35:24.226 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:35:24.280 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:35:24.345 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:35:24.385 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:35:24.421 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:35:24.469 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:35:24.505 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:35:24.564 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:35:24.606 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:35:24.741 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:35:24.791 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:35:24.833 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:35:24.936 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:35:24.975 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:35:25.190 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:35:25.224 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:35:25.248 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:35:25.325 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:35:25.406 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:35:25.449 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:35:25.489 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:35:25.503 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:35:25.516 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:35:25.539 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:35:25.551 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:35:25.572 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:35:25.590 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:35:25.622 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:35:25.652 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:35:25.686 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:35:25.728 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:35:25.778 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:35:25.812 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:35:25.898 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:35:25.935 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:35:25.942 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:35:25.974 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:35:25.984 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:35:26.076 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:35:26.105 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:35:26.125 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:35:26.148 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:35:26.198 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:35:26.754 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:35:26.786 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:35:26.841 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:35:26.889 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:35:26.922 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:35:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:35:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:35:27.022 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:35:27.077 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:35:27.121 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:35:27.209 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:35:27.250 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:35:27.441 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:35:27.472 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:35:27.549 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:35:28.175 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:35:28.287 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:35:29.500 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:35:29.578 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:35:29.606 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:35:29.639 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:35:29.813 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:35:29.870 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:35:29.949 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:35:29.994 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:35:30.083 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:35:30.205 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:35:30.259 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:35:30.540 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:35:30.590 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:35:30.714 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:35:30.714 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:35:30.715 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:35:30.715 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:35:30.737 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:35:30.758 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:35:30.771 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:35:30.842 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:35:30.865 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:35:32.010 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:35:32.011 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /sys 2024-09-12T02:35:32.011 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /proc 2024-09-12T02:35:32.011 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /mnt 2024-09-12T02:35:32.011 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /var/tmp 2024-09-12T02:35:32.011 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /home 2024-09-12T02:35:32.011 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /root 2024-09-12T02:35:32.011 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /tmp 2024-09-12T02:35:32.011 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:35:32.196 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:35:32.213 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:35:32.213 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:32.214 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:35:32.214 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:35:33.103 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:35:33.145 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:35:33.689 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:35:33.723 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:35:33.749 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:35:33.776 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:35:33.776 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:33.776 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:35:33.776 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:35:33.777 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:35:33.777 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:35:33.817 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:35:33.817 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:35:33.817 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:35:33.818 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:35:33.849 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:35:34.009 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:35:34.032 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:35:34.032 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:34.032 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:35:34.032 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:35:34.033 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:35:34.033 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:35:34.492 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:35:34.516 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:35:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:35:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:35:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:35:34.516 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:35:34.631 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:35:34.689 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:35:34.753 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:35:34.945 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:35:35.002 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:35:35.082 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:35:35.171 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:35:35.313 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:35:35.369 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:35:35.400 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:35:35.428 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:35:35.794 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:35:35.826 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:35:35.858 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:35:35.922 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:35:35.949 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:35:37.058 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:35:37.093 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:35:38.113 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:35:38.143 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:35:38.251 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:35:38.421 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:35:38.445 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:35:38.469 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:35:38.469 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:38.469 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:35:38.469 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:35:38.469 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:35:38.469 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:35:38.521 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:35:38.533 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:35:38.635 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:35:38.687 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:35:39.668 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:35:39.698 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:35:39.722 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:35:39.722 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:39.722 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:35:39.722 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:35:39.723 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:35:39.723 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:35:39.766 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:35:39.789 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:35:39.789 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:39.789 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:35:39.789 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:35:39.841 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:35:39.864 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:35:39.865 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:39.865 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:35:39.865 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:35:39.865 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:35:39.865 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:35:40.184 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:35:40.208 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:35:40.208 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:40.208 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:35:40.208 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:35:40.208 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:35:40.208 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:35:44.190 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:35:44.190 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /sys 2024-09-12T02:35:44.190 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /proc 2024-09-12T02:35:44.190 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /mnt 2024-09-12T02:35:44.191 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /var/tmp 2024-09-12T02:35:44.191 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /home 2024-09-12T02:35:44.191 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /root 2024-09-12T02:35:44.191 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /tmp 2024-09-12T02:35:44.191 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:35:44.421 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:35:44.457 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:35:44.458 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:44.458 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:35:44.458 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:35:45.030 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:35:45.071 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:35:45.112 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:35:45.143 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:35:45.171 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:35:45.389 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:35:45.424 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:35:45.424 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /sys 2024-09-12T02:35:45.425 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /proc 2024-09-12T02:35:45.425 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /mnt 2024-09-12T02:35:45.425 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /var/tmp 2024-09-12T02:35:45.425 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /home 2024-09-12T02:35:45.425 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /root 2024-09-12T02:35:45.425 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /tmp 2024-09-12T02:35:45.425 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:35:45.425 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:35:45.456 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:35:45.485 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:35:45.532 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:35:45.603 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:35:45.619 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:35:45.619 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:45.619 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:35:45.619 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:35:46.139 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:35:46.186 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:35:46.198 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:35:46.198 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:46.199 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:35:46.199 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:35:46.199 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:35:46.199 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:35:46.229 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:35:46.250 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:35:46.457 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:35:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:35:46.509 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:46.509 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:35:46.509 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:35:46.509 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:35:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:35:47.016 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:35:47.067 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:35:47.067 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:47.067 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:35:47.067 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:35:47.067 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:35:47.068 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:35:47.097 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:35:47.123 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:35:47.123 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:47.123 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:35:47.123 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:35:47.123 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:35:47.124 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:35:47.127 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:35:47.200 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:35:47.234 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:35:47.275 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:35:47.294 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:35:47.348 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:35:47.359 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:35:47.367 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:35:47.370 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:35:47.371 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:47.371 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:35:47.371 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:35:47.371 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:35:47.371 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:35:47.387 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:35:47.413 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:35:47.447 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:35:47.447 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:35:47.531 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:35:47.531 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:35:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:35:47.623 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:35:47.648 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:35:47.654 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:35:47.654 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:35:47.662 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:35:47.750 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:35:47.807 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:35:47.830 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:35:47.830 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:47.830 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:35:47.830 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:35:47.830 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:35:47.830 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:35:47.833 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:35:47.833 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:35:47.860 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:35:47.917 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:35:47.937 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:35:47.984 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:35:47.993 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:35:48.030 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:35:48.049 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:35:48.079 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:35:48.118 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:35:48.143 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:35:48.243 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:35:48.299 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:35:48.376 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:35:48.465 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:35:48.604 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:35:48.649 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:35:48.681 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:35:48.709 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:35:48.714 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:35:48.752 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:35:48.793 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:35:48.871 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:35:48.899 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:35:49.159 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:35:49.191 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:35:49.222 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:35:49.293 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:35:49.330 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:35:50.199 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:35:50.234 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:35:50.372 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:35:50.407 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:35:51.368 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:35:51.394 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:35:51.399 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:35:51.426 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:35:51.500 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:35:51.570 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:35:51.670 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:35:51.701 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:35:51.725 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:35:51.725 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:51.725 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:35:51.725 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:35:51.725 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:35:51.726 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:35:51.757 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:35:51.777 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:35:51.786 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:35:51.788 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:35:51.837 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:35:51.838 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:51.838 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:35:51.838 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:35:51.838 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:35:51.838 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:35:51.887 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:35:51.904 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:35:51.930 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:35:51.936 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:35:52.042 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:35:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:35:52.869 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:35:52.904 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:35:52.928 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:35:52.928 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:52.928 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:35:52.928 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:35:52.928 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:35:52.928 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:35:52.972 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:35:52.994 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:35:52.995 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:52.995 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:35:52.995 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:35:53.039 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:35:53.062 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:35:53.062 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:53.062 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:35:53.062 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:35:53.063 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:35:53.063 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:35:53.176 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:35:53.206 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:35:53.258 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:35:53.258 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:53.259 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:35:53.259 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:35:53.259 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:35:53.259 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:35:53.307 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:35:53.364 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:35:53.388 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:35:53.388 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:53.388 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:35:53.388 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:35:53.388 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:35:53.388 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:35:53.416 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:35:53.467 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:35:53.467 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:53.468 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:35:53.468 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:35:53.468 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:35:53.468 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:35:53.649 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:35:53.649 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:35:53.649 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:35:53.649 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:35:53.650 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:35:53.650 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:35:53.650 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:35:53.650 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:35:53.650 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:35:53.650 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:35:53.650 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:35:53.650 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:35:53.650 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:35:53.650 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:35:53.650 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:35:53.650 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:35:53.651 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:35:53.651 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:35:53.651 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:35:53.651 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:35:53.651 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:35:53.651 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:35:53.651 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:35:53.651 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:35:53.651 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:35:53.651 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:35:53.652 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:35:53.652 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:35:53.652 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:35:53.652 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:35:53.652 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:35:53.652 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:35:53.652 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:35:53.652 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:35:53.652 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:35:53.652 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:35:53.652 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:35:53.653 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:35:53.653 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:35:53.653 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:35:53.653 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:35:53.653 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:35:53.653 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:35:53.653 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:35:53.653 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:35:53.653 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:35:53.653 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:35:53.654 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:35:53.654 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:35:53.654 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:35:53.654 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:35:53.654 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:35:53.654 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:35:53.654 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:35:53.654 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:35:53.654 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:35:53.654 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:35:53.654 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:35:53.655 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:35:53.655 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:35:53.655 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:35:53.655 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:35:53.655 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:35:53.655 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:35:53.655 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:35:53.655 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:35:53.655 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:35:53.655 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:35:53.656 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:35:53.656 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:35:53.656 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:35:53.656 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:35:53.656 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:35:53.656 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:35:53.656 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:35:53.656 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:35:53.656 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:35:53.656 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:35:53.657 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:35:53.657 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:35:53.657 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:35:53.657 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:35:53.657 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:35:53.657 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:35:53.657 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:35:53.657 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:35:53.657 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:35:53.657 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:35:53.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:35:53.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:35:53.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:35:53.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:35:53.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:35:53.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:35:53.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:35:53.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:35:53.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:35:53.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:35:53.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:35:53.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:35:53.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:35:53.658 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:35:53.659 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:35:53.659 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:35:53.659 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:35:53.659 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:35:53.659 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:35:53.659 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:35:53.659 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:35:53.659 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:35:53.659 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:35:53.659 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:35:53.659 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:35:53.659 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:35:53.659 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:35:53.660 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:35:53.660 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:35:53.660 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:35:53.660 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:35:53.660 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:35:53.660 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:35:53.660 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:35:53.660 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:35:53.660 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:35:53.660 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:35:53.660 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:35:53.660 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:35:53.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:35:53.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:35:53.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:35:53.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:35:53.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:35:53.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:35:53.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:35:53.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:35:53.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:35:53.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:35:53.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:35:53.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:35:53.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:35:53.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:35:53.662 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:35:53.662 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:35:53.662 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:35:53.662 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:35:53.662 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:35:53.662 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:35:53.662 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:35:53.662 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:35:53.662 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:35:53.662 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:35:53.662 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:35:53.662 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:35:53.662 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:35:53.662 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:35:53.662 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:35:53.663 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:35:53.663 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:35:53.663 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:35:53.663 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:35:53.663 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:35:53.663 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:35:53.663 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:35:53.663 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:35:53.817 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:35:53.868 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:35:53.869 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:35:53.869 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:35:53.869 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:35:53.869 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:35:53.869 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:35:56.100 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:35:56.100 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:35:56.100 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2024-09-12T02:35:56.100 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:35:56.100 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:35:56.100 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:35:56.100 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:35:56.100 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.100 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.101 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:35:56.101 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:35:56.101 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-09-12T02:35:56.101 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:35:56.101 INFO:teuthology.orchestra.run.smithi062.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:35:56.101 INFO:teuthology.orchestra.run.smithi062.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:35:56.101 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:35:56.101 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.101 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.101 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.101 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.101 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:35:56.101 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.102 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.102 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.102 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:35:56.102 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:35:56.102 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:35:56.102 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:35:56.102 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:35:56.102 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.102 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.102 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:35:56.102 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.102 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.102 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.103 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:35:56.103 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:35:56.103 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.103 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.103 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:35:56.103 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:35:56.103 INFO:teuthology.orchestra.run.smithi062.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:35:56.103 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:35:56.103 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:35:56.103 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:35:56.103 INFO:teuthology.orchestra.run.smithi062.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:35:56.103 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:35:56.104 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:35:56.104 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:35:56.104 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:35:56.104 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:35:56.104 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.104 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.104 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.104 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:35:56.104 INFO:teuthology.orchestra.run.smithi062.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:35:56.104 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:35:56.104 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:35:56.104 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:35:56.105 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.105 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.105 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:35:56.105 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.105 INFO:teuthology.orchestra.run.smithi062.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:35:56.105 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:35:56.105 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:35:56.105 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:35:56.105 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:35:56.105 INFO:teuthology.orchestra.run.smithi062.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:35:56.105 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:35:56.105 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:35:56.105 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:35:56.106 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:35:56.106 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:35:56.106 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:35:56.106 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:35:56.106 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:35:56.106 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:35:56.106 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:35:56.106 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:35:56.106 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:35:56.106 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:35:56.106 INFO:teuthology.orchestra.run.smithi062.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:35:56.106 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:35:56.107 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:35:56.107 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:35:56.107 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.107 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.107 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.107 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:35:56.107 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:35:56.107 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:35:56.107 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:35:56.107 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:35:56.107 INFO:teuthology.orchestra.run.smithi062.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:35:56.107 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:35:56.107 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:35:56.108 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:35:56.108 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:35:56.108 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:35:56.108 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:35:56.108 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:35:56.108 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:35:56.108 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:35:56.108 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:35:56.108 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:35:56.108 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:35:56.108 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:35:56.108 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:35:56.109 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:35:56.109 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:35:56.109 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:35:56.109 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:35:56.109 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:35:56.109 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:35:56.109 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:35:56.109 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:35:56.109 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:35:56.109 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:35:56.109 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:35:56.109 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:35:56.109 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:35:56.110 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:35:56.110 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:35:56.110 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:35:56.110 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:35:56.110 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:35:56.110 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:35:56.110 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:35:56.110 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.110 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.110 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:35:56.110 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:35:56.110 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:35:56.110 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.110 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:35:56.111 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:35:56.111 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:35:56.111 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:35:56.111 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:35:56.111 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:35:56.111 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:35:56.111 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:35:56.111 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:35:56.111 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:35:56.111 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:35:56.111 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:35:56.111 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:35:56.111 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:35:56.112 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:35:56.112 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.112 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.112 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:35:56.112 INFO:teuthology.orchestra.run.smithi062.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:35:56.112 INFO:teuthology.orchestra.run.smithi062.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:35:56.112 INFO:teuthology.orchestra.run.smithi062.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:35:56.112 INFO:teuthology.orchestra.run.smithi062.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:35:56.112 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:35:56.112 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:35:56.113 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:35:56.113 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:35:56.113 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-09-12T02:35:56.570 DEBUG:teuthology.parallel:result is None 2024-09-12T02:35:57.943 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:35:57.985 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:35:58.025 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:35:58.057 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:35:58.085 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:35:58.267 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:35:58.306 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:35:58.337 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:35:58.366 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:35:58.413 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:35:59.011 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:35:59.052 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:35:59.071 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:35:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:35:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:35:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:35:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:35:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:35:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:35:59.685 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:35:59.715 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:35:59.747 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:35:59.799 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:35:59.906 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:35:59.998 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:36:00.039 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:36:00.122 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:36:00.160 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:36:00.185 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:36:00.211 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:36:00.211 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:36:00.278 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:36:00.279 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:36:00.346 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:36:00.371 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:36:00.376 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:36:00.376 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:36:00.556 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:36:00.556 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:36:00.592 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:36:00.638 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:36:00.640 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:36:00.680 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:36:00.702 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:36:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:36:02.222 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:36:02.338 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:36:02.381 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:36:02.409 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:36:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:36:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:36:02.600 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:36:02.600 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:36:02.709 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:36:02.733 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:36:02.749 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:36:02.750 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:36:03.003 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:36:03.003 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:36:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:36:03.213 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:36:03.423 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:36:03.423 INFO:teuthology.orchestra.run.smithi018.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-12T02:36:03.423 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:36:06.264 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:36:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:36:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:36:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:36:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:36:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:36:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:36:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:36:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:36:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:36:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:36:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:36:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:36:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:36:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:36:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:36:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:36:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:36:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:36:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:36:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:36:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:36:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:36:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:36:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:36:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:36:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:36:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:36:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:36:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:36:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:36:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:36:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:36:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:36:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:36:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:36:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:36:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:36:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:36:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:36:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:36:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:36:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:36:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:36:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:36:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:36:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:36:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:36:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:36:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:36:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:36:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:36:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:36:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:36:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:36:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:36:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:36:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:36:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:36:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:36:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:36:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:36:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:36:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:36:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:36:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:36:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:36:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:36:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:36:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:36:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:36:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:36:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:36:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:36:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:36:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:36:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:36:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:36:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:36:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:36:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:36:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:36:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:36:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:36:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:36:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:36:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:36:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:36:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:36:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:36:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:36:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:36:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:36:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:36:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:36:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:36:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:36:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:36:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:36:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:36:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:36:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:36:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:36:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:36:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:36:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:36:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:36:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:36:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:36:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:36:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:36:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:36:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:36:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:36:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:36:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:36:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:36:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:36:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:36:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:36:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:36:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:36:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:36:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:36:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:36:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:36:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:36:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:36:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:36:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:36:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:36:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:36:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:36:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:36:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:36:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:36:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:36:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:36:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:36:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:36:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:36:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:36:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:36:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:36:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:36:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:36:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:36:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:36:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:36:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:36:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:36:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:36:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:36:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:36:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:36:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:36:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:36:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:36:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:36:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:36:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:36:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:36:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:36:06.278 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:36:09.074 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:36:09.074 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:36:09.075 INFO:teuthology.orchestra.run.smithi176.stdout:Upgraded: 2024-09-12T02:36:09.075 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:36:09.075 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:36:09.075 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:36:09.075 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:36:09.075 INFO:teuthology.orchestra.run.smithi176.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.075 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.075 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:36:09.075 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:36:09.075 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-12T02:36:09.075 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:36:09.075 INFO:teuthology.orchestra.run.smithi176.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:36:09.076 INFO:teuthology.orchestra.run.smithi176.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:36:09.076 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:36:09.076 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.076 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.076 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.076 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.076 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:09.076 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.076 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.076 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.076 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:09.076 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:09.076 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:09.077 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:09.077 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:09.077 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.077 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.077 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:09.077 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.077 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.077 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.077 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:09.077 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:09.077 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.077 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.078 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:09.078 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:36:09.078 INFO:teuthology.orchestra.run.smithi176.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:36:09.078 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:36:09.078 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:36:09.078 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:36:09.078 INFO:teuthology.orchestra.run.smithi176.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:36:09.078 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:36:09.078 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:36:09.078 INFO:teuthology.orchestra.run.smithi176.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:36:09.078 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:36:09.078 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:36:09.078 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.079 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.079 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.079 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:36:09.079 INFO:teuthology.orchestra.run.smithi176.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:36:09.079 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:36:09.079 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:36:09.079 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:36:09.079 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.079 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.079 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:36:09.079 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.079 INFO:teuthology.orchestra.run.smithi176.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:36:09.079 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:36:09.079 INFO:teuthology.orchestra.run.smithi176.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:36:09.080 INFO:teuthology.orchestra.run.smithi176.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:36:09.080 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:36:09.080 INFO:teuthology.orchestra.run.smithi176.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:36:09.080 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:36:09.080 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:36:09.080 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:36:09.080 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:36:09.080 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:36:09.080 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:36:09.080 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:36:09.080 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:36:09.080 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:36:09.080 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:36:09.081 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:36:09.081 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:36:09.081 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:36:09.081 INFO:teuthology.orchestra.run.smithi176.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:36:09.081 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:36:09.081 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:36:09.081 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:36:09.081 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.081 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.081 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.081 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:36:09.081 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:36:09.081 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:36:09.081 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:36:09.082 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:36:09.082 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:36:09.082 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:36:09.082 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:36:09.082 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:36:09.082 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:36:09.082 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:36:09.082 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:36:09.082 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:36:09.082 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:36:09.082 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:36:09.082 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:36:09.082 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:36:09.083 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:36:09.083 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:36:09.083 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:36:09.083 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:36:09.083 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:36:09.083 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:36:09.083 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:36:09.083 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:36:09.083 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:36:09.083 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:36:09.083 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:36:09.083 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:36:09.083 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:36:09.083 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:36:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:36:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:36:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:36:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:36:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:36:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:36:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:36:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:36:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:36:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:36:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:36:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:36:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:36:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:36:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:36:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:36:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:36:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:36:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:36:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:36:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:36:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:36:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:36:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:36:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:36:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:36:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:36:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:36:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:36:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:36:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:36:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:36:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:36:09.087 INFO:teuthology.orchestra.run.smithi176.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:36:09.087 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:36:09.087 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-12T02:36:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:36:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:36:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:36:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:36:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:36:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:36:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:36:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:36:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:36:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:36:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:36:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:36:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:36:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:36:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:36:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:36:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:36:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:36:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:36:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:36:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:36:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:36:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:36:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:36:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:36:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:36:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:36:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:36:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:36:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:36:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:36:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:36:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:36:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:36:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:36:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:36:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:36:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:36:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:36:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:36:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:36:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:36:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:36:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:36:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:36:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:36:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:36:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:36:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:36:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:36:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:36:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:36:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:36:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:36:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:36:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:36:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:36:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:36:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:36:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:36:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:36:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:36:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:36:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:36:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:36:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:36:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:36:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:36:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:36:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:36:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:36:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:36:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:36:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:36:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:36:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:36:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:36:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:36:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:36:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:36:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:36:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:36:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:36:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:36:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:36:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:36:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:36:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:36:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:36:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:36:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:36:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:36:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:36:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:36:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:36:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:36:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:36:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:36:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:36:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:36:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:36:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:36:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:36:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:36:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:36:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:36:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:36:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:36:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:36:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:36:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:36:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:36:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:36:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:36:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:36:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:36:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:36:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:36:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:36:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:36:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:36:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:36:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:36:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:36:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:36:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:36:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:36:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:36:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:36:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:36:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:36:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:36:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:36:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:36:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:36:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:36:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:36:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:36:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:36:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:36:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:36:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:36:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:36:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:36:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:36:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:36:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:36:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:36:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:36:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:36:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:36:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:36:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:36:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:36:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:36:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:36:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:36:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:36:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:36:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:36:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:36:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:36:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:36:09.507 DEBUG:teuthology.parallel:result is None 2024-09-12T02:36:11.458 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:36:11.458 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:36:11.458 INFO:teuthology.orchestra.run.smithi018.stdout:Upgraded: 2024-09-12T02:36:11.458 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:36:11.459 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:36:11.459 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:36:11.459 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:36:11.459 INFO:teuthology.orchestra.run.smithi018.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.459 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.459 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:36:11.459 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:36:11.459 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-12T02:36:11.459 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:36:11.459 INFO:teuthology.orchestra.run.smithi018.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:36:11.459 INFO:teuthology.orchestra.run.smithi018.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:36:11.459 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:36:11.459 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.460 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.460 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.460 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.460 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:11.460 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.460 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.460 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.460 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:11.460 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:11.460 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:11.460 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:11.460 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:11.460 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.461 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.461 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:11.461 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.461 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.461 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.461 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:11.461 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:11.461 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.461 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.461 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:36:11.461 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:36:11.461 INFO:teuthology.orchestra.run.smithi018.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:36:11.461 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:36:11.462 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:36:11.462 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:36:11.462 INFO:teuthology.orchestra.run.smithi018.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:36:11.462 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:36:11.462 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:36:11.462 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:36:11.462 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:36:11.462 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:36:11.462 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.462 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.462 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.463 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:36:11.463 INFO:teuthology.orchestra.run.smithi018.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:36:11.463 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:36:11.463 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:36:11.463 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:36:11.463 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.463 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.463 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:36:11.463 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.463 INFO:teuthology.orchestra.run.smithi018.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:36:11.463 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:36:11.463 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:36:11.463 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:36:11.464 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:36:11.464 INFO:teuthology.orchestra.run.smithi018.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:36:11.464 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:36:11.464 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:36:11.464 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:36:11.464 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:36:11.464 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:36:11.464 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:36:11.464 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:36:11.464 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:36:11.464 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:36:11.464 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:36:11.464 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:36:11.464 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:36:11.465 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:36:11.466 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:36:11.467 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:36:11.467 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:36:11.467 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:36:11.467 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:36:11.467 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:36:11.467 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:36:11.467 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:36:11.467 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:36:11.467 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:36:11.467 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:36:11.467 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:36:11.467 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:36:11.467 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:36:11.468 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:36:11.468 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:36:11.468 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:36:11.468 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:36:11.468 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:36:11.468 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:36:11.468 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:36:11.468 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:36:11.468 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:36:11.468 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.468 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.468 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:36:11.468 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:36:11.468 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:36:11.469 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.469 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:36:11.469 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:36:11.469 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:36:11.469 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:36:11.469 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:36:11.469 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:36:11.469 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:36:11.469 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:36:11.469 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:36:11.469 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:36:11.469 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:36:11.469 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:36:11.470 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:36:11.470 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:36:11.470 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:36:11.470 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.470 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.470 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:36:11.470 INFO:teuthology.orchestra.run.smithi018.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:36:11.470 INFO:teuthology.orchestra.run.smithi018.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:36:11.470 INFO:teuthology.orchestra.run.smithi018.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:36:11.470 INFO:teuthology.orchestra.run.smithi018.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:36:11.470 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:36:11.470 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:36:11.471 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:36:11.471 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:36:11.471 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-12T02:36:12.059 DEBUG:teuthology.parallel:result is None 2024-09-12T02:36:12.060 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:36:12.209 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:36:12.256 INFO:teuthology.orchestra.run.smithi018.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:36:12.257 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:36:12.257 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:36:12.260 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:36:12.403 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:36:12.429 INFO:teuthology.orchestra.run.smithi062.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:36:12.429 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:36:12.429 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:36:12.431 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:36:12.575 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:36:12.601 INFO:teuthology.orchestra.run.smithi176.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:36:12.602 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:36:12.602 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:36:12.604 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T02:36:12.604 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:36:12.604 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:36:12.664 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T02:36:12.664 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:36:12.697 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T02:36:12.697 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:36:12.728 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T02:36:12.729 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:36:12.729 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:36:12.790 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:36:12.888 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T02:36:12.889 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:36:12.918 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:36:12.988 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T02:36:12.988 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:36:13.017 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:36:13.085 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T02:36:13.085 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:36:13.085 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:36:13.145 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:36:13.243 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T02:36:13.243 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:36:13.268 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:36:13.333 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T02:36:13.333 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:36:13.362 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:36:13.431 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T02:36:13.432 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:36:13.432 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:36:13.488 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:36:13.589 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T02:36:13.589 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:36:13.615 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:36:13.680 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T02:36:13.680 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:36:13.709 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:36:13.777 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-12T02:36:13.873 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-12T02:36:13.873 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:36:13.873 INFO:tasks.cephadm:Cluster fsid is c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:36:13.874 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-12T02:36:13.874 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.18', 'mon.b': '172.21.15.62', 'mon.c': '172.21.15.176'} 2024-09-12T02:36:13.874 INFO:tasks.cephadm:First mon is mon.a on smithi018 2024-09-12T02:36:13.874 INFO:tasks.cephadm:First mgr is x 2024-09-12T02:36:13.874 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-12T02:36:13.874 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname $(hostname -s) 2024-09-12T02:36:13.932 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname $(hostname -s) 2024-09-12T02:36:13.957 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname $(hostname -s) 2024-09-12T02:36:13.987 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-12T02:36:13.988 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:36:14.136 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-12T02:36:14.276 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:36:14.278 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T02:36:14.278 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T02:36:14.278 DEBUG:teuthology.orchestra.run.smithi018:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T02:36:14.748 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 02:36 /home/ubuntu/cephtest/cephadm 2024-09-12T02:36:14.749 DEBUG:teuthology.orchestra.run.smithi062:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T02:36:15.144 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 02:36 /home/ubuntu/cephtest/cephadm 2024-09-12T02:36:15.144 DEBUG:teuthology.orchestra.run.smithi176:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T02:36:15.532 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 02:36 /home/ubuntu/cephtest/cephadm 2024-09-12T02:36:15.532 DEBUG:teuthology.orchestra.run.smithi018:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T02:36:15.574 DEBUG:teuthology.orchestra.run.smithi062:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T02:36:15.594 DEBUG:teuthology.orchestra.run.smithi176:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T02:36:15.631 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-12T02:36:15.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T02:36:15.635 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T02:36:15.638 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T02:36:17.178 INFO:teuthology.orchestra.run.smithi176.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:36:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:36:17.716 INFO:teuthology.orchestra.run.smithi018.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:36:44.064 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T02:36:44.065 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:36:44.065 INFO:teuthology.orchestra.run.smithi062.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T02:36:44.065 INFO:teuthology.orchestra.run.smithi062.stdout: "repo_digests": [ 2024-09-12T02:36:44.065 INFO:teuthology.orchestra.run.smithi062.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T02:36:44.065 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T02:36:44.065 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T02:36:44.590 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T02:36:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:36:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T02:36:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: "repo_digests": [ 2024-09-12T02:36:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T02:36:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T02:36:44.590 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T02:36:51.314 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T02:36:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:36:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T02:36:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "repo_digests": [ 2024-09-12T02:36:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T02:36:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-12T02:36:51.315 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T02:36:51.346 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph 2024-09-12T02:36:51.406 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph 2024-09-12T02:36:51.440 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph 2024-09-12T02:36:51.474 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /etc/ceph 2024-09-12T02:36:51.530 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /etc/ceph 2024-09-12T02:36:51.559 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 777 /etc/ceph 2024-09-12T02:36:51.589 INFO:tasks.cephadm:Writing seed config... 2024-09-12T02:36:51.590 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-12T02:36:51.590 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-12T02:36:51.590 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-12T02:36:51.590 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-12T02:36:51.591 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-12T02:36:51.591 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-12T02:36:51.591 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-12T02:36:51.591 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-12T02:36:51.591 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-12T02:36:51.591 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-12T02:36:51.591 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-12T02:36:51.591 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-12T02:36:51.591 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-12T02:36:51.591 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-12T02:36:51.591 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-12T02:36:51.591 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-12T02:36:51.591 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-12T02:36:51.592 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-12T02:36:51.592 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-12T02:36:51.592 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-12T02:36:51.592 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-12T02:36:51.592 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-12T02:36:51.592 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-12T02:36:51.592 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-12T02:36:51.592 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-12T02:36:51.592 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-12T02:36:51.592 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-12T02:36:51.592 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-12T02:36:51.592 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-12T02:36:51.593 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-12T02:36:51.593 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-12T02:36:51.593 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-12T02:36:51.593 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-12T02:36:51.593 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-12T02:36:51.593 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-12T02:36:51.593 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-12T02:36:51.593 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-12T02:36:51.593 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-12T02:36:51.593 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-12T02:36:51.593 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-12T02:36:51.593 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-12T02:36:51.593 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-12T02:36:51.593 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-12T02:36:51.594 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-12T02:36:51.594 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-12T02:36:51.594 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-12T02:36:51.594 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:36:51.594 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-12T02:36:51.630 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c7666100-70af-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-12T02:36:51.630 DEBUG:teuthology.orchestra.run.smithi018:mon.a> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mon.a.service 2024-09-12T02:36:51.674 DEBUG:teuthology.orchestra.run.smithi018:mgr.x> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mgr.x.service 2024-09-12T02:36:51.720 INFO:tasks.cephadm:Bootstrapping... 2024-09-12T02:36:51.720 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid c7666100-70af-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.18 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:36:51.990 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:36:51.990 INFO:teuthology.orchestra.run.smithi018.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', 'c7666100-70af-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.18', '--skip-admin-label'] 2024-09-12T02:36:51.991 INFO:teuthology.orchestra.run.smithi018.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-12T02:36:51.991 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying podman|docker is present... 2024-09-12T02:36:52.037 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stdout 5.2.2 2024-09-12T02:36:52.037 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying lvm2 is present... 2024-09-12T02:36:52.037 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying time synchronization is in place... 2024-09-12T02:36:52.052 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T02:36:52.052 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T02:36:52.064 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T02:36:52.064 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-12T02:36:52.078 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout enabled 2024-09-12T02:36:52.090 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout active 2024-09-12T02:36:52.090 INFO:teuthology.orchestra.run.smithi018.stdout:Unit chronyd.service is enabled and running 2024-09-12T02:36:52.090 INFO:teuthology.orchestra.run.smithi018.stdout:Repeating the final host check... 2024-09-12T02:36:52.134 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stdout 5.2.2 2024-09-12T02:36:52.134 INFO:teuthology.orchestra.run.smithi018.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-12T02:36:52.134 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl is present 2024-09-12T02:36:52.134 INFO:teuthology.orchestra.run.smithi018.stdout:lvcreate is present 2024-09-12T02:36:52.147 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T02:36:52.147 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T02:36:52.159 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T02:36:52.159 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-12T02:36:52.173 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout enabled 2024-09-12T02:36:52.185 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout active 2024-09-12T02:36:52.185 INFO:teuthology.orchestra.run.smithi018.stdout:Unit chronyd.service is enabled and running 2024-09-12T02:36:52.185 INFO:teuthology.orchestra.run.smithi018.stdout:Host looks OK 2024-09-12T02:36:52.186 INFO:teuthology.orchestra.run.smithi018.stdout:Cluster fsid: c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:36:52.186 INFO:teuthology.orchestra.run.smithi018.stdout:Acquiring lock 140467279233904 on /run/cephadm/c7666100-70af-11ef-bcea-c7b262605968.lock 2024-09-12T02:36:52.186 INFO:teuthology.orchestra.run.smithi018.stdout:Lock 140467279233904 acquired on /run/cephadm/c7666100-70af-11ef-bcea-c7b262605968.lock 2024-09-12T02:36:52.186 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying IP 172.21.15.18 port 3300 ... 2024-09-12T02:36:52.187 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying IP 172.21.15.18 port 6789 ... 2024-09-12T02:36:52.187 INFO:teuthology.orchestra.run.smithi018.stdout:Base mon IP(s) is [172.21.15.18:3300, 172.21.15.18:6789], mon addrv is [v2:172.21.15.18:3300,v1:172.21.15.18:6789] 2024-09-12T02:36:52.194 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.18 metric 100 2024-09-12T02:36:52.194 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.18 metric 100 2024-09-12T02:36:52.199 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-12T02:36:52.199 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-12T02:36:52.200 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1745sec hoplimit 64 pref medium 2024-09-12T02:36:52.205 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-12T02:36:52.205 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-12T02:36:52.205 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T02:36:52.205 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-12T02:36:52.205 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-12T02:36:52.206 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T02:36:52.206 INFO:teuthology.orchestra.run.smithi018.stdout:Mon IP `172.21.15.18` is in CIDR network `172.21.0.0/20` 2024-09-12T02:36:52.206 INFO:teuthology.orchestra.run.smithi018.stdout:Mon IP `172.21.15.18` is in CIDR network `172.21.0.0/20` 2024-09-12T02:36:52.206 INFO:teuthology.orchestra.run.smithi018.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-12T02:36:52.207 INFO:teuthology.orchestra.run.smithi018.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-12T02:36:52.208 INFO:teuthology.orchestra.run.smithi018.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:36:52.876 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T02:36:52.876 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:36:52.876 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Getting image source signatures 2024-09-12T02:36:52.876 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-12T02:36:52.876 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-12T02:36:52.876 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T02:36:52.876 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-12T02:36:54.104 INFO:teuthology.orchestra.run.smithi018.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:36:54.105 INFO:teuthology.orchestra.run.smithi018.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:36:54.105 INFO:teuthology.orchestra.run.smithi018.stdout:Extracting ceph user uid/gid from container image... 2024-09-12T02:37:05.322 INFO:teuthology.orchestra.run.smithi018.stdout:stat: stdout 167 167 2024-09-12T02:37:05.323 INFO:teuthology.orchestra.run.smithi018.stdout:Creating initial keys... 2024-09-12T02:37:06.596 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph-authtool: stdout AQDRU+JmtnpBMBAAv254uAinBV6X4xYQ3FswGA== 2024-09-12T02:37:07.819 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph-authtool: stdout AQDTU+Jm8DfZAxAAECOXMHMNMO8x+uG3v45qrA== 2024-09-12T02:37:08.949 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph-authtool: stdout AQDUU+JmnpvvDRAAW8r9v8FdrJsISTC3c9H4sg== 2024-09-12T02:37:08.950 INFO:teuthology.orchestra.run.smithi018.stdout:Creating initial monmap... 2024-09-12T02:37:10.856 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T02:37:10.857 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-12T02:37:10.857 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:37:10.857 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T02:37:10.857 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool for a [v2:172.21.15.18:3300,v1:172.21.15.18:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T02:37:10.857 INFO:teuthology.orchestra.run.smithi018.stdout:setting min_mon_release = quincy 2024-09-12T02:37:10.857 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: set fsid to c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:37:10.858 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T02:37:10.858 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:37:10.858 INFO:teuthology.orchestra.run.smithi018.stdout:Creating mon... 2024-09-12T02:37:12.066 INFO:teuthology.orchestra.run.smithi018.stdout:create mon.a on 2024-09-12T02:37:12.360 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-12T02:37:12.579 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-12T02:37:12.839 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c7666100-70af-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-c7666100-70af-11ef-bcea-c7b262605968.target. 2024-09-12T02:37:12.839 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c7666100-70af-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-c7666100-70af-11ef-bcea-c7b262605968.target. 2024-09-12T02:37:13.157 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c7666100-70af-11ef-bcea-c7b262605968@mon.a 2024-09-12T02:37:13.157 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c7666100-70af-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-c7666100-70af-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-12T02:37:13.427 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c7666100-70af-11ef-bcea-c7b262605968.target.wants/ceph-c7666100-70af-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-c7666100-70af-11ef-bcea-c7b262605968@.service. 2024-09-12T02:37:14.074 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:13 smithi018 podman[30230]: 2024-09-12 02:37:13.779896559 +0000 UTC m=+0.125362454 container create 1aed8fd5f755b9fb8f9c334c9bd07b745a20a21cb438f3e961fc206892ae72e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-12T02:37:14.074 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:14 smithi018 podman[30230]: 2024-09-12 02:37:14.074085963 +0000 UTC m=+0.419551869 container init 1aed8fd5f755b9fb8f9c334c9bd07b745a20a21cb438f3e961fc206892ae72e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T02:37:14.192 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:37:14.193 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-09-12T02:37:14.206 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:37:14.206 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-12T02:37:14.206 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-09-12T02:37:14.206 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T02:37:14.207 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mon to start... 2024-09-12T02:37:14.207 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mon... 2024-09-12T02:37:14.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:14 smithi018 podman[30230]: 2024-09-12 02:37:14.080692158 +0000 UTC m=+0.426158054 container start 1aed8fd5f755b9fb8f9c334c9bd07b745a20a21cb438f3e961fc206892ae72e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-12T02:37:14.348 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:14 smithi018 ceph-mon[30249]: mkfs c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:37:14.348 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:14 smithi018 ceph-mon[30249]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T02:37:14.348 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:14 smithi018 bash[30230]: 1aed8fd5f755b9fb8f9c334c9bd07b745a20a21cb438f3e961fc206892ae72e8 2024-09-12T02:37:14.348 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:14 smithi018 systemd[1]: Started Ceph mon.a for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:37:15.522 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:15 smithi018 ceph-mon[30249]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T02:37:15.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:15 smithi018 ceph-mon[30249]: monmap epoch 1 2024-09-12T02:37:15.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:15 smithi018 ceph-mon[30249]: fsid c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:37:15.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:15 smithi018 ceph-mon[30249]: last_changed 2024-09-12T02:37:09.409832+0000 2024-09-12T02:37:15.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:15 smithi018 ceph-mon[30249]: created 2024-09-12T02:37:09.409832+0000 2024-09-12T02:37:15.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:15 smithi018 ceph-mon[30249]: min_mon_release 19 (squid) 2024-09-12T02:37:15.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:15 smithi018 ceph-mon[30249]: election_strategy: 1 2024-09-12T02:37:15.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:15 smithi018 ceph-mon[30249]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-12T02:37:15.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:15 smithi018 ceph-mon[30249]: fsmap 2024-09-12T02:37:15.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:15 smithi018 ceph-mon[30249]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T02:37:15.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:15 smithi018 ceph-mon[30249]: mgrmap e1: no daemons active 2024-09-12T02:37:15.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:15 smithi018 ceph-mon[30249]: from='client.? 172.21.15.18:0/3517945215' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-12T02:37:15.868 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout cluster: 2024-09-12T02:37:15.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout id: c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:37:15.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-12T02:37:15.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-12T02:37:15.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout services: 2024-09-12T02:37:15.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.67717s) 2024-09-12T02:37:15.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-12T02:37:15.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-12T02:37:15.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-12T02:37:15.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout data: 2024-09-12T02:37:15.869 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-12T02:37:15.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-12T02:37:15.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-12T02:37:15.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout pgs: 2024-09-12T02:37:15.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-12T02:37:15.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.736+0000 7fb54a200640 1 Processor -- start 2024-09-12T02:37:15.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.736+0000 7fb54a200640 1 -- start start 2024-09-12T02:37:15.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.736+0000 7fb54a200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb544109810 0x7fb544109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:15.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.736+0000 7fb54a200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb54410a1e0 con 0x7fb544109810 2024-09-12T02:37:15.870 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.737+0000 7fb543400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb544109810 0x7fb544109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.737+0000 7fb543400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb544109810 0x7fb544109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43360/0 (socket says 172.21.15.18:43360) 2024-09-12T02:37:15.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.737+0000 7fb543400640 1 -- 172.21.15.18:0/245822304 learned_addr learned my addr 172.21.15.18:0/245822304 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:15.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.738+0000 7fb543400640 1 -- 172.21.15.18:0/245822304 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54410a950 con 0x7fb544109810 2024-09-12T02:37:15.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.740+0000 7fb543400640 1 --2- 172.21.15.18:0/245822304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb544109810 0x7fb544109c10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb534009820 tx=0x7fb53402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc60e40dc8b88897 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:15.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.740+0000 7fb542000640 1 -- 172.21.15.18:0/245822304 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb534037070 con 0x7fb544109810 2024-09-12T02:37:15.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.740+0000 7fb542000640 1 -- 172.21.15.18:0/245822304 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb534032440 con 0x7fb544109810 2024-09-12T02:37:15.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.740+0000 7fb542000640 1 -- 172.21.15.18:0/245822304 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb534032740 con 0x7fb544109810 2024-09-12T02:37:15.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.741+0000 7fb54a200640 1 -- 172.21.15.18:0/245822304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb544109810 msgr2=0x7fb544109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:15.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.741+0000 7fb54a200640 1 --2- 172.21.15.18:0/245822304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb544109810 0x7fb544109c10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb534009820 tx=0x7fb53402a270 comp rx=0 tx=0).stop 2024-09-12T02:37:15.871 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.741+0000 7fb54a200640 1 -- 172.21.15.18:0/245822304 shutdown_connections 2024-09-12T02:37:15.872 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.741+0000 7fb54a200640 1 --2- 172.21.15.18:0/245822304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb544109810 0x7fb544109c10 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.872 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.741+0000 7fb54a200640 1 -- 172.21.15.18:0/245822304 >> 172.21.15.18:0/245822304 conn(0x7fb54407ccf0 msgr2=0x7fb54407d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:15.872 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.741+0000 7fb54a200640 1 -- 172.21.15.18:0/245822304 shutdown_connections 2024-09-12T02:37:15.872 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.741+0000 7fb54a200640 1 -- 172.21.15.18:0/245822304 wait complete. 2024-09-12T02:37:15.872 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.742+0000 7fb54a200640 1 Processor -- start 2024-09-12T02:37:15.872 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.742+0000 7fb54a200640 1 -- start start 2024-09-12T02:37:15.872 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.743+0000 7fb54a200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb544109810 0x7fb54419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:15.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.743+0000 7fb54a200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb54410aef0 con 0x7fb544109810 2024-09-12T02:37:15.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.743+0000 7fb543400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb544109810 0x7fb54419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.743+0000 7fb543400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb544109810 0x7fb54419cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43362/0 (socket says 172.21.15.18:43362) 2024-09-12T02:37:15.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.743+0000 7fb543400640 1 -- 172.21.15.18:0/3517945215 learned_addr learned my addr 172.21.15.18:0/3517945215 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:15.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.743+0000 7fb543400640 1 -- 172.21.15.18:0/3517945215 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54419d480 con 0x7fb544109810 2024-09-12T02:37:15.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.744+0000 7fb543400640 1 --2- 172.21.15.18:0/3517945215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb544109810 0x7fb54419cf40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb5340090b0 tx=0x7fb5340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:15.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.744+0000 7fb53be00640 1 -- 172.21.15.18:0/3517945215 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb534041070 con 0x7fb544109810 2024-09-12T02:37:15.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.744+0000 7fb53be00640 1 -- 172.21.15.18:0/3517945215 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb53403c7a0 con 0x7fb544109810 2024-09-12T02:37:15.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.744+0000 7fb53be00640 1 -- 172.21.15.18:0/3517945215 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb534037040 con 0x7fb544109810 2024-09-12T02:37:15.873 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.744+0000 7fb54a200640 1 -- 172.21.15.18:0/3517945215 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb54419d710 con 0x7fb544109810 2024-09-12T02:37:15.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.744+0000 7fb54a200640 1 -- 172.21.15.18:0/3517945215 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5441a0400 con 0x7fb544109810 2024-09-12T02:37:15.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.745+0000 7fb53be00640 1 -- 172.21.15.18:0/3517945215 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb534044070 con 0x7fb544109810 2024-09-12T02:37:15.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.745+0000 7fb53be00640 1 -- 172.21.15.18:0/3517945215 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb53403d3f0 con 0x7fb544109810 2024-09-12T02:37:15.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.745+0000 7fb54a200640 1 -- 172.21.15.18:0/3517945215 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb54410b560 con 0x7fb544109810 2024-09-12T02:37:15.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.749+0000 7fb53be00640 1 -- 172.21.15.18:0/3517945215 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb534046450 con 0x7fb544109810 2024-09-12T02:37:15.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.813+0000 7fb54a200640 1 -- 172.21.15.18:0/3517945215 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fb54402d940 con 0x7fb544109810 2024-09-12T02:37:15.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.814+0000 7fb53be00640 1 -- 172.21.15.18:0/3517945215 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+316 (secure 0 0 0) 0x7fb534046630 con 0x7fb544109810 2024-09-12T02:37:15.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.814+0000 7fb54a200640 1 -- 172.21.15.18:0/3517945215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb544109810 msgr2=0x7fb54419cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:15.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.814+0000 7fb54a200640 1 --2- 172.21.15.18:0/3517945215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb544109810 0x7fb54419cf40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb5340090b0 tx=0x7fb5340046c0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.815+0000 7fb54a200640 1 -- 172.21.15.18:0/3517945215 shutdown_connections 2024-09-12T02:37:15.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.815+0000 7fb54a200640 1 --2- 172.21.15.18:0/3517945215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb544109810 0x7fb54419cf40 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.874 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.815+0000 7fb54a200640 1 -- 172.21.15.18:0/3517945215 >> 172.21.15.18:0/3517945215 conn(0x7fb54407ccf0 msgr2=0x7fb544191110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:15.875 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.815+0000 7fb54a200640 1 -- 172.21.15.18:0/3517945215 shutdown_connections 2024-09-12T02:37:15.875 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:14.815+0000 7fb54a200640 1 -- 172.21.15.18:0/3517945215 wait complete. 2024-09-12T02:37:15.875 INFO:teuthology.orchestra.run.smithi018.stdout:mon is available 2024-09-12T02:37:15.875 INFO:teuthology.orchestra.run.smithi018.stdout:Assimilating anything we can from ceph.conf... 2024-09-12T02:37:16.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:16 smithi018 ceph-mon[30249]: from='client.? 172.21.15.18:0/2217842008' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T02:37:16.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:16 smithi018 ceph-mon[30249]: from='client.? 172.21.15.18:0/2217842008' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-12T02:37:17.164 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-12T02:37:17.164 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T02:37:17.164 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout fsid = c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:37:17.164 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.18:3300,v1:172.21.15.18:6789] 2024-09-12T02:37:17.164 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T02:37:17.164 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T02:37:17.164 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T02:37:17.164 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T02:37:17.164 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-12T02:37:17.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T02:37:17.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T02:37:17.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-12T02:37:17.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T02:37:17.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T02:37:17.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T02:37:17.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T02:37:17.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T02:37:17.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T02:37:17.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.423+0000 7f94ac400640 1 Processor -- start 2024-09-12T02:37:17.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.424+0000 7f94ac400640 1 -- start start 2024-09-12T02:37:17.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.424+0000 7f94ac400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94a4109810 0x7f94a4109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.165 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.424+0000 7f94ac400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f94a410a1e0 con 0x7f94a4109810 2024-09-12T02:37:17.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.425+0000 7f94a9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94a4109810 0x7f94a4109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.425+0000 7f94a9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94a4109810 0x7f94a4109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51902/0 (socket says 172.21.15.18:51902) 2024-09-12T02:37:17.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.425+0000 7f94a9a00640 1 -- 172.21.15.18:0/1657137092 learned_addr learned my addr 172.21.15.18:0/1657137092 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:17.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.425+0000 7f94a9a00640 1 -- 172.21.15.18:0/1657137092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a410a950 con 0x7f94a4109810 2024-09-12T02:37:17.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.426+0000 7f94a9a00640 1 --2- 172.21.15.18:0/1657137092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94a4109810 0x7f94a4109c10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9498009820 tx=0x7f949802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba206092dec9ef9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:17.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.427+0000 7f94a3e00640 1 -- 172.21.15.18:0/1657137092 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9498037070 con 0x7f94a4109810 2024-09-12T02:37:17.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.427+0000 7f94a3e00640 1 -- 172.21.15.18:0/1657137092 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9498032440 con 0x7f94a4109810 2024-09-12T02:37:17.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.427+0000 7f94a3e00640 1 -- 172.21.15.18:0/1657137092 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9498032740 con 0x7f94a4109810 2024-09-12T02:37:17.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.427+0000 7f94ac400640 1 -- 172.21.15.18:0/1657137092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94a4109810 msgr2=0x7f94a4109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:17.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.427+0000 7f94ac400640 1 --2- 172.21.15.18:0/1657137092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94a4109810 0x7f94a4109c10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9498009820 tx=0x7f949802a270 comp rx=0 tx=0).stop 2024-09-12T02:37:17.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.427+0000 7f94ac400640 1 -- 172.21.15.18:0/1657137092 shutdown_connections 2024-09-12T02:37:17.166 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.427+0000 7f94ac400640 1 --2- 172.21.15.18:0/1657137092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94a4109810 0x7f94a4109c10 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.427+0000 7f94ac400640 1 -- 172.21.15.18:0/1657137092 >> 172.21.15.18:0/1657137092 conn(0x7f94a407ccf0 msgr2=0x7f94a407d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:17.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.427+0000 7f94ac400640 1 -- 172.21.15.18:0/1657137092 shutdown_connections 2024-09-12T02:37:17.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.427+0000 7f94ac400640 1 -- 172.21.15.18:0/1657137092 wait complete. 2024-09-12T02:37:17.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.428+0000 7f94ac400640 1 Processor -- start 2024-09-12T02:37:17.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.428+0000 7f94ac400640 1 -- start start 2024-09-12T02:37:17.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.429+0000 7f94ac400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94a4109810 0x7f94a419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.429+0000 7f94ac400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f94a410aef0 con 0x7f94a4109810 2024-09-12T02:37:17.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.429+0000 7f94a9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94a4109810 0x7f94a419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.429+0000 7f94a9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94a4109810 0x7f94a419cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51906/0 (socket says 172.21.15.18:51906) 2024-09-12T02:37:17.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.429+0000 7f94a9a00640 1 -- 172.21.15.18:0/2217842008 learned_addr learned my addr 172.21.15.18:0/2217842008 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:17.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.429+0000 7f94a9a00640 1 -- 172.21.15.18:0/2217842008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a419d480 con 0x7f94a4109810 2024-09-12T02:37:17.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.430+0000 7f94a9a00640 1 --2- 172.21.15.18:0/2217842008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94a4109810 0x7f94a419cf40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f94980090b0 tx=0x7f94980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:17.167 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.430+0000 7f94a2000640 1 -- 172.21.15.18:0/2217842008 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9498041070 con 0x7f94a4109810 2024-09-12T02:37:17.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.430+0000 7f94a2000640 1 -- 172.21.15.18:0/2217842008 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f949803c7a0 con 0x7f94a4109810 2024-09-12T02:37:17.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.430+0000 7f94a2000640 1 -- 172.21.15.18:0/2217842008 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9498037040 con 0x7f94a4109810 2024-09-12T02:37:17.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.430+0000 7f94ac400640 1 -- 172.21.15.18:0/2217842008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94a419d710 con 0x7f94a4109810 2024-09-12T02:37:17.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.430+0000 7f94ac400640 1 -- 172.21.15.18:0/2217842008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94a41a0400 con 0x7f94a4109810 2024-09-12T02:37:17.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.431+0000 7f94a2000640 1 -- 172.21.15.18:0/2217842008 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9498044070 con 0x7f94a4109810 2024-09-12T02:37:17.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.431+0000 7f94a2000640 1 -- 172.21.15.18:0/2217842008 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f949803d3f0 con 0x7f94a4109810 2024-09-12T02:37:17.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.431+0000 7f94ac400640 1 -- 172.21.15.18:0/2217842008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94a410b560 con 0x7f94a4109810 2024-09-12T02:37:17.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.434+0000 7f94a2000640 1 -- 172.21.15.18:0/2217842008 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9498046450 con 0x7f94a4109810 2024-09-12T02:37:17.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.497+0000 7f94ac400640 1 -- 172.21.15.18:0/2217842008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f94a402d940 con 0x7f94a4109810 2024-09-12T02:37:17.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.501+0000 7f94a2000640 1 -- 172.21.15.18:0/2217842008 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f9498046630 con 0x7f94a4109810 2024-09-12T02:37:17.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.501+0000 7f94a2000640 1 -- 172.21.15.18:0/2217842008 <== mon.0 v2:172.21.15.18:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94980584b0 con 0x7f94a4109810 2024-09-12T02:37:17.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.502+0000 7f94ac400640 1 -- 172.21.15.18:0/2217842008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94a4109810 msgr2=0x7f94a419cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:17.168 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.502+0000 7f94ac400640 1 --2- 172.21.15.18:0/2217842008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94a4109810 0x7f94a419cf40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f94980090b0 tx=0x7f94980046c0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.169 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.502+0000 7f94ac400640 1 -- 172.21.15.18:0/2217842008 shutdown_connections 2024-09-12T02:37:17.169 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.502+0000 7f94ac400640 1 --2- 172.21.15.18:0/2217842008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94a4109810 0x7f94a419cf40 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.169 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.502+0000 7f94ac400640 1 -- 172.21.15.18:0/2217842008 >> 172.21.15.18:0/2217842008 conn(0x7f94a407ccf0 msgr2=0x7f94a4191110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:17.169 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.502+0000 7f94ac400640 1 -- 172.21.15.18:0/2217842008 shutdown_connections 2024-09-12T02:37:17.169 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:16.502+0000 7f94ac400640 1 -- 172.21.15.18:0/2217842008 wait complete. 2024-09-12T02:37:17.169 INFO:teuthology.orchestra.run.smithi018.stdout:Generating new minimal ceph.conf... 2024-09-12T02:37:18.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:17 smithi018 ceph-mon[30249]: from='client.? 172.21.15.18:0/2605285100' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:37:18.436 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.678+0000 7f596be00640 1 Processor -- start 2024-09-12T02:37:18.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.679+0000 7f596be00640 1 -- start start 2024-09-12T02:37:18.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.679+0000 7f596be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c109810 0x7f596c109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:18.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.679+0000 7f596be00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f596c10a1e0 con 0x7f596c109810 2024-09-12T02:37:18.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.679+0000 7f596aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c109810 0x7f596c109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:18.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.679+0000 7f596aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c109810 0x7f596c109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51920/0 (socket says 172.21.15.18:51920) 2024-09-12T02:37:18.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.679+0000 7f596aa00640 1 -- 172.21.15.18:0/3868707016 learned_addr learned my addr 172.21.15.18:0/3868707016 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:18.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.680+0000 7f596aa00640 1 -- 172.21.15.18:0/3868707016 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c10a730 con 0x7f596c109810 2024-09-12T02:37:18.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.681+0000 7f596aa00640 1 --2- 172.21.15.18:0/3868707016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c109810 0x7f596c109c10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f595c009820 tx=0x7f595c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d268dae2fa54d6ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:18.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.681+0000 7f5969600640 1 -- 172.21.15.18:0/3868707016 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f595c037070 con 0x7f596c109810 2024-09-12T02:37:18.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.681+0000 7f5969600640 1 -- 172.21.15.18:0/3868707016 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f595c032900 con 0x7f596c109810 2024-09-12T02:37:18.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.681+0000 7f5969600640 1 -- 172.21.15.18:0/3868707016 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f595c030850 con 0x7f596c109810 2024-09-12T02:37:18.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.682+0000 7f596be00640 1 -- 172.21.15.18:0/3868707016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c109810 msgr2=0x7f596c109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:18.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.682+0000 7f596be00640 1 --2- 172.21.15.18:0/3868707016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c109810 0x7f596c109c10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f595c009820 tx=0x7f595c02a270 comp rx=0 tx=0).stop 2024-09-12T02:37:18.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.682+0000 7f596be00640 1 -- 172.21.15.18:0/3868707016 shutdown_connections 2024-09-12T02:37:18.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.682+0000 7f596be00640 1 --2- 172.21.15.18:0/3868707016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c109810 0x7f596c109c10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.682+0000 7f596be00640 1 -- 172.21.15.18:0/3868707016 >> 172.21.15.18:0/3868707016 conn(0x7f596c07cb00 msgr2=0x7f596c07cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:18.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.682+0000 7f596be00640 1 -- 172.21.15.18:0/3868707016 shutdown_connections 2024-09-12T02:37:18.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.682+0000 7f596be00640 1 -- 172.21.15.18:0/3868707016 wait complete. 2024-09-12T02:37:18.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.683+0000 7f596be00640 1 Processor -- start 2024-09-12T02:37:18.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.683+0000 7f596be00640 1 -- start start 2024-09-12T02:37:18.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.683+0000 7f596be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c109810 0x7f596c19d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:18.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.683+0000 7f596be00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f596c10d9f0 con 0x7f596c109810 2024-09-12T02:37:18.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.683+0000 7f596aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c109810 0x7f596c19d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:18.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.683+0000 7f596aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c109810 0x7f596c19d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51932/0 (socket says 172.21.15.18:51932) 2024-09-12T02:37:18.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.684+0000 7f596aa00640 1 -- 172.21.15.18:0/2605285100 learned_addr learned my addr 172.21.15.18:0/2605285100 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:18.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.684+0000 7f596aa00640 1 -- 172.21.15.18:0/2605285100 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c19db10 con 0x7f596c109810 2024-09-12T02:37:18.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.684+0000 7f596aa00640 1 --2- 172.21.15.18:0/2605285100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c109810 0x7f596c19d5d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f595c0097f0 tx=0x7f595c030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:18.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.684+0000 7f5963400640 1 -- 172.21.15.18:0/2605285100 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f595c042070 con 0x7f596c109810 2024-09-12T02:37:18.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.684+0000 7f5963400640 1 -- 172.21.15.18:0/2605285100 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f595c032ca0 con 0x7f596c109810 2024-09-12T02:37:18.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.684+0000 7f596be00640 1 -- 172.21.15.18:0/2605285100 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596c19dda0 con 0x7f596c109810 2024-09-12T02:37:18.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.684+0000 7f5963400640 1 -- 172.21.15.18:0/2605285100 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f595c037040 con 0x7f596c109810 2024-09-12T02:37:18.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.685+0000 7f596be00640 1 -- 172.21.15.18:0/2605285100 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596c1a0a90 con 0x7f596c109810 2024-09-12T02:37:18.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.685+0000 7f5963400640 1 -- 172.21.15.18:0/2605285100 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f595c045070 con 0x7f596c109810 2024-09-12T02:37:18.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.685+0000 7f5963400640 1 -- 172.21.15.18:0/2605285100 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f595c047a90 con 0x7f596c109810 2024-09-12T02:37:18.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.686+0000 7f596be00640 1 -- 172.21.15.18:0/2605285100 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f596c109c90 con 0x7f596c109810 2024-09-12T02:37:18.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.689+0000 7f5963400640 1 -- 172.21.15.18:0/2605285100 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f595c03db10 con 0x7f596c109810 2024-09-12T02:37:18.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.751+0000 7f596be00640 1 -- 172.21.15.18:0/2605285100 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f596c1a1000 con 0x7f596c109810 2024-09-12T02:37:18.440 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.751+0000 7f5963400640 1 -- 172.21.15.18:0/2605285100 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f595c03d430 con 0x7f596c109810 2024-09-12T02:37:18.440 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.752+0000 7f596be00640 1 -- 172.21.15.18:0/2605285100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c109810 msgr2=0x7f596c19d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:18.440 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.752+0000 7f596be00640 1 --2- 172.21.15.18:0/2605285100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c109810 0x7f596c19d5d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f595c0097f0 tx=0x7f595c030ec0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.440 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.753+0000 7f596be00640 1 -- 172.21.15.18:0/2605285100 shutdown_connections 2024-09-12T02:37:18.440 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.753+0000 7f596be00640 1 --2- 172.21.15.18:0/2605285100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c109810 0x7f596c19d5d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.440 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.753+0000 7f596be00640 1 -- 172.21.15.18:0/2605285100 >> 172.21.15.18:0/2605285100 conn(0x7f596c07cb00 msgr2=0x7f596c107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:18.440 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.753+0000 7f596be00640 1 -- 172.21.15.18:0/2605285100 shutdown_connections 2024-09-12T02:37:18.440 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:17.753+0000 7f596be00640 1 -- 172.21.15.18:0/2605285100 wait complete. 2024-09-12T02:37:18.440 INFO:teuthology.orchestra.run.smithi018.stdout:Restarting the monitor... 2024-09-12T02:37:18.799 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:18 smithi018 systemd[1]: Stopping Ceph mon.a for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T02:37:19.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:18 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a[30245]: 2024-09-12T02:37:18.797+0000 7f5731000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:37:19.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:18 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a[30245]: 2024-09-12T02:37:18.797+0000 7f5731000640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-12T02:37:19.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:19 smithi018 podman[30489]: 2024-09-12 02:37:19.05524547 +0000 UTC m=+0.380540833 container died 1aed8fd5f755b9fb8f9c334c9bd07b745a20a21cb438f3e961fc206892ae72e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T02:37:19.771 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:19 smithi018 podman[30489]: 2024-09-12 02:37:19.528105688 +0000 UTC m=+0.853401059 container cleanup 1aed8fd5f755b9fb8f9c334c9bd07b745a20a21cb438f3e961fc206892ae72e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T02:37:19.771 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:19 smithi018 bash[30489]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a 2024-09-12T02:37:20.076 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:19 smithi018 podman[30500]: 2024-09-12 02:37:19.770763504 +0000 UTC m=+0.706459012 container remove 1aed8fd5f755b9fb8f9c334c9bd07b745a20a21cb438f3e961fc206892ae72e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-12T02:37:20.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 systemd[1]: ceph-c7666100-70af-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T02:37:20.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 systemd[1]: Stopped Ceph mon.a for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:37:20.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 systemd[1]: ceph-c7666100-70af-11ef-bcea-c7b262605968@mon.a.service: Consumed 1.278s CPU time. 2024-09-12T02:37:20.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 systemd[1]: Starting Ceph mon.a for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T02:37:20.766 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 podman[30598]: 2024-09-12 02:37:20.322673189 +0000 UTC m=+0.039064483 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:37:20.766 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 podman[30598]: 2024-09-12 02:37:20.504747242 +0000 UTC m=+0.221138535 container create 148cd232de42e3695eb17ae511afd37d6a44a0d0a9628325ba3a0d405d26007d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-12T02:37:20.766 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 podman[30598]: 2024-09-12 02:37:20.766192523 +0000 UTC m=+0.482583818 container init 148cd232de42e3695eb17ae511afd37d6a44a0d0a9628325ba3a0d405d26007d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:37:20.858 INFO:teuthology.orchestra.run.smithi018.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-12T02:37:21.025 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 podman[30598]: 2024-09-12 02:37:20.77288853 +0000 UTC m=+0.489279830 container start 148cd232de42e3695eb17ae511afd37d6a44a0d0a9628325ba3a0d405d26007d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-12T02:37:21.025 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T02:37:21.025 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T02:37:21.025 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: pidfile_write: ignore empty --pid-file 2024-09-12T02:37:21.025 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: load: jerasure load: lrc 2024-09-12T02:37:21.025 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: RocksDB version: 7.9.2 2024-09-12T02:37:21.025 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Git sha 0 2024-09-12T02:37:21.025 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T02:37:21.025 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: DB SUMMARY 2024-09-12T02:37:21.025 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: DB Session ID: R5E04HKNSJBYBX89O6MY 2024-09-12T02:37:21.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: CURRENT file: CURRENT 2024-09-12T02:37:21.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T02:37:21.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-12T02:37:21.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-12T02:37:21.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104688 ; 2024-09-12T02:37:21.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.error_if_exists: 0 2024-09-12T02:37:21.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.create_if_missing: 0 2024-09-12T02:37:21.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.paranoid_checks: 1 2024-09-12T02:37:21.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T02:37:21.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T02:37:21.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T02:37:21.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.env: 0x5654b35e7940 2024-09-12T02:37:21.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T02:37:21.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.info_log: 0x5654d5cf16a0 2024-09-12T02:37:21.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T02:37:21.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.statistics: (nil) 2024-09-12T02:37:21.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.use_fsync: 0 2024-09-12T02:37:21.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_log_file_size: 0 2024-09-12T02:37:21.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T02:37:21.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T02:37:21.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T02:37:21.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T02:37:21.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.allow_fallocate: 1 2024-09-12T02:37:21.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T02:37:21.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T02:37:21.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.use_direct_reads: 0 2024-09-12T02:37:21.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T02:37:21.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T02:37:21.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.db_log_dir: 2024-09-12T02:37:21.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.wal_dir: 2024-09-12T02:37:21.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T02:37:21.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T02:37:21.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T02:37:21.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T02:37:21.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T02:37:21.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T02:37:21.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T02:37:21.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T02:37:21.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.write_buffer_manager: 0x5654d5d00dc0 2024-09-12T02:37:21.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T02:37:21.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T02:37:21.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T02:37:21.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T02:37:21.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T02:37:21.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T02:37:21.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T02:37:21.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T02:37:21.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.unordered_write: 0 2024-09-12T02:37:21.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T02:37:21.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T02:37:21.031 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T02:37:21.031 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T02:37:21.031 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.row_cache: None 2024-09-12T02:37:21.031 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.wal_filter: None 2024-09-12T02:37:21.031 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T02:37:21.031 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T02:37:21.031 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.two_write_queues: 0 2024-09-12T02:37:21.031 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T02:37:21.031 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.wal_compression: 0 2024-09-12T02:37:21.031 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.atomic_flush: 0 2024-09-12T02:37:21.031 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T02:37:21.031 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T02:37:21.031 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T02:37:21.031 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.log_readahead_size: 0 2024-09-12T02:37:21.031 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T02:37:21.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T02:37:21.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T02:37:21.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T02:37:21.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T02:37:21.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T02:37:21.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T02:37:21.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_background_jobs: 2 2024-09-12T02:37:21.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_background_compactions: -1 2024-09-12T02:37:21.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_subcompactions: 1 2024-09-12T02:37:21.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T02:37:21.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T02:37:21.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T02:37:21.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T02:37:21.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T02:37:21.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T02:37:21.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T02:37:21.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T02:37:21.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_open_files: -1 2024-09-12T02:37:21.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T02:37:21.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T02:37:21.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T02:37:21.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T02:37:21.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_background_flushes: -1 2024-09-12T02:37:21.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Compression algorithms supported: 2024-09-12T02:37:21.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: kZSTD supported: 0 2024-09-12T02:37:21.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: kXpressCompression supported: 0 2024-09-12T02:37:21.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: kBZip2Compression supported: 0 2024-09-12T02:37:21.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T02:37:21.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: kLZ4Compression supported: 1 2024-09-12T02:37:21.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: kZlibCompression supported: 1 2024-09-12T02:37:21.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T02:37:21.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: kSnappyCompression supported: 1 2024-09-12T02:37:21.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T02:37:21.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T02:37:21.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-12T02:37:21.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T02:37:21.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T02:37:21.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.merge_operator: 2024-09-12T02:37:21.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compaction_filter: None 2024-09-12T02:37:21.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T02:37:21.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T02:37:21.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T02:37:21.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T02:37:21.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5654d5cf1300) 2024-09-12T02:37:21.035 INFO:journalctl@ceph.mon.a.smithi018.stdout: cache_index_and_filter_blocks: 1 2024-09-12T02:37:21.035 INFO:journalctl@ceph.mon.a.smithi018.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T02:37:21.035 INFO:journalctl@ceph.mon.a.smithi018.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T02:37:21.035 INFO:journalctl@ceph.mon.a.smithi018.stdout: pin_top_level_index_and_filter: 1 2024-09-12T02:37:21.035 INFO:journalctl@ceph.mon.a.smithi018.stdout: index_type: 0 2024-09-12T02:37:21.035 INFO:journalctl@ceph.mon.a.smithi018.stdout: data_block_index_type: 0 2024-09-12T02:37:21.035 INFO:journalctl@ceph.mon.a.smithi018.stdout: index_shortening: 1 2024-09-12T02:37:21.035 INFO:journalctl@ceph.mon.a.smithi018.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T02:37:21.035 INFO:journalctl@ceph.mon.a.smithi018.stdout: checksum: 4 2024-09-12T02:37:21.035 INFO:journalctl@ceph.mon.a.smithi018.stdout: no_block_cache: 0 2024-09-12T02:37:21.035 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache: 0x5654d5ce51f0 2024-09-12T02:37:21.035 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache_name: BinnedLRUCache 2024-09-12T02:37:21.035 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache_options: 2024-09-12T02:37:21.036 INFO:journalctl@ceph.mon.a.smithi018.stdout: capacity : 536870912 2024-09-12T02:37:21.036 INFO:journalctl@ceph.mon.a.smithi018.stdout: num_shard_bits : 4 2024-09-12T02:37:21.036 INFO:journalctl@ceph.mon.a.smithi018.stdout: strict_capacity_limit : 0 2024-09-12T02:37:21.036 INFO:journalctl@ceph.mon.a.smithi018.stdout: high_pri_pool_ratio: 0.000 2024-09-12T02:37:21.036 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache_compressed: (nil) 2024-09-12T02:37:21.036 INFO:journalctl@ceph.mon.a.smithi018.stdout: persistent_cache: (nil) 2024-09-12T02:37:21.036 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_size: 4096 2024-09-12T02:37:21.036 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_size_deviation: 10 2024-09-12T02:37:21.036 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_restart_interval: 16 2024-09-12T02:37:21.036 INFO:journalctl@ceph.mon.a.smithi018.stdout: index_block_restart_interval: 1 2024-09-12T02:37:21.036 INFO:journalctl@ceph.mon.a.smithi018.stdout: metadata_block_size: 4096 2024-09-12T02:37:21.036 INFO:journalctl@ceph.mon.a.smithi018.stdout: partition_filters: 0 2024-09-12T02:37:21.036 INFO:journalctl@ceph.mon.a.smithi018.stdout: use_delta_encoding: 1 2024-09-12T02:37:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout: filter_policy: bloomfilter 2024-09-12T02:37:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout: whole_key_filtering: 1 2024-09-12T02:37:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout: verify_compression: 0 2024-09-12T02:37:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout: read_amp_bytes_per_bit: 0 2024-09-12T02:37:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout: format_version: 5 2024-09-12T02:37:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout: enable_index_compression: 1 2024-09-12T02:37:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_align: 0 2024-09-12T02:37:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout: max_auto_readahead_size: 262144 2024-09-12T02:37:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout: prepopulate_block_cache: 0 2024-09-12T02:37:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout: initial_auto_readahead_size: 8192 2024-09-12T02:37:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T02:37:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T02:37:21.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T02:37:21.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compression: NoCompression 2024-09-12T02:37:21.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T02:37:21.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T02:37:21.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T02:37:21.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.num_levels: 7 2024-09-12T02:37:21.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T02:37:21.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T02:37:21.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T02:37:21.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T02:37:21.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T02:37:21.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T02:37:21.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T02:37:21.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:37:21.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T02:37:21.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T02:37:21.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:37:21.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:37:21.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T02:37:21.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T02:37:21.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T02:37:21.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T02:37:21.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:37:21.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:37:21.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T02:37:21.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T02:37:21.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:37:21.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T02:37:21.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T02:37:21.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T02:37:21.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T02:37:21.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T02:37:21.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T02:37:21.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T02:37:21.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T02:37:21.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T02:37:21.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T02:37:21.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T02:37:21.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T02:37:21.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T02:37:21.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T02:37:21.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T02:37:21.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T02:37:21.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T02:37:21.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T02:37:21.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T02:37:21.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T02:37:21.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T02:37:21.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T02:37:21.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T02:37:21.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T02:37:21.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T02:37:21.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T02:37:21.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T02:37:21.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T02:37:21.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T02:37:21.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T02:37:21.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T02:37:21.042 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T02:37:21.042 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T02:37:21.042 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.inplace_update_support: 0 2024-09-12T02:37:21.042 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T02:37:21.042 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T02:37:21.042 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T02:37:21.042 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T02:37:21.042 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.bloom_locality: 0 2024-09-12T02:37:21.042 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.max_successive_merges: 0 2024-09-12T02:37:21.042 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T02:37:21.042 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T02:37:21.042 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T02:37:21.042 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T02:37:21.042 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.ttl: 2592000 2024-09-12T02:37:21.043 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T02:37:21.043 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T02:37:21.043 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T02:37:21.043 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.enable_blob_files: false 2024-09-12T02:37:21.043 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.min_blob_size: 0 2024-09-12T02:37:21.043 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T02:37:21.043 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T02:37:21.043 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T02:37:21.043 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T02:37:21.043 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T02:37:21.043 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T02:37:21.043 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T02:37:21.043 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T02:37:21.043 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-12T02:37:21.043 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-12T02:37:21.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 649b562f-62ea-4d03-a5ff-c5c91f16ccad 2024-09-12T02:37:21.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108640815699, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-12T02:37:21.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-12T02:37:21.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108640817741, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99843, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 97725, "index_size": 310, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14159, "raw_average_key_size": 49, "raw_value_size": 90034, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726108640, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "649b562f-62ea-4d03-a5ff-c5c91f16ccad", "db_session_id": "R5E04HKNSJBYBX89O6MY", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-12T02:37:21.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108640817955, "job": 1, "event": "recovery_finished"} 2024-09-12T02:37:21.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-12T02:37:21.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T02:37:21.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5654d5d14e00 2024-09-12T02:37:21.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: DB pointer 0x5654d5e10000 2024-09-12T02:37:21.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T02:37:21.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T02:37:21.044 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** DB Stats ** 2024-09-12T02:37:21.044 INFO:journalctl@ceph.mon.a.smithi018.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:37:21.044 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T02:37:21.045 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:37:21.045 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:37:21.045 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T02:37:21.045 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:37:21.045 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:37:21.045 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-12T02:37:21.045 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** Compaction Stats [default] ** 2024-09-12T02:37:21.045 INFO:journalctl@ceph.mon.a.smithi018.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:37:21.045 INFO:journalctl@ceph.mon.a.smithi018.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T02:37:21.045 INFO:journalctl@ceph.mon.a.smithi018.stdout: L0 2/0 99.36 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 70.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:37:21.045 INFO:journalctl@ceph.mon.a.smithi018.stdout: Sum 2/0 99.36 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 70.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:37:21.045 INFO:journalctl@ceph.mon.a.smithi018.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 70.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:37:21.045 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-12T02:37:21.046 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** Compaction Stats [default] ** 2024-09-12T02:37:21.046 INFO:journalctl@ceph.mon.a.smithi018.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:37:21.046 INFO:journalctl@ceph.mon.a.smithi018.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T02:37:21.046 INFO:journalctl@ceph.mon.a.smithi018.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 70.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:37:21.046 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-12T02:37:21.046 INFO:journalctl@ceph.mon.a.smithi018.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T02:37:21.046 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-12T02:37:21.046 INFO:journalctl@ceph.mon.a.smithi018.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:37:21.046 INFO:journalctl@ceph.mon.a.smithi018.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T02:37:21.046 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T02:37:21.046 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T02:37:21.046 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T02:37:21.046 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T02:37:21.046 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative compaction: 0.00 GB write, 14.75 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:37:21.046 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval compaction: 0.00 GB write, 14.75 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:37:21.047 INFO:journalctl@ceph.mon.a.smithi018.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T02:37:21.047 INFO:journalctl@ceph.mon.a.smithi018.stdout: Block cache BinnedLRUCache@0x5654d5ce51f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-12T02:37:21.047 INFO:journalctl@ceph.mon.a.smithi018.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-12T02:37:21.047 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-12T02:37:21.047 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T02:37:21.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: starting mon.a rank 0 at public addrs [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] at bind addrs [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:37:21.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: mon.a@-1(???) e1 preinit fsid c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:37:21.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: mon.a@-1(???).mds e1 new map 2024-09-12T02:37:21.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: mon.a@-1(???).mds e1 print_map 2024-09-12T02:37:21.047 INFO:journalctl@ceph.mon.a.smithi018.stdout: e1 2024-09-12T02:37:21.047 INFO:journalctl@ceph.mon.a.smithi018.stdout: btime 2024-09-12T02:37:14:139320+0000 2024-09-12T02:37:21.047 INFO:journalctl@ceph.mon.a.smithi018.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T02:37:21.047 INFO:journalctl@ceph.mon.a.smithi018.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:37:21.047 INFO:journalctl@ceph.mon.a.smithi018.stdout: legacy client fscid: -1 2024-09-12T02:37:21.048 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-12T02:37:21.048 INFO:journalctl@ceph.mon.a.smithi018.stdout: No filesystems configured 2024-09-12T02:37:21.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T02:37:21.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:37:21.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:37:21.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:37:21.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-12T02:37:21.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 bash[30598]: 148cd232de42e3695eb17ae511afd37d6a44a0d0a9628325ba3a0d405d26007d 2024-09-12T02:37:21.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 systemd[1]: Started Ceph mon.a for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:37:21.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T02:37:21.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: monmap epoch 1 2024-09-12T02:37:21.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: fsid c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:37:21.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: last_changed 2024-09-12T02:37:09.409832+0000 2024-09-12T02:37:21.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: created 2024-09-12T02:37:09.409832+0000 2024-09-12T02:37:21.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: min_mon_release 19 (squid) 2024-09-12T02:37:21.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: election_strategy: 1 2024-09-12T02:37:21.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-12T02:37:21.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: fsmap 2024-09-12T02:37:21.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T02:37:21.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:20 smithi018 ceph-mon[30616]: mgrmap e1: no daemons active 2024-09-12T02:37:22.259 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.472+0000 7f0275000640 1 Processor -- start 2024-09-12T02:37:22.260 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.472+0000 7f0275000640 1 -- start start 2024-09-12T02:37:22.260 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.472+0000 7f0275000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f027007de40 0x7f027007c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:22.260 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.472+0000 7f0275000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f027007c870 con 0x7f027007de40 2024-09-12T02:37:22.260 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.473+0000 7f026de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f027007de40 0x7f027007c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:22.260 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.473+0000 7f026de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f027007de40 0x7f027007c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51940/0 (socket says 172.21.15.18:51940) 2024-09-12T02:37:22.260 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.473+0000 7f026de00640 1 -- 172.21.15.18:0/1826989418 learned_addr learned my addr 172.21.15.18:0/1826989418 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:22.260 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.473+0000 7f026de00640 1 -- 172.21.15.18:0/1826989418 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027007c9f0 con 0x7f027007de40 2024-09-12T02:37:22.260 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.476+0000 7f026de00640 1 --2- 172.21.15.18:0/1826989418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f027007de40 0x7f027007c2a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0260009820 tx=0x7f026002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51643911502dcda5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:22.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.476+0000 7f026ca00640 1 -- 172.21.15.18:0/1826989418 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0260037070 con 0x7f027007de40 2024-09-12T02:37:22.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.476+0000 7f026ca00640 1 -- 172.21.15.18:0/1826989418 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0260032900 con 0x7f027007de40 2024-09-12T02:37:22.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.476+0000 7f026ca00640 1 -- 172.21.15.18:0/1826989418 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0260030850 con 0x7f027007de40 2024-09-12T02:37:22.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.477+0000 7f0275000640 1 -- 172.21.15.18:0/1826989418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f027007de40 msgr2=0x7f027007c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:22.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.477+0000 7f0275000640 1 --2- 172.21.15.18:0/1826989418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f027007de40 0x7f027007c2a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0260009820 tx=0x7f026002a270 comp rx=0 tx=0).stop 2024-09-12T02:37:22.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.477+0000 7f0275000640 1 -- 172.21.15.18:0/1826989418 shutdown_connections 2024-09-12T02:37:22.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.477+0000 7f0275000640 1 --2- 172.21.15.18:0/1826989418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f027007de40 0x7f027007c2a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:22.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.477+0000 7f0275000640 1 -- 172.21.15.18:0/1826989418 >> 172.21.15.18:0/1826989418 conn(0x7f0270102cc0 msgr2=0x7f0270105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:22.261 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.477+0000 7f0275000640 1 -- 172.21.15.18:0/1826989418 shutdown_connections 2024-09-12T02:37:22.262 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.477+0000 7f0275000640 1 -- 172.21.15.18:0/1826989418 wait complete. 2024-09-12T02:37:22.262 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.478+0000 7f0275000640 1 Processor -- start 2024-09-12T02:37:22.262 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.478+0000 7f0275000640 1 -- start start 2024-09-12T02:37:22.262 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.478+0000 7f0275000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f027007de40 0x7f027019d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:22.262 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.479+0000 7f0275000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f027010dba0 con 0x7f027007de40 2024-09-12T02:37:22.262 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.479+0000 7f026de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f027007de40 0x7f027019d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:22.262 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.479+0000 7f026de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f027007de40 0x7f027019d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51942/0 (socket says 172.21.15.18:51942) 2024-09-12T02:37:22.262 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.479+0000 7f026de00640 1 -- 172.21.15.18:0/2794250557 learned_addr learned my addr 172.21.15.18:0/2794250557 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:22.262 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.479+0000 7f026de00640 1 -- 172.21.15.18:0/2794250557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027019dc80 con 0x7f027007de40 2024-09-12T02:37:22.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.479+0000 7f026de00640 1 --2- 172.21.15.18:0/2794250557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f027007de40 0x7f027019d740 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0260032ce0 tx=0x7f0260032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:22.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.480+0000 7f0266a00640 1 -- 172.21.15.18:0/2794250557 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0260042070 con 0x7f027007de40 2024-09-12T02:37:22.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.480+0000 7f0266a00640 1 -- 172.21.15.18:0/2794250557 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f02600308c0 con 0x7f027007de40 2024-09-12T02:37:22.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.480+0000 7f0266a00640 1 -- 172.21.15.18:0/2794250557 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0260037040 con 0x7f027007de40 2024-09-12T02:37:22.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.480+0000 7f0275000640 1 -- 172.21.15.18:0/2794250557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f027019df10 con 0x7f027007de40 2024-09-12T02:37:22.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.480+0000 7f0275000640 1 -- 172.21.15.18:0/2794250557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02701a0c00 con 0x7f027007de40 2024-09-12T02:37:22.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.480+0000 7f0266a00640 1 -- 172.21.15.18:0/2794250557 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0260045070 con 0x7f027007de40 2024-09-12T02:37:22.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.480+0000 7f0266a00640 1 -- 172.21.15.18:0/2794250557 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0260047840 con 0x7f027007de40 2024-09-12T02:37:22.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.481+0000 7f0275000640 1 -- 172.21.15.18:0/2794250557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f027007c320 con 0x7f027007de40 2024-09-12T02:37:22.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.484+0000 7f0266a00640 1 -- 172.21.15.18:0/2794250557 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0260047a40 con 0x7f027007de40 2024-09-12T02:37:22.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.547+0000 7f0275000640 1 -- 172.21.15.18:0/2794250557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f02701a0dd0 con 0x7f027007de40 2024-09-12T02:37:22.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.549+0000 7f0266a00640 1 -- 172.21.15.18:0/2794250557 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f026003d770 con 0x7f027007de40 2024-09-12T02:37:22.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.550+0000 7f0275000640 1 -- 172.21.15.18:0/2794250557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f027007de40 msgr2=0x7f027019d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:22.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.550+0000 7f0275000640 1 --2- 172.21.15.18:0/2794250557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f027007de40 0x7f027019d740 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0260032ce0 tx=0x7f0260032d10 comp rx=0 tx=0).stop 2024-09-12T02:37:22.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.550+0000 7f0275000640 1 -- 172.21.15.18:0/2794250557 shutdown_connections 2024-09-12T02:37:22.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.550+0000 7f0275000640 1 --2- 172.21.15.18:0/2794250557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f027007de40 0x7f027019d740 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:22.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.550+0000 7f0275000640 1 -- 172.21.15.18:0/2794250557 >> 172.21.15.18:0/2794250557 conn(0x7f0270102cc0 msgr2=0x7f0270103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:22.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.550+0000 7f0275000640 1 -- 172.21.15.18:0/2794250557 shutdown_connections 2024-09-12T02:37:22.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:21.550+0000 7f0275000640 1 -- 172.21.15.18:0/2794250557 wait complete. 2024-09-12T02:37:22.264 INFO:teuthology.orchestra.run.smithi018.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-12T02:37:22.300 INFO:teuthology.orchestra.run.smithi018.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:37:22.300 INFO:teuthology.orchestra.run.smithi018.stdout:Creating mgr... 2024-09-12T02:37:22.300 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-12T02:37:22.301 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-12T02:37:22.647 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c7666100-70af-11ef-bcea-c7b262605968@mgr.x 2024-09-12T02:37:22.648 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c7666100-70af-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-c7666100-70af-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-12T02:37:22.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:22 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2794250557' entity='client.admin' 2024-09-12T02:37:22.879 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c7666100-70af-11ef-bcea-c7b262605968.target.wants/ceph-c7666100-70af-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-c7666100-70af-11ef-bcea-c7b262605968@.service. 2024-09-12T02:37:23.227 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:22 smithi018 systemd[1]: Starting Ceph mgr.x for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T02:37:23.501 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:23 smithi018 podman[30827]: 2024-09-12 02:37:23.13196354 +0000 UTC m=+0.026882642 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:37:23.501 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:23 smithi018 podman[30827]: 2024-09-12 02:37:23.274605311 +0000 UTC m=+0.169524413 container create 4e1ebb106e6331d79cdec7c48e43776407873cdf4d38fce40c1b5080fecd35b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T02:37:23.501 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:23 smithi018 podman[30827]: 2024-09-12 02:37:23.501311876 +0000 UTC m=+0.396231000 container init 4e1ebb106e6331d79cdec7c48e43776407873cdf4d38fce40c1b5080fecd35b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:37:23.620 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:37:23.621 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-09-12T02:37:23.634 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:37:23.635 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-12T02:37:23.635 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-09-12T02:37:23.635 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T02:37:23.652 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:37:23.652 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-09-12T02:37:23.667 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:37:23.667 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-12T02:37:23.667 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-09-12T02:37:23.667 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-12T02:37:23.667 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr to start... 2024-09-12T02:37:23.667 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr... 2024-09-12T02:37:23.756 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:23 smithi018 podman[30827]: 2024-09-12 02:37:23.507804554 +0000 UTC m=+0.402723656 container start 4e1ebb106e6331d79cdec7c48e43776407873cdf4d38fce40c1b5080fecd35b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-12T02:37:23.757 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:23 smithi018 bash[30827]: 4e1ebb106e6331d79cdec7c48e43776407873cdf4d38fce40c1b5080fecd35b5 2024-09-12T02:37:23.757 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:23 smithi018 systemd[1]: Started Ceph mgr.x for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:37:23.757 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:23 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:23.678+0000 7f6e1fa30040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:37:23.757 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:23 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:23.755+0000 7f6e1fa30040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:37:24.043 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:23 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:23.953+0000 7f6e1fa30040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:37:24.043 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:24 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:24.041+0000 7f6e1fa30040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:37:24.303 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:24 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:24.226+0000 7f6e1fa30040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:37:24.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:24 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3914135220' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T02:37:24.601 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:24 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:24.407+0000 7f6e1fa30040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:37:25.089 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:24 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:24.808+0000 7f6e1fa30040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:37:25.089 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:24 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:24.882+0000 7f6e1fa30040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:37:25.097 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-12T02:37:25.097 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:37:25.097 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsid": "c7666100-70af-11ef-bcea-c7b262605968", 2024-09-12T02:37:25.097 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T02:37:25.097 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T02:37:25.097 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T02:37:25.097 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T02:37:25.097 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:25.098 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T02:37:25.098 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T02:37:25.098 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 0 2024-09-12T02:37:25.098 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:37:25.098 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T02:37:25.098 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T02:37:25.098 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:37:25.098 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-12T02:37:25.098 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T02:37:25.098 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:37:25.098 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T02:37:25.098 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T02:37:25.099 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:25.099 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T02:37:25.099 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:37:25.099 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T02:37:25.099 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T02:37:25.099 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T02:37:25.107 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T02:37:25.107 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T02:37:25.107 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T02:37:25.107 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:25.107 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T02:37:25.107 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T02:37:25.107 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T02:37:25.107 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T02:37:25.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T02:37:25.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T02:37:25.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T02:37:25.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T02:37:25.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T02:37:25.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:25.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T02:37:25.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:37:25.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T02:37:14:139320+0000", 2024-09-12T02:37:25.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T02:37:25.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T02:37:25.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:25.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T02:37:25.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T02:37:25.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T02:37:25.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T02:37:25.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T02:37:25.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T02:37:25.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T02:37:25.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:37:25.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:37:25.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:25.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T02:37:25.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:37:25.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T02:37:14.140105+0000", 2024-09-12T02:37:25.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:37:25.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:25.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T02:37:25.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:37:25.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.222+0000 7ff4b4e00640 1 Processor -- start 2024-09-12T02:37:25.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.222+0000 7ff4b4e00640 1 -- start start 2024-09-12T02:37:25.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.222+0000 7ff4b4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4b0109810 0x7ff4b0109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:25.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.222+0000 7ff4b4e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b010a1e0 con 0x7ff4b0109810 2024-09-12T02:37:25.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.223+0000 7ff4ade00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4b0109810 0x7ff4b0109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:25.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.223+0000 7ff4ade00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4b0109810 0x7ff4b0109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51986/0 (socket says 172.21.15.18:51986) 2024-09-12T02:37:25.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.223+0000 7ff4ade00640 1 -- 172.21.15.18:0/3176268775 learned_addr learned my addr 172.21.15.18:0/3176268775 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:25.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.223+0000 7ff4ade00640 1 -- 172.21.15.18:0/3176268775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b010a950 con 0x7ff4b0109810 2024-09-12T02:37:25.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.224+0000 7ff4ade00640 1 --2- 172.21.15.18:0/3176268775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4b0109810 0x7ff4b0109c10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0009820 tx=0x7ff4a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b2ae73d4ef45a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:25.110 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.225+0000 7ff4aca00640 1 -- 172.21.15.18:0/3176268775 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a0037070 con 0x7ff4b0109810 2024-09-12T02:37:25.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.225+0000 7ff4aca00640 1 -- 172.21.15.18:0/3176268775 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff4a0032900 con 0x7ff4b0109810 2024-09-12T02:37:25.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.225+0000 7ff4aca00640 1 -- 172.21.15.18:0/3176268775 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a0030850 con 0x7ff4b0109810 2024-09-12T02:37:25.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.225+0000 7ff4b4e00640 1 -- 172.21.15.18:0/3176268775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4b0109810 msgr2=0x7ff4b0109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:25.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.225+0000 7ff4b4e00640 1 --2- 172.21.15.18:0/3176268775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4b0109810 0x7ff4b0109c10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0009820 tx=0x7ff4a002a270 comp rx=0 tx=0).stop 2024-09-12T02:37:25.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.225+0000 7ff4b4e00640 1 -- 172.21.15.18:0/3176268775 shutdown_connections 2024-09-12T02:37:25.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.225+0000 7ff4b4e00640 1 --2- 172.21.15.18:0/3176268775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4b0109810 0x7ff4b0109c10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:25.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.225+0000 7ff4b4e00640 1 -- 172.21.15.18:0/3176268775 >> 172.21.15.18:0/3176268775 conn(0x7ff4b007ccf0 msgr2=0x7ff4b007d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:25.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.226+0000 7ff4b4e00640 1 -- 172.21.15.18:0/3176268775 shutdown_connections 2024-09-12T02:37:25.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.226+0000 7ff4b4e00640 1 -- 172.21.15.18:0/3176268775 wait complete. 2024-09-12T02:37:25.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.227+0000 7ff4b4e00640 1 Processor -- start 2024-09-12T02:37:25.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.227+0000 7ff4b4e00640 1 -- start start 2024-09-12T02:37:25.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.227+0000 7ff4b4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4b0109810 0x7ff4b019d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:25.111 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.227+0000 7ff4b4e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b010dd00 con 0x7ff4b0109810 2024-09-12T02:37:25.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.227+0000 7ff4ade00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4b0109810 0x7ff4b019d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:25.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.228+0000 7ff4ade00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4b0109810 0x7ff4b019d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51990/0 (socket says 172.21.15.18:51990) 2024-09-12T02:37:25.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.228+0000 7ff4ade00640 1 -- 172.21.15.18:0/3914135220 learned_addr learned my addr 172.21.15.18:0/3914135220 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:25.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.228+0000 7ff4ade00640 1 -- 172.21.15.18:0/3914135220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b019dd10 con 0x7ff4b0109810 2024-09-12T02:37:25.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.228+0000 7ff4ade00640 1 --2- 172.21.15.18:0/3914135220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4b0109810 0x7ff4b019d7d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0030460 tx=0x7ff4a0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:25.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.229+0000 7ff4a6a00640 1 -- 172.21.15.18:0/3914135220 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a0042070 con 0x7ff4b0109810 2024-09-12T02:37:25.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.229+0000 7ff4a6a00640 1 -- 172.21.15.18:0/3914135220 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff4a0032be0 con 0x7ff4b0109810 2024-09-12T02:37:25.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.229+0000 7ff4b4e00640 1 -- 172.21.15.18:0/3914135220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b019dfa0 con 0x7ff4b0109810 2024-09-12T02:37:25.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.229+0000 7ff4b4e00640 1 -- 172.21.15.18:0/3914135220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b01a0c90 con 0x7ff4b0109810 2024-09-12T02:37:25.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.229+0000 7ff4a6a00640 1 -- 172.21.15.18:0/3914135220 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a0037040 con 0x7ff4b0109810 2024-09-12T02:37:25.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.229+0000 7ff4a6a00640 1 -- 172.21.15.18:0/3914135220 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff4a0045070 con 0x7ff4b0109810 2024-09-12T02:37:25.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.229+0000 7ff4a6a00640 1 -- 172.21.15.18:0/3914135220 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff4a00463b0 con 0x7ff4b0109810 2024-09-12T02:37:25.112 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.230+0000 7ff49be00640 1 -- 172.21.15.18:0/3914135220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b0109c10 con 0x7ff4b0109810 2024-09-12T02:37:25.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.235+0000 7ff4a6a00640 1 -- 172.21.15.18:0/3914135220 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff4a0032d90 con 0x7ff4b0109810 2024-09-12T02:37:25.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.301+0000 7ff49be00640 1 -- 172.21.15.18:0/3914135220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff4b0062df0 con 0x7ff4b0109810 2024-09-12T02:37:25.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.302+0000 7ff4a6a00640 1 -- 172.21.15.18:0/3914135220 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7ff4a003da10 con 0x7ff4b0109810 2024-09-12T02:37:25.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.304+0000 7ff49be00640 1 -- 172.21.15.18:0/3914135220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4b0109810 msgr2=0x7ff4b019d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:25.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.304+0000 7ff49be00640 1 --2- 172.21.15.18:0/3914135220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4b0109810 0x7ff4b019d7d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0030460 tx=0x7ff4a0030d80 comp rx=0 tx=0).stop 2024-09-12T02:37:25.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.304+0000 7ff49be00640 1 -- 172.21.15.18:0/3914135220 shutdown_connections 2024-09-12T02:37:25.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.304+0000 7ff49be00640 1 --2- 172.21.15.18:0/3914135220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4b0109810 0x7ff4b019d7d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:25.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.304+0000 7ff49be00640 1 -- 172.21.15.18:0/3914135220 >> 172.21.15.18:0/3914135220 conn(0x7ff4b007ccf0 msgr2=0x7ff4b01074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:25.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.304+0000 7ff49be00640 1 -- 172.21.15.18:0/3914135220 shutdown_connections 2024-09-12T02:37:25.113 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:24.304+0000 7ff49be00640 1 -- 172.21.15.18:0/3914135220 wait complete. 2024-09-12T02:37:25.113 INFO:teuthology.orchestra.run.smithi018.stdout:mgr not available, waiting (1/15)... 2024-09-12T02:37:25.350 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:25 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:25.102+0000 7f6e1fa30040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:37:26.601 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:26 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:26.257+0000 7f6e1fa30040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:37:26.601 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:26 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:26.340+0000 7f6e1fa30040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:37:27.600 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:27 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:27.332+0000 7f6e1fa30040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:37:27.601 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:27 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:27.477+0000 7f6e1fa30040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:37:27.916 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:27 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1235056566' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T02:37:27.916 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:27 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:27.650+0000 7f6e1fa30040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:37:27.916 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:27 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:27.727+0000 7f6e1fa30040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:37:27.916 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:27 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:27.914+0000 7f6e1fa30040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:37:28.211 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:28 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:27.999+0000 7f6e1fa30040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:37:28.211 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:28 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:28.074+0000 7f6e1fa30040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:37:28.530 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:28 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:28.264+0000 7f6e1fa30040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:37:28.530 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:28 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:28.345+0000 7f6e1fa30040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:37:28.531 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:28 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:28.427+0000 7f6e1fa30040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:37:28.531 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:28 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:28.529+0000 7f6e1fa30040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:37:28.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-12T02:37:28.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:37:28.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsid": "c7666100-70af-11ef-bcea-c7b262605968", 2024-09-12T02:37:28.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T02:37:28.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T02:37:28.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T02:37:28.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T02:37:28.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:28.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T02:37:28.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T02:37:28.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 0 2024-09-12T02:37:28.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:37:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T02:37:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T02:37:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:37:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-12T02:37:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T02:37:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:37:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T02:37:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T02:37:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T02:37:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:37:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T02:37:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T02:37:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T02:37:28.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T02:37:28.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T02:37:28.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T02:37:28.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:28.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T02:37:28.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T02:37:28.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T02:37:28.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T02:37:28.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T02:37:28.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T02:37:28.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T02:37:28.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T02:37:28.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T02:37:28.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:28.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T02:37:28.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:37:28.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T02:37:14:139320+0000", 2024-09-12T02:37:28.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T02:37:28.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T02:37:28.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:28.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T02:37:28.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T02:37:28.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T02:37:28.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T02:37:28.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T02:37:28.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T02:37:28.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T02:37:28.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:37:28.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:37:28.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:28.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T02:37:28.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:37:28.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T02:37:14.140105+0000", 2024-09-12T02:37:28.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:37:28.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:28.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T02:37:28.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:37:28.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.743+0000 7fb8d4800640 1 Processor -- start 2024-09-12T02:37:28.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.743+0000 7fb8d4800640 1 -- start start 2024-09-12T02:37:28.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.744+0000 7fb8d4800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8cc109810 0x7fb8cc109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:28.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.744+0000 7fb8d4800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc10a1e0 con 0x7fb8cc109810 2024-09-12T02:37:28.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.744+0000 7fb8d1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8cc109810 0x7fb8cc109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:28.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.744+0000 7fb8d1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8cc109810 0x7fb8cc109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38728/0 (socket says 172.21.15.18:38728) 2024-09-12T02:37:28.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.744+0000 7fb8d1e00640 1 -- 172.21.15.18:0/1312363698 learned_addr learned my addr 172.21.15.18:0/1312363698 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:28.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.744+0000 7fb8d1e00640 1 -- 172.21.15.18:0/1312363698 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8cc10a950 con 0x7fb8cc109810 2024-09-12T02:37:28.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.745+0000 7fb8d1e00640 1 --2- 172.21.15.18:0/1312363698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8cc109810 0x7fb8cc109c10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009820 tx=0x7fb8c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58281f2103884390 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:28.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.746+0000 7fb8d0a00640 1 -- 172.21.15.18:0/1312363698 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8c0037070 con 0x7fb8cc109810 2024-09-12T02:37:28.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.746+0000 7fb8d0a00640 1 -- 172.21.15.18:0/1312363698 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb8c0032900 con 0x7fb8cc109810 2024-09-12T02:37:28.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.746+0000 7fb8d0a00640 1 -- 172.21.15.18:0/1312363698 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8c0030850 con 0x7fb8cc109810 2024-09-12T02:37:28.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.746+0000 7fb8d4800640 1 -- 172.21.15.18:0/1312363698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8cc109810 msgr2=0x7fb8cc109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:28.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.746+0000 7fb8d4800640 1 --2- 172.21.15.18:0/1312363698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8cc109810 0x7fb8cc109c10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009820 tx=0x7fb8c002a270 comp rx=0 tx=0).stop 2024-09-12T02:37:28.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.747+0000 7fb8d4800640 1 -- 172.21.15.18:0/1312363698 shutdown_connections 2024-09-12T02:37:28.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.747+0000 7fb8d4800640 1 --2- 172.21.15.18:0/1312363698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8cc109810 0x7fb8cc109c10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:28.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.747+0000 7fb8d4800640 1 -- 172.21.15.18:0/1312363698 >> 172.21.15.18:0/1312363698 conn(0x7fb8cc07ccf0 msgr2=0x7fb8cc07d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:28.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.747+0000 7fb8d4800640 1 -- 172.21.15.18:0/1312363698 shutdown_connections 2024-09-12T02:37:28.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.747+0000 7fb8d4800640 1 -- 172.21.15.18:0/1312363698 wait complete. 2024-09-12T02:37:28.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.748+0000 7fb8d4800640 1 Processor -- start 2024-09-12T02:37:28.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.748+0000 7fb8d4800640 1 -- start start 2024-09-12T02:37:28.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.748+0000 7fb8d4800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8cc109810 0x7fb8cc19d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:28.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.748+0000 7fb8d4800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc10dd00 con 0x7fb8cc109810 2024-09-12T02:37:28.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.748+0000 7fb8d1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8cc109810 0x7fb8cc19d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:28.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.749+0000 7fb8d1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8cc109810 0x7fb8cc19d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38732/0 (socket says 172.21.15.18:38732) 2024-09-12T02:37:28.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.749+0000 7fb8d1e00640 1 -- 172.21.15.18:0/1235056566 learned_addr learned my addr 172.21.15.18:0/1235056566 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:28.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.749+0000 7fb8d1e00640 1 -- 172.21.15.18:0/1235056566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8cc19dd10 con 0x7fb8cc109810 2024-09-12T02:37:28.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.749+0000 7fb8d1e00640 1 --2- 172.21.15.18:0/1235056566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8cc109810 0x7fb8cc19d7d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0030460 tx=0x7fb8c0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:28.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.750+0000 7fb8c6a00640 1 -- 172.21.15.18:0/1235056566 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8c0042070 con 0x7fb8cc109810 2024-09-12T02:37:28.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.750+0000 7fb8c6a00640 1 -- 172.21.15.18:0/1235056566 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb8c0032be0 con 0x7fb8cc109810 2024-09-12T02:37:28.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.750+0000 7fb8d4800640 1 -- 172.21.15.18:0/1235056566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8cc19dfa0 con 0x7fb8cc109810 2024-09-12T02:37:28.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.750+0000 7fb8c6a00640 1 -- 172.21.15.18:0/1235056566 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8c0037040 con 0x7fb8cc109810 2024-09-12T02:37:28.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.750+0000 7fb8d4800640 1 -- 172.21.15.18:0/1235056566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8cc1a0c90 con 0x7fb8cc109810 2024-09-12T02:37:28.570 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.750+0000 7fb8c6a00640 1 -- 172.21.15.18:0/1235056566 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb8c0045070 con 0x7fb8cc109810 2024-09-12T02:37:28.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.750+0000 7fb8c6a00640 1 -- 172.21.15.18:0/1235056566 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb8c0047a90 con 0x7fb8cc109810 2024-09-12T02:37:28.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.751+0000 7fb8d4800640 1 -- 172.21.15.18:0/1235056566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8cc109c10 con 0x7fb8cc109810 2024-09-12T02:37:28.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.754+0000 7fb8c6a00640 1 -- 172.21.15.18:0/1235056566 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb8c0032d90 con 0x7fb8cc109810 2024-09-12T02:37:28.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.820+0000 7fb8d4800640 1 -- 172.21.15.18:0/1235056566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb8cc1a0e60 con 0x7fb8cc109810 2024-09-12T02:37:28.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.820+0000 7fb8c6a00640 1 -- 172.21.15.18:0/1235056566 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fb8c003da10 con 0x7fb8cc109810 2024-09-12T02:37:28.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.821+0000 7fb8d4800640 1 -- 172.21.15.18:0/1235056566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8cc109810 msgr2=0x7fb8cc19d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:28.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.821+0000 7fb8d4800640 1 --2- 172.21.15.18:0/1235056566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8cc109810 0x7fb8cc19d7d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0030460 tx=0x7fb8c0030d80 comp rx=0 tx=0).stop 2024-09-12T02:37:28.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.821+0000 7fb8d4800640 1 -- 172.21.15.18:0/1235056566 shutdown_connections 2024-09-12T02:37:28.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.822+0000 7fb8d4800640 1 --2- 172.21.15.18:0/1235056566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8cc109810 0x7fb8cc19d7d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:28.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.822+0000 7fb8d4800640 1 -- 172.21.15.18:0/1235056566 >> 172.21.15.18:0/1235056566 conn(0x7fb8cc07ccf0 msgr2=0x7fb8cc1074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:28.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.822+0000 7fb8d4800640 1 -- 172.21.15.18:0/1235056566 shutdown_connections 2024-09-12T02:37:28.571 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:27.822+0000 7fb8d4800640 1 -- 172.21.15.18:0/1235056566 wait complete. 2024-09-12T02:37:28.571 INFO:teuthology.orchestra.run.smithi018.stdout:mgr not available, waiting (2/15)... 2024-09-12T02:37:28.850 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:28 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:28.604+0000 7f6e1fa30040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:37:28.851 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:28 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:28.677+0000 7f6e1fa30040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:37:30.101 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:29 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:29.629+0000 7f6e1fa30040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:37:30.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:29 smithi018 ceph-mon[30616]: Activating manager daemon x 2024-09-12T02:37:30.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:29 smithi018 ceph-mon[30616]: mgrmap e2: x(active, starting, since 0.00412872s) 2024-09-12T02:37:30.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:29 smithi018 ceph-mon[30616]: from='mgr.14100 172.21.15.18:0/589413981' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:37:30.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:29 smithi018 ceph-mon[30616]: from='mgr.14100 172.21.15.18:0/589413981' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:37:30.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:29 smithi018 ceph-mon[30616]: from='mgr.14100 172.21.15.18:0/589413981' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:37:30.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:29 smithi018 ceph-mon[30616]: from='mgr.14100 172.21.15.18:0/589413981' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:37:30.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:29 smithi018 ceph-mon[30616]: from='mgr.14100 172.21.15.18:0/589413981' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:37:30.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:29 smithi018 ceph-mon[30616]: Manager daemon x is now available 2024-09-12T02:37:30.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:29 smithi018 ceph-mon[30616]: from='mgr.14100 172.21.15.18:0/589413981' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:37:30.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:29 smithi018 ceph-mon[30616]: from='mgr.14100 172.21.15.18:0/589413981' entity='mgr.x' 2024-09-12T02:37:30.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:29 smithi018 ceph-mon[30616]: from='mgr.14100 172.21.15.18:0/589413981' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:37:30.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:29 smithi018 ceph-mon[30616]: from='mgr.14100 172.21.15.18:0/589413981' entity='mgr.x' 2024-09-12T02:37:30.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:29 smithi018 ceph-mon[30616]: from='mgr.14100 172.21.15.18:0/589413981' entity='mgr.x' 2024-09-12T02:37:32.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:31 smithi018 ceph-mon[30616]: mgrmap e3: x(active, since 1.00916s) 2024-09-12T02:37:32.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:31 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2805283652' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T02:37:32.052 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-12T02:37:32.052 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:37:32.052 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsid": "c7666100-70af-11ef-bcea-c7b262605968", 2024-09-12T02:37:32.052 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T02:37:32.053 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T02:37:32.053 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T02:37:32.053 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T02:37:32.053 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:32.053 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T02:37:32.053 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T02:37:32.053 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 0 2024-09-12T02:37:32.053 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:37:32.053 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T02:37:32.053 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T02:37:32.053 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:37:32.053 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-12T02:37:32.053 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T02:37:32.053 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:37:32.053 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T02:37:32.054 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T02:37:32.054 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:32.054 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T02:37:32.054 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:37:32.054 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T02:37:32.054 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T02:37:32.054 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T02:37:32.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T02:37:32.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T02:37:32.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T02:37:32.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:32.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T02:37:32.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T02:37:32.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T02:37:32.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T02:37:32.063 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T02:37:32.063 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T02:37:32.063 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T02:37:32.063 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T02:37:32.063 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T02:37:32.063 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:32.063 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T02:37:32.063 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:37:32.063 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T02:37:14:139320+0000", 2024-09-12T02:37:32.063 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T02:37:32.063 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T02:37:32.063 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:32.063 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T02:37:32.064 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T02:37:32.064 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T02:37:32.064 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T02:37:32.064 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T02:37:32.064 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T02:37:32.064 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T02:37:32.064 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:37:32.064 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:37:32.064 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:32.064 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T02:37:32.064 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:37:32.064 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T02:37:14.140105+0000", 2024-09-12T02:37:32.064 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:37:32.065 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:37:32.065 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T02:37:32.065 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:37:32.065 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.093+0000 7fe458c00640 1 Processor -- start 2024-09-12T02:37:32.065 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.093+0000 7fe458c00640 1 -- start start 2024-09-12T02:37:32.065 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.093+0000 7fe458c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe454109810 0x7fe454109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:32.065 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.093+0000 7fe458c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe45410a1e0 con 0x7fe454109810 2024-09-12T02:37:32.065 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.094+0000 7fe451e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe454109810 0x7fe454109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:32.065 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.094+0000 7fe451e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe454109810 0x7fe454109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38822/0 (socket says 172.21.15.18:38822) 2024-09-12T02:37:32.065 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.094+0000 7fe451e00640 1 -- 172.21.15.18:0/2716449713 learned_addr learned my addr 172.21.15.18:0/2716449713 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:32.065 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.094+0000 7fe451e00640 1 -- 172.21.15.18:0/2716449713 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45410a950 con 0x7fe454109810 2024-09-12T02:37:32.065 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.095+0000 7fe451e00640 1 --2- 172.21.15.18:0/2716449713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe454109810 0x7fe454109c10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe444009820 tx=0x7fe44402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f25ee2629d54eb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:32.065 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.095+0000 7fe450a00640 1 -- 172.21.15.18:0/2716449713 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe444037070 con 0x7fe454109810 2024-09-12T02:37:32.065 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.095+0000 7fe450a00640 1 -- 172.21.15.18:0/2716449713 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe444032900 con 0x7fe454109810 2024-09-12T02:37:32.066 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.095+0000 7fe450a00640 1 -- 172.21.15.18:0/2716449713 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe444030850 con 0x7fe454109810 2024-09-12T02:37:32.066 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.096+0000 7fe458c00640 1 -- 172.21.15.18:0/2716449713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe454109810 msgr2=0x7fe454109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:32.066 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.096+0000 7fe458c00640 1 --2- 172.21.15.18:0/2716449713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe454109810 0x7fe454109c10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe444009820 tx=0x7fe44402a270 comp rx=0 tx=0).stop 2024-09-12T02:37:32.066 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.096+0000 7fe458c00640 1 -- 172.21.15.18:0/2716449713 shutdown_connections 2024-09-12T02:37:32.066 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.096+0000 7fe458c00640 1 --2- 172.21.15.18:0/2716449713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe454109810 0x7fe454109c10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:32.066 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.096+0000 7fe458c00640 1 -- 172.21.15.18:0/2716449713 >> 172.21.15.18:0/2716449713 conn(0x7fe45407ccf0 msgr2=0x7fe45407d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:32.066 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.096+0000 7fe458c00640 1 -- 172.21.15.18:0/2716449713 shutdown_connections 2024-09-12T02:37:32.066 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.096+0000 7fe458c00640 1 -- 172.21.15.18:0/2716449713 wait complete. 2024-09-12T02:37:32.066 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.097+0000 7fe458c00640 1 Processor -- start 2024-09-12T02:37:32.066 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.097+0000 7fe458c00640 1 -- start start 2024-09-12T02:37:32.066 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.097+0000 7fe458c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe454109810 0x7fe45419d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:32.066 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.097+0000 7fe458c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe45410dd00 con 0x7fe454109810 2024-09-12T02:37:32.067 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.098+0000 7fe451e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe454109810 0x7fe45419d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:32.067 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.098+0000 7fe451e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe454109810 0x7fe45419d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38826/0 (socket says 172.21.15.18:38826) 2024-09-12T02:37:32.067 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.098+0000 7fe451e00640 1 -- 172.21.15.18:0/2805283652 learned_addr learned my addr 172.21.15.18:0/2805283652 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:32.067 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.098+0000 7fe451e00640 1 -- 172.21.15.18:0/2805283652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45419dd10 con 0x7fe454109810 2024-09-12T02:37:32.067 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.098+0000 7fe451e00640 1 --2- 172.21.15.18:0/2805283652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe454109810 0x7fe45419d7d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe444030460 tx=0x7fe444030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:32.067 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.099+0000 7fe44aa00640 1 -- 172.21.15.18:0/2805283652 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe444042070 con 0x7fe454109810 2024-09-12T02:37:32.067 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.099+0000 7fe44aa00640 1 -- 172.21.15.18:0/2805283652 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe444032be0 con 0x7fe454109810 2024-09-12T02:37:32.067 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.099+0000 7fe44aa00640 1 -- 172.21.15.18:0/2805283652 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe444037040 con 0x7fe454109810 2024-09-12T02:37:32.067 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.099+0000 7fe458c00640 1 -- 172.21.15.18:0/2805283652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe45419dfa0 con 0x7fe454109810 2024-09-12T02:37:32.067 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.099+0000 7fe458c00640 1 -- 172.21.15.18:0/2805283652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4541a0c90 con 0x7fe454109810 2024-09-12T02:37:32.067 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.100+0000 7fe44aa00640 1 -- 172.21.15.18:0/2805283652 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7fe444045070 con 0x7fe454109810 2024-09-12T02:37:32.067 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.100+0000 7fe458c00640 1 -- 172.21.15.18:0/2805283652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe454109c10 con 0x7fe454109810 2024-09-12T02:37:32.067 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.100+0000 7fe44aa00640 1 --2- 172.21.15.18:0/2805283652 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7fe438038e60 0x7fe43803b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:32.068 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.100+0000 7fe44aa00640 1 -- 172.21.15.18:0/2805283652 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe44406bb60 con 0x7fe454109810 2024-09-12T02:37:32.068 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.101+0000 7fe451400640 1 --2- 172.21.15.18:0/2805283652 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7fe438038e60 0x7fe43803b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:32.068 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.101+0000 7fe451400640 1 --2- 172.21.15.18:0/2805283652 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7fe438038e60 0x7fe43803b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe4400098c0 tx=0x7fe440006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:32.068 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.106+0000 7fe44aa00640 1 -- 172.21.15.18:0/2805283652 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe444045360 con 0x7fe454109810 2024-09-12T02:37:32.068 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.356+0000 7fe458c00640 1 -- 172.21.15.18:0/2805283652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fe4541a1310 con 0x7fe454109810 2024-09-12T02:37:32.068 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.357+0000 7fe44aa00640 1 -- 172.21.15.18:0/2805283652 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fe444032d90 con 0x7fe454109810 2024-09-12T02:37:32.068 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.359+0000 7fe458c00640 1 -- 172.21.15.18:0/2805283652 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7fe438038e60 msgr2=0x7fe43803b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:32.068 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.359+0000 7fe458c00640 1 --2- 172.21.15.18:0/2805283652 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7fe438038e60 0x7fe43803b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe4400098c0 tx=0x7fe440006db0 comp rx=0 tx=0).stop 2024-09-12T02:37:32.068 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.359+0000 7fe458c00640 1 -- 172.21.15.18:0/2805283652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe454109810 msgr2=0x7fe45419d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:32.068 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.359+0000 7fe458c00640 1 --2- 172.21.15.18:0/2805283652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe454109810 0x7fe45419d7d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe444030460 tx=0x7fe444030d80 comp rx=0 tx=0).stop 2024-09-12T02:37:32.068 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.359+0000 7fe458c00640 1 -- 172.21.15.18:0/2805283652 shutdown_connections 2024-09-12T02:37:32.068 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.359+0000 7fe458c00640 1 --2- 172.21.15.18:0/2805283652 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7fe438038e60 0x7fe43803b320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:32.068 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.359+0000 7fe458c00640 1 --2- 172.21.15.18:0/2805283652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe454109810 0x7fe45419d7d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:32.068 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.359+0000 7fe458c00640 1 -- 172.21.15.18:0/2805283652 >> 172.21.15.18:0/2805283652 conn(0x7fe45407ccf0 msgr2=0x7fe4541074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:32.068 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.359+0000 7fe458c00640 1 -- 172.21.15.18:0/2805283652 shutdown_connections 2024-09-12T02:37:32.069 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:31.359+0000 7fe458c00640 1 -- 172.21.15.18:0/2805283652 wait complete. 2024-09-12T02:37:32.069 INFO:teuthology.orchestra.run.smithi018.stdout:mgr is available 2024-09-12T02:37:32.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:32 smithi018 ceph-mon[30616]: mgrmap e4: x(active, since 2s) 2024-09-12T02:37:33.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-12T02:37:33.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T02:37:33.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout fsid = c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:37:33.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.18:3300,v1:172.21.15.18:6789] 2024-09-12T02:37:33.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T02:37:33.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T02:37:33.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T02:37:33.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T02:37:33.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-12T02:37:33.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T02:37:33.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T02:37:33.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-12T02:37:33.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T02:37:33.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T02:37:33.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T02:37:33.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T02:37:33.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T02:37:33.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T02:37:33.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.588+0000 7f4dfe400640 1 Processor -- start 2024-09-12T02:37:33.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.588+0000 7f4dfe400640 1 -- start start 2024-09-12T02:37:33.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.588+0000 7f4dfe400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df8109810 0x7f4df8109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:33.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.588+0000 7f4dfe400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4df810a1e0 con 0x7f4df8109810 2024-09-12T02:37:33.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.588+0000 7f4dfd000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df8109810 0x7f4df8109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:33.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.589+0000 7f4dfd000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df8109810 0x7f4df8109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38840/0 (socket says 172.21.15.18:38840) 2024-09-12T02:37:33.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.589+0000 7f4dfd000640 1 -- 172.21.15.18:0/2376792258 learned_addr learned my addr 172.21.15.18:0/2376792258 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:33.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.589+0000 7f4dfd000640 1 -- 172.21.15.18:0/2376792258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df810a730 con 0x7f4df8109810 2024-09-12T02:37:33.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.590+0000 7f4dfd000640 1 --2- 172.21.15.18:0/2376792258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df8109810 0x7f4df8109c10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4de8009820 tx=0x7f4de802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76dd4897181e02d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:33.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.590+0000 7f4df7e00640 1 -- 172.21.15.18:0/2376792258 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4de8037070 con 0x7f4df8109810 2024-09-12T02:37:33.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.590+0000 7f4df7e00640 1 -- 172.21.15.18:0/2376792258 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4de8032900 con 0x7f4df8109810 2024-09-12T02:37:33.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.590+0000 7f4df7e00640 1 -- 172.21.15.18:0/2376792258 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4de8030850 con 0x7f4df8109810 2024-09-12T02:37:33.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.591+0000 7f4dfe400640 1 -- 172.21.15.18:0/2376792258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df8109810 msgr2=0x7f4df8109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.582 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.591+0000 7f4dfe400640 1 --2- 172.21.15.18:0/2376792258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df8109810 0x7f4df8109c10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4de8009820 tx=0x7f4de802a270 comp rx=0 tx=0).stop 2024-09-12T02:37:33.582 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.591+0000 7f4dfe400640 1 -- 172.21.15.18:0/2376792258 shutdown_connections 2024-09-12T02:37:33.582 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.591+0000 7f4dfe400640 1 --2- 172.21.15.18:0/2376792258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df8109810 0x7f4df8109c10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.582 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.591+0000 7f4dfe400640 1 -- 172.21.15.18:0/2376792258 >> 172.21.15.18:0/2376792258 conn(0x7f4df807cb00 msgr2=0x7f4df807cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:33.582 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.591+0000 7f4dfe400640 1 -- 172.21.15.18:0/2376792258 shutdown_connections 2024-09-12T02:37:33.582 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.591+0000 7f4dfe400640 1 -- 172.21.15.18:0/2376792258 wait complete. 2024-09-12T02:37:33.582 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.592+0000 7f4dfe400640 1 Processor -- start 2024-09-12T02:37:33.582 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.592+0000 7f4dfe400640 1 -- start start 2024-09-12T02:37:33.582 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.592+0000 7f4dfe400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df8109810 0x7f4df819d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:33.582 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.592+0000 7f4dfe400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4df810d9f0 con 0x7f4df8109810 2024-09-12T02:37:33.582 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.593+0000 7f4dfd000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df8109810 0x7f4df819d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:33.583 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.593+0000 7f4dfd000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df8109810 0x7f4df819d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38846/0 (socket says 172.21.15.18:38846) 2024-09-12T02:37:33.583 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.593+0000 7f4dfd000640 1 -- 172.21.15.18:0/282946622 learned_addr learned my addr 172.21.15.18:0/282946622 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:33.583 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.593+0000 7f4dfd000640 1 -- 172.21.15.18:0/282946622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df819db10 con 0x7f4df8109810 2024-09-12T02:37:33.583 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.593+0000 7f4dfd000640 1 --2- 172.21.15.18:0/282946622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df8109810 0x7f4df819d5d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4de80097f0 tx=0x7f4de8030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:33.583 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.594+0000 7f4df6000640 1 -- 172.21.15.18:0/282946622 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4de8042070 con 0x7f4df8109810 2024-09-12T02:37:33.583 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.594+0000 7f4df6000640 1 -- 172.21.15.18:0/282946622 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4de8032ca0 con 0x7f4df8109810 2024-09-12T02:37:33.583 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.594+0000 7f4dfe400640 1 -- 172.21.15.18:0/282946622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df819dda0 con 0x7f4df8109810 2024-09-12T02:37:33.583 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.594+0000 7f4df6000640 1 -- 172.21.15.18:0/282946622 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4de8037040 con 0x7f4df8109810 2024-09-12T02:37:33.583 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.594+0000 7f4dfe400640 1 -- 172.21.15.18:0/282946622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df81a0a90 con 0x7f4df8109810 2024-09-12T02:37:33.583 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.595+0000 7f4df6000640 1 -- 172.21.15.18:0/282946622 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f4de8045070 con 0x7f4df8109810 2024-09-12T02:37:33.583 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.595+0000 7f4dfe400640 1 -- 172.21.15.18:0/282946622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df8109c90 con 0x7f4df8109810 2024-09-12T02:37:33.583 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.595+0000 7f4df6000640 1 --2- 172.21.15.18:0/282946622 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7f4ddc038f20 0x7f4ddc03b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:33.584 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.595+0000 7f4df6000640 1 -- 172.21.15.18:0/282946622 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4de806bf40 con 0x7f4df8109810 2024-09-12T02:37:33.584 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.596+0000 7f4defe00640 1 --2- 172.21.15.18:0/282946622 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7f4ddc038f20 0x7f4ddc03b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:33.584 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.596+0000 7f4defe00640 1 --2- 172.21.15.18:0/282946622 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7f4ddc038f20 0x7f4ddc03b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4de00098c0 tx=0x7f4de0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:33.584 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.601+0000 7f4df6000640 1 -- 172.21.15.18:0/282946622 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4de804b170 con 0x7f4df8109810 2024-09-12T02:37:33.584 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.786+0000 7f4dfe400640 1 -- 172.21.15.18:0/282946622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f4df81a2290 con 0x7f4df8109810 2024-09-12T02:37:33.584 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.787+0000 7f4df6000640 1 -- 172.21.15.18:0/282946622 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f4de806b960 con 0x7f4df8109810 2024-09-12T02:37:33.584 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.789+0000 7f4dfe400640 1 -- 172.21.15.18:0/282946622 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7f4ddc038f20 msgr2=0x7f4ddc03b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.584 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.789+0000 7f4dfe400640 1 --2- 172.21.15.18:0/282946622 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7f4ddc038f20 0x7f4ddc03b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4de00098c0 tx=0x7f4de0006db0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.584 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.789+0000 7f4dfe400640 1 -- 172.21.15.18:0/282946622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df8109810 msgr2=0x7f4df819d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.584 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.789+0000 7f4dfe400640 1 --2- 172.21.15.18:0/282946622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df8109810 0x7f4df819d5d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4de80097f0 tx=0x7f4de8030ec0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.584 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.790+0000 7f4dfe400640 1 -- 172.21.15.18:0/282946622 shutdown_connections 2024-09-12T02:37:33.585 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.790+0000 7f4dfe400640 1 --2- 172.21.15.18:0/282946622 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7f4ddc038f20 0x7f4ddc03b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.585 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.790+0000 7f4dfe400640 1 --2- 172.21.15.18:0/282946622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df8109810 0x7f4df819d5d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.585 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.790+0000 7f4dfe400640 1 -- 172.21.15.18:0/282946622 >> 172.21.15.18:0/282946622 conn(0x7f4df807cb00 msgr2=0x7f4df8107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:33.585 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.790+0000 7f4dfe400640 1 -- 172.21.15.18:0/282946622 shutdown_connections 2024-09-12T02:37:33.585 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:32.790+0000 7f4dfe400640 1 -- 172.21.15.18:0/282946622 wait complete. 2024-09-12T02:37:33.585 INFO:teuthology.orchestra.run.smithi018.stdout:Enabling cephadm module... 2024-09-12T02:37:33.715 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:33 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/282946622' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T02:37:34.754 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:34 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2952772914' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-12T02:37:35.071 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:34 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: ignoring --setuser ceph since I am not root 2024-09-12T02:37:35.071 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:34 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: ignoring --setgroup ceph since I am not root 2024-09-12T02:37:35.072 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:34 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:34.880+0000 7f875d5de040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:37:35.072 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:34 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:34.953+0000 7f875d5de040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:37:35.350 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:35 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:35.146+0000 7f875d5de040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:37:35.351 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:35 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:35.230+0000 7f875d5de040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:37:35.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.179+0000 7fbc79200640 1 Processor -- start 2024-09-12T02:37:35.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.179+0000 7fbc79200640 1 -- start start 2024-09-12T02:37:35.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.180+0000 7fbc79200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc7407de60 0x7fbc7407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:35.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.180+0000 7fbc79200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7407c890 con 0x7fbc7407de60 2024-09-12T02:37:35.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.180+0000 7fbc71e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc7407de60 0x7fbc7407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:35.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.180+0000 7fbc71e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc7407de60 0x7fbc7407c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38856/0 (socket says 172.21.15.18:38856) 2024-09-12T02:37:35.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.180+0000 7fbc71e00640 1 -- 172.21.15.18:0/942577829 learned_addr learned my addr 172.21.15.18:0/942577829 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:35.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.180+0000 7fbc71e00640 1 -- 172.21.15.18:0/942577829 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc7407ca10 con 0x7fbc7407de60 2024-09-12T02:37:35.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.181+0000 7fbc71e00640 1 --2- 172.21.15.18:0/942577829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc7407de60 0x7fbc7407c2c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbc64009820 tx=0x7fbc6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498ee1bbe0d1c665 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:35.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.182+0000 7fbc71400640 1 -- 172.21.15.18:0/942577829 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc64037070 con 0x7fbc7407de60 2024-09-12T02:37:35.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.182+0000 7fbc71400640 1 -- 172.21.15.18:0/942577829 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc64032900 con 0x7fbc7407de60 2024-09-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.182+0000 7fbc71400640 1 -- 172.21.15.18:0/942577829 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc64030850 con 0x7fbc7407de60 2024-09-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.182+0000 7fbc79200640 1 -- 172.21.15.18:0/942577829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc7407de60 msgr2=0x7fbc7407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.182+0000 7fbc79200640 1 --2- 172.21.15.18:0/942577829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc7407de60 0x7fbc7407c2c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbc64009820 tx=0x7fbc6402a270 comp rx=0 tx=0).stop 2024-09-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.182+0000 7fbc79200640 1 -- 172.21.15.18:0/942577829 shutdown_connections 2024-09-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.182+0000 7fbc79200640 1 --2- 172.21.15.18:0/942577829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc7407de60 0x7fbc7407c2c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.182+0000 7fbc79200640 1 -- 172.21.15.18:0/942577829 >> 172.21.15.18:0/942577829 conn(0x7fbc74102cc0 msgr2=0x7fbc74105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.182+0000 7fbc79200640 1 -- 172.21.15.18:0/942577829 shutdown_connections 2024-09-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.182+0000 7fbc79200640 1 -- 172.21.15.18:0/942577829 wait complete. 2024-09-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.183+0000 7fbc79200640 1 Processor -- start 2024-09-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.184+0000 7fbc79200640 1 -- start start 2024-09-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.184+0000 7fbc79200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc7407de60 0x7fbc7419d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.184+0000 7fbc79200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7410db80 con 0x7fbc7407de60 2024-09-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.184+0000 7fbc71e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc7407de60 0x7fbc7419d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:35.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.184+0000 7fbc71e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc7407de60 0x7fbc7419d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38872/0 (socket says 172.21.15.18:38872) 2024-09-12T02:37:35.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.184+0000 7fbc71e00640 1 -- 172.21.15.18:0/2952772914 learned_addr learned my addr 172.21.15.18:0/2952772914 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:35.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.184+0000 7fbc71e00640 1 -- 172.21.15.18:0/2952772914 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc7419dcb0 con 0x7fbc7407de60 2024-09-12T02:37:35.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.185+0000 7fbc71e00640 1 --2- 172.21.15.18:0/2952772914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc7407de60 0x7fbc7419d770 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbc640097f0 tx=0x7fbc64030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:35.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.185+0000 7fbc6aa00640 1 -- 172.21.15.18:0/2952772914 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc64037040 con 0x7fbc7407de60 2024-09-12T02:37:35.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.185+0000 7fbc6aa00640 1 -- 172.21.15.18:0/2952772914 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc64040070 con 0x7fbc7407de60 2024-09-12T02:37:35.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.185+0000 7fbc79200640 1 -- 172.21.15.18:0/2952772914 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc7419df40 con 0x7fbc7407de60 2024-09-12T02:37:35.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.185+0000 7fbc6aa00640 1 -- 172.21.15.18:0/2952772914 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc6403a390 con 0x7fbc7407de60 2024-09-12T02:37:35.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.185+0000 7fbc79200640 1 -- 172.21.15.18:0/2952772914 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc741a0c30 con 0x7fbc7407de60 2024-09-12T02:37:35.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.186+0000 7fbc6aa00640 1 -- 172.21.15.18:0/2952772914 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fbc64032900 con 0x7fbc7407de60 2024-09-12T02:37:35.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.186+0000 7fbc79200640 1 -- 172.21.15.18:0/2952772914 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc7407c340 con 0x7fbc7407de60 2024-09-12T02:37:35.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.187+0000 7fbc6aa00640 1 --2- 172.21.15.18:0/2952772914 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7fbc58038f20 0x7fbc5803b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:35.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.187+0000 7fbc6aa00640 1 -- 172.21.15.18:0/2952772914 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbc6406c0f0 con 0x7fbc7407de60 2024-09-12T02:37:35.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.187+0000 7fbc6be00640 1 --2- 172.21.15.18:0/2952772914 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7fbc58038f20 0x7fbc5803b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:35.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.188+0000 7fbc6be00640 1 --2- 172.21.15.18:0/2952772914 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7fbc58038f20 0x7fbc5803b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0098c0 tx=0x7fbc5c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:35.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.192+0000 7fbc6aa00640 1 -- 172.21.15.18:0/2952772914 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbc6406be50 con 0x7fbc7407de60 2024-09-12T02:37:35.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.426+0000 7fbc79200640 1 -- 172.21.15.18:0/2952772914 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fbc741a0e00 con 0x7fbc7407de60 2024-09-12T02:37:35.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.645+0000 7fbc6aa00640 1 -- 172.21.15.18:0/2952772914 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fbc6403a630 con 0x7fbc7407de60 2024-09-12T02:37:35.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.647+0000 7fbc6aa00640 1 -- 172.21.15.18:0/2952772914 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fbc64032bf0 con 0x7fbc7407de60 2024-09-12T02:37:35.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.649+0000 7fbc79200640 1 -- 172.21.15.18:0/2952772914 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7fbc58038f20 msgr2=0x7fbc5803b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:35.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.649+0000 7fbc79200640 1 --2- 172.21.15.18:0/2952772914 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7fbc58038f20 0x7fbc5803b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0098c0 tx=0x7fbc5c006db0 comp rx=0 tx=0).stop 2024-09-12T02:37:35.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.649+0000 7fbc79200640 1 -- 172.21.15.18:0/2952772914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc7407de60 msgr2=0x7fbc7419d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:35.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.649+0000 7fbc79200640 1 --2- 172.21.15.18:0/2952772914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc7407de60 0x7fbc7419d770 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbc640097f0 tx=0x7fbc64030d80 comp rx=0 tx=0).stop 2024-09-12T02:37:35.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.649+0000 7fbc79200640 1 -- 172.21.15.18:0/2952772914 shutdown_connections 2024-09-12T02:37:35.381 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.649+0000 7fbc79200640 1 --2- 172.21.15.18:0/2952772914 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7fbc58038f20 0x7fbc5803b3e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:35.382 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.649+0000 7fbc79200640 1 --2- 172.21.15.18:0/2952772914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc7407de60 0x7fbc7419d770 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:35.382 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.649+0000 7fbc79200640 1 -- 172.21.15.18:0/2952772914 >> 172.21.15.18:0/2952772914 conn(0x7fbc74102cc0 msgr2=0x7fbc741038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:35.382 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.650+0000 7fbc79200640 1 -- 172.21.15.18:0/2952772914 shutdown_connections 2024-09-12T02:37:35.382 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:34.650+0000 7fbc79200640 1 -- 172.21.15.18:0/2952772914 wait complete. 2024-09-12T02:37:35.648 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:35 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:35.411+0000 7f875d5de040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:37:35.648 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:35 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:35.584+0000 7f875d5de040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:37:35.954 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:35 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2952772914' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-12T02:37:35.954 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:35 smithi018 ceph-mon[30616]: mgrmap e5: x(active, since 5s) 2024-09-12T02:37:36.221 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:35 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:35.971+0000 7f875d5de040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:37:36.221 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:36 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:36.049+0000 7f875d5de040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:37:36.575 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:36 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:36.276+0000 7f875d5de040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:37:36.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:36 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3565785076' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T02:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-12T02:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T02:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T02:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T02:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.970+0000 7f9e49200640 1 Processor -- start 2024-09-12T02:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.970+0000 7f9e49200640 1 -- start start 2024-09-12T02:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.970+0000 7f9e49200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e44109810 0x7f9e44109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.970+0000 7f9e49200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4410a1e0 con 0x7f9e44109810 2024-09-12T02:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.971+0000 7f9e41e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e44109810 0x7f9e44109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.971+0000 7f9e41e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e44109810 0x7f9e44109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59792/0 (socket says 172.21.15.18:59792) 2024-09-12T02:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.971+0000 7f9e41e00640 1 -- 172.21.15.18:0/2663602144 learned_addr learned my addr 172.21.15.18:0/2663602144 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.971+0000 7f9e41e00640 1 -- 172.21.15.18:0/2663602144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4410a950 con 0x7f9e44109810 2024-09-12T02:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.973+0000 7f9e41e00640 1 --2- 172.21.15.18:0/2663602144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e44109810 0x7f9e44109c10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009820 tx=0x7f9e3402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f896776edcfa02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.973+0000 7f9e40a00640 1 -- 172.21.15.18:0/2663602144 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e34037070 con 0x7f9e44109810 2024-09-12T02:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.973+0000 7f9e40a00640 1 -- 172.21.15.18:0/2663602144 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e34032900 con 0x7f9e44109810 2024-09-12T02:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.973+0000 7f9e40a00640 1 -- 172.21.15.18:0/2663602144 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e34030850 con 0x7f9e44109810 2024-09-12T02:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.974+0000 7f9e49200640 1 -- 172.21.15.18:0/2663602144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e44109810 msgr2=0x7f9e44109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.974+0000 7f9e49200640 1 --2- 172.21.15.18:0/2663602144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e44109810 0x7f9e44109c10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009820 tx=0x7f9e3402a270 comp rx=0 tx=0).stop 2024-09-12T02:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.974+0000 7f9e49200640 1 -- 172.21.15.18:0/2663602144 shutdown_connections 2024-09-12T02:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.974+0000 7f9e49200640 1 --2- 172.21.15.18:0/2663602144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e44109810 0x7f9e44109c10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.974+0000 7f9e49200640 1 -- 172.21.15.18:0/2663602144 >> 172.21.15.18:0/2663602144 conn(0x7f9e4407ccf0 msgr2=0x7f9e4407d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.974+0000 7f9e49200640 1 -- 172.21.15.18:0/2663602144 shutdown_connections 2024-09-12T02:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.974+0000 7f9e49200640 1 -- 172.21.15.18:0/2663602144 wait complete. 2024-09-12T02:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.975+0000 7f9e49200640 1 Processor -- start 2024-09-12T02:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.975+0000 7f9e49200640 1 -- start start 2024-09-12T02:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.975+0000 7f9e49200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e44109810 0x7f9e4419d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.975+0000 7f9e49200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4410dd00 con 0x7f9e44109810 2024-09-12T02:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.976+0000 7f9e41e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e44109810 0x7f9e4419d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.976+0000 7f9e41e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e44109810 0x7f9e4419d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59800/0 (socket says 172.21.15.18:59800) 2024-09-12T02:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.976+0000 7f9e41e00640 1 -- 172.21.15.18:0/3565785076 learned_addr learned my addr 172.21.15.18:0/3565785076 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.976+0000 7f9e41e00640 1 -- 172.21.15.18:0/3565785076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4419dd10 con 0x7f9e44109810 2024-09-12T02:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.977+0000 7f9e41e00640 1 --2- 172.21.15.18:0/3565785076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e44109810 0x7f9e4419d7d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9e34030460 tx=0x7f9e34030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.977+0000 7f9e3aa00640 1 -- 172.21.15.18:0/3565785076 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e34042070 con 0x7f9e44109810 2024-09-12T02:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.977+0000 7f9e3aa00640 1 -- 172.21.15.18:0/3565785076 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e34032be0 con 0x7f9e44109810 2024-09-12T02:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.977+0000 7f9e3aa00640 1 -- 172.21.15.18:0/3565785076 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e34037040 con 0x7f9e44109810 2024-09-12T02:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.977+0000 7f9e49200640 1 -- 172.21.15.18:0/3565785076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e4419dfa0 con 0x7f9e44109810 2024-09-12T02:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.977+0000 7f9e49200640 1 -- 172.21.15.18:0/3565785076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e441a0c90 con 0x7f9e44109810 2024-09-12T02:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.978+0000 7f9e49200640 1 -- 172.21.15.18:0/3565785076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e44109c10 con 0x7f9e44109810 2024-09-12T02:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.979+0000 7f9e3aa00640 1 -- 172.21.15.18:0/3565785076 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f9e34045070 con 0x7f9e44109810 2024-09-12T02:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.979+0000 7f9e3aa00640 1 --2- 172.21.15.18:0/3565785076 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7f9e28038fc0 0x7f9e2803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.979+0000 7f9e3aa00640 1 -- 172.21.15.18:0/3565785076 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9e3406be40 con 0x7f9e44109810 2024-09-12T02:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.980+0000 7f9e41400640 1 -- 172.21.15.18:0/3565785076 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7f9e28038fc0 msgr2=0x7f9e2803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/601880715 2024-09-12T02:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.980+0000 7f9e41400640 1 --2- 172.21.15.18:0/3565785076 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7f9e28038fc0 0x7f9e2803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:35.984+0000 7f9e3aa00640 1 -- 172.21.15.18:0/3565785076 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9e340371e0 con 0x7f9e44109810 2024-09-12T02:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:36.181+0000 7f9e41400640 1 -- 172.21.15.18:0/3565785076 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7f9e28038fc0 msgr2=0x7f9e2803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/601880715 2024-09-12T02:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:36.181+0000 7f9e41400640 1 --2- 172.21.15.18:0/3565785076 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7f9e28038fc0 0x7f9e2803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:36.219+0000 7f9e49200640 1 -- 172.21.15.18:0/3565785076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f9e441a0e60 con 0x7f9e44109810 2024-09-12T02:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:36.220+0000 7f9e3aa00640 1 -- 172.21.15.18:0/3565785076 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f9e441a0e60 con 0x7f9e44109810 2024-09-12T02:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:36.222+0000 7f9e49200640 1 -- 172.21.15.18:0/3565785076 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7f9e28038fc0 msgr2=0x7f9e2803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:36.222+0000 7f9e49200640 1 --2- 172.21.15.18:0/3565785076 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7f9e28038fc0 0x7f9e2803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:36.222+0000 7f9e49200640 1 -- 172.21.15.18:0/3565785076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e44109810 msgr2=0x7f9e4419d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:36.222+0000 7f9e49200640 1 --2- 172.21.15.18:0/3565785076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e44109810 0x7f9e4419d7d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9e34030460 tx=0x7f9e34030d80 comp rx=0 tx=0).stop 2024-09-12T02:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:36.223+0000 7f9e49200640 1 -- 172.21.15.18:0/3565785076 shutdown_connections 2024-09-12T02:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:36.223+0000 7f9e49200640 1 --2- 172.21.15.18:0/3565785076 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7f9e28038fc0 0x7f9e2803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:36.223+0000 7f9e49200640 1 --2- 172.21.15.18:0/3565785076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e44109810 0x7f9e4419d7d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:36.223+0000 7f9e49200640 1 -- 172.21.15.18:0/3565785076 >> 172.21.15.18:0/3565785076 conn(0x7f9e4407ccf0 msgr2=0x7f9e441074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:36.223+0000 7f9e49200640 1 -- 172.21.15.18:0/3565785076 shutdown_connections 2024-09-12T02:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:36.223+0000 7f9e49200640 1 -- 172.21.15.18:0/3565785076 wait complete. 2024-09-12T02:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for the mgr to restart... 2024-09-12T02:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr epoch 5... 2024-09-12T02:37:37.718 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:37 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:37.474+0000 7f875d5de040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:37:37.718 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:37 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:37.559+0000 7f875d5de040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:37:38.655 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:38 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:38.512+0000 7f875d5de040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:37:38.655 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:38 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:38.654+0000 7f875d5de040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:37:39.078 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:38 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:38.825+0000 7f875d5de040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:37:39.079 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:38 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:38.900+0000 7f875d5de040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:37:39.079 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:39.078+0000 7f875d5de040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:37:39.350 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:39.163+0000 7f875d5de040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:37:39.351 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:39.238+0000 7f875d5de040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:37:39.689 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:39.426+0000 7f875d5de040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:37:39.690 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:39.506+0000 7f875d5de040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:37:39.690 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:39.588+0000 7f875d5de040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:37:39.690 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:39.689+0000 7f875d5de040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:37:40.100 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:39.763+0000 7f875d5de040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:37:40.101 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:39.836+0000 7f875d5de040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:37:41.100 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:40 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:40.788+0000 7f875d5de040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:37:41.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:40 smithi018 ceph-mon[30616]: Active manager daemon x restarted 2024-09-12T02:37:41.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:40 smithi018 ceph-mon[30616]: Activating manager daemon x 2024-09-12T02:37:41.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:40 smithi018 ceph-mon[30616]: osdmap e2: 0 total, 0 up, 0 in 2024-09-12T02:37:41.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:40 smithi018 ceph-mon[30616]: mgrmap e6: x(active, starting, since 0.00401194s) 2024-09-12T02:37:41.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:40 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:37:41.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:40 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:37:41.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:40 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:37:41.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:40 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:37:41.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:40 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:37:41.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:40 smithi018 ceph-mon[30616]: Manager daemon x is now available 2024-09-12T02:37:41.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:40 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' 2024-09-12T02:37:41.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:40 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' 2024-09-12T02:37:41.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:40 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:37:41.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:40 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:37:42.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:41 smithi018 ceph-mon[30616]: Found migration_current of "None". Setting to last migration. 2024-09-12T02:37:42.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:41 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:37:42.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:41 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:37:42.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:41 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' 2024-09-12T02:37:42.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:41 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' 2024-09-12T02:37:42.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:41 smithi018 ceph-mon[30616]: mgrmap e7: x(active, since 1.00613s) 2024-09-12T02:37:42.469 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:37:42.469 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-12T02:37:42.469 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T02:37:42.469 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:37:42.469 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.745+0000 7ff180400640 1 Processor -- start 2024-09-12T02:37:42.469 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.745+0000 7ff180400640 1 -- start start 2024-09-12T02:37:42.469 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.746+0000 7ff180400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1781097d0 0x7ff178109bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:42.469 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.746+0000 7ff180400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff17810a1a0 con 0x7ff1781097d0 2024-09-12T02:37:42.470 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.746+0000 7ff17da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1781097d0 0x7ff178109bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:42.470 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.746+0000 7ff17da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1781097d0 0x7ff178109bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59812/0 (socket says 172.21.15.18:59812) 2024-09-12T02:37:42.470 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.746+0000 7ff17da00640 1 -- 172.21.15.18:0/1533744000 learned_addr learned my addr 172.21.15.18:0/1533744000 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:42.470 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.747+0000 7ff17da00640 1 -- 172.21.15.18:0/1533744000 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17810a970 con 0x7ff1781097d0 2024-09-12T02:37:42.470 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.748+0000 7ff17da00640 1 --2- 172.21.15.18:0/1533744000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1781097d0 0x7ff178109bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009820 tx=0x7ff16c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d31b53d6023a52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:42.470 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.748+0000 7ff177e00640 1 -- 172.21.15.18:0/1533744000 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff16c037070 con 0x7ff1781097d0 2024-09-12T02:37:42.470 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.748+0000 7ff177e00640 1 -- 172.21.15.18:0/1533744000 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff16c032900 con 0x7ff1781097d0 2024-09-12T02:37:42.470 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.748+0000 7ff177e00640 1 -- 172.21.15.18:0/1533744000 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff16c030850 con 0x7ff1781097d0 2024-09-12T02:37:42.470 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.749+0000 7ff180400640 1 -- 172.21.15.18:0/1533744000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1781097d0 msgr2=0x7ff178109bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:42.470 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.749+0000 7ff180400640 1 --2- 172.21.15.18:0/1533744000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1781097d0 0x7ff178109bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009820 tx=0x7ff16c02a270 comp rx=0 tx=0).stop 2024-09-12T02:37:42.470 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.749+0000 7ff180400640 1 -- 172.21.15.18:0/1533744000 shutdown_connections 2024-09-12T02:37:42.470 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.749+0000 7ff180400640 1 --2- 172.21.15.18:0/1533744000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1781097d0 0x7ff178109bd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.470 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.749+0000 7ff180400640 1 -- 172.21.15.18:0/1533744000 >> 172.21.15.18:0/1533744000 conn(0x7ff17807cd20 msgr2=0x7ff17807d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:42.471 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.749+0000 7ff180400640 1 -- 172.21.15.18:0/1533744000 shutdown_connections 2024-09-12T02:37:42.471 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.749+0000 7ff180400640 1 -- 172.21.15.18:0/1533744000 wait complete. 2024-09-12T02:37:42.471 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.750+0000 7ff180400640 1 Processor -- start 2024-09-12T02:37:42.471 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.750+0000 7ff180400640 1 -- start start 2024-09-12T02:37:42.471 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.751+0000 7ff180400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1781097d0 0x7ff17819d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:42.471 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.751+0000 7ff180400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff17810dd20 con 0x7ff1781097d0 2024-09-12T02:37:42.471 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.751+0000 7ff17da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1781097d0 0x7ff17819d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:42.471 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.751+0000 7ff17da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1781097d0 0x7ff17819d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59818/0 (socket says 172.21.15.18:59818) 2024-09-12T02:37:42.471 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.751+0000 7ff17da00640 1 -- 172.21.15.18:0/2532287724 learned_addr learned my addr 172.21.15.18:0/2532287724 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:42.471 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.751+0000 7ff17da00640 1 -- 172.21.15.18:0/2532287724 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17819dd30 con 0x7ff1781097d0 2024-09-12T02:37:42.472 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.752+0000 7ff17da00640 1 --2- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1781097d0 0x7ff17819d7f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0097f0 tx=0x7ff16c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:42.472 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.752+0000 7ff176000640 1 -- 172.21.15.18:0/2532287724 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff16c037040 con 0x7ff1781097d0 2024-09-12T02:37:42.472 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.752+0000 7ff176000640 1 -- 172.21.15.18:0/2532287724 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff16c040070 con 0x7ff1781097d0 2024-09-12T02:37:42.472 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.752+0000 7ff176000640 1 -- 172.21.15.18:0/2532287724 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff16c03a390 con 0x7ff1781097d0 2024-09-12T02:37:42.472 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.752+0000 7ff180400640 1 -- 172.21.15.18:0/2532287724 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff17819dfc0 con 0x7ff1781097d0 2024-09-12T02:37:42.472 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.752+0000 7ff180400640 1 -- 172.21.15.18:0/2532287724 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1781a0cb0 con 0x7ff1781097d0 2024-09-12T02:37:42.472 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.753+0000 7ff176000640 1 -- 172.21.15.18:0/2532287724 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7ff16c03b430 con 0x7ff1781097d0 2024-09-12T02:37:42.472 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.754+0000 7ff176000640 1 --2- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7ff160038fc0 0x7ff16003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:42.472 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.754+0000 7ff180400640 1 -- 172.21.15.18:0/2532287724 --> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff17819e440 con 0x7ff160038fc0 2024-09-12T02:37:42.472 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.754+0000 7ff176000640 1 -- 172.21.15.18:0/2532287724 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff16c06c0e0 con 0x7ff1781097d0 2024-09-12T02:37:42.472 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.754+0000 7ff17d000640 1 -- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7ff160038fc0 msgr2=0x7ff16003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/601880715 2024-09-12T02:37:42.472 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.754+0000 7ff17d000640 1 --2- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7ff160038fc0 0x7ff16003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:42.473 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.955+0000 7ff17d000640 1 -- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7ff160038fc0 msgr2=0x7ff16003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/601880715 2024-09-12T02:37:42.473 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:37.955+0000 7ff17d000640 1 --2- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7ff160038fc0 0x7ff16003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:37:42.473 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:38.356+0000 7ff17d000640 1 -- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7ff160038fc0 msgr2=0x7ff16003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/601880715 2024-09-12T02:37:42.473 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:38.356+0000 7ff17d000640 1 --2- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7ff160038fc0 0x7ff16003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:37:42.473 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:39.158+0000 7ff17d000640 1 -- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7ff160038fc0 msgr2=0x7ff16003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/601880715 2024-09-12T02:37:42.473 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:39.158+0000 7ff17d000640 1 --2- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7ff160038fc0 0x7ff16003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:37:42.473 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:40.760+0000 7ff17d000640 1 -- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7ff160038fc0 msgr2=0x7ff16003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/601880715 2024-09-12T02:37:42.473 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:40.760+0000 7ff17d000640 1 --2- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7ff160038fc0 0x7ff16003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-12T02:37:42.473 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:40.792+0000 7ff176000640 1 -- 172.21.15.18:0/2532287724 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7ff16c032900 con 0x7ff1781097d0 2024-09-12T02:37:42.474 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:40.792+0000 7ff176000640 1 -- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7ff160038fc0 msgr2=0x7ff16003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:37:42.474 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:40.792+0000 7ff176000640 1 --2- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7ff160038fc0 0x7ff16003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.474 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.793+0000 7ff176000640 1 -- 172.21.15.18:0/2532287724 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7ff16c06ce90 con 0x7ff1781097d0 2024-09-12T02:37:42.474 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.794+0000 7ff176000640 1 --2- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff16003c700 0x7ff16003eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:42.474 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.794+0000 7ff176000640 1 -- 172.21.15.18:0/2532287724 --> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff17819e440 con 0x7ff16003c700 2024-09-12T02:37:42.474 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.795+0000 7ff17d000640 1 --2- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff16003c700 0x7ff16003eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:42.474 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.796+0000 7ff17d000640 1 --2- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff16003c700 0x7ff16003eaf0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff164003980 tx=0x7ff1640092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:42.474 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.797+0000 7ff176000640 1 -- 172.21.15.18:0/2532287724 <== mgr.14118 v2:172.21.15.18:6800/3271799053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7ff17819e440 con 0x7ff16003c700 2024-09-12T02:37:42.474 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.810+0000 7ff180400640 1 -- 172.21.15.18:0/2532287724 --> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ff178109bd0 con 0x7ff16003c700 2024-09-12T02:37:42.474 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.811+0000 7ff176000640 1 -- 172.21.15.18:0/2532287724 <== mgr.14118 v2:172.21.15.18:6800/3271799053 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7ff178109bd0 con 0x7ff16003c700 2024-09-12T02:37:42.474 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.811+0000 7ff180400640 1 -- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff16003c700 msgr2=0x7ff16003eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:42.474 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.811+0000 7ff180400640 1 --2- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff16003c700 0x7ff16003eaf0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff164003980 tx=0x7ff1640092b0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.474 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.811+0000 7ff180400640 1 -- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1781097d0 msgr2=0x7ff17819d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:42.475 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.811+0000 7ff180400640 1 --2- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1781097d0 0x7ff17819d7f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0097f0 tx=0x7ff16c030d80 comp rx=0 tx=0).stop 2024-09-12T02:37:42.475 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.811+0000 7ff180400640 1 -- 172.21.15.18:0/2532287724 shutdown_connections 2024-09-12T02:37:42.475 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.811+0000 7ff180400640 1 --2- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff16003c700 0x7ff16003eaf0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.475 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.811+0000 7ff180400640 1 --2- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:6800/601880715,v1:172.21.15.18:6801/601880715] conn(0x7ff160038fc0 0x7ff16003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.475 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.811+0000 7ff180400640 1 --2- 172.21.15.18:0/2532287724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1781097d0 0x7ff17819d7f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:42.475 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.811+0000 7ff180400640 1 -- 172.21.15.18:0/2532287724 >> 172.21.15.18:0/2532287724 conn(0x7ff17807cd20 msgr2=0x7ff1781074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:42.475 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.811+0000 7ff180400640 1 -- 172.21.15.18:0/2532287724 shutdown_connections 2024-09-12T02:37:42.475 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:41.811+0000 7ff180400640 1 -- 172.21.15.18:0/2532287724 wait complete. 2024-09-12T02:37:42.475 INFO:teuthology.orchestra.run.smithi018.stdout:mgr epoch 5 is available 2024-09-12T02:37:42.475 INFO:teuthology.orchestra.run.smithi018.stdout:Setting orchestrator backend to cephadm... 2024-09-12T02:37:42.999 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:42 smithi018 ceph-mon[30616]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T02:37:42.999 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:42 smithi018 ceph-mon[30616]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T02:37:43.351 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:43.185+0000 7f86b4e00640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:02:37:43] ENGINE Error in HTTPServer.serve 2024-09-12T02:37:43.351 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: Traceback (most recent call last): 2024-09-12T02:37:43.351 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:37:43.351 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: self._connections.run(self.expiration_interval) 2024-09-12T02:37:43.351 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:37:43.351 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: self._run(expiration_interval) 2024-09-12T02:37:43.352 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:37:43.352 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:37:43.352 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:37:43.352 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:37:43.352 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:37:43.352 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: s = self.context.wrap_socket( 2024-09-12T02:37:43.352 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:37:43.352 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: return self.sslsocket_class._create( 2024-09-12T02:37:43.352 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:37:43.352 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: self.do_handshake() 2024-09-12T02:37:43.352 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:37:43.352 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: self._sslobj.do_handshake() 2024-09-12T02:37:43.352 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:37:43.353 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:37:44.012 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-mon[30616]: mgrmap e8: x(active, since 2s) 2024-09-12T02:37:44.012 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-mon[30616]: [12/Sep/2024:02:37:42] ENGINE Bus STARTING 2024-09-12T02:37:44.012 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-mon[30616]: [12/Sep/2024:02:37:43] ENGINE Serving on http://172.21.15.18:8765 2024-09-12T02:37:44.012 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-mon[30616]: [12/Sep/2024:02:37:43] ENGINE Serving on https://172.21.15.18:7150 2024-09-12T02:37:44.012 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-mon[30616]: [12/Sep/2024:02:37:43] ENGINE Bus STARTED 2024-09-12T02:37:44.012 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:37:44.012 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-mon[30616]: [12/Sep/2024:02:37:43] ENGINE Error in HTTPServer.serve 2024-09-12T02:37:44.012 INFO:journalctl@ceph.mon.a.smithi018.stdout: Traceback (most recent call last): 2024-09-12T02:37:44.012 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:37:44.012 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:37:44.013 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:37:44.013 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._run(expiration_interval) 2024-09-12T02:37:44.013 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:37:44.013 INFO:journalctl@ceph.mon.a.smithi018.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:37:44.013 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:37:44.013 INFO:journalctl@ceph.mon.a.smithi018.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:37:44.013 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:37:44.013 INFO:journalctl@ceph.mon.a.smithi018.stdout: s = self.context.wrap_socket( 2024-09-12T02:37:44.013 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:37:44.013 INFO:journalctl@ceph.mon.a.smithi018.stdout: return self.sslsocket_class._create( 2024-09-12T02:37:44.013 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:37:44.013 INFO:journalctl@ceph.mon.a.smithi018.stdout: self.do_handshake() 2024-09-12T02:37:44.013 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:37:44.014 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._sslobj.do_handshake() 2024-09-12T02:37:44.014 INFO:journalctl@ceph.mon.a.smithi018.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:37:44.014 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-mon[30616]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:44.014 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' 2024-09-12T02:37:44.014 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:43 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:37:44.022 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.009+0000 7fa357000640 1 Processor -- start 2024-09-12T02:37:44.022 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.009+0000 7fa357000640 1 -- start start 2024-09-12T02:37:44.022 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.009+0000 7fa357000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa350081510 0x7fa350081910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:44.022 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.009+0000 7fa357000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa350081ee0 con 0x7fa350081510 2024-09-12T02:37:44.022 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.010+0000 7fa34fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa350081510 0x7fa350081910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:44.022 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.010+0000 7fa34fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa350081510 0x7fa350081910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59880/0 (socket says 172.21.15.18:59880) 2024-09-12T02:37:44.022 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.010+0000 7fa34fe00640 1 -- 172.21.15.18:0/594849328 learned_addr learned my addr 172.21.15.18:0/594849328 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:44.022 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.010+0000 7fa34fe00640 1 -- 172.21.15.18:0/594849328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35010ed70 con 0x7fa350081510 2024-09-12T02:37:44.022 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.011+0000 7fa34fe00640 1 --2- 172.21.15.18:0/594849328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa350081510 0x7fa350081910 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa340009820 tx=0x7fa34002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=525c12326bee752d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:44.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.012+0000 7fa34f400640 1 -- 172.21.15.18:0/594849328 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa340037070 con 0x7fa350081510 2024-09-12T02:37:44.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.012+0000 7fa34f400640 1 -- 172.21.15.18:0/594849328 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa340032900 con 0x7fa350081510 2024-09-12T02:37:44.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.012+0000 7fa34f400640 1 -- 172.21.15.18:0/594849328 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa340030850 con 0x7fa350081510 2024-09-12T02:37:44.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.012+0000 7fa357000640 1 -- 172.21.15.18:0/594849328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa350081510 msgr2=0x7fa350081910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:44.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.012+0000 7fa357000640 1 --2- 172.21.15.18:0/594849328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa350081510 0x7fa350081910 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa340009820 tx=0x7fa34002a270 comp rx=0 tx=0).stop 2024-09-12T02:37:44.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.012+0000 7fa357000640 1 -- 172.21.15.18:0/594849328 shutdown_connections 2024-09-12T02:37:44.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.012+0000 7fa357000640 1 --2- 172.21.15.18:0/594849328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa350081510 0x7fa350081910 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.012+0000 7fa357000640 1 -- 172.21.15.18:0/594849328 >> 172.21.15.18:0/594849328 conn(0x7fa35007ccf0 msgr2=0x7fa35007f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:44.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.012+0000 7fa357000640 1 -- 172.21.15.18:0/594849328 shutdown_connections 2024-09-12T02:37:44.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.012+0000 7fa357000640 1 -- 172.21.15.18:0/594849328 wait complete. 2024-09-12T02:37:44.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.013+0000 7fa357000640 1 Processor -- start 2024-09-12T02:37:44.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.013+0000 7fa357000640 1 -- start start 2024-09-12T02:37:44.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.014+0000 7fa357000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa350081510 0x7fa3501a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:44.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.014+0000 7fa357000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa350112120 con 0x7fa350081510 2024-09-12T02:37:44.024 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.014+0000 7fa34fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa350081510 0x7fa3501a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:44.024 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.014+0000 7fa34fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa350081510 0x7fa3501a1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59886/0 (socket says 172.21.15.18:59886) 2024-09-12T02:37:44.024 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.014+0000 7fa34fe00640 1 -- 172.21.15.18:0/827497785 learned_addr learned my addr 172.21.15.18:0/827497785 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:44.024 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.014+0000 7fa34fe00640 1 -- 172.21.15.18:0/827497785 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3501a2140 con 0x7fa350081510 2024-09-12T02:37:44.024 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.015+0000 7fa34fe00640 1 --2- 172.21.15.18:0/827497785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa350081510 0x7fa3501a1c00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa340009940 tx=0x7fa3400326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:44.024 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.015+0000 7fa34d600640 1 -- 172.21.15.18:0/827497785 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa340042070 con 0x7fa350081510 2024-09-12T02:37:44.024 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.015+0000 7fa34d600640 1 -- 172.21.15.18:0/827497785 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa340032be0 con 0x7fa350081510 2024-09-12T02:37:44.024 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.015+0000 7fa357000640 1 -- 172.21.15.18:0/827497785 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3501a23d0 con 0x7fa350081510 2024-09-12T02:37:44.024 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.015+0000 7fa34d600640 1 -- 172.21.15.18:0/827497785 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa340037040 con 0x7fa350081510 2024-09-12T02:37:44.024 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.015+0000 7fa357000640 1 -- 172.21.15.18:0/827497785 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3501a50c0 con 0x7fa350081510 2024-09-12T02:37:44.024 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.016+0000 7fa34d600640 1 -- 172.21.15.18:0/827497785 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa340045070 con 0x7fa350081510 2024-09-12T02:37:44.024 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.016+0000 7fa357000640 1 -- 172.21.15.18:0/827497785 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa350081990 con 0x7fa350081510 2024-09-12T02:37:44.024 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.017+0000 7fa34d600640 1 --2- 172.21.15.18:0/827497785 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fa334038f70 0x7fa33403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:44.025 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.017+0000 7fa34d600640 1 -- 172.21.15.18:0/827497785 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa34006bfb0 con 0x7fa350081510 2024-09-12T02:37:44.025 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.017+0000 7fa347e00640 1 --2- 172.21.15.18:0/827497785 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fa334038f70 0x7fa33403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:44.025 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.018+0000 7fa347e00640 1 --2- 172.21.15.18:0/827497785 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fa334038f70 0x7fa33403b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa3380098c0 tx=0x7fa338006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:44.025 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.023+0000 7fa34d600640 1 -- 172.21.15.18:0/827497785 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa34006b900 con 0x7fa350081510 2024-09-12T02:37:44.025 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.224+0000 7fa357000640 1 -- 172.21.15.18:0/827497785 --> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fa35007e060 con 0x7fa334038f70 2024-09-12T02:37:44.025 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.229+0000 7fa34d600640 1 -- 172.21.15.18:0/827497785 <== mgr.14118 v2:172.21.15.18:6800/3271799053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa35007e060 con 0x7fa334038f70 2024-09-12T02:37:44.025 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.231+0000 7fa357000640 1 -- 172.21.15.18:0/827497785 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fa334038f70 msgr2=0x7fa33403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:44.025 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.231+0000 7fa357000640 1 --2- 172.21.15.18:0/827497785 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fa334038f70 0x7fa33403b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa3380098c0 tx=0x7fa338006db0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.025 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.231+0000 7fa357000640 1 -- 172.21.15.18:0/827497785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa350081510 msgr2=0x7fa3501a1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:44.025 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.231+0000 7fa357000640 1 --2- 172.21.15.18:0/827497785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa350081510 0x7fa3501a1c00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa340009940 tx=0x7fa3400326e0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.025 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.231+0000 7fa357000640 1 -- 172.21.15.18:0/827497785 shutdown_connections 2024-09-12T02:37:44.025 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.231+0000 7fa357000640 1 --2- 172.21.15.18:0/827497785 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fa334038f70 0x7fa33403b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.025 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.231+0000 7fa357000640 1 --2- 172.21.15.18:0/827497785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa350081510 0x7fa3501a1c00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.026 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.231+0000 7fa357000640 1 -- 172.21.15.18:0/827497785 >> 172.21.15.18:0/827497785 conn(0x7fa35007ccf0 msgr2=0x7fa35007d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:44.026 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.232+0000 7fa357000640 1 -- 172.21.15.18:0/827497785 shutdown_connections 2024-09-12T02:37:44.026 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:43.232+0000 7fa357000640 1 -- 172.21.15.18:0/827497785 wait complete. 2024-09-12T02:37:45.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:44 smithi018 ceph-mon[30616]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:45.561 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-12T02:37:45.561 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.531+0000 7f0faf600640 1 Processor -- start 2024-09-12T02:37:45.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.531+0000 7f0faf600640 1 -- start start 2024-09-12T02:37:45.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.531+0000 7f0faf600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fa807de20 0x7f0fa807c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.531+0000 7f0faf600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa807c850 con 0x7f0fa807de20 2024-09-12T02:37:45.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.532+0000 7f0facc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fa807de20 0x7f0fa807c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.532+0000 7f0facc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fa807de20 0x7f0fa807c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59894/0 (socket says 172.21.15.18:59894) 2024-09-12T02:37:45.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.532+0000 7f0facc00640 1 -- 172.21.15.18:0/806140406 learned_addr learned my addr 172.21.15.18:0/806140406 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:45.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.532+0000 7f0facc00640 1 -- 172.21.15.18:0/806140406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa807c9d0 con 0x7f0fa807de20 2024-09-12T02:37:45.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.533+0000 7f0facc00640 1 --2- 172.21.15.18:0/806140406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fa807de20 0x7f0fa807c280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009820 tx=0x7f0f9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec2e025fd0ba18f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:45.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.533+0000 7f0fa7400640 1 -- 172.21.15.18:0/806140406 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f9c037070 con 0x7f0fa807de20 2024-09-12T02:37:45.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.533+0000 7f0fa7400640 1 -- 172.21.15.18:0/806140406 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f9c032900 con 0x7f0fa807de20 2024-09-12T02:37:45.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.533+0000 7f0fa7400640 1 -- 172.21.15.18:0/806140406 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f9c030850 con 0x7f0fa807de20 2024-09-12T02:37:45.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.534+0000 7f0faf600640 1 -- 172.21.15.18:0/806140406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fa807de20 msgr2=0x7f0fa807c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:45.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.534+0000 7f0faf600640 1 --2- 172.21.15.18:0/806140406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fa807de20 0x7f0fa807c280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009820 tx=0x7f0f9c02a270 comp rx=0 tx=0).stop 2024-09-12T02:37:45.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.534+0000 7f0faf600640 1 -- 172.21.15.18:0/806140406 shutdown_connections 2024-09-12T02:37:45.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.534+0000 7f0faf600640 1 --2- 172.21.15.18:0/806140406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fa807de20 0x7f0fa807c280 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.534+0000 7f0faf600640 1 -- 172.21.15.18:0/806140406 >> 172.21.15.18:0/806140406 conn(0x7f0fa8102d00 msgr2=0x7f0fa8105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:45.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.534+0000 7f0faf600640 1 -- 172.21.15.18:0/806140406 shutdown_connections 2024-09-12T02:37:45.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.534+0000 7f0faf600640 1 -- 172.21.15.18:0/806140406 wait complete. 2024-09-12T02:37:45.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.535+0000 7f0faf600640 1 Processor -- start 2024-09-12T02:37:45.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.535+0000 7f0faf600640 1 -- start start 2024-09-12T02:37:45.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.536+0000 7f0faf600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fa807de20 0x7f0fa819d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.536+0000 7f0faf600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa810db80 con 0x7f0fa807de20 2024-09-12T02:37:45.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.536+0000 7f0facc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fa807de20 0x7f0fa819d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.536+0000 7f0facc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fa807de20 0x7f0fa819d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59898/0 (socket says 172.21.15.18:59898) 2024-09-12T02:37:45.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.536+0000 7f0facc00640 1 -- 172.21.15.18:0/1977462308 learned_addr learned my addr 172.21.15.18:0/1977462308 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:45.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.536+0000 7f0facc00640 1 -- 172.21.15.18:0/1977462308 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa819dcb0 con 0x7f0fa807de20 2024-09-12T02:37:45.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.537+0000 7f0facc00640 1 --2- 172.21.15.18:0/1977462308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fa807de20 0x7f0fa819d770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0097f0 tx=0x7f0f9c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:45.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.537+0000 7f0fa5600640 1 -- 172.21.15.18:0/1977462308 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f9c037040 con 0x7f0fa807de20 2024-09-12T02:37:45.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.537+0000 7f0fa5600640 1 -- 172.21.15.18:0/1977462308 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f9c040070 con 0x7f0fa807de20 2024-09-12T02:37:45.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.537+0000 7f0faf600640 1 -- 172.21.15.18:0/1977462308 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa819df40 con 0x7f0fa807de20 2024-09-12T02:37:45.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.537+0000 7f0fa5600640 1 -- 172.21.15.18:0/1977462308 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f9c03a390 con 0x7f0fa807de20 2024-09-12T02:37:45.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.537+0000 7f0faf600640 1 -- 172.21.15.18:0/1977462308 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa81a0c30 con 0x7f0fa807de20 2024-09-12T02:37:45.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.538+0000 7f0fa5600640 1 -- 172.21.15.18:0/1977462308 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f0f9c032900 con 0x7f0fa807de20 2024-09-12T02:37:45.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.538+0000 7f0faf600640 1 -- 172.21.15.18:0/1977462308 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa807c300 con 0x7f0fa807de20 2024-09-12T02:37:45.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.539+0000 7f0fa5600640 1 --2- 172.21.15.18:0/1977462308 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f0f90038f70 0x7f0f9003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.539+0000 7f0fa5600640 1 -- 172.21.15.18:0/1977462308 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0f9c06c570 con 0x7f0fa807de20 2024-09-12T02:37:45.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.540+0000 7f0fa7e00640 1 --2- 172.21.15.18:0/1977462308 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f0f90038f70 0x7f0f9003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.540+0000 7f0fa7e00640 1 --2- 172.21.15.18:0/1977462308 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f0f90038f70 0x7f0f9003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0f940098c0 tx=0x7f0f94006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:45.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.544+0000 7f0fa5600640 1 -- 172.21.15.18:0/1977462308 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f9c06bec0 con 0x7f0fa807de20 2024-09-12T02:37:45.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.731+0000 7f0faf600640 1 -- 172.21.15.18:0/1977462308 --> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f0fa8104000 con 0x7f0f90038f70 2024-09-12T02:37:45.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.731+0000 7f0fa5600640 1 -- 172.21.15.18:0/1977462308 <== mgr.14118 v2:172.21.15.18:6800/3271799053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f0fa8104000 con 0x7f0f90038f70 2024-09-12T02:37:45.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.734+0000 7f0faf600640 1 -- 172.21.15.18:0/1977462308 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f0f90038f70 msgr2=0x7f0f9003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:45.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.734+0000 7f0faf600640 1 --2- 172.21.15.18:0/1977462308 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f0f90038f70 0x7f0f9003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0f940098c0 tx=0x7f0f94006db0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.734+0000 7f0faf600640 1 -- 172.21.15.18:0/1977462308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fa807de20 msgr2=0x7f0fa819d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:45.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.734+0000 7f0faf600640 1 --2- 172.21.15.18:0/1977462308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fa807de20 0x7f0fa819d770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0097f0 tx=0x7f0f9c030d80 comp rx=0 tx=0).stop 2024-09-12T02:37:45.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.734+0000 7f0faf600640 1 -- 172.21.15.18:0/1977462308 shutdown_connections 2024-09-12T02:37:45.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.734+0000 7f0faf600640 1 --2- 172.21.15.18:0/1977462308 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f0f90038f70 0x7f0f9003b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.734+0000 7f0faf600640 1 --2- 172.21.15.18:0/1977462308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fa807de20 0x7f0fa819d770 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.734+0000 7f0faf600640 1 -- 172.21.15.18:0/1977462308 >> 172.21.15.18:0/1977462308 conn(0x7f0fa8102d00 msgr2=0x7f0fa81038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:45.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.734+0000 7f0faf600640 1 -- 172.21.15.18:0/1977462308 shutdown_connections 2024-09-12T02:37:45.565 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:44.734+0000 7f0faf600640 1 -- 172.21.15.18:0/1977462308 wait complete. 2024-09-12T02:37:45.566 INFO:teuthology.orchestra.run.smithi018.stdout:Generating ssh key... 2024-09-12T02:37:46.851 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: Generating public/private rsa key pair. 2024-09-12T02:37:46.851 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: Your identification has been saved in /tmp/tmpz5hiu5_e/key 2024-09-12T02:37:46.851 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: Your public key has been saved in /tmp/tmpz5hiu5_e/key.pub 2024-09-12T02:37:46.851 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: The key fingerprint is: 2024-09-12T02:37:46.851 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: SHA256:xdV3ZG44h4cqFL768Lov3DhEKB7gQRdxPHu+ZiV+PuI ceph-c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:37:46.851 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: The key's randomart image is: 2024-09-12T02:37:46.851 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: +---[RSA 3072]----+ 2024-09-12T02:37:46.852 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: | .. ++. . .. .o| 2024-09-12T02:37:46.852 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: | o. .o o o .*o| 2024-09-12T02:37:46.852 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: | . o + = =.*| 2024-09-12T02:37:46.852 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: | . o o oo . . = | 2024-09-12T02:37:46.852 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: | . o +S o . | 2024-09-12T02:37:46.852 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: | . +... | 2024-09-12T02:37:46.852 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: | +o* | 2024-09-12T02:37:46.852 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: | @++ | 2024-09-12T02:37:46.852 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: | +EX=. | 2024-09-12T02:37:46.852 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:37:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: +----[SHA256]-----+ 2024-09-12T02:37:47.286 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.129+0000 7fbd7f600640 1 Processor -- start 2024-09-12T02:37:47.287 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.129+0000 7fbd7f600640 1 -- start start 2024-09-12T02:37:47.287 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.129+0000 7fbd7f600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd7807de20 0x7fbd7807c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.287 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.129+0000 7fbd7f600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7807c850 con 0x7fbd7807de20 2024-09-12T02:37:47.287 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.130+0000 7fbd7cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd7807de20 0x7fbd7807c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.287 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.130+0000 7fbd7cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd7807de20 0x7fbd7807c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60092/0 (socket says 172.21.15.18:60092) 2024-09-12T02:37:47.287 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.130+0000 7fbd7cc00640 1 -- 172.21.15.18:0/3120333115 learned_addr learned my addr 172.21.15.18:0/3120333115 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:47.287 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.130+0000 7fbd7cc00640 1 -- 172.21.15.18:0/3120333115 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7807c9d0 con 0x7fbd7807de20 2024-09-12T02:37:47.287 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.131+0000 7fbd7cc00640 1 --2- 172.21.15.18:0/3120333115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd7807de20 0x7fbd7807c280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c009820 tx=0x7fbd6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d355671dca7791f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:47.287 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.131+0000 7fbd77400640 1 -- 172.21.15.18:0/3120333115 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd6c037070 con 0x7fbd7807de20 2024-09-12T02:37:47.287 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.131+0000 7fbd77400640 1 -- 172.21.15.18:0/3120333115 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbd6c032900 con 0x7fbd7807de20 2024-09-12T02:37:47.287 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.131+0000 7fbd77400640 1 -- 172.21.15.18:0/3120333115 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd6c030850 con 0x7fbd7807de20 2024-09-12T02:37:47.288 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.132+0000 7fbd7f600640 1 -- 172.21.15.18:0/3120333115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd7807de20 msgr2=0x7fbd7807c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:47.288 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.132+0000 7fbd7f600640 1 --2- 172.21.15.18:0/3120333115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd7807de20 0x7fbd7807c280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c009820 tx=0x7fbd6c02a270 comp rx=0 tx=0).stop 2024-09-12T02:37:47.288 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.132+0000 7fbd7f600640 1 -- 172.21.15.18:0/3120333115 shutdown_connections 2024-09-12T02:37:47.288 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.132+0000 7fbd7f600640 1 --2- 172.21.15.18:0/3120333115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd7807de20 0x7fbd7807c280 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.288 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.132+0000 7fbd7f600640 1 -- 172.21.15.18:0/3120333115 >> 172.21.15.18:0/3120333115 conn(0x7fbd78102cc0 msgr2=0x7fbd78105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:47.288 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.132+0000 7fbd7f600640 1 -- 172.21.15.18:0/3120333115 shutdown_connections 2024-09-12T02:37:47.288 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.132+0000 7fbd7f600640 1 -- 172.21.15.18:0/3120333115 wait complete. 2024-09-12T02:37:47.288 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.133+0000 7fbd7f600640 1 Processor -- start 2024-09-12T02:37:47.288 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.133+0000 7fbd7f600640 1 -- start start 2024-09-12T02:37:47.288 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.133+0000 7fbd7f600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd7807de20 0x7fbd7819d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.288 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.133+0000 7fbd7f600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7810db60 con 0x7fbd7807de20 2024-09-12T02:37:47.288 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.134+0000 7fbd7cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd7807de20 0x7fbd7819d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.288 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.134+0000 7fbd7cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd7807de20 0x7fbd7819d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60104/0 (socket says 172.21.15.18:60104) 2024-09-12T02:37:47.288 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.134+0000 7fbd7cc00640 1 -- 172.21.15.18:0/2966376796 learned_addr learned my addr 172.21.15.18:0/2966376796 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:47.289 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.134+0000 7fbd7cc00640 1 -- 172.21.15.18:0/2966376796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7819dcd0 con 0x7fbd7807de20 2024-09-12T02:37:47.289 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.134+0000 7fbd7cc00640 1 --2- 172.21.15.18:0/2966376796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd7807de20 0x7fbd7819d790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0097f0 tx=0x7fbd6c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:47.289 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.134+0000 7fbd75600640 1 -- 172.21.15.18:0/2966376796 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd6c037040 con 0x7fbd7807de20 2024-09-12T02:37:47.289 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.134+0000 7fbd75600640 1 -- 172.21.15.18:0/2966376796 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbd6c040070 con 0x7fbd7807de20 2024-09-12T02:37:47.289 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.134+0000 7fbd75600640 1 -- 172.21.15.18:0/2966376796 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd6c03a390 con 0x7fbd7807de20 2024-09-12T02:37:47.289 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.134+0000 7fbd7f600640 1 -- 172.21.15.18:0/2966376796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd7819df60 con 0x7fbd7807de20 2024-09-12T02:37:47.289 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.135+0000 7fbd7f600640 1 -- 172.21.15.18:0/2966376796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd781a0c50 con 0x7fbd7807de20 2024-09-12T02:37:47.289 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.136+0000 7fbd75600640 1 -- 172.21.15.18:0/2966376796 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fbd6c03b430 con 0x7fbd7807de20 2024-09-12T02:37:47.289 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.136+0000 7fbd7f600640 1 -- 172.21.15.18:0/2966376796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd7807c300 con 0x7fbd7807de20 2024-09-12T02:37:47.289 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.136+0000 7fbd75600640 1 --2- 172.21.15.18:0/2966376796 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fbd60038f70 0x7fbd6003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.289 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.136+0000 7fbd75600640 1 -- 172.21.15.18:0/2966376796 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbd6c06c560 con 0x7fbd7807de20 2024-09-12T02:37:47.289 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.136+0000 7fbd77e00640 1 --2- 172.21.15.18:0/2966376796 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fbd60038f70 0x7fbd6003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.137+0000 7fbd77e00640 1 --2- 172.21.15.18:0/2966376796 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fbd60038f70 0x7fbd6003b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbd640098c0 tx=0x7fbd64006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:47.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.141+0000 7fbd75600640 1 -- 172.21.15.18:0/2966376796 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd6c06beb0 con 0x7fbd7807de20 2024-09-12T02:37:47.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.325+0000 7fbd7f600640 1 -- 172.21.15.18:0/2966376796 --> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fbd78104010 con 0x7fbd60038f70 2024-09-12T02:37:47.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.581+0000 7fbd75600640 1 -- 172.21.15.18:0/2966376796 <== mgr.14118 v2:172.21.15.18:6800/3271799053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbd78104010 con 0x7fbd60038f70 2024-09-12T02:37:47.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.584+0000 7fbd7f600640 1 -- 172.21.15.18:0/2966376796 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fbd60038f70 msgr2=0x7fbd6003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:47.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.584+0000 7fbd7f600640 1 --2- 172.21.15.18:0/2966376796 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fbd60038f70 0x7fbd6003b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbd640098c0 tx=0x7fbd64006db0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.584+0000 7fbd7f600640 1 -- 172.21.15.18:0/2966376796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd7807de20 msgr2=0x7fbd7819d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:47.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.584+0000 7fbd7f600640 1 --2- 172.21.15.18:0/2966376796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd7807de20 0x7fbd7819d790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0097f0 tx=0x7fbd6c030d80 comp rx=0 tx=0).stop 2024-09-12T02:37:47.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.584+0000 7fbd7f600640 1 -- 172.21.15.18:0/2966376796 shutdown_connections 2024-09-12T02:37:47.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.584+0000 7fbd7f600640 1 --2- 172.21.15.18:0/2966376796 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fbd60038f70 0x7fbd6003b430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.584+0000 7fbd7f600640 1 --2- 172.21.15.18:0/2966376796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd7807de20 0x7fbd7819d790 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.584+0000 7fbd7f600640 1 -- 172.21.15.18:0/2966376796 >> 172.21.15.18:0/2966376796 conn(0x7fbd78102cc0 msgr2=0x7fbd78103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:47.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.584+0000 7fbd7f600640 1 -- 172.21.15.18:0/2966376796 shutdown_connections 2024-09-12T02:37:47.290 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:46.584+0000 7fbd7f600640 1 -- 172.21.15.18:0/2966376796 wait complete. 2024-09-12T02:37:47.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:47 smithi018 ceph-mon[30616]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:47 smithi018 ceph-mon[30616]: Generating ssh key... 2024-09-12T02:37:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:47 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' 2024-09-12T02:37:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:47 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' 2024-09-12T02:37:48.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCK6Af9cfeLfnfdr/7GeAGS9Cjx/QgBLiOEFea6DtfjjqzipX0RM6mymE75FQauCh2JEaTftP8p1OBeaHiPpgZxR4EgtrBydbbmpAamkEOML5APqa67h+baX3KPSD4roqegYP12JHtxmhCUKg1X1QcoqBHEN+M5J/SZy8/QQj+JZu1fz4HR5izkApvcdb4z1YjGh9obzeeVjJFpP3e/yXcYHhPTll2QFdyBJ3fbO4o/6XHyrpvAitQDVGKlsYwxd8RvIklqYGPUl7Wno1xey5xiizBG3zeluz0eBv8J9r+pFwj/SXtx4irfscF/uDAxmsZ532z+X4VaevzHqah4PU0neEF3/K4lxcoBJjHQmW+wXNpde2jQpLmYuAaQp4C/88j/1FCc5bxV1Z+Qz4cbm00wPcc0lhbXS7RCGzaEhsm4/GHqIARQUYmXKayY/v/A46ljb2Z2UigLK1PcYtCF4+uIpImfHj/YmsFpW/Q0ptf2WPRX1VR6nZMQmveklPW42ek= ceph-c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:37:48.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.809+0000 7f45c4c00640 1 Processor -- start 2024-09-12T02:37:48.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.810+0000 7f45c4c00640 1 -- start start 2024-09-12T02:37:48.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.810+0000 7f45c4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0107350 0x7f45c0107750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:48.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.810+0000 7f45c4c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f45c0107d20 con 0x7f45c0107350 2024-09-12T02:37:48.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.810+0000 7f45bf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0107350 0x7f45c0107750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.810+0000 7f45bf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0107350 0x7f45c0107750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60116/0 (socket says 172.21.15.18:60116) 2024-09-12T02:37:48.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.810+0000 7f45bf400640 1 -- 172.21.15.18:0/3127920307 learned_addr learned my addr 172.21.15.18:0/3127920307 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:48.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.811+0000 7f45bf400640 1 -- 172.21.15.18:0/3127920307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c0108550 con 0x7f45c0107350 2024-09-12T02:37:48.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.812+0000 7f45bf400640 1 --2- 172.21.15.18:0/3127920307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0107350 0x7f45c0107750 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009820 tx=0x7f45b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384b56c6532f65ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:48.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.812+0000 7f45bea00640 1 -- 172.21.15.18:0/3127920307 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45b0037070 con 0x7f45c0107350 2024-09-12T02:37:48.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.812+0000 7f45bea00640 1 -- 172.21.15.18:0/3127920307 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f45b0032900 con 0x7f45c0107350 2024-09-12T02:37:48.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.812+0000 7f45bea00640 1 -- 172.21.15.18:0/3127920307 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45b0030850 con 0x7f45c0107350 2024-09-12T02:37:48.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.812+0000 7f45c4c00640 1 -- 172.21.15.18:0/3127920307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0107350 msgr2=0x7f45c0107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:48.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.812+0000 7f45c4c00640 1 --2- 172.21.15.18:0/3127920307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0107350 0x7f45c0107750 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009820 tx=0x7f45b002a270 comp rx=0 tx=0).stop 2024-09-12T02:37:48.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.813+0000 7f45c4c00640 1 -- 172.21.15.18:0/3127920307 shutdown_connections 2024-09-12T02:37:48.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.813+0000 7f45c4c00640 1 --2- 172.21.15.18:0/3127920307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0107350 0x7f45c0107750 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.813+0000 7f45c4c00640 1 -- 172.21.15.18:0/3127920307 >> 172.21.15.18:0/3127920307 conn(0x7f45c0102ae0 msgr2=0x7f45c0104f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:48.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.813+0000 7f45c4c00640 1 -- 172.21.15.18:0/3127920307 shutdown_connections 2024-09-12T02:37:48.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.813+0000 7f45c4c00640 1 -- 172.21.15.18:0/3127920307 wait complete. 2024-09-12T02:37:48.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.814+0000 7f45c4c00640 1 Processor -- start 2024-09-12T02:37:48.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.814+0000 7f45c4c00640 1 -- start start 2024-09-12T02:37:48.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.814+0000 7f45c4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0107350 0x7f45c019d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:48.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.814+0000 7f45c4c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f45c010b900 con 0x7f45c0107350 2024-09-12T02:37:48.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.814+0000 7f45bf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0107350 0x7f45c019d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.814+0000 7f45bf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0107350 0x7f45c019d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60126/0 (socket says 172.21.15.18:60126) 2024-09-12T02:37:48.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.814+0000 7f45bf400640 1 -- 172.21.15.18:0/1846646105 learned_addr learned my addr 172.21.15.18:0/1846646105 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:48.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.815+0000 7f45bf400640 1 -- 172.21.15.18:0/1846646105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c019dae0 con 0x7f45c0107350 2024-09-12T02:37:48.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.815+0000 7f45bf400640 1 --2- 172.21.15.18:0/1846646105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0107350 0x7f45c019d5a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f45b00097f0 tx=0x7f45b0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:48.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.815+0000 7f45bcc00640 1 -- 172.21.15.18:0/1846646105 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45b0037040 con 0x7f45c0107350 2024-09-12T02:37:48.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.815+0000 7f45bcc00640 1 -- 172.21.15.18:0/1846646105 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f45b0040070 con 0x7f45c0107350 2024-09-12T02:37:48.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.815+0000 7f45c4c00640 1 -- 172.21.15.18:0/1846646105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c019dd70 con 0x7f45c0107350 2024-09-12T02:37:48.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.815+0000 7f45bcc00640 1 -- 172.21.15.18:0/1846646105 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45b003a390 con 0x7f45c0107350 2024-09-12T02:37:48.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.816+0000 7f45c4c00640 1 -- 172.21.15.18:0/1846646105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c01a0a60 con 0x7f45c0107350 2024-09-12T02:37:48.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.817+0000 7f45bcc00640 1 -- 172.21.15.18:0/1846646105 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f45b003b430 con 0x7f45c0107350 2024-09-12T02:37:48.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.817+0000 7f45c4c00640 1 -- 172.21.15.18:0/1846646105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45c01077d0 con 0x7f45c0107350 2024-09-12T02:37:48.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.817+0000 7f45bcc00640 1 --2- 172.21.15.18:0/1846646105 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f45a4039020 0x7f45a403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:48.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.817+0000 7f45bcc00640 1 -- 172.21.15.18:0/1846646105 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f45b006c4d0 con 0x7f45c0107350 2024-09-12T02:37:48.720 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.817+0000 7f45b6a00640 1 --2- 172.21.15.18:0/1846646105 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f45a4039020 0x7f45a403b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.720 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.818+0000 7f45b6a00640 1 --2- 172.21.15.18:0/1846646105 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f45a4039020 0x7f45a403b4e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f45a80098c0 tx=0x7f45a8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:48.720 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:47.822+0000 7f45bcc00640 1 -- 172.21.15.18:0/1846646105 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f45b00371e0 con 0x7f45c0107350 2024-09-12T02:37:48.720 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:48.012+0000 7f45c4c00640 1 -- 172.21.15.18:0/1846646105 --> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f45c0103d30 con 0x7f45a4039020 2024-09-12T02:37:48.720 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:48.013+0000 7f45bcc00640 1 -- 172.21.15.18:0/1846646105 <== mgr.14118 v2:172.21.15.18:6800/3271799053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f45c0103d30 con 0x7f45a4039020 2024-09-12T02:37:48.720 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:48.015+0000 7f45c4c00640 1 -- 172.21.15.18:0/1846646105 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f45a4039020 msgr2=0x7f45a403b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:48.720 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:48.015+0000 7f45c4c00640 1 --2- 172.21.15.18:0/1846646105 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f45a4039020 0x7f45a403b4e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f45a80098c0 tx=0x7f45a8006db0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.720 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:48.015+0000 7f45c4c00640 1 -- 172.21.15.18:0/1846646105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0107350 msgr2=0x7f45c019d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:48.720 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:48.015+0000 7f45c4c00640 1 --2- 172.21.15.18:0/1846646105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0107350 0x7f45c019d5a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f45b00097f0 tx=0x7f45b0030d80 comp rx=0 tx=0).stop 2024-09-12T02:37:48.720 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:48.015+0000 7f45c4c00640 1 -- 172.21.15.18:0/1846646105 shutdown_connections 2024-09-12T02:37:48.720 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:48.015+0000 7f45c4c00640 1 --2- 172.21.15.18:0/1846646105 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f45a4039020 0x7f45a403b4e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.720 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:48.015+0000 7f45c4c00640 1 --2- 172.21.15.18:0/1846646105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0107350 0x7f45c019d5a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.720 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:48.015+0000 7f45c4c00640 1 -- 172.21.15.18:0/1846646105 >> 172.21.15.18:0/1846646105 conn(0x7f45c0102ae0 msgr2=0x7f45c0103620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:48.720 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:48.016+0000 7f45c4c00640 1 -- 172.21.15.18:0/1846646105 shutdown_connections 2024-09-12T02:37:48.721 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:48.016+0000 7f45c4c00640 1 -- 172.21.15.18:0/1846646105 wait complete. 2024-09-12T02:37:48.721 INFO:teuthology.orchestra.run.smithi018.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:37:48.721 INFO:teuthology.orchestra.run.smithi018.stdout:Adding key to root@localhost authorized_keys... 2024-09-12T02:37:48.731 INFO:teuthology.orchestra.run.smithi018.stdout:Adding host smithi018... 2024-09-12T02:37:49.093 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:48 smithi018 ceph-mon[30616]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:50.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:49 smithi018 ceph-mon[30616]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi018", "addr": "172.21.15.18", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:52.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:51 smithi018 ceph-mon[30616]: Deploying cephadm binary to smithi018 2024-09-12T02:37:54.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Added host 'smithi018' with addr '172.21.15.18' 2024-09-12T02:37:54.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.327+0000 7f3f64a00640 1 Processor -- start 2024-09-12T02:37:54.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.327+0000 7f3f64a00640 1 -- start start 2024-09-12T02:37:54.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.328+0000 7f3f64a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f60109810 0x7f3f60109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.328+0000 7f3f64a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6010a1e0 con 0x7f3f60109810 2024-09-12T02:37:54.842 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.328+0000 7f3f5de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f60109810 0x7f3f60109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.843 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.328+0000 7f3f5de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f60109810 0x7f3f60109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60128/0 (socket says 172.21.15.18:60128) 2024-09-12T02:37:54.843 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.328+0000 7f3f5de00640 1 -- 172.21.15.18:0/725823901 learned_addr learned my addr 172.21.15.18:0/725823901 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:54.843 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.328+0000 7f3f5de00640 1 -- 172.21.15.18:0/725823901 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6010a950 con 0x7f3f60109810 2024-09-12T02:37:54.843 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.329+0000 7f3f5de00640 1 --2- 172.21.15.18:0/725823901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f60109810 0x7f3f60109c10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3f50009820 tx=0x7f3f5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3e0904e88e9641 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:54.843 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.329+0000 7f3f5d400640 1 -- 172.21.15.18:0/725823901 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f50037070 con 0x7f3f60109810 2024-09-12T02:37:54.843 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.329+0000 7f3f5d400640 1 -- 172.21.15.18:0/725823901 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f50032900 con 0x7f3f60109810 2024-09-12T02:37:54.843 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.329+0000 7f3f5d400640 1 -- 172.21.15.18:0/725823901 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f50030850 con 0x7f3f60109810 2024-09-12T02:37:54.843 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.330+0000 7f3f64a00640 1 -- 172.21.15.18:0/725823901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f60109810 msgr2=0x7f3f60109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.843 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.330+0000 7f3f64a00640 1 --2- 172.21.15.18:0/725823901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f60109810 0x7f3f60109c10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3f50009820 tx=0x7f3f5002a270 comp rx=0 tx=0).stop 2024-09-12T02:37:54.843 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.330+0000 7f3f64a00640 1 -- 172.21.15.18:0/725823901 shutdown_connections 2024-09-12T02:37:54.843 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.330+0000 7f3f64a00640 1 --2- 172.21.15.18:0/725823901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f60109810 0x7f3f60109c10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.844 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.330+0000 7f3f64a00640 1 -- 172.21.15.18:0/725823901 >> 172.21.15.18:0/725823901 conn(0x7f3f6007ccf0 msgr2=0x7f3f6007d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:54.844 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.330+0000 7f3f64a00640 1 -- 172.21.15.18:0/725823901 shutdown_connections 2024-09-12T02:37:54.844 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.330+0000 7f3f64a00640 1 -- 172.21.15.18:0/725823901 wait complete. 2024-09-12T02:37:54.844 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.331+0000 7f3f64a00640 1 Processor -- start 2024-09-12T02:37:54.844 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.331+0000 7f3f64a00640 1 -- start start 2024-09-12T02:37:54.844 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.332+0000 7f3f64a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f60109810 0x7f3f6019d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.844 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.332+0000 7f3f64a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6010dd00 con 0x7f3f60109810 2024-09-12T02:37:54.844 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.332+0000 7f3f5de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f60109810 0x7f3f6019d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.844 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.332+0000 7f3f5de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f60109810 0x7f3f6019d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60142/0 (socket says 172.21.15.18:60142) 2024-09-12T02:37:54.844 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.332+0000 7f3f5de00640 1 -- 172.21.15.18:0/2229794487 learned_addr learned my addr 172.21.15.18:0/2229794487 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:54.844 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.332+0000 7f3f5de00640 1 -- 172.21.15.18:0/2229794487 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6019dd10 con 0x7f3f60109810 2024-09-12T02:37:54.844 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.333+0000 7f3f5de00640 1 --2- 172.21.15.18:0/2229794487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f60109810 0x7f3f6019d7d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3f50030460 tx=0x7f3f50030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:54.844 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.333+0000 7f3f57400640 1 -- 172.21.15.18:0/2229794487 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f50042070 con 0x7f3f60109810 2024-09-12T02:37:54.845 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.333+0000 7f3f57400640 1 -- 172.21.15.18:0/2229794487 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f50032be0 con 0x7f3f60109810 2024-09-12T02:37:54.845 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.333+0000 7f3f57400640 1 -- 172.21.15.18:0/2229794487 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f50037040 con 0x7f3f60109810 2024-09-12T02:37:54.845 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.333+0000 7f3f64a00640 1 -- 172.21.15.18:0/2229794487 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f6019dfa0 con 0x7f3f60109810 2024-09-12T02:37:54.845 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.333+0000 7f3f64a00640 1 -- 172.21.15.18:0/2229794487 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f601a0c90 con 0x7f3f60109810 2024-09-12T02:37:54.845 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.334+0000 7f3f57400640 1 -- 172.21.15.18:0/2229794487 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f3f50045070 con 0x7f3f60109810 2024-09-12T02:37:54.845 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.334+0000 7f3f64a00640 1 -- 172.21.15.18:0/2229794487 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f60109c10 con 0x7f3f60109810 2024-09-12T02:37:54.845 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.334+0000 7f3f57400640 1 --2- 172.21.15.18:0/2229794487 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f3f44038fc0 0x7f3f4403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.845 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.334+0000 7f3f57400640 1 -- 172.21.15.18:0/2229794487 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3f5006bed0 con 0x7f3f60109810 2024-09-12T02:37:54.845 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.335+0000 7f3f55400640 1 --2- 172.21.15.18:0/2229794487 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f3f44038fc0 0x7f3f4403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.845 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.335+0000 7f3f55400640 1 --2- 172.21.15.18:0/2229794487 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f3f44038fc0 0x7f3f4403b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3f480098c0 tx=0x7f3f48006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:54.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.339+0000 7f3f57400640 1 -- 172.21.15.18:0/2229794487 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3f50045360 con 0x7f3f60109810 2024-09-12T02:37:54.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:49.530+0000 7f3f64a00640 1 -- 172.21.15.18:0/2229794487 --> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi018", "addr": "172.21.15.18", "target": ["mon-mgr", ""]}) -- 0x7f3f60107be0 con 0x7f3f44038fc0 2024-09-12T02:37:54.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:54.132+0000 7f3f57400640 1 -- 172.21.15.18:0/2229794487 <== mgr.14118 v2:172.21.15.18:6800/3271799053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f3f60107be0 con 0x7f3f44038fc0 2024-09-12T02:37:54.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:54.135+0000 7f3f64a00640 1 -- 172.21.15.18:0/2229794487 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f3f44038fc0 msgr2=0x7f3f4403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:54.135+0000 7f3f64a00640 1 --2- 172.21.15.18:0/2229794487 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f3f44038fc0 0x7f3f4403b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3f480098c0 tx=0x7f3f48006db0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:54.135+0000 7f3f64a00640 1 -- 172.21.15.18:0/2229794487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f60109810 msgr2=0x7f3f6019d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:54.135+0000 7f3f64a00640 1 --2- 172.21.15.18:0/2229794487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f60109810 0x7f3f6019d7d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3f50030460 tx=0x7f3f50030d80 comp rx=0 tx=0).stop 2024-09-12T02:37:54.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:54.135+0000 7f3f64a00640 1 -- 172.21.15.18:0/2229794487 shutdown_connections 2024-09-12T02:37:54.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:54.135+0000 7f3f64a00640 1 --2- 172.21.15.18:0/2229794487 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f3f44038fc0 0x7f3f4403b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:54.135+0000 7f3f64a00640 1 --2- 172.21.15.18:0/2229794487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f60109810 0x7f3f6019d7d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:54.135+0000 7f3f64a00640 1 -- 172.21.15.18:0/2229794487 >> 172.21.15.18:0/2229794487 conn(0x7f3f6007ccf0 msgr2=0x7f3f601074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:54.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:54.135+0000 7f3f64a00640 1 -- 172.21.15.18:0/2229794487 shutdown_connections 2024-09-12T02:37:54.847 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:54.135+0000 7f3f64a00640 1 -- 172.21.15.18:0/2229794487 wait complete. 2024-09-12T02:37:54.847 INFO:teuthology.orchestra.run.smithi018.stdout:Deploying unmanaged mon service... 2024-09-12T02:37:55.391 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:55 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' 2024-09-12T02:37:55.391 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:55 smithi018 ceph-mon[30616]: Added host smithi018 2024-09-12T02:37:55.392 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:55 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:37:56.677 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-12T02:37:56.677 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.395+0000 7fc66b400640 1 Processor -- start 2024-09-12T02:37:56.677 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.395+0000 7fc66b400640 1 -- start start 2024-09-12T02:37:56.678 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.395+0000 7fc66b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc664109810 0x7fc664109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:56.678 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.395+0000 7fc66b400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc66410a1e0 con 0x7fc664109810 2024-09-12T02:37:56.678 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.395+0000 7fc668a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc664109810 0x7fc664109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:56.678 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.395+0000 7fc668a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc664109810 0x7fc664109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53498/0 (socket says 172.21.15.18:53498) 2024-09-12T02:37:56.678 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.395+0000 7fc668a00640 1 -- 172.21.15.18:0/3582724852 learned_addr learned my addr 172.21.15.18:0/3582724852 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:56.678 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.396+0000 7fc668a00640 1 -- 172.21.15.18:0/3582724852 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66410a950 con 0x7fc664109810 2024-09-12T02:37:56.678 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.397+0000 7fc668a00640 1 --2- 172.21.15.18:0/3582724852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc664109810 0x7fc664109c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc658009820 tx=0x7fc65802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f81bd0d7f50e3d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:56.678 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.397+0000 7fc663400640 1 -- 172.21.15.18:0/3582724852 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc658037070 con 0x7fc664109810 2024-09-12T02:37:56.678 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.397+0000 7fc663400640 1 -- 172.21.15.18:0/3582724852 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc658032900 con 0x7fc664109810 2024-09-12T02:37:56.678 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.397+0000 7fc663400640 1 -- 172.21.15.18:0/3582724852 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc658030850 con 0x7fc664109810 2024-09-12T02:37:56.678 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.398+0000 7fc66b400640 1 -- 172.21.15.18:0/3582724852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc664109810 msgr2=0x7fc664109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:56.678 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.398+0000 7fc66b400640 1 --2- 172.21.15.18:0/3582724852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc664109810 0x7fc664109c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc658009820 tx=0x7fc65802a270 comp rx=0 tx=0).stop 2024-09-12T02:37:56.678 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.398+0000 7fc66b400640 1 -- 172.21.15.18:0/3582724852 shutdown_connections 2024-09-12T02:37:56.679 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.398+0000 7fc66b400640 1 --2- 172.21.15.18:0/3582724852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc664109810 0x7fc664109c10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.679 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.398+0000 7fc66b400640 1 -- 172.21.15.18:0/3582724852 >> 172.21.15.18:0/3582724852 conn(0x7fc66407ccf0 msgr2=0x7fc66407d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:56.679 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.398+0000 7fc66b400640 1 -- 172.21.15.18:0/3582724852 shutdown_connections 2024-09-12T02:37:56.679 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.398+0000 7fc66b400640 1 -- 172.21.15.18:0/3582724852 wait complete. 2024-09-12T02:37:56.679 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.399+0000 7fc66b400640 1 Processor -- start 2024-09-12T02:37:56.679 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.399+0000 7fc66b400640 1 -- start start 2024-09-12T02:37:56.679 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.399+0000 7fc66b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc664109810 0x7fc66419d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:56.679 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.399+0000 7fc66b400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc66410dd00 con 0x7fc664109810 2024-09-12T02:37:56.679 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.399+0000 7fc668a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc664109810 0x7fc66419d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:56.679 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.399+0000 7fc668a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc664109810 0x7fc66419d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53504/0 (socket says 172.21.15.18:53504) 2024-09-12T02:37:56.679 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.400+0000 7fc668a00640 1 -- 172.21.15.18:0/2285671798 learned_addr learned my addr 172.21.15.18:0/2285671798 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:56.679 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.400+0000 7fc668a00640 1 -- 172.21.15.18:0/2285671798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66419dd10 con 0x7fc664109810 2024-09-12T02:37:56.679 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.400+0000 7fc668a00640 1 --2- 172.21.15.18:0/2285671798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc664109810 0x7fc66419d7d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc658030460 tx=0x7fc658030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:56.680 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.400+0000 7fc661600640 1 -- 172.21.15.18:0/2285671798 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc658042070 con 0x7fc664109810 2024-09-12T02:37:56.680 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.400+0000 7fc661600640 1 -- 172.21.15.18:0/2285671798 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc658032be0 con 0x7fc664109810 2024-09-12T02:37:56.680 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.400+0000 7fc661600640 1 -- 172.21.15.18:0/2285671798 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc658037040 con 0x7fc664109810 2024-09-12T02:37:56.680 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.400+0000 7fc66b400640 1 -- 172.21.15.18:0/2285671798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66419dfa0 con 0x7fc664109810 2024-09-12T02:37:56.680 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.401+0000 7fc66b400640 1 -- 172.21.15.18:0/2285671798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6641a0c90 con 0x7fc664109810 2024-09-12T02:37:56.680 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.402+0000 7fc661600640 1 -- 172.21.15.18:0/2285671798 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fc658045070 con 0x7fc664109810 2024-09-12T02:37:56.680 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.402+0000 7fc66b400640 1 -- 172.21.15.18:0/2285671798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc664109c10 con 0x7fc664109810 2024-09-12T02:37:56.680 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.402+0000 7fc661600640 1 --2- 172.21.15.18:0/2285671798 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fc64c038fc0 0x7fc64c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:56.680 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.402+0000 7fc661600640 1 -- 172.21.15.18:0/2285671798 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc65806bed0 con 0x7fc664109810 2024-09-12T02:37:56.680 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.402+0000 7fc663e00640 1 --2- 172.21.15.18:0/2285671798 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fc64c038fc0 0x7fc64c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:56.680 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.403+0000 7fc663e00640 1 --2- 172.21.15.18:0/2285671798 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fc64c038fc0 0x7fc64c03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc6500098c0 tx=0x7fc650006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:56.680 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.409+0000 7fc661600640 1 -- 172.21.15.18:0/2285671798 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc658045360 con 0x7fc664109810 2024-09-12T02:37:56.681 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.610+0000 7fc66b400640 1 -- 172.21.15.18:0/2285671798 --> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fc664107be0 con 0x7fc64c038fc0 2024-09-12T02:37:56.681 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.615+0000 7fc661600640 1 -- 172.21.15.18:0/2285671798 <== mgr.14118 v2:172.21.15.18:6800/3271799053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc664107be0 con 0x7fc64c038fc0 2024-09-12T02:37:56.681 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.617+0000 7fc66b400640 1 -- 172.21.15.18:0/2285671798 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fc64c038fc0 msgr2=0x7fc64c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:56.681 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.617+0000 7fc66b400640 1 --2- 172.21.15.18:0/2285671798 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fc64c038fc0 0x7fc64c03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc6500098c0 tx=0x7fc650006db0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.681 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.617+0000 7fc66b400640 1 -- 172.21.15.18:0/2285671798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc664109810 msgr2=0x7fc66419d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:56.681 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.617+0000 7fc66b400640 1 --2- 172.21.15.18:0/2285671798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc664109810 0x7fc66419d7d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc658030460 tx=0x7fc658030d80 comp rx=0 tx=0).stop 2024-09-12T02:37:56.681 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.618+0000 7fc66b400640 1 -- 172.21.15.18:0/2285671798 shutdown_connections 2024-09-12T02:37:56.681 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.618+0000 7fc66b400640 1 --2- 172.21.15.18:0/2285671798 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fc64c038fc0 0x7fc64c03b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.681 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.618+0000 7fc66b400640 1 --2- 172.21.15.18:0/2285671798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc664109810 0x7fc66419d7d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.681 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.618+0000 7fc66b400640 1 -- 172.21.15.18:0/2285671798 >> 172.21.15.18:0/2285671798 conn(0x7fc66407ccf0 msgr2=0x7fc6641074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:56.681 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.618+0000 7fc66b400640 1 -- 172.21.15.18:0/2285671798 shutdown_connections 2024-09-12T02:37:56.681 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:55.618+0000 7fc66b400640 1 -- 172.21.15.18:0/2285671798 wait complete. 2024-09-12T02:37:56.681 INFO:teuthology.orchestra.run.smithi018.stdout:Deploying unmanaged mgr service... 2024-09-12T02:37:56.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:56 smithi018 ceph-mon[30616]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:56.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:56 smithi018 ceph-mon[30616]: Saving service mon spec with placement count:5 2024-09-12T02:37:56.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:56 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' 2024-09-12T02:37:58.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-12T02:37:58.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.456+0000 7f7c45800640 1 Processor -- start 2024-09-12T02:37:58.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.456+0000 7f7c45800640 1 -- start start 2024-09-12T02:37:58.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.456+0000 7f7c45800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4007de20 0x7f7c4007c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:58.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.456+0000 7f7c45800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4007c850 con 0x7f7c4007de20 2024-09-12T02:37:58.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.457+0000 7f7c3ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4007de20 0x7f7c4007c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:58.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.457+0000 7f7c3ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4007de20 0x7f7c4007c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53518/0 (socket says 172.21.15.18:53518) 2024-09-12T02:37:58.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.457+0000 7f7c3ea00640 1 -- 172.21.15.18:0/2229244395 learned_addr learned my addr 172.21.15.18:0/2229244395 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:58.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.457+0000 7f7c3ea00640 1 -- 172.21.15.18:0/2229244395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4007c9d0 con 0x7f7c4007de20 2024-09-12T02:37:58.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.458+0000 7f7c3ea00640 1 --2- 172.21.15.18:0/2229244395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4007de20 0x7f7c4007c280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009820 tx=0x7f7c3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3ffb1267fc7d42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:58.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.459+0000 7f7c3d600640 1 -- 172.21.15.18:0/2229244395 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c30037070 con 0x7f7c4007de20 2024-09-12T02:37:58.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.459+0000 7f7c3d600640 1 -- 172.21.15.18:0/2229244395 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c30032900 con 0x7f7c4007de20 2024-09-12T02:37:58.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.459+0000 7f7c3d600640 1 -- 172.21.15.18:0/2229244395 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c30030850 con 0x7f7c4007de20 2024-09-12T02:37:58.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.459+0000 7f7c45800640 1 -- 172.21.15.18:0/2229244395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4007de20 msgr2=0x7f7c4007c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:58.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.459+0000 7f7c45800640 1 --2- 172.21.15.18:0/2229244395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4007de20 0x7f7c4007c280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009820 tx=0x7f7c3002a270 comp rx=0 tx=0).stop 2024-09-12T02:37:58.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.459+0000 7f7c45800640 1 -- 172.21.15.18:0/2229244395 shutdown_connections 2024-09-12T02:37:58.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.459+0000 7f7c45800640 1 --2- 172.21.15.18:0/2229244395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4007de20 0x7f7c4007c280 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.459+0000 7f7c45800640 1 -- 172.21.15.18:0/2229244395 >> 172.21.15.18:0/2229244395 conn(0x7f7c40102cc0 msgr2=0x7f7c40105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:58.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.459+0000 7f7c45800640 1 -- 172.21.15.18:0/2229244395 shutdown_connections 2024-09-12T02:37:58.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.459+0000 7f7c45800640 1 -- 172.21.15.18:0/2229244395 wait complete. 2024-09-12T02:37:58.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.460+0000 7f7c45800640 1 Processor -- start 2024-09-12T02:37:58.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.460+0000 7f7c45800640 1 -- start start 2024-09-12T02:37:58.563 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.461+0000 7f7c45800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4007de20 0x7f7c4019d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:58.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.461+0000 7f7c45800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4010db60 con 0x7f7c4007de20 2024-09-12T02:37:58.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.461+0000 7f7c3ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4007de20 0x7f7c4019d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:58.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.461+0000 7f7c3ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4007de20 0x7f7c4019d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53532/0 (socket says 172.21.15.18:53532) 2024-09-12T02:37:58.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.461+0000 7f7c3ea00640 1 -- 172.21.15.18:0/1823651668 learned_addr learned my addr 172.21.15.18:0/1823651668 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:37:58.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.461+0000 7f7c3ea00640 1 -- 172.21.15.18:0/1823651668 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4019dcd0 con 0x7f7c4007de20 2024-09-12T02:37:58.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.461+0000 7f7c3ea00640 1 --2- 172.21.15.18:0/1823651668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4007de20 0x7f7c4019d790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7c300097f0 tx=0x7f7c30030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:58.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.462+0000 7f7c37400640 1 -- 172.21.15.18:0/1823651668 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c30037040 con 0x7f7c4007de20 2024-09-12T02:37:58.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.462+0000 7f7c37400640 1 -- 172.21.15.18:0/1823651668 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c30040070 con 0x7f7c4007de20 2024-09-12T02:37:58.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.462+0000 7f7c37400640 1 -- 172.21.15.18:0/1823651668 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c3003a390 con 0x7f7c4007de20 2024-09-12T02:37:58.566 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.462+0000 7f7c45800640 1 -- 172.21.15.18:0/1823651668 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4019df60 con 0x7f7c4007de20 2024-09-12T02:37:58.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.462+0000 7f7c45800640 1 -- 172.21.15.18:0/1823651668 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c401a0c50 con 0x7f7c4007de20 2024-09-12T02:37:58.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.463+0000 7f7c37400640 1 -- 172.21.15.18:0/1823651668 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f7c3003b430 con 0x7f7c4007de20 2024-09-12T02:37:58.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.464+0000 7f7c45800640 1 -- 172.21.15.18:0/1823651668 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4007c300 con 0x7f7c4007de20 2024-09-12T02:37:58.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.464+0000 7f7c37400640 1 --2- 172.21.15.18:0/1823651668 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f7c24038f70 0x7f7c2403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:58.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.464+0000 7f7c37400640 1 -- 172.21.15.18:0/1823651668 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7c3006bb00 con 0x7f7c4007de20 2024-09-12T02:37:58.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.464+0000 7f7c3e000640 1 --2- 172.21.15.18:0/1823651668 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f7c24038f70 0x7f7c2403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:58.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.465+0000 7f7c3e000640 1 --2- 172.21.15.18:0/1823651668 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f7c24038f70 0x7f7c2403b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0098c0 tx=0x7f7c2c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:58.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.469+0000 7f7c37400640 1 -- 172.21.15.18:0/1823651668 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c300313a0 con 0x7f7c4007de20 2024-09-12T02:37:58.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.669+0000 7f7c45800640 1 -- 172.21.15.18:0/1823651668 --> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f7c40104010 con 0x7f7c24038f70 2024-09-12T02:37:58.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.674+0000 7f7c37400640 1 -- 172.21.15.18:0/1823651668 <== mgr.14118 v2:172.21.15.18:6800/3271799053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7c40104010 con 0x7f7c24038f70 2024-09-12T02:37:58.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.676+0000 7f7c45800640 1 -- 172.21.15.18:0/1823651668 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f7c24038f70 msgr2=0x7f7c2403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:58.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.676+0000 7f7c45800640 1 --2- 172.21.15.18:0/1823651668 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f7c24038f70 0x7f7c2403b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0098c0 tx=0x7f7c2c006db0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.676+0000 7f7c45800640 1 -- 172.21.15.18:0/1823651668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4007de20 msgr2=0x7f7c4019d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:58.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.676+0000 7f7c45800640 1 --2- 172.21.15.18:0/1823651668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4007de20 0x7f7c4019d790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7c300097f0 tx=0x7f7c30030d80 comp rx=0 tx=0).stop 2024-09-12T02:37:58.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.677+0000 7f7c45800640 1 -- 172.21.15.18:0/1823651668 shutdown_connections 2024-09-12T02:37:58.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.677+0000 7f7c45800640 1 --2- 172.21.15.18:0/1823651668 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f7c24038f70 0x7f7c2403b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.677+0000 7f7c45800640 1 --2- 172.21.15.18:0/1823651668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4007de20 0x7f7c4019d790 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.677+0000 7f7c45800640 1 -- 172.21.15.18:0/1823651668 >> 172.21.15.18:0/1823651668 conn(0x7f7c40102cc0 msgr2=0x7f7c40103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:58.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.677+0000 7f7c45800640 1 -- 172.21.15.18:0/1823651668 shutdown_connections 2024-09-12T02:37:58.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:57.677+0000 7f7c45800640 1 -- 172.21.15.18:0/1823651668 wait complete. 2024-09-12T02:37:58.810 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:58 smithi018 ceph-mon[30616]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:58.810 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:58 smithi018 ceph-mon[30616]: Saving service mgr spec with placement count:2 2024-09-12T02:37:58.811 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:37:58 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' 2024-09-12T02:38:00.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:00 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' 2024-09-12T02:38:00.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:00 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' 2024-09-12T02:38:00.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:00 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/449624797' entity='client.admin' 2024-09-12T02:38:00.639 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.684+0000 7fcf30200640 1 Processor -- start 2024-09-12T02:38:00.639 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.684+0000 7fcf30200640 1 -- start start 2024-09-12T02:38:00.639 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.685+0000 7fcf30200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf28107540 0x7fcf28107940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:00.640 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.685+0000 7fcf30200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcf28107f10 con 0x7fcf28107540 2024-09-12T02:38:00.640 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.685+0000 7fcf2d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf28107540 0x7fcf28107940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:00.640 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.685+0000 7fcf2d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf28107540 0x7fcf28107940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53546/0 (socket says 172.21.15.18:53546) 2024-09-12T02:38:00.640 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.685+0000 7fcf2d800640 1 -- 172.21.15.18:0/3460650440 learned_addr learned my addr 172.21.15.18:0/3460650440 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:00.640 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.686+0000 7fcf2d800640 1 -- 172.21.15.18:0/3460650440 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf28108740 con 0x7fcf28107540 2024-09-12T02:38:00.640 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.687+0000 7fcf2d800640 1 --2- 172.21.15.18:0/3460650440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf28107540 0x7fcf28107940 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009820 tx=0x7fcf1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85d3b76406692 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:00.640 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.687+0000 7fcf27e00640 1 -- 172.21.15.18:0/3460650440 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf1c037070 con 0x7fcf28107540 2024-09-12T02:38:00.640 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.687+0000 7fcf27e00640 1 -- 172.21.15.18:0/3460650440 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf1c032920 con 0x7fcf28107540 2024-09-12T02:38:00.640 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.687+0000 7fcf27e00640 1 -- 172.21.15.18:0/3460650440 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf1c030810 con 0x7fcf28107540 2024-09-12T02:38:00.640 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.688+0000 7fcf30200640 1 -- 172.21.15.18:0/3460650440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf28107540 msgr2=0x7fcf28107940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:00.640 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.688+0000 7fcf30200640 1 --2- 172.21.15.18:0/3460650440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf28107540 0x7fcf28107940 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009820 tx=0x7fcf1c02a270 comp rx=0 tx=0).stop 2024-09-12T02:38:00.640 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.688+0000 7fcf30200640 1 -- 172.21.15.18:0/3460650440 shutdown_connections 2024-09-12T02:38:00.641 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.688+0000 7fcf30200640 1 --2- 172.21.15.18:0/3460650440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf28107540 0x7fcf28107940 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.641 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.688+0000 7fcf30200640 1 -- 172.21.15.18:0/3460650440 >> 172.21.15.18:0/3460650440 conn(0x7fcf28102d90 msgr2=0x7fcf281051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:00.641 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.688+0000 7fcf30200640 1 -- 172.21.15.18:0/3460650440 shutdown_connections 2024-09-12T02:38:00.641 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.688+0000 7fcf30200640 1 -- 172.21.15.18:0/3460650440 wait complete. 2024-09-12T02:38:00.641 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.689+0000 7fcf30200640 1 Processor -- start 2024-09-12T02:38:00.641 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.689+0000 7fcf30200640 1 -- start start 2024-09-12T02:38:00.641 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.690+0000 7fcf30200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf28107540 0x7fcf2807ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:00.641 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.690+0000 7fcf30200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2810baf0 con 0x7fcf28107540 2024-09-12T02:38:00.641 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.690+0000 7fcf2d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf28107540 0x7fcf2807ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:00.641 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.690+0000 7fcf2d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf28107540 0x7fcf2807ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53556/0 (socket says 172.21.15.18:53556) 2024-09-12T02:38:00.641 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.690+0000 7fcf2d800640 1 -- 172.21.15.18:0/449624797 learned_addr learned my addr 172.21.15.18:0/449624797 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:00.641 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.690+0000 7fcf2d800640 1 -- 172.21.15.18:0/449624797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf2807cf40 con 0x7fcf28107540 2024-09-12T02:38:00.641 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.691+0000 7fcf2d800640 1 --2- 172.21.15.18:0/449624797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf28107540 0x7fcf2807ca00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0097f0 tx=0x7fcf1c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:00.642 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.691+0000 7fcf26000640 1 -- 172.21.15.18:0/449624797 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf1c037040 con 0x7fcf28107540 2024-09-12T02:38:00.642 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.691+0000 7fcf26000640 1 -- 172.21.15.18:0/449624797 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf1c030c40 con 0x7fcf28107540 2024-09-12T02:38:00.642 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.691+0000 7fcf26000640 1 -- 172.21.15.18:0/449624797 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf1c03a5b0 con 0x7fcf28107540 2024-09-12T02:38:00.642 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.691+0000 7fcf30200640 1 -- 172.21.15.18:0/449624797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf2807b130 con 0x7fcf28107540 2024-09-12T02:38:00.642 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.691+0000 7fcf30200640 1 -- 172.21.15.18:0/449624797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf2807b670 con 0x7fcf28107540 2024-09-12T02:38:00.642 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.693+0000 7fcf30200640 1 -- 172.21.15.18:0/449624797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf2810bc70 con 0x7fcf28107540 2024-09-12T02:38:00.642 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.693+0000 7fcf26000640 1 -- 172.21.15.18:0/449624797 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fcf1c03a7a0 con 0x7fcf28107540 2024-09-12T02:38:00.642 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.693+0000 7fcf26000640 1 --2- 172.21.15.18:0/449624797 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fcf10038fc0 0x7fcf1003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:00.642 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.693+0000 7fcf26000640 1 -- 172.21.15.18:0/449624797 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcf1c06c450 con 0x7fcf28107540 2024-09-12T02:38:00.642 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.694+0000 7fcf2ce00640 1 --2- 172.21.15.18:0/449624797 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fcf10038fc0 0x7fcf1003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:00.642 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.695+0000 7fcf2ce00640 1 --2- 172.21.15.18:0/449624797 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fcf10038fc0 0x7fcf1003b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcf140098c0 tx=0x7fcf14006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:00.642 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.700+0000 7fcf26000640 1 -- 172.21.15.18:0/449624797 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcf1c0371e0 con 0x7fcf28107540 2024-09-12T02:38:00.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.897+0000 7fcf30200640 1 -- 172.21.15.18:0/449624797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fcf281079c0 con 0x7fcf28107540 2024-09-12T02:38:00.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.900+0000 7fcf26000640 1 -- 172.21.15.18:0/449624797 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fcf1c06bda0 con 0x7fcf28107540 2024-09-12T02:38:00.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.902+0000 7fcf30200640 1 -- 172.21.15.18:0/449624797 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fcf10038fc0 msgr2=0x7fcf1003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:00.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.902+0000 7fcf30200640 1 --2- 172.21.15.18:0/449624797 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fcf10038fc0 0x7fcf1003b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcf140098c0 tx=0x7fcf14006db0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.902+0000 7fcf30200640 1 -- 172.21.15.18:0/449624797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf28107540 msgr2=0x7fcf2807ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:00.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.902+0000 7fcf30200640 1 --2- 172.21.15.18:0/449624797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf28107540 0x7fcf2807ca00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0097f0 tx=0x7fcf1c0327b0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.903+0000 7fcf30200640 1 -- 172.21.15.18:0/449624797 shutdown_connections 2024-09-12T02:38:00.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.903+0000 7fcf30200640 1 --2- 172.21.15.18:0/449624797 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fcf10038fc0 0x7fcf1003b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.903+0000 7fcf30200640 1 --2- 172.21.15.18:0/449624797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf28107540 0x7fcf2807ca00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.903+0000 7fcf30200640 1 -- 172.21.15.18:0/449624797 >> 172.21.15.18:0/449624797 conn(0x7fcf28102d90 msgr2=0x7fcf281039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:00.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.903+0000 7fcf30200640 1 -- 172.21.15.18:0/449624797 shutdown_connections 2024-09-12T02:38:00.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:37:59.903+0000 7fcf30200640 1 -- 172.21.15.18:0/449624797 wait complete. 2024-09-12T02:38:02.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:02 smithi018 ceph-mon[30616]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:02.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:02 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1025640675' entity='client.admin' 2024-09-12T02:38:02.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:02 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' 2024-09-12T02:38:02.654 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.174+0000 7f7a7b600640 1 Processor -- start 2024-09-12T02:38:02.654 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.174+0000 7f7a7b600640 1 -- start start 2024-09-12T02:38:02.654 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.174+0000 7f7a7b600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a74109810 0x7f7a74109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:02.654 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.174+0000 7f7a7b600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7410a1e0 con 0x7f7a74109810 2024-09-12T02:38:02.654 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.175+0000 7f7a78c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a74109810 0x7f7a74109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:02.654 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.175+0000 7f7a78c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a74109810 0x7f7a74109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53558/0 (socket says 172.21.15.18:53558) 2024-09-12T02:38:02.654 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.175+0000 7f7a78c00640 1 -- 172.21.15.18:0/1102696856 learned_addr learned my addr 172.21.15.18:0/1102696856 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:02.654 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.175+0000 7f7a78c00640 1 -- 172.21.15.18:0/1102696856 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7410a950 con 0x7f7a74109810 2024-09-12T02:38:02.654 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.176+0000 7f7a78c00640 1 --2- 172.21.15.18:0/1102696856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a74109810 0x7f7a74109c10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009820 tx=0x7f7a6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1a3b3161e3341a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:02.654 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.176+0000 7f7a73400640 1 -- 172.21.15.18:0/1102696856 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a68037070 con 0x7f7a74109810 2024-09-12T02:38:02.654 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.176+0000 7f7a73400640 1 -- 172.21.15.18:0/1102696856 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a68032920 con 0x7f7a74109810 2024-09-12T02:38:02.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.176+0000 7f7a73400640 1 -- 172.21.15.18:0/1102696856 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a68030810 con 0x7f7a74109810 2024-09-12T02:38:02.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.177+0000 7f7a7b600640 1 -- 172.21.15.18:0/1102696856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a74109810 msgr2=0x7f7a74109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:02.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.177+0000 7f7a7b600640 1 --2- 172.21.15.18:0/1102696856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a74109810 0x7f7a74109c10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009820 tx=0x7f7a6802a270 comp rx=0 tx=0).stop 2024-09-12T02:38:02.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.177+0000 7f7a7b600640 1 -- 172.21.15.18:0/1102696856 shutdown_connections 2024-09-12T02:38:02.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.177+0000 7f7a7b600640 1 --2- 172.21.15.18:0/1102696856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a74109810 0x7f7a74109c10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:02.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.177+0000 7f7a7b600640 1 -- 172.21.15.18:0/1102696856 >> 172.21.15.18:0/1102696856 conn(0x7f7a7407ccf0 msgr2=0x7f7a7407d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:02.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.178+0000 7f7a7b600640 1 -- 172.21.15.18:0/1102696856 shutdown_connections 2024-09-12T02:38:02.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.178+0000 7f7a7b600640 1 -- 172.21.15.18:0/1102696856 wait complete. 2024-09-12T02:38:02.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.179+0000 7f7a7b600640 1 Processor -- start 2024-09-12T02:38:02.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.179+0000 7f7a7b600640 1 -- start start 2024-09-12T02:38:02.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.179+0000 7f7a7b600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a74109810 0x7f7a7419d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:02.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.179+0000 7f7a7b600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7410dd00 con 0x7f7a74109810 2024-09-12T02:38:02.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.179+0000 7f7a78c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a74109810 0x7f7a7419d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:02.655 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.179+0000 7f7a78c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a74109810 0x7f7a7419d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53570/0 (socket says 172.21.15.18:53570) 2024-09-12T02:38:02.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.179+0000 7f7a78c00640 1 -- 172.21.15.18:0/1025640675 learned_addr learned my addr 172.21.15.18:0/1025640675 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:02.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.180+0000 7f7a78c00640 1 -- 172.21.15.18:0/1025640675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7419dcf0 con 0x7f7a74109810 2024-09-12T02:38:02.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.180+0000 7f7a78c00640 1 --2- 172.21.15.18:0/1025640675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a74109810 0x7f7a7419d7b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7a680097f0 tx=0x7f7a680327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:02.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.180+0000 7f7a71600640 1 -- 172.21.15.18:0/1025640675 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a68037040 con 0x7f7a74109810 2024-09-12T02:38:02.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.180+0000 7f7a71600640 1 -- 172.21.15.18:0/1025640675 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a68030c40 con 0x7f7a74109810 2024-09-12T02:38:02.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.180+0000 7f7a71600640 1 -- 172.21.15.18:0/1025640675 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a6803a5d0 con 0x7f7a74109810 2024-09-12T02:38:02.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.180+0000 7f7a7b600640 1 -- 172.21.15.18:0/1025640675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a7419df80 con 0x7f7a74109810 2024-09-12T02:38:02.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.180+0000 7f7a7b600640 1 -- 172.21.15.18:0/1025640675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a741a0c70 con 0x7f7a74109810 2024-09-12T02:38:02.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.182+0000 7f7a7b600640 1 -- 172.21.15.18:0/1025640675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a74109c90 con 0x7f7a74109810 2024-09-12T02:38:02.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.182+0000 7f7a71600640 1 -- 172.21.15.18:0/1025640675 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f7a6803b3f0 con 0x7f7a74109810 2024-09-12T02:38:02.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.182+0000 7f7a71600640 1 --2- 172.21.15.18:0/1025640675 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f7a5c038fc0 0x7f7a5c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:02.656 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.182+0000 7f7a71600640 1 -- 172.21.15.18:0/1025640675 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7a6806c4f0 con 0x7f7a74109810 2024-09-12T02:38:02.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.183+0000 7f7a73e00640 1 --2- 172.21.15.18:0/1025640675 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f7a5c038fc0 0x7f7a5c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:02.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.183+0000 7f7a73e00640 1 --2- 172.21.15.18:0/1025640675 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f7a5c038fc0 0x7f7a5c03b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7a600098c0 tx=0x7f7a60006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:02.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.187+0000 7f7a71600640 1 -- 172.21.15.18:0/1025640675 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a6806be40 con 0x7f7a74109810 2024-09-12T02:38:02.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.393+0000 7f7a7b600640 1 -- 172.21.15.18:0/1025640675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f7a741a0e40 con 0x7f7a74109810 2024-09-12T02:38:02.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.396+0000 7f7a71600640 1 -- 172.21.15.18:0/1025640675 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f7a6803b6e0 con 0x7f7a74109810 2024-09-12T02:38:02.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.398+0000 7f7a7b600640 1 -- 172.21.15.18:0/1025640675 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f7a5c038fc0 msgr2=0x7f7a5c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:02.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.398+0000 7f7a7b600640 1 --2- 172.21.15.18:0/1025640675 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f7a5c038fc0 0x7f7a5c03b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7a600098c0 tx=0x7f7a60006db0 comp rx=0 tx=0).stop 2024-09-12T02:38:02.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.398+0000 7f7a7b600640 1 -- 172.21.15.18:0/1025640675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a74109810 msgr2=0x7f7a7419d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:02.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.398+0000 7f7a7b600640 1 --2- 172.21.15.18:0/1025640675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a74109810 0x7f7a7419d7b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7a680097f0 tx=0x7f7a680327b0 comp rx=0 tx=0).stop 2024-09-12T02:38:02.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.398+0000 7f7a7b600640 1 -- 172.21.15.18:0/1025640675 shutdown_connections 2024-09-12T02:38:02.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.398+0000 7f7a7b600640 1 --2- 172.21.15.18:0/1025640675 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f7a5c038fc0 0x7f7a5c03b480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:02.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.398+0000 7f7a7b600640 1 --2- 172.21.15.18:0/1025640675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a74109810 0x7f7a7419d7b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:02.657 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.398+0000 7f7a7b600640 1 -- 172.21.15.18:0/1025640675 >> 172.21.15.18:0/1025640675 conn(0x7f7a7407ccf0 msgr2=0x7f7a74107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:02.658 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.399+0000 7f7a7b600640 1 -- 172.21.15.18:0/1025640675 shutdown_connections 2024-09-12T02:38:02.658 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:01.399+0000 7f7a7b600640 1 -- 172.21.15.18:0/1025640675 wait complete. 2024-09-12T02:38:02.658 INFO:teuthology.orchestra.run.smithi018.stdout:Enabling the dashboard module... 2024-09-12T02:38:04.651 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:04 smithi018 ceph-mon[30616]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:04.652 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:04 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/380526413' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-12T02:38:04.652 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:04 smithi018 ceph-mon[30616]: from='mgr.14118 172.21.15.18:0/2113467221' entity='mgr.x' 2024-09-12T02:38:04.652 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:04 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: ignoring --setuser ceph since I am not root 2024-09-12T02:38:04.652 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:04 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: ignoring --setgroup ceph since I am not root 2024-09-12T02:38:04.652 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:04 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:04.651+0000 7fdcfc434040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:38:04.912 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:04 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:04.722+0000 7fdcfc434040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:38:04.913 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:04 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:04.912+0000 7fdcfc434040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:38:05.177 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:04 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:04.995+0000 7fdcfc434040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:38:05.177 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:05 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:05.176+0000 7fdcfc434040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:38:05.556 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:05 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:05.348+0000 7fdcfc434040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:38:05.557 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:05 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/380526413' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-12T02:38:05.557 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:05 smithi018 ceph-mon[30616]: mgrmap e9: x(active, since 23s) 2024-09-12T02:38:05.850 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:05 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:05.730+0000 7fdcfc434040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:38:05.851 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:05 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:05.805+0000 7fdcfc434040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:38:05.925 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.244+0000 7f92e2200640 1 Processor -- start 2024-09-12T02:38:05.925 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.244+0000 7f92e2200640 1 -- start start 2024-09-12T02:38:05.925 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.244+0000 7f92e2200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92dc07cd30 0x7f92dc07b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.925 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.244+0000 7f92e2200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f92dc07b760 con 0x7f92dc07cd30 2024-09-12T02:38:05.926 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.244+0000 7f92e0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92dc07cd30 0x7f92dc07b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.926 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.245+0000 7f92e0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92dc07cd30 0x7f92dc07b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53582/0 (socket says 172.21.15.18:53582) 2024-09-12T02:38:05.926 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.245+0000 7f92e0e00640 1 -- 172.21.15.18:0/2709400006 learned_addr learned my addr 172.21.15.18:0/2709400006 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:05.926 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.245+0000 7f92e0e00640 1 -- 172.21.15.18:0/2709400006 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92dc07b8e0 con 0x7f92dc07cd30 2024-09-12T02:38:05.926 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.246+0000 7f92e0e00640 1 --2- 172.21.15.18:0/2709400006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92dc07cd30 0x7f92dc07b190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009820 tx=0x7f92d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6e7f3ed70e6614 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.926 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.247+0000 7f92db400640 1 -- 172.21.15.18:0/2709400006 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d0037070 con 0x7f92dc07cd30 2024-09-12T02:38:05.926 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.247+0000 7f92db400640 1 -- 172.21.15.18:0/2709400006 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92d0032920 con 0x7f92dc07cd30 2024-09-12T02:38:05.926 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.247+0000 7f92db400640 1 -- 172.21.15.18:0/2709400006 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d0030810 con 0x7f92dc07cd30 2024-09-12T02:38:05.926 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.247+0000 7f92e2200640 1 -- 172.21.15.18:0/2709400006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92dc07cd30 msgr2=0x7f92dc07b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.926 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.247+0000 7f92e2200640 1 --2- 172.21.15.18:0/2709400006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92dc07cd30 0x7f92dc07b190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009820 tx=0x7f92d002a270 comp rx=0 tx=0).stop 2024-09-12T02:38:05.926 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.248+0000 7f92e2200640 1 -- 172.21.15.18:0/2709400006 shutdown_connections 2024-09-12T02:38:05.926 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.248+0000 7f92e2200640 1 --2- 172.21.15.18:0/2709400006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92dc07cd30 0x7f92dc07b190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.927 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.248+0000 7f92e2200640 1 -- 172.21.15.18:0/2709400006 >> 172.21.15.18:0/2709400006 conn(0x7f92dc102b90 msgr2=0x7f92dc104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:05.927 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.248+0000 7f92e2200640 1 -- 172.21.15.18:0/2709400006 shutdown_connections 2024-09-12T02:38:05.927 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.248+0000 7f92e2200640 1 -- 172.21.15.18:0/2709400006 wait complete. 2024-09-12T02:38:05.927 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.249+0000 7f92e2200640 1 Processor -- start 2024-09-12T02:38:05.927 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.249+0000 7f92e2200640 1 -- start start 2024-09-12T02:38:05.927 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.249+0000 7f92e2200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92dc07cd30 0x7f92dc19d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.927 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.249+0000 7f92e2200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f92dc10da70 con 0x7f92dc07cd30 2024-09-12T02:38:05.927 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.249+0000 7f92e0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92dc07cd30 0x7f92dc19d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.927 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.250+0000 7f92e0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92dc07cd30 0x7f92dc19d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53588/0 (socket says 172.21.15.18:53588) 2024-09-12T02:38:05.927 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.250+0000 7f92e0e00640 1 -- 172.21.15.18:0/380526413 learned_addr learned my addr 172.21.15.18:0/380526413 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:05.927 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.250+0000 7f92e0e00640 1 -- 172.21.15.18:0/380526413 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92dc19daf0 con 0x7f92dc07cd30 2024-09-12T02:38:05.927 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.250+0000 7f92e0e00640 1 --2- 172.21.15.18:0/380526413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92dc07cd30 0x7f92dc19d5b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f92d00097f0 tx=0x7f92d00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.927 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.250+0000 7f92d9600640 1 -- 172.21.15.18:0/380526413 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d0037040 con 0x7f92dc07cd30 2024-09-12T02:38:05.927 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.251+0000 7f92e2200640 1 -- 172.21.15.18:0/380526413 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92dc19dd80 con 0x7f92dc07cd30 2024-09-12T02:38:05.928 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.251+0000 7f92d9600640 1 -- 172.21.15.18:0/380526413 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92d0030cc0 con 0x7f92dc07cd30 2024-09-12T02:38:05.928 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.251+0000 7f92d9600640 1 -- 172.21.15.18:0/380526413 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d003a6b0 con 0x7f92dc07cd30 2024-09-12T02:38:05.928 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.251+0000 7f92e2200640 1 -- 172.21.15.18:0/380526413 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92dc1a0a70 con 0x7f92dc07cd30 2024-09-12T02:38:05.928 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.252+0000 7f92d9600640 1 -- 172.21.15.18:0/380526413 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f92d003baf0 con 0x7f92dc07cd30 2024-09-12T02:38:05.928 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.252+0000 7f92e2200640 1 -- 172.21.15.18:0/380526413 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92dc07b210 con 0x7f92dc07cd30 2024-09-12T02:38:05.928 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.252+0000 7f92d9600640 1 --2- 172.21.15.18:0/380526413 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f92c4038f70 0x7f92c403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.928 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.253+0000 7f92d9600640 1 -- 172.21.15.18:0/380526413 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f92d006c500 con 0x7f92dc07cd30 2024-09-12T02:38:05.928 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.253+0000 7f92dbe00640 1 --2- 172.21.15.18:0/380526413 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f92c4038f70 0x7f92c403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.928 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.254+0000 7f92dbe00640 1 --2- 172.21.15.18:0/380526413 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f92c4038f70 0x7f92c403b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f92c80098c0 tx=0x7f92c8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.928 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.258+0000 7f92d9600640 1 -- 172.21.15.18:0/380526413 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f92d00371e0 con 0x7f92dc07cd30 2024-09-12T02:38:05.928 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:03.505+0000 7f92e2200640 1 -- 172.21.15.18:0/380526413 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f92dc1a0c40 con 0x7f92dc07cd30 2024-09-12T02:38:05.928 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:04.400+0000 7f92d9600640 1 -- 172.21.15.18:0/380526413 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f92d003b4a0 con 0x7f92dc07cd30 2024-09-12T02:38:05.928 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:04.401+0000 7f92d9600640 1 -- 172.21.15.18:0/380526413 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f92d003a8a0 con 0x7f92dc07cd30 2024-09-12T02:38:05.929 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:04.403+0000 7f92e2200640 1 -- 172.21.15.18:0/380526413 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f92c4038f70 msgr2=0x7f92c403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.929 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:04.403+0000 7f92e2200640 1 --2- 172.21.15.18:0/380526413 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f92c4038f70 0x7f92c403b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f92c80098c0 tx=0x7f92c8006db0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.929 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:04.403+0000 7f92e2200640 1 -- 172.21.15.18:0/380526413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92dc07cd30 msgr2=0x7f92dc19d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.929 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:04.403+0000 7f92e2200640 1 --2- 172.21.15.18:0/380526413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92dc07cd30 0x7f92dc19d5b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f92d00097f0 tx=0x7f92d00327b0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.929 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:04.403+0000 7f92e2200640 1 -- 172.21.15.18:0/380526413 shutdown_connections 2024-09-12T02:38:05.929 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:04.403+0000 7f92e2200640 1 --2- 172.21.15.18:0/380526413 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7f92c4038f70 0x7f92c403b430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.929 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:04.404+0000 7f92e2200640 1 --2- 172.21.15.18:0/380526413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92dc07cd30 0x7f92dc19d5b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.929 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:04.404+0000 7f92e2200640 1 -- 172.21.15.18:0/380526413 >> 172.21.15.18:0/380526413 conn(0x7f92dc102b90 msgr2=0x7f92dc1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:05.929 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:04.404+0000 7f92e2200640 1 -- 172.21.15.18:0/380526413 shutdown_connections 2024-09-12T02:38:05.929 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:04.404+0000 7f92e2200640 1 -- 172.21.15.18:0/380526413 wait complete. 2024-09-12T02:38:06.215 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:06 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:06.040+0000 7fdcfc434040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:38:07.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:06 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1651822096' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T02:38:07.496 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:07 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:07.203+0000 7fdcfc434040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:38:07.496 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:07 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:07.286+0000 7fdcfc434040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:38:07.502 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:38:07.508 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-12T02:38:07.508 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T02:38:07.508 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T02:38:07.508 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T02:38:07.508 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:38:07.508 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.487+0000 7fb860a00640 1 Processor -- start 2024-09-12T02:38:07.509 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.488+0000 7fb860a00640 1 -- start start 2024-09-12T02:38:07.509 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.488+0000 7fb860a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb85c1095a0 0x7fb85c1099a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:07.509 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.488+0000 7fb860a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c109f70 con 0x7fb85c1095a0 2024-09-12T02:38:07.509 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.488+0000 7fb85a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb85c1095a0 0x7fb85c1099a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:07.509 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.488+0000 7fb85a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb85c1095a0 0x7fb85c1099a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53900/0 (socket says 172.21.15.18:53900) 2024-09-12T02:38:07.509 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.488+0000 7fb85a800640 1 -- 172.21.15.18:0/3277095624 learned_addr learned my addr 172.21.15.18:0/3277095624 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:07.509 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.489+0000 7fb85a800640 1 -- 172.21.15.18:0/3277095624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c10a7a0 con 0x7fb85c1095a0 2024-09-12T02:38:07.509 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.490+0000 7fb85a800640 1 --2- 172.21.15.18:0/3277095624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb85c1095a0 0x7fb85c1099a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009820 tx=0x7fb84c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7059ba94e46be98f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:07.509 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.490+0000 7fb859400640 1 -- 172.21.15.18:0/3277095624 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c037070 con 0x7fb85c1095a0 2024-09-12T02:38:07.509 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.490+0000 7fb859400640 1 -- 172.21.15.18:0/3277095624 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb84c032920 con 0x7fb85c1095a0 2024-09-12T02:38:07.509 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.490+0000 7fb859400640 1 -- 172.21.15.18:0/3277095624 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c030810 con 0x7fb85c1095a0 2024-09-12T02:38:07.509 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.491+0000 7fb860a00640 1 -- 172.21.15.18:0/3277095624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb85c1095a0 msgr2=0x7fb85c1099a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:07.509 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.491+0000 7fb860a00640 1 --2- 172.21.15.18:0/3277095624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb85c1095a0 0x7fb85c1099a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009820 tx=0x7fb84c02a270 comp rx=0 tx=0).stop 2024-09-12T02:38:07.510 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.491+0000 7fb860a00640 1 -- 172.21.15.18:0/3277095624 shutdown_connections 2024-09-12T02:38:07.510 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.491+0000 7fb860a00640 1 --2- 172.21.15.18:0/3277095624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb85c1095a0 0x7fb85c1099a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:07.510 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.491+0000 7fb860a00640 1 -- 172.21.15.18:0/3277095624 >> 172.21.15.18:0/3277095624 conn(0x7fb85c07cbc0 msgr2=0x7fb85c107360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:07.510 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.491+0000 7fb860a00640 1 -- 172.21.15.18:0/3277095624 shutdown_connections 2024-09-12T02:38:07.510 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.491+0000 7fb860a00640 1 -- 172.21.15.18:0/3277095624 wait complete. 2024-09-12T02:38:07.510 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.492+0000 7fb860a00640 1 Processor -- start 2024-09-12T02:38:07.510 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.492+0000 7fb860a00640 1 -- start start 2024-09-12T02:38:07.510 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.493+0000 7fb860a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb85c1095a0 0x7fb85c19d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:07.510 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.493+0000 7fb860a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c10db50 con 0x7fb85c1095a0 2024-09-12T02:38:07.510 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.493+0000 7fb85a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb85c1095a0 0x7fb85c19d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:07.510 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.493+0000 7fb85a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb85c1095a0 0x7fb85c19d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53906/0 (socket says 172.21.15.18:53906) 2024-09-12T02:38:07.510 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.493+0000 7fb85a800640 1 -- 172.21.15.18:0/1651822096 learned_addr learned my addr 172.21.15.18:0/1651822096 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:07.510 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.493+0000 7fb85a800640 1 -- 172.21.15.18:0/1651822096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c19dae0 con 0x7fb85c1095a0 2024-09-12T02:38:07.510 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.494+0000 7fb85a800640 1 --2- 172.21.15.18:0/1651822096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb85c1095a0 0x7fb85c19d5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0097f0 tx=0x7fb84c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:07.510 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.494+0000 7fb853400640 1 -- 172.21.15.18:0/1651822096 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c037040 con 0x7fb85c1095a0 2024-09-12T02:38:07.511 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.494+0000 7fb853400640 1 -- 172.21.15.18:0/1651822096 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb84c030cc0 con 0x7fb85c1095a0 2024-09-12T02:38:07.511 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.494+0000 7fb860a00640 1 -- 172.21.15.18:0/1651822096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb85c19dd70 con 0x7fb85c1095a0 2024-09-12T02:38:07.511 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.494+0000 7fb853400640 1 -- 172.21.15.18:0/1651822096 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c03a640 con 0x7fb85c1095a0 2024-09-12T02:38:07.511 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.494+0000 7fb860a00640 1 -- 172.21.15.18:0/1651822096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb85c1a0a60 con 0x7fb85c1095a0 2024-09-12T02:38:07.511 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.495+0000 7fb860a00640 1 -- 172.21.15.18:0/1651822096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb85c10dcd0 con 0x7fb85c1095a0 2024-09-12T02:38:07.511 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.495+0000 7fb853400640 1 -- 172.21.15.18:0/1651822096 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fb84c03b3f0 con 0x7fb85c1095a0 2024-09-12T02:38:07.511 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.496+0000 7fb853400640 1 --2- 172.21.15.18:0/1651822096 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fb840038fc0 0x7fb84003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:07.511 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.496+0000 7fb853400640 1 -- 172.21.15.18:0/1651822096 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb84c06c5f0 con 0x7fb85c1095a0 2024-09-12T02:38:07.511 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.496+0000 7fb859e00640 1 -- 172.21.15.18:0/1651822096 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fb840038fc0 msgr2=0x7fb84003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/3271799053 2024-09-12T02:38:07.511 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.496+0000 7fb859e00640 1 --2- 172.21.15.18:0/1651822096 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fb840038fc0 0x7fb84003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:07.511 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.501+0000 7fb853400640 1 -- 172.21.15.18:0/1651822096 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb84c0328c0 con 0x7fb85c1095a0 2024-09-12T02:38:07.511 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.697+0000 7fb859e00640 1 -- 172.21.15.18:0/1651822096 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fb840038fc0 msgr2=0x7fb84003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/3271799053 2024-09-12T02:38:07.511 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.697+0000 7fb859e00640 1 --2- 172.21.15.18:0/1651822096 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fb840038fc0 0x7fb84003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:38:07.511 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.737+0000 7fb860a00640 1 -- 172.21.15.18:0/1651822096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fb85c1a0c30 con 0x7fb85c1095a0 2024-09-12T02:38:07.512 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.737+0000 7fb853400640 1 -- 172.21.15.18:0/1651822096 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fb84c042dc0 con 0x7fb85c1095a0 2024-09-12T02:38:07.512 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.740+0000 7fb860a00640 1 -- 172.21.15.18:0/1651822096 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fb840038fc0 msgr2=0x7fb84003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:38:07.512 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.740+0000 7fb860a00640 1 --2- 172.21.15.18:0/1651822096 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fb840038fc0 0x7fb84003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:07.512 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.740+0000 7fb860a00640 1 -- 172.21.15.18:0/1651822096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb85c1095a0 msgr2=0x7fb85c19d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:07.512 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.740+0000 7fb860a00640 1 --2- 172.21.15.18:0/1651822096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb85c1095a0 0x7fb85c19d5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0097f0 tx=0x7fb84c0327b0 comp rx=0 tx=0).stop 2024-09-12T02:38:07.512 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.740+0000 7fb860a00640 1 -- 172.21.15.18:0/1651822096 shutdown_connections 2024-09-12T02:38:07.512 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.740+0000 7fb860a00640 1 --2- 172.21.15.18:0/1651822096 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7fb840038fc0 0x7fb84003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:07.512 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.740+0000 7fb860a00640 1 --2- 172.21.15.18:0/1651822096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb85c1095a0 0x7fb85c19d5a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:07.512 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.740+0000 7fb860a00640 1 -- 172.21.15.18:0/1651822096 >> 172.21.15.18:0/1651822096 conn(0x7fb85c07cbc0 msgr2=0x7fb85c106b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:07.512 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.741+0000 7fb860a00640 1 -- 172.21.15.18:0/1651822096 shutdown_connections 2024-09-12T02:38:07.512 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:06.741+0000 7fb860a00640 1 -- 172.21.15.18:0/1651822096 wait complete. 2024-09-12T02:38:07.512 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for the mgr to restart... 2024-09-12T02:38:07.512 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr epoch 9... 2024-09-12T02:38:08.350 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:08 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:08.254+0000 7fdcfc434040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:38:08.660 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:08 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:08.396+0000 7fdcfc434040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:38:08.660 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:08 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:08.566+0000 7fdcfc434040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:38:08.661 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:08 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:08.641+0000 7fdcfc434040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:38:08.979 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:08 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:08.819+0000 7fdcfc434040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:38:08.979 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:08 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:08.904+0000 7fdcfc434040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:38:08.979 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:08 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:08.978+0000 7fdcfc434040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:38:09.247 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:09 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:09.166+0000 7fdcfc434040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:38:09.247 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:09 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:09.246+0000 7fdcfc434040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:38:09.503 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:09 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:09.328+0000 7fdcfc434040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:38:09.503 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:09 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:09.428+0000 7fdcfc434040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:38:09.503 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:09 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:09.502+0000 7fdcfc434040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:38:09.850 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:09 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:09.575+0000 7fdcfc434040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:38:10.800 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:10 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:10.523+0000 7fdcfc434040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:38:10.800 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:10 smithi018 ceph-mon[30616]: Active manager daemon x restarted 2024-09-12T02:38:10.800 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:10 smithi018 ceph-mon[30616]: Activating manager daemon x 2024-09-12T02:38:10.800 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:10 smithi018 ceph-mon[30616]: osdmap e3: 0 total, 0 up, 0 in 2024-09-12T02:38:10.801 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:10 smithi018 ceph-mon[30616]: mgrmap e10: x(active, starting, since 0.00398168s) 2024-09-12T02:38:10.801 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:38:10.801 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:38:10.801 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:38:10.801 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:38:10.801 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:38:10.801 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:10 smithi018 ceph-mon[30616]: Manager daemon x is now available 2024-09-12T02:38:10.801 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:38:11.785 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:38:11.785 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:38:11.785 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:11 smithi018 ceph-mon[30616]: mgrmap e11: x(active, since 1.00874s) 2024-09-12T02:38:12.601 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:12.265+0000 7fdc52a00640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:02:38:12] ENGINE Error in HTTPServer.serve 2024-09-12T02:38:12.601 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: Traceback (most recent call last): 2024-09-12T02:38:12.601 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:38:12.601 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: self._connections.run(self.expiration_interval) 2024-09-12T02:38:12.601 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:38:12.601 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: self._run(expiration_interval) 2024-09-12T02:38:12.602 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:38:12.602 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:38:12.602 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:38:12.602 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:38:12.602 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:38:12.602 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: s = self.context.wrap_socket( 2024-09-12T02:38:12.602 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:38:12.602 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: return self.sslsocket_class._create( 2024-09-12T02:38:12.602 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:38:12.602 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: self.do_handshake() 2024-09-12T02:38:12.602 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:38:12.602 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: self._sslobj.do_handshake() 2024-09-12T02:38:12.603 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:38:12.603 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:38:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:38:12.771 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:38:12.771 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-12T02:38:12.771 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T02:38:12.771 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:38:12.771 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.049+0000 7ff8e8400640 1 Processor -- start 2024-09-12T02:38:12.771 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.049+0000 7ff8e8400640 1 -- start start 2024-09-12T02:38:12.771 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.050+0000 7ff8e8400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e01097d0 0x7ff8e0109bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:12.772 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.050+0000 7ff8e8400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e010a1a0 con 0x7ff8e01097d0 2024-09-12T02:38:12.772 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.050+0000 7ff8e5a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e01097d0 0x7ff8e0109bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:12.772 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.050+0000 7ff8e5a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e01097d0 0x7ff8e0109bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53914/0 (socket says 172.21.15.18:53914) 2024-09-12T02:38:12.772 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.050+0000 7ff8e5a00640 1 -- 172.21.15.18:0/2282858267 learned_addr learned my addr 172.21.15.18:0/2282858267 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:12.772 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.051+0000 7ff8e5a00640 1 -- 172.21.15.18:0/2282858267 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e010a970 con 0x7ff8e01097d0 2024-09-12T02:38:12.772 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.052+0000 7ff8e5a00640 1 --2- 172.21.15.18:0/2282858267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e01097d0 0x7ff8e0109bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009820 tx=0x7ff8d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b063bc80064cbf1f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:12.772 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.052+0000 7ff8dfe00640 1 -- 172.21.15.18:0/2282858267 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d4037070 con 0x7ff8e01097d0 2024-09-12T02:38:12.772 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.052+0000 7ff8dfe00640 1 -- 172.21.15.18:0/2282858267 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8d4032920 con 0x7ff8e01097d0 2024-09-12T02:38:12.772 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.052+0000 7ff8dfe00640 1 -- 172.21.15.18:0/2282858267 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d4030810 con 0x7ff8e01097d0 2024-09-12T02:38:12.772 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.053+0000 7ff8e8400640 1 -- 172.21.15.18:0/2282858267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e01097d0 msgr2=0x7ff8e0109bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:12.772 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.053+0000 7ff8e8400640 1 --2- 172.21.15.18:0/2282858267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e01097d0 0x7ff8e0109bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009820 tx=0x7ff8d402a270 comp rx=0 tx=0).stop 2024-09-12T02:38:12.772 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.053+0000 7ff8e8400640 1 -- 172.21.15.18:0/2282858267 shutdown_connections 2024-09-12T02:38:12.772 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.053+0000 7ff8e8400640 1 --2- 172.21.15.18:0/2282858267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e01097d0 0x7ff8e0109bd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:12.773 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.053+0000 7ff8e8400640 1 -- 172.21.15.18:0/2282858267 >> 172.21.15.18:0/2282858267 conn(0x7ff8e007cd20 msgr2=0x7ff8e007d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:12.773 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.053+0000 7ff8e8400640 1 -- 172.21.15.18:0/2282858267 shutdown_connections 2024-09-12T02:38:12.773 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.053+0000 7ff8e8400640 1 -- 172.21.15.18:0/2282858267 wait complete. 2024-09-12T02:38:12.773 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.054+0000 7ff8e8400640 1 Processor -- start 2024-09-12T02:38:12.773 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.054+0000 7ff8e8400640 1 -- start start 2024-09-12T02:38:12.773 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.055+0000 7ff8e8400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e01097d0 0x7ff8e019d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:12.773 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.055+0000 7ff8e8400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e010dd20 con 0x7ff8e01097d0 2024-09-12T02:38:12.773 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.055+0000 7ff8e5a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e01097d0 0x7ff8e019d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:12.773 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.055+0000 7ff8e5a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e01097d0 0x7ff8e019d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53930/0 (socket says 172.21.15.18:53930) 2024-09-12T02:38:12.773 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.055+0000 7ff8e5a00640 1 -- 172.21.15.18:0/2207721342 learned_addr learned my addr 172.21.15.18:0/2207721342 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:12.773 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.055+0000 7ff8e5a00640 1 -- 172.21.15.18:0/2207721342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e019dd10 con 0x7ff8e01097d0 2024-09-12T02:38:12.773 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.056+0000 7ff8e5a00640 1 --2- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e01097d0 0x7ff8e019d7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4030560 tx=0x7ff8d4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:12.773 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.056+0000 7ff8de000640 1 -- 172.21.15.18:0/2207721342 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d4037040 con 0x7ff8e01097d0 2024-09-12T02:38:12.774 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.056+0000 7ff8de000640 1 -- 172.21.15.18:0/2207721342 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8d4040070 con 0x7ff8e01097d0 2024-09-12T02:38:12.774 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.056+0000 7ff8de000640 1 -- 172.21.15.18:0/2207721342 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d403a740 con 0x7ff8e01097d0 2024-09-12T02:38:12.774 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.056+0000 7ff8e8400640 1 -- 172.21.15.18:0/2207721342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e019dfa0 con 0x7ff8e01097d0 2024-09-12T02:38:12.774 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.056+0000 7ff8e8400640 1 -- 172.21.15.18:0/2207721342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e01a0c90 con 0x7ff8e01097d0 2024-09-12T02:38:12.774 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.058+0000 7ff8de000640 1 -- 172.21.15.18:0/2207721342 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7ff8d403bb90 con 0x7ff8e01097d0 2024-09-12T02:38:12.774 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.058+0000 7ff8de000640 1 --2- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff8c8039020 0x7ff8c803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:12.774 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.058+0000 7ff8de000640 1 -- 172.21.15.18:0/2207721342 --> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff8c803bbf0 con 0x7ff8c8039020 2024-09-12T02:38:12.774 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.058+0000 7ff8de000640 1 -- 172.21.15.18:0/2207721342 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff8d406c640 con 0x7ff8e01097d0 2024-09-12T02:38:12.774 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.058+0000 7ff8e5000640 1 -- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff8c8039020 msgr2=0x7ff8c803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/3271799053 2024-09-12T02:38:12.774 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.058+0000 7ff8e5000640 1 --2- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff8c8039020 0x7ff8c803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:12.774 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.259+0000 7ff8e5000640 1 -- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff8c8039020 msgr2=0x7ff8c803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/3271799053 2024-09-12T02:38:12.774 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.259+0000 7ff8e5000640 1 --2- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff8c8039020 0x7ff8c803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:38:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.660+0000 7ff8e5000640 1 -- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff8c8039020 msgr2=0x7ff8c803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/3271799053 2024-09-12T02:38:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:08.660+0000 7ff8e5000640 1 --2- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff8c8039020 0x7ff8c803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:38:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:09.461+0000 7ff8e5000640 1 -- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff8c8039020 msgr2=0x7ff8c803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/3271799053 2024-09-12T02:38:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:09.461+0000 7ff8e5000640 1 --2- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff8c8039020 0x7ff8c803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:38:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:10.528+0000 7ff8de000640 1 -- 172.21.15.18:0/2207721342 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7ff8d406b030 con 0x7ff8e01097d0 2024-09-12T02:38:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:10.528+0000 7ff8de000640 1 -- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff8c8039020 msgr2=0x7ff8c803b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:38:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:10.528+0000 7ff8de000640 1 --2- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff8c8039020 0x7ff8c803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.531+0000 7ff8de000640 1 -- 172.21.15.18:0/2207721342 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7ff8d403b420 con 0x7ff8e01097d0 2024-09-12T02:38:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.531+0000 7ff8de000640 1 --2- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff8c803cae0 0x7ff8c803eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.531+0000 7ff8de000640 1 -- 172.21.15.18:0/2207721342 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff8d403de70 con 0x7ff8c803cae0 2024-09-12T02:38:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.532+0000 7ff8e5000640 1 --2- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff8c803cae0 0x7ff8c803eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.533+0000 7ff8e5000640 1 --2- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff8c803cae0 0x7ff8c803eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc003980 tx=0x7ff8cc0092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.534+0000 7ff8de000640 1 -- 172.21.15.18:0/2207721342 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7ff8d403de70 con 0x7ff8c803cae0 2024-09-12T02:38:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.542+0000 7ff8e8400640 1 -- 172.21.15.18:0/2207721342 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ff8e0109bd0 con 0x7ff8c803cae0 2024-09-12T02:38:12.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.542+0000 7ff8de000640 1 -- 172.21.15.18:0/2207721342 <== mgr.14150 v2:172.21.15.18:6800/494888664 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7ff8e0109bd0 con 0x7ff8c803cae0 2024-09-12T02:38:12.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.543+0000 7ff8e8400640 1 -- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff8c803cae0 msgr2=0x7ff8c803eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:12.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.543+0000 7ff8e8400640 1 --2- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff8c803cae0 0x7ff8c803eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc003980 tx=0x7ff8cc0092b0 comp rx=0 tx=0).stop 2024-09-12T02:38:12.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.543+0000 7ff8e8400640 1 -- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e01097d0 msgr2=0x7ff8e019d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:12.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.543+0000 7ff8e8400640 1 --2- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e01097d0 0x7ff8e019d7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4030560 tx=0x7ff8d4032670 comp rx=0 tx=0).stop 2024-09-12T02:38:12.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.543+0000 7ff8e8400640 1 -- 172.21.15.18:0/2207721342 shutdown_connections 2024-09-12T02:38:12.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.543+0000 7ff8e8400640 1 --2- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff8c803cae0 0x7ff8c803eed0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:12.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.543+0000 7ff8e8400640 1 --2- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:6800/3271799053,v1:172.21.15.18:6801/3271799053] conn(0x7ff8c8039020 0x7ff8c803b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:12.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.543+0000 7ff8e8400640 1 --2- 172.21.15.18:0/2207721342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e01097d0 0x7ff8e019d7d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:12.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.543+0000 7ff8e8400640 1 -- 172.21.15.18:0/2207721342 >> 172.21.15.18:0/2207721342 conn(0x7ff8e007cd20 msgr2=0x7ff8e01074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:12.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.543+0000 7ff8e8400640 1 -- 172.21.15.18:0/2207721342 shutdown_connections 2024-09-12T02:38:12.776 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:11.543+0000 7ff8e8400640 1 -- 172.21.15.18:0/2207721342 wait complete. 2024-09-12T02:38:12.776 INFO:teuthology.orchestra.run.smithi018.stdout:mgr epoch 9 is available 2024-09-12T02:38:12.776 INFO:teuthology.orchestra.run.smithi018.stdout:Generating a dashboard self-signed certificate... 2024-09-12T02:38:13.653 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:13 smithi018 ceph-mon[30616]: [12/Sep/2024:02:38:12] ENGINE Bus STARTING 2024-09-12T02:38:13.653 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:13 smithi018 ceph-mon[30616]: [12/Sep/2024:02:38:12] ENGINE Serving on http://172.21.15.18:8765 2024-09-12T02:38:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:13 smithi018 ceph-mon[30616]: [12/Sep/2024:02:38:12] ENGINE Serving on https://172.21.15.18:7150 2024-09-12T02:38:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:13 smithi018 ceph-mon[30616]: [12/Sep/2024:02:38:12] ENGINE Bus STARTED 2024-09-12T02:38:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:13 smithi018 ceph-mon[30616]: [12/Sep/2024:02:38:12] ENGINE Error in HTTPServer.serve 2024-09-12T02:38:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout: Traceback (most recent call last): 2024-09-12T02:38:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:38:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:38:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:38:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._run(expiration_interval) 2024-09-12T02:38:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:38:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:38:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:38:13.654 INFO:journalctl@ceph.mon.a.smithi018.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:38:13.655 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:38:13.655 INFO:journalctl@ceph.mon.a.smithi018.stdout: s = self.context.wrap_socket( 2024-09-12T02:38:13.655 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:38:13.655 INFO:journalctl@ceph.mon.a.smithi018.stdout: return self.sslsocket_class._create( 2024-09-12T02:38:13.655 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:38:13.655 INFO:journalctl@ceph.mon.a.smithi018.stdout: self.do_handshake() 2024-09-12T02:38:13.655 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:38:13.655 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._sslobj.do_handshake() 2024-09-12T02:38:13.655 INFO:journalctl@ceph.mon.a.smithi018.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:38:13.655 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:14.423 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-12T02:38:14.423 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.326+0000 7f06f7c00640 1 Processor -- start 2024-09-12T02:38:14.423 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.326+0000 7f06f7c00640 1 -- start start 2024-09-12T02:38:14.423 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.326+0000 7f06f7c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f0109810 0x7f06f0109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:14.424 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.326+0000 7f06f7c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f06f010a1e0 con 0x7f06f0109810 2024-09-12T02:38:14.424 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.327+0000 7f06f5200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f0109810 0x7f06f0109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:14.424 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.327+0000 7f06f5200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f0109810 0x7f06f0109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54002/0 (socket says 172.21.15.18:54002) 2024-09-12T02:38:14.424 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.327+0000 7f06f5200640 1 -- 172.21.15.18:0/3815632443 learned_addr learned my addr 172.21.15.18:0/3815632443 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:14.424 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.327+0000 7f06f5200640 1 -- 172.21.15.18:0/3815632443 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f010a950 con 0x7f06f0109810 2024-09-12T02:38:14.424 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.328+0000 7f06f5200640 1 --2- 172.21.15.18:0/3815632443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f0109810 0x7f06f0109c10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009820 tx=0x7f06e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf85892931ccb424 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:14.424 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.329+0000 7f06ef400640 1 -- 172.21.15.18:0/3815632443 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e4037070 con 0x7f06f0109810 2024-09-12T02:38:14.424 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.329+0000 7f06ef400640 1 -- 172.21.15.18:0/3815632443 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06e4032920 con 0x7f06f0109810 2024-09-12T02:38:14.424 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.329+0000 7f06ef400640 1 -- 172.21.15.18:0/3815632443 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e4030810 con 0x7f06f0109810 2024-09-12T02:38:14.424 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.329+0000 7f06f7c00640 1 -- 172.21.15.18:0/3815632443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f0109810 msgr2=0x7f06f0109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:14.424 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.329+0000 7f06f7c00640 1 --2- 172.21.15.18:0/3815632443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f0109810 0x7f06f0109c10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009820 tx=0x7f06e402a270 comp rx=0 tx=0).stop 2024-09-12T02:38:14.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.329+0000 7f06f7c00640 1 -- 172.21.15.18:0/3815632443 shutdown_connections 2024-09-12T02:38:14.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.329+0000 7f06f7c00640 1 --2- 172.21.15.18:0/3815632443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f0109810 0x7f06f0109c10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.329+0000 7f06f7c00640 1 -- 172.21.15.18:0/3815632443 >> 172.21.15.18:0/3815632443 conn(0x7f06f007ccf0 msgr2=0x7f06f007d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:14.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.330+0000 7f06f7c00640 1 -- 172.21.15.18:0/3815632443 shutdown_connections 2024-09-12T02:38:14.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.330+0000 7f06f7c00640 1 -- 172.21.15.18:0/3815632443 wait complete. 2024-09-12T02:38:14.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.330+0000 7f06f7c00640 1 Processor -- start 2024-09-12T02:38:14.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.331+0000 7f06f7c00640 1 -- start start 2024-09-12T02:38:14.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.331+0000 7f06f7c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f0109810 0x7f06f019d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:14.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.331+0000 7f06f7c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f06f010dd00 con 0x7f06f0109810 2024-09-12T02:38:14.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.331+0000 7f06f5200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f0109810 0x7f06f019d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:14.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.331+0000 7f06f5200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f0109810 0x7f06f019d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54014/0 (socket says 172.21.15.18:54014) 2024-09-12T02:38:14.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.331+0000 7f06f5200640 1 -- 172.21.15.18:0/2060781391 learned_addr learned my addr 172.21.15.18:0/2060781391 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:14.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.331+0000 7f06f5200640 1 -- 172.21.15.18:0/2060781391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f019dcf0 con 0x7f06f0109810 2024-09-12T02:38:14.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.332+0000 7f06f5200640 1 --2- 172.21.15.18:0/2060781391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f0109810 0x7f06f019d7b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f06e40097f0 tx=0x7f06e40327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:14.426 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.332+0000 7f06ed600640 1 -- 172.21.15.18:0/2060781391 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e4037040 con 0x7f06f0109810 2024-09-12T02:38:14.426 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.332+0000 7f06ed600640 1 -- 172.21.15.18:0/2060781391 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06e4030c40 con 0x7f06f0109810 2024-09-12T02:38:14.426 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.332+0000 7f06f7c00640 1 -- 172.21.15.18:0/2060781391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f019df80 con 0x7f06f0109810 2024-09-12T02:38:14.426 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.332+0000 7f06ed600640 1 -- 172.21.15.18:0/2060781391 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e403a5d0 con 0x7f06f0109810 2024-09-12T02:38:14.426 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.332+0000 7f06f7c00640 1 -- 172.21.15.18:0/2060781391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f01a0c70 con 0x7f06f0109810 2024-09-12T02:38:14.426 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.333+0000 7f06ed600640 1 -- 172.21.15.18:0/2060781391 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f06e403b3f0 con 0x7f06f0109810 2024-09-12T02:38:14.426 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.333+0000 7f06f7c00640 1 -- 172.21.15.18:0/2060781391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f0109c90 con 0x7f06f0109810 2024-09-12T02:38:14.426 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.334+0000 7f06ed600640 1 --2- 172.21.15.18:0/2060781391 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f06d8038eb0 0x7f06d803b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:14.426 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.334+0000 7f06ed600640 1 -- 172.21.15.18:0/2060781391 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f06e406c470 con 0x7f06f0109810 2024-09-12T02:38:14.426 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.334+0000 7f06efe00640 1 --2- 172.21.15.18:0/2060781391 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f06d8038eb0 0x7f06d803b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:14.426 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.335+0000 7f06efe00640 1 --2- 172.21.15.18:0/2060781391 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f06d8038eb0 0x7f06d803b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0098c0 tx=0x7f06dc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:14.426 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.339+0000 7f06ed600640 1 -- 172.21.15.18:0/2060781391 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f06e40313a0 con 0x7f06f0109810 2024-09-12T02:38:14.426 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.488+0000 7f06ed600640 1 -- 172.21.15.18:0/2060781391 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f06e4041d10 con 0x7f06f0109810 2024-09-12T02:38:14.427 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.535+0000 7f06f7c00640 1 -- 172.21.15.18:0/2060781391 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f06f0107c70 con 0x7f06d8038eb0 2024-09-12T02:38:14.427 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.653+0000 7f06ed600640 1 -- 172.21.15.18:0/2060781391 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f06f0107c70 con 0x7f06d8038eb0 2024-09-12T02:38:14.427 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.655+0000 7f06f7c00640 1 -- 172.21.15.18:0/2060781391 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f06d8038eb0 msgr2=0x7f06d803b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:14.427 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.655+0000 7f06f7c00640 1 --2- 172.21.15.18:0/2060781391 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f06d8038eb0 0x7f06d803b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0098c0 tx=0x7f06dc006db0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.427 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.655+0000 7f06f7c00640 1 -- 172.21.15.18:0/2060781391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f0109810 msgr2=0x7f06f019d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:14.427 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.655+0000 7f06f7c00640 1 --2- 172.21.15.18:0/2060781391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f0109810 0x7f06f019d7b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f06e40097f0 tx=0x7f06e40327b0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.427 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.655+0000 7f06f7c00640 1 -- 172.21.15.18:0/2060781391 shutdown_connections 2024-09-12T02:38:14.427 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.655+0000 7f06f7c00640 1 --2- 172.21.15.18:0/2060781391 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f06d8038eb0 0x7f06d803b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.427 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.655+0000 7f06f7c00640 1 --2- 172.21.15.18:0/2060781391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06f0109810 0x7f06f019d7b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.427 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.655+0000 7f06f7c00640 1 -- 172.21.15.18:0/2060781391 >> 172.21.15.18:0/2060781391 conn(0x7f06f007ccf0 msgr2=0x7f06f0107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:14.427 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.656+0000 7f06f7c00640 1 -- 172.21.15.18:0/2060781391 shutdown_connections 2024-09-12T02:38:14.427 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:13.656+0000 7f06f7c00640 1 -- 172.21.15.18:0/2060781391 wait complete. 2024-09-12T02:38:14.427 INFO:teuthology.orchestra.run.smithi018.stdout:Creating initial admin user... 2024-09-12T02:38:14.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:14 smithi018 ceph-mon[30616]: mgrmap e12: x(active, since 2s) 2024-09-12T02:38:14.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:14 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:14.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:14 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:14.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:14 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:15.821 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:15 smithi018 ceph-mon[30616]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:16.435 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$6/Vj2CSiOJ86GEQJEikdZ.mhGsYyfeeVbEXMw8DeL1H4eIm0mkSA6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726108695, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-12T02:38:16.435 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.208+0000 7f7e91200640 1 Processor -- start 2024-09-12T02:38:16.435 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.208+0000 7f7e91200640 1 -- start start 2024-09-12T02:38:16.435 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.208+0000 7f7e91200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e8c1095a0 0x7f7e8c1099a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:16.436 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.208+0000 7f7e91200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c109f70 con 0x7f7e8c1095a0 2024-09-12T02:38:16.436 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.208+0000 7f7e8b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e8c1095a0 0x7f7e8c1099a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:16.436 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.209+0000 7f7e8b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e8c1095a0 0x7f7e8c1099a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58714/0 (socket says 172.21.15.18:58714) 2024-09-12T02:38:16.436 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.209+0000 7f7e8b400640 1 -- 172.21.15.18:0/1810047446 learned_addr learned my addr 172.21.15.18:0/1810047446 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:16.436 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.209+0000 7f7e8b400640 1 -- 172.21.15.18:0/1810047446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c10a7a0 con 0x7f7e8c1095a0 2024-09-12T02:38:16.436 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.210+0000 7f7e8b400640 1 --2- 172.21.15.18:0/1810047446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e8c1095a0 0x7f7e8c1099a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009e80 tx=0x7f7e7c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60d56cd734907d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:16.436 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.210+0000 7f7e8a000640 1 -- 172.21.15.18:0/1810047446 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c036070 con 0x7f7e8c1095a0 2024-09-12T02:38:16.436 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.210+0000 7f7e8a000640 1 -- 172.21.15.18:0/1810047446 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e7c0318e0 con 0x7f7e8c1095a0 2024-09-12T02:38:16.436 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.210+0000 7f7e8a000640 1 -- 172.21.15.18:0/1810047446 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c007a00 con 0x7f7e8c1095a0 2024-09-12T02:38:16.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.211+0000 7f7e91200640 1 -- 172.21.15.18:0/1810047446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e8c1095a0 msgr2=0x7f7e8c1099a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:16.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.211+0000 7f7e91200640 1 --2- 172.21.15.18:0/1810047446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e8c1095a0 0x7f7e8c1099a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009e80 tx=0x7f7e7c02a7a0 comp rx=0 tx=0).stop 2024-09-12T02:38:16.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.211+0000 7f7e91200640 1 -- 172.21.15.18:0/1810047446 shutdown_connections 2024-09-12T02:38:16.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.211+0000 7f7e91200640 1 --2- 172.21.15.18:0/1810047446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e8c1095a0 0x7f7e8c1099a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:16.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.211+0000 7f7e91200640 1 -- 172.21.15.18:0/1810047446 >> 172.21.15.18:0/1810047446 conn(0x7f7e8c07cbc0 msgr2=0x7f7e8c107360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:16.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.211+0000 7f7e91200640 1 -- 172.21.15.18:0/1810047446 shutdown_connections 2024-09-12T02:38:16.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.211+0000 7f7e91200640 1 -- 172.21.15.18:0/1810047446 wait complete. 2024-09-12T02:38:16.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.212+0000 7f7e91200640 1 Processor -- start 2024-09-12T02:38:16.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.212+0000 7f7e91200640 1 -- start start 2024-09-12T02:38:16.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.212+0000 7f7e91200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e8c1095a0 0x7f7e8c19d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:16.437 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.212+0000 7f7e91200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c10db50 con 0x7f7e8c1095a0 2024-09-12T02:38:16.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.213+0000 7f7e8b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e8c1095a0 0x7f7e8c19d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:16.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.213+0000 7f7e8b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e8c1095a0 0x7f7e8c19d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58716/0 (socket says 172.21.15.18:58716) 2024-09-12T02:38:16.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.213+0000 7f7e8b400640 1 -- 172.21.15.18:0/2912655791 learned_addr learned my addr 172.21.15.18:0/2912655791 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:16.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.213+0000 7f7e8b400640 1 -- 172.21.15.18:0/2912655791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c19db00 con 0x7f7e8c1095a0 2024-09-12T02:38:16.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.213+0000 7f7e8b400640 1 --2- 172.21.15.18:0/2912655791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e8c1095a0 0x7f7e8c19d5c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c02acc0 tx=0x7f7e7c031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:16.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.214+0000 7f7e83e00640 1 -- 172.21.15.18:0/2912655791 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c036050 con 0x7f7e8c1095a0 2024-09-12T02:38:16.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.214+0000 7f7e83e00640 1 -- 172.21.15.18:0/2912655791 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e7c037040 con 0x7f7e8c1095a0 2024-09-12T02:38:16.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.214+0000 7f7e83e00640 1 -- 172.21.15.18:0/2912655791 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c03b890 con 0x7f7e8c1095a0 2024-09-12T02:38:16.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.214+0000 7f7e91200640 1 -- 172.21.15.18:0/2912655791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8c19dd90 con 0x7f7e8c1095a0 2024-09-12T02:38:16.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.214+0000 7f7e91200640 1 -- 172.21.15.18:0/2912655791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8c1a0a80 con 0x7f7e8c1095a0 2024-09-12T02:38:16.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.215+0000 7f7e83e00640 1 -- 172.21.15.18:0/2912655791 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f7e7c044020 con 0x7f7e8c1095a0 2024-09-12T02:38:16.438 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.215+0000 7f7e91200640 1 -- 172.21.15.18:0/2912655791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e8c10dcd0 con 0x7f7e8c1095a0 2024-09-12T02:38:16.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.215+0000 7f7e83e00640 1 --2- 172.21.15.18:0/2912655791 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7e70039020 0x7f7e7003b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:16.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.215+0000 7f7e83e00640 1 -- 172.21.15.18:0/2912655791 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7e7c042020 con 0x7f7e8c1095a0 2024-09-12T02:38:16.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.216+0000 7f7e8aa00640 1 --2- 172.21.15.18:0/2912655791 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7e70039020 0x7f7e7003b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:16.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.216+0000 7f7e8aa00640 1 --2- 172.21.15.18:0/2912655791 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7e70039020 0x7f7e7003b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7e780098c0 tx=0x7f7e78006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:16.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.220+0000 7f7e83e00640 1 -- 172.21.15.18:0/2912655791 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7e7c04b020 con 0x7f7e8c1095a0 2024-09-12T02:38:16.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.422+0000 7f7e91200640 1 -- 172.21.15.18:0/2912655791 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f7e8c1a0d10 con 0x7f7e70039020 2024-09-12T02:38:16.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.675+0000 7f7e83e00640 1 -- 172.21.15.18:0/2912655791 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f7e8c1a0d10 con 0x7f7e70039020 2024-09-12T02:38:16.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.678+0000 7f7e91200640 1 -- 172.21.15.18:0/2912655791 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7e70039020 msgr2=0x7f7e7003b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:16.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.678+0000 7f7e91200640 1 --2- 172.21.15.18:0/2912655791 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7e70039020 0x7f7e7003b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7e780098c0 tx=0x7f7e78006db0 comp rx=0 tx=0).stop 2024-09-12T02:38:16.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.678+0000 7f7e91200640 1 -- 172.21.15.18:0/2912655791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e8c1095a0 msgr2=0x7f7e8c19d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:16.439 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.678+0000 7f7e91200640 1 --2- 172.21.15.18:0/2912655791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e8c1095a0 0x7f7e8c19d5c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c02acc0 tx=0x7f7e7c031cc0 comp rx=0 tx=0).stop 2024-09-12T02:38:16.440 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.678+0000 7f7e91200640 1 -- 172.21.15.18:0/2912655791 shutdown_connections 2024-09-12T02:38:16.440 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.678+0000 7f7e91200640 1 --2- 172.21.15.18:0/2912655791 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7e70039020 0x7f7e7003b4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:16.440 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.678+0000 7f7e91200640 1 --2- 172.21.15.18:0/2912655791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e8c1095a0 0x7f7e8c19d5c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:16.440 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.678+0000 7f7e91200640 1 -- 172.21.15.18:0/2912655791 >> 172.21.15.18:0/2912655791 conn(0x7f7e8c07cbc0 msgr2=0x7f7e8c106a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:16.440 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.678+0000 7f7e91200640 1 -- 172.21.15.18:0/2912655791 shutdown_connections 2024-09-12T02:38:16.440 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:15.678+0000 7f7e91200640 1 -- 172.21.15.18:0/2912655791 wait complete. 2024-09-12T02:38:16.440 INFO:teuthology.orchestra.run.smithi018.stdout:Fetching dashboard port number... 2024-09-12T02:38:16.776 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:16 smithi018 ceph-mon[30616]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:16.776 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:18.334 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 8443 2024-09-12T02:38:18.334 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.368+0000 7f3a42000640 1 Processor -- start 2024-09-12T02:38:18.334 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.368+0000 7f3a42000640 1 -- start start 2024-09-12T02:38:18.334 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.368+0000 7f3a42000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3c1095a0 0x7f3a3c1099a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:18.334 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.368+0000 7f3a42000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c109f70 con 0x7f3a3c1095a0 2024-09-12T02:38:18.334 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.369+0000 7f3a40c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3c1095a0 0x7f3a3c1099a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:18.334 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.369+0000 7f3a40c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3c1095a0 0x7f3a3c1099a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58728/0 (socket says 172.21.15.18:58728) 2024-09-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.369+0000 7f3a40c00640 1 -- 172.21.15.18:0/1209723182 learned_addr learned my addr 172.21.15.18:0/1209723182 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.369+0000 7f3a40c00640 1 -- 172.21.15.18:0/1209723182 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3c10a7a0 con 0x7f3a3c1095a0 2024-09-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.370+0000 7f3a40c00640 1 --2- 172.21.15.18:0/1209723182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3c1095a0 0x7f3a3c1099a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009820 tx=0x7f3a3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8469acd7da009028 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.370+0000 7f3a3b400640 1 -- 172.21.15.18:0/1209723182 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a30037070 con 0x7f3a3c1095a0 2024-09-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.370+0000 7f3a3b400640 1 -- 172.21.15.18:0/1209723182 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a30032920 con 0x7f3a3c1095a0 2024-09-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.370+0000 7f3a3b400640 1 -- 172.21.15.18:0/1209723182 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a30030810 con 0x7f3a3c1095a0 2024-09-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.371+0000 7f3a42000640 1 -- 172.21.15.18:0/1209723182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3c1095a0 msgr2=0x7f3a3c1099a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.371+0000 7f3a42000640 1 --2- 172.21.15.18:0/1209723182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3c1095a0 0x7f3a3c1099a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009820 tx=0x7f3a3002a270 comp rx=0 tx=0).stop 2024-09-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.371+0000 7f3a42000640 1 -- 172.21.15.18:0/1209723182 shutdown_connections 2024-09-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.371+0000 7f3a42000640 1 --2- 172.21.15.18:0/1209723182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3c1095a0 0x7f3a3c1099a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.371+0000 7f3a42000640 1 -- 172.21.15.18:0/1209723182 >> 172.21.15.18:0/1209723182 conn(0x7f3a3c07cbc0 msgr2=0x7f3a3c107360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.371+0000 7f3a42000640 1 -- 172.21.15.18:0/1209723182 shutdown_connections 2024-09-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.371+0000 7f3a42000640 1 -- 172.21.15.18:0/1209723182 wait complete. 2024-09-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.372+0000 7f3a42000640 1 Processor -- start 2024-09-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.372+0000 7f3a42000640 1 -- start start 2024-09-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.372+0000 7f3a42000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3c1095a0 0x7f3a3c19d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.372+0000 7f3a42000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c10db50 con 0x7f3a3c1095a0 2024-09-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.373+0000 7f3a40c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3c1095a0 0x7f3a3c19d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.373+0000 7f3a40c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3c1095a0 0x7f3a3c19d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58740/0 (socket says 172.21.15.18:58740) 2024-09-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.373+0000 7f3a40c00640 1 -- 172.21.15.18:0/3244837860 learned_addr learned my addr 172.21.15.18:0/3244837860 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.373+0000 7f3a40c00640 1 -- 172.21.15.18:0/3244837860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3c19dae0 con 0x7f3a3c1095a0 2024-09-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.373+0000 7f3a40c00640 1 --2- 172.21.15.18:0/3244837860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3c1095a0 0x7f3a3c19d5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a300097f0 tx=0x7f3a300327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.374+0000 7f3a39600640 1 -- 172.21.15.18:0/3244837860 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a30037040 con 0x7f3a3c1095a0 2024-09-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.374+0000 7f3a39600640 1 -- 172.21.15.18:0/3244837860 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a30030cc0 con 0x7f3a3c1095a0 2024-09-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.374+0000 7f3a39600640 1 -- 172.21.15.18:0/3244837860 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a3003a640 con 0x7f3a3c1095a0 2024-09-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.374+0000 7f3a42000640 1 -- 172.21.15.18:0/3244837860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a3c19dd70 con 0x7f3a3c1095a0 2024-09-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.374+0000 7f3a42000640 1 -- 172.21.15.18:0/3244837860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a3c1a0a60 con 0x7f3a3c1095a0 2024-09-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.375+0000 7f3a42000640 1 -- 172.21.15.18:0/3244837860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a3c10dcd0 con 0x7f3a3c1095a0 2024-09-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.375+0000 7f3a39600640 1 -- 172.21.15.18:0/3244837860 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f3a3003b3f0 con 0x7f3a3c1095a0 2024-09-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.376+0000 7f3a39600640 1 --2- 172.21.15.18:0/3244837860 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3a24039020 0x7f3a2403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.376+0000 7f3a39600640 1 -- 172.21.15.18:0/3244837860 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3a3006c6a0 con 0x7f3a3c1095a0 2024-09-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.376+0000 7f3a3be00640 1 --2- 172.21.15.18:0/3244837860 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3a24039020 0x7f3a2403b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.377+0000 7f3a3be00640 1 --2- 172.21.15.18:0/3244837860 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3a24039020 0x7f3a2403b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3a280098c0 tx=0x7f3a28006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.381+0000 7f3a39600640 1 -- 172.21.15.18:0/3244837860 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3a300328c0 con 0x7f3a3c1095a0 2024-09-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.491+0000 7f3a39600640 1 -- 172.21.15.18:0/3244837860 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3a3003a8f0 con 0x7f3a3c1095a0 2024-09-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.565+0000 7f3a42000640 1 -- 172.21.15.18:0/3244837860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f3a3c1a0c30 con 0x7f3a3c1095a0 2024-09-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.566+0000 7f3a39600640 1 -- 172.21.15.18:0/3244837860 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f3a30048e20 con 0x7f3a3c1095a0 2024-09-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.568+0000 7f3a42000640 1 -- 172.21.15.18:0/3244837860 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3a24039020 msgr2=0x7f3a2403b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.568+0000 7f3a42000640 1 --2- 172.21.15.18:0/3244837860 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3a24039020 0x7f3a2403b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3a280098c0 tx=0x7f3a28006db0 comp rx=0 tx=0).stop 2024-09-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.568+0000 7f3a42000640 1 -- 172.21.15.18:0/3244837860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3c1095a0 msgr2=0x7f3a3c19d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.568+0000 7f3a42000640 1 --2- 172.21.15.18:0/3244837860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3c1095a0 0x7f3a3c19d5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a300097f0 tx=0x7f3a300327b0 comp rx=0 tx=0).stop 2024-09-12T02:38:18.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.568+0000 7f3a42000640 1 -- 172.21.15.18:0/3244837860 shutdown_connections 2024-09-12T02:38:18.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.568+0000 7f3a42000640 1 --2- 172.21.15.18:0/3244837860 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3a24039020 0x7f3a2403b4e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:18.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.568+0000 7f3a42000640 1 --2- 172.21.15.18:0/3244837860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3c1095a0 0x7f3a3c19d5a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:18.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.568+0000 7f3a42000640 1 -- 172.21.15.18:0/3244837860 >> 172.21.15.18:0/3244837860 conn(0x7f3a3c07cbc0 msgr2=0x7f3a3c106b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:18.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.568+0000 7f3a42000640 1 -- 172.21.15.18:0/3244837860 shutdown_connections 2024-09-12T02:38:18.338 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:17.568+0000 7f3a42000640 1 -- 172.21.15.18:0/3244837860 wait complete. 2024-09-12T02:38:18.350 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:38:18.351 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-09-12T02:38:18.364 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:38:18.364 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-12T02:38:18.365 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-09-12T02:38:18.365 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-12T02:38:18.367 INFO:teuthology.orchestra.run.smithi018.stdout:Ceph Dashboard is now available at: 2024-09-12T02:38:18.367 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:38:18.367 INFO:teuthology.orchestra.run.smithi018.stdout: URL: https://smithi018.front.sepia.ceph.com:8443/ 2024-09-12T02:38:18.367 INFO:teuthology.orchestra.run.smithi018.stdout: User: admin 2024-09-12T02:38:18.367 INFO:teuthology.orchestra.run.smithi018.stdout: Password: tez5kkf5cq 2024-09-12T02:38:18.368 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:38:18.368 INFO:teuthology.orchestra.run.smithi018.stdout:Saving cluster configuration to /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config directory 2024-09-12T02:38:18.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:18 smithi018 ceph-mon[30616]: mgrmap e13: x(active, since 6s) 2024-09-12T02:38:18.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:18 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3244837860' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-12T02:38:19.917 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.879+0000 7f40f7200640 1 Processor -- start 2024-09-12T02:38:19.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.879+0000 7f40f7200640 1 -- start start 2024-09-12T02:38:19.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.879+0000 7f40f7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40f81073a0 0x7f40f81077a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:19.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.879+0000 7f40f7200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f40f8107d70 con 0x7f40f81073a0 2024-09-12T02:38:19.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.879+0000 7f40f5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40f81073a0 0x7f40f81077a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:19.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.879+0000 7f40f5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40f81073a0 0x7f40f81077a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58754/0 (socket says 172.21.15.18:58754) 2024-09-12T02:38:19.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.879+0000 7f40f5e00640 1 -- 172.21.15.18:0/2086505752 learned_addr learned my addr 172.21.15.18:0/2086505752 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:19.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.880+0000 7f40f5e00640 1 -- 172.21.15.18:0/2086505752 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f81085a0 con 0x7f40f81073a0 2024-09-12T02:38:19.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.881+0000 7f40f5e00640 1 --2- 172.21.15.18:0/2086505752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40f81073a0 0x7f40f81077a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009820 tx=0x7f40e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53edf12f05342146 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:19.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.881+0000 7f40f5400640 1 -- 172.21.15.18:0/2086505752 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e8037070 con 0x7f40f81073a0 2024-09-12T02:38:19.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.881+0000 7f40f5400640 1 -- 172.21.15.18:0/2086505752 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40e8032920 con 0x7f40f81073a0 2024-09-12T02:38:19.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.881+0000 7f40f5400640 1 -- 172.21.15.18:0/2086505752 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e8030810 con 0x7f40f81073a0 2024-09-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.882+0000 7f40f7200640 1 -- 172.21.15.18:0/2086505752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40f81073a0 msgr2=0x7f40f81077a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.882+0000 7f40f7200640 1 --2- 172.21.15.18:0/2086505752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40f81073a0 0x7f40f81077a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009820 tx=0x7f40e802a270 comp rx=0 tx=0).stop 2024-09-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.882+0000 7f40f7200640 1 -- 172.21.15.18:0/2086505752 shutdown_connections 2024-09-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.882+0000 7f40f7200640 1 --2- 172.21.15.18:0/2086505752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40f81073a0 0x7f40f81077a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.882+0000 7f40f7200640 1 -- 172.21.15.18:0/2086505752 >> 172.21.15.18:0/2086505752 conn(0x7f40f8102b90 msgr2=0x7f40f8104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.882+0000 7f40f7200640 1 -- 172.21.15.18:0/2086505752 shutdown_connections 2024-09-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.882+0000 7f40f7200640 1 -- 172.21.15.18:0/2086505752 wait complete. 2024-09-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.883+0000 7f40f7200640 1 Processor -- start 2024-09-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.883+0000 7f40f7200640 1 -- start start 2024-09-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.883+0000 7f40f7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40f81073a0 0x7f40f819b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.883+0000 7f40f7200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f40f810b950 con 0x7f40f81073a0 2024-09-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.883+0000 7f40f5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40f81073a0 0x7f40f819b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:19.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.884+0000 7f40f5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40f81073a0 0x7f40f819b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58770/0 (socket says 172.21.15.18:58770) 2024-09-12T02:38:19.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.884+0000 7f40f5e00640 1 -- 172.21.15.18:0/3056461044 learned_addr learned my addr 172.21.15.18:0/3056461044 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:19.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.884+0000 7f40f5e00640 1 -- 172.21.15.18:0/3056461044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f819b900 con 0x7f40f81073a0 2024-09-12T02:38:19.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.884+0000 7f40f5e00640 1 --2- 172.21.15.18:0/3056461044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40f81073a0 0x7f40f819b3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f40e80097f0 tx=0x7f40e80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:19.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.884+0000 7f40eea00640 1 -- 172.21.15.18:0/3056461044 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e8037040 con 0x7f40f81073a0 2024-09-12T02:38:19.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.884+0000 7f40eea00640 1 -- 172.21.15.18:0/3056461044 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40e8030cc0 con 0x7f40f81073a0 2024-09-12T02:38:19.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.884+0000 7f40f7200640 1 -- 172.21.15.18:0/3056461044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f819bb90 con 0x7f40f81073a0 2024-09-12T02:38:19.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.884+0000 7f40eea00640 1 -- 172.21.15.18:0/3056461044 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e803a640 con 0x7f40f81073a0 2024-09-12T02:38:19.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.885+0000 7f40f7200640 1 -- 172.21.15.18:0/3056461044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f819e880 con 0x7f40f81073a0 2024-09-12T02:38:19.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.886+0000 7f40eea00640 1 -- 172.21.15.18:0/3056461044 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f40e803a8f0 con 0x7f40f81073a0 2024-09-12T02:38:19.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.886+0000 7f40f7200640 1 -- 172.21.15.18:0/3056461044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f810bad0 con 0x7f40f81073a0 2024-09-12T02:38:19.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.886+0000 7f40eea00640 1 --2- 172.21.15.18:0/3056461044 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40dc0390c0 0x7f40dc03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.886+0000 7f40eea00640 1 -- 172.21.15.18:0/3056461044 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f40e806c7d0 con 0x7f40f81073a0 2024-09-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.886+0000 7f40efe00640 1 --2- 172.21.15.18:0/3056461044 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40dc0390c0 0x7f40dc03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.887+0000 7f40efe00640 1 --2- 172.21.15.18:0/3056461044 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40dc0390c0 0x7f40dc03b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f40e00098c0 tx=0x7f40e0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:18.891+0000 7f40eea00640 1 -- 172.21.15.18:0/3056461044 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f40e80328c0 con 0x7f40f81073a0 2024-09-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:19.167+0000 7f40f7200640 1 -- 172.21.15.18:0/3056461044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f40f819ea50 con 0x7f40f81073a0 2024-09-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:19.170+0000 7f40eea00640 1 -- 172.21.15.18:0/3056461044 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f40e8031c30 con 0x7f40f81073a0 2024-09-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:19.173+0000 7f40f7200640 1 -- 172.21.15.18:0/3056461044 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40dc0390c0 msgr2=0x7f40dc03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:19.173+0000 7f40f7200640 1 --2- 172.21.15.18:0/3056461044 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40dc0390c0 0x7f40dc03b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f40e00098c0 tx=0x7f40e0006db0 comp rx=0 tx=0).stop 2024-09-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:19.173+0000 7f40f7200640 1 -- 172.21.15.18:0/3056461044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40f81073a0 msgr2=0x7f40f819b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:19.173+0000 7f40f7200640 1 --2- 172.21.15.18:0/3056461044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40f81073a0 0x7f40f819b3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f40e80097f0 tx=0x7f40e80327b0 comp rx=0 tx=0).stop 2024-09-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:19.173+0000 7f40f7200640 1 -- 172.21.15.18:0/3056461044 shutdown_connections 2024-09-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:19.173+0000 7f40f7200640 1 --2- 172.21.15.18:0/3056461044 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40dc0390c0 0x7f40dc03b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:19.173+0000 7f40f7200640 1 --2- 172.21.15.18:0/3056461044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40f81073a0 0x7f40f819b3c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:19.173+0000 7f40f7200640 1 -- 172.21.15.18:0/3056461044 >> 172.21.15.18:0/3056461044 conn(0x7f40f8102b90 msgr2=0x7f40f8103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:19.173+0000 7f40f7200640 1 -- 172.21.15.18:0/3056461044 shutdown_connections 2024-09-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-12T02:38:19.173+0000 7f40f7200640 1 -- 172.21.15.18:0/3056461044 wait complete. 2024-09-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi018.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi018.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi018.stdout:Or, if you are only running a single cluster on this host: 2024-09-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi018.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi018.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:38:19.923 INFO:teuthology.orchestra.run.smithi018.stdout: ceph telemetry on 2024-09-12T02:38:19.923 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:38:19.923 INFO:teuthology.orchestra.run.smithi018.stdout:For more information see: 2024-09-12T02:38:19.923 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:38:19.923 INFO:teuthology.orchestra.run.smithi018.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-12T02:38:19.923 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:38:19.923 INFO:teuthology.orchestra.run.smithi018.stdout:Bootstrap complete. 2024-09-12T02:38:19.975 INFO:tasks.cephadm:Fetching config... 2024-09-12T02:38:19.975 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:38:19.975 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-12T02:38:20.013 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-12T02:38:20.013 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:38:20.013 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-12T02:38:20.093 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-12T02:38:20.094 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:38:20.094 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-12T02:38:20.192 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-12T02:38:20.193 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:38:20.193 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-12T02:38:20.268 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-12T02:38:20.268 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCK6Af9cfeLfnfdr/7GeAGS9Cjx/QgBLiOEFea6DtfjjqzipX0RM6mymE75FQauCh2JEaTftP8p1OBeaHiPpgZxR4EgtrBydbbmpAamkEOML5APqa67h+baX3KPSD4roqegYP12JHtxmhCUKg1X1QcoqBHEN+M5J/SZy8/QQj+JZu1fz4HR5izkApvcdb4z1YjGh9obzeeVjJFpP3e/yXcYHhPTll2QFdyBJ3fbO4o/6XHyrpvAitQDVGKlsYwxd8RvIklqYGPUl7Wno1xey5xiizBG3zeluz0eBv8J9r+pFwj/SXtx4irfscF/uDAxmsZ532z+X4VaevzHqah4PU0neEF3/K4lxcoBJjHQmW+wXNpde2jQpLmYuAaQp4C/88j/1FCc5bxV1Z+Qz4cbm00wPcc0lhbXS7RCGzaEhsm4/GHqIARQUYmXKayY/v/A46ljb2Z2UigLK1PcYtCF4+uIpImfHj/YmsFpW/Q0ptf2WPRX1VR6nZMQmveklPW42ek= ceph-c7666100-70af-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T02:38:20.396 INFO:teuthology.orchestra.run.smithi018.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCK6Af9cfeLfnfdr/7GeAGS9Cjx/QgBLiOEFea6DtfjjqzipX0RM6mymE75FQauCh2JEaTftP8p1OBeaHiPpgZxR4EgtrBydbbmpAamkEOML5APqa67h+baX3KPSD4roqegYP12JHtxmhCUKg1X1QcoqBHEN+M5J/SZy8/QQj+JZu1fz4HR5izkApvcdb4z1YjGh9obzeeVjJFpP3e/yXcYHhPTll2QFdyBJ3fbO4o/6XHyrpvAitQDVGKlsYwxd8RvIklqYGPUl7Wno1xey5xiizBG3zeluz0eBv8J9r+pFwj/SXtx4irfscF/uDAxmsZ532z+X4VaevzHqah4PU0neEF3/K4lxcoBJjHQmW+wXNpde2jQpLmYuAaQp4C/88j/1FCc5bxV1Z+Qz4cbm00wPcc0lhbXS7RCGzaEhsm4/GHqIARQUYmXKayY/v/A46ljb2Z2UigLK1PcYtCF4+uIpImfHj/YmsFpW/Q0ptf2WPRX1VR6nZMQmveklPW42ek= ceph-c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:38:20.421 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:20 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3056461044' entity='client.admin' 2024-09-12T02:38:20.423 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCK6Af9cfeLfnfdr/7GeAGS9Cjx/QgBLiOEFea6DtfjjqzipX0RM6mymE75FQauCh2JEaTftP8p1OBeaHiPpgZxR4EgtrBydbbmpAamkEOML5APqa67h+baX3KPSD4roqegYP12JHtxmhCUKg1X1QcoqBHEN+M5J/SZy8/QQj+JZu1fz4HR5izkApvcdb4z1YjGh9obzeeVjJFpP3e/yXcYHhPTll2QFdyBJ3fbO4o/6XHyrpvAitQDVGKlsYwxd8RvIklqYGPUl7Wno1xey5xiizBG3zeluz0eBv8J9r+pFwj/SXtx4irfscF/uDAxmsZ532z+X4VaevzHqah4PU0neEF3/K4lxcoBJjHQmW+wXNpde2jQpLmYuAaQp4C/88j/1FCc5bxV1Z+Qz4cbm00wPcc0lhbXS7RCGzaEhsm4/GHqIARQUYmXKayY/v/A46ljb2Z2UigLK1PcYtCF4+uIpImfHj/YmsFpW/Q0ptf2WPRX1VR6nZMQmveklPW42ek= ceph-c7666100-70af-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T02:38:20.465 INFO:teuthology.orchestra.run.smithi062.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCK6Af9cfeLfnfdr/7GeAGS9Cjx/QgBLiOEFea6DtfjjqzipX0RM6mymE75FQauCh2JEaTftP8p1OBeaHiPpgZxR4EgtrBydbbmpAamkEOML5APqa67h+baX3KPSD4roqegYP12JHtxmhCUKg1X1QcoqBHEN+M5J/SZy8/QQj+JZu1fz4HR5izkApvcdb4z1YjGh9obzeeVjJFpP3e/yXcYHhPTll2QFdyBJ3fbO4o/6XHyrpvAitQDVGKlsYwxd8RvIklqYGPUl7Wno1xey5xiizBG3zeluz0eBv8J9r+pFwj/SXtx4irfscF/uDAxmsZ532z+X4VaevzHqah4PU0neEF3/K4lxcoBJjHQmW+wXNpde2jQpLmYuAaQp4C/88j/1FCc5bxV1Z+Qz4cbm00wPcc0lhbXS7RCGzaEhsm4/GHqIARQUYmXKayY/v/A46ljb2Z2UigLK1PcYtCF4+uIpImfHj/YmsFpW/Q0ptf2WPRX1VR6nZMQmveklPW42ek= ceph-c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:38:20.477 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCK6Af9cfeLfnfdr/7GeAGS9Cjx/QgBLiOEFea6DtfjjqzipX0RM6mymE75FQauCh2JEaTftP8p1OBeaHiPpgZxR4EgtrBydbbmpAamkEOML5APqa67h+baX3KPSD4roqegYP12JHtxmhCUKg1X1QcoqBHEN+M5J/SZy8/QQj+JZu1fz4HR5izkApvcdb4z1YjGh9obzeeVjJFpP3e/yXcYHhPTll2QFdyBJ3fbO4o/6XHyrpvAitQDVGKlsYwxd8RvIklqYGPUl7Wno1xey5xiizBG3zeluz0eBv8J9r+pFwj/SXtx4irfscF/uDAxmsZ532z+X4VaevzHqah4PU0neEF3/K4lxcoBJjHQmW+wXNpde2jQpLmYuAaQp4C/88j/1FCc5bxV1Z+Qz4cbm00wPcc0lhbXS7RCGzaEhsm4/GHqIARQUYmXKayY/v/A46ljb2Z2UigLK1PcYtCF4+uIpImfHj/YmsFpW/Q0ptf2WPRX1VR6nZMQmveklPW42ek= ceph-c7666100-70af-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T02:38:20.520 INFO:teuthology.orchestra.run.smithi176.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCK6Af9cfeLfnfdr/7GeAGS9Cjx/QgBLiOEFea6DtfjjqzipX0RM6mymE75FQauCh2JEaTftP8p1OBeaHiPpgZxR4EgtrBydbbmpAamkEOML5APqa67h+baX3KPSD4roqegYP12JHtxmhCUKg1X1QcoqBHEN+M5J/SZy8/QQj+JZu1fz4HR5izkApvcdb4z1YjGh9obzeeVjJFpP3e/yXcYHhPTll2QFdyBJ3fbO4o/6XHyrpvAitQDVGKlsYwxd8RvIklqYGPUl7Wno1xey5xiizBG3zeluz0eBv8J9r+pFwj/SXtx4irfscF/uDAxmsZ532z+X4VaevzHqah4PU0neEF3/K4lxcoBJjHQmW+wXNpde2jQpLmYuAaQp4C/88j/1FCc5bxV1Z+Qz4cbm00wPcc0lhbXS7RCGzaEhsm4/GHqIARQUYmXKayY/v/A46ljb2Z2UigLK1PcYtCF4+uIpImfHj/YmsFpW/Q0ptf2WPRX1VR6nZMQmveklPW42ek= ceph-c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:38:20.533 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-12T02:38:20.902 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:21.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.486+0000 7f2013000640 1 -- 172.21.15.18:0/1815618889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200c1015f0 msgr2=0x7f200c1019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.486+0000 7f2013000640 1 --2- 172.21.15.18:0/1815618889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200c1015f0 0x7f200c1019f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009880 tx=0x7f1ffc02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.487+0000 7f2013000640 1 -- 172.21.15.18:0/1815618889 shutdown_connections 2024-09-12T02:38:21.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.487+0000 7f2013000640 1 --2- 172.21.15.18:0/1815618889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200c1015f0 0x7f200c1019f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.487+0000 7f2013000640 1 -- 172.21.15.18:0/1815618889 >> 172.21.15.18:0/1815618889 conn(0x7f200c0fcd80 msgr2=0x7f200c0ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:21.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.487+0000 7f2013000640 1 -- 172.21.15.18:0/1815618889 shutdown_connections 2024-09-12T02:38:21.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.487+0000 7f2013000640 1 -- 172.21.15.18:0/1815618889 wait complete. 2024-09-12T02:38:21.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.488+0000 7f2013000640 1 Processor -- start 2024-09-12T02:38:21.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.488+0000 7f2013000640 1 -- start start 2024-09-12T02:38:21.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.488+0000 7f2013000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200c1015f0 0x7f200c198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.488+0000 7f2013000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f200c107700 con 0x7f200c1015f0 2024-09-12T02:38:21.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.489+0000 7f200be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200c1015f0 0x7f200c198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.489+0000 7f200be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200c1015f0 0x7f200c198fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58778/0 (socket says 172.21.15.18:58778) 2024-09-12T02:38:21.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.489+0000 7f200be00640 1 -- 172.21.15.18:0/2207095129 learned_addr learned my addr 172.21.15.18:0/2207095129 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:21.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.489+0000 7f200be00640 1 -- 172.21.15.18:0/2207095129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c199500 con 0x7f200c1015f0 2024-09-12T02:38:21.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.489+0000 7f200be00640 1 --2- 172.21.15.18:0/2207095129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200c1015f0 0x7f200c198fc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc004f60 tx=0x7f1ffc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:21.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.490+0000 7f2008c00640 1 -- 172.21.15.18:0/2207095129 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ffc03f070 con 0x7f200c1015f0 2024-09-12T02:38:21.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.490+0000 7f2008c00640 1 -- 172.21.15.18:0/2207095129 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ffc004d40 con 0x7f200c1015f0 2024-09-12T02:38:21.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.490+0000 7f2013000640 1 -- 172.21.15.18:0/2207095129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200c199790 con 0x7f200c1015f0 2024-09-12T02:38:21.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.490+0000 7f2008c00640 1 -- 172.21.15.18:0/2207095129 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ffc035030 con 0x7f200c1015f0 2024-09-12T02:38:21.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.490+0000 7f2013000640 1 -- 172.21.15.18:0/2207095129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f200c19c480 con 0x7f200c1015f0 2024-09-12T02:38:21.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.491+0000 7f2013000640 1 -- 172.21.15.18:0/2207095129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f200c107e80 con 0x7f200c1015f0 2024-09-12T02:38:21.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.491+0000 7f2008c00640 1 -- 172.21.15.18:0/2207095129 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f1ffc042070 con 0x7f200c1015f0 2024-09-12T02:38:21.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.492+0000 7f2008c00640 1 --2- 172.21.15.18:0/2207095129 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f1ff0039110 0x7f1ff003b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.492+0000 7f2008c00640 1 -- 172.21.15.18:0/2207095129 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1ffc06cd20 con 0x7f200c1015f0 2024-09-12T02:38:21.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.492+0000 7f200b400640 1 --2- 172.21.15.18:0/2207095129 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f1ff0039110 0x7f1ff003b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.493+0000 7f200b400640 1 --2- 172.21.15.18:0/2207095129 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f1ff0039110 0x7f1ff003b5d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1ff80098c0 tx=0x7f1ff8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:21.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.497+0000 7f2008c00640 1 -- 172.21.15.18:0/2207095129 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1ffc04a260 con 0x7f200c1015f0 2024-09-12T02:38:21.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.687+0000 7f2013000640 1 -- 172.21.15.18:0/2207095129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f200c02d7c0 con 0x7f200c1015f0 2024-09-12T02:38:21.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.689+0000 7f2008c00640 1 -- 172.21.15.18:0/2207095129 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f1ffc0035f0 con 0x7f200c1015f0 2024-09-12T02:38:21.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.692+0000 7f2013000640 1 -- 172.21.15.18:0/2207095129 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f1ff0039110 msgr2=0x7f1ff003b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.692+0000 7f2013000640 1 --2- 172.21.15.18:0/2207095129 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f1ff0039110 0x7f1ff003b5d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1ff80098c0 tx=0x7f1ff8006db0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.692+0000 7f2013000640 1 -- 172.21.15.18:0/2207095129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200c1015f0 msgr2=0x7f200c198fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.692+0000 7f2013000640 1 --2- 172.21.15.18:0/2207095129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200c1015f0 0x7f200c198fc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc004f60 tx=0x7f1ffc0048f0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.692+0000 7f2013000640 1 -- 172.21.15.18:0/2207095129 shutdown_connections 2024-09-12T02:38:21.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.692+0000 7f2013000640 1 --2- 172.21.15.18:0/2207095129 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f1ff0039110 0x7f1ff003b5d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.692+0000 7f2013000640 1 --2- 172.21.15.18:0/2207095129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200c1015f0 0x7f200c198fc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.692+0000 7f2013000640 1 -- 172.21.15.18:0/2207095129 >> 172.21.15.18:0/2207095129 conn(0x7f200c0fcd80 msgr2=0x7f200c0ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:21.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.692+0000 7f2013000640 1 -- 172.21.15.18:0/2207095129 shutdown_connections 2024-09-12T02:38:21.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:21.692+0000 7f2013000640 1 -- 172.21.15.18:0/2207095129 wait complete. 2024-09-12T02:38:22.937 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:22 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2207095129' entity='client.admin' 2024-09-12T02:38:22.937 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:22 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:22.937 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:22 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:22.937 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:22 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi018", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:22.937 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:22 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:22.938 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:22 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:38:22.938 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:22 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:23.548 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-12T02:38:23.548 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-12T02:38:23.934 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:25.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.122+0000 7f863f800640 1 -- 172.21.15.18:0/1909103889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86381037f0 msgr2=0x7f8638103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:25.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.122+0000 7f863f800640 1 --2- 172.21.15.18:0/1909103889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86381037f0 0x7f8638103bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f862c009880 tx=0x7f862c02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:38:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.122+0000 7f863f800640 1 -- 172.21.15.18:0/1909103889 shutdown_connections 2024-09-12T02:38:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.122+0000 7f863f800640 1 --2- 172.21.15.18:0/1909103889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86381037f0 0x7f8638103bf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.122+0000 7f863f800640 1 -- 172.21.15.18:0/1909103889 >> 172.21.15.18:0/1909103889 conn(0x7f86380fefc0 msgr2=0x7f8638101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.123+0000 7f863f800640 1 -- 172.21.15.18:0/1909103889 shutdown_connections 2024-09-12T02:38:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.123+0000 7f863f800640 1 -- 172.21.15.18:0/1909103889 wait complete. 2024-09-12T02:38:25.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.124+0000 7f863f800640 1 Processor -- start 2024-09-12T02:38:25.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.124+0000 7f863f800640 1 -- start start 2024-09-12T02:38:25.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.124+0000 7f863f800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86381037f0 0x7f8638198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:25.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.124+0000 7f863f800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8638109900 con 0x7f86381037f0 2024-09-12T02:38:25.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.124+0000 7f863ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86381037f0 0x7f8638198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:25.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.125+0000 7f863ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86381037f0 0x7f8638198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37308/0 (socket says 172.21.15.18:37308) 2024-09-12T02:38:25.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.125+0000 7f863ce00640 1 -- 172.21.15.18:0/3474637178 learned_addr learned my addr 172.21.15.18:0/3474637178 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:25.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.125+0000 7f863ce00640 1 -- 172.21.15.18:0/3474637178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86381994e0 con 0x7f86381037f0 2024-09-12T02:38:25.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.125+0000 7f863ce00640 1 --2- 172.21.15.18:0/3474637178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86381037f0 0x7f8638198fa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f862c004f60 tx=0x7f862c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:25.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.126+0000 7f8635600640 1 -- 172.21.15.18:0/3474637178 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f862c03f070 con 0x7f86381037f0 2024-09-12T02:38:25.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.126+0000 7f8635600640 1 -- 172.21.15.18:0/3474637178 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f862c004cc0 con 0x7f86381037f0 2024-09-12T02:38:25.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.126+0000 7f863f800640 1 -- 172.21.15.18:0/3474637178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8638199770 con 0x7f86381037f0 2024-09-12T02:38:25.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.126+0000 7f8635600640 1 -- 172.21.15.18:0/3474637178 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f862c035030 con 0x7f86381037f0 2024-09-12T02:38:25.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.126+0000 7f863f800640 1 -- 172.21.15.18:0/3474637178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f863819c460 con 0x7f86381037f0 2024-09-12T02:38:25.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.127+0000 7f8635600640 1 -- 172.21.15.18:0/3474637178 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f862c042070 con 0x7f86381037f0 2024-09-12T02:38:25.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.127+0000 7f863f800640 1 -- 172.21.15.18:0/3474637178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f863810a080 con 0x7f86381037f0 2024-09-12T02:38:25.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.127+0000 7f8635600640 1 --2- 172.21.15.18:0/3474637178 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f86200390c0 0x7f862003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:25.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.128+0000 7f8635600640 1 -- 172.21.15.18:0/3474637178 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f862c06ce10 con 0x7f86381037f0 2024-09-12T02:38:25.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.128+0000 7f8637e00640 1 --2- 172.21.15.18:0/3474637178 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f86200390c0 0x7f862003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:25.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.128+0000 7f8637e00640 1 --2- 172.21.15.18:0/3474637178 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f86200390c0 0x7f862003b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f86240098c0 tx=0x7f8624006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:25.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.133+0000 7f8635600640 1 -- 172.21.15.18:0/3474637178 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f862c0433b0 con 0x7f86381037f0 2024-09-12T02:38:25.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.324+0000 7f863f800640 1 -- 172.21.15.18:0/3474637178 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f863802d830 con 0x7f86200390c0 2024-09-12T02:38:25.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.327+0000 7f8635600640 1 -- 172.21.15.18:0/3474637178 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f863802d830 con 0x7f86200390c0 2024-09-12T02:38:25.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.330+0000 7f863f800640 1 -- 172.21.15.18:0/3474637178 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f86200390c0 msgr2=0x7f862003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:25.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.330+0000 7f863f800640 1 --2- 172.21.15.18:0/3474637178 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f86200390c0 0x7f862003b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f86240098c0 tx=0x7f8624006db0 comp rx=0 tx=0).stop 2024-09-12T02:38:25.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.330+0000 7f863f800640 1 -- 172.21.15.18:0/3474637178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86381037f0 msgr2=0x7f8638198fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:25.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.330+0000 7f863f800640 1 --2- 172.21.15.18:0/3474637178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86381037f0 0x7f8638198fa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f862c004f60 tx=0x7f862c0048f0 comp rx=0 tx=0).stop 2024-09-12T02:38:25.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.330+0000 7f863f800640 1 -- 172.21.15.18:0/3474637178 shutdown_connections 2024-09-12T02:38:25.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.330+0000 7f863f800640 1 --2- 172.21.15.18:0/3474637178 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f86200390c0 0x7f862003b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:25.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.330+0000 7f863f800640 1 --2- 172.21.15.18:0/3474637178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86381037f0 0x7f8638198fa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:25.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.330+0000 7f863f800640 1 -- 172.21.15.18:0/3474637178 >> 172.21.15.18:0/3474637178 conn(0x7f86380fefc0 msgr2=0x7f86380ff9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:25.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.330+0000 7f863f800640 1 -- 172.21.15.18:0/3474637178 shutdown_connections 2024-09-12T02:38:25.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:25.331+0000 7f863f800640 1 -- 172.21.15.18:0/3474637178 wait complete. 2024-09-12T02:38:26.201 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi062 2024-09-12T02:38:26.201 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T02:38:26.201 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/etc/ceph/ceph.conf 2024-09-12T02:38:26.220 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T02:38:26.220 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:38:26.278 INFO:tasks.cephadm:Adding host smithi062 to orchestrator... 2024-09-12T02:38:26.279 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch host add smithi062 2024-09-12T02:38:26.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:26 smithi018 ceph-mon[30616]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:26.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:26.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:38:26.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:26.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:38:26.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:26 smithi018 ceph-mon[30616]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-12T02:38:26.659 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:27.472 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:27 smithi018 ceph-mon[30616]: Updating smithi018:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:38:27.473 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:27 smithi018 ceph-mon[30616]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:38:27.473 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:27.473 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:27.473 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:27.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.496+0000 7fe6d0200640 1 -- 172.21.15.18:0/726626763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6c8107660 msgr2=0x7fe6c8107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:27.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.496+0000 7fe6d0200640 1 --2- 172.21.15.18:0/726626763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6c8107660 0x7fe6c8107a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009880 tx=0x7fe6bc02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.496+0000 7fe6d0200640 1 -- 172.21.15.18:0/726626763 shutdown_connections 2024-09-12T02:38:27.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.496+0000 7fe6d0200640 1 --2- 172.21.15.18:0/726626763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6c8107660 0x7fe6c8107a40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:27.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.496+0000 7fe6d0200640 1 -- 172.21.15.18:0/726626763 >> 172.21.15.18:0/726626763 conn(0x7fe6c80fd290 msgr2=0x7fe6c80ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:27.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.497+0000 7fe6d0200640 1 -- 172.21.15.18:0/726626763 shutdown_connections 2024-09-12T02:38:27.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.497+0000 7fe6d0200640 1 -- 172.21.15.18:0/726626763 wait complete. 2024-09-12T02:38:27.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.497+0000 7fe6d0200640 1 Processor -- start 2024-09-12T02:38:27.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.498+0000 7fe6d0200640 1 -- start start 2024-09-12T02:38:27.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.498+0000 7fe6d0200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6c8107660 0x7fe6c8199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.498+0000 7fe6d0200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c810bc90 con 0x7fe6c8107660 2024-09-12T02:38:27.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.498+0000 7fe6cd800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6c8107660 0x7fe6c8199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.498+0000 7fe6cd800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6c8107660 0x7fe6c8199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37324/0 (socket says 172.21.15.18:37324) 2024-09-12T02:38:27.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.498+0000 7fe6cd800640 1 -- 172.21.15.18:0/3564261371 learned_addr learned my addr 172.21.15.18:0/3564261371 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:27.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.499+0000 7fe6cd800640 1 -- 172.21.15.18:0/3564261371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c8199860 con 0x7fe6c8107660 2024-09-12T02:38:27.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.499+0000 7fe6cd800640 1 --2- 172.21.15.18:0/3564261371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6c8107660 0x7fe6c8199320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009230 tx=0x7fe6bc003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:27.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.499+0000 7fe6c6000640 1 -- 172.21.15.18:0/3564261371 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6bc03f070 con 0x7fe6c8107660 2024-09-12T02:38:27.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.499+0000 7fe6c6000640 1 -- 172.21.15.18:0/3564261371 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6bc03bc80 con 0x7fe6c8107660 2024-09-12T02:38:27.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.499+0000 7fe6c6000640 1 -- 172.21.15.18:0/3564261371 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6bc035030 con 0x7fe6c8107660 2024-09-12T02:38:27.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.499+0000 7fe6d0200640 1 -- 172.21.15.18:0/3564261371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c8199af0 con 0x7fe6c8107660 2024-09-12T02:38:27.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.499+0000 7fe6d0200640 1 -- 172.21.15.18:0/3564261371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c819dbf0 con 0x7fe6c8107660 2024-09-12T02:38:27.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.500+0000 7fe6c6000640 1 -- 172.21.15.18:0/3564261371 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fe6bc042070 con 0x7fe6c8107660 2024-09-12T02:38:27.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.500+0000 7fe6d0200640 1 -- 172.21.15.18:0/3564261371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6c8102cd0 con 0x7fe6c8107660 2024-09-12T02:38:27.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.501+0000 7fe6c6000640 1 --2- 172.21.15.18:0/3564261371 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe6b00390c0 0x7fe6b003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:27.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.501+0000 7fe6c6000640 1 -- 172.21.15.18:0/3564261371 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe6bc06cd80 con 0x7fe6c8107660 2024-09-12T02:38:27.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.501+0000 7fe6cce00640 1 --2- 172.21.15.18:0/3564261371 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe6b00390c0 0x7fe6b003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:27.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.502+0000 7fe6cce00640 1 --2- 172.21.15.18:0/3564261371 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe6b00390c0 0x7fe6b003b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40098c0 tx=0x7fe6b4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:27.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.506+0000 7fe6c6000640 1 -- 172.21.15.18:0/3564261371 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe6bc0372d0 con 0x7fe6c8107660 2024-09-12T02:38:27.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:27.695+0000 7fe6d0200640 1 -- 172.21.15.18:0/3564261371 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi062", "target": ["mon-mgr", ""]}) -- 0x7fe6c819a680 con 0x7fe6b00390c0 2024-09-12T02:38:28.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:28 smithi018 ceph-mon[30616]: Updating smithi018:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:38:29.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:29 smithi018 ceph-mon[30616]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi062", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:30.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:30 smithi018 ceph-mon[30616]: Deploying cephadm binary to smithi062 2024-09-12T02:38:31.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:31.568+0000 7fe6c6000640 1 -- 172.21.15.18:0/3564261371 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fe6c819a680 con 0x7fe6b00390c0 2024-09-12T02:38:31.570 INFO:teuthology.orchestra.run.smithi018.stdout:Added host 'smithi062' with addr '172.21.15.62' 2024-09-12T02:38:31.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:31.570+0000 7fe6d0200640 1 -- 172.21.15.18:0/3564261371 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe6b00390c0 msgr2=0x7fe6b003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:31.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:31.570+0000 7fe6d0200640 1 --2- 172.21.15.18:0/3564261371 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe6b00390c0 0x7fe6b003b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40098c0 tx=0x7fe6b4006db0 comp rx=0 tx=0).stop 2024-09-12T02:38:31.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:31.570+0000 7fe6d0200640 1 -- 172.21.15.18:0/3564261371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6c8107660 msgr2=0x7fe6c8199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:31.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:31.570+0000 7fe6d0200640 1 --2- 172.21.15.18:0/3564261371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6c8107660 0x7fe6c8199320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009230 tx=0x7fe6bc003d40 comp rx=0 tx=0).stop 2024-09-12T02:38:31.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:31.570+0000 7fe6d0200640 1 -- 172.21.15.18:0/3564261371 shutdown_connections 2024-09-12T02:38:31.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:31.570+0000 7fe6d0200640 1 --2- 172.21.15.18:0/3564261371 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe6b00390c0 0x7fe6b003b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:31.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:31.570+0000 7fe6d0200640 1 --2- 172.21.15.18:0/3564261371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6c8107660 0x7fe6c8199320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:31.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:31.570+0000 7fe6d0200640 1 -- 172.21.15.18:0/3564261371 >> 172.21.15.18:0/3564261371 conn(0x7fe6c80fd290 msgr2=0x7fe6c80fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:31.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:31.571+0000 7fe6d0200640 1 -- 172.21.15.18:0/3564261371 shutdown_connections 2024-09-12T02:38:31.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:31.571+0000 7fe6d0200640 1 -- 172.21.15.18:0/3564261371 wait complete. 2024-09-12T02:38:31.586 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:31 smithi018 ceph-mon[30616]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:32.361 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T02:38:32.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:32 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:32.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:32 smithi018 ceph-mon[30616]: Added host smithi062 2024-09-12T02:38:32.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:32 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:38:32.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:32 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:32.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:32 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:32.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:32 smithi018 ceph-mon[30616]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:32.733 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:33.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.242+0000 7f813da00640 1 -- 172.21.15.18:0/991135365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81381025a0 msgr2=0x7f8138102980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.242+0000 7f813da00640 1 --2- 172.21.15.18:0/991135365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81381025a0 0x7f8138102980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8128009880 tx=0x7f812802a670 comp rx=0 tx=0).stop 2024-09-12T02:38:33.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.242+0000 7f813da00640 1 -- 172.21.15.18:0/991135365 shutdown_connections 2024-09-12T02:38:33.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.242+0000 7f813da00640 1 --2- 172.21.15.18:0/991135365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81381025a0 0x7f8138102980 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.242+0000 7f813da00640 1 -- 172.21.15.18:0/991135365 >> 172.21.15.18:0/991135365 conn(0x7f81380fbfc0 msgr2=0x7f81380fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:33.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.242+0000 7f813da00640 1 -- 172.21.15.18:0/991135365 shutdown_connections 2024-09-12T02:38:33.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.242+0000 7f813da00640 1 -- 172.21.15.18:0/991135365 wait complete. 2024-09-12T02:38:33.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.243+0000 7f813da00640 1 Processor -- start 2024-09-12T02:38:33.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.243+0000 7f813da00640 1 -- start start 2024-09-12T02:38:33.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.243+0000 7f813da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81381025a0 0x7f81381992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:33.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.243+0000 7f813da00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f813810bb10 con 0x7f81381025a0 2024-09-12T02:38:33.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.244+0000 7f8137e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81381025a0 0x7f81381992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:33.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.244+0000 7f8137e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81381025a0 0x7f81381992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37336/0 (socket says 172.21.15.18:37336) 2024-09-12T02:38:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.244+0000 7f8137e00640 1 -- 172.21.15.18:0/3265205088 learned_addr learned my addr 172.21.15.18:0/3265205088 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.244+0000 7f8137e00640 1 -- 172.21.15.18:0/3265205088 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81381997e0 con 0x7f81381025a0 2024-09-12T02:38:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.244+0000 7f8137e00640 1 --2- 172.21.15.18:0/3265205088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81381025a0 0x7f81381992a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8128009230 tx=0x7f8128003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.245+0000 7f8135600640 1 -- 172.21.15.18:0/3265205088 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f812803f070 con 0x7f81381025a0 2024-09-12T02:38:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.245+0000 7f8135600640 1 -- 172.21.15.18:0/3265205088 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f812803bd40 con 0x7f81381025a0 2024-09-12T02:38:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.245+0000 7f813da00640 1 -- 172.21.15.18:0/3265205088 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8138199a70 con 0x7f81381025a0 2024-09-12T02:38:33.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.245+0000 7f8135600640 1 -- 172.21.15.18:0/3265205088 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8128035030 con 0x7f81381025a0 2024-09-12T02:38:33.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.245+0000 7f813da00640 1 -- 172.21.15.18:0/3265205088 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8138199ed0 con 0x7f81381025a0 2024-09-12T02:38:33.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.246+0000 7f8135600640 1 -- 172.21.15.18:0/3265205088 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8128042070 con 0x7f81381025a0 2024-09-12T02:38:33.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.246+0000 7f813da00640 1 -- 172.21.15.18:0/3265205088 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f813806a7b0 con 0x7f81381025a0 2024-09-12T02:38:33.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.246+0000 7f8135600640 1 --2- 172.21.15.18:0/3265205088 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f811c039060 0x7f811c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:33.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.246+0000 7f8135600640 1 -- 172.21.15.18:0/3265205088 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f812806cd20 con 0x7f81381025a0 2024-09-12T02:38:33.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.247+0000 7f812f400640 1 --2- 172.21.15.18:0/3265205088 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f811c039060 0x7f811c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:33.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.247+0000 7f812f400640 1 --2- 172.21.15.18:0/3265205088 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f811c039060 0x7f811c03b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f81200098c0 tx=0x7f8120006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:33.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.251+0000 7f8135600640 1 -- 172.21.15.18:0/3265205088 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8128030d60 con 0x7f81381025a0 2024-09-12T02:38:33.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.441+0000 7f813da00640 1 -- 172.21.15.18:0/3265205088 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f813819a670 con 0x7f811c039060 2024-09-12T02:38:33.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.442+0000 7f8135600640 1 -- 172.21.15.18:0/3265205088 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f813819a670 con 0x7f811c039060 2024-09-12T02:38:33.445 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:38:33.445 INFO:teuthology.orchestra.run.smithi018.stdout:[{"addr": "172.21.15.18", "hostname": "smithi018", "labels": [], "status": ""}, {"addr": "172.21.15.62", "hostname": "smithi062", "labels": [], "status": ""}] 2024-09-12T02:38:33.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.445+0000 7f813da00640 1 -- 172.21.15.18:0/3265205088 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f811c039060 msgr2=0x7f811c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.445+0000 7f813da00640 1 --2- 172.21.15.18:0/3265205088 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f811c039060 0x7f811c03b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f81200098c0 tx=0x7f8120006db0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.445+0000 7f813da00640 1 -- 172.21.15.18:0/3265205088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81381025a0 msgr2=0x7f81381992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:33.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.445+0000 7f813da00640 1 --2- 172.21.15.18:0/3265205088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81381025a0 0x7f81381992a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8128009230 tx=0x7f8128003d80 comp rx=0 tx=0).stop 2024-09-12T02:38:33.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.445+0000 7f813da00640 1 -- 172.21.15.18:0/3265205088 shutdown_connections 2024-09-12T02:38:33.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.445+0000 7f813da00640 1 --2- 172.21.15.18:0/3265205088 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f811c039060 0x7f811c03b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.445+0000 7f813da00640 1 --2- 172.21.15.18:0/3265205088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81381025a0 0x7f81381992a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:33.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.445+0000 7f813da00640 1 -- 172.21.15.18:0/3265205088 >> 172.21.15.18:0/3265205088 conn(0x7f81380fbfc0 msgr2=0x7f8138107760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:33.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.445+0000 7f813da00640 1 -- 172.21.15.18:0/3265205088 shutdown_connections 2024-09-12T02:38:33.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:33.445+0000 7f813da00640 1 -- 172.21.15.18:0/3265205088 wait complete. 2024-09-12T02:38:34.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:33 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:34.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:33 smithi018 ceph-mon[30616]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:34.177 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi176 2024-09-12T02:38:34.178 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T02:38:34.178 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/etc/ceph/ceph.conf 2024-09-12T02:38:34.196 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T02:38:34.196 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:38:34.254 INFO:tasks.cephadm:Adding host smithi176 to orchestrator... 2024-09-12T02:38:34.254 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch host add smithi176 2024-09-12T02:38:34.619 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:35.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:34 smithi018 ceph-mon[30616]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:35.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.148+0000 7fc696a00640 1 -- 172.21.15.18:0/1951174311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc690109740 msgr2=0x7fc690109b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:35.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.148+0000 7fc696a00640 1 --2- 172.21.15.18:0/1951174311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc690109740 0x7fc690109b20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc684009880 tx=0x7fc68402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:38:35.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.148+0000 7fc696a00640 1 -- 172.21.15.18:0/1951174311 shutdown_connections 2024-09-12T02:38:35.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.148+0000 7fc696a00640 1 --2- 172.21.15.18:0/1951174311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc690109740 0x7fc690109b20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:35.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.148+0000 7fc696a00640 1 -- 172.21.15.18:0/1951174311 >> 172.21.15.18:0/1951174311 conn(0x7fc6900ff2c0 msgr2=0x7fc6901016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:35.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.148+0000 7fc696a00640 1 -- 172.21.15.18:0/1951174311 shutdown_connections 2024-09-12T02:38:35.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.148+0000 7fc696a00640 1 -- 172.21.15.18:0/1951174311 wait complete. 2024-09-12T02:38:35.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.149+0000 7fc696a00640 1 Processor -- start 2024-09-12T02:38:35.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.149+0000 7fc696a00640 1 -- start start 2024-09-12T02:38:35.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.149+0000 7fc696a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc690109740 0x7fc6901991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:35.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.149+0000 7fc696a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc69010dd50 con 0x7fc690109740 2024-09-12T02:38:35.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.150+0000 7fc695600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc690109740 0x7fc6901991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:35.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.150+0000 7fc695600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc690109740 0x7fc6901991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44930/0 (socket says 172.21.15.18:44930) 2024-09-12T02:38:35.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.150+0000 7fc695600640 1 -- 172.21.15.18:0/1358476062 learned_addr learned my addr 172.21.15.18:0/1358476062 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:35.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.150+0000 7fc695600640 1 -- 172.21.15.18:0/1358476062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc690199700 con 0x7fc690109740 2024-09-12T02:38:35.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.150+0000 7fc695600640 1 --2- 172.21.15.18:0/1358476062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc690109740 0x7fc6901991c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc684009230 tx=0x7fc684003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:35.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.150+0000 7fc68e000640 1 -- 172.21.15.18:0/1358476062 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc68403f070 con 0x7fc690109740 2024-09-12T02:38:35.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.150+0000 7fc68e000640 1 -- 172.21.15.18:0/1358476062 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc68403bd40 con 0x7fc690109740 2024-09-12T02:38:35.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.150+0000 7fc68e000640 1 -- 172.21.15.18:0/1358476062 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc684035030 con 0x7fc690109740 2024-09-12T02:38:35.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.150+0000 7fc696a00640 1 -- 172.21.15.18:0/1358476062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6901999f0 con 0x7fc690109740 2024-09-12T02:38:35.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.151+0000 7fc696a00640 1 -- 172.21.15.18:0/1358476062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69019da90 con 0x7fc690109740 2024-09-12T02:38:35.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.152+0000 7fc68e000640 1 -- 172.21.15.18:0/1358476062 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fc684042070 con 0x7fc690109740 2024-09-12T02:38:35.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.152+0000 7fc696a00640 1 -- 172.21.15.18:0/1358476062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc690104ce0 con 0x7fc690109740 2024-09-12T02:38:35.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.152+0000 7fc68e000640 1 --2- 172.21.15.18:0/1358476062 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc6780390c0 0x7fc67803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:35.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.152+0000 7fc68e000640 1 -- 172.21.15.18:0/1358476062 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc68406cc70 con 0x7fc690109740 2024-09-12T02:38:35.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.152+0000 7fc694c00640 1 --2- 172.21.15.18:0/1358476062 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc6780390c0 0x7fc67803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:35.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.153+0000 7fc694c00640 1 --2- 172.21.15.18:0/1358476062 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc6780390c0 0x7fc67803b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0098c0 tx=0x7fc67c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:35.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.157+0000 7fc68e000640 1 -- 172.21.15.18:0/1358476062 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc684030d60 con 0x7fc690109740 2024-09-12T02:38:35.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:35.345+0000 7fc696a00640 1 -- 172.21.15.18:0/1358476062 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi176", "target": ["mon-mgr", ""]}) -- 0x7fc690109bd0 con 0x7fc6780390c0 2024-09-12T02:38:36.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:35 smithi018 ceph-mon[30616]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi176", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:36.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:35 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:36.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:35 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:36.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:35 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:36.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:35 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:36.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:35 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi062", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:36.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:35 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:36.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:35 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:38:37.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:36 smithi018 ceph-mon[30616]: Updating smithi062:/etc/ceph/ceph.conf 2024-09-12T02:38:37.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:36 smithi018 ceph-mon[30616]: Updating smithi062:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:38:37.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:36 smithi018 ceph-mon[30616]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:38:37.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:36 smithi018 ceph-mon[30616]: Updating smithi062:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:38:37.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:36 smithi018 ceph-mon[30616]: Deploying cephadm binary to smithi176 2024-09-12T02:38:37.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:36 smithi018 ceph-mon[30616]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:37.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:36 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:37.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:36 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:37.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:36 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:38.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:38 smithi018 ceph-mon[30616]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:39.216 INFO:teuthology.orchestra.run.smithi018.stdout:Added host 'smithi176' with addr '172.21.15.176' 2024-09-12T02:38:39.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:39.214+0000 7fc68e000640 1 -- 172.21.15.18:0/1358476062 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fc690109bd0 con 0x7fc6780390c0 2024-09-12T02:38:39.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:39.216+0000 7fc696a00640 1 -- 172.21.15.18:0/1358476062 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc6780390c0 msgr2=0x7fc67803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:39.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:39.216+0000 7fc696a00640 1 --2- 172.21.15.18:0/1358476062 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc6780390c0 0x7fc67803b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0098c0 tx=0x7fc67c006db0 comp rx=0 tx=0).stop 2024-09-12T02:38:39.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:39.216+0000 7fc696a00640 1 -- 172.21.15.18:0/1358476062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc690109740 msgr2=0x7fc6901991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:39.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:39.216+0000 7fc696a00640 1 --2- 172.21.15.18:0/1358476062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc690109740 0x7fc6901991c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc684009230 tx=0x7fc684003d80 comp rx=0 tx=0).stop 2024-09-12T02:38:39.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:39.216+0000 7fc696a00640 1 -- 172.21.15.18:0/1358476062 shutdown_connections 2024-09-12T02:38:39.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:39.216+0000 7fc696a00640 1 --2- 172.21.15.18:0/1358476062 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc6780390c0 0x7fc67803b580 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:39.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:39.216+0000 7fc696a00640 1 --2- 172.21.15.18:0/1358476062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc690109740 0x7fc6901991c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:39.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:39.216+0000 7fc696a00640 1 -- 172.21.15.18:0/1358476062 >> 172.21.15.18:0/1358476062 conn(0x7fc6900ff2c0 msgr2=0x7fc6900ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:39.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:39.217+0000 7fc696a00640 1 -- 172.21.15.18:0/1358476062 shutdown_connections 2024-09-12T02:38:39.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:39.217+0000 7fc696a00640 1 -- 172.21.15.18:0/1358476062 wait complete. 2024-09-12T02:38:40.009 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T02:38:40.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:40 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:40.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:40 smithi018 ceph-mon[30616]: Added host smithi176 2024-09-12T02:38:40.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:40 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:38:40.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:40 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:40.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:40 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:40.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.978+0000 7fe0fe800640 1 -- 172.21.15.18:0/587274768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0f8107580 msgr2=0x7fe0f8107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:40.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.978+0000 7fe0fe800640 1 --2- 172.21.15.18:0/587274768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0f8107580 0x7fe0f8107960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009880 tx=0x7fe0ec02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:38:40.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.979+0000 7fe0fe800640 1 -- 172.21.15.18:0/587274768 shutdown_connections 2024-09-12T02:38:40.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.979+0000 7fe0fe800640 1 --2- 172.21.15.18:0/587274768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0f8107580 0x7fe0f8107960 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:40.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.979+0000 7fe0fe800640 1 -- 172.21.15.18:0/587274768 >> 172.21.15.18:0/587274768 conn(0x7fe0f8078260 msgr2=0x7fe0f80ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:40.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.979+0000 7fe0fe800640 1 -- 172.21.15.18:0/587274768 shutdown_connections 2024-09-12T02:38:40.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.979+0000 7fe0fe800640 1 -- 172.21.15.18:0/587274768 wait complete. 2024-09-12T02:38:40.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.980+0000 7fe0fe800640 1 Processor -- start 2024-09-12T02:38:40.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.980+0000 7fe0fe800640 1 -- start start 2024-09-12T02:38:40.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.980+0000 7fe0fe800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0f8107580 0x7fe0f8199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:40.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.980+0000 7fe0fe800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f810bbb0 con 0x7fe0f8107580 2024-09-12T02:38:40.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.980+0000 7fe0fd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0f8107580 0x7fe0f8199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:40.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.980+0000 7fe0fd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0f8107580 0x7fe0f8199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44952/0 (socket says 172.21.15.18:44952) 2024-09-12T02:38:40.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.980+0000 7fe0fd400640 1 -- 172.21.15.18:0/3727172984 learned_addr learned my addr 172.21.15.18:0/3727172984 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:40.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.981+0000 7fe0fd400640 1 -- 172.21.15.18:0/3727172984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f8199770 con 0x7fe0f8107580 2024-09-12T02:38:40.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.981+0000 7fe0fd400640 1 --2- 172.21.15.18:0/3727172984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0f8107580 0x7fe0f8199230 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009230 tx=0x7fe0ec003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:40.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.981+0000 7fe0f6000640 1 -- 172.21.15.18:0/3727172984 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0ec03f070 con 0x7fe0f8107580 2024-09-12T02:38:40.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.981+0000 7fe0f6000640 1 -- 172.21.15.18:0/3727172984 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0ec03bd40 con 0x7fe0f8107580 2024-09-12T02:38:40.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.981+0000 7fe0f6000640 1 -- 172.21.15.18:0/3727172984 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0ec035030 con 0x7fe0f8107580 2024-09-12T02:38:40.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.981+0000 7fe0fe800640 1 -- 172.21.15.18:0/3727172984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f8199a00 con 0x7fe0f8107580 2024-09-12T02:38:40.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.982+0000 7fe0fe800640 1 -- 172.21.15.18:0/3727172984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f819db00 con 0x7fe0f8107580 2024-09-12T02:38:40.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.983+0000 7fe0f6000640 1 -- 172.21.15.18:0/3727172984 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fe0ec042070 con 0x7fe0f8107580 2024-09-12T02:38:40.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.983+0000 7fe0fe800640 1 -- 172.21.15.18:0/3727172984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0f8102ae0 con 0x7fe0f8107580 2024-09-12T02:38:40.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.983+0000 7fe0f6000640 1 --2- 172.21.15.18:0/3727172984 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe0e00390c0 0x7fe0e003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.983+0000 7fe0f6000640 1 -- 172.21.15.18:0/3727172984 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe0ec06ccd0 con 0x7fe0f8107580 2024-09-12T02:38:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.983+0000 7fe0fca00640 1 --2- 172.21.15.18:0/3727172984 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe0e00390c0 0x7fe0e003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.984+0000 7fe0fca00640 1 --2- 172.21.15.18:0/3727172984 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe0e00390c0 0x7fe0e003b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40098c0 tx=0x7fe0e4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:40.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:40.988+0000 7fe0f6000640 1 -- 172.21.15.18:0/3727172984 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe0ec0412c0 con 0x7fe0f8107580 2024-09-12T02:38:41.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:41.179+0000 7fe0fe800640 1 -- 172.21.15.18:0/3727172984 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0f81079e0 con 0x7fe0e00390c0 2024-09-12T02:38:41.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:41.181+0000 7fe0f6000640 1 -- 172.21.15.18:0/3727172984 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7fe0f81079e0 con 0x7fe0e00390c0 2024-09-12T02:38:41.182 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:38:41.182 INFO:teuthology.orchestra.run.smithi018.stdout:[{"addr": "172.21.15.18", "hostname": "smithi018", "labels": [], "status": ""}, {"addr": "172.21.15.62", "hostname": "smithi062", "labels": [], "status": ""}, {"addr": "172.21.15.176", "hostname": "smithi176", "labels": [], "status": ""}] 2024-09-12T02:38:41.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:41.184+0000 7fe0fe800640 1 -- 172.21.15.18:0/3727172984 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe0e00390c0 msgr2=0x7fe0e003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:41.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:41.184+0000 7fe0fe800640 1 --2- 172.21.15.18:0/3727172984 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe0e00390c0 0x7fe0e003b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40098c0 tx=0x7fe0e4006db0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:41.184+0000 7fe0fe800640 1 -- 172.21.15.18:0/3727172984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0f8107580 msgr2=0x7fe0f8199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:41.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:41.184+0000 7fe0fe800640 1 --2- 172.21.15.18:0/3727172984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0f8107580 0x7fe0f8199230 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009230 tx=0x7fe0ec003d80 comp rx=0 tx=0).stop 2024-09-12T02:38:41.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:41.184+0000 7fe0fe800640 1 -- 172.21.15.18:0/3727172984 shutdown_connections 2024-09-12T02:38:41.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:41.184+0000 7fe0fe800640 1 --2- 172.21.15.18:0/3727172984 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe0e00390c0 0x7fe0e003b580 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:41.184+0000 7fe0fe800640 1 --2- 172.21.15.18:0/3727172984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0f8107580 0x7fe0f8199230 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:41.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:41.184+0000 7fe0fe800640 1 -- 172.21.15.18:0/3727172984 >> 172.21.15.18:0/3727172984 conn(0x7fe0f8078260 msgr2=0x7fe0f8075e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:41.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:41.184+0000 7fe0fe800640 1 -- 172.21.15.18:0/3727172984 shutdown_connections 2024-09-12T02:38:41.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:41.184+0000 7fe0fe800640 1 -- 172.21.15.18:0/3727172984 wait complete. 2024-09-12T02:38:41.516 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:41 smithi018 ceph-mon[30616]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:41.516 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:41 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:41.891 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-12T02:38:41.892 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-12T02:38:42.256 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:38:42.537 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:42 smithi018 ceph-mon[30616]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:42.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.845+0000 7f9dcf600640 1 -- 172.21.15.18:0/2943482828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dc8107660 msgr2=0x7f9dc8107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:42.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.845+0000 7f9dcf600640 1 --2- 172.21.15.18:0/2943482828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dc8107660 0x7f9dc8107a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009880 tx=0x7f9dbc02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:38:42.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.845+0000 7f9dcf600640 1 -- 172.21.15.18:0/2943482828 shutdown_connections 2024-09-12T02:38:42.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.845+0000 7f9dcf600640 1 --2- 172.21.15.18:0/2943482828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dc8107660 0x7f9dc8107a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:42.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.845+0000 7f9dcf600640 1 -- 172.21.15.18:0/2943482828 >> 172.21.15.18:0/2943482828 conn(0x7f9dc80fd290 msgr2=0x7f9dc80ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:42.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.845+0000 7f9dcf600640 1 -- 172.21.15.18:0/2943482828 shutdown_connections 2024-09-12T02:38:42.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.846+0000 7f9dcf600640 1 -- 172.21.15.18:0/2943482828 wait complete. 2024-09-12T02:38:42.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.846+0000 7f9dcf600640 1 Processor -- start 2024-09-12T02:38:42.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.847+0000 7f9dcf600640 1 -- start start 2024-09-12T02:38:42.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.847+0000 7f9dcf600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dc8107660 0x7f9dc8199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:42.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.847+0000 7f9dcf600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc810bc90 con 0x7f9dc8107660 2024-09-12T02:38:42.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.847+0000 7f9dccc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dc8107660 0x7f9dc8199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:42.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.847+0000 7f9dccc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dc8107660 0x7f9dc8199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44970/0 (socket says 172.21.15.18:44970) 2024-09-12T02:38:42.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.847+0000 7f9dccc00640 1 -- 172.21.15.18:0/2823573842 learned_addr learned my addr 172.21.15.18:0/2823573842 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:38:42.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.848+0000 7f9dccc00640 1 -- 172.21.15.18:0/2823573842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc8199860 con 0x7f9dc8107660 2024-09-12T02:38:42.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.848+0000 7f9dccc00640 1 --2- 172.21.15.18:0/2823573842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dc8107660 0x7f9dc8199320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009230 tx=0x7f9dbc003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:42.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.848+0000 7f9dc5600640 1 -- 172.21.15.18:0/2823573842 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dbc03f070 con 0x7f9dc8107660 2024-09-12T02:38:42.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.848+0000 7f9dc5600640 1 -- 172.21.15.18:0/2823573842 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dbc03bd40 con 0x7f9dc8107660 2024-09-12T02:38:42.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.848+0000 7f9dcf600640 1 -- 172.21.15.18:0/2823573842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc8199af0 con 0x7f9dc8107660 2024-09-12T02:38:42.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.848+0000 7f9dc5600640 1 -- 172.21.15.18:0/2823573842 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dbc035030 con 0x7f9dc8107660 2024-09-12T02:38:42.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.848+0000 7f9dcf600640 1 -- 172.21.15.18:0/2823573842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc819dbf0 con 0x7f9dc8107660 2024-09-12T02:38:42.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.850+0000 7f9dc5600640 1 -- 172.21.15.18:0/2823573842 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f9dbc042070 con 0x7f9dc8107660 2024-09-12T02:38:42.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.849+0000 7f9dcf600640 1 -- 172.21.15.18:0/2823573842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc8102cd0 con 0x7f9dc8107660 2024-09-12T02:38:42.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.850+0000 7f9dc5600640 1 --2- 172.21.15.18:0/2823573842 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9db00390c0 0x7f9db003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:42.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.850+0000 7f9dc5600640 1 -- 172.21.15.18:0/2823573842 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9dbc06cc90 con 0x7f9dc8107660 2024-09-12T02:38:42.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.850+0000 7f9dc7e00640 1 --2- 172.21.15.18:0/2823573842 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9db00390c0 0x7f9db003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:42.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.851+0000 7f9dc7e00640 1 --2- 172.21.15.18:0/2823573842 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9db00390c0 0x7f9db003b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9db40098c0 tx=0x7f9db4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:42.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:42.855+0000 7f9dc5600640 1 -- 172.21.15.18:0/2823573842 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9dbc036df0 con 0x7f9dc8107660 2024-09-12T02:38:43.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:43.045+0000 7f9dcf600640 1 -- 172.21.15.18:0/2823573842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f9dc819a680 con 0x7f9dc8107660 2024-09-12T02:38:43.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:43.219+0000 7f9dc5600640 1 -- 172.21.15.18:0/2823573842 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f9dbc030d60 con 0x7f9dc8107660 2024-09-12T02:38:43.221 INFO:teuthology.orchestra.run.smithi018.stderr:adjusted tunables profile to default 2024-09-12T02:38:43.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:43.221+0000 7f9dcf600640 1 -- 172.21.15.18:0/2823573842 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9db00390c0 msgr2=0x7f9db003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:43.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:43.221+0000 7f9dcf600640 1 --2- 172.21.15.18:0/2823573842 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9db00390c0 0x7f9db003b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9db40098c0 tx=0x7f9db4006db0 comp rx=0 tx=0).stop 2024-09-12T02:38:43.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:43.221+0000 7f9dcf600640 1 -- 172.21.15.18:0/2823573842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dc8107660 msgr2=0x7f9dc8199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:43.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:43.221+0000 7f9dcf600640 1 --2- 172.21.15.18:0/2823573842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dc8107660 0x7f9dc8199320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009230 tx=0x7f9dbc003d80 comp rx=0 tx=0).stop 2024-09-12T02:38:43.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:43.221+0000 7f9dcf600640 1 -- 172.21.15.18:0/2823573842 shutdown_connections 2024-09-12T02:38:43.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:43.221+0000 7f9dcf600640 1 --2- 172.21.15.18:0/2823573842 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9db00390c0 0x7f9db003b580 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:43.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:43.221+0000 7f9dcf600640 1 --2- 172.21.15.18:0/2823573842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dc8107660 0x7f9dc8199320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:43.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:43.221+0000 7f9dcf600640 1 -- 172.21.15.18:0/2823573842 >> 172.21.15.18:0/2823573842 conn(0x7f9dc80fd290 msgr2=0x7f9dc8075e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:43.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:43.222+0000 7f9dcf600640 1 -- 172.21.15.18:0/2823573842 shutdown_connections 2024-09-12T02:38:43.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:38:43.222+0000 7f9dcf600640 1 -- 172.21.15.18:0/2823573842 wait complete. 2024-09-12T02:38:43.584 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:43 smithi018 ceph-mon[30616]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:43.585 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:43 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2823573842' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T02:38:44.022 INFO:tasks.cephadm:Adding mon.a on smithi018 2024-09-12T02:38:44.022 INFO:tasks.cephadm:Adding mon.b on smithi062 2024-09-12T02:38:44.022 INFO:tasks.cephadm:Adding mon.c on smithi176 2024-09-12T02:38:44.022 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi018:172.21.15.18=a;smithi062:172.21.15.62=b;smithi176:172.21.15.176=c' 2024-09-12T02:38:44.272 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:38:44.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:44 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2823573842' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T02:38:44.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:44 smithi018 ceph-mon[30616]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:38:44.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:44 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:44.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:44 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:44.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:44 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:44.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:44 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:44.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:44 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi176", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:44.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:44 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:44.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:44 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:38:44.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:44 smithi018 ceph-mon[30616]: Updating smithi176:/etc/ceph/ceph.conf 2024-09-12T02:38:44.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:44 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:44.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:44 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:44.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:44 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:44.693 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.692+0000 7fb4ef370640 1 -- 172.21.15.176:0/3308123366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4e8107650 msgr2=0x7fb4e8107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:44.693 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.692+0000 7fb4ef370640 1 --2- 172.21.15.176:0/3308123366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4e8107650 0x7fb4e8107a30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009880 tx=0x7fb4e402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:38:44.693 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.692+0000 7fb4ef370640 1 -- 172.21.15.176:0/3308123366 shutdown_connections 2024-09-12T02:38:44.693 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.692+0000 7fb4ef370640 1 --2- 172.21.15.176:0/3308123366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4e8107650 0x7fb4e8107a30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:44.694 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.692+0000 7fb4ef370640 1 -- 172.21.15.176:0/3308123366 >> 172.21.15.176:0/3308123366 conn(0x7fb4e80fd260 msgr2=0x7fb4e80ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:44.694 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.692+0000 7fb4ef370640 1 -- 172.21.15.176:0/3308123366 shutdown_connections 2024-09-12T02:38:44.694 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.692+0000 7fb4ef370640 1 -- 172.21.15.176:0/3308123366 wait complete. 2024-09-12T02:38:44.695 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.693+0000 7fb4ef370640 1 Processor -- start 2024-09-12T02:38:44.695 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.693+0000 7fb4ef370640 1 -- start start 2024-09-12T02:38:44.695 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.693+0000 7fb4ef370640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4e8107650 0x7fb4e8197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:44.695 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.693+0000 7fb4ef370640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e810bc80 con 0x7fb4e8107650 2024-09-12T02:38:44.695 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.693+0000 7fb4ed10c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4e8107650 0x7fb4e8197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:44.695 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.693+0000 7fb4ed10c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4e8107650 0x7fb4e8197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.176:42394/0 (socket says 172.21.15.176:42394) 2024-09-12T02:38:44.695 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.693+0000 7fb4ed10c640 1 -- 172.21.15.176:0/3717203607 learned_addr learned my addr 172.21.15.176:0/3717203607 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-12T02:38:44.696 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.694+0000 7fb4ed10c640 1 -- 172.21.15.176:0/3717203607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e8197650 con 0x7fb4e8107650 2024-09-12T02:38:44.696 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.694+0000 7fb4ed10c640 1 --2- 172.21.15.176:0/3717203607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4e8107650 0x7fb4e8197110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009230 tx=0x7fb4e4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:44.696 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.694+0000 7fb4de7fc640 1 -- 172.21.15.176:0/3717203607 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4e403f070 con 0x7fb4e8107650 2024-09-12T02:38:44.696 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.694+0000 7fb4ef370640 1 -- 172.21.15.176:0/3717203607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e81978e0 con 0x7fb4e8107650 2024-09-12T02:38:44.696 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.694+0000 7fb4de7fc640 1 -- 172.21.15.176:0/3717203607 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4e403bc80 con 0x7fb4e8107650 2024-09-12T02:38:44.696 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.694+0000 7fb4de7fc640 1 -- 172.21.15.176:0/3717203607 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4e4035030 con 0x7fb4e8107650 2024-09-12T02:38:44.696 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.694+0000 7fb4ef370640 1 -- 172.21.15.176:0/3717203607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e819b9e0 con 0x7fb4e8107650 2024-09-12T02:38:44.697 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.695+0000 7fb4de7fc640 1 -- 172.21.15.176:0/3717203607 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fb4e4042070 con 0x7fb4e8107650 2024-09-12T02:38:44.697 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.695+0000 7fb4ef370640 1 -- 172.21.15.176:0/3717203607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e8102cc0 con 0x7fb4e8107650 2024-09-12T02:38:44.697 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.695+0000 7fb4de7fc640 1 --2- 172.21.15.176:0/3717203607 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb4d4039060 0x7fb4d403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:44.697 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.695+0000 7fb4de7fc640 1 -- 172.21.15.176:0/3717203607 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb4e406cdc0 con 0x7fb4e8107650 2024-09-12T02:38:44.697 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.696+0000 7fb4ec90b640 1 --2- 172.21.15.176:0/3717203607 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb4d4039060 0x7fb4d403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:44.697 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.696+0000 7fb4ec90b640 1 --2- 172.21.15.176:0/3717203607 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb4d4039060 0x7fb4d403b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb4d80098c0 tx=0x7fb4d8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:44.701 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.701+0000 7fb4de7fc640 1 -- 172.21.15.176:0/3717203607 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb4e4031e20 con 0x7fb4e8107650 2024-09-12T02:38:44.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.884+0000 7fb4ef370640 1 -- 172.21.15.176:0/3717203607 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi018:172.21.15.18=a;smithi062:172.21.15.62=b;smithi176:172.21.15.176=c", "target": ["mon-mgr", ""]}) -- 0x7fb4e8198470 con 0x7fb4d4039060 2024-09-12T02:38:44.890 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.890+0000 7fb4de7fc640 1 -- 172.21.15.176:0/3717203607 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb4e8198470 con 0x7fb4d4039060 2024-09-12T02:38:44.891 INFO:teuthology.orchestra.run.smithi176.stdout:Scheduled mon update... 2024-09-12T02:38:44.894 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.893+0000 7fb4ef370640 1 -- 172.21.15.176:0/3717203607 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb4d4039060 msgr2=0x7fb4d403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:44.894 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.893+0000 7fb4ef370640 1 --2- 172.21.15.176:0/3717203607 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb4d4039060 0x7fb4d403b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb4d80098c0 tx=0x7fb4d8006db0 comp rx=0 tx=0).stop 2024-09-12T02:38:44.894 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.893+0000 7fb4ef370640 1 -- 172.21.15.176:0/3717203607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4e8107650 msgr2=0x7fb4e8197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:44.894 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.893+0000 7fb4ef370640 1 --2- 172.21.15.176:0/3717203607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4e8107650 0x7fb4e8197110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009230 tx=0x7fb4e4003d40 comp rx=0 tx=0).stop 2024-09-12T02:38:44.894 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.893+0000 7fb4ef370640 1 -- 172.21.15.176:0/3717203607 shutdown_connections 2024-09-12T02:38:44.894 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.893+0000 7fb4ef370640 1 --2- 172.21.15.176:0/3717203607 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb4d4039060 0x7fb4d403b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:44.894 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.893+0000 7fb4ef370640 1 --2- 172.21.15.176:0/3717203607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4e8107650 0x7fb4e8197110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:44.894 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.893+0000 7fb4ef370640 1 -- 172.21.15.176:0/3717203607 >> 172.21.15.176:0/3717203607 conn(0x7fb4e80fd260 msgr2=0x7fb4e80fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:44.894 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.893+0000 7fb4ef370640 1 -- 172.21.15.176:0/3717203607 shutdown_connections 2024-09-12T02:38:44.895 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:44.893+0000 7fb4ef370640 1 -- 172.21.15.176:0/3717203607 wait complete. 2024-09-12T02:38:45.548 DEBUG:teuthology.orchestra.run.smithi062:mon.b> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mon.b.service 2024-09-12T02:38:45.550 DEBUG:teuthology.orchestra.run.smithi176:mon.c> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mon.c.service 2024-09-12T02:38:45.553 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:38:45.553 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:38:45.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:45 smithi018 ceph-mon[30616]: Updating smithi176:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:38:45.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:45 smithi018 ceph-mon[30616]: Updating smithi176:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:38:45.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:45 smithi018 ceph-mon[30616]: Updating smithi176:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:38:45.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:45 smithi018 ceph-mon[30616]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:45.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:45.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:38:45.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:45.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:38:45.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:45.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:38:45.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:46.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:46 smithi018 ceph-mon[30616]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi018:172.21.15.18=a;smithi062:172.21.15.62=b;smithi176:172.21.15.176=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:46.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:46 smithi018 ceph-mon[30616]: Saving service mon spec with placement smithi018:172.21.15.18=a;smithi062:172.21.15.62=b;smithi176:172.21.15.176=c;count:3 2024-09-12T02:38:46.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:46 smithi018 ceph-mon[30616]: Deploying daemon mon.c on smithi176 2024-09-12T02:38:47.598 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:38:47.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:47 smithi018 ceph-mon[30616]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:48.181 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.172+0000 7f2c22816640 1 -- 172.21.15.176:0/826366500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c1c106660 msgr2=0x7f2c1c106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:48.182 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.172+0000 7f2c22816640 1 --2- 172.21.15.176:0/826366500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c1c106660 0x7f2c1c106a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c009880 tx=0x7f2c0c02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:38:48.182 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.172+0000 7f2c22816640 1 -- 172.21.15.176:0/826366500 shutdown_connections 2024-09-12T02:38:48.182 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.172+0000 7f2c22816640 1 --2- 172.21.15.176:0/826366500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c1c106660 0x7f2c1c106a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:48.182 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.172+0000 7f2c22816640 1 -- 172.21.15.176:0/826366500 >> 172.21.15.176:0/826366500 conn(0x7f2c1c0fc250 msgr2=0x7f2c1c0fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:48.182 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.172+0000 7f2c22816640 1 -- 172.21.15.176:0/826366500 shutdown_connections 2024-09-12T02:38:48.182 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.172+0000 7f2c22816640 1 -- 172.21.15.176:0/826366500 wait complete. 2024-09-12T02:38:48.182 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.172+0000 7f2c22816640 1 Processor -- start 2024-09-12T02:38:48.182 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.172+0000 7f2c22816640 1 -- start start 2024-09-12T02:38:48.182 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.173+0000 7f2c22816640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c1c106660 0x7f2c1c1980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:48.182 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.173+0000 7f2c22816640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c10ac90 con 0x7f2c1c106660 2024-09-12T02:38:48.183 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.173+0000 7f2c1bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c1c106660 0x7f2c1c1980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:48.183 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.173+0000 7f2c1bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c1c106660 0x7f2c1c1980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.176:42408/0 (socket says 172.21.15.176:42408) 2024-09-12T02:38:48.183 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.173+0000 7f2c1bfff640 1 -- 172.21.15.176:0/1992067473 learned_addr learned my addr 172.21.15.176:0/1992067473 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-12T02:38:48.183 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.174+0000 7f2c1bfff640 1 -- 172.21.15.176:0/1992067473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1c1985f0 con 0x7f2c1c106660 2024-09-12T02:38:48.183 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.174+0000 7f2c1bfff640 1 --2- 172.21.15.176:0/1992067473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c1c106660 0x7f2c1c1980b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c009230 tx=0x7f2c0c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:48.183 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.174+0000 7f2c197fa640 1 -- 172.21.15.176:0/1992067473 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c03f070 con 0x7f2c1c106660 2024-09-12T02:38:48.183 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.174+0000 7f2c22816640 1 -- 172.21.15.176:0/1992067473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c1c198880 con 0x7f2c1c106660 2024-09-12T02:38:48.183 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.174+0000 7f2c197fa640 1 -- 172.21.15.176:0/1992067473 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c0c03bc80 con 0x7f2c1c106660 2024-09-12T02:38:48.183 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.174+0000 7f2c197fa640 1 -- 172.21.15.176:0/1992067473 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c035030 con 0x7f2c1c106660 2024-09-12T02:38:48.183 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.174+0000 7f2c22816640 1 -- 172.21.15.176:0/1992067473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c1c198ce0 con 0x7f2c1c106660 2024-09-12T02:38:48.183 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.175+0000 7f2c197fa640 1 -- 172.21.15.176:0/1992067473 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2c0c042070 con 0x7f2c1c106660 2024-09-12T02:38:48.183 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.175+0000 7f2c22816640 1 -- 172.21.15.176:0/1992067473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c1c101cd0 con 0x7f2c1c106660 2024-09-12T02:38:48.183 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.175+0000 7f2c197fa640 1 --2- 172.21.15.176:0/1992067473 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2c04039060 0x7f2c0403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:48.183 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.175+0000 7f2c197fa640 1 -- 172.21.15.176:0/1992067473 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2c0c06cd10 con 0x7f2c1c106660 2024-09-12T02:38:48.184 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.176+0000 7f2c1b7fe640 1 --2- 172.21.15.176:0/1992067473 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2c04039060 0x7f2c0403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:48.184 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.177+0000 7f2c1b7fe640 1 --2- 172.21.15.176:0/1992067473 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2c04039060 0x7f2c0403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2c100098c0 tx=0x7f2c10006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:48.184 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.181+0000 7f2c197fa640 1 -- 172.21.15.176:0/1992067473 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2c0c031e20 con 0x7f2c1c106660 2024-09-12T02:38:48.426 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.425+0000 7f2c22816640 1 -- 172.21.15.176:0/1992067473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f2c1c106ac0 con 0x7f2c1c106660 2024-09-12T02:38:48.427 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.426+0000 7f2c197fa640 1 -- 172.21.15.176:0/1992067473 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f2c0c0372d0 con 0x7f2c1c106660 2024-09-12T02:38:48.427 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:38:48.427 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"c7666100-70af-11ef-bcea-c7b262605968","modified":"2024-09-12T02:37:09.409832Z","created":"2024-09-12T02:37:09.409832Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T02:38:48.427 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-12T02:38:48.429 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.428+0000 7f2c22816640 1 -- 172.21.15.176:0/1992067473 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2c04039060 msgr2=0x7f2c0403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:48.429 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.428+0000 7f2c22816640 1 --2- 172.21.15.176:0/1992067473 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2c04039060 0x7f2c0403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2c100098c0 tx=0x7f2c10006db0 comp rx=0 tx=0).stop 2024-09-12T02:38:48.429 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.428+0000 7f2c22816640 1 -- 172.21.15.176:0/1992067473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c1c106660 msgr2=0x7f2c1c1980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:48.429 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.428+0000 7f2c22816640 1 --2- 172.21.15.176:0/1992067473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c1c106660 0x7f2c1c1980b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c009230 tx=0x7f2c0c003d40 comp rx=0 tx=0).stop 2024-09-12T02:38:48.429 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.428+0000 7f2c22816640 1 -- 172.21.15.176:0/1992067473 shutdown_connections 2024-09-12T02:38:48.429 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.428+0000 7f2c22816640 1 --2- 172.21.15.176:0/1992067473 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2c04039060 0x7f2c0403b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:48.429 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.428+0000 7f2c22816640 1 --2- 172.21.15.176:0/1992067473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c1c106660 0x7f2c1c1980b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:48.430 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.428+0000 7f2c22816640 1 -- 172.21.15.176:0/1992067473 >> 172.21.15.176:0/1992067473 conn(0x7f2c1c0fc250 msgr2=0x7f2c1c0fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:48.430 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.428+0000 7f2c22816640 1 -- 172.21.15.176:0/1992067473 shutdown_connections 2024-09-12T02:38:48.430 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:48.428+0000 7f2c22816640 1 -- 172.21.15.176:0/1992067473 wait complete. 2024-09-12T02:38:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:48 smithi018 ceph-mon[30616]: from='client.? 172.21.15.176:0/1992067473' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:38:49.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:49 smithi176 systemd[1]: Started Ceph mon.c for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:38:49.988 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:38:49.988 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:38:50.240 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:38:54.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:38:54.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: mon.a calling monitor election 2024-09-12T02:38:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: mon.c calling monitor election 2024-09-12T02:38:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:54.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:38:54.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: monmap epoch 2 2024-09-12T02:38:54.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: fsid c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:38:54.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: last_changed 2024-09-12T02:38:49.614777+0000 2024-09-12T02:38:54.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: created 2024-09-12T02:37:09.409832+0000 2024-09-12T02:38:54.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: min_mon_release 19 (squid) 2024-09-12T02:38:54.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: election_strategy: 1 2024-09-12T02:38:54.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-12T02:38:54.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.c 2024-09-12T02:38:54.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: fsmap 2024-09-12T02:38:54.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:38:54.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: mgrmap e13: x(active, since 44s) 2024-09-12T02:38:54.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: overall HEALTH_OK 2024-09-12T02:38:54.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:54.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:54.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:54.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:38:54.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:55.062 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.061+0000 7f497b5d3640 1 -- 172.21.15.176:0/2553553541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f495c003530 msgr2=0x7f495c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:55.062 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.061+0000 7f497b5d3640 1 --2- 172.21.15.176:0/2553553541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f495c003530 0x7f495c0059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f49741016c0 tx=0x7f496402bfe0 comp rx=0 tx=0).stop 2024-09-12T02:38:55.063 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.061+0000 7f497b5d3640 1 -- 172.21.15.176:0/2553553541 shutdown_connections 2024-09-12T02:38:55.063 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.061+0000 7f497b5d3640 1 --2- 172.21.15.176:0/2553553541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f495c003530 0x7f495c0059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:55.063 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.061+0000 7f497b5d3640 1 -- 172.21.15.176:0/2553553541 >> 172.21.15.176:0/2553553541 conn(0x7f49740fc280 msgr2=0x7f49740fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:55.063 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.061+0000 7f497b5d3640 1 -- 172.21.15.176:0/2553553541 shutdown_connections 2024-09-12T02:38:55.063 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.061+0000 7f497b5d3640 1 -- 172.21.15.176:0/2553553541 wait complete. 2024-09-12T02:38:55.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.062+0000 7f497b5d3640 1 Processor -- start 2024-09-12T02:38:55.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.062+0000 7f497b5d3640 1 -- start start 2024-09-12T02:38:55.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.062+0000 7f497b5d3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f495c003530 0x7f4974195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:55.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.062+0000 7f497b5d3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4974196400 0x7f4974196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:55.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.062+0000 7f497b5d3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4974108690 con 0x7f4974196400 2024-09-12T02:38:55.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.062+0000 7f497b5d3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4974108510 con 0x7f495c003530 2024-09-12T02:38:55.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.063+0000 7f497936f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f495c003530 0x7f4974195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:55.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.063+0000 7f497936f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f495c003530 0x7f4974195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:50748/0 (socket says 172.21.15.176:50748) 2024-09-12T02:38:55.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.063+0000 7f497936f640 1 -- 172.21.15.176:0/1193874329 learned_addr learned my addr 172.21.15.176:0/1193874329 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-12T02:38:55.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.063+0000 7f497936f640 1 -- 172.21.15.176:0/1193874329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f495c003530 msgr2=0x7f4974195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T02:38:55.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.063+0000 7f497936f640 1 -- 172.21.15.176:0/1193874329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f495c003530 msgr2=0x7f4974195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:38:55.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.063+0000 7f497936f640 1 --2- 172.21.15.176:0/1193874329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f495c003530 0x7f4974195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:38:55.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.063+0000 7f497936f640 1 --2- 172.21.15.176:0/1193874329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f495c003530 0x7f4974195ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:55.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.063+0000 7f4978b6e640 1 --2- 172.21.15.176:0/1193874329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4974196400 0x7f4974196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:55.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.063+0000 7f4978b6e640 1 -- 172.21.15.176:0/1193874329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f495c003530 msgr2=0x7f4974195ec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:38:55.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.063+0000 7f4978b6e640 1 --2- 172.21.15.176:0/1193874329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f495c003530 0x7f4974195ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:55.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.063+0000 7f4978b6e640 1 -- 172.21.15.176:0/1193874329 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497406aa10 con 0x7f4974196400 2024-09-12T02:38:55.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.063+0000 7f4978b6e640 1 --2- 172.21.15.176:0/1193874329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4974196400 0x7f4974196860 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f496800b400 tx=0x7f496800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:55.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.064+0000 7f49727fc640 1 -- 172.21.15.176:0/1193874329 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f4968011630 con 0x7f4974196400 2024-09-12T02:38:55.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.064+0000 7f49727fc640 1 -- 172.21.15.176:0/1193874329 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4968011cb0 con 0x7f4974196400 2024-09-12T02:38:55.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.064+0000 7f497b5d3640 1 -- 172.21.15.176:0/1193874329 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49741a3530 con 0x7f4974196400 2024-09-12T02:38:55.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.064+0000 7f49727fc640 1 -- 172.21.15.176:0/1193874329 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f4968010d80 con 0x7f4974196400 2024-09-12T02:38:55.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.064+0000 7f497b5d3640 1 -- 172.21.15.176:0/1193874329 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49741a3a30 con 0x7f4974196400 2024-09-12T02:38:55.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.065+0000 7f49727fc640 1 -- 172.21.15.176:0/1193874329 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f4968018020 con 0x7f4974196400 2024-09-12T02:38:55.068 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.065+0000 7f49727fc640 1 --2- 172.21.15.176:0/1193874329 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4960038e50 0x7f496003b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:55.068 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.065+0000 7f49727fc640 1 -- 172.21.15.176:0/1193874329 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f496804bb60 con 0x7f4974196400 2024-09-12T02:38:55.068 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.065+0000 7f497b5d3640 1 -- 172.21.15.176:0/1193874329 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4974101cc0 con 0x7f4974196400 2024-09-12T02:38:55.068 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.066+0000 7f497936f640 1 --2- 172.21.15.176:0/1193874329 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4960038e50 0x7f496003b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:55.068 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.066+0000 7f497936f640 1 --2- 172.21.15.176:0/1193874329 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4960038e50 0x7f496003b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4964009b30 tx=0x7f4964005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:55.071 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.071+0000 7f49727fc640 1 -- 172.21.15.176:0/1193874329 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f496801f020 con 0x7f4974196400 2024-09-12T02:38:55.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:38:55.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:55.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: mon.a calling monitor election 2024-09-12T02:38:55.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:55.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:55.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: mon.c calling monitor election 2024-09-12T02:38:55.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:55.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:55.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:55.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:55.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:55.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:38:55.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: monmap epoch 2 2024-09-12T02:38:55.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: fsid c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:38:55.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: last_changed 2024-09-12T02:38:49.614777+0000 2024-09-12T02:38:55.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: created 2024-09-12T02:37:09.409832+0000 2024-09-12T02:38:55.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: min_mon_release 19 (squid) 2024-09-12T02:38:55.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: election_strategy: 1 2024-09-12T02:38:55.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-12T02:38:55.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.c 2024-09-12T02:38:55.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: fsmap 2024-09-12T02:38:55.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:38:55.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: mgrmap e13: x(active, since 44s) 2024-09-12T02:38:55.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: overall HEALTH_OK 2024-09-12T02:38:55.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:55.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:55.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:55.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:38:55.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:55.310 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.309+0000 7f497b5d3640 1 -- 172.21.15.176:0/1193874329 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f497418fdf0 con 0x7f4974196400 2024-09-12T02:38:55.311 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.310+0000 7f49727fc640 1 -- 172.21.15.176:0/1193874329 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f4968018310 con 0x7f4974196400 2024-09-12T02:38:55.311 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:38:55.311 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":2,"fsid":"c7666100-70af-11ef-bcea-c7b262605968","modified":"2024-09-12T02:38:49.614777Z","created":"2024-09-12T02:37:09.409832Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:3300","nonce":0},{"type":"v1","addr":"172.21.15.176:6789","nonce":0}]},"addr":"172.21.15.176:6789/0","public_addr":"172.21.15.176:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T02:38:55.311 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 2 2024-09-12T02:38:55.313 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.312+0000 7f497b5d3640 1 -- 172.21.15.176:0/1193874329 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4960038e50 msgr2=0x7f496003b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:55.313 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.312+0000 7f497b5d3640 1 --2- 172.21.15.176:0/1193874329 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4960038e50 0x7f496003b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4964009b30 tx=0x7f4964005c50 comp rx=0 tx=0).stop 2024-09-12T02:38:55.313 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.312+0000 7f497b5d3640 1 -- 172.21.15.176:0/1193874329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4974196400 msgr2=0x7f4974196860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:55.314 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.312+0000 7f497b5d3640 1 --2- 172.21.15.176:0/1193874329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4974196400 0x7f4974196860 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f496800b400 tx=0x7f496800b8c0 comp rx=0 tx=0).stop 2024-09-12T02:38:55.314 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.312+0000 7f497b5d3640 1 -- 172.21.15.176:0/1193874329 shutdown_connections 2024-09-12T02:38:55.314 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.312+0000 7f497b5d3640 1 --2- 172.21.15.176:0/1193874329 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4960038e50 0x7f496003b310 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:55.314 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.312+0000 7f497b5d3640 1 --2- 172.21.15.176:0/1193874329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4974196400 0x7f4974196860 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:55.314 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.312+0000 7f497b5d3640 1 --2- 172.21.15.176:0/1193874329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f495c003530 0x7f4974195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:55.314 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.312+0000 7f497b5d3640 1 -- 172.21.15.176:0/1193874329 >> 172.21.15.176:0/1193874329 conn(0x7f49740fc280 msgr2=0x7f49740fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:55.314 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.312+0000 7f497b5d3640 1 -- 172.21.15.176:0/1193874329 shutdown_connections 2024-09-12T02:38:55.314 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:55.312+0000 7f497b5d3640 1 -- 172.21.15.176:0/1193874329 wait complete. 2024-09-12T02:38:55.902 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:55 smithi176 ceph-mon[35713]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:55.902 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:55 smithi176 ceph-mon[35713]: Deploying daemon mon.b on smithi062 2024-09-12T02:38:55.902 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:55 smithi176 ceph-mon[35713]: from='client.? 172.21.15.176:0/1193874329' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:38:55.902 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:55 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:56.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:55 smithi018 ceph-mon[30616]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:56.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:55 smithi018 ceph-mon[30616]: Deploying daemon mon.b on smithi062 2024-09-12T02:38:56.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:55 smithi018 ceph-mon[30616]: from='client.? 172.21.15.176:0/1193874329' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:38:56.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:55 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:56.929 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:38:56.930 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:38:57.179 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:38:57.571 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.566+0000 7fe1e211f640 1 -- 172.21.15.176:0/2079767943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1dc102820 msgr2=0x7fe1dc102c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:57.572 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.566+0000 7fe1e211f640 1 --2- 172.21.15.176:0/2079767943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1dc102820 0x7fe1dc102c00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009880 tx=0x7fe1cc02a670 comp rx=0 tx=0).stop 2024-09-12T02:38:57.572 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.566+0000 7fe1e211f640 1 -- 172.21.15.176:0/2079767943 shutdown_connections 2024-09-12T02:38:57.572 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.566+0000 7fe1e211f640 1 --2- 172.21.15.176:0/2079767943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1dc102820 0x7fe1dc102c00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.572 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.566+0000 7fe1e211f640 1 -- 172.21.15.176:0/2079767943 >> 172.21.15.176:0/2079767943 conn(0x7fe1dc0fc220 msgr2=0x7fe1dc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:57.572 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.566+0000 7fe1e211f640 1 -- 172.21.15.176:0/2079767943 shutdown_connections 2024-09-12T02:38:57.572 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.566+0000 7fe1e211f640 1 -- 172.21.15.176:0/2079767943 wait complete. 2024-09-12T02:38:57.572 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.567+0000 7fe1e211f640 1 Processor -- start 2024-09-12T02:38:57.572 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.567+0000 7fe1e211f640 1 -- start start 2024-09-12T02:38:57.572 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.568+0000 7fe1e211f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1dc102820 0x7fe1dc197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.572 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.568+0000 7fe1e211f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1dc197970 0x7fe1dc19bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.572 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.568+0000 7fe1e211f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc10bd70 con 0x7fe1dc102820 2024-09-12T02:38:57.573 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.568+0000 7fe1e211f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc10bbf0 con 0x7fe1dc197970 2024-09-12T02:38:57.573 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.568+0000 7fe1daffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1dc197970 0x7fe1dc19bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.573 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.568+0000 7fe1daffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1dc197970 0x7fe1dc19bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:50752/0 (socket says 172.21.15.176:50752) 2024-09-12T02:38:57.573 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.568+0000 7fe1daffd640 1 -- 172.21.15.176:0/178116567 learned_addr learned my addr 172.21.15.176:0/178116567 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-12T02:38:57.573 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.568+0000 7fe1db7fe640 1 --2- 172.21.15.176:0/178116567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1dc102820 0x7fe1dc197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.573 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.568+0000 7fe1daffd640 1 -- 172.21.15.176:0/178116567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1dc197970 msgr2=0x7fe1dc19bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T02:38:57.573 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.568+0000 7fe1daffd640 1 -- 172.21.15.176:0/178116567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1dc197970 msgr2=0x7fe1dc19bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:38:57.573 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.568+0000 7fe1daffd640 1 --2- 172.21.15.176:0/178116567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1dc197970 0x7fe1dc19bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:38:57.573 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.568+0000 7fe1daffd640 1 --2- 172.21.15.176:0/178116567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1dc197970 0x7fe1dc19bd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:57.573 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.568+0000 7fe1db7fe640 1 -- 172.21.15.176:0/178116567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1dc197970 msgr2=0x7fe1dc19bd00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.568+0000 7fe1db7fe640 1 --2- 172.21.15.176:0/178116567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1dc197970 0x7fe1dc19bd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.568+0000 7fe1db7fe640 1 -- 172.21.15.176:0/178116567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1dc197f90 con 0x7fe1dc102820 2024-09-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.568+0000 7fe1db7fe640 1 --2- 172.21.15.176:0/178116567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1dc102820 0x7fe1dc197430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc006010 tx=0x7fe1cc032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.569+0000 7fe1d8ff9640 1 -- 172.21.15.176:0/178116567 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe1cc035070 con 0x7fe1dc102820 2024-09-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.569+0000 7fe1d8ff9640 1 -- 172.21.15.176:0/178116567 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1cc032e40 con 0x7fe1dc102820 2024-09-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.569+0000 7fe1e211f640 1 -- 172.21.15.176:0/178116567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1dc19c240 con 0x7fe1dc102820 2024-09-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.569+0000 7fe1d8ff9640 1 -- 172.21.15.176:0/178116567 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe1cc03bb50 con 0x7fe1dc102820 2024-09-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.569+0000 7fe1e211f640 1 -- 172.21.15.176:0/178116567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1dc19c720 con 0x7fe1dc102820 2024-09-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.570+0000 7fe1e211f640 1 -- 172.21.15.176:0/178116567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1dc06ad10 con 0x7fe1dc102820 2024-09-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.570+0000 7fe1d8ff9640 1 -- 172.21.15.176:0/178116567 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fe1cc042030 con 0x7fe1dc102820 2024-09-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.570+0000 7fe1d8ff9640 1 --2- 172.21.15.176:0/178116567 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe1c4038e50 0x7fe1c403b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.570+0000 7fe1d8ff9640 1 -- 172.21.15.176:0/178116567 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe1cc040070 con 0x7fe1dc102820 2024-09-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.570+0000 7fe1daffd640 1 --2- 172.21.15.176:0/178116567 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe1c4038e50 0x7fe1c403b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:57.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.571+0000 7fe1daffd640 1 --2- 172.21.15.176:0/178116567 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe1c4038e50 0x7fe1c403b310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009100 tx=0x7fe1d0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:57.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.575+0000 7fe1d8ff9640 1 -- 172.21.15.176:0/178116567 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe1cc04a260 con 0x7fe1dc102820 2024-09-12T02:38:57.806 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.805+0000 7fe1e211f640 1 -- 172.21.15.176:0/178116567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe1dc19c9d0 con 0x7fe1dc102820 2024-09-12T02:38:57.806 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.805+0000 7fe1d8ff9640 1 -- 172.21.15.176:0/178116567 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fe1cc03bdb0 con 0x7fe1dc102820 2024-09-12T02:38:57.806 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:38:57.807 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":2,"fsid":"c7666100-70af-11ef-bcea-c7b262605968","modified":"2024-09-12T02:38:49.614777Z","created":"2024-09-12T02:37:09.409832Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:3300","nonce":0},{"type":"v1","addr":"172.21.15.176:6789","nonce":0}]},"addr":"172.21.15.176:6789/0","public_addr":"172.21.15.176:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T02:38:57.807 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 2 2024-09-12T02:38:57.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.808+0000 7fe1e211f640 1 -- 172.21.15.176:0/178116567 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe1c4038e50 msgr2=0x7fe1c403b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:57.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.808+0000 7fe1e211f640 1 --2- 172.21.15.176:0/178116567 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe1c4038e50 0x7fe1c403b310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009100 tx=0x7fe1d0008040 comp rx=0 tx=0).stop 2024-09-12T02:38:57.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.808+0000 7fe1e211f640 1 -- 172.21.15.176:0/178116567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1dc102820 msgr2=0x7fe1dc197430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:57.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.808+0000 7fe1e211f640 1 --2- 172.21.15.176:0/178116567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1dc102820 0x7fe1dc197430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc006010 tx=0x7fe1cc032c50 comp rx=0 tx=0).stop 2024-09-12T02:38:57.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.808+0000 7fe1e211f640 1 -- 172.21.15.176:0/178116567 shutdown_connections 2024-09-12T02:38:57.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.808+0000 7fe1e211f640 1 --2- 172.21.15.176:0/178116567 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe1c4038e50 0x7fe1c403b310 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.808+0000 7fe1e211f640 1 --2- 172.21.15.176:0/178116567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1dc197970 0x7fe1dc19bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.808+0000 7fe1e211f640 1 --2- 172.21.15.176:0/178116567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1dc102820 0x7fe1dc197430 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:57.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.808+0000 7fe1e211f640 1 -- 172.21.15.176:0/178116567 >> 172.21.15.176:0/178116567 conn(0x7fe1dc0fc220 msgr2=0x7fe1dc1055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:57.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.808+0000 7fe1e211f640 1 -- 172.21.15.176:0/178116567 shutdown_connections 2024-09-12T02:38:57.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:38:57.808+0000 7fe1e211f640 1 -- 172.21.15.176:0/178116567 wait complete. 2024-09-12T02:38:57.817 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:38:57 smithi176 ceph-mon[35713]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:58.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:38:57 smithi018 ceph-mon[30616]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:58.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 podman[35507]: 2024-09-12 02:38:58.088120581 +0000 UTC m=+0.015752786 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:38:58.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 podman[35507]: 2024-09-12 02:38:58.4559501 +0000 UTC m=+0.383582284 container init 6ea4dc7aab4bf26c6e3ad7101557c52f54157dc5ca173c60674a35093fe257da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-12T02:38:58.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 podman[35507]: 2024-09-12 02:38:58.459193133 +0000 UTC m=+0.386825319 container start 6ea4dc7aab4bf26c6e3ad7101557c52f54157dc5ca173c60674a35093fe257da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-12T02:38:58.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T02:38:58.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T02:38:58.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: pidfile_write: ignore empty --pid-file 2024-09-12T02:38:58.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: load: jerasure load: lrc 2024-09-12T02:38:58.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: RocksDB version: 7.9.2 2024-09-12T02:38:58.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Git sha 0 2024-09-12T02:38:58.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T02:38:58.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: DB SUMMARY 2024-09-12T02:38:58.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: DB Session ID: IEP0WYWL08I7Y6WG05W6 2024-09-12T02:38:58.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: CURRENT file: CURRENT 2024-09-12T02:38:58.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T02:38:58.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-12T02:38:58.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-12T02:38:58.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-12T02:38:58.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.error_if_exists: 0 2024-09-12T02:38:58.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.create_if_missing: 0 2024-09-12T02:38:58.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.paranoid_checks: 1 2024-09-12T02:38:58.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T02:38:58.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T02:38:58.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T02:38:58.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.env: 0x5589c588b940 2024-09-12T02:38:58.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T02:38:58.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.info_log: 0x5589c6ee96e0 2024-09-12T02:38:58.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T02:38:58.787 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.statistics: (nil) 2024-09-12T02:38:58.788 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.use_fsync: 0 2024-09-12T02:38:58.788 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_log_file_size: 0 2024-09-12T02:38:58.788 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T02:38:58.788 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T02:38:58.788 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T02:38:58.788 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T02:38:58.788 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.allow_fallocate: 1 2024-09-12T02:38:58.788 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T02:38:58.788 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T02:38:58.788 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.use_direct_reads: 0 2024-09-12T02:38:58.788 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T02:38:58.789 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T02:38:58.789 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.db_log_dir: 2024-09-12T02:38:58.789 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.wal_dir: 2024-09-12T02:38:58.789 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T02:38:58.789 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T02:38:58.789 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T02:38:58.789 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T02:38:58.789 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T02:38:58.789 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T02:38:58.789 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T02:38:58.789 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T02:38:58.789 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.write_buffer_manager: 0x5589c6ef8dc0 2024-09-12T02:38:58.790 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T02:38:58.790 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T02:38:58.790 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T02:38:58.790 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T02:38:58.790 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T02:38:58.790 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T02:38:58.790 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T02:38:58.790 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T02:38:58.790 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.unordered_write: 0 2024-09-12T02:38:58.790 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T02:38:58.790 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T02:38:58.790 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T02:38:58.790 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T02:38:58.790 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.row_cache: None 2024-09-12T02:38:58.791 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.wal_filter: None 2024-09-12T02:38:58.791 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T02:38:58.791 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T02:38:58.791 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.two_write_queues: 0 2024-09-12T02:38:58.791 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T02:38:58.791 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.wal_compression: 0 2024-09-12T02:38:58.791 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.atomic_flush: 0 2024-09-12T02:38:58.791 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T02:38:58.791 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T02:38:58.791 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T02:38:58.791 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.log_readahead_size: 0 2024-09-12T02:38:58.792 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T02:38:58.792 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T02:38:58.792 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T02:38:58.792 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T02:38:58.792 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T02:38:58.792 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T02:38:58.792 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T02:38:58.792 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_background_jobs: 2 2024-09-12T02:38:58.792 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_background_compactions: -1 2024-09-12T02:38:58.792 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_subcompactions: 1 2024-09-12T02:38:58.793 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T02:38:58.793 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T02:38:58.793 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T02:38:58.793 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T02:38:58.793 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T02:38:58.793 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T02:38:58.793 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T02:38:58.793 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T02:38:58.793 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_open_files: -1 2024-09-12T02:38:58.793 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T02:38:58.793 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T02:38:58.794 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T02:38:58.794 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T02:38:58.794 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_background_flushes: -1 2024-09-12T02:38:58.794 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Compression algorithms supported: 2024-09-12T02:38:58.794 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: kZSTD supported: 0 2024-09-12T02:38:58.794 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: kXpressCompression supported: 0 2024-09-12T02:38:58.794 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: kBZip2Compression supported: 0 2024-09-12T02:38:58.794 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T02:38:58.794 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: kLZ4Compression supported: 1 2024-09-12T02:38:58.794 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: kZlibCompression supported: 1 2024-09-12T02:38:58.794 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T02:38:58.794 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: kSnappyCompression supported: 1 2024-09-12T02:38:58.795 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T02:38:58.795 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T02:38:58.795 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-12T02:38:58.795 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T02:38:58.795 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T02:38:58.795 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.merge_operator: 2024-09-12T02:38:58.795 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compaction_filter: None 2024-09-12T02:38:58.795 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T02:38:58.795 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T02:38:58.795 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T02:38:58.795 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T02:38:58.795 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5589c6ee9320) 2024-09-12T02:38:58.795 INFO:journalctl@ceph.mon.b.smithi062.stdout: cache_index_and_filter_blocks: 1 2024-09-12T02:38:58.795 INFO:journalctl@ceph.mon.b.smithi062.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T02:38:58.796 INFO:journalctl@ceph.mon.b.smithi062.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T02:38:58.796 INFO:journalctl@ceph.mon.b.smithi062.stdout: pin_top_level_index_and_filter: 1 2024-09-12T02:38:58.796 INFO:journalctl@ceph.mon.b.smithi062.stdout: index_type: 0 2024-09-12T02:38:58.796 INFO:journalctl@ceph.mon.b.smithi062.stdout: data_block_index_type: 0 2024-09-12T02:38:58.796 INFO:journalctl@ceph.mon.b.smithi062.stdout: index_shortening: 1 2024-09-12T02:38:58.796 INFO:journalctl@ceph.mon.b.smithi062.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T02:38:58.796 INFO:journalctl@ceph.mon.b.smithi062.stdout: checksum: 4 2024-09-12T02:38:58.796 INFO:journalctl@ceph.mon.b.smithi062.stdout: no_block_cache: 0 2024-09-12T02:38:58.796 INFO:journalctl@ceph.mon.b.smithi062.stdout: block_cache: 0x5589c6edd1f0 2024-09-12T02:38:58.796 INFO:journalctl@ceph.mon.b.smithi062.stdout: block_cache_name: BinnedLRUCache 2024-09-12T02:38:58.796 INFO:journalctl@ceph.mon.b.smithi062.stdout: block_cache_options: 2024-09-12T02:38:58.796 INFO:journalctl@ceph.mon.b.smithi062.stdout: capacity : 536870912 2024-09-12T02:38:58.797 INFO:journalctl@ceph.mon.b.smithi062.stdout: num_shard_bits : 4 2024-09-12T02:38:58.797 INFO:journalctl@ceph.mon.b.smithi062.stdout: strict_capacity_limit : 0 2024-09-12T02:38:58.797 INFO:journalctl@ceph.mon.b.smithi062.stdout: high_pri_pool_ratio: 0.000 2024-09-12T02:38:58.797 INFO:journalctl@ceph.mon.b.smithi062.stdout: block_cache_compressed: (nil) 2024-09-12T02:38:58.797 INFO:journalctl@ceph.mon.b.smithi062.stdout: persistent_cache: (nil) 2024-09-12T02:38:58.797 INFO:journalctl@ceph.mon.b.smithi062.stdout: block_size: 4096 2024-09-12T02:38:58.797 INFO:journalctl@ceph.mon.b.smithi062.stdout: block_size_deviation: 10 2024-09-12T02:38:58.797 INFO:journalctl@ceph.mon.b.smithi062.stdout: block_restart_interval: 16 2024-09-12T02:38:58.797 INFO:journalctl@ceph.mon.b.smithi062.stdout: index_block_restart_interval: 1 2024-09-12T02:38:58.797 INFO:journalctl@ceph.mon.b.smithi062.stdout: metadata_block_size: 4096 2024-09-12T02:38:58.797 INFO:journalctl@ceph.mon.b.smithi062.stdout: partition_filters: 0 2024-09-12T02:38:58.797 INFO:journalctl@ceph.mon.b.smithi062.stdout: use_delta_encoding: 1 2024-09-12T02:38:58.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: filter_policy: bloomfilter 2024-09-12T02:38:58.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: whole_key_filtering: 1 2024-09-12T02:38:58.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: verify_compression: 0 2024-09-12T02:38:58.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: read_amp_bytes_per_bit: 0 2024-09-12T02:38:58.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: format_version: 5 2024-09-12T02:38:58.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: enable_index_compression: 1 2024-09-12T02:38:58.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: block_align: 0 2024-09-12T02:38:58.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: max_auto_readahead_size: 262144 2024-09-12T02:38:58.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: prepopulate_block_cache: 0 2024-09-12T02:38:58.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: initial_auto_readahead_size: 8192 2024-09-12T02:38:58.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T02:38:58.798 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T02:38:58.798 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T02:38:58.798 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compression: NoCompression 2024-09-12T02:38:58.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T02:38:58.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T02:38:58.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T02:38:58.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.num_levels: 7 2024-09-12T02:38:58.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T02:38:58.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T02:38:58.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T02:38:58.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T02:38:58.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T02:38:58.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T02:38:58.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T02:38:58.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:38:58.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T02:38:58.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T02:38:58.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:38:58.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:38:58.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T02:38:58.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T02:38:58.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T02:38:58.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T02:38:58.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:38:58.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:38:58.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T02:38:58.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T02:38:58.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:38:58.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T02:38:58.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T02:38:58.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T02:38:58.801 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T02:38:58.801 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T02:38:58.801 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T02:38:58.801 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T02:38:58.801 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T02:38:58.801 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T02:38:58.801 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T02:38:58.801 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T02:38:58.801 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T02:38:58.801 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T02:38:58.801 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T02:38:58.801 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T02:38:58.801 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T02:38:58.802 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T02:38:58.802 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T02:38:58.802 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T02:38:58.802 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T02:38:58.802 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T02:38:58.802 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T02:38:58.802 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T02:38:58.802 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T02:38:58.802 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T02:38:58.802 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T02:38:58.802 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T02:38:58.802 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T02:38:58.802 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T02:38:58.803 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T02:38:58.803 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T02:38:58.803 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T02:38:58.803 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T02:38:58.803 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.inplace_update_support: 0 2024-09-12T02:38:58.803 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T02:38:58.803 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T02:38:58.803 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T02:38:58.803 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T02:38:58.803 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.bloom_locality: 0 2024-09-12T02:38:58.803 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.max_successive_merges: 0 2024-09-12T02:38:58.803 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T02:38:58.803 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T02:38:58.804 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T02:38:58.804 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T02:38:58.804 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.ttl: 2592000 2024-09-12T02:38:58.804 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T02:38:58.804 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T02:38:58.804 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T02:38:58.804 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.enable_blob_files: false 2024-09-12T02:38:58.804 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.min_blob_size: 0 2024-09-12T02:38:58.804 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T02:38:58.804 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T02:38:58.804 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T02:38:58.804 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T02:38:58.804 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T02:38:58.804 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T02:38:58.805 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T02:38:58.805 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T02:38:58.805 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-12T02:38:58.805 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-12T02:38:58.805 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: edc701d7-950c-4e0e-a23f-50af20149ab9 2024-09-12T02:38:58.805 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108738486413, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-12T02:38:58.805 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-12T02:38:58.805 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108738486812, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726108738, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "edc701d7-950c-4e0e-a23f-50af20149ab9", "db_session_id": "IEP0WYWL08I7Y6WG05W6", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-12T02:38:58.805 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108738486905, "job": 1, "event": "recovery_finished"} 2024-09-12T02:38:58.805 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-12T02:38:58.805 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T02:38:58.805 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5589c6f0ae00 2024-09-12T02:38:58.805 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: DB pointer 0x5589c7006000 2024-09-12T02:38:58.806 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T02:38:58.806 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T02:38:58.806 INFO:journalctl@ceph.mon.b.smithi062.stdout: ** DB Stats ** 2024-09-12T02:38:58.806 INFO:journalctl@ceph.mon.b.smithi062.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:38:58.806 INFO:journalctl@ceph.mon.b.smithi062.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T02:38:58.806 INFO:journalctl@ceph.mon.b.smithi062.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:38:58.806 INFO:journalctl@ceph.mon.b.smithi062.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:38:58.806 INFO:journalctl@ceph.mon.b.smithi062.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T02:38:58.806 INFO:journalctl@ceph.mon.b.smithi062.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:38:58.806 INFO:journalctl@ceph.mon.b.smithi062.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:38:58.806 INFO:journalctl@ceph.mon.b.smithi062.stdout: 2024-09-12T02:38:58.806 INFO:journalctl@ceph.mon.b.smithi062.stdout: ** Compaction Stats [default] ** 2024-09-12T02:38:58.807 INFO:journalctl@ceph.mon.b.smithi062.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:38:58.807 INFO:journalctl@ceph.mon.b.smithi062.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T02:38:58.807 INFO:journalctl@ceph.mon.b.smithi062.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:38:58.807 INFO:journalctl@ceph.mon.b.smithi062.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:38:58.807 INFO:journalctl@ceph.mon.b.smithi062.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:38:58.807 INFO:journalctl@ceph.mon.b.smithi062.stdout: 2024-09-12T02:38:58.807 INFO:journalctl@ceph.mon.b.smithi062.stdout: ** Compaction Stats [default] ** 2024-09-12T02:38:58.807 INFO:journalctl@ceph.mon.b.smithi062.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:38:58.807 INFO:journalctl@ceph.mon.b.smithi062.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T02:38:58.807 INFO:journalctl@ceph.mon.b.smithi062.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:38:58.807 INFO:journalctl@ceph.mon.b.smithi062.stdout: 2024-09-12T02:38:58.807 INFO:journalctl@ceph.mon.b.smithi062.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T02:38:58.807 INFO:journalctl@ceph.mon.b.smithi062.stdout: 2024-09-12T02:38:58.807 INFO:journalctl@ceph.mon.b.smithi062.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:38:58.808 INFO:journalctl@ceph.mon.b.smithi062.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T02:38:58.808 INFO:journalctl@ceph.mon.b.smithi062.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T02:38:58.808 INFO:journalctl@ceph.mon.b.smithi062.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T02:38:58.808 INFO:journalctl@ceph.mon.b.smithi062.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T02:38:58.808 INFO:journalctl@ceph.mon.b.smithi062.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T02:38:58.808 INFO:journalctl@ceph.mon.b.smithi062.stdout: Cumulative compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:38:58.808 INFO:journalctl@ceph.mon.b.smithi062.stdout: Interval compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:38:58.808 INFO:journalctl@ceph.mon.b.smithi062.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T02:38:58.808 INFO:journalctl@ceph.mon.b.smithi062.stdout: Block cache BinnedLRUCache@0x5589c6edd1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-12T02:38:58.808 INFO:journalctl@ceph.mon.b.smithi062.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-12T02:38:58.808 INFO:journalctl@ceph.mon.b.smithi062.stdout: 2024-09-12T02:38:58.808 INFO:journalctl@ceph.mon.b.smithi062.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T02:38:58.808 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-12T02:38:58.809 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: using public_addr v2:172.21.15.62:0/0 -> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T02:38:58.809 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: starting mon.b rank -1 at public addrs [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] at bind addrs [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:38:58.809 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.b@-1(???) e0 preinit fsid c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:38:58.809 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.b@-1(synchronizing).mds e1 new map 2024-09-12T02:38:58.809 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-12T02:38:58.809 INFO:journalctl@ceph.mon.b.smithi062.stdout: e1 2024-09-12T02:38:58.809 INFO:journalctl@ceph.mon.b.smithi062.stdout: btime 2024-09-12T02:37:14:139320+0000 2024-09-12T02:38:58.809 INFO:journalctl@ceph.mon.b.smithi062.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T02:38:58.809 INFO:journalctl@ceph.mon.b.smithi062.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:38:58.809 INFO:journalctl@ceph.mon.b.smithi062.stdout: legacy client fscid: -1 2024-09-12T02:38:58.809 INFO:journalctl@ceph.mon.b.smithi062.stdout: 2024-09-12T02:38:58.809 INFO:journalctl@ceph.mon.b.smithi062.stdout: No filesystems configured 2024-09-12T02:38:58.809 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-12T02:38:58.809 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-12T02:38:58.809 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-12T02:38:58.810 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-12T02:38:58.810 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-12T02:38:58.810 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-12T02:38:58.810 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T02:38:58.810 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:38:58.810 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:38:58.810 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:38:58.810 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi176", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:58.810 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.811 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.811 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.811 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.811 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi062", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:58.811 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:58.811 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:38:58.811 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: Updating smithi062:/etc/ceph/ceph.conf 2024-09-12T02:38:58.811 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: Updating smithi062:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:38:58.811 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:38:58.812 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: Updating smithi062:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:38:58.812 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: Deploying cephadm binary to smithi176 2024-09-12T02:38:58.812 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:58.812 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.812 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.812 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.812 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:58.812 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.812 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: Added host smithi176 2024-09-12T02:38:58.812 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:38:58.812 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.812 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.812 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:58.812 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.812 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:38:58.813 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:58.813 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2823573842' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T02:38:58.813 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2823573842' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T02:38:58.813 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:38:58.813 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.813 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.813 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.813 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.813 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi176", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:58.813 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:58.813 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:38:58.813 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: Updating smithi176:/etc/ceph/ceph.conf 2024-09-12T02:38:58.813 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.813 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.814 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.814 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: Updating smithi176:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:38:58.814 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: Updating smithi176:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:38:58.814 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: Updating smithi176:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:38:58.814 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:58.814 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.814 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:38:58.814 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:58.814 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:38:58.814 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.814 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:38:58.814 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:58.814 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi018:172.21.15.18=a;smithi062:172.21.15.62=b;smithi176:172.21.15.176=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:58.815 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: Saving service mon spec with placement smithi018:172.21.15.18=a;smithi062:172.21.15.62=b;smithi176:172.21.15.176=c;count:3 2024-09-12T02:38:58.815 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: Deploying daemon mon.c on smithi176 2024-09-12T02:38:58.815 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:58.815 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='client.? 172.21.15.176:0/1992067473' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:38:58.815 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:38:58.815 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:58.815 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.a calling monitor election 2024-09-12T02:38:58.815 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:58.815 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:58.815 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.c calling monitor election 2024-09-12T02:38:58.815 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:58.815 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:58.815 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:58.815 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:58.816 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:58.816 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:38:58.816 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: monmap epoch 2 2024-09-12T02:38:58.816 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: fsid c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:38:58.816 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: last_changed 2024-09-12T02:38:49.614777+0000 2024-09-12T02:38:58.816 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: created 2024-09-12T02:37:09.409832+0000 2024-09-12T02:38:58.816 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: min_mon_release 19 (squid) 2024-09-12T02:38:58.816 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: election_strategy: 1 2024-09-12T02:38:58.816 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-12T02:38:58.816 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.c 2024-09-12T02:38:58.816 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: fsmap 2024-09-12T02:38:58.816 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:38:58.816 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mgrmap e13: x(active, since 44s) 2024-09-12T02:38:58.816 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: overall HEALTH_OK 2024-09-12T02:38:58.817 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.817 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.817 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:38:58.817 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:38:58.817 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:58.817 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:58.817 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: Deploying daemon mon.b on smithi062 2024-09-12T02:38:58.817 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='client.? 172.21.15.176:0/1193874329' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:38:58.817 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:38:58.817 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:38:58.817 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 ceph-mon[35527]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-12T02:38:58.817 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 bash[35507]: 6ea4dc7aab4bf26c6e3ad7101557c52f54157dc5ca173c60674a35093fe257da 2024-09-12T02:38:58.817 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:38:58 smithi062 systemd[1]: Started Ceph mon.b for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:38:59.402 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:38:59.403 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:38:59.652 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:39:03.677 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.676+0000 7f9de080e640 1 -- 172.21.15.176:0/2120173509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dc8005740 msgr2=0x7f9dc8007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:03.677 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.676+0000 7f9de080e640 1 --2- 172.21.15.176:0/2120173509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dc8005740 0x7f9dc8007bd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc1016a0 tx=0x7f9dd402c3f0 comp rx=0 tx=0).stop 2024-09-12T02:39:03.677 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.676+0000 7f9de080e640 1 -- 172.21.15.176:0/2120173509 shutdown_connections 2024-09-12T02:39:03.677 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.676+0000 7f9de080e640 1 --2- 172.21.15.176:0/2120173509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dc8005740 0x7f9dc8007bd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:03.677 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.676+0000 7f9de080e640 1 -- 172.21.15.176:0/2120173509 >> 172.21.15.176:0/2120173509 conn(0x7f9ddc0fc220 msgr2=0x7f9ddc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:03.678 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.676+0000 7f9de080e640 1 -- 172.21.15.176:0/2120173509 shutdown_connections 2024-09-12T02:39:03.678 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.676+0000 7f9de080e640 1 -- 172.21.15.176:0/2120173509 wait complete. 2024-09-12T02:39:03.679 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.677+0000 7f9de080e640 1 Processor -- start 2024-09-12T02:39:03.679 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.677+0000 7f9de080e640 1 -- start start 2024-09-12T02:39:03.679 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.677+0000 7f9de080e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc8005740 0x7f9ddc1950d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:03.679 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.677+0000 7f9de080e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ddc195610 0x7f9ddc1999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:03.679 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.677+0000 7f9de080e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ddc199ee0 0x7f9ddc19a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:03.679 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.677+0000 7f9de080e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc107550 con 0x7f9ddc199ee0 2024-09-12T02:39:03.679 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.677+0000 7f9de080e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc1073d0 con 0x7f9dc8005740 2024-09-12T02:39:03.679 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.677+0000 7f9de080e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc1076d0 con 0x7f9ddc195610 2024-09-12T02:39:03.679 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.678+0000 7f9dd9d9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ddc195610 0x7f9ddc1999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:03.679 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.678+0000 7f9dd9d9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ddc195610 0x7f9ddc1999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:50368/0 (socket says 172.21.15.176:50368) 2024-09-12T02:39:03.680 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.678+0000 7f9dd9d9b640 1 -- 172.21.15.176:0/2288488803 learned_addr learned my addr 172.21.15.176:0/2288488803 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-12T02:39:03.680 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.678+0000 7f9dda59c640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc8005740 0x7f9ddc1950d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:03.680 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.678+0000 7f9dd9d9b640 1 -- 172.21.15.176:0/2288488803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ddc195610 msgr2=0x7f9ddc1999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T02:39:03.680 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.678+0000 7f9dd9d9b640 1 -- 172.21.15.176:0/2288488803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ddc195610 msgr2=0x7f9ddc1999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:39:03.680 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.678+0000 7f9dd9d9b640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ddc195610 0x7f9ddc1999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:39:03.680 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.678+0000 7f9dd9d9b640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ddc195610 0x7f9ddc1999a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:03.680 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.678+0000 7f9dda59c640 1 -- 172.21.15.176:0/2288488803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc8005740 msgr2=0x7f9ddc1950d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-12T02:39:03.680 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.678+0000 7f9dda59c640 1 -- 172.21.15.176:0/2288488803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc8005740 msgr2=0x7f9ddc1950d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:39:03.680 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.678+0000 7f9ddad9d640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ddc199ee0 0x7f9ddc19a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:03.680 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.678+0000 7f9dda59c640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc8005740 0x7f9ddc1950d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:39:03.681 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.678+0000 7f9dda59c640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc8005740 0x7f9ddc1950d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:03.682 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.679+0000 7f9ddad9d640 1 -- 172.21.15.176:0/2288488803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ddc195610 msgr2=0x7f9ddc1999a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:39:03.682 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.679+0000 7f9ddad9d640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ddc195610 0x7f9ddc1999a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:03.682 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.679+0000 7f9ddad9d640 1 -- 172.21.15.176:0/2288488803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc8005740 msgr2=0x7f9ddc1950d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:39:03.682 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.679+0000 7f9ddad9d640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc8005740 0x7f9ddc1950d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:03.682 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.679+0000 7f9ddad9d640 1 -- 172.21.15.176:0/2288488803 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ddc1a1c50 con 0x7f9ddc199ee0 2024-09-12T02:39:03.682 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.679+0000 7f9ddad9d640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ddc199ee0 0x7f9ddc19a390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00bd50 tx=0x7f9dcc00be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:03.682 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.679+0000 7f9dd37fe640 1 -- 172.21.15.176:0/2288488803 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc019070 con 0x7f9ddc199ee0 2024-09-12T02:39:03.682 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.679+0000 7f9dd37fe640 1 -- 172.21.15.176:0/2288488803 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dcc014920 con 0x7f9ddc199ee0 2024-09-12T02:39:03.682 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.679+0000 7f9dd37fe640 1 -- 172.21.15.176:0/2288488803 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc012990 con 0x7f9ddc199ee0 2024-09-12T02:39:03.683 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.679+0000 7f9de080e640 1 -- 172.21.15.176:0/2288488803 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ddc1a1e80 con 0x7f9ddc199ee0 2024-09-12T02:39:03.683 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.679+0000 7f9de080e640 1 -- 172.21.15.176:0/2288488803 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ddc1a2360 con 0x7f9ddc199ee0 2024-09-12T02:39:03.683 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.681+0000 7f9dd37fe640 1 -- 172.21.15.176:0/2288488803 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f9dcc01c070 con 0x7f9ddc199ee0 2024-09-12T02:39:03.683 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.681+0000 7f9de080e640 1 -- 172.21.15.176:0/2288488803 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ddc108690 con 0x7f9ddc199ee0 2024-09-12T02:39:03.683 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.681+0000 7f9dd37fe640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9dbc0394f0 0x7f9dbc03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:03.683 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.681+0000 7f9dd37fe640 1 -- 172.21.15.176:0/2288488803 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9dcc04bd40 con 0x7f9ddc199ee0 2024-09-12T02:39:03.683 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.681+0000 7f9dda59c640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9dbc0394f0 0x7f9dbc03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:03.683 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.682+0000 7f9dda59c640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9dbc0394f0 0x7f9dbc03b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4005fd0 tx=0x7f9dd4005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:03.687 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.686+0000 7f9dd37fe640 1 -- 172.21.15.176:0/2288488803 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9dcc012b90 con 0x7f9ddc199ee0 2024-09-12T02:39:03.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: mon.c calling monitor election 2024-09-12T02:39:03.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:39:03.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: mon.a calling monitor election 2024-09-12T02:39:03.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:03.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:39:03.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:03.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:03.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:03.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:03.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:03.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:03.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:03.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:03.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:39:03.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: monmap epoch 3 2024-09-12T02:39:03.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: fsid c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:39:03.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: last_changed 2024-09-12T02:38:58.513388+0000 2024-09-12T02:39:03.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: created 2024-09-12T02:37:09.409832+0000 2024-09-12T02:39:03.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: min_mon_release 19 (squid) 2024-09-12T02:39:03.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: election_strategy: 1 2024-09-12T02:39:03.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-12T02:39:03.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.c 2024-09-12T02:39:03.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: 2: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2024-09-12T02:39:03.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: fsmap 2024-09-12T02:39:03.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:39:03.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: mgrmap e13: x(active, since 52s) 2024-09-12T02:39:03.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: overall HEALTH_OK 2024-09-12T02:39:03.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:03.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:03.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:03.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:03 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:03.931 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.930+0000 7f9de080e640 1 -- 172.21.15.176:0/2288488803 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f9ddc02d7c0 con 0x7f9ddc199ee0 2024-09-12T02:39:03.931 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: mon.c calling monitor election 2024-09-12T02:39:03.932 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:39:03.932 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: mon.a calling monitor election 2024-09-12T02:39:03.932 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:03.932 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:39:03.932 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:03.932 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:03.932 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:03.932 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:03.932 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:03.932 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:03.932 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:03.932 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:03.932 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:39:03.933 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: monmap epoch 3 2024-09-12T02:39:03.933 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: fsid c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:39:03.933 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: last_changed 2024-09-12T02:38:58.513388+0000 2024-09-12T02:39:03.933 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: created 2024-09-12T02:37:09.409832+0000 2024-09-12T02:39:03.933 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: min_mon_release 19 (squid) 2024-09-12T02:39:03.933 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: election_strategy: 1 2024-09-12T02:39:03.933 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-12T02:39:03.933 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.c 2024-09-12T02:39:03.933 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: 2: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2024-09-12T02:39:03.933 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: fsmap 2024-09-12T02:39:03.933 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:39:03.933 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: mgrmap e13: x(active, since 52s) 2024-09-12T02:39:03.933 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: overall HEALTH_OK 2024-09-12T02:39:03.933 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:03.934 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:03.934 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:03.934 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:03 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:03.934 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.931+0000 7f9dd37fe640 1 -- 172.21.15.176:0/2288488803 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7f9dcc01d3b0 con 0x7f9ddc199ee0 2024-09-12T02:39:03.934 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:39:03.934 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":3,"fsid":"c7666100-70af-11ef-bcea-c7b262605968","modified":"2024-09-12T02:38:58.513388Z","created":"2024-09-12T02:37:09.409832Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:3300","nonce":0},{"type":"v1","addr":"172.21.15.176:6789","nonce":0}]},"addr":"172.21.15.176:6789/0","public_addr":"172.21.15.176:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T02:39:03.935 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 3 2024-09-12T02:39:03.935 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.933+0000 7f9de080e640 1 -- 172.21.15.176:0/2288488803 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9dbc0394f0 msgr2=0x7f9dbc03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:03.935 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.933+0000 7f9de080e640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9dbc0394f0 0x7f9dbc03b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4005fd0 tx=0x7f9dd4005f60 comp rx=0 tx=0).stop 2024-09-12T02:39:03.935 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.933+0000 7f9de080e640 1 -- 172.21.15.176:0/2288488803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ddc199ee0 msgr2=0x7f9ddc19a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:03.935 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.933+0000 7f9de080e640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ddc199ee0 0x7f9ddc19a390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00bd50 tx=0x7f9dcc00be40 comp rx=0 tx=0).stop 2024-09-12T02:39:03.935 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.933+0000 7f9de080e640 1 -- 172.21.15.176:0/2288488803 shutdown_connections 2024-09-12T02:39:03.935 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.933+0000 7f9de080e640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9dbc0394f0 0x7f9dbc03b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:03.936 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.933+0000 7f9de080e640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ddc199ee0 0x7f9ddc19a390 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:03.936 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.933+0000 7f9de080e640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ddc195610 0x7f9ddc1999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:03.936 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.933+0000 7f9de080e640 1 --2- 172.21.15.176:0/2288488803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc8005740 0x7f9ddc1950d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:03.936 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.933+0000 7f9de080e640 1 -- 172.21.15.176:0/2288488803 >> 172.21.15.176:0/2288488803 conn(0x7f9ddc0fc220 msgr2=0x7f9ddc0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:03.936 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.933+0000 7f9de080e640 1 -- 172.21.15.176:0/2288488803 shutdown_connections 2024-09-12T02:39:03.936 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:03.933+0000 7f9de080e640 1 -- 172.21.15.176:0/2288488803 wait complete. 2024-09-12T02:39:04.466 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-12T02:39:04.466 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-12T02:39:04.848 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:39:04.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:04 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:04.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:04 smithi018 ceph-mon[30616]: from='client.? 172.21.15.176:0/2288488803' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:39:04.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:04 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:04.930 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:04 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:04.930 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:04 smithi176 ceph-mon[35713]: from='client.? 172.21.15.176:0/2288488803' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:39:04.930 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:04 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:05.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.420+0000 7fc2e1200640 1 -- 172.21.15.18:0/3159695484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2dc109770 msgr2=0x7fc2dc109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:05.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.420+0000 7fc2e1200640 1 --2- 172.21.15.18:0/3159695484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2dc109770 0x7fc2dc109b50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009880 tx=0x7fc2cc02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:39:05.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.420+0000 7fc2e1200640 1 -- 172.21.15.18:0/3159695484 shutdown_connections 2024-09-12T02:39:05.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.420+0000 7fc2e1200640 1 --2- 172.21.15.18:0/3159695484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2dc109770 0x7fc2dc109b50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:05.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.420+0000 7fc2e1200640 1 -- 172.21.15.18:0/3159695484 >> 172.21.15.18:0/3159695484 conn(0x7fc2dc0ff450 msgr2=0x7fc2dc101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:05.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.420+0000 7fc2e1200640 1 -- 172.21.15.18:0/3159695484 shutdown_connections 2024-09-12T02:39:05.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.420+0000 7fc2e1200640 1 -- 172.21.15.18:0/3159695484 wait complete. 2024-09-12T02:39:05.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.421+0000 7fc2e1200640 1 Processor -- start 2024-09-12T02:39:05.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.421+0000 7fc2e1200640 1 -- start start 2024-09-12T02:39:05.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.422+0000 7fc2e1200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2dc109770 0x7fc2dc076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:05.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.422+0000 7fc2e1200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2dc07a660 0x7fc2dc076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:05.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.422+0000 7fc2e1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2dc0772e0 0x7fc2dc1a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:05.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.422+0000 7fc2e1200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc10ddd0 con 0x7fc2dc0772e0 2024-09-12T02:39:05.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.422+0000 7fc2e1200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc10dc50 con 0x7fc2dc07a660 2024-09-12T02:39:05.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.422+0000 7fc2e1200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc10df50 con 0x7fc2dc109770 2024-09-12T02:39:05.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.422+0000 7fc2d9e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2dc109770 0x7fc2dc076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:05.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.422+0000 7fc2d3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2dc07a660 0x7fc2dc076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:05.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.422+0000 7fc2d9e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2dc109770 0x7fc2dc076700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:40334/0 (socket says 172.21.15.18:40334) 2024-09-12T02:39:05.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.422+0000 7fc2d9e00640 1 -- 172.21.15.18:0/1915408575 learned_addr learned my addr 172.21.15.18:0/1915408575 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:39:05.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.422+0000 7fc2d3e00640 1 -- 172.21.15.18:0/1915408575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2dc07a660 msgr2=0x7fc2dc076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T02:39:05.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.422+0000 7fc2d3e00640 1 -- 172.21.15.18:0/1915408575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2dc07a660 msgr2=0x7fc2dc076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:39:05.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.422+0000 7fc2d3e00640 1 --2- 172.21.15.18:0/1915408575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2dc07a660 0x7fc2dc076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:39:05.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.422+0000 7fc2da800640 1 --2- 172.21.15.18:0/1915408575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2dc0772e0 0x7fc2dc1a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:05.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.422+0000 7fc2d3e00640 1 --2- 172.21.15.18:0/1915408575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2dc07a660 0x7fc2dc076c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:05.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.423+0000 7fc2d9e00640 1 -- 172.21.15.18:0/1915408575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2dc07a660 msgr2=0x7fc2dc076c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:39:05.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.423+0000 7fc2d9e00640 1 --2- 172.21.15.18:0/1915408575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2dc07a660 0x7fc2dc076c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:05.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.423+0000 7fc2d9e00640 1 -- 172.21.15.18:0/1915408575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2dc0772e0 msgr2=0x7fc2dc1a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:05.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.423+0000 7fc2d9e00640 1 --2- 172.21.15.18:0/1915408575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2dc0772e0 0x7fc2dc1a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:05.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.423+0000 7fc2d9e00640 1 -- 172.21.15.18:0/1915408575 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2dc1aa3d0 con 0x7fc2dc109770 2024-09-12T02:39:05.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.423+0000 7fc2da800640 1 --2- 172.21.15.18:0/1915408575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2dc0772e0 0x7fc2dc1a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:05.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.423+0000 7fc2d9e00640 1 --2- 172.21.15.18:0/1915408575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2dc109770 0x7fc2dc076700 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc031550 tx=0x7fc2cc0042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:05.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.423+0000 7fc2d2a00640 1 -- 172.21.15.18:0/1915408575 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc03f030 con 0x7fc2dc109770 2024-09-12T02:39:05.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.423+0000 7fc2d2a00640 1 -- 172.21.15.18:0/1915408575 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2cc003ce0 con 0x7fc2dc109770 2024-09-12T02:39:05.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.423+0000 7fc2d2a00640 1 -- 172.21.15.18:0/1915408575 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc035070 con 0x7fc2dc109770 2024-09-12T02:39:05.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.423+0000 7fc2e1200640 1 -- 172.21.15.18:0/1915408575 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2dc1aa660 con 0x7fc2dc109770 2024-09-12T02:39:05.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.423+0000 7fc2e1200640 1 -- 172.21.15.18:0/1915408575 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2dc1aabf0 con 0x7fc2dc109770 2024-09-12T02:39:05.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.425+0000 7fc2e1200640 1 -- 172.21.15.18:0/1915408575 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2dc104eb0 con 0x7fc2dc109770 2024-09-12T02:39:05.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.425+0000 7fc2d2a00640 1 -- 172.21.15.18:0/1915408575 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fc2cc042030 con 0x7fc2dc109770 2024-09-12T02:39:05.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.425+0000 7fc2d2a00640 1 --2- 172.21.15.18:0/1915408575 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc2c00394f0 0x7fc2c003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:05.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.425+0000 7fc2d2a00640 1 -- 172.21.15.18:0/1915408575 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc2cc06cda0 con 0x7fc2dc109770 2024-09-12T02:39:05.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.425+0000 7fc2d3e00640 1 --2- 172.21.15.18:0/1915408575 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc2c00394f0 0x7fc2c003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:05.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.426+0000 7fc2d3e00640 1 --2- 172.21.15.18:0/1915408575 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc2c00394f0 0x7fc2c003b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc077ec0 tx=0x7fc2c4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.430+0000 7fc2d2a00640 1 -- 172.21.15.18:0/1915408575 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc2cc049020 con 0x7fc2dc109770 2024-09-12T02:39:05.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.621+0000 7fc2e1200640 1 -- 172.21.15.18:0/1915408575 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fc2dc1aaf70 con 0x7fc2dc109770 2024-09-12T02:39:05.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.622+0000 7fc2d2a00640 1 -- 172.21.15.18:0/1915408575 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7fc2cc040270 con 0x7fc2dc109770 2024-09-12T02:39:05.623 INFO:teuthology.orchestra.run.smithi018.stdout:# minimal ceph.conf for c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:39:05.623 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-09-12T02:39:05.623 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:39:05.623 INFO:teuthology.orchestra.run.smithi018.stdout: mon_host = [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] 2024-09-12T02:39:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.624+0000 7fc2e1200640 1 -- 172.21.15.18:0/1915408575 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc2c00394f0 msgr2=0x7fc2c003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.624+0000 7fc2e1200640 1 --2- 172.21.15.18:0/1915408575 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc2c00394f0 0x7fc2c003b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc077ec0 tx=0x7fc2c4008040 comp rx=0 tx=0).stop 2024-09-12T02:39:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.624+0000 7fc2e1200640 1 -- 172.21.15.18:0/1915408575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2dc109770 msgr2=0x7fc2dc076700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.624+0000 7fc2e1200640 1 --2- 172.21.15.18:0/1915408575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2dc109770 0x7fc2dc076700 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc031550 tx=0x7fc2cc0042f0 comp rx=0 tx=0).stop 2024-09-12T02:39:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.625+0000 7fc2e1200640 1 -- 172.21.15.18:0/1915408575 shutdown_connections 2024-09-12T02:39:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.625+0000 7fc2e1200640 1 --2- 172.21.15.18:0/1915408575 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc2c00394f0 0x7fc2c003b9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.625+0000 7fc2e1200640 1 --2- 172.21.15.18:0/1915408575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2dc0772e0 0x7fc2dc1a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.625+0000 7fc2e1200640 1 --2- 172.21.15.18:0/1915408575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2dc07a660 0x7fc2dc076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.625+0000 7fc2e1200640 1 --2- 172.21.15.18:0/1915408575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2dc109770 0x7fc2dc076700 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.625+0000 7fc2e1200640 1 -- 172.21.15.18:0/1915408575 >> 172.21.15.18:0/1915408575 conn(0x7fc2dc0ff450 msgr2=0x7fc2dc0ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.625+0000 7fc2e1200640 1 -- 172.21.15.18:0/1915408575 shutdown_connections 2024-09-12T02:39:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:05.625+0000 7fc2e1200640 1 -- 172.21.15.18:0/1915408575 wait complete. 2024-09-12T02:39:05.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: mon.c calling monitor election 2024-09-12T02:39:05.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:39:05.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: mon.a calling monitor election 2024-09-12T02:39:05.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:05.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:39:05.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:05.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:05.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:05.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:05.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:05.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:05.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:05.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:05.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:39:05.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: monmap epoch 3 2024-09-12T02:39:05.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: fsid c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:39:05.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: last_changed 2024-09-12T02:38:58.513388+0000 2024-09-12T02:39:05.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: created 2024-09-12T02:37:09.409832+0000 2024-09-12T02:39:05.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: min_mon_release 19 (squid) 2024-09-12T02:39:05.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: election_strategy: 1 2024-09-12T02:39:05.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-12T02:39:05.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.c 2024-09-12T02:39:05.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: 2: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2024-09-12T02:39:05.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: fsmap 2024-09-12T02:39:05.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:39:05.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: mgrmap e13: x(active, since 52s) 2024-09-12T02:39:05.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: overall HEALTH_OK 2024-09-12T02:39:05.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:05.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:05.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:05.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:05.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:05.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: from='client.? 172.21.15.176:0/2288488803' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:39:05.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:06.201 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: mon.b calling monitor election 2024-09-12T02:39:06.202 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:06.202 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-12T02:39:06.202 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: Updating smithi062:/etc/ceph/ceph.conf 2024-09-12T02:39:06.202 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: Updating smithi176:/etc/ceph/ceph.conf 2024-09-12T02:39:06.202 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: Updating smithi176:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:39:06.202 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: Updating smithi062:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:39:06.202 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: mon.b calling monitor election 2024-09-12T02:39:06.202 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: mon.c calling monitor election 2024-09-12T02:39:06.202 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: mon.a calling monitor election 2024-09-12T02:39:06.202 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T02:39:06.202 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: monmap epoch 3 2024-09-12T02:39:06.202 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: fsid c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:39:06.203 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: last_changed 2024-09-12T02:38:58.513388+0000 2024-09-12T02:39:06.203 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: created 2024-09-12T02:37:09.409832+0000 2024-09-12T02:39:06.203 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: min_mon_release 19 (squid) 2024-09-12T02:39:06.203 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: election_strategy: 1 2024-09-12T02:39:06.203 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-12T02:39:06.203 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.c 2024-09-12T02:39:06.203 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: 2: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2024-09-12T02:39:06.203 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: fsmap 2024-09-12T02:39:06.203 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:39:06.203 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: mgrmap e13: x(active, since 55s) 2024-09-12T02:39:06.203 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: overall HEALTH_OK 2024-09-12T02:39:06.203 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:06.203 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1915408575' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:06.203 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:06.204 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:06.204 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:06.204 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:06 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:06.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: mon.b calling monitor election 2024-09-12T02:39:06.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:06.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-12T02:39:06.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: Updating smithi062:/etc/ceph/ceph.conf 2024-09-12T02:39:06.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: Updating smithi176:/etc/ceph/ceph.conf 2024-09-12T02:39:06.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: Updating smithi176:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:39:06.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: Updating smithi062:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:39:06.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: mon.b calling monitor election 2024-09-12T02:39:06.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: mon.c calling monitor election 2024-09-12T02:39:06.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: mon.a calling monitor election 2024-09-12T02:39:06.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T02:39:06.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: monmap epoch 3 2024-09-12T02:39:06.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: fsid c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:39:06.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: last_changed 2024-09-12T02:38:58.513388+0000 2024-09-12T02:39:06.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: created 2024-09-12T02:37:09.409832+0000 2024-09-12T02:39:06.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: min_mon_release 19 (squid) 2024-09-12T02:39:06.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: election_strategy: 1 2024-09-12T02:39:06.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-12T02:39:06.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.c 2024-09-12T02:39:06.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: 2: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2024-09-12T02:39:06.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: fsmap 2024-09-12T02:39:06.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:39:06.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: mgrmap e13: x(active, since 55s) 2024-09-12T02:39:06.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: overall HEALTH_OK 2024-09-12T02:39:06.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:06.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1915408575' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:06.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:06.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:06.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:06.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:06 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:06.462 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-12T02:39:06.462 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:39:06.463 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T02:39:06.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: mon.b calling monitor election 2024-09-12T02:39:06.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:06.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-12T02:39:06.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: Updating smithi062:/etc/ceph/ceph.conf 2024-09-12T02:39:06.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: Updating smithi176:/etc/ceph/ceph.conf 2024-09-12T02:39:06.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: Updating smithi176:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:39:06.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: Updating smithi062:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:39:06.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: mon.b calling monitor election 2024-09-12T02:39:06.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: mon.c calling monitor election 2024-09-12T02:39:06.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: mon.a calling monitor election 2024-09-12T02:39:06.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T02:39:06.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: monmap epoch 3 2024-09-12T02:39:06.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: fsid c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:39:06.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: last_changed 2024-09-12T02:38:58.513388+0000 2024-09-12T02:39:06.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: created 2024-09-12T02:37:09.409832+0000 2024-09-12T02:39:06.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: min_mon_release 19 (squid) 2024-09-12T02:39:06.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: election_strategy: 1 2024-09-12T02:39:06.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-12T02:39:06.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.c 2024-09-12T02:39:06.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: 2: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2024-09-12T02:39:06.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: fsmap 2024-09-12T02:39:06.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:39:06.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: mgrmap e13: x(active, since 55s) 2024-09-12T02:39:06.481 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: overall HEALTH_OK 2024-09-12T02:39:06.481 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:06.481 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1915408575' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:06.481 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:06.481 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:06.481 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:06.481 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:06 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:06.520 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:39:06.520 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:39:06.617 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T02:39:06.617 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T02:39:06.645 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T02:39:06.645 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:39:06.709 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T02:39:06.709 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T02:39:06.737 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T02:39:06.737 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:39:06.803 INFO:tasks.cephadm:Adding mgr.x on smithi018 2024-09-12T02:39:06.803 INFO:tasks.cephadm:Adding mgr.y on smithi062 2024-09-12T02:39:06.804 INFO:tasks.cephadm:Adding mgr.z on smithi176 2024-09-12T02:39:06.804 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi018=x;smithi062=y;smithi176=z' 2024-09-12T02:39:07.079 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:39:07.461 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:07 smithi176 ceph-mon[35713]: Updating smithi018:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:39:07.461 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.461 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.462 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.462 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.462 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.462 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.462 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.462 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:07 smithi176 ceph-mon[35713]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T02:39:07.462 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:39:07.462 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:39:07.462 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:07.462 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:07 smithi176 ceph-mon[35713]: Reconfiguring daemon mon.a on smithi018 2024-09-12T02:39:07.462 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:07.515 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:07 smithi018 ceph-mon[30616]: Updating smithi018:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:39:07.515 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.515 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.515 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.515 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.516 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.516 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.516 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.516 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:07 smithi018 ceph-mon[30616]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T02:39:07.516 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:39:07.516 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:39:07.516 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:07.516 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:07 smithi018 ceph-mon[30616]: Reconfiguring daemon mon.a on smithi018 2024-09-12T02:39:07.516 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:07.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:07 smithi062 ceph-mon[35527]: Updating smithi018:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:39:07.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:07.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:07 smithi062 ceph-mon[35527]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T02:39:07.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:39:07.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:39:07.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:07.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:07 smithi062 ceph-mon[35527]: Reconfiguring daemon mon.a on smithi018 2024-09-12T02:39:07.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:39:07.553 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.543+0000 7f69b16db640 1 -- 172.21.15.176:0/978859790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69ac1016e0 msgr2=0x7f69ac101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:07.553 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.543+0000 7f69b16db640 1 --2- 172.21.15.176:0/978859790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69ac1016e0 0x7f69ac101ae0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f699c009c20 tx=0x7f699c02aa90 comp rx=0 tx=0).stop 2024-09-12T02:39:07.553 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.543+0000 7f69b16db640 1 -- 172.21.15.176:0/978859790 shutdown_connections 2024-09-12T02:39:07.553 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.543+0000 7f69b16db640 1 --2- 172.21.15.176:0/978859790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69ac1016e0 0x7f69ac101ae0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:07.553 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.543+0000 7f69b16db640 1 -- 172.21.15.176:0/978859790 >> 172.21.15.176:0/978859790 conn(0x7f69ac0fce90 msgr2=0x7f69ac0ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:07.554 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.543+0000 7f69b16db640 1 -- 172.21.15.176:0/978859790 shutdown_connections 2024-09-12T02:39:07.554 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.543+0000 7f69b16db640 1 -- 172.21.15.176:0/978859790 wait complete. 2024-09-12T02:39:07.554 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.543+0000 7f69b16db640 1 Processor -- start 2024-09-12T02:39:07.554 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.543+0000 7f69b16db640 1 -- start start 2024-09-12T02:39:07.554 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69b16db640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69ac1016e0 0x7f69ac196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:07.554 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69b16db640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ac1974f0 0x7f69ac19c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:07.554 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69b16db640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69ac197970 0x7f69ac19eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:07.554 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69b16db640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac1077f0 con 0x7f69ac1016e0 2024-09-12T02:39:07.554 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69b16db640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac107670 con 0x7f69ac197970 2024-09-12T02:39:07.554 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69b16db640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac107970 con 0x7f69ac1974f0 2024-09-12T02:39:07.554 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69aa7fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ac1974f0 0x7f69ac19c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:07.554 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69aa7fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ac1974f0 0x7f69ac19c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:50372/0 (socket says 172.21.15.176:50372) 2024-09-12T02:39:07.554 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69aa7fc640 1 -- 172.21.15.176:0/1556798817 learned_addr learned my addr 172.21.15.176:0/1556798817 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-12T02:39:07.554 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69aaffd640 1 --2- 172.21.15.176:0/1556798817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69ac1016e0 0x7f69ac196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:07.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69ab7fe640 1 --2- 172.21.15.176:0/1556798817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69ac197970 0x7f69ac19eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:07.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69aa7fc640 1 -- 172.21.15.176:0/1556798817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69ac197970 msgr2=0x7f69ac19eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:07.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69aa7fc640 1 --2- 172.21.15.176:0/1556798817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69ac197970 0x7f69ac19eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:07.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69aa7fc640 1 -- 172.21.15.176:0/1556798817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69ac1016e0 msgr2=0x7f69ac196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:07.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69aa7fc640 1 --2- 172.21.15.176:0/1556798817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69ac1016e0 0x7f69ac196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:07.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69aa7fc640 1 -- 172.21.15.176:0/1556798817 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ac19f3b0 con 0x7f69ac1974f0 2024-09-12T02:39:07.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69ab7fe640 1 --2- 172.21.15.176:0/1556798817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69ac197970 0x7f69ac19eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:39:07.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69aa7fc640 1 --2- 172.21.15.176:0/1556798817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ac1974f0 0x7f69ac19c560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f699400b520 tx=0x7f699400b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:07.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69a3fff640 1 -- 172.21.15.176:0/1556798817 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6994004230 con 0x7f69ac1974f0 2024-09-12T02:39:07.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69a3fff640 1 -- 172.21.15.176:0/1556798817 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69940043d0 con 0x7f69ac1974f0 2024-09-12T02:39:07.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.544+0000 7f69a3fff640 1 -- 172.21.15.176:0/1556798817 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6994003d60 con 0x7f69ac1974f0 2024-09-12T02:39:07.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.545+0000 7f69b16db640 1 -- 172.21.15.176:0/1556798817 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69ac19f6a0 con 0x7f69ac1974f0 2024-09-12T02:39:07.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.545+0000 7f69b16db640 1 -- 172.21.15.176:0/1556798817 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69ac19fc60 con 0x7f69ac1974f0 2024-09-12T02:39:07.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.545+0000 7f69a3fff640 1 -- 172.21.15.176:0/1556798817 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f699400e070 con 0x7f69ac1974f0 2024-09-12T02:39:07.556 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.546+0000 7f69b16db640 1 -- 172.21.15.176:0/1556798817 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69ac1905b0 con 0x7f69ac1974f0 2024-09-12T02:39:07.556 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.546+0000 7f69a3fff640 1 --2- 172.21.15.176:0/1556798817 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f69980394f0 0x7f699803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:07.556 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.546+0000 7f69a3fff640 1 -- 172.21.15.176:0/1556798817 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f699404bb80 con 0x7f69ac1974f0 2024-09-12T02:39:07.556 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.546+0000 7f69aaffd640 1 --2- 172.21.15.176:0/1556798817 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f69980394f0 0x7f699803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:07.556 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.547+0000 7f69aaffd640 1 --2- 172.21.15.176:0/1556798817 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f69980394f0 0x7f699803b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f699c005e30 tx=0x7f699c03a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:07.556 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.550+0000 7f69a3fff640 1 -- 172.21.15.176:0/1556798817 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6994014020 con 0x7f69ac1974f0 2024-09-12T02:39:07.728 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.727+0000 7f69b16db640 1 -- 172.21.15.176:0/1556798817 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi062=y;smithi176=z", "target": ["mon-mgr", ""]}) -- 0x7f69ac0626c0 con 0x7f69980394f0 2024-09-12T02:39:07.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.735+0000 7f69a3fff640 1 -- 172.21.15.176:0/1556798817 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f69ac0626c0 con 0x7f69980394f0 2024-09-12T02:39:07.736 INFO:teuthology.orchestra.run.smithi176.stdout:Scheduled mgr update... 2024-09-12T02:39:07.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.737+0000 7f69b16db640 1 -- 172.21.15.176:0/1556798817 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f69980394f0 msgr2=0x7f699803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:07.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.737+0000 7f69b16db640 1 --2- 172.21.15.176:0/1556798817 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f69980394f0 0x7f699803b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f699c005e30 tx=0x7f699c03a040 comp rx=0 tx=0).stop 2024-09-12T02:39:07.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.737+0000 7f69b16db640 1 -- 172.21.15.176:0/1556798817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ac1974f0 msgr2=0x7f69ac19c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:07.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.737+0000 7f69b16db640 1 --2- 172.21.15.176:0/1556798817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ac1974f0 0x7f69ac19c560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f699400b520 tx=0x7f699400b9e0 comp rx=0 tx=0).stop 2024-09-12T02:39:07.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.737+0000 7f69b16db640 1 -- 172.21.15.176:0/1556798817 shutdown_connections 2024-09-12T02:39:07.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.737+0000 7f69b16db640 1 --2- 172.21.15.176:0/1556798817 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f69980394f0 0x7f699803b9b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:07.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.737+0000 7f69b16db640 1 --2- 172.21.15.176:0/1556798817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69ac197970 0x7f69ac19eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:07.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.737+0000 7f69b16db640 1 --2- 172.21.15.176:0/1556798817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ac1974f0 0x7f69ac19c560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:07.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.737+0000 7f69b16db640 1 --2- 172.21.15.176:0/1556798817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69ac1016e0 0x7f69ac196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:07.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.737+0000 7f69b16db640 1 -- 172.21.15.176:0/1556798817 >> 172.21.15.176:0/1556798817 conn(0x7f69ac0fce90 msgr2=0x7f69ac0fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:07.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.737+0000 7f69b16db640 1 -- 172.21.15.176:0/1556798817 shutdown_connections 2024-09-12T02:39:07.739 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:39:07.737+0000 7f69b16db640 1 -- 172.21.15.176:0/1556798817 wait complete. 2024-09-12T02:39:07.850 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:39:07 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:39:07.514+0000 7fdc99e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T02:39:08.309 DEBUG:teuthology.orchestra.run.smithi062:mgr.y> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mgr.y.service 2024-09-12T02:39:08.312 DEBUG:teuthology.orchestra.run.smithi176:mgr.z> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mgr.z.service 2024-09-12T02:39:08.314 INFO:tasks.cephadm:Deploying OSDs... 2024-09-12T02:39:08.314 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:39:08.314 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:39:08.350 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:39:08.350 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2024-09-12T02:39:08.427 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:39:08.427 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:39:08.427 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 637 Links: 1 2024-09-12T02:39:08.427 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:39:08.428 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:39:08.428 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-12 02:38:23.779967978 +0000 2024-09-12T02:39:08.428 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-12 02:33:54.335127686 +0000 2024-09-12T02:39:08.428 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-12 02:33:54.335127686 +0000 2024-09-12T02:39:08.428 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-12 02:33:54.335127686 +0000 2024-09-12T02:39:08.428 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:39:08.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:08 smithi176 ceph-mon[35713]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:08.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:08 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:08.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:08 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:08.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:08 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:08.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:08 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:39:08.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:08 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:39:08.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:08 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:08.524 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-12T02:39:08.524 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-12T02:39:08.524 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000178874 s, 2.9 MB/s 2024-09-12T02:39:08.527 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:39:08.564 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2024-09-12T02:39:08.641 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:39:08.641 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:39:08.641 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 656 Links: 1 2024-09-12T02:39:08.641 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:39:08.641 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:39:08.641 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-12 02:38:23.830967379 +0000 2024-09-12T02:39:08.642 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-12 02:33:54.803122147 +0000 2024-09-12T02:39:08.642 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-12 02:33:54.803122147 +0000 2024-09-12T02:39:08.642 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-12 02:33:54.803122147 +0000 2024-09-12T02:39:08.642 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:39:08.730 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:08 smithi018 ceph-mon[30616]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:08.730 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:08 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:08.730 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:08 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:08.731 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:08 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:08.731 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:08 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:39:08.731 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:08 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:39:08.731 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:08 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:08.741 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-12T02:39:08.741 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-12T02:39:08.742 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000181554 s, 2.8 MB/s 2024-09-12T02:39:08.744 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:39:08.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:08 smithi062 ceph-mon[35527]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:08.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:08 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:08.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:08 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:08.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:08 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:08.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:08 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:39:08.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:08 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:39:08.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:08 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:08.785 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2024-09-12T02:39:08.861 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:39:08.861 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:39:08.861 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 676 Links: 1 2024-09-12T02:39:08.861 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:39:08.861 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:39:08.861 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-12 02:38:23.886966721 +0000 2024-09-12T02:39:08.861 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-12 02:33:55.260116740 +0000 2024-09-12T02:39:08.861 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-12 02:33:55.260116740 +0000 2024-09-12T02:39:08.861 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-12 02:33:55.260116740 +0000 2024-09-12T02:39:08.862 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:39:08.957 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-12T02:39:08.957 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-12T02:39:08.957 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000187746 s, 2.7 MB/s 2024-09-12T02:39:08.960 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:39:08.997 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2024-09-12T02:39:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:39:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:39:09.074 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 696 Links: 1 2024-09-12T02:39:09.074 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:39:09.074 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:39:09.074 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-12 02:38:23.939966098 +0000 2024-09-12T02:39:09.074 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-12 02:33:55.737111095 +0000 2024-09-12T02:39:09.074 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-12 02:33:55.737111095 +0000 2024-09-12T02:39:09.075 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-12 02:33:55.737111095 +0000 2024-09-12T02:39:09.075 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:39:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-12T02:39:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-12T02:39:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000178939 s, 2.9 MB/s 2024-09-12T02:39:09.170 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:39:09.207 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T02:39:09.207 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:39:09.226 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:39:09.226 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-09-12T02:39:09.285 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:39:09.285 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:39:09.285 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-12T02:39:09.285 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:39:09.285 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:39:09.285 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-12 02:38:57.890289536 +0000 2024-09-12T02:39:09.285 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-12 02:33:22.281721107 +0000 2024-09-12T02:39:09.285 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-12 02:33:22.281721107 +0000 2024-09-12T02:39:09.285 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-09-12 02:33:22.281721107 +0000 2024-09-12T02:39:09.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:39:09.353 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-12T02:39:09.353 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-12T02:39:09.353 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000287178 s, 1.8 MB/s 2024-09-12T02:39:09.355 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:39:09.415 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-09-12T02:39:09.470 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:39:09.470 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:39:09.470 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-12T02:39:09.470 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:39:09.471 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:39:09.471 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-12 02:38:57.890289536 +0000 2024-09-12T02:39:09.471 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-12 02:33:22.606715894 +0000 2024-09-12T02:39:09.471 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-12 02:33:22.606715894 +0000 2024-09-12T02:39:09.471 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-09-12 02:33:22.606715894 +0000 2024-09-12T02:39:09.471 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:39:09.537 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-12T02:39:09.537 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-12T02:39:09.537 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000210156 s, 2.4 MB/s 2024-09-12T02:39:09.539 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:39:09.597 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-09-12T02:39:09.655 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:39:09.655 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:39:09.655 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-12T02:39:09.655 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:39:09.656 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:39:09.656 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-12 02:38:57.891289520 +0000 2024-09-12T02:39:09.656 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-12 02:33:22.928710729 +0000 2024-09-12T02:39:09.656 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-12 02:33:22.928710729 +0000 2024-09-12T02:39:09.656 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-09-12 02:33:22.928710729 +0000 2024-09-12T02:39:09.656 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:39:09.719 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:09 smithi062 ceph-mon[35527]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi062=y;smithi176=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:39:09.719 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:09 smithi062 ceph-mon[35527]: Saving service mgr spec with placement smithi018=x;smithi062=y;smithi176=z;count:3 2024-09-12T02:39:09.719 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:09 smithi062 ceph-mon[35527]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T02:39:09.719 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:09 smithi062 ceph-mon[35527]: Reconfiguring daemon mgr.x on smithi018 2024-09-12T02:39:09.722 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-12T02:39:09.722 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-12T02:39:09.722 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000196089 s, 2.6 MB/s 2024-09-12T02:39:09.723 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:39:09.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:09 smithi176 ceph-mon[35713]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi062=y;smithi176=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:39:09.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:09 smithi176 ceph-mon[35713]: Saving service mgr spec with placement smithi018=x;smithi062=y;smithi176=z;count:3 2024-09-12T02:39:09.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:09 smithi176 ceph-mon[35713]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T02:39:09.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:09 smithi176 ceph-mon[35713]: Reconfiguring daemon mgr.x on smithi018 2024-09-12T02:39:09.729 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:09 smithi018 ceph-mon[30616]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi062=y;smithi176=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:39:09.729 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:09 smithi018 ceph-mon[30616]: Saving service mgr spec with placement smithi018=x;smithi062=y;smithi176=z;count:3 2024-09-12T02:39:09.729 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:09 smithi018 ceph-mon[30616]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T02:39:09.730 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:09 smithi018 ceph-mon[30616]: Reconfiguring daemon mgr.x on smithi018 2024-09-12T02:39:09.781 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-09-12T02:39:09.839 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:39:09.839 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:39:09.839 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-12T02:39:09.840 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:39:09.840 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:39:09.840 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-12 02:38:57.891289520 +0000 2024-09-12T02:39:09.840 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-12 02:33:23.289704939 +0000 2024-09-12T02:39:09.840 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-12 02:33:23.289704939 +0000 2024-09-12T02:39:09.840 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-09-12 02:33:23.289704939 +0000 2024-09-12T02:39:09.840 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:39:09.905 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-12T02:39:09.905 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-12T02:39:09.905 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000245548 s, 2.1 MB/s 2024-09-12T02:39:09.906 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:39:09.964 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T02:39:09.964 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:39:09.983 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:39:09.984 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_1 2024-09-12T02:39:10.042 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:39:10.042 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:39:10.042 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T02:39:10.042 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:39:10.042 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:39:10.042 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-12 02:38:48.608072701 +0000 2024-09-12T02:39:10.042 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-12 02:33:14.625544398 +0000 2024-09-12T02:39:10.042 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-12 02:33:14.625544398 +0000 2024-09-12T02:39:10.043 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-12 02:33:14.625544398 +0000 2024-09-12T02:39:10.043 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:39:10.110 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-12T02:39:10.110 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-12T02:39:10.110 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000283924 s, 1.8 MB/s 2024-09-12T02:39:10.111 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:39:10.169 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_2 2024-09-12T02:39:10.226 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:39:10.226 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:39:10.226 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-12T02:39:10.226 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:39:10.226 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:39:10.226 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-12 02:38:48.608072701 +0000 2024-09-12T02:39:10.226 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-12 02:33:14.936547028 +0000 2024-09-12T02:39:10.226 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-12 02:33:14.936547028 +0000 2024-09-12T02:39:10.226 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-12 02:33:14.936547028 +0000 2024-09-12T02:39:10.227 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:39:10.292 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-12T02:39:10.292 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-12T02:39:10.292 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000224592 s, 2.3 MB/s 2024-09-12T02:39:10.293 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:39:10.350 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_3 2024-09-12T02:39:10.406 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:39:10.406 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:39:10.407 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-12T02:39:10.407 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:39:10.407 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:39:10.407 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-12 02:38:48.608072701 +0000 2024-09-12T02:39:10.407 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-12 02:33:15.268549836 +0000 2024-09-12T02:39:10.407 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-12 02:33:15.268549836 +0000 2024-09-12T02:39:10.407 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-12 02:33:15.268549836 +0000 2024-09-12T02:39:10.407 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:39:10.470 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-12T02:39:10.471 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-12T02:39:10.471 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000206998 s, 2.5 MB/s 2024-09-12T02:39:10.472 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:39:10.496 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:10 smithi062 ceph-mon[35527]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:10.496 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:10 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:10.497 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:10 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:10.497 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:10 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:39:10.497 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:10 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:39:10.497 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:10 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:10.529 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_4 2024-09-12T02:39:10.585 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:39:10.585 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:39:10.585 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T02:39:10.585 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:39:10.585 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:39:10.585 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-12 02:38:48.609072708 +0000 2024-09-12T02:39:10.585 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-12 02:33:15.596552609 +0000 2024-09-12T02:39:10.585 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-12 02:33:15.596552609 +0000 2024-09-12T02:39:10.585 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-12 02:33:15.596552609 +0000 2024-09-12T02:39:10.586 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:39:10.647 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:10 smithi176 ceph-mon[35713]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:10.647 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:10 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:10.647 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:10 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:10.648 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:10 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:39:10.648 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:10 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:39:10.648 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:10 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:10.649 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-12T02:39:10.650 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-12T02:39:10.650 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000192654 s, 2.7 MB/s 2024-09-12T02:39:10.651 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:39:10.707 INFO:tasks.cephadm:Deploying osd.0 on smithi018 with /dev/vg_nvme/lv_4... 2024-09-12T02:39:10.708 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T02:39:10.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:10 smithi018 ceph-mon[30616]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:10.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:10.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:10.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:39:10.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:39:10.760 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:11.078 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:39:11.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:11 smithi018 ceph-mon[30616]: Reconfiguring mon.b (monmap changed)... 2024-09-12T02:39:11.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:11 smithi018 ceph-mon[30616]: Reconfiguring daemon mon.b on smithi062 2024-09-12T02:39:11.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:11.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:11.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:39:11.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:39:11.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:11.636 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:11 smithi176 ceph-mon[35713]: Reconfiguring mon.b (monmap changed)... 2024-09-12T02:39:11.636 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:11 smithi176 ceph-mon[35713]: Reconfiguring daemon mon.b on smithi062 2024-09-12T02:39:11.637 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:11.637 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:11.637 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:39:11.637 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:39:11.637 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:11.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:11 smithi062 ceph-mon[35527]: Reconfiguring mon.b (monmap changed)... 2024-09-12T02:39:11.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:11 smithi062 ceph-mon[35527]: Reconfiguring daemon mon.b on smithi062 2024-09-12T02:39:11.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:11.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:11.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:39:11.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:39:11.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:12.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:12 smithi018 ceph-mon[30616]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:12.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:12 smithi018 ceph-mon[30616]: Reconfiguring mon.c (monmap changed)... 2024-09-12T02:39:12.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:12 smithi018 ceph-mon[30616]: Reconfiguring daemon mon.c on smithi176 2024-09-12T02:39:12.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:12 smithi176 ceph-mon[35713]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:12.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:12 smithi176 ceph-mon[35713]: Reconfiguring mon.c (monmap changed)... 2024-09-12T02:39:12.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:12 smithi176 ceph-mon[35713]: Reconfiguring daemon mon.c on smithi176 2024-09-12T02:39:12.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:12 smithi062 ceph-mon[35527]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:12.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:12 smithi062 ceph-mon[35527]: Reconfiguring mon.c (monmap changed)... 2024-09-12T02:39:12.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:12 smithi062 ceph-mon[35527]: Reconfiguring daemon mon.c on smithi176 2024-09-12T02:39:13.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:13.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:13.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:13.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:13.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:13.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:13.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:39:13.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:39:13.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:39:13.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:13.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:13 smithi018 ceph-mon[30616]: Deploying daemon mgr.z on smithi176 2024-09-12T02:39:13.708 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:13.709 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:13.709 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:13.709 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:13.709 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:13.709 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:13.709 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:39:13.709 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:39:13.709 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:39:13.709 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:13.709 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:13 smithi176 ceph-mon[35713]: Deploying daemon mgr.z on smithi176 2024-09-12T02:39:13.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:13.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:13.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:13.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:13.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:13.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:13.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:39:13.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:39:13.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:39:13.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:13.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:13 smithi062 ceph-mon[35527]: Deploying daemon mgr.z on smithi176 2024-09-12T02:39:14.100 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:39:14.131 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_4 2024-09-12T02:39:14.498 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:39:14.642 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:14 smithi176 ceph-mon[35713]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:14.643 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:14 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:14.581+0000 7f341da3d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:39:14.643 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:14 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:14.641+0000 7f341da3d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:39:14.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:14 smithi062 ceph-mon[35527]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:14.783 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:14 smithi018 ceph-mon[30616]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:14.978 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:14 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:14.789+0000 7f341da3d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:39:14.978 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:14 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:14.856+0000 7f341da3d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:39:15.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.062+0000 7f3e64600640 1 -- 172.21.15.18:0/1889721383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e5c105920 msgr2=0x7f3e5c10c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:15.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.062+0000 7f3e64600640 1 --2- 172.21.15.18:0/1889721383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e5c105920 0x7f3e5c10c240 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009ca0 tx=0x7f3e5402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:39:15.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.062+0000 7f3e64600640 1 -- 172.21.15.18:0/1889721383 shutdown_connections 2024-09-12T02:39:15.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.062+0000 7f3e64600640 1 --2- 172.21.15.18:0/1889721383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e5c105920 0x7f3e5c10c240 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:15.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.062+0000 7f3e64600640 1 --2- 172.21.15.18:0/1889721383 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e5c104f60 0x7f3e5c1053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:15.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.062+0000 7f3e64600640 1 --2- 172.21.15.18:0/1889721383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e5c103e00 0x7f3e5c104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:15.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.062+0000 7f3e64600640 1 -- 172.21.15.18:0/1889721383 >> 172.21.15.18:0/1889721383 conn(0x7f3e5c0ff5b0 msgr2=0x7f3e5c1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:15.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.062+0000 7f3e64600640 1 -- 172.21.15.18:0/1889721383 shutdown_connections 2024-09-12T02:39:15.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.063+0000 7f3e64600640 1 -- 172.21.15.18:0/1889721383 wait complete. 2024-09-12T02:39:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.063+0000 7f3e64600640 1 Processor -- start 2024-09-12T02:39:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.063+0000 7f3e64600640 1 -- start start 2024-09-12T02:39:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.064+0000 7f3e64600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e5c103e00 0x7f3e5c19a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.064+0000 7f3e64600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e5c104f60 0x7f3e5c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.064+0000 7f3e64600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e5c105920 0x7f3e5c1a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.064+0000 7f3e64600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c10fb00 con 0x7f3e5c103e00 2024-09-12T02:39:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.064+0000 7f3e64600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c10f980 con 0x7f3e5c104f60 2024-09-12T02:39:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.064+0000 7f3e64600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c10fc80 con 0x7f3e5c105920 2024-09-12T02:39:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.064+0000 7f3e61c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e5c103e00 0x7f3e5c19a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.064+0000 7f3e61200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e5c104f60 0x7f3e5c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.064+0000 7f3e62600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e5c105920 0x7f3e5c1a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.064+0000 7f3e61c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e5c103e00 0x7f3e5c19a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47762/0 (socket says 172.21.15.18:47762) 2024-09-12T02:39:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.064+0000 7f3e61c00640 1 -- 172.21.15.18:0/4186193268 learned_addr learned my addr 172.21.15.18:0/4186193268 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:39:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.064+0000 7f3e61200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e5c104f60 0x7f3e5c19a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:33400/0 (socket says 172.21.15.18:33400) 2024-09-12T02:39:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.064+0000 7f3e62600640 1 --2- 172.21.15.18:0/4186193268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e5c105920 0x7f3e5c1a1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:40370/0 (socket says 172.21.15.18:40370) 2024-09-12T02:39:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.065+0000 7f3e61200640 1 -- 172.21.15.18:0/4186193268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e5c105920 msgr2=0x7f3e5c1a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.065+0000 7f3e61200640 1 --2- 172.21.15.18:0/4186193268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e5c105920 0x7f3e5c1a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.065+0000 7f3e61200640 1 -- 172.21.15.18:0/4186193268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e5c103e00 msgr2=0x7f3e5c19a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.065+0000 7f3e61200640 1 --2- 172.21.15.18:0/4186193268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e5c103e00 0x7f3e5c19a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.065+0000 7f3e61200640 1 -- 172.21.15.18:0/4186193268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c1a1c90 con 0x7f3e5c104f60 2024-09-12T02:39:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.065+0000 7f3e62600640 1 --2- 172.21.15.18:0/4186193268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e5c105920 0x7f3e5c1a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:39:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.065+0000 7f3e61c00640 1 --2- 172.21.15.18:0/4186193268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e5c103e00 0x7f3e5c19a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:39:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.065+0000 7f3e61200640 1 --2- 172.21.15.18:0/4186193268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e5c104f60 0x7f3e5c19a5a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800e9c0 tx=0x7f3e4800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.065+0000 7f3e5a000640 1 -- 172.21.15.18:0/4186193268 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4800ccc0 con 0x7f3e5c104f60 2024-09-12T02:39:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.065+0000 7f3e5a000640 1 -- 172.21.15.18:0/4186193268 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e480035f0 con 0x7f3e5c104f60 2024-09-12T02:39:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.065+0000 7f3e64600640 1 -- 172.21.15.18:0/4186193268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e5c1a1f80 con 0x7f3e5c104f60 2024-09-12T02:39:15.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.065+0000 7f3e5a000640 1 -- 172.21.15.18:0/4186193268 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4800ce60 con 0x7f3e5c104f60 2024-09-12T02:39:15.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.065+0000 7f3e64600640 1 -- 172.21.15.18:0/4186193268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e5c1a2430 con 0x7f3e5c104f60 2024-09-12T02:39:15.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.066+0000 7f3e5a000640 1 -- 172.21.15.18:0/4186193268 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3e48010690 con 0x7f3e5c104f60 2024-09-12T02:39:15.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.066+0000 7f3e64600640 1 -- 172.21.15.18:0/4186193268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e5c10b0c0 con 0x7f3e5c104f60 2024-09-12T02:39:15.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.067+0000 7f3e5a000640 1 --2- 172.21.15.18:0/4186193268 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3e440392c0 0x7f3e4403b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:15.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.067+0000 7f3e5a000640 1 -- 172.21.15.18:0/4186193268 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3e4804c8a0 con 0x7f3e5c104f60 2024-09-12T02:39:15.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.067+0000 7f3e61c00640 1 --2- 172.21.15.18:0/4186193268 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3e440392c0 0x7f3e4403b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:15.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.068+0000 7f3e61c00640 1 --2- 172.21.15.18:0/4186193268 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3e440392c0 0x7f3e4403b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3e50005fd0 tx=0x7f3e5000b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:15.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.072+0000 7f3e5a000640 1 -- 172.21.15.18:0/4186193268 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e4801f340 con 0x7f3e5c104f60 2024-09-12T02:39:15.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:15.266+0000 7f3e64600640 1 -- 172.21.15.18:0/4186193268 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3e5c062630 con 0x7f3e440392c0 2024-09-12T02:39:15.454 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:15.004+0000 7f341da3d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:39:15.454 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:15.142+0000 7f341da3d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:39:15.454 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:15.453+0000 7f341da3d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:39:15.728 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:15.514+0000 7f341da3d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:39:15.729 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:15.700+0000 7f341da3d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:39:15.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-mon[35713]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:15.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:15.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:15.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:15.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:39:15.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:39:15.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:39:15.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:15.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-mon[35713]: Deploying daemon mgr.y on smithi062 2024-09-12T02:39:15.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-mon[35713]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:39:15.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:39:15.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:39:15.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:15 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:15.861 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:15 smithi018 ceph-mon[30616]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:15.861 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:15 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:15.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:15 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:15.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:15 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:15.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:15 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:39:15.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:15 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:39:15.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:15 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:39:15.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:15 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:15.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:15 smithi018 ceph-mon[30616]: Deploying daemon mgr.y on smithi062 2024-09-12T02:39:15.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:15 smithi018 ceph-mon[30616]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:39:15.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:15 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:39:15.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:15 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:39:15.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:15 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:16.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:15 smithi062 ceph-mon[35527]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:16.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:15 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:16.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:15 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:16.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:15 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:16.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:15 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:39:16.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:15 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:39:16.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:15 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:39:16.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:15 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:16.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:15 smithi062 ceph-mon[35527]: Deploying daemon mgr.y on smithi062 2024-09-12T02:39:16.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:15 smithi062 ceph-mon[35527]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:39:16.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:15 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:39:16.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:15 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:39:16.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:15 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:16.784 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:16 smithi062 systemd[1]: Starting Ceph mgr.y for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T02:39:16.868 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:16 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:16.575+0000 7f341da3d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:39:16.868 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:16 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:16.644+0000 7f341da3d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:39:17.037 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:16 smithi062 podman[36874]: 2024-09-12 02:39:16.689568555 +0000 UTC m=+0.015400749 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:39:17.038 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:16 smithi062 podman[36874]: 2024-09-12 02:39:16.790774574 +0000 UTC m=+0.116606756 container create d9c451f580aeeb779c17dce9b90fba5718fde5fc4ddaea83063be479f7e35723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-12T02:39:17.038 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:17 smithi062 podman[36874]: 2024-09-12 02:39:17.009780032 +0000 UTC m=+0.335612214 container init d9c451f580aeeb779c17dce9b90fba5718fde5fc4ddaea83063be479f7e35723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-12T02:39:17.038 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:17 smithi062 podman[36874]: 2024-09-12 02:39:17.012638205 +0000 UTC m=+0.338470401 container start d9c451f580aeeb779c17dce9b90fba5718fde5fc4ddaea83063be479f7e35723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-12T02:39:17.038 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:17 smithi062 ceph-mgr[36893]: -- 172.21.15.62:0/3396993100 <== mon.2 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d6c14650e0 con 0x55d6c1442800 2024-09-12T02:39:17.357 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:17 smithi062 bash[36874]: d9c451f580aeeb779c17dce9b90fba5718fde5fc4ddaea83063be479f7e35723 2024-09-12T02:39:17.358 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:17 smithi062 systemd[1]: Started Ceph mgr.y for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:39:17.358 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:17 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:17.137+0000 7faac248c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:39:17.358 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:17 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:17.198+0000 7faac248c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:39:17.358 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:17 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:17.356+0000 7faac248c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:39:17.676 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:17.393+0000 7f341da3d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:39:17.676 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:17.515+0000 7f341da3d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:39:17.676 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:17.675+0000 7f341da3d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:39:17.745 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:17 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:17.428+0000 7faac248c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:39:17.745 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:17 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:17.588+0000 7faac248c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:39:17.745 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:17 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:17.744+0000 7faac248c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:39:17.974 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:17.742+0000 7f341da3d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:39:17.974 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:17.900+0000 7f341da3d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:39:18.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:18 smithi176 ceph-mon[35713]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:18.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:18 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:18.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:18 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:18.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:18 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:18.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:18 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:18.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:18 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:18.229 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:17.972+0000 7f341da3d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:39:18.229 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:18 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:18.035+0000 7f341da3d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:39:18.230 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:18 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:18.199+0000 7f341da3d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:39:18.283 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:18 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:18.081+0000 7faac248c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:39:18.283 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:18 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:18.146+0000 7faac248c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:39:18.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:18 smithi062 ceph-mon[35527]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:18.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:18 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:18.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:18 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:18.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:18 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:18.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:18 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:18.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:18 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:18.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:18 smithi018 ceph-mon[30616]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:18.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:18 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:18.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:18 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:18.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:18 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:18.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:18 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:18.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:18 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:18.547 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:18 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:18.265+0000 7f341da3d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:39:18.547 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:18 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:18.331+0000 7f341da3d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:39:18.548 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:18 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:18.425+0000 7f341da3d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:39:18.548 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:18 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:18.487+0000 7f341da3d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:39:18.548 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:18 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:18.546+0000 7f341da3d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:39:18.783 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:18 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:18.341+0000 7faac248c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:39:19.533 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:19.274+0000 7faac248c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:39:19.533 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:19.345+0000 7faac248c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:39:19.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/4251991451' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a61ecdc1-ceb9-43cb-a67d-b197888cca42"}]: dispatch 2024-09-12T02:39:19.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a61ecdc1-ceb9-43cb-a67d-b197888cca42"}]: dispatch 2024-09-12T02:39:19.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a61ecdc1-ceb9-43cb-a67d-b197888cca42"}]': finished 2024-09-12T02:39:19.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T02:39:19.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:19.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:19.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:19.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:19.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:19.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:19.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/803853546' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:39:19.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: Standby manager daemon z started 2024-09-12T02:39:19.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='mgr.? 172.21.15.176:0/4234966715' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:39:19.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='mgr.? 172.21.15.176:0/4234966715' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:39:19.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='mgr.? 172.21.15.176:0/4234966715' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:39:19.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:19 smithi062 ceph-mon[35527]: from='mgr.? 172.21.15.176:0/4234966715' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:39:19.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:19.587+0000 7f3e5a000640 1 -- 172.21.15.18:0/4186193268 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7f3e4801dd20 con 0x7f3e5c104f60 2024-09-12T02:39:19.728 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:39:19.341+0000 7f341da3d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:39:19.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/4251991451' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a61ecdc1-ceb9-43cb-a67d-b197888cca42"}]: dispatch 2024-09-12T02:39:19.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a61ecdc1-ceb9-43cb-a67d-b197888cca42"}]: dispatch 2024-09-12T02:39:19.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a61ecdc1-ceb9-43cb-a67d-b197888cca42"}]': finished 2024-09-12T02:39:19.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T02:39:19.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:19.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:19.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:19.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:19.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:19.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:19.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/803853546' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:39:19.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: Standby manager daemon z started 2024-09-12T02:39:19.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='mgr.? 172.21.15.176:0/4234966715' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:39:19.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='mgr.? 172.21.15.176:0/4234966715' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:39:19.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='mgr.? 172.21.15.176:0/4234966715' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:39:19.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:19 smithi176 ceph-mon[35713]: from='mgr.? 172.21.15.176:0/4234966715' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:39:19.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/4251991451' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a61ecdc1-ceb9-43cb-a67d-b197888cca42"}]: dispatch 2024-09-12T02:39:19.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a61ecdc1-ceb9-43cb-a67d-b197888cca42"}]: dispatch 2024-09-12T02:39:19.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a61ecdc1-ceb9-43cb-a67d-b197888cca42"}]': finished 2024-09-12T02:39:19.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T02:39:19.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:19.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:19.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:19.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:19.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:19.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:19.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:19.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/803853546' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:39:19.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: Standby manager daemon z started 2024-09-12T02:39:19.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='mgr.? 172.21.15.176:0/4234966715' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:39:19.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='mgr.? 172.21.15.176:0/4234966715' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:39:19.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='mgr.? 172.21.15.176:0/4234966715' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:39:19.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:19 smithi018 ceph-mon[30616]: from='mgr.? 172.21.15.176:0/4234966715' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:39:20.378 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:20 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:20.107+0000 7faac248c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:39:20.378 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:20 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:20.228+0000 7faac248c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:39:20.670 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:20 smithi062 ceph-mon[35527]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:20.670 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:20 smithi062 ceph-mon[35527]: mgrmap e14: x(active, since 69s), standbys: z 2024-09-12T02:39:20.670 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:20 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:39:20.670 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:20 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:20.377+0000 7faac248c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:39:20.670 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:20 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:20.441+0000 7faac248c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:39:20.670 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:20 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:20.598+0000 7faac248c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:39:20.671 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:20 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:20.668+0000 7faac248c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:39:20.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:20 smithi176 ceph-mon[35713]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:20.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:20 smithi176 ceph-mon[35713]: mgrmap e14: x(active, since 69s), standbys: z 2024-09-12T02:39:20.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:20 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:39:20.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:20 smithi018 ceph-mon[30616]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:20.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:20 smithi018 ceph-mon[30616]: mgrmap e14: x(active, since 69s), standbys: z 2024-09-12T02:39:20.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:20 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:39:20.965 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:20 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:20.731+0000 7faac248c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:39:20.966 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:20 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:20.896+0000 7faac248c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:39:20.966 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:20 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:20.964+0000 7faac248c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:39:21.245 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:21 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:21.034+0000 7faac248c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:39:21.245 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:21 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:21.120+0000 7faac248c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:39:21.245 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:21 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:21.182+0000 7faac248c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:39:21.245 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:21 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:21.244+0000 7faac248c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:39:21.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:21 smithi018 ceph-mon[30616]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:21.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:21 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:21.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:21 smithi176 ceph-mon[35713]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:21.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:21 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:22.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:21 smithi062 ceph-mon[35527]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:22.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:21 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:22.533 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:39:22 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:39:22.074+0000 7faac248c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:39:22.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:22.591+0000 7f3e5a000640 1 -- 172.21.15.18:0/4186193268 <== mon.2 v2:172.21.15.62:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f3e480037a0 con 0x7f3e5c104f60 2024-09-12T02:39:22.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:22 smithi018 ceph-mon[30616]: Standby manager daemon y started 2024-09-12T02:39:22.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:22 smithi018 ceph-mon[30616]: from='mgr.? 172.21.15.62:0/3811702202' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:39:22.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:22 smithi018 ceph-mon[30616]: from='mgr.? 172.21.15.62:0/3811702202' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:39:22.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:22 smithi018 ceph-mon[30616]: from='mgr.? 172.21.15.62:0/3811702202' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:39:22.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:22 smithi018 ceph-mon[30616]: from='mgr.? 172.21.15.62:0/3811702202' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:39:22.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:22 smithi176 ceph-mon[35713]: Standby manager daemon y started 2024-09-12T02:39:22.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:22 smithi176 ceph-mon[35713]: from='mgr.? 172.21.15.62:0/3811702202' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:39:22.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:22 smithi176 ceph-mon[35713]: from='mgr.? 172.21.15.62:0/3811702202' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:39:22.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:22 smithi176 ceph-mon[35713]: from='mgr.? 172.21.15.62:0/3811702202' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:39:22.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:22 smithi176 ceph-mon[35713]: from='mgr.? 172.21.15.62:0/3811702202' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:39:23.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:22 smithi062 ceph-mon[35527]: Standby manager daemon y started 2024-09-12T02:39:23.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:22 smithi062 ceph-mon[35527]: from='mgr.? 172.21.15.62:0/3811702202' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:39:23.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:22 smithi062 ceph-mon[35527]: from='mgr.? 172.21.15.62:0/3811702202' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:39:23.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:22 smithi062 ceph-mon[35527]: from='mgr.? 172.21.15.62:0/3811702202' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:39:23.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:22 smithi062 ceph-mon[35527]: from='mgr.? 172.21.15.62:0/3811702202' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:39:23.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:23 smithi018 ceph-mon[30616]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:23.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:23 smithi018 ceph-mon[30616]: mgrmap e15: x(active, since 72s), standbys: z, y 2024-09-12T02:39:23.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:23 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:39:23.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:23 smithi176 ceph-mon[35713]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:23.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:23 smithi176 ceph-mon[35713]: mgrmap e15: x(active, since 72s), standbys: z, y 2024-09-12T02:39:23.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:23 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:39:24.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:23 smithi062 ceph-mon[35527]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:24.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:23 smithi062 ceph-mon[35527]: mgrmap e15: x(active, since 72s), standbys: z, y 2024-09-12T02:39:24.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:23 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:39:25.677 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:25 smithi018 ceph-mon[30616]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:25.857 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:25 smithi062 ceph-mon[35527]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:25.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:25 smithi176 ceph-mon[35713]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:27.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:27 smithi018 ceph-mon[30616]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:27.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T02:39:27.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:27.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:27 smithi018 ceph-mon[30616]: Deploying daemon osd.0 on smithi018 2024-09-12T02:39:27.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:27 smithi176 ceph-mon[35713]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:27.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T02:39:27.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:27.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:27 smithi176 ceph-mon[35713]: Deploying daemon osd.0 on smithi018 2024-09-12T02:39:28.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:27 smithi062 ceph-mon[35527]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:28.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T02:39:28.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:28.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:27 smithi062 ceph-mon[35527]: Deploying daemon osd.0 on smithi018 2024-09-12T02:39:29.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:29 smithi018 ceph-mon[30616]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:29.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:29 smithi176 ceph-mon[35713]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:30.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:29 smithi062 ceph-mon[35527]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:31.775 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:31 smithi018 ceph-mon[30616]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:31.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:31 smithi176 ceph-mon[35713]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:32.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:31 smithi062 ceph-mon[35527]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:33.722 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:33 smithi018 ceph-mon[30616]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:33.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:33 smithi176 ceph-mon[35713]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:34.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:33 smithi062 ceph-mon[35527]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:35.857 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:35 smithi018 ceph-mon[30616]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:35.857 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:35 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:35.857 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:35 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:35.858 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:35 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:35.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:35 smithi176 ceph-mon[35713]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:35.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:35 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:35.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:35 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:35.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:35 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:36.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:35 smithi062 ceph-mon[35527]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:36.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:35 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:36.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:35 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:36.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:35 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:38.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:38 smithi176 ceph-mon[35713]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:38.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:38 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:38.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:38 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:38.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:38 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:38.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:38 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:38.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:38 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:38.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:38 smithi062 ceph-mon[35527]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:38.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:38 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:38.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:38 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:38.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:38 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:38.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:38 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:38.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:38 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:38.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:38 smithi018 ceph-mon[30616]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:38.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:38 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:38.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:38 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:38.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:38 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:38.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:38 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:38.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:38 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:40.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:40.438+0000 7f3e5a000640 1 -- 172.21.15.18:0/4186193268 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3e5c062630 con 0x7f3e440392c0 2024-09-12T02:39:40.439 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 0 on host 'smithi018' 2024-09-12T02:39:40.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:40.440+0000 7f3e64600640 1 -- 172.21.15.18:0/4186193268 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3e440392c0 msgr2=0x7f3e4403b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:40.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:40.440+0000 7f3e64600640 1 --2- 172.21.15.18:0/4186193268 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3e440392c0 0x7f3e4403b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3e50005fd0 tx=0x7f3e5000b4a0 comp rx=0 tx=0).stop 2024-09-12T02:39:40.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:40.441+0000 7f3e64600640 1 -- 172.21.15.18:0/4186193268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e5c104f60 msgr2=0x7f3e5c19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:40.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:40.441+0000 7f3e64600640 1 --2- 172.21.15.18:0/4186193268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e5c104f60 0x7f3e5c19a5a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800e9c0 tx=0x7f3e4800ee80 comp rx=0 tx=0).stop 2024-09-12T02:39:40.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:40.441+0000 7f3e64600640 1 -- 172.21.15.18:0/4186193268 shutdown_connections 2024-09-12T02:39:40.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:40.441+0000 7f3e64600640 1 --2- 172.21.15.18:0/4186193268 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3e440392c0 0x7f3e4403b780 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:40.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:40.441+0000 7f3e64600640 1 --2- 172.21.15.18:0/4186193268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e5c105920 0x7f3e5c1a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:40.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:40.441+0000 7f3e64600640 1 --2- 172.21.15.18:0/4186193268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e5c104f60 0x7f3e5c19a5a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:40.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:40.441+0000 7f3e64600640 1 --2- 172.21.15.18:0/4186193268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e5c103e00 0x7f3e5c19a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:40.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:40.441+0000 7f3e64600640 1 -- 172.21.15.18:0/4186193268 >> 172.21.15.18:0/4186193268 conn(0x7f3e5c0ff5b0 msgr2=0x7f3e5c108290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:40.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:40.441+0000 7f3e64600640 1 -- 172.21.15.18:0/4186193268 shutdown_connections 2024-09-12T02:39:40.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:39:40.441+0000 7f3e64600640 1 -- 172.21.15.18:0/4186193268 wait complete. 2024-09-12T02:39:40.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:40 smithi062 ceph-mon[35527]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:40.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:40 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:40.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:40 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:40.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:40 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:40.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:40 smithi018 ceph-mon[30616]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:40.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:40 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:40.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:40 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:40.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:40 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:40.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:40 smithi176 ceph-mon[35713]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:40.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:40 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:40.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:40 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:40.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:40 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:41.353 DEBUG:teuthology.orchestra.run.smithi018:osd.0> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.0.service 2024-09-12T02:39:41.357 INFO:tasks.cephadm:Deploying osd.1 on smithi062 with /dev/vg_nvme/lv_4... 2024-09-12T02:39:41.357 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T02:39:41.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:41 smithi018 ceph-mon[30616]: from='osd.0 [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T02:39:41.577 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 02:39:41 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-0[44604]: 2024-09-12T02:39:41.463+0000 7ff8f5839640 -1 osd.0 0 log_to_monitors true 2024-09-12T02:39:41.615 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:39:41.723 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:41 smithi062 ceph-mon[35527]: from='osd.0 [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T02:39:41.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:41 smithi176 ceph-mon[35713]: from='osd.0 [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T02:39:42.645 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:42 smithi062 ceph-mon[35527]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:42.645 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:42 smithi062 ceph-mon[35527]: from='osd.0 [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T02:39:42.645 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:42 smithi062 ceph-mon[35527]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T02:39:42.645 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:42 smithi062 ceph-mon[35527]: from='osd.0 [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-12T02:39:42.645 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:42 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:42.759 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:42 smithi018 ceph-mon[30616]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:42.759 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:42 smithi018 ceph-mon[30616]: from='osd.0 [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T02:39:42.759 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:42 smithi018 ceph-mon[30616]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T02:39:42.759 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:42 smithi018 ceph-mon[30616]: from='osd.0 [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-12T02:39:42.759 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:42 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:42.759 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 02:39:42 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-0[44604]: 2024-09-12T02:39:42.515+0000 7ff8f0400640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T02:39:42.759 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 02:39:42 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-0[44604]: 2024-09-12T02:39:42.518+0000 7ff8eb400640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:39:42.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:42 smithi176 ceph-mon[35713]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:42.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:42 smithi176 ceph-mon[35713]: from='osd.0 [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T02:39:42.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:42 smithi176 ceph-mon[35713]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T02:39:42.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:42 smithi176 ceph-mon[35713]: from='osd.0 [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-12T02:39:42.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:42 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:43.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:43 smithi062 ceph-mon[35527]: from='osd.0 [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-12T02:39:43.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:43 smithi062 ceph-mon[35527]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T02:39:43.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:43 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:43.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:43 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:43.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:43 smithi018 ceph-mon[30616]: from='osd.0 [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-12T02:39:43.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:43 smithi018 ceph-mon[30616]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T02:39:43.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:43 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:43.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:43 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:43.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:43 smithi176 ceph-mon[35713]: from='osd.0 [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-12T02:39:43.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:43 smithi176 ceph-mon[35713]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T02:39:43.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:43 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:43.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:43 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:44.021 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:39:44.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi062:vg_nvme/lv_4 2024-09-12T02:39:44.292 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:39:44.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:44 smithi018 ceph-mon[30616]: purged_snaps scrub starts 2024-09-12T02:39:44.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:44 smithi018 ceph-mon[30616]: purged_snaps scrub ok 2024-09-12T02:39:44.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:44 smithi018 ceph-mon[30616]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:44.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:44 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:44.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:44 smithi018 ceph-mon[30616]: osd.0 [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522] boot 2024-09-12T02:39:44.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:44 smithi018 ceph-mon[30616]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T02:39:44.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:44 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:44.738 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:44 smithi062 ceph-mon[35527]: purged_snaps scrub starts 2024-09-12T02:39:44.738 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:44 smithi062 ceph-mon[35527]: purged_snaps scrub ok 2024-09-12T02:39:44.738 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:44 smithi062 ceph-mon[35527]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:44.738 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:44 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:44.738 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:44 smithi062 ceph-mon[35527]: osd.0 [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522] boot 2024-09-12T02:39:44.738 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:44 smithi062 ceph-mon[35527]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T02:39:44.738 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:44 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:44.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.739+0000 7f66447c8640 1 -- 172.21.15.62:0/3255506164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663c1026d0 msgr2=0x7f663c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:44.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.739+0000 7f66447c8640 1 --2- 172.21.15.62:0/3255506164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663c1026d0 0x7f663c108f60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6634009ca0 tx=0x7f663402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:39:44.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.739+0000 7f66447c8640 1 -- 172.21.15.62:0/3255506164 shutdown_connections 2024-09-12T02:39:44.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.739+0000 7f66447c8640 1 --2- 172.21.15.62:0/3255506164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663c1026d0 0x7f663c108f60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:44.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.739+0000 7f66447c8640 1 --2- 172.21.15.62:0/3255506164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f663c101d10 0x7f663c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:44.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.739+0000 7f66447c8640 1 --2- 172.21.15.62:0/3255506164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f663c100b10 0x7f663c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:44.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.739+0000 7f66447c8640 1 -- 172.21.15.62:0/3255506164 >> 172.21.15.62:0/3255506164 conn(0x7f663c0fc2a0 msgr2=0x7f663c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.739+0000 7f66447c8640 1 -- 172.21.15.62:0/3255506164 shutdown_connections 2024-09-12T02:39:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.739+0000 7f66447c8640 1 -- 172.21.15.62:0/3255506164 wait complete. 2024-09-12T02:39:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.740+0000 7f66447c8640 1 Processor -- start 2024-09-12T02:39:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.740+0000 7f66447c8640 1 -- start start 2024-09-12T02:39:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.740+0000 7f66447c8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663c100b10 0x7f663c19a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.740+0000 7f66447c8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f663c101d10 0x7f663c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.740+0000 7f66447c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f663c1026d0 0x7f663c1a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.740+0000 7f66447c8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f663c10c770 con 0x7f663c1026d0 2024-09-12T02:39:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.740+0000 7f66447c8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f663c10c5f0 con 0x7f663c100b10 2024-09-12T02:39:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.740+0000 7f66447c8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f663c10c8f0 con 0x7f663c101d10 2024-09-12T02:39:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.740+0000 7f6642564640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663c100b10 0x7f663c19a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.740+0000 7f6642564640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663c100b10 0x7f663c19a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51560/0 (socket says 172.21.15.62:51560) 2024-09-12T02:39:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.740+0000 7f6642564640 1 -- 172.21.15.62:0/3533637406 learned_addr learned my addr 172.21.15.62:0/3533637406 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:39:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.741+0000 7f6641d63640 1 --2- 172.21.15.62:0/3533637406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f663c101d10 0x7f663c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.741+0000 7f6642d65640 1 --2- 172.21.15.62:0/3533637406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f663c1026d0 0x7f663c1a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.741+0000 7f6642564640 1 -- 172.21.15.62:0/3533637406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f663c101d10 msgr2=0x7f663c19a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.741+0000 7f6642564640 1 --2- 172.21.15.62:0/3533637406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f663c101d10 0x7f663c19a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.741+0000 7f6642564640 1 -- 172.21.15.62:0/3533637406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f663c1026d0 msgr2=0x7f663c1a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.741+0000 7f6642564640 1 --2- 172.21.15.62:0/3533637406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f663c1026d0 0x7f663c1a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.741+0000 7f6642564640 1 -- 172.21.15.62:0/3533637406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663c1a1d50 con 0x7f663c100b10 2024-09-12T02:39:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.741+0000 7f6642d65640 1 --2- 172.21.15.62:0/3533637406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f663c1026d0 0x7f663c1a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.741+0000 7f6642564640 1 --2- 172.21.15.62:0/3533637406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663c100b10 0x7f663c19a120 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f663800e9c0 tx=0x7f663800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.741+0000 7f66337fe640 1 -- 172.21.15.62:0/3533637406 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663800cd80 con 0x7f663c100b10 2024-09-12T02:39:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.741+0000 7f66337fe640 1 -- 172.21.15.62:0/3533637406 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66380035f0 con 0x7f663c100b10 2024-09-12T02:39:44.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.741+0000 7f66337fe640 1 -- 172.21.15.62:0/3533637406 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6638010690 con 0x7f663c100b10 2024-09-12T02:39:44.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.741+0000 7f66447c8640 1 -- 172.21.15.62:0/3533637406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f663c1a1fe0 con 0x7f663c100b10 2024-09-12T02:39:44.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.741+0000 7f66447c8640 1 -- 172.21.15.62:0/3533637406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f663c1a24e0 con 0x7f663c100b10 2024-09-12T02:39:44.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.742+0000 7f66447c8640 1 -- 172.21.15.62:0/3533637406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f663c1a27a0 con 0x7f663c100b10 2024-09-12T02:39:44.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.743+0000 7f66337fe640 1 -- 172.21.15.62:0/3533637406 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f66380037a0 con 0x7f663c100b10 2024-09-12T02:39:44.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.744+0000 7f66337fe640 1 --2- 172.21.15.62:0/3533637406 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f66280a2ba0 0x7f66280a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:44.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.744+0000 7f66337fe640 1 -- 172.21.15.62:0/3533637406 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f66380cda00 con 0x7f663c100b10 2024-09-12T02:39:44.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.747+0000 7f6641d63640 1 --2- 172.21.15.62:0/3533637406 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f66280a2ba0 0x7f66280a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:44.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.747+0000 7f6641d63640 1 --2- 172.21.15.62:0/3533637406 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f66280a2ba0 0x7f66280a5060 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f663c19b640 tx=0x7f662c00b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.748+0000 7f66337fe640 1 -- 172.21.15.62:0/3533637406 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f66380cfe20 con 0x7f663c100b10 2024-09-12T02:39:44.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:39:44.931+0000 7f66447c8640 1 -- 172.21.15.62:0/3533637406 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f663c1a2970 con 0x7f66280a2ba0 2024-09-12T02:39:44.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:44 smithi176 ceph-mon[35713]: purged_snaps scrub starts 2024-09-12T02:39:44.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:44 smithi176 ceph-mon[35713]: purged_snaps scrub ok 2024-09-12T02:39:44.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:44 smithi176 ceph-mon[35713]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:39:44.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:44 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:44.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:44 smithi176 ceph-mon[35713]: osd.0 [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522] boot 2024-09-12T02:39:44.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:44 smithi176 ceph-mon[35713]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T02:39:44.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:44 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:39:45.625 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:45 smithi062 ceph-mon[35527]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T02:39:45.625 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:39:45.625 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:39:45.625 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:45.625 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:45.625 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:45.625 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:39:45.625 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:45.625 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:45.626 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:45.626 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:45.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:45 smithi018 ceph-mon[30616]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T02:39:45.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:39:45.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:39:45.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:45.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:45.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:45.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:39:45.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:45.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:45.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:45.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:45.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:45 smithi176 ceph-mon[35713]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T02:39:45.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:39:45.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:39:45.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:45.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:45.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:45.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:39:45.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:45.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:45.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:45.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:39:46.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:46 smithi062 ceph-mon[35527]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:46.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:46 smithi062 ceph-mon[35527]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:39:46.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:46 smithi062 ceph-mon[35527]: Detected new or changed devices on smithi018 2024-09-12T02:39:46.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:46 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi018 to 17094M 2024-09-12T02:39:46.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:46 smithi018 ceph-mon[30616]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:46.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:46 smithi018 ceph-mon[30616]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:39:46.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:46 smithi018 ceph-mon[30616]: Detected new or changed devices on smithi018 2024-09-12T02:39:46.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:46 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi018 to 17094M 2024-09-12T02:39:46.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:46 smithi176 ceph-mon[35713]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:46.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:46 smithi176 ceph-mon[35713]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:39:46.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:46 smithi176 ceph-mon[35713]: Detected new or changed devices on smithi018 2024-09-12T02:39:46.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:46 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi018 to 17094M 2024-09-12T02:39:47.714 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:47 smithi062 ceph-mon[35527]: from='client.? 172.21.15.62:0/700477719' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b84f4be-23ce-466c-b974-b9851521785d"}]: dispatch 2024-09-12T02:39:47.714 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:47 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b84f4be-23ce-466c-b974-b9851521785d"}]: dispatch 2024-09-12T02:39:47.714 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:47 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b84f4be-23ce-466c-b974-b9851521785d"}]': finished 2024-09-12T02:39:47.714 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:47 smithi062 ceph-mon[35527]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T02:39:47.715 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:47 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:39:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:47 smithi018 ceph-mon[30616]: from='client.? 172.21.15.62:0/700477719' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b84f4be-23ce-466c-b974-b9851521785d"}]: dispatch 2024-09-12T02:39:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:47 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b84f4be-23ce-466c-b974-b9851521785d"}]: dispatch 2024-09-12T02:39:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:47 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b84f4be-23ce-466c-b974-b9851521785d"}]': finished 2024-09-12T02:39:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:47 smithi018 ceph-mon[30616]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T02:39:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:47 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:39:47.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:47 smithi176 ceph-mon[35713]: from='client.? 172.21.15.62:0/700477719' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b84f4be-23ce-466c-b974-b9851521785d"}]: dispatch 2024-09-12T02:39:47.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:47 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b84f4be-23ce-466c-b974-b9851521785d"}]: dispatch 2024-09-12T02:39:47.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:47 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b84f4be-23ce-466c-b974-b9851521785d"}]': finished 2024-09-12T02:39:47.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:47 smithi176 ceph-mon[35713]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T02:39:47.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:47 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:39:48.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:48 smithi062 ceph-mon[35527]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:48.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:48 smithi062 ceph-mon[35527]: from='client.? 172.21.15.62:0/3928768057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:39:48.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:48 smithi018 ceph-mon[30616]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:48 smithi018 ceph-mon[30616]: from='client.? 172.21.15.62:0/3928768057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:39:48.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:48 smithi176 ceph-mon[35713]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:48.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:48 smithi176 ceph-mon[35713]: from='client.? 172.21.15.62:0/3928768057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:39:50.781 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:50 smithi176 ceph-mon[35713]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:50.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:50 smithi062 ceph-mon[35527]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:50.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:50 smithi018 ceph-mon[30616]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:52.586 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:52 smithi062 ceph-mon[35527]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:52.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:52 smithi018 ceph-mon[30616]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:52.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:52 smithi176 ceph-mon[35713]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:54.641 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:54 smithi062 ceph-mon[35527]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:54.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:54 smithi018 ceph-mon[30616]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:54.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:54 smithi176 ceph-mon[35713]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:55.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:55 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T02:39:55.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:55 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:55.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:55 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T02:39:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:55 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:55.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:55 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T02:39:55.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:55 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:56.774 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:56 smithi062 ceph-mon[35527]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:56.774 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:56 smithi062 ceph-mon[35527]: Deploying daemon osd.1 on smithi062 2024-09-12T02:39:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:56 smithi018 ceph-mon[30616]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:56 smithi018 ceph-mon[30616]: Deploying daemon osd.1 on smithi062 2024-09-12T02:39:56.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:56 smithi176 ceph-mon[35713]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:56.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:56 smithi176 ceph-mon[35713]: Deploying daemon osd.1 on smithi062 2024-09-12T02:39:58.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:39:58 smithi018 ceph-mon[30616]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:58.666 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:39:58 smithi062 ceph-mon[35527]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:39:58.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:39:58 smithi176 ceph-mon[35713]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:00.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:00 smithi018 ceph-mon[30616]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:00.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:00 smithi018 ceph-mon[30616]: overall HEALTH_OK 2024-09-12T02:40:00.896 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:00 smithi062 ceph-mon[35527]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:00.896 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:00 smithi062 ceph-mon[35527]: overall HEALTH_OK 2024-09-12T02:40:00.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:00 smithi176 ceph-mon[35713]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:00.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:00 smithi176 ceph-mon[35713]: overall HEALTH_OK 2024-09-12T02:40:01.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:01 smithi018 ceph-mon[30616]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:01.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:01 smithi176 ceph-mon[35713]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:02.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:01 smithi062 ceph-mon[35527]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:02.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:02 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:02.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:02 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:02.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:02 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:03.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:02 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:03.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:02 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:03.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:02 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:03.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:02 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:03.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:02 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:03.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:02 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:03.921 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:03 smithi062 ceph-mon[35527]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:04.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:03 smithi018 ceph-mon[30616]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:04.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:03 smithi176 ceph-mon[35713]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:05.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:40:05.267+0000 7f66337fe640 1 -- 172.21.15.62:0/3533637406 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f663c1a2970 con 0x7f66280a2ba0 2024-09-12T02:40:05.269 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 1 on host 'smithi062' 2024-09-12T02:40:05.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:40:05.271+0000 7f66447c8640 1 -- 172.21.15.62:0/3533637406 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f66280a2ba0 msgr2=0x7f66280a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:05.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:40:05.271+0000 7f66447c8640 1 --2- 172.21.15.62:0/3533637406 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f66280a2ba0 0x7f66280a5060 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f663c19b640 tx=0x7f662c00b590 comp rx=0 tx=0).stop 2024-09-12T02:40:05.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:40:05.271+0000 7f66447c8640 1 -- 172.21.15.62:0/3533637406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663c100b10 msgr2=0x7f663c19a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:05.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:40:05.271+0000 7f66447c8640 1 --2- 172.21.15.62:0/3533637406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663c100b10 0x7f663c19a120 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f663800e9c0 tx=0x7f663800ee80 comp rx=0 tx=0).stop 2024-09-12T02:40:05.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:40:05.271+0000 7f66447c8640 1 -- 172.21.15.62:0/3533637406 shutdown_connections 2024-09-12T02:40:05.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:40:05.271+0000 7f66447c8640 1 --2- 172.21.15.62:0/3533637406 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f66280a2ba0 0x7f66280a5060 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:05.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:40:05.271+0000 7f66447c8640 1 --2- 172.21.15.62:0/3533637406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f663c1026d0 0x7f663c1a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:05.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:40:05.271+0000 7f66447c8640 1 --2- 172.21.15.62:0/3533637406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f663c101d10 0x7f663c19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:05.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:40:05.271+0000 7f66447c8640 1 --2- 172.21.15.62:0/3533637406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663c100b10 0x7f663c19a120 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:05.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:40:05.271+0000 7f66447c8640 1 -- 172.21.15.62:0/3533637406 >> 172.21.15.62:0/3533637406 conn(0x7f663c0fc2a0 msgr2=0x7f663c0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:05.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:40:05.271+0000 7f66447c8640 1 -- 172.21.15.62:0/3533637406 shutdown_connections 2024-09-12T02:40:05.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:40:05.271+0000 7f66447c8640 1 -- 172.21.15.62:0/3533637406 wait complete. 2024-09-12T02:40:05.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:05.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:05.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:05.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:40:05.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:05.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:05.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:05.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:05.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:40:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:05.782 DEBUG:teuthology.orchestra.run.smithi062:osd.1> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.1.service 2024-09-12T02:40:05.784 INFO:tasks.cephadm:Deploying osd.2 on smithi176 with /dev/vg_nvme/lv_4... 2024-09-12T02:40:05.785 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T02:40:05.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:40:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:06.043 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:40:06.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:06 smithi176 ceph-mon[35713]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:06.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:06 smithi062 ceph-mon[35527]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:06.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:06 smithi018 ceph-mon[30616]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:08.259 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 02:40:08 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-1[39979]: 2024-09-12T02:40:08.109+0000 7f6cee0ce640 -1 osd.1 0 log_to_monitors true 2024-09-12T02:40:08.421 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:40:08.448 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi176:vg_nvme/lv_4 2024-09-12T02:40:08.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:08 smithi062 ceph-mon[35527]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:08.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:08 smithi062 ceph-mon[35527]: from='osd.1 [v2:172.21.15.62:6800/3139630617,v1:172.21.15.62:6801/3139630617]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:40:08.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:08 smithi062 ceph-mon[35527]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:40:08.698 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:40:08.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:08 smithi176 ceph-mon[35713]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:08.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:08 smithi176 ceph-mon[35713]: from='osd.1 [v2:172.21.15.62:6800/3139630617,v1:172.21.15.62:6801/3139630617]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:40:08.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:08 smithi176 ceph-mon[35713]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:40:08.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:08 smithi018 ceph-mon[30616]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:08.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:08 smithi018 ceph-mon[30616]: from='osd.1 [v2:172.21.15.62:6800/3139630617,v1:172.21.15.62:6801/3139630617]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:40:08.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:08 smithi018 ceph-mon[30616]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:40:09.162 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.155+0000 7faaa80fa640 1 -- 172.21.15.176:0/4348300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faaa00fff10 msgr2=0x7faaa0100310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:09.162 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.155+0000 7faaa80fa640 1 --2- 172.21.15.176:0/4348300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faaa00fff10 0x7faaa0100310 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faa94009900 tx=0x7faa9402a410 comp rx=0 tx=0).stop 2024-09-12T02:40:09.162 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.155+0000 7faaa80fa640 1 -- 172.21.15.176:0/4348300 shutdown_connections 2024-09-12T02:40:09.162 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.155+0000 7faaa80fa640 1 --2- 172.21.15.176:0/4348300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaa0101640 0x7faaa0101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:09.162 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.155+0000 7faaa80fa640 1 --2- 172.21.15.176:0/4348300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaa0100c80 0x7faaa0101100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:09.162 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.155+0000 7faaa80fa640 1 --2- 172.21.15.176:0/4348300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faaa00fff10 0x7faaa0100310 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:09.162 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.155+0000 7faaa80fa640 1 -- 172.21.15.176:0/4348300 >> 172.21.15.176:0/4348300 conn(0x7faaa00fba80 msgr2=0x7faaa00fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:09.162 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.155+0000 7faaa80fa640 1 -- 172.21.15.176:0/4348300 shutdown_connections 2024-09-12T02:40:09.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.156+0000 7faaa80fa640 1 -- 172.21.15.176:0/4348300 wait complete. 2024-09-12T02:40:09.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.156+0000 7faaa80fa640 1 Processor -- start 2024-09-12T02:40:09.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.156+0000 7faaa80fa640 1 -- start start 2024-09-12T02:40:09.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.156+0000 7faaa80fa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faaa00fff10 0x7faaa019a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:09.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.156+0000 7faaa80fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaa0100c80 0x7faaa019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:09.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.156+0000 7faaa80fa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaa0101640 0x7faaa01a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:09.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.156+0000 7faaa80fa640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faaa010fb70 con 0x7faaa0100c80 2024-09-12T02:40:09.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.156+0000 7faaa80fa640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7faaa010f9f0 con 0x7faaa0101640 2024-09-12T02:40:09.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.156+0000 7faaa80fa640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faaa010fcf0 con 0x7faaa00fff10 2024-09-12T02:40:09.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.156+0000 7faaa5e96640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faaa00fff10 0x7faaa019a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:09.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.156+0000 7faaa5e96640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faaa00fff10 0x7faaa019a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:38272/0 (socket says 172.21.15.176:38272) 2024-09-12T02:40:09.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.156+0000 7faaa5e96640 1 -- 172.21.15.176:0/527576819 learned_addr learned my addr 172.21.15.176:0/527576819 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-12T02:40:09.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.157+0000 7faaa5695640 1 --2- 172.21.15.176:0/527576819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaa0100c80 0x7faaa019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:09.164 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.157+0000 7faaa6697640 1 --2- 172.21.15.176:0/527576819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaa0101640 0x7faaa01a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:09.164 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.157+0000 7faaa5e96640 1 -- 172.21.15.176:0/527576819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaa0101640 msgr2=0x7faaa01a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:09.164 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.157+0000 7faaa5e96640 1 --2- 172.21.15.176:0/527576819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaa0101640 0x7faaa01a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:09.164 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.157+0000 7faaa5e96640 1 -- 172.21.15.176:0/527576819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaa0100c80 msgr2=0x7faaa019a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:09.164 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.157+0000 7faaa5e96640 1 --2- 172.21.15.176:0/527576819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaa0100c80 0x7faaa019a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:09.164 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.157+0000 7faaa5e96640 1 -- 172.21.15.176:0/527576819 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa01a1ef0 con 0x7faaa00fff10 2024-09-12T02:40:09.164 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.157+0000 7faaa5e96640 1 --2- 172.21.15.176:0/527576819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faaa00fff10 0x7faaa019a2c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faa94009230 tx=0x7faa94004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:09.164 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.157+0000 7faa92ffd640 1 -- 172.21.15.176:0/527576819 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9403f030 con 0x7faaa00fff10 2024-09-12T02:40:09.164 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.157+0000 7faaa80fa640 1 -- 172.21.15.176:0/527576819 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa01a2180 con 0x7faaa00fff10 2024-09-12T02:40:09.164 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.157+0000 7faa92ffd640 1 -- 172.21.15.176:0/527576819 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa94003ce0 con 0x7faaa00fff10 2024-09-12T02:40:09.164 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.157+0000 7faa92ffd640 1 -- 172.21.15.176:0/527576819 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94035070 con 0x7faaa00fff10 2024-09-12T02:40:09.164 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.157+0000 7faaa80fa640 1 -- 172.21.15.176:0/527576819 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa01a26e0 con 0x7faaa00fff10 2024-09-12T02:40:09.164 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.158+0000 7faaa80fa640 1 -- 172.21.15.176:0/527576819 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa010ba30 con 0x7faaa00fff10 2024-09-12T02:40:09.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.159+0000 7faa92ffd640 1 -- 172.21.15.176:0/527576819 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7faa94042030 con 0x7faaa00fff10 2024-09-12T02:40:09.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.160+0000 7faa92ffd640 1 --2- 172.21.15.176:0/527576819 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faa8c0a2b20 0x7faa8c0a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:09.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.160+0000 7faa92ffd640 1 -- 172.21.15.176:0/527576819 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7faa940ede20 con 0x7faaa00fff10 2024-09-12T02:40:09.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.160+0000 7faaa5695640 1 --2- 172.21.15.176:0/527576819 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faa8c0a2b20 0x7faa8c0a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:09.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.161+0000 7faaa5695640 1 --2- 172.21.15.176:0/527576819 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faa8c0a2b20 0x7faa8c0a4fe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faaa019b7e0 tx=0x7faa9c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:09.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.165+0000 7faa92ffd640 1 -- 172.21.15.176:0/527576819 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa940bc770 con 0x7faaa00fff10 2024-09-12T02:40:09.345 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:09.344+0000 7faaa80fa640 1 -- 172.21.15.176:0/527576819 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7faaa0062630 con 0x7faa8c0a2b20 2024-09-12T02:40:09.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:09 smithi176 ceph-mon[35713]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:40:09.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:09 smithi176 ceph-mon[35713]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:40:09.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:40:09.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:09 smithi176 ceph-mon[35713]: from='osd.1 [v2:172.21.15.62:6800/3139630617,v1:172.21.15.62:6801/3139630617]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:40:09.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:09 smithi176 ceph-mon[35713]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:40:09.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:09.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:09.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:40:09.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:09.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:09.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:40:09.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:09.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:40:09.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:40:09.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:09.783 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 02:40:09 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-1[39979]: 2024-09-12T02:40:09.470+0000 7f6cea051640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T02:40:09.783 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 02:40:09 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-1[39979]: 2024-09-12T02:40:09.473+0000 7f6ce5e79640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:40:09.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:09 smithi062 ceph-mon[35527]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:40:09.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:09 smithi062 ceph-mon[35527]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:40:09.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:40:09.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:09 smithi062 ceph-mon[35527]: from='osd.1 [v2:172.21.15.62:6800/3139630617,v1:172.21.15.62:6801/3139630617]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:40:09.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:09 smithi062 ceph-mon[35527]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:40:09.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:09.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:09.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:40:09.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:09.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:09.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:40:09.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:09.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:40:09.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:40:09.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:09.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:09 smithi018 ceph-mon[30616]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:40:09.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:09 smithi018 ceph-mon[30616]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:40:09.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:40:09.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:09 smithi018 ceph-mon[30616]: from='osd.1 [v2:172.21.15.62:6800/3139630617,v1:172.21.15.62:6801/3139630617]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:40:09.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:09 smithi018 ceph-mon[30616]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:40:09.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:09.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:09.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:40:09.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:09.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:09.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:40:09.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:09.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:40:09.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:40:09.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:10.593 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:10 smithi176 ceph-mon[35713]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:10.593 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:10 smithi176 ceph-mon[35713]: Detected new or changed devices on smithi062 2024-09-12T02:40:10.594 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:10 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi062 to 17088M 2024-09-12T02:40:10.594 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:10 smithi176 ceph-mon[35713]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:40:10.594 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:10 smithi176 ceph-mon[35713]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T02:40:10.594 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:10 smithi176 ceph-mon[35713]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:40:10.594 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:10 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:40:10.594 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:10 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:40:10.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:10 smithi062 ceph-mon[35527]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:10.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:10 smithi062 ceph-mon[35527]: Detected new or changed devices on smithi062 2024-09-12T02:40:10.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:10 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi062 to 17088M 2024-09-12T02:40:10.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:10 smithi062 ceph-mon[35527]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:40:10.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:10 smithi062 ceph-mon[35527]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T02:40:10.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:10 smithi062 ceph-mon[35527]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:40:10.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:10 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:40:10.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:10 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:40:10.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:10 smithi018 ceph-mon[30616]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:10.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:10 smithi018 ceph-mon[30616]: Detected new or changed devices on smithi062 2024-09-12T02:40:10.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:10 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi062 to 17088M 2024-09-12T02:40:10.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:10 smithi018 ceph-mon[30616]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:40:10.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:10 smithi018 ceph-mon[30616]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T02:40:10.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:10 smithi018 ceph-mon[30616]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:40:10.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:40:10.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:40:11.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:11 smithi176 ceph-mon[35713]: purged_snaps scrub starts 2024-09-12T02:40:11.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:11 smithi176 ceph-mon[35713]: purged_snaps scrub ok 2024-09-12T02:40:11.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:11 smithi176 ceph-mon[35713]: osd.1 [v2:172.21.15.62:6800/3139630617,v1:172.21.15.62:6801/3139630617] boot 2024-09-12T02:40:11.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:11 smithi176 ceph-mon[35713]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T02:40:11.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:40:11.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:11 smithi062 ceph-mon[35527]: purged_snaps scrub starts 2024-09-12T02:40:11.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:11 smithi062 ceph-mon[35527]: purged_snaps scrub ok 2024-09-12T02:40:11.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:11 smithi062 ceph-mon[35527]: osd.1 [v2:172.21.15.62:6800/3139630617,v1:172.21.15.62:6801/3139630617] boot 2024-09-12T02:40:11.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:11 smithi062 ceph-mon[35527]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T02:40:11.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:40:11.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:11 smithi018 ceph-mon[30616]: purged_snaps scrub starts 2024-09-12T02:40:11.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:11 smithi018 ceph-mon[30616]: purged_snaps scrub ok 2024-09-12T02:40:11.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:11 smithi018 ceph-mon[30616]: osd.1 [v2:172.21.15.62:6800/3139630617,v1:172.21.15.62:6801/3139630617] boot 2024-09-12T02:40:11.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:11 smithi018 ceph-mon[30616]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T02:40:11.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:40:12.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:12 smithi062 ceph-mon[35527]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:12.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:12 smithi062 ceph-mon[35527]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T02:40:12.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:12 smithi062 ceph-mon[35527]: from='client.? 172.21.15.176:0/1279756397' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7bdf028-db32-4d92-a039-bada37c3a146"}]: dispatch 2024-09-12T02:40:12.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:12 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7bdf028-db32-4d92-a039-bada37c3a146"}]: dispatch 2024-09-12T02:40:12.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:12 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7bdf028-db32-4d92-a039-bada37c3a146"}]': finished 2024-09-12T02:40:12.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:12 smithi062 ceph-mon[35527]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:40:12.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:40:12.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:12 smithi062 ceph-mon[35527]: from='client.? 172.21.15.176:0/2803946477' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:40:12.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:12 smithi018 ceph-mon[30616]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:12.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:12 smithi018 ceph-mon[30616]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T02:40:12.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:12 smithi018 ceph-mon[30616]: from='client.? 172.21.15.176:0/1279756397' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7bdf028-db32-4d92-a039-bada37c3a146"}]: dispatch 2024-09-12T02:40:12.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:12 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7bdf028-db32-4d92-a039-bada37c3a146"}]: dispatch 2024-09-12T02:40:12.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:12 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7bdf028-db32-4d92-a039-bada37c3a146"}]': finished 2024-09-12T02:40:12.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:12 smithi018 ceph-mon[30616]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:40:12.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:40:12.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:12 smithi018 ceph-mon[30616]: from='client.? 172.21.15.176:0/2803946477' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:40:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:12 smithi176 ceph-mon[35713]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:40:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:12 smithi176 ceph-mon[35713]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T02:40:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:12 smithi176 ceph-mon[35713]: from='client.? 172.21.15.176:0/1279756397' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7bdf028-db32-4d92-a039-bada37c3a146"}]: dispatch 2024-09-12T02:40:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:12 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7bdf028-db32-4d92-a039-bada37c3a146"}]: dispatch 2024-09-12T02:40:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:12 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7bdf028-db32-4d92-a039-bada37c3a146"}]': finished 2024-09-12T02:40:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:12 smithi176 ceph-mon[35713]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:40:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:40:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:12 smithi176 ceph-mon[35713]: from='client.? 172.21.15.176:0/2803946477' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:40:14.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:14 smithi062 ceph-mon[35527]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:14.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:14 smithi018 ceph-mon[30616]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:14.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:14 smithi176 ceph-mon[35713]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:16.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:16 smithi176 ceph-mon[35713]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:16.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:16 smithi062 ceph-mon[35527]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:16.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:16 smithi018 ceph-mon[30616]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:18.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:18 smithi176 ceph-mon[35713]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:18.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:18 smithi062 ceph-mon[35527]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:18.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:18 smithi018 ceph-mon[30616]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:19.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:19 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:40:19.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:19 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:19.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:19 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:40:19.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:19 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:19.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:19 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:40:19.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:19 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:20.760 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:20 smithi176 ceph-mon[35713]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:20.760 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:20 smithi176 ceph-mon[35713]: Deploying daemon osd.2 on smithi176 2024-09-12T02:40:20.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:20 smithi062 ceph-mon[35527]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:20.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:20 smithi062 ceph-mon[35527]: Deploying daemon osd.2 on smithi176 2024-09-12T02:40:20.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:20 smithi018 ceph-mon[30616]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:20.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:20 smithi018 ceph-mon[30616]: Deploying daemon osd.2 on smithi176 2024-09-12T02:40:22.638 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:22 smithi176 ceph-mon[35713]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:22.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:22 smithi062 ceph-mon[35527]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:22.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:22 smithi018 ceph-mon[30616]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:24.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:24 smithi176 ceph-mon[35713]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:24.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:24 smithi062 ceph-mon[35527]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:24.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:24 smithi018 ceph-mon[30616]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:26.762 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:26 smithi176 ceph-mon[35713]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:26.762 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:26 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:26.762 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:26 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:26.762 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:26 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:26.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:26 smithi062 ceph-mon[35527]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:26.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:26 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:26.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:26 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:26.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:26 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:26.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:26 smithi018 ceph-mon[30616]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:26.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:26.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:26.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:28.635 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:28 smithi176 ceph-mon[35713]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:28.635 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:28 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:28.635 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:28 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:28.635 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:28 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:28.635 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:28 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:40:28.635 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:28 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:28.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:28 smithi062 ceph-mon[35527]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:28.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:28 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:28.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:28 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:28.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:28 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:28.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:28 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:40:28.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:28 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:28.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:28 smithi018 ceph-mon[30616]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:28.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:28 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:28.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:28 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:28.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:28 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:28.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:28 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:40:28.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:28 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:28.943 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:28.942+0000 7faa92ffd640 1 -- 172.21.15.176:0/527576819 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faaa0062630 con 0x7faa8c0a2b20 2024-09-12T02:40:28.944 INFO:teuthology.orchestra.run.smithi176.stdout:Created osd(s) 2 on host 'smithi176' 2024-09-12T02:40:28.945 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:28.944+0000 7faaa80fa640 1 -- 172.21.15.176:0/527576819 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faa8c0a2b20 msgr2=0x7faa8c0a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:28.945 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:28.944+0000 7faaa80fa640 1 --2- 172.21.15.176:0/527576819 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faa8c0a2b20 0x7faa8c0a4fe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faaa019b7e0 tx=0x7faa9c008040 comp rx=0 tx=0).stop 2024-09-12T02:40:28.946 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:28.944+0000 7faaa80fa640 1 -- 172.21.15.176:0/527576819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faaa00fff10 msgr2=0x7faaa019a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:28.946 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:28.944+0000 7faaa80fa640 1 --2- 172.21.15.176:0/527576819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faaa00fff10 0x7faaa019a2c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faa94009230 tx=0x7faa94004430 comp rx=0 tx=0).stop 2024-09-12T02:40:28.946 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:28.944+0000 7faaa80fa640 1 -- 172.21.15.176:0/527576819 shutdown_connections 2024-09-12T02:40:28.946 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:28.944+0000 7faaa80fa640 1 --2- 172.21.15.176:0/527576819 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faa8c0a2b20 0x7faa8c0a4fe0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:28.946 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:28.944+0000 7faaa80fa640 1 --2- 172.21.15.176:0/527576819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaa0101640 0x7faaa01a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:28.946 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:28.944+0000 7faaa80fa640 1 --2- 172.21.15.176:0/527576819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaa0100c80 0x7faaa019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:28.946 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:28.944+0000 7faaa80fa640 1 --2- 172.21.15.176:0/527576819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faaa00fff10 0x7faaa019a2c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:28.946 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:28.944+0000 7faaa80fa640 1 -- 172.21.15.176:0/527576819 >> 172.21.15.176:0/527576819 conn(0x7faaa00fba80 msgr2=0x7faaa00fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:28.946 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:28.945+0000 7faaa80fa640 1 -- 172.21.15.176:0/527576819 shutdown_connections 2024-09-12T02:40:28.946 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:40:28.945+0000 7faaa80fa640 1 -- 172.21.15.176:0/527576819 wait complete. 2024-09-12T02:40:29.433 DEBUG:teuthology.orchestra.run.smithi176:osd.2> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.2.service 2024-09-12T02:40:29.435 INFO:tasks.cephadm:Deploying osd.3 on smithi018 with /dev/vg_nvme/lv_3... 2024-09-12T02:40:29.436 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:40:29.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:29 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:29.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:29 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:29.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:29 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:29.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:29 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:29.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:29 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:29.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:29 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:29.814 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:29.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:29 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:29.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:29 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:29.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:29 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:30.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:30 smithi176 ceph-mon[35713]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:30.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:30 smithi062 ceph-mon[35527]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:30.808 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:30 smithi018 ceph-mon[30616]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:32.076 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 02:40:31 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-2[40704]: 2024-09-12T02:40:31.888+0000 7f0388e59640 -1 osd.2 0 log_to_monitors true 2024-09-12T02:40:32.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:32 smithi176 ceph-mon[35713]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:32 smithi176 ceph-mon[35713]: from='osd.2 [v2:172.21.15.176:6800/2704054654,v1:172.21.15.176:6801/2704054654]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:40:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:32 smithi176 ceph-mon[35713]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:40:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:32 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:32 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:32 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:40:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:32 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:32 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:32 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:40:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:32 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:32.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:32 smithi062 ceph-mon[35527]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:32.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:32 smithi062 ceph-mon[35527]: from='osd.2 [v2:172.21.15.176:6800/2704054654,v1:172.21.15.176:6801/2704054654]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:40:32.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:32 smithi062 ceph-mon[35527]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:40:32.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:32 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:32.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:32 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:32.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:32 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:40:32.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:32 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:32.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:32 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:32.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:32 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:40:32.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:32 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:32 smithi018 ceph-mon[30616]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:32 smithi018 ceph-mon[30616]: from='osd.2 [v2:172.21.15.176:6800/2704054654,v1:172.21.15.176:6801/2704054654]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:40:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:32 smithi018 ceph-mon[30616]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:40:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:32 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:32 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:32 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:40:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:32 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:32 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:32 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:40:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:32 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:33.058 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:40:33.091 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_3 2024-09-12T02:40:33.457 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:40:33.789 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:33 smithi018 ceph-mon[30616]: Detected new or changed devices on smithi176 2024-09-12T02:40:33.789 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:33 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi176 to 17088M 2024-09-12T02:40:33.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:33 smithi018 ceph-mon[30616]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:40:33.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:33 smithi018 ceph-mon[30616]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:40:33.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:33 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:40:33.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:33 smithi018 ceph-mon[30616]: from='osd.2 [v2:172.21.15.176:6800/2704054654,v1:172.21.15.176:6801/2704054654]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:40:33.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:33 smithi018 ceph-mon[30616]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:40:33.978 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 02:40:33 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-2[40704]: 2024-09-12T02:40:33.539+0000 7f0384ddc640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T02:40:33.979 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 02:40:33 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-2[40704]: 2024-09-12T02:40:33.544+0000 7f0380c04640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:40:33.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:33 smithi176 ceph-mon[35713]: Detected new or changed devices on smithi176 2024-09-12T02:40:33.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:33 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi176 to 17088M 2024-09-12T02:40:33.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:33 smithi176 ceph-mon[35713]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:40:33.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:33 smithi176 ceph-mon[35713]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:40:33.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:33 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:40:33.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:33 smithi176 ceph-mon[35713]: from='osd.2 [v2:172.21.15.176:6800/2704054654,v1:172.21.15.176:6801/2704054654]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:40:33.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:33 smithi176 ceph-mon[35713]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:40:34.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:33 smithi062 ceph-mon[35527]: Detected new or changed devices on smithi176 2024-09-12T02:40:34.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:33 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi176 to 17088M 2024-09-12T02:40:34.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:33 smithi062 ceph-mon[35527]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:40:34.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:33 smithi062 ceph-mon[35527]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:40:34.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:33 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:40:34.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:33 smithi062 ceph-mon[35527]: from='osd.2 [v2:172.21.15.176:6800/2704054654,v1:172.21.15.176:6801/2704054654]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:40:34.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:33 smithi062 ceph-mon[35527]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:40:34.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.096+0000 7f0ebaa00640 1 -- 172.21.15.18:0/2212100067 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0eb4078790 msgr2=0x7f0eb4079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:34.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.096+0000 7f0ebaa00640 1 --2- 172.21.15.18:0/2212100067 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0eb4078790 0x7f0eb4079030 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0eac009ca0 tx=0x7f0eac02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:40:34.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.096+0000 7f0ebaa00640 1 -- 172.21.15.18:0/2212100067 shutdown_connections 2024-09-12T02:40:34.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.096+0000 7f0ebaa00640 1 --2- 172.21.15.18:0/2212100067 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0eb4078790 0x7f0eb4079030 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:34.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.096+0000 7f0ebaa00640 1 --2- 172.21.15.18:0/2212100067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0eb4077df0 0x7f0eb4078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:34.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.096+0000 7f0ebaa00640 1 --2- 172.21.15.18:0/2212100067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0eb4076ba0 0x7f0eb4076fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:34.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.096+0000 7f0ebaa00640 1 -- 172.21.15.18:0/2212100067 >> 172.21.15.18:0/2212100067 conn(0x7f0eb40ff5b0 msgr2=0x7f0eb41019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:34.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.097+0000 7f0ebaa00640 1 -- 172.21.15.18:0/2212100067 shutdown_connections 2024-09-12T02:40:34.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.097+0000 7f0ebaa00640 1 -- 172.21.15.18:0/2212100067 wait complete. 2024-09-12T02:40:34.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.097+0000 7f0ebaa00640 1 Processor -- start 2024-09-12T02:40:34.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.098+0000 7f0ebaa00640 1 -- start start 2024-09-12T02:40:34.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.098+0000 7f0ebaa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0eb4076ba0 0x7f0eb419e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:34.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.098+0000 7f0ebaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0eb4077df0 0x7f0eb419e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:34.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.098+0000 7f0ebaa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0eb4078790 0x7f0eb41a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:34.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.098+0000 7f0ebaa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb4113f10 con 0x7f0eb4077df0 2024-09-12T02:40:34.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.098+0000 7f0ebaa00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb4113d90 con 0x7f0eb4076ba0 2024-09-12T02:40:34.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.098+0000 7f0ebaa00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb4114090 con 0x7f0eb4078790 2024-09-12T02:40:34.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.098+0000 7f0eb3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0eb4077df0 0x7f0eb419e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:34.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.098+0000 7f0eb8a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0eb4078790 0x7f0eb41a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:34.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.098+0000 7f0eb3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0eb4077df0 0x7f0eb419e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35052/0 (socket says 172.21.15.18:35052) 2024-09-12T02:40:34.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.098+0000 7f0eb3400640 1 -- 172.21.15.18:0/1259227775 learned_addr learned my addr 172.21.15.18:0/1259227775 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:40:34.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.098+0000 7f0eb3e00640 1 --2- 172.21.15.18:0/1259227775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0eb4076ba0 0x7f0eb419e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:34.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.099+0000 7f0eb8a00640 1 -- 172.21.15.18:0/1259227775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0eb4076ba0 msgr2=0x7f0eb419e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:34.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.099+0000 7f0eb8a00640 1 --2- 172.21.15.18:0/1259227775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0eb4076ba0 0x7f0eb419e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:34.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.099+0000 7f0eb8a00640 1 -- 172.21.15.18:0/1259227775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0eb4077df0 msgr2=0x7f0eb419e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:34.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.099+0000 7f0eb8a00640 1 --2- 172.21.15.18:0/1259227775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0eb4077df0 0x7f0eb419e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:34.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.099+0000 7f0eb8a00640 1 -- 172.21.15.18:0/1259227775 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb41a6070 con 0x7f0eb4078790 2024-09-12T02:40:34.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.099+0000 7f0eb3400640 1 --2- 172.21.15.18:0/1259227775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0eb4077df0 0x7f0eb419e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:34.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.099+0000 7f0eb8a00640 1 --2- 172.21.15.18:0/1259227775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0eb4078790 0x7f0eb41a5a00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0eac031ae0 tx=0x7f0eac031750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:34.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.099+0000 7f0eb0c00640 1 -- 172.21.15.18:0/1259227775 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eac003b70 con 0x7f0eb4078790 2024-09-12T02:40:34.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.100+0000 7f0ebaa00640 1 -- 172.21.15.18:0/1259227775 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb41a6300 con 0x7f0eb4078790 2024-09-12T02:40:34.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.100+0000 7f0ebaa00640 1 -- 172.21.15.18:0/1259227775 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb41a6890 con 0x7f0eb4078790 2024-09-12T02:40:34.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.100+0000 7f0eb0c00640 1 -- 172.21.15.18:0/1259227775 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0eac003d10 con 0x7f0eb4078790 2024-09-12T02:40:34.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.100+0000 7f0eb0c00640 1 -- 172.21.15.18:0/1259227775 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eac02fb10 con 0x7f0eb4078790 2024-09-12T02:40:34.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.101+0000 7f0ebaa00640 1 -- 172.21.15.18:0/1259227775 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb4110780 con 0x7f0eb4078790 2024-09-12T02:40:34.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.103+0000 7f0eb0c00640 1 -- 172.21.15.18:0/1259227775 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f0eac02fd10 con 0x7f0eb4078790 2024-09-12T02:40:34.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.104+0000 7f0eb0c00640 1 --2- 172.21.15.18:0/1259227775 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0e980a2ba0 0x7f0e980a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:34.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.104+0000 7f0eb0c00640 1 -- 172.21.15.18:0/1259227775 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f0eac0eed40 con 0x7f0eb4078790 2024-09-12T02:40:34.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.105+0000 7f0eb3e00640 1 --2- 172.21.15.18:0/1259227775 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0e980a2ba0 0x7f0e980a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:34.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.105+0000 7f0eb3e00640 1 --2- 172.21.15.18:0/1259227775 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0e980a2ba0 0x7f0e980a5060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009bd0 tx=0x7f0ea4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:34.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.107+0000 7f0eb0c00640 1 -- 172.21.15.18:0/1259227775 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0eac0bd350 con 0x7f0eb4078790 2024-09-12T02:40:34.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:34.300+0000 7f0ebaa00640 1 -- 172.21.15.18:0/1259227775 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0eb4062630 con 0x7f0e980a2ba0 2024-09-12T02:40:34.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:34 smithi018 ceph-mon[30616]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:34 smithi018 ceph-mon[30616]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-12T02:40:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:34 smithi018 ceph-mon[30616]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T02:40:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:34 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:40:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:34 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:40:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:34 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:40:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:34 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:40:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:34 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:34.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:34 smithi176 ceph-mon[35713]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:34.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:34 smithi176 ceph-mon[35713]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-12T02:40:34.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:34 smithi176 ceph-mon[35713]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T02:40:34.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:34 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:40:34.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:34 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:40:34.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:34 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:40:34.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:34 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:40:34.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:34 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:35.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:34 smithi062 ceph-mon[35527]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:35.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:34 smithi062 ceph-mon[35527]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-12T02:40:35.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:34 smithi062 ceph-mon[35527]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T02:40:35.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:34 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:40:35.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:34 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:40:35.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:34 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:40:35.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:34 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:40:35.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:34 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:35.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:35 smithi018 ceph-mon[30616]: purged_snaps scrub starts 2024-09-12T02:40:35.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:35 smithi018 ceph-mon[30616]: purged_snaps scrub ok 2024-09-12T02:40:35.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:35 smithi018 ceph-mon[30616]: from='client.24190 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:40:35.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:35 smithi018 ceph-mon[30616]: osd.2 [v2:172.21.15.176:6800/2704054654,v1:172.21.15.176:6801/2704054654] boot 2024-09-12T02:40:35.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:35 smithi018 ceph-mon[30616]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T02:40:35.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:35 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:40:35.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:35 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:40:35.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:35 smithi176 ceph-mon[35713]: purged_snaps scrub starts 2024-09-12T02:40:35.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:35 smithi176 ceph-mon[35713]: purged_snaps scrub ok 2024-09-12T02:40:35.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:35 smithi176 ceph-mon[35713]: from='client.24190 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:40:35.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:35 smithi176 ceph-mon[35713]: osd.2 [v2:172.21.15.176:6800/2704054654,v1:172.21.15.176:6801/2704054654] boot 2024-09-12T02:40:35.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:35 smithi176 ceph-mon[35713]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T02:40:35.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:35 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:40:35.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:35 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:40:36.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:35 smithi062 ceph-mon[35527]: purged_snaps scrub starts 2024-09-12T02:40:36.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:35 smithi062 ceph-mon[35527]: purged_snaps scrub ok 2024-09-12T02:40:36.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:35 smithi062 ceph-mon[35527]: from='client.24190 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:40:36.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:35 smithi062 ceph-mon[35527]: osd.2 [v2:172.21.15.176:6800/2704054654,v1:172.21.15.176:6801/2704054654] boot 2024-09-12T02:40:36.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:35 smithi062 ceph-mon[35527]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T02:40:36.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:35 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:40:36.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:35 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:40:36.758 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:36 smithi018 ceph-mon[30616]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:36.758 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:36 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:40:36.759 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:36 smithi018 ceph-mon[30616]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T02:40:36.759 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:36 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:40:36.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:36 smithi176 ceph-mon[35713]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:36.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:36 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:40:36.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:36 smithi176 ceph-mon[35713]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T02:40:36.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:36 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:40:37.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:36 smithi062 ceph-mon[35527]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:40:37.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:36 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:40:37.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:36 smithi062 ceph-mon[35527]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T02:40:37.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:36 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:40:37.562 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 02:40:37 smithi018 sudo[49439]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:40:37.562 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 02:40:37 smithi018 sudo[49439]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:40:37.562 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 02:40:37 smithi018 sudo[49439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:40:37.563 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 02:40:37 smithi018 sudo[49439]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:40:37.822 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:40:37.822 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:37 smithi018 ceph-mon[30616]: pgmap v83: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:37.822 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:37 smithi018 ceph-mon[30616]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T02:40:37.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:40:37.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:37 smithi176 ceph-mon[35713]: pgmap v83: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:37.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:37 smithi176 ceph-mon[35713]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T02:40:38.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:40:38.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:37 smithi062 ceph-mon[35527]: pgmap v83: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:38.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:37 smithi062 ceph-mon[35527]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T02:40:38.100 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 02:40:37 smithi018 sudo[49472]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:40:38.100 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 02:40:37 smithi018 sudo[49472]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:40:38.101 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 02:40:37 smithi018 sudo[49472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:40:38.101 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 02:40:37 smithi018 sudo[49472]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:40:38.382 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 02:40:38 smithi062 sudo[43947]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:40:38.382 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 02:40:38 smithi062 sudo[43947]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:40:38.382 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 02:40:38 smithi062 sudo[43947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:40:38.382 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 02:40:38 smithi062 sudo[43947]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:40:38.783 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 02:40:38 smithi062 sudo[43950]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:40:38.783 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 02:40:38 smithi062 sudo[43950]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:40:38.783 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 02:40:38 smithi062 sudo[43950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:40:38.784 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 02:40:38 smithi062 sudo[43950]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:40:38.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:38 smithi062 ceph-mon[35527]: osdmap e21: 3 total, 3 up, 3 in 2024-09-12T02:40:38.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:38 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1593802186' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357"}]: dispatch 2024-09-12T02:40:38.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:38 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357"}]: dispatch 2024-09-12T02:40:38.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:38 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357"}]': finished 2024-09-12T02:40:38.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:38 smithi062 ceph-mon[35527]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T02:40:38.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:38 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:40:38.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:38 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:38.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:38 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3141346883' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:40:38.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:38 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:38.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:38 smithi018 ceph-mon[30616]: osdmap e21: 3 total, 3 up, 3 in 2024-09-12T02:40:38.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:38 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1593802186' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357"}]: dispatch 2024-09-12T02:40:38.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:38 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357"}]: dispatch 2024-09-12T02:40:38.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:38 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357"}]': finished 2024-09-12T02:40:38.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:38 smithi018 ceph-mon[30616]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T02:40:38.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:38 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:40:38.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:38 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:38.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:38 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3141346883' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:40:38.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:38 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:38.914 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 02:40:38 smithi176 sudo[44765]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:40:38.914 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 02:40:38 smithi176 sudo[44765]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:40:38.914 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 02:40:38 smithi176 sudo[44765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:40:38.914 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 02:40:38 smithi176 sudo[44765]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:40:38.915 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:38 smithi176 ceph-mon[35713]: osdmap e21: 3 total, 3 up, 3 in 2024-09-12T02:40:38.915 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:38 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1593802186' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357"}]: dispatch 2024-09-12T02:40:38.915 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:38 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357"}]: dispatch 2024-09-12T02:40:38.915 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:38 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357"}]': finished 2024-09-12T02:40:38.915 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:38 smithi176 ceph-mon[35713]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T02:40:38.915 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:38 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:40:38.915 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:38 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:38.915 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:38 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3141346883' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:40:38.915 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:38 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:39.228 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 02:40:38 smithi176 sudo[44768]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:40:39.228 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 02:40:38 smithi176 sudo[44768]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:40:39.229 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 02:40:38 smithi176 sudo[44768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:40:39.229 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 02:40:38 smithi176 sudo[44768]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:40:39.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:39 smithi018 sudo[49604]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:40:39.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:39 smithi018 sudo[49604]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:40:39.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:39 smithi018 sudo[49604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:40:39.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:39 smithi018 sudo[49604]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:40:40.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:40 smithi018 sudo[49926]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:40:40.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:40 smithi018 sudo[49926]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:40:40.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:40 smithi018 sudo[49926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:40:40.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:40 smithi018 sudo[49926]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:40:40.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:40 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:40.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:40 smithi018 ceph-mon[30616]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:40:40.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:40 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:40.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:40 smithi062 ceph-mon[35527]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:40:40.587 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:40 smithi176 sudo[44771]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:40:40.587 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:40 smithi176 sudo[44771]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:40:40.587 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:40 smithi176 sudo[44771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:40:40.587 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:40 smithi176 sudo[44771]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:40:40.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:40:40.599+0000 7f0eb0c00640 1 -- 172.21.15.18:0/1259227775 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0eac0b92c0 con 0x7f0eb4078790 2024-09-12T02:40:40.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:40 smithi176 sudo[44774]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:40:40.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:40 smithi176 sudo[44774]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:40:40.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:40 smithi176 sudo[44774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:40:40.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:40 smithi176 sudo[44774]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:40:40.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:40 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:40.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:40 smithi176 ceph-mon[35713]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:40:41.111 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:40 smithi062 sudo[43953]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:40:41.112 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:40 smithi062 sudo[43953]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:40:41.112 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:40 smithi062 sudo[43953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:40:41.112 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:40 smithi062 sudo[43953]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:40:41.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:41 smithi176 ceph-mon[35713]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:41.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:41 smithi176 ceph-mon[35713]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:40:41.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:41 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:40:41.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:41 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:40:41.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:41 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:40:41.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:41 smithi176 ceph-mon[35713]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:40:41.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:41 smithi176 ceph-mon[35713]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:40:41.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:41 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:40:41.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:41 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:40:41.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:41 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:40:41.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:41 smithi176 ceph-mon[35713]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:40:41.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:41 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:40:41.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:41 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:40:41.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:41 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:40:41.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 sudo[43956]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:40:41.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 sudo[43956]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:40:41.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 sudo[43956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:40:41.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 sudo[43956]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:40:41.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 ceph-mon[35527]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:41.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 ceph-mon[35527]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:40:41.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:40:41.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:40:41.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:40:41.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 ceph-mon[35527]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:40:41.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 ceph-mon[35527]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:40:41.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:40:41.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:40:41.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:40:41.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 ceph-mon[35527]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:40:41.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:40:41.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:40:41.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:41 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:40:41.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:41 smithi018 ceph-mon[30616]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:41.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:41 smithi018 ceph-mon[30616]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:40:41.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:41 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:40:41.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:41 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:40:41.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:41 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:40:41.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:41 smithi018 ceph-mon[30616]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:40:41.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:41 smithi018 ceph-mon[30616]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:40:41.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:41 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:40:41.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:41 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:40:41.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:41 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:40:41.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:41 smithi018 ceph-mon[30616]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:40:41.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:41 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:40:41.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:41 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:40:41.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:41 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:40:42.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:42 smithi176 ceph-mon[35713]: pgmap v87: 1 pgs: 1 creating+peering; 0 B data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:42.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:42 smithi176 ceph-mon[35713]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:40:42.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:42 smithi176 ceph-mon[35713]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:40:42.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:42 smithi062 ceph-mon[35527]: pgmap v87: 1 pgs: 1 creating+peering; 0 B data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:42.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:42 smithi062 ceph-mon[35527]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:40:42.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:42 smithi062 ceph-mon[35527]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:40:42.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:42 smithi018 ceph-mon[30616]: pgmap v87: 1 pgs: 1 creating+peering; 0 B data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:42.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:42 smithi018 ceph-mon[30616]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:40:42.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:42 smithi018 ceph-mon[30616]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:40:44.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:44 smithi018 ceph-mon[30616]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:44.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:44 smithi176 ceph-mon[35713]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:44.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:44 smithi062 ceph-mon[35527]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:46.316 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:46 smithi018 ceph-mon[30616]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:46.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:46 smithi176 ceph-mon[35713]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:46.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:46 smithi062 ceph-mon[35527]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:48.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:48 smithi018 ceph-mon[30616]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:48.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:40:48.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:48.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:48 smithi018 ceph-mon[30616]: Deploying daemon osd.3 on smithi018 2024-09-12T02:40:48.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:48 smithi176 ceph-mon[35713]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:48.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:40:48.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:48.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:48 smithi176 ceph-mon[35713]: Deploying daemon osd.3 on smithi018 2024-09-12T02:40:48.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:48 smithi062 ceph-mon[35527]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:48.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:40:48.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:48.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:48 smithi062 ceph-mon[35527]: Deploying daemon osd.3 on smithi018 2024-09-12T02:40:50.433 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:50 smithi018 ceph-mon[30616]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:50.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:50 smithi176 ceph-mon[35713]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:50.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:50 smithi062 ceph-mon[35527]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:52.262 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:52 smithi018 ceph-mon[30616]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:52.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:52 smithi176 ceph-mon[35713]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:52.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:52 smithi062 ceph-mon[35527]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:54.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:54 smithi018 ceph-mon[30616]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:54.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:54 smithi176 ceph-mon[35713]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:54.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:54 smithi062 ceph-mon[35527]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:56.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:56 smithi176 ceph-mon[35713]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:56.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:56 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:56.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:56 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:56.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:56 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:56.503 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:56 smithi018 ceph-mon[30616]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:56.503 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:56 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:56.503 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:56 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:56.503 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:56 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:56.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:56 smithi062 ceph-mon[35527]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:56.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:56 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:56.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:56 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:56.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:56 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:40:58.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:58 smithi018 ceph-mon[30616]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:58.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:58 smithi176 ceph-mon[35713]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:40:58.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:58 smithi062 ceph-mon[35527]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:41:00.004 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:59 smithi018 ceph-mon[30616]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:41:00.004 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:59 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:00.004 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:59 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:00.005 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:59 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:00.005 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:59 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:00.005 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:40:59 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:00.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:59 smithi176 ceph-mon[35713]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:41:00.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:59 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:00.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:59 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:00.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:59 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:00.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:59 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:00.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:40:59 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:00.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:59 smithi062 ceph-mon[35527]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:41:00.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:59 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:00.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:59 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:00.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:59 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:00.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:59 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:00.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:40:59 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:00.428 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 3 on host 'smithi018' 2024-09-12T02:41:00.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:00.424+0000 7f0eb0c00640 1 -- 172.21.15.18:0/1259227775 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0eb4062630 con 0x7f0e980a2ba0 2024-09-12T02:41:00.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:00.427+0000 7f0ebaa00640 1 -- 172.21.15.18:0/1259227775 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0e980a2ba0 msgr2=0x7f0e980a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:00.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:00.427+0000 7f0ebaa00640 1 --2- 172.21.15.18:0/1259227775 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0e980a2ba0 0x7f0e980a5060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009bd0 tx=0x7f0ea4005f90 comp rx=0 tx=0).stop 2024-09-12T02:41:00.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:00.427+0000 7f0ebaa00640 1 -- 172.21.15.18:0/1259227775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0eb4078790 msgr2=0x7f0eb41a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:00.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:00.427+0000 7f0ebaa00640 1 --2- 172.21.15.18:0/1259227775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0eb4078790 0x7f0eb41a5a00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0eac031ae0 tx=0x7f0eac031750 comp rx=0 tx=0).stop 2024-09-12T02:41:00.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:00.427+0000 7f0ebaa00640 1 -- 172.21.15.18:0/1259227775 shutdown_connections 2024-09-12T02:41:00.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:00.427+0000 7f0ebaa00640 1 --2- 172.21.15.18:0/1259227775 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0e980a2ba0 0x7f0e980a5060 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:00.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:00.427+0000 7f0ebaa00640 1 --2- 172.21.15.18:0/1259227775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0eb4078790 0x7f0eb41a5a00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:00.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:00.427+0000 7f0ebaa00640 1 --2- 172.21.15.18:0/1259227775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0eb4077df0 0x7f0eb419e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:00.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:00.427+0000 7f0ebaa00640 1 --2- 172.21.15.18:0/1259227775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0eb4076ba0 0x7f0eb419e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:00.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:00.427+0000 7f0ebaa00640 1 -- 172.21.15.18:0/1259227775 >> 172.21.15.18:0/1259227775 conn(0x7f0eb40ff5b0 msgr2=0x7f0eb4101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:00.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:00.427+0000 7f0ebaa00640 1 -- 172.21.15.18:0/1259227775 shutdown_connections 2024-09-12T02:41:00.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:00.427+0000 7f0ebaa00640 1 -- 172.21.15.18:0/1259227775 wait complete. 2024-09-12T02:41:01.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:00 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:01.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:00 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:01.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:00 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:01.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:00 smithi018 ceph-mon[30616]: from='osd.3 [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:41:01.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:00 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:01.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:00 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:01.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:00 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:01.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:00 smithi176 ceph-mon[35713]: from='osd.3 [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:41:01.242 DEBUG:teuthology.orchestra.run.smithi018:osd.3> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.3.service 2024-09-12T02:41:01.246 INFO:tasks.cephadm:Deploying osd.4 on smithi062 with /dev/vg_nvme/lv_3... 2024-09-12T02:41:01.246 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:41:01.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:00 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:01.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:00 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:01.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:00 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:01.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:00 smithi062 ceph-mon[35527]: from='osd.3 [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:41:01.504 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:41:02.582 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:02 smithi018 ceph-mon[30616]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:41:02.582 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:02 smithi018 ceph-mon[30616]: from='osd.3 [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:41:02.582 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:02 smithi018 ceph-mon[30616]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T02:41:02.582 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:02 smithi018 ceph-mon[30616]: from='osd.3 [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-12T02:41:02.582 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:02 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:41:02.583 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 02:41:02 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-3[51506]: 2024-09-12T02:41:02.445+0000 7fec50a00640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T02:41:02.583 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 02:41:02 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-3[51506]: 2024-09-12T02:41:02.451+0000 7fec4ba00640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:41:02.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:02 smithi176 ceph-mon[35713]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:41:02.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:02 smithi176 ceph-mon[35713]: from='osd.3 [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:41:02.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:02 smithi176 ceph-mon[35713]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T02:41:02.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:02 smithi176 ceph-mon[35713]: from='osd.3 [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-12T02:41:02.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:02 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:41:02.775 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:02 smithi062 ceph-mon[35527]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:41:02.775 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:02 smithi062 ceph-mon[35527]: from='osd.3 [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:41:02.775 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:02 smithi062 ceph-mon[35527]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T02:41:02.775 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:02 smithi062 ceph-mon[35527]: from='osd.3 [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-12T02:41:02.775 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:02 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:41:03.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:03 smithi018 ceph-mon[30616]: from='osd.3 [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-12T02:41:03.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:03 smithi018 ceph-mon[30616]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T02:41:03.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:03 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:41:03.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:03 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:41:03.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:03 smithi176 ceph-mon[35713]: from='osd.3 [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-12T02:41:03.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:03 smithi176 ceph-mon[35713]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T02:41:03.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:03 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:41:03.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:03 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:41:03.745 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:03 smithi062 ceph-mon[35527]: from='osd.3 [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-12T02:41:03.745 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:03 smithi062 ceph-mon[35527]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T02:41:03.745 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:03 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:41:03.745 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:03 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:41:04.065 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:41:04.091 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi062:vg_nvme/lv_3 2024-09-12T02:41:04.386 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:41:04.665 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:04 smithi062 ceph-mon[35527]: purged_snaps scrub starts 2024-09-12T02:41:04.665 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:04 smithi062 ceph-mon[35527]: purged_snaps scrub ok 2024-09-12T02:41:04.665 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:04 smithi062 ceph-mon[35527]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:41:04.665 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:04 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:41:04.665 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:04 smithi062 ceph-mon[35527]: osd.3 [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261] boot 2024-09-12T02:41:04.665 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:04 smithi062 ceph-mon[35527]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T02:41:04.665 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:04 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:41:04.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:04 smithi176 ceph-mon[35713]: purged_snaps scrub starts 2024-09-12T02:41:04.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:04 smithi176 ceph-mon[35713]: purged_snaps scrub ok 2024-09-12T02:41:04.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:04 smithi176 ceph-mon[35713]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:41:04.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:04 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:41:04.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:04 smithi176 ceph-mon[35713]: osd.3 [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261] boot 2024-09-12T02:41:04.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:04 smithi176 ceph-mon[35713]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T02:41:04.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:04 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:41:04.831 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:04 smithi018 ceph-mon[30616]: purged_snaps scrub starts 2024-09-12T02:41:04.831 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:04 smithi018 ceph-mon[30616]: purged_snaps scrub ok 2024-09-12T02:41:04.831 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:04 smithi018 ceph-mon[30616]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:41:04.831 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:04 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:41:04.831 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:04 smithi018 ceph-mon[30616]: osd.3 [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261] boot 2024-09-12T02:41:04.831 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:04 smithi018 ceph-mon[30616]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T02:41:04.831 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:04 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:41:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.882+0000 7fa6d9024640 1 -- 172.21.15.62:0/2992429751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6d4102700 msgr2=0x7fa6d4104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.882+0000 7fa6d9024640 1 --2- 172.21.15.62:0/2992429751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6d4102700 0x7fa6d4104af0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009900 tx=0x7fa6c402a410 comp rx=0 tx=0).stop 2024-09-12T02:41:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.882+0000 7fa6d9024640 1 -- 172.21.15.62:0/2992429751 shutdown_connections 2024-09-12T02:41:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.882+0000 7fa6d9024640 1 --2- 172.21.15.62:0/2992429751 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6d4107960 0x7fa6d4109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.882+0000 7fa6d9024640 1 --2- 172.21.15.62:0/2992429751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6d4105030 0x7fa6d4107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.882+0000 7fa6d9024640 1 --2- 172.21.15.62:0/2992429751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6d4102700 0x7fa6d4104af0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.882+0000 7fa6d9024640 1 -- 172.21.15.62:0/2992429751 >> 172.21.15.62:0/2992429751 conn(0x7fa6d40fc280 msgr2=0x7fa6d40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.882+0000 7fa6d9024640 1 -- 172.21.15.62:0/2992429751 shutdown_connections 2024-09-12T02:41:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.882+0000 7fa6d9024640 1 -- 172.21.15.62:0/2992429751 wait complete. 2024-09-12T02:41:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.882+0000 7fa6d9024640 1 Processor -- start 2024-09-12T02:41:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d9024640 1 -- start start 2024-09-12T02:41:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d9024640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6d4102700 0x7fa6d4102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d9024640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6d4105030 0x7fa6d41006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d9024640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6d4107960 0x7fa6d4100bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d9024640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d410d8b0 con 0x7fa6d4107960 2024-09-12T02:41:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d9024640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d410d730 con 0x7fa6d4105030 2024-09-12T02:41:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d9024640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d410da30 con 0x7fa6d4102700 2024-09-12T02:41:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6d4105030 0x7fa6d41006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6d4105030 0x7fa6d41006b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53684/0 (socket says 172.21.15.62:53684) 2024-09-12T02:41:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d259c640 1 -- 172.21.15.62:0/1372558616 learned_addr learned my addr 172.21.15.62:0/1372558616 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:41:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d359e640 1 --2- 172.21.15.62:0/1372558616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6d4107960 0x7fa6d4100bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d2d9d640 1 --2- 172.21.15.62:0/1372558616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6d4102700 0x7fa6d4102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d259c640 1 -- 172.21.15.62:0/1372558616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6d4102700 msgr2=0x7fa6d4102060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d259c640 1 --2- 172.21.15.62:0/1372558616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6d4102700 0x7fa6d4102060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d259c640 1 -- 172.21.15.62:0/1372558616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6d4107960 msgr2=0x7fa6d4100bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d259c640 1 --2- 172.21.15.62:0/1372558616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6d4107960 0x7fa6d4100bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d259c640 1 -- 172.21.15.62:0/1372558616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d41014b0 con 0x7fa6d4105030 2024-09-12T02:41:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.883+0000 7fa6d259c640 1 --2- 172.21.15.62:0/1372558616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6d4105030 0x7fa6d41006b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800d770 tx=0x7fa6c800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.884+0000 7fa6bbfff640 1 -- 172.21.15.62:0/1372558616 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8017070 con 0x7fa6d4105030 2024-09-12T02:41:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.884+0000 7fa6bbfff640 1 -- 172.21.15.62:0/1372558616 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6c8009c30 con 0x7fa6d4105030 2024-09-12T02:41:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.884+0000 7fa6d9024640 1 -- 172.21.15.62:0/1372558616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d41a20f0 con 0x7fa6d4105030 2024-09-12T02:41:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.884+0000 7fa6bbfff640 1 -- 172.21.15.62:0/1372558616 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c800f620 con 0x7fa6d4105030 2024-09-12T02:41:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.884+0000 7fa6d9024640 1 -- 172.21.15.62:0/1372558616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d41a2600 con 0x7fa6d4105030 2024-09-12T02:41:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.885+0000 7fa6d9024640 1 -- 172.21.15.62:0/1372558616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d40fdd70 con 0x7fa6d4105030 2024-09-12T02:41:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.886+0000 7fa6bbfff640 1 -- 172.21.15.62:0/1372558616 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa6c801a070 con 0x7fa6d4105030 2024-09-12T02:41:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.887+0000 7fa6bbfff640 1 --2- 172.21.15.62:0/1372558616 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa6bc0a2b80 0x7fa6bc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.887+0000 7fa6bbfff640 1 -- 172.21.15.62:0/1372558616 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3698+0+0 (secure 0 0 0) 0x7fa6c80cd940 con 0x7fa6d4105030 2024-09-12T02:41:04.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.887+0000 7fa6d2d9d640 1 --2- 172.21.15.62:0/1372558616 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa6bc0a2b80 0x7fa6bc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:04.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.887+0000 7fa6d2d9d640 1 --2- 172.21.15.62:0/1372558616 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa6bc0a2b80 0x7fa6bc0a5040 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4006010 tx=0x7fa6c4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:04.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:04.892+0000 7fa6bbfff640 1 -- 172.21.15.62:0/1372558616 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa6c8009de0 con 0x7fa6d4105030 2024-09-12T02:41:05.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:05.077+0000 7fa6d9024640 1 -- 172.21.15.62:0/1372558616 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa6d4062630 con 0x7fa6bc0a2b80 2024-09-12T02:41:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:05 smithi176 ceph-mon[35713]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T02:41:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:41:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:41:05.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:05.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:05 smithi062 ceph-mon[35527]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T02:41:05.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:05.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:05.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:05.769 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:05.769 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:05.769 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:05.769 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:05.769 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:05.769 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:41:05.769 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:41:05.769 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:05 smithi018 ceph-mon[30616]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T02:41:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:41:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:41:05.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:06.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:06 smithi176 ceph-mon[35713]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:06.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:06 smithi176 ceph-mon[35713]: Detected new or changed devices on smithi018 2024-09-12T02:41:06.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:06 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi018 to 8547M 2024-09-12T02:41:06.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:06 smithi176 ceph-mon[35713]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:41:06.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:06 smithi176 ceph-mon[35713]: osdmap e27: 4 total, 4 up, 4 in 2024-09-12T02:41:06.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:06 smithi176 ceph-mon[35713]: osdmap e28: 4 total, 4 up, 4 in 2024-09-12T02:41:06.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:06 smithi062 ceph-mon[35527]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:06.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:06 smithi062 ceph-mon[35527]: Detected new or changed devices on smithi018 2024-09-12T02:41:06.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:06 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi018 to 8547M 2024-09-12T02:41:06.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:06 smithi062 ceph-mon[35527]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:41:06.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:06 smithi062 ceph-mon[35527]: osdmap e27: 4 total, 4 up, 4 in 2024-09-12T02:41:06.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:06 smithi062 ceph-mon[35527]: osdmap e28: 4 total, 4 up, 4 in 2024-09-12T02:41:06.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:06 smithi018 ceph-mon[30616]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:06.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:06 smithi018 ceph-mon[30616]: Detected new or changed devices on smithi018 2024-09-12T02:41:06.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:06 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi018 to 8547M 2024-09-12T02:41:06.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:06 smithi018 ceph-mon[30616]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:41:06.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:06 smithi018 ceph-mon[30616]: osdmap e27: 4 total, 4 up, 4 in 2024-09-12T02:41:06.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:06 smithi018 ceph-mon[30616]: osdmap e28: 4 total, 4 up, 4 in 2024-09-12T02:41:07.989 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:07 smithi062 ceph-mon[35527]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:41:07.989 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:07 smithi062 ceph-mon[35527]: osdmap e29: 4 total, 4 up, 4 in 2024-09-12T02:41:07.989 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:07 smithi062 ceph-mon[35527]: from='client.? 172.21.15.62:0/178771085' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66a2c8a0-1a99-4c6d-b56a-f1f6c3199655"}]: dispatch 2024-09-12T02:41:07.989 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:07 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66a2c8a0-1a99-4c6d-b56a-f1f6c3199655"}]: dispatch 2024-09-12T02:41:07.989 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:07 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66a2c8a0-1a99-4c6d-b56a-f1f6c3199655"}]': finished 2024-09-12T02:41:07.989 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:07 smithi062 ceph-mon[35527]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T02:41:07.989 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:08.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:07 smithi176 ceph-mon[35713]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:41:08.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:07 smithi176 ceph-mon[35713]: osdmap e29: 4 total, 4 up, 4 in 2024-09-12T02:41:08.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:07 smithi176 ceph-mon[35713]: from='client.? 172.21.15.62:0/178771085' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66a2c8a0-1a99-4c6d-b56a-f1f6c3199655"}]: dispatch 2024-09-12T02:41:08.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:07 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66a2c8a0-1a99-4c6d-b56a-f1f6c3199655"}]: dispatch 2024-09-12T02:41:08.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:07 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66a2c8a0-1a99-4c6d-b56a-f1f6c3199655"}]': finished 2024-09-12T02:41:08.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:07 smithi176 ceph-mon[35713]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T02:41:08.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:08.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:07 smithi018 ceph-mon[30616]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:41:08.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:07 smithi018 ceph-mon[30616]: osdmap e29: 4 total, 4 up, 4 in 2024-09-12T02:41:08.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:07 smithi018 ceph-mon[30616]: from='client.? 172.21.15.62:0/178771085' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66a2c8a0-1a99-4c6d-b56a-f1f6c3199655"}]: dispatch 2024-09-12T02:41:08.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:07 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66a2c8a0-1a99-4c6d-b56a-f1f6c3199655"}]: dispatch 2024-09-12T02:41:08.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:07 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66a2c8a0-1a99-4c6d-b56a-f1f6c3199655"}]': finished 2024-09-12T02:41:08.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:07 smithi018 ceph-mon[30616]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T02:41:08.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:09.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:08 smithi176 ceph-mon[35713]: from='client.? 172.21.15.62:0/3131282305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:41:09.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:08 smithi062 ceph-mon[35527]: from='client.? 172.21.15.62:0/3131282305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:41:09.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:08 smithi018 ceph-mon[30616]: from='client.? 172.21.15.62:0/3131282305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:41:10.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:09 smithi176 ceph-mon[35713]: pgmap v109: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:41:10.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:09 smithi062 ceph-mon[35527]: pgmap v109: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:41:10.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:09 smithi018 ceph-mon[30616]: pgmap v109: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:41:12.225 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:11 smithi062 ceph-mon[35527]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-12T02:41:12.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:11 smithi176 ceph-mon[35713]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-12T02:41:12.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:11 smithi018 ceph-mon[30616]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-12T02:41:14.133 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:13 smithi062 ceph-mon[35527]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-12T02:41:14.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:13 smithi176 ceph-mon[35713]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-12T02:41:14.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:13 smithi018 ceph-mon[30616]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-12T02:41:16.136 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:15 smithi062 ceph-mon[35527]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:16.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:15 smithi176 ceph-mon[35713]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:16.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:15 smithi018 ceph-mon[30616]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:17.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:41:17.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:17.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:16 smithi176 ceph-mon[35713]: Deploying daemon osd.4 on smithi062 2024-09-12T02:41:17.232 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:41:17.232 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:17.232 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:16 smithi062 ceph-mon[35527]: Deploying daemon osd.4 on smithi062 2024-09-12T02:41:17.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:41:17.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:17.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:16 smithi018 ceph-mon[30616]: Deploying daemon osd.4 on smithi062 2024-09-12T02:41:18.130 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:17 smithi062 ceph-mon[35527]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:18.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:17 smithi176 ceph-mon[35713]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:18.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:17 smithi018 ceph-mon[30616]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:20.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:19 smithi062 ceph-mon[35527]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:20.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:19 smithi176 ceph-mon[35713]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:20.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:19 smithi018 ceph-mon[30616]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:22.155 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:21 smithi062 ceph-mon[35527]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:22.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:21 smithi176 ceph-mon[35713]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:22.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:21 smithi018 ceph-mon[30616]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:23.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:22 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:23.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:22 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:23.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:22 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:23.237 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:22 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:23.237 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:22 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:23.237 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:22 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:23.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:22 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:23.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:22 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:23.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:22 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:24.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:24 smithi176 ceph-mon[35713]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:24.750 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:24 smithi062 ceph-mon[35527]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:24.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:24 smithi018 ceph-mon[30616]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:25.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:25.755+0000 7fa6bbfff640 1 -- 172.21.15.62:0/1372558616 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa6d4062630 con 0x7fa6bc0a2b80 2024-09-12T02:41:25.757 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 4 on host 'smithi062' 2024-09-12T02:41:25.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:25.757+0000 7fa6d9024640 1 -- 172.21.15.62:0/1372558616 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa6bc0a2b80 msgr2=0x7fa6bc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:25.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:25.757+0000 7fa6d9024640 1 --2- 172.21.15.62:0/1372558616 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa6bc0a2b80 0x7fa6bc0a5040 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4006010 tx=0x7fa6c4000bc0 comp rx=0 tx=0).stop 2024-09-12T02:41:25.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:25.757+0000 7fa6d9024640 1 -- 172.21.15.62:0/1372558616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6d4105030 msgr2=0x7fa6d41006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:25.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:25.757+0000 7fa6d9024640 1 --2- 172.21.15.62:0/1372558616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6d4105030 0x7fa6d41006b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800d770 tx=0x7fa6c800dc30 comp rx=0 tx=0).stop 2024-09-12T02:41:25.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:25.757+0000 7fa6d9024640 1 -- 172.21.15.62:0/1372558616 shutdown_connections 2024-09-12T02:41:25.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:25.757+0000 7fa6d9024640 1 --2- 172.21.15.62:0/1372558616 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa6bc0a2b80 0x7fa6bc0a5040 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:25.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:25.757+0000 7fa6d9024640 1 --2- 172.21.15.62:0/1372558616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6d4107960 0x7fa6d4100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:25.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:25.757+0000 7fa6d9024640 1 --2- 172.21.15.62:0/1372558616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6d4105030 0x7fa6d41006b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:25.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:25.757+0000 7fa6d9024640 1 --2- 172.21.15.62:0/1372558616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6d4102700 0x7fa6d4102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:25.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:25.757+0000 7fa6d9024640 1 -- 172.21.15.62:0/1372558616 >> 172.21.15.62:0/1372558616 conn(0x7fa6d40fc280 msgr2=0x7fa6d41030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:25.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:25.758+0000 7fa6d9024640 1 -- 172.21.15.62:0/1372558616 shutdown_connections 2024-09-12T02:41:25.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:41:25.758+0000 7fa6d9024640 1 -- 172.21.15.62:0/1372558616 wait complete. 2024-09-12T02:41:26.477 DEBUG:teuthology.orchestra.run.smithi062:osd.4> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.4.service 2024-09-12T02:41:26.479 INFO:tasks.cephadm:Deploying osd.5 on smithi176 with /dev/vg_nvme/lv_3... 2024-09-12T02:41:26.480 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:41:26.653 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:26 smithi018 ceph-mon[30616]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:26.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:26.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:26.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:26.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:26.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:26.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:26.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:26.654 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:26.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:26 smithi176 ceph-mon[35713]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:26.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:26 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:26.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:26 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:26.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:26 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:26.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:26 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:26.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:26 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:26.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:26 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:26.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:26 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:26.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:26 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:26.734 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:41:26.750 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:26 smithi062 ceph-mon[35527]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:26.750 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:26 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:26.750 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:26 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:26.750 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:26 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:26.750 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:26 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:26.750 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:26 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:26.750 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:26 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:26.750 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:26 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:26.750 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:26 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:28.511 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:28 smithi176 ceph-mon[35713]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:28.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:28 smithi018 ceph-mon[30616]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:28.691 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:28 smithi062 ceph-mon[35527]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:29.033 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 02:41:28 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4[46682]: 2024-09-12T02:41:28.776+0000 7fa9dedf5640 -1 osd.4 0 log_to_monitors true 2024-09-12T02:41:29.137 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:41:29.165 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi176:vg_nvme/lv_3 2024-09-12T02:41:29.421 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:41:29.444 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:29 smithi176 ceph-mon[35713]: from='osd.4 [v2:172.21.15.62:6808/1416302860,v1:172.21.15.62:6809/1416302860]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:41:29.444 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:29 smithi176 ceph-mon[35713]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:41:29.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:29 smithi018 ceph-mon[30616]: from='osd.4 [v2:172.21.15.62:6808/1416302860,v1:172.21.15.62:6809/1416302860]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:41:29.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:29 smithi018 ceph-mon[30616]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:41:29.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:29 smithi062 ceph-mon[35527]: from='osd.4 [v2:172.21.15.62:6808/1416302860,v1:172.21.15.62:6809/1416302860]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:41:29.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:29 smithi062 ceph-mon[35527]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:41:29.883 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.880+0000 7fe53c569640 1 -- 172.21.15.176:0/154509923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5341037c0 msgr2=0x7fe53410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:29.883 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.880+0000 7fe53c569640 1 --2- 172.21.15.176:0/154509923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5341037c0 0x7fe53410a050 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009ca0 tx=0x7fe52c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:41:29.883 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.880+0000 7fe53c569640 1 -- 172.21.15.176:0/154509923 shutdown_connections 2024-09-12T02:41:29.883 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.880+0000 7fe53c569640 1 --2- 172.21.15.176:0/154509923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5341037c0 0x7fe53410a050 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:29.883 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.880+0000 7fe53c569640 1 --2- 172.21.15.176:0/154509923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe534102e00 0x7fe534103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:29.883 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.880+0000 7fe53c569640 1 --2- 172.21.15.176:0/154509923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe534101c00 0x7fe534102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:29.883 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.880+0000 7fe53c569640 1 -- 172.21.15.176:0/154509923 >> 172.21.15.176:0/154509923 conn(0x7fe5340fd390 msgr2=0x7fe5340ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:29.883 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.880+0000 7fe53c569640 1 -- 172.21.15.176:0/154509923 shutdown_connections 2024-09-12T02:41:29.883 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.880+0000 7fe53c569640 1 -- 172.21.15.176:0/154509923 wait complete. 2024-09-12T02:41:29.883 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.881+0000 7fe53c569640 1 Processor -- start 2024-09-12T02:41:29.883 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.881+0000 7fe53c569640 1 -- start start 2024-09-12T02:41:29.884 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.881+0000 7fe53c569640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe534101c00 0x7fe534075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:29.884 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.881+0000 7fe53c569640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe534102e00 0x7fe5340745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:29.884 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.881+0000 7fe53c569640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5341037c0 0x7fe534074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:29.884 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.881+0000 7fe53c569640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe53410d880 con 0x7fe5341037c0 2024-09-12T02:41:29.884 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.881+0000 7fe53c569640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe53410d700 con 0x7fe534102e00 2024-09-12T02:41:29.884 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.881+0000 7fe53c569640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe53410da00 con 0x7fe534101c00 2024-09-12T02:41:29.884 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.881+0000 7fe53a305640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe534101c00 0x7fe534075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:29.884 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.881+0000 7fe53a305640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe534101c00 0x7fe534075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:43182/0 (socket says 172.21.15.176:43182) 2024-09-12T02:41:29.884 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.881+0000 7fe53a305640 1 -- 172.21.15.176:0/2899740466 learned_addr learned my addr 172.21.15.176:0/2899740466 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-12T02:41:29.884 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.881+0000 7fe539b04640 1 --2- 172.21.15.176:0/2899740466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe534102e00 0x7fe5340745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:29.884 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.882+0000 7fe53a305640 1 -- 172.21.15.176:0/2899740466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe534102e00 msgr2=0x7fe5340745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:29.884 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.882+0000 7fe53ab06640 1 --2- 172.21.15.176:0/2899740466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5341037c0 0x7fe534074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:29.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.882+0000 7fe53a305640 1 --2- 172.21.15.176:0/2899740466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe534102e00 0x7fe5340745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:29.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.882+0000 7fe53a305640 1 -- 172.21.15.176:0/2899740466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5341037c0 msgr2=0x7fe534074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:29.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.882+0000 7fe53a305640 1 --2- 172.21.15.176:0/2899740466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5341037c0 0x7fe534074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:29.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.882+0000 7fe53a305640 1 -- 172.21.15.176:0/2899740466 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5340753e0 con 0x7fe534101c00 2024-09-12T02:41:29.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.882+0000 7fe539b04640 1 --2- 172.21.15.176:0/2899740466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe534102e00 0x7fe5340745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:41:29.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.882+0000 7fe53a305640 1 --2- 172.21.15.176:0/2899740466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe534101c00 0x7fe534075f90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe52400d950 tx=0x7fe52400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:29.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.882+0000 7fe52b7fe640 1 -- 172.21.15.176:0/2899740466 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe524017020 con 0x7fe534101c00 2024-09-12T02:41:29.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.882+0000 7fe52b7fe640 1 -- 172.21.15.176:0/2899740466 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe524009c30 con 0x7fe534101c00 2024-09-12T02:41:29.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.882+0000 7fe53c569640 1 -- 172.21.15.176:0/2899740466 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5341a1fe0 con 0x7fe534101c00 2024-09-12T02:41:29.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.882+0000 7fe52b7fe640 1 -- 172.21.15.176:0/2899740466 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52400f740 con 0x7fe534101c00 2024-09-12T02:41:29.885 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.882+0000 7fe53c569640 1 -- 172.21.15.176:0/2899740466 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5341a2430 con 0x7fe534101c00 2024-09-12T02:41:29.886 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.883+0000 7fe53c569640 1 -- 172.21.15.176:0/2899740466 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe534109000 con 0x7fe534101c00 2024-09-12T02:41:29.886 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.884+0000 7fe52b7fe640 1 -- 172.21.15.176:0/2899740466 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe52401a020 con 0x7fe534101c00 2024-09-12T02:41:29.886 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.885+0000 7fe52b7fe640 1 --2- 172.21.15.176:0/2899740466 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe5200a2b80 0x7fe5200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:29.887 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.885+0000 7fe52b7fe640 1 -- 172.21.15.176:0/2899740466 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3805+0+0 (secure 0 0 0) 0x7fe5240cd910 con 0x7fe534101c00 2024-09-12T02:41:29.887 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.885+0000 7fe539b04640 1 --2- 172.21.15.176:0/2899740466 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe5200a2b80 0x7fe5200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:29.887 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.886+0000 7fe539b04640 1 --2- 172.21.15.176:0/2899740466 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe5200a2b80 0x7fe5200a5040 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe530005fd0 tx=0x7fe53000b5d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:29.890 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:29.889+0000 7fe52b7fe640 1 -- 172.21.15.176:0/2899740466 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe524021070 con 0x7fe534101c00 2024-09-12T02:41:30.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:30.066+0000 7fe53c569640 1 -- 172.21.15.176:0/2899740466 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe534062630 con 0x7fe5200a2b80 2024-09-12T02:41:30.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:30.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:41:30.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T02:41:30.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: from='osd.4 [v2:172.21.15.62:6808/1416302860,v1:172.21.15.62:6809/1416302860]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:41:30.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:30.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:41:30.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: Detected new or changed devices on smithi062 2024-09-12T02:41:30.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:30.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:30.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:30.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:30.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi062 to 8544M 2024-09-12T02:41:30.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:30.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:30.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:30.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:30.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:41:30.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:41:30.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:30 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:30.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:30.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:41:30.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T02:41:30.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: from='osd.4 [v2:172.21.15.62:6808/1416302860,v1:172.21.15.62:6809/1416302860]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:41:30.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:30.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:41:30.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: Detected new or changed devices on smithi062 2024-09-12T02:41:30.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:30.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:30.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:30.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:30.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi062 to 8544M 2024-09-12T02:41:30.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:30.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:30.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:30.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:30.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:41:30.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:41:30.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:30 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:30.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:30.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:41:30.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T02:41:30.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: from='osd.4 [v2:172.21.15.62:6808/1416302860,v1:172.21.15.62:6809/1416302860]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:41:30.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:30.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:41:30.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: Detected new or changed devices on smithi062 2024-09-12T02:41:30.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:30.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:30.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:30.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:30.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi062 to 8544M 2024-09-12T02:41:30.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:30.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:30.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:30.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:30.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:41:30.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:41:30.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:30 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:31.413 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 02:41:31 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4[46682]: 2024-09-12T02:41:31.073+0000 7fa9dad78640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T02:41:31.414 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 02:41:31 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4[46682]: 2024-09-12T02:41:31.079+0000 7fa9d2b98640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:41:31.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:31 smithi176 ceph-mon[35713]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:41:31.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:31 smithi176 ceph-mon[35713]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T02:41:31.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:31 smithi176 ceph-mon[35713]: osdmap e32: 5 total, 4 up, 5 in 2024-09-12T02:41:31.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:31 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:31.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:31 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:31.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:31 smithi176 ceph-mon[35713]: from='osd.4 ' entity='osd.4' 2024-09-12T02:41:31.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:31 smithi062 ceph-mon[35527]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:41:31.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:31 smithi062 ceph-mon[35527]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T02:41:31.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:31 smithi062 ceph-mon[35527]: osdmap e32: 5 total, 4 up, 5 in 2024-09-12T02:41:31.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:31 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:31.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:31 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:31.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:31 smithi062 ceph-mon[35527]: from='osd.4 ' entity='osd.4' 2024-09-12T02:41:31.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:31 smithi018 ceph-mon[30616]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:41:31.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:31 smithi018 ceph-mon[30616]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T02:41:31.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:31 smithi018 ceph-mon[30616]: osdmap e32: 5 total, 4 up, 5 in 2024-09-12T02:41:31.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:31 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:31.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:31 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:31.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:31 smithi018 ceph-mon[30616]: from='osd.4 ' entity='osd.4' 2024-09-12T02:41:32.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:32 smithi176 ceph-mon[35713]: purged_snaps scrub starts 2024-09-12T02:41:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:32 smithi176 ceph-mon[35713]: purged_snaps scrub ok 2024-09-12T02:41:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:32 smithi176 ceph-mon[35713]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:32 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:32 smithi176 ceph-mon[35713]: osd.4 [v2:172.21.15.62:6808/1416302860,v1:172.21.15.62:6809/1416302860] boot 2024-09-12T02:41:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:32 smithi176 ceph-mon[35713]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T02:41:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:32 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:32.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:32 smithi062 ceph-mon[35527]: purged_snaps scrub starts 2024-09-12T02:41:32.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:32 smithi062 ceph-mon[35527]: purged_snaps scrub ok 2024-09-12T02:41:32.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:32 smithi062 ceph-mon[35527]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:32.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:32 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:32.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:32 smithi062 ceph-mon[35527]: osd.4 [v2:172.21.15.62:6808/1416302860,v1:172.21.15.62:6809/1416302860] boot 2024-09-12T02:41:32.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:32 smithi062 ceph-mon[35527]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T02:41:32.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:32 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:32.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:32 smithi018 ceph-mon[30616]: purged_snaps scrub starts 2024-09-12T02:41:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:32 smithi018 ceph-mon[30616]: purged_snaps scrub ok 2024-09-12T02:41:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:32 smithi018 ceph-mon[30616]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-12T02:41:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:32 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:32 smithi018 ceph-mon[30616]: osd.4 [v2:172.21.15.62:6808/1416302860,v1:172.21.15.62:6809/1416302860] boot 2024-09-12T02:41:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:32 smithi018 ceph-mon[30616]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T02:41:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:32 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:41:33.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:33 smithi176 ceph-mon[35713]: from='client.? 172.21.15.176:0/1222401393' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4070ecf-703a-4f5f-9a2b-63473ff7f98f"}]: dispatch 2024-09-12T02:41:33.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:33 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4070ecf-703a-4f5f-9a2b-63473ff7f98f"}]: dispatch 2024-09-12T02:41:33.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:33 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c4070ecf-703a-4f5f-9a2b-63473ff7f98f"}]': finished 2024-09-12T02:41:33.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:33 smithi176 ceph-mon[35713]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T02:41:33.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:33 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:33.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:33 smithi176 ceph-mon[35713]: from='client.? 172.21.15.176:0/304318160' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:41:33.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:33 smithi062 ceph-mon[35527]: from='client.? 172.21.15.176:0/1222401393' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4070ecf-703a-4f5f-9a2b-63473ff7f98f"}]: dispatch 2024-09-12T02:41:33.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:33 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4070ecf-703a-4f5f-9a2b-63473ff7f98f"}]: dispatch 2024-09-12T02:41:33.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:33 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c4070ecf-703a-4f5f-9a2b-63473ff7f98f"}]': finished 2024-09-12T02:41:33.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:33 smithi062 ceph-mon[35527]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T02:41:33.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:33 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:33.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:33 smithi062 ceph-mon[35527]: from='client.? 172.21.15.176:0/304318160' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:41:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:33 smithi018 ceph-mon[30616]: from='client.? 172.21.15.176:0/1222401393' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4070ecf-703a-4f5f-9a2b-63473ff7f98f"}]: dispatch 2024-09-12T02:41:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:33 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4070ecf-703a-4f5f-9a2b-63473ff7f98f"}]: dispatch 2024-09-12T02:41:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:33 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c4070ecf-703a-4f5f-9a2b-63473ff7f98f"}]': finished 2024-09-12T02:41:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:33 smithi018 ceph-mon[30616]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T02:41:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:33 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:33 smithi018 ceph-mon[30616]: from='client.? 172.21.15.176:0/304318160' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:41:34.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:34 smithi062 ceph-mon[35527]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:34.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:34 smithi062 ceph-mon[35527]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T02:41:34.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:34 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:34 smithi018 ceph-mon[30616]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:34 smithi018 ceph-mon[30616]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T02:41:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:34 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:34.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:34 smithi176 ceph-mon[35713]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:34.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:34 smithi176 ceph-mon[35713]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T02:41:34.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:34 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:36.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:36 smithi062 ceph-mon[35527]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:36.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:36 smithi018 ceph-mon[30616]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:36.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:36 smithi176 ceph-mon[35713]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:38.750 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:38 smithi176 ceph-mon[35713]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:38.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:38 smithi062 ceph-mon[35527]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:38.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:38 smithi018 ceph-mon[30616]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:40.780 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:40 smithi176 ceph-mon[35713]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:40.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:40 smithi062 ceph-mon[35527]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:40.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:40 smithi018 ceph-mon[30616]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:41.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:41 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:41:41.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:41 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:41.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:41 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:41:41.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:41 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:41.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:41 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:41:41.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:41 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:42.687 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:42 smithi176 ceph-mon[35713]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:42.687 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:42 smithi176 ceph-mon[35713]: Deploying daemon osd.5 on smithi176 2024-09-12T02:41:42.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:42 smithi062 ceph-mon[35527]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:42.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:42 smithi062 ceph-mon[35527]: Deploying daemon osd.5 on smithi176 2024-09-12T02:41:42.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:42 smithi018 ceph-mon[30616]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:42.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:42 smithi018 ceph-mon[30616]: Deploying daemon osd.5 on smithi176 2024-09-12T02:41:44.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:44 smithi176 ceph-mon[35713]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:44 smithi062 ceph-mon[35527]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:44.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:44 smithi018 ceph-mon[30616]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:46.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:46 smithi176 ceph-mon[35713]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:46.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:46 smithi062 ceph-mon[35527]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:46.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:46 smithi018 ceph-mon[30616]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:47.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:47 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:47.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:47 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:47.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:47 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:47.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:47 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:47.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:47 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:47.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:47 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:47.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:47 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:47 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:47 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:48.672 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:48 smithi176 ceph-mon[35713]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:48.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:48 smithi062 ceph-mon[35527]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:48 smithi018 ceph-mon[30616]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:50.209 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:50.208+0000 7fe52b7fe640 1 -- 172.21.15.176:0/2899740466 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe534062630 con 0x7fe5200a2b80 2024-09-12T02:41:50.209 INFO:teuthology.orchestra.run.smithi176.stdout:Created osd(s) 5 on host 'smithi176' 2024-09-12T02:41:50.211 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:50.210+0000 7fe53c569640 1 -- 172.21.15.176:0/2899740466 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe5200a2b80 msgr2=0x7fe5200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:50.211 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:50.210+0000 7fe53c569640 1 --2- 172.21.15.176:0/2899740466 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe5200a2b80 0x7fe5200a5040 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe530005fd0 tx=0x7fe53000b5d0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.211 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:50.210+0000 7fe53c569640 1 -- 172.21.15.176:0/2899740466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe534101c00 msgr2=0x7fe534075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:50.211 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:50.210+0000 7fe53c569640 1 --2- 172.21.15.176:0/2899740466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe534101c00 0x7fe534075f90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe52400d950 tx=0x7fe52400de10 comp rx=0 tx=0).stop 2024-09-12T02:41:50.211 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:50.210+0000 7fe53c569640 1 -- 172.21.15.176:0/2899740466 shutdown_connections 2024-09-12T02:41:50.211 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:50.210+0000 7fe53c569640 1 --2- 172.21.15.176:0/2899740466 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe5200a2b80 0x7fe5200a5040 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.211 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:50.210+0000 7fe53c569640 1 --2- 172.21.15.176:0/2899740466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5341037c0 0x7fe534074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.211 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:50.210+0000 7fe53c569640 1 --2- 172.21.15.176:0/2899740466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe534102e00 0x7fe5340745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.211 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:50.210+0000 7fe53c569640 1 --2- 172.21.15.176:0/2899740466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe534101c00 0x7fe534075f90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:50.211 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:50.210+0000 7fe53c569640 1 -- 172.21.15.176:0/2899740466 >> 172.21.15.176:0/2899740466 conn(0x7fe5340fd390 msgr2=0x7fe5341061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:50.211 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:50.210+0000 7fe53c569640 1 -- 172.21.15.176:0/2899740466 shutdown_connections 2024-09-12T02:41:50.212 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:41:50.210+0000 7fe53c569640 1 -- 172.21.15.176:0/2899740466 wait complete. 2024-09-12T02:41:50.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:50 smithi062 ceph-mon[35527]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:50.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:50 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:50.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:50 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:50.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:50 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:50.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:50 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:50.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:50 smithi018 ceph-mon[30616]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:50.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:50 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:50.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:50 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:50.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:50 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:50.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:50 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:50.906 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:50 smithi176 ceph-mon[35713]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:50.906 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:50 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:50.907 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:50 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:50.907 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:50 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:50.907 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:50 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:50.934 DEBUG:teuthology.orchestra.run.smithi176:osd.5> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.5.service 2024-09-12T02:41:50.936 INFO:tasks.cephadm:Deploying osd.6 on smithi018 with /dev/vg_nvme/lv_2... 2024-09-12T02:41:50.936 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:41:51.319 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:41:52.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:52 smithi176 ceph-mon[35713]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:52.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:52 smithi062 ceph-mon[35527]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:52.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:52 smithi018 ceph-mon[30616]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:53.229 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 02:41:52 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T02:41:52.839+0000 7fa0f6173640 -1 osd.5 0 log_to_monitors true 2024-09-12T02:41:53.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:53 smithi018 ceph-mon[30616]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:53.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:53 smithi018 ceph-mon[30616]: from='osd.5 [v2:172.21.15.176:6808/2234269387,v1:172.21.15.176:6809/2234269387]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:41:53.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:53 smithi018 ceph-mon[30616]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:41:53.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:53 smithi176 ceph-mon[35713]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:53.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:53 smithi176 ceph-mon[35713]: from='osd.5 [v2:172.21.15.176:6808/2234269387,v1:172.21.15.176:6809/2234269387]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:41:53.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:53 smithi176 ceph-mon[35713]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:41:53.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:53 smithi062 ceph-mon[35527]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:53.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:53 smithi062 ceph-mon[35527]: from='osd.5 [v2:172.21.15.176:6808/2234269387,v1:172.21.15.176:6809/2234269387]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:41:53.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:53 smithi062 ceph-mon[35527]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:41:54.837 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:54 smithi018 ceph-mon[30616]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:41:54.837 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:54 smithi018 ceph-mon[30616]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T02:41:54.837 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:54 smithi018 ceph-mon[30616]: from='osd.5 [v2:172.21.15.176:6808/2234269387,v1:172.21.15.176:6809/2234269387]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:41:54.837 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:54.837 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:54 smithi018 ceph-mon[30616]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:41:54.837 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:54.837 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:54.837 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:54.838 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:54.838 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:54.838 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:54.838 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:54.838 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:54.838 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:54.838 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:54.838 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:54.838 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:54 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:54.979 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T02:41:54.542+0000 7fa0f20f6640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T02:41:54.979 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T02:41:54.548+0000 7fa0edf1e640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:41:54.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-mon[35713]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:41:54.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-mon[35713]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T02:41:54.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-mon[35713]: from='osd.5 [v2:172.21.15.176:6808/2234269387,v1:172.21.15.176:6809/2234269387]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:41:54.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:54.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-mon[35713]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:41:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:54.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:54 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:55.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:54 smithi062 ceph-mon[35527]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:41:55.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:54 smithi062 ceph-mon[35527]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T02:41:55.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:54 smithi062 ceph-mon[35527]: from='osd.5 [v2:172.21.15.176:6808/2234269387,v1:172.21.15.176:6809/2234269387]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:41:55.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:54 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:55.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:54 smithi062 ceph-mon[35527]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:41:55.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:54 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:55.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:54 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:55.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:54 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:55.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:54 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:41:55.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:54 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:55.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:54 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:55.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:54 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:55.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:54 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:55.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:54 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:55.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:54 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:55.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:54 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:55.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:54 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:41:55.318 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:41:55.350 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_2 2024-09-12T02:41:55.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:55 smithi018 ceph-mon[30616]: Detected new or changed devices on smithi176 2024-09-12T02:41:55.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:55 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi176 to 8544M 2024-09-12T02:41:55.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:55 smithi018 ceph-mon[30616]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-12T02:41:55.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:55 smithi018 ceph-mon[30616]: osdmap e37: 6 total, 5 up, 6 in 2024-09-12T02:41:55.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:55 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:55.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:55 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:55.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:55 smithi018 ceph-mon[30616]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:55.727 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:41:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:55 smithi176 ceph-mon[35713]: Detected new or changed devices on smithi176 2024-09-12T02:41:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:55 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi176 to 8544M 2024-09-12T02:41:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:55 smithi176 ceph-mon[35713]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-12T02:41:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:55 smithi176 ceph-mon[35713]: osdmap e37: 6 total, 5 up, 6 in 2024-09-12T02:41:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:55 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:55 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:55 smithi176 ceph-mon[35713]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:56.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:55 smithi062 ceph-mon[35527]: Detected new or changed devices on smithi176 2024-09-12T02:41:56.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:55 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi176 to 8544M 2024-09-12T02:41:56.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:55 smithi062 ceph-mon[35527]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-12T02:41:56.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:55 smithi062 ceph-mon[35527]: osdmap e37: 6 total, 5 up, 6 in 2024-09-12T02:41:56.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:55 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:56.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:55 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:56.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:55 smithi062 ceph-mon[35527]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:41:56.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.282+0000 7ff69f200640 1 -- 172.21.15.18:0/2011252680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a0105800 msgr2=0x7ff6a010c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:56.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.282+0000 7ff69f200640 1 --2- 172.21.15.18:0/2011252680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a0105800 0x7ff6a010c090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff698009ca0 tx=0x7ff69802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:41:56.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.282+0000 7ff69f200640 1 -- 172.21.15.18:0/2011252680 shutdown_connections 2024-09-12T02:41:56.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.282+0000 7ff69f200640 1 --2- 172.21.15.18:0/2011252680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a0105800 0x7ff6a010c090 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:56.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.282+0000 7ff69f200640 1 --2- 172.21.15.18:0/2011252680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6a0104e40 0x7ff6a01052c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:56.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.282+0000 7ff69f200640 1 --2- 172.21.15.18:0/2011252680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a0103c40 0x7ff6a0104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:56.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.282+0000 7ff69f200640 1 -- 172.21.15.18:0/2011252680 >> 172.21.15.18:0/2011252680 conn(0x7ff6a00ff3d0 msgr2=0x7ff6a0101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:56.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.282+0000 7ff69f200640 1 -- 172.21.15.18:0/2011252680 shutdown_connections 2024-09-12T02:41:56.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.282+0000 7ff69f200640 1 -- 172.21.15.18:0/2011252680 wait complete. 2024-09-12T02:41:56.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.283+0000 7ff69f200640 1 Processor -- start 2024-09-12T02:41:56.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.283+0000 7ff69f200640 1 -- start start 2024-09-12T02:41:56.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.283+0000 7ff69f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6a0103c40 0x7ff6a0199e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:56.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.283+0000 7ff69f200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a0104e40 0x7ff6a019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:56.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.283+0000 7ff69f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a0105800 0x7ff6a01a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:56.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.283+0000 7ff69f200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a010f8f0 con 0x7ff6a0105800 2024-09-12T02:41:56.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.283+0000 7ff69f200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a010f770 con 0x7ff6a0104e40 2024-09-12T02:41:56.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.283+0000 7ff69f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a010fa70 con 0x7ff6a0103c40 2024-09-12T02:41:56.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.284+0000 7ff69e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a0105800 0x7ff6a01a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:56.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.284+0000 7ff69d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a0104e40 0x7ff6a019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:56.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.284+0000 7ff69d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a0104e40 0x7ff6a019a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:56124/0 (socket says 172.21.15.18:56124) 2024-09-12T02:41:56.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.284+0000 7ff69d400640 1 -- 172.21.15.18:0/2579089216 learned_addr learned my addr 172.21.15.18:0/2579089216 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:41:56.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.284+0000 7ff69de00640 1 --2- 172.21.15.18:0/2579089216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6a0103c40 0x7ff6a0199e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:56.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.284+0000 7ff69d400640 1 -- 172.21.15.18:0/2579089216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6a0103c40 msgr2=0x7ff6a0199e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:56.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.284+0000 7ff69d400640 1 --2- 172.21.15.18:0/2579089216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6a0103c40 0x7ff6a0199e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:56.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.284+0000 7ff69d400640 1 -- 172.21.15.18:0/2579089216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a0105800 msgr2=0x7ff6a01a1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:56.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.284+0000 7ff69d400640 1 --2- 172.21.15.18:0/2579089216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a0105800 0x7ff6a01a1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:56.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.284+0000 7ff69d400640 1 -- 172.21.15.18:0/2579089216 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a01a1a90 con 0x7ff6a0104e40 2024-09-12T02:41:56.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.284+0000 7ff69e800640 1 --2- 172.21.15.18:0/2579089216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a0105800 0x7ff6a01a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:56.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.284+0000 7ff69d400640 1 --2- 172.21.15.18:0/2579089216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a0104e40 0x7ff6a019a3a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00d950 tx=0x7ff68c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:56.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.285+0000 7ff696a00640 1 -- 172.21.15.18:0/2579089216 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c017070 con 0x7ff6a0104e40 2024-09-12T02:41:56.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.285+0000 7ff696a00640 1 -- 172.21.15.18:0/2579089216 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff68c009c30 con 0x7ff6a0104e40 2024-09-12T02:41:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.285+0000 7ff69f200640 1 -- 172.21.15.18:0/2579089216 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a01a1d80 con 0x7ff6a0104e40 2024-09-12T02:41:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.285+0000 7ff696a00640 1 -- 172.21.15.18:0/2579089216 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c00f6b0 con 0x7ff6a0104e40 2024-09-12T02:41:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.285+0000 7ff69f200640 1 -- 172.21.15.18:0/2579089216 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a01a2260 con 0x7ff6a0104e40 2024-09-12T02:41:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.286+0000 7ff69f200640 1 -- 172.21.15.18:0/2579089216 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6a010af70 con 0x7ff6a0104e40 2024-09-12T02:41:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.288+0000 7ff696a00640 1 -- 172.21.15.18:0/2579089216 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff68c0109d0 con 0x7ff6a0104e40 2024-09-12T02:41:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.289+0000 7ff696a00640 1 --2- 172.21.15.18:0/2579089216 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff6840a2bb0 0x7ff6840a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.289+0000 7ff696a00640 1 -- 172.21.15.18:0/2579089216 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4562+0+0 (secure 0 0 0) 0x7ff68c0ce0e0 con 0x7ff6a0104e40 2024-09-12T02:41:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.289+0000 7ff69de00640 1 --2- 172.21.15.18:0/2579089216 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff6840a2bb0 0x7ff6840a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.290+0000 7ff69de00640 1 --2- 172.21.15.18:0/2579089216 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff6840a2bb0 0x7ff6840a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0104ca0 tx=0x7ff690005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.291+0000 7ff696a00640 1 -- 172.21.15.18:0/2579089216 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff68c09b7f0 con 0x7ff6a0104e40 2024-09-12T02:41:56.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:41:56.486+0000 7ff69f200640 1 -- 172.21.15.18:0/2579089216 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff6a0062630 con 0x7ff6840a2bb0 2024-09-12T02:41:56.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:56 smithi018 ceph-mon[30616]: purged_snaps scrub starts 2024-09-12T02:41:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:56 smithi018 ceph-mon[30616]: purged_snaps scrub ok 2024-09-12T02:41:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:56 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:56 smithi018 ceph-mon[30616]: osd.5 [v2:172.21.15.176:6808/2234269387,v1:172.21.15.176:6809/2234269387] boot 2024-09-12T02:41:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:56 smithi018 ceph-mon[30616]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T02:41:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:56 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:56 smithi018 ceph-mon[30616]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T02:41:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:56 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:41:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:56 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:41:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:56 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:56.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:56 smithi062 ceph-mon[35527]: purged_snaps scrub starts 2024-09-12T02:41:56.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:56 smithi062 ceph-mon[35527]: purged_snaps scrub ok 2024-09-12T02:41:56.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:56 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:56.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:56 smithi062 ceph-mon[35527]: osd.5 [v2:172.21.15.176:6808/2234269387,v1:172.21.15.176:6809/2234269387] boot 2024-09-12T02:41:56.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:56 smithi062 ceph-mon[35527]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T02:41:56.935 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:56 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:56.935 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:56 smithi062 ceph-mon[35527]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T02:41:56.935 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:56 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:41:56.935 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:56 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:41:56.935 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:56 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:56.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:56 smithi176 ceph-mon[35713]: purged_snaps scrub starts 2024-09-12T02:41:56.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:56 smithi176 ceph-mon[35713]: purged_snaps scrub ok 2024-09-12T02:41:56.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:56 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:56.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:56 smithi176 ceph-mon[35713]: osd.5 [v2:172.21.15.176:6808/2234269387,v1:172.21.15.176:6809/2234269387] boot 2024-09-12T02:41:56.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:56 smithi176 ceph-mon[35713]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T02:41:56.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:56 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:41:56.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:56 smithi176 ceph-mon[35713]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T02:41:56.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:56 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:41:56.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:56 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:41:56.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:56 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:57.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:57 smithi018 ceph-mon[30616]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:41:57.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:57 smithi018 ceph-mon[30616]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:41:57.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:57 smithi018 ceph-mon[30616]: osdmap e40: 6 total, 6 up, 6 in 2024-09-12T02:41:57.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:57 smithi176 ceph-mon[35713]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:41:57.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:57 smithi176 ceph-mon[35713]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:41:57.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:57 smithi176 ceph-mon[35713]: osdmap e40: 6 total, 6 up, 6 in 2024-09-12T02:41:58.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:57 smithi062 ceph-mon[35527]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:41:58.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:57 smithi062 ceph-mon[35527]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:41:58.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:57 smithi062 ceph-mon[35527]: osdmap e40: 6 total, 6 up, 6 in 2024-09-12T02:41:59.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:58 smithi176 ceph-mon[35713]: osdmap e41: 6 total, 6 up, 6 in 2024-09-12T02:41:59.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:58 smithi176 ceph-mon[35713]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:41:59.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:58 smithi062 ceph-mon[35527]: osdmap e41: 6 total, 6 up, 6 in 2024-09-12T02:41:59.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:58 smithi062 ceph-mon[35527]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:41:59.310 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:58 smithi018 ceph-mon[30616]: osdmap e41: 6 total, 6 up, 6 in 2024-09-12T02:41:59.310 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:58 smithi018 ceph-mon[30616]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:00.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:59 smithi018 ceph-mon[30616]: osdmap e42: 6 total, 6 up, 6 in 2024-09-12T02:42:00.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:59 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3068934190' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12a08874-041e-4734-bc33-68ebfce97b2b"}]: dispatch 2024-09-12T02:42:00.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:59 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3068934190' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12a08874-041e-4734-bc33-68ebfce97b2b"}]': finished 2024-09-12T02:42:00.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:59 smithi018 ceph-mon[30616]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T02:42:00.145 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:41:59 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:42:00.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:59 smithi176 ceph-mon[35713]: osdmap e42: 6 total, 6 up, 6 in 2024-09-12T02:42:00.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:59 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3068934190' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12a08874-041e-4734-bc33-68ebfce97b2b"}]: dispatch 2024-09-12T02:42:00.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:59 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3068934190' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12a08874-041e-4734-bc33-68ebfce97b2b"}]': finished 2024-09-12T02:42:00.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:59 smithi176 ceph-mon[35713]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T02:42:00.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:41:59 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:42:00.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:59 smithi062 ceph-mon[35527]: osdmap e42: 6 total, 6 up, 6 in 2024-09-12T02:42:00.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:59 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3068934190' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12a08874-041e-4734-bc33-68ebfce97b2b"}]: dispatch 2024-09-12T02:42:00.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:59 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3068934190' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12a08874-041e-4734-bc33-68ebfce97b2b"}]': finished 2024-09-12T02:42:00.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:59 smithi062 ceph-mon[35527]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T02:42:00.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:41:59 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:42:01.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:00 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3432821136' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:42:01.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:00 smithi176 ceph-mon[35713]: pgmap v148: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:01.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:00 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3432821136' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:42:01.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:00 smithi062 ceph-mon[35527]: pgmap v148: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:01.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:00 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3432821136' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:42:01.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:00 smithi018 ceph-mon[30616]: pgmap v148: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:02.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:02 smithi176 ceph-mon[35713]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-09-12T02:42:03.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:02 smithi062 ceph-mon[35527]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-09-12T02:42:03.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:02 smithi018 ceph-mon[30616]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-09-12T02:42:04.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:04 smithi018 ceph-mon[30616]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-12T02:42:04.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:04 smithi176 ceph-mon[35713]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-12T02:42:05.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:04 smithi062 ceph-mon[35527]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-12T02:42:06.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:06 smithi018 ceph-mon[30616]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:42:06.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:06 smithi176 ceph-mon[35713]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:42:07.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:06 smithi062 ceph-mon[35527]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:42:08.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:08 smithi018 ceph-mon[30616]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-12T02:42:08.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:08 smithi176 ceph-mon[35713]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-12T02:42:09.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:08 smithi062 ceph-mon[35527]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-12T02:42:09.957 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:42:09.957 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:09.958 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:09 smithi018 ceph-mon[30616]: Deploying daemon osd.6 on smithi018 2024-09-12T02:42:09.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:42:09.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:09.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:09 smithi176 ceph-mon[35713]: Deploying daemon osd.6 on smithi018 2024-09-12T02:42:10.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:42:10.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:10.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:09 smithi062 ceph-mon[35527]: Deploying daemon osd.6 on smithi018 2024-09-12T02:42:10.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:10 smithi176 ceph-mon[35713]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T02:42:11.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:10 smithi062 ceph-mon[35527]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T02:42:11.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:10 smithi018 ceph-mon[30616]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T02:42:12.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:12 smithi176 ceph-mon[35713]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:42:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:12 smithi062 ceph-mon[35527]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:42:13.051 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:12 smithi018 ceph-mon[30616]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:42:14.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:14 smithi176 ceph-mon[35713]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:15.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:14 smithi062 ceph-mon[35527]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:15.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:14 smithi018 ceph-mon[30616]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:16.837 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:16 smithi018 ceph-mon[30616]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:16.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:16 smithi176 ceph-mon[35713]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:17.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:16 smithi062 ceph-mon[35527]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:17.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:17 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:17.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:17 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:17.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:17 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:18.014 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:17 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:18.015 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:17 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:18.015 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:17 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:18.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:17 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:18.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:17 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:18.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:17 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:18.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:18 smithi018 ceph-mon[30616]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:18.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:18 smithi176 ceph-mon[35713]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:19.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:18 smithi062 ceph-mon[35527]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:20.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:20 smithi018 ceph-mon[30616]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:20.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:20 smithi176 ceph-mon[35713]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:21.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:20 smithi062 ceph-mon[35527]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:21.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:42:21.865+0000 7ff696a00640 1 -- 172.21.15.18:0/2579089216 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff6a0062630 con 0x7ff6840a2bb0 2024-09-12T02:42:21.866 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 6 on host 'smithi018' 2024-09-12T02:42:21.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:42:21.868+0000 7ff69f200640 1 -- 172.21.15.18:0/2579089216 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff6840a2bb0 msgr2=0x7ff6840a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:21.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:42:21.868+0000 7ff69f200640 1 --2- 172.21.15.18:0/2579089216 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff6840a2bb0 0x7ff6840a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0104ca0 tx=0x7ff690005f90 comp rx=0 tx=0).stop 2024-09-12T02:42:21.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:42:21.868+0000 7ff69f200640 1 -- 172.21.15.18:0/2579089216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a0104e40 msgr2=0x7ff6a019a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:42:21.868+0000 7ff69f200640 1 --2- 172.21.15.18:0/2579089216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a0104e40 0x7ff6a019a3a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00d950 tx=0x7ff68c00de10 comp rx=0 tx=0).stop 2024-09-12T02:42:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:42:21.868+0000 7ff69f200640 1 -- 172.21.15.18:0/2579089216 shutdown_connections 2024-09-12T02:42:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:42:21.868+0000 7ff69f200640 1 --2- 172.21.15.18:0/2579089216 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff6840a2bb0 0x7ff6840a5070 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:42:21.868+0000 7ff69f200640 1 --2- 172.21.15.18:0/2579089216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a0105800 0x7ff6a01a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:42:21.868+0000 7ff69f200640 1 --2- 172.21.15.18:0/2579089216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6a0104e40 0x7ff6a019a3a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:42:21.868+0000 7ff69f200640 1 --2- 172.21.15.18:0/2579089216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6a0103c40 0x7ff6a0199e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:42:21.868+0000 7ff69f200640 1 -- 172.21.15.18:0/2579089216 >> 172.21.15.18:0/2579089216 conn(0x7ff6a00ff3d0 msgr2=0x7ff6a0108140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:42:21.868+0000 7ff69f200640 1 -- 172.21.15.18:0/2579089216 shutdown_connections 2024-09-12T02:42:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:42:21.868+0000 7ff69f200640 1 -- 172.21.15.18:0/2579089216 wait complete. 2024-09-12T02:42:22.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:22 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:22.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:22 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:22.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:22 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:22.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:22 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:22.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:22 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:22.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:22 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:22.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:22 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:22.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:22 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:22.656 DEBUG:teuthology.orchestra.run.smithi018:osd.6> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.6.service 2024-09-12T02:42:22.660 INFO:tasks.cephadm:Deploying osd.7 on smithi062 with /dev/vg_nvme/lv_2... 2024-09-12T02:42:22.661 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:42:22.689 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:22 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:22.689 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:22 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:22.689 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:22 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:22.690 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:22 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:22.690 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:22 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:22.690 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:22 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:22.690 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:22 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:22.690 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:22 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:22.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:22 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:22.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:22 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:22.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:22 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:22.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:22 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:22.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:22 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:22.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:22 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:22.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:22 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:22.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:22 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:22.920 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:42:23.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:23 smithi018 ceph-mon[30616]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:23.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:23 smithi018 ceph-mon[30616]: from='osd.6 [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:42:23.601 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 02:42:23 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T02:42:23.349+0000 7f569c63a640 -1 osd.6 0 log_to_monitors true 2024-09-12T02:42:23.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:23 smithi176 ceph-mon[35713]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:23.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:23 smithi176 ceph-mon[35713]: from='osd.6 [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:42:23.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:23 smithi062 ceph-mon[35527]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:23.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:23 smithi062 ceph-mon[35527]: from='osd.6 [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:42:24.669 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:24 smithi018 ceph-mon[30616]: from='osd.6 [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:42:24.669 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:24 smithi018 ceph-mon[30616]: osdmap e44: 7 total, 6 up, 7 in 2024-09-12T02:42:24.670 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:24 smithi018 ceph-mon[30616]: from='osd.6 [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-12T02:42:24.670 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:24 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:42:24.670 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 02:42:24 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T02:42:24.439+0000 7f5696e00640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T02:42:24.670 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 02:42:24 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T02:42:24.449+0000 7f5691e00640 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:42:24.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:24 smithi176 ceph-mon[35713]: from='osd.6 [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:42:24.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:24 smithi176 ceph-mon[35713]: osdmap e44: 7 total, 6 up, 7 in 2024-09-12T02:42:24.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:24 smithi176 ceph-mon[35713]: from='osd.6 [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-12T02:42:24.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:24 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:42:24.744 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:24 smithi062 ceph-mon[35527]: from='osd.6 [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:42:24.744 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:24 smithi062 ceph-mon[35527]: osdmap e44: 7 total, 6 up, 7 in 2024-09-12T02:42:24.744 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:24 smithi062 ceph-mon[35527]: from='osd.6 [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-12T02:42:24.744 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:24 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:42:25.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:25 smithi176 ceph-mon[35713]: from='osd.6 [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-12T02:42:25.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:25 smithi176 ceph-mon[35713]: osdmap e45: 7 total, 6 up, 7 in 2024-09-12T02:42:25.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:25 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:42:25.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:25 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:42:25.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:25 smithi176 ceph-mon[35713]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:25.741 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:25 smithi062 ceph-mon[35527]: from='osd.6 [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-12T02:42:25.741 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:25 smithi062 ceph-mon[35527]: osdmap e45: 7 total, 6 up, 7 in 2024-09-12T02:42:25.741 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:25 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:42:25.741 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:25 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:42:25.741 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:25 smithi062 ceph-mon[35527]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:25.744 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:42:25.771 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi062:vg_nvme/lv_2 2024-09-12T02:42:25.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:25 smithi018 ceph-mon[30616]: from='osd.6 [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-12T02:42:25.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:25 smithi018 ceph-mon[30616]: osdmap e45: 7 total, 6 up, 7 in 2024-09-12T02:42:25.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:25 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:42:25.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:25 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:42:25.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:25 smithi018 ceph-mon[30616]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:42:26.067 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:42:26.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.536+0000 7f59f350f640 1 -- 172.21.15.62:0/1650921664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59ec100dc0 msgr2=0x7f59ec101240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.536+0000 7f59f350f640 1 --2- 172.21.15.62:0/1650921664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59ec100dc0 0x7f59ec101240 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f59dc009900 tx=0x7f59dc02a410 comp rx=0 tx=0).stop 2024-09-12T02:42:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.536+0000 7f59f350f640 1 -- 172.21.15.62:0/1650921664 shutdown_connections 2024-09-12T02:42:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.536+0000 7f59f350f640 1 --2- 172.21.15.62:0/1650921664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59ec101780 0x7f59ec109020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.536+0000 7f59f350f640 1 --2- 172.21.15.62:0/1650921664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59ec100dc0 0x7f59ec101240 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.536+0000 7f59f350f640 1 --2- 172.21.15.62:0/1650921664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59ec102080 0x7f59ec102480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.536+0000 7f59f350f640 1 -- 172.21.15.62:0/1650921664 >> 172.21.15.62:0/1650921664 conn(0x7f59ec0fba40 msgr2=0x7f59ec0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.536+0000 7f59f350f640 1 -- 172.21.15.62:0/1650921664 shutdown_connections 2024-09-12T02:42:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.536+0000 7f59f350f640 1 -- 172.21.15.62:0/1650921664 wait complete. 2024-09-12T02:42:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.536+0000 7f59f350f640 1 Processor -- start 2024-09-12T02:42:26.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.536+0000 7f59f350f640 1 -- start start 2024-09-12T02:42:26.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59f350f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59ec100dc0 0x7f59ec197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59f350f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59ec101780 0x7f59ec198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59f350f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59ec102080 0x7f59ec19f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59f350f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec10d930 con 0x7f59ec100dc0 2024-09-12T02:42:26.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59f350f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec10d7b0 con 0x7f59ec102080 2024-09-12T02:42:26.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59f350f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec10dab0 con 0x7f59ec101780 2024-09-12T02:42:26.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59f1aac640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59ec102080 0x7f59ec19f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59f1aac640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59ec102080 0x7f59ec19f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55152/0 (socket says 172.21.15.62:55152) 2024-09-12T02:42:26.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59f1aac640 1 -- 172.21.15.62:0/1098224330 learned_addr learned my addr 172.21.15.62:0/1098224330 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:42:26.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59f0aaa640 1 --2- 172.21.15.62:0/1098224330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59ec101780 0x7f59ec198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59f1aac640 1 -- 172.21.15.62:0/1098224330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59ec101780 msgr2=0x7f59ec198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59f1aac640 1 --2- 172.21.15.62:0/1098224330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59ec101780 0x7f59ec198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59f1aac640 1 -- 172.21.15.62:0/1098224330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59ec100dc0 msgr2=0x7f59ec197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59f1aac640 1 --2- 172.21.15.62:0/1098224330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59ec100dc0 0x7f59ec197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59f1aac640 1 -- 172.21.15.62:0/1098224330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec19fb80 con 0x7f59ec102080 2024-09-12T02:42:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59f1aac640 1 --2- 172.21.15.62:0/1098224330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59ec102080 0x7f59ec19f510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f59e400b970 tx=0x7f59e400be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59e27fc640 1 -- 172.21.15.62:0/1098224330 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4019070 con 0x7f59ec102080 2024-09-12T02:42:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.537+0000 7f59e27fc640 1 -- 172.21.15.62:0/1098224330 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59e400cb40 con 0x7f59ec102080 2024-09-12T02:42:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.538+0000 7f59f350f640 1 -- 172.21.15.62:0/1098224330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59ec19fe70 con 0x7f59ec102080 2024-09-12T02:42:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.538+0000 7f59e27fc640 1 -- 172.21.15.62:0/1098224330 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4007650 con 0x7f59ec102080 2024-09-12T02:42:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.538+0000 7f59f350f640 1 -- 172.21.15.62:0/1098224330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59ec1a03a0 con 0x7f59ec102080 2024-09-12T02:42:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.538+0000 7f59f350f640 1 -- 172.21.15.62:0/1098224330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59ec107fd0 con 0x7f59ec102080 2024-09-12T02:42:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.540+0000 7f59e27fc640 1 -- 172.21.15.62:0/1098224330 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f59e401c070 con 0x7f59ec102080 2024-09-12T02:42:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.540+0000 7f59e27fc640 1 --2- 172.21.15.62:0/1098224330 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f59d80a2c30 0x7f59d80a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:26.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.540+0000 7f59e27fc640 1 -- 172.21.15.62:0/1098224330 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7f59e40cdcd0 con 0x7f59ec102080 2024-09-12T02:42:26.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.541+0000 7f59f12ab640 1 --2- 172.21.15.62:0/1098224330 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f59d80a2c30 0x7f59d80a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:26.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.541+0000 7f59f12ab640 1 --2- 172.21.15.62:0/1098224330 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f59d80a2c30 0x7f59d80a50f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f59ec06a510 tx=0x7f59e8005c10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:26.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.544+0000 7f59e27fc640 1 -- 172.21.15.62:0/1098224330 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f59e409b2f0 con 0x7f59ec102080 2024-09-12T02:42:26.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:26 smithi176 ceph-mon[35713]: purged_snaps scrub starts 2024-09-12T02:42:26.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:26 smithi176 ceph-mon[35713]: purged_snaps scrub ok 2024-09-12T02:42:26.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:26 smithi176 ceph-mon[35713]: osd.6 [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982] boot 2024-09-12T02:42:26.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:26 smithi176 ceph-mon[35713]: osdmap e46: 7 total, 7 up, 7 in 2024-09-12T02:42:26.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:26 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:42:26.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:26.731+0000 7f59f350f640 1 -- 172.21.15.62:0/1098224330 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f59ec062630 con 0x7f59d80a2c30 2024-09-12T02:42:26.732 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:26 smithi062 ceph-mon[35527]: purged_snaps scrub starts 2024-09-12T02:42:26.732 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:26 smithi062 ceph-mon[35527]: purged_snaps scrub ok 2024-09-12T02:42:26.732 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:26 smithi062 ceph-mon[35527]: osd.6 [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982] boot 2024-09-12T02:42:26.732 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:26 smithi062 ceph-mon[35527]: osdmap e46: 7 total, 7 up, 7 in 2024-09-12T02:42:26.732 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:26 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:42:26.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:26 smithi018 ceph-mon[30616]: purged_snaps scrub starts 2024-09-12T02:42:26.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:26 smithi018 ceph-mon[30616]: purged_snaps scrub ok 2024-09-12T02:42:26.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:26 smithi018 ceph-mon[30616]: osd.6 [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982] boot 2024-09-12T02:42:26.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:26 smithi018 ceph-mon[30616]: osdmap e46: 7 total, 7 up, 7 in 2024-09-12T02:42:26.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:42:27.701 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:27 smithi018 ceph-mon[30616]: osdmap e47: 7 total, 7 up, 7 in 2024-09-12T02:42:27.701 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:27 smithi018 ceph-mon[30616]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:27.701 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:27.701 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:27.701 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:27.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:27.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:27.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:27.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:27.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:27.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:27.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:42:27.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:42:27.702 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:27.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:27 smithi176 ceph-mon[35713]: osdmap e47: 7 total, 7 up, 7 in 2024-09-12T02:42:27.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:27 smithi176 ceph-mon[35713]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:27.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:27.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:27.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:27.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:27.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:27.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:27.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:27.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:27.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:27.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:42:27.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:42:27.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:27.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:27 smithi062 ceph-mon[35527]: osdmap e47: 7 total, 7 up, 7 in 2024-09-12T02:42:27.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:27 smithi062 ceph-mon[35527]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:27.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:27.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:27.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:27.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:27.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:27.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:27.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:27.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:27.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:27.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:42:27.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:42:27.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:28.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:28 smithi062 ceph-mon[35527]: Detected new or changed devices on smithi018 2024-09-12T02:42:28.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:28 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi018 to 5698M 2024-09-12T02:42:28.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:28 smithi062 ceph-mon[35527]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:42:28.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:28 smithi176 ceph-mon[35713]: Detected new or changed devices on smithi018 2024-09-12T02:42:28.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:28 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi018 to 5698M 2024-09-12T02:42:28.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:28 smithi176 ceph-mon[35713]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:42:28.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:28 smithi018 ceph-mon[30616]: Detected new or changed devices on smithi018 2024-09-12T02:42:28.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:28 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi018 to 5698M 2024-09-12T02:42:28.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:28 smithi018 ceph-mon[30616]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:42:29.712 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:29 smithi062 ceph-mon[35527]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:29.712 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:29 smithi062 ceph-mon[35527]: from='client.? 172.21.15.62:0/3745226189' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86a5b47c-143f-4848-892f-c7b6a17a2799"}]: dispatch 2024-09-12T02:42:29.713 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:29 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86a5b47c-143f-4848-892f-c7b6a17a2799"}]: dispatch 2024-09-12T02:42:29.713 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:29 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86a5b47c-143f-4848-892f-c7b6a17a2799"}]': finished 2024-09-12T02:42:29.713 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:29 smithi062 ceph-mon[35527]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T02:42:29.713 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:29 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:42:29.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:29 smithi176 ceph-mon[35713]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:29.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:29 smithi176 ceph-mon[35713]: from='client.? 172.21.15.62:0/3745226189' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86a5b47c-143f-4848-892f-c7b6a17a2799"}]: dispatch 2024-09-12T02:42:29.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:29 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86a5b47c-143f-4848-892f-c7b6a17a2799"}]: dispatch 2024-09-12T02:42:29.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:29 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86a5b47c-143f-4848-892f-c7b6a17a2799"}]': finished 2024-09-12T02:42:29.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:29 smithi176 ceph-mon[35713]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T02:42:29.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:29 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:42:29.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:29 smithi018 ceph-mon[30616]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:29.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:29 smithi018 ceph-mon[30616]: from='client.? 172.21.15.62:0/3745226189' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86a5b47c-143f-4848-892f-c7b6a17a2799"}]: dispatch 2024-09-12T02:42:29.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:29 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86a5b47c-143f-4848-892f-c7b6a17a2799"}]: dispatch 2024-09-12T02:42:29.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:29 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86a5b47c-143f-4848-892f-c7b6a17a2799"}]': finished 2024-09-12T02:42:29.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:29 smithi018 ceph-mon[30616]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T02:42:29.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:29 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:42:30.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:30 smithi176 ceph-mon[35713]: from='client.? 172.21.15.62:0/3532986529' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:42:30.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:30 smithi062 ceph-mon[35527]: from='client.? 172.21.15.62:0/3532986529' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:42:30.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:30 smithi018 ceph-mon[30616]: from='client.? 172.21.15.62:0/3532986529' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:42:31.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:31 smithi176 ceph-mon[35713]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:31.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:31 smithi062 ceph-mon[35527]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:31.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:31 smithi018 ceph-mon[30616]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:32.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:32 smithi176 ceph-mon[35713]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:33.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:32 smithi062 ceph-mon[35527]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:33.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:32 smithi018 ceph-mon[30616]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:34.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:34 smithi176 ceph-mon[35713]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:35.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:34 smithi062 ceph-mon[35527]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:35.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:34 smithi018 ceph-mon[30616]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:36.849 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:36 smithi062 ceph-mon[35527]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:36.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:36 smithi176 ceph-mon[35713]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:37.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:36 smithi018 ceph-mon[30616]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:38.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:42:38.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:38.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:42:38.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:38.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:42:38.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:39.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:39 smithi062 ceph-mon[35527]: Deploying daemon osd.7 on smithi062 2024-09-12T02:42:39.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:39 smithi062 ceph-mon[35527]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:39.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:39 smithi018 ceph-mon[30616]: Deploying daemon osd.7 on smithi062 2024-09-12T02:42:39.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:39 smithi018 ceph-mon[30616]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:39.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:39 smithi176 ceph-mon[35713]: Deploying daemon osd.7 on smithi062 2024-09-12T02:42:39.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:39 smithi176 ceph-mon[35713]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:40.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:40 smithi176 ceph-mon[35713]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:41.299 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:40 smithi018 ceph-mon[30616]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:41.300 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:40 smithi062 ceph-mon[35527]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:42.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:42 smithi176 ceph-mon[35713]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:43.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:42 smithi062 ceph-mon[35527]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:43.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:42 smithi018 ceph-mon[30616]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:44.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:44 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:44.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:44 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:44.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:44 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:44 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:44 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:44 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:44.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:44 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:44.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:44 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:44.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:44 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:45.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:45 smithi176 ceph-mon[35713]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:45.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:45 smithi062 ceph-mon[35527]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:45.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:45 smithi018 ceph-mon[30616]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:46.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:46 smithi062 ceph-mon[35527]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:46.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:46 smithi176 ceph-mon[35713]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:47.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:46 smithi018 ceph-mon[30616]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:47.911 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 7 on host 'smithi062' 2024-09-12T02:42:47.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:47.909+0000 7f59e27fc640 1 -- 172.21.15.62:0/1098224330 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f59ec062630 con 0x7f59d80a2c30 2024-09-12T02:42:47.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:47.912+0000 7f59f350f640 1 -- 172.21.15.62:0/1098224330 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f59d80a2c30 msgr2=0x7f59d80a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:47.912+0000 7f59f350f640 1 --2- 172.21.15.62:0/1098224330 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f59d80a2c30 0x7f59d80a50f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f59ec06a510 tx=0x7f59e8005c10 comp rx=0 tx=0).stop 2024-09-12T02:42:47.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:47.912+0000 7f59f350f640 1 -- 172.21.15.62:0/1098224330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59ec102080 msgr2=0x7f59ec19f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:47.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:47.912+0000 7f59f350f640 1 --2- 172.21.15.62:0/1098224330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59ec102080 0x7f59ec19f510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f59e400b970 tx=0x7f59e400be30 comp rx=0 tx=0).stop 2024-09-12T02:42:47.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:47.912+0000 7f59f350f640 1 -- 172.21.15.62:0/1098224330 shutdown_connections 2024-09-12T02:42:47.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:47.912+0000 7f59f350f640 1 --2- 172.21.15.62:0/1098224330 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f59d80a2c30 0x7f59d80a50f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:47.912+0000 7f59f350f640 1 --2- 172.21.15.62:0/1098224330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59ec102080 0x7f59ec19f510 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:47.912+0000 7f59f350f640 1 --2- 172.21.15.62:0/1098224330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59ec101780 0x7f59ec198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:47.912+0000 7f59f350f640 1 --2- 172.21.15.62:0/1098224330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59ec100dc0 0x7f59ec197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:47.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:47.912+0000 7f59f350f640 1 -- 172.21.15.62:0/1098224330 >> 172.21.15.62:0/1098224330 conn(0x7f59ec0fba40 msgr2=0x7f59ec1051a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:47.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:47.912+0000 7f59f350f640 1 -- 172.21.15.62:0/1098224330 shutdown_connections 2024-09-12T02:42:47.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:42:47.912+0000 7f59f350f640 1 -- 172.21.15.62:0/1098224330 wait complete. 2024-09-12T02:42:48.532 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:48.532 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:48.532 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:48.532 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:48.532 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:48.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:48.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:48.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:48.558 DEBUG:teuthology.orchestra.run.smithi062:osd.7> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.7.service 2024-09-12T02:42:48.560 INFO:tasks.cephadm:Deploying osd.8 on smithi176 with /dev/vg_nvme/lv_2... 2024-09-12T02:42:48.560 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:42:48.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:48.817 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:42:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:49.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:49 smithi176 ceph-mon[35713]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:49.756 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:49 smithi062 ceph-mon[35527]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:49.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:49 smithi018 ceph-mon[30616]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:50.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 02:42:50 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T02:42:50.019+0000 7f54c54e6640 -1 osd.7 0 log_to_monitors true 2024-09-12T02:42:50.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:50 smithi176 ceph-mon[35713]: from='osd.7 [v2:172.21.15.62:6816/750933013,v1:172.21.15.62:6817/750933013]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:42:50.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:50 smithi176 ceph-mon[35713]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:42:50.779 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:50 smithi062 ceph-mon[35527]: from='osd.7 [v2:172.21.15.62:6816/750933013,v1:172.21.15.62:6817/750933013]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:42:50.779 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:50 smithi062 ceph-mon[35527]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:42:50.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:50 smithi018 ceph-mon[30616]: from='osd.7 [v2:172.21.15.62:6816/750933013,v1:172.21.15.62:6817/750933013]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:42:50.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:50 smithi018 ceph-mon[30616]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:42:51.240 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:42:51.266 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi176:vg_nvme/lv_2 2024-09-12T02:42:51.522 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:42:51.753 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:51 smithi176 ceph-mon[35713]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:42:51.753 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:51 smithi176 ceph-mon[35713]: osdmap e49: 8 total, 7 up, 8 in 2024-09-12T02:42:51.753 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:51 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:42:51.753 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:51 smithi176 ceph-mon[35713]: from='osd.7 [v2:172.21.15.62:6816/750933013,v1:172.21.15.62:6817/750933013]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:42:51.753 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:51 smithi176 ceph-mon[35713]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:42:51.753 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:51 smithi176 ceph-mon[35713]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:51.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:51 smithi062 ceph-mon[35527]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:42:51.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:51 smithi062 ceph-mon[35527]: osdmap e49: 8 total, 7 up, 8 in 2024-09-12T02:42:51.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:51 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:42:51.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:51 smithi062 ceph-mon[35527]: from='osd.7 [v2:172.21.15.62:6816/750933013,v1:172.21.15.62:6817/750933013]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:42:51.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:51 smithi062 ceph-mon[35527]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:42:51.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:51 smithi062 ceph-mon[35527]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:51.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:51 smithi018 ceph-mon[30616]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:42:51.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:51 smithi018 ceph-mon[30616]: osdmap e49: 8 total, 7 up, 8 in 2024-09-12T02:42:51.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:51 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:42:51.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:51 smithi018 ceph-mon[30616]: from='osd.7 [v2:172.21.15.62:6816/750933013,v1:172.21.15.62:6817/750933013]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:42:51.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:51 smithi018 ceph-mon[30616]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:42:51.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:51 smithi018 ceph-mon[30616]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:42:51.990 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.983+0000 7f72f2b39640 1 -- 172.21.15.176:0/4246926833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72ec101d00 msgr2=0x7f72ec102180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:51.990 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.983+0000 7f72f2b39640 1 --2- 172.21.15.176:0/4246926833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72ec101d00 0x7f72ec102180 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009900 tx=0x7f72d802a410 comp rx=0 tx=0).stop 2024-09-12T02:42:51.991 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.983+0000 7f72f2b39640 1 -- 172.21.15.176:0/4246926833 shutdown_connections 2024-09-12T02:42:51.991 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.983+0000 7f72f2b39640 1 --2- 172.21.15.176:0/4246926833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72ec1026c0 0x7f72ec108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.991 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.983+0000 7f72f2b39640 1 --2- 172.21.15.176:0/4246926833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72ec101d00 0x7f72ec102180 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.991 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.983+0000 7f72f2b39640 1 --2- 172.21.15.176:0/4246926833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72ec100b00 0x7f72ec100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.991 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.983+0000 7f72f2b39640 1 -- 172.21.15.176:0/4246926833 >> 172.21.15.176:0/4246926833 conn(0x7f72ec0fc270 msgr2=0x7f72ec0fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:42:51.991 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.983+0000 7f72f2b39640 1 -- 172.21.15.176:0/4246926833 shutdown_connections 2024-09-12T02:42:51.991 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.983+0000 7f72f2b39640 1 -- 172.21.15.176:0/4246926833 wait complete. 2024-09-12T02:42:51.991 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f2b39640 1 Processor -- start 2024-09-12T02:42:51.991 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f2b39640 1 -- start start 2024-09-12T02:42:51.991 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f2b39640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72ec100b00 0x7f72ec06b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.991 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f2b39640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72ec101d00 0x7f72ec19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.991 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f2b39640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72ec1026c0 0x7f72ec19f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.992 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f2b39640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec10c800 con 0x7f72ec100b00 2024-09-12T02:42:51.992 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f2b39640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec10c680 con 0x7f72ec101d00 2024-09-12T02:42:51.992 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f2b39640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec10c980 con 0x7f72ec1026c0 2024-09-12T02:42:51.992 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f10d6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72ec1026c0 0x7f72ec19f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.992 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f10d6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72ec1026c0 0x7f72ec19f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:37284/0 (socket says 172.21.15.176:37284) 2024-09-12T02:42:51.992 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72ebfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72ec101d00 0x7f72ec19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.992 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f10d6640 1 -- 172.21.15.176:0/3673745876 learned_addr learned my addr 172.21.15.176:0/3673745876 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-12T02:42:51.992 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f08d5640 1 --2- 172.21.15.176:0/3673745876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72ec100b00 0x7f72ec06b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.992 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f10d6640 1 -- 172.21.15.176:0/3673745876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72ec101d00 msgr2=0x7f72ec19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:51.992 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f10d6640 1 --2- 172.21.15.176:0/3673745876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72ec101d00 0x7f72ec19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.992 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f10d6640 1 -- 172.21.15.176:0/3673745876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72ec100b00 msgr2=0x7f72ec06b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:42:51.992 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f10d6640 1 --2- 172.21.15.176:0/3673745876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72ec100b00 0x7f72ec06b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:42:51.993 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f10d6640 1 -- 172.21.15.176:0/3673745876 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ec19fcd0 con 0x7f72ec1026c0 2024-09-12T02:42:51.993 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.984+0000 7f72f08d5640 1 --2- 172.21.15.176:0/3673745876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72ec100b00 0x7f72ec06b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:42:51.993 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.985+0000 7f72f10d6640 1 --2- 172.21.15.176:0/3673745876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72ec1026c0 0x7f72ec19f3c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009fd0 tx=0x7f72e400b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:51.993 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.985+0000 7f72e9ffb640 1 -- 172.21.15.176:0/3673745876 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4017070 con 0x7f72ec1026c0 2024-09-12T02:42:51.993 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.985+0000 7f72f2b39640 1 -- 172.21.15.176:0/3673745876 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72ec19ff60 con 0x7f72ec1026c0 2024-09-12T02:42:51.993 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.985+0000 7f72e9ffb640 1 -- 172.21.15.176:0/3673745876 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72e4003e50 con 0x7f72ec1026c0 2024-09-12T02:42:51.993 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.985+0000 7f72e9ffb640 1 -- 172.21.15.176:0/3673745876 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e40106c0 con 0x7f72ec1026c0 2024-09-12T02:42:51.993 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.985+0000 7f72f2b39640 1 -- 172.21.15.176:0/3673745876 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72ec1a0410 con 0x7f72ec1026c0 2024-09-12T02:42:51.993 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.986+0000 7f72f2b39640 1 -- 172.21.15.176:0/3673745876 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72ec100ee0 con 0x7f72ec1026c0 2024-09-12T02:42:51.993 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.987+0000 7f72e9ffb640 1 -- 172.21.15.176:0/3673745876 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f72e4003970 con 0x7f72ec1026c0 2024-09-12T02:42:51.993 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.988+0000 7f72e9ffb640 1 --2- 172.21.15.176:0/3673745876 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f72dc0a2b80 0x7f72dc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:42:51.993 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.988+0000 7f72e9ffb640 1 -- 172.21.15.176:0/3673745876 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5117+0+0 (secure 0 0 0) 0x7f72e40ce180 con 0x7f72ec1026c0 2024-09-12T02:42:51.993 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.988+0000 7f72f08d5640 1 --2- 172.21.15.176:0/3673745876 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f72dc0a2b80 0x7f72dc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:42:51.994 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.989+0000 7f72f08d5640 1 --2- 172.21.15.176:0/3673745876 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f72dc0a2b80 0x7f72dc0a5040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f72e0006fd0 tx=0x7f72e0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:42:51.997 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:51.997+0000 7f72e9ffb640 1 -- 172.21.15.176:0/3673745876 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f72e409bd60 con 0x7f72ec1026c0 2024-09-12T02:42:52.175 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:42:52.174+0000 7f72f2b39640 1 -- 172.21.15.176:0/3673745876 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f72ec0626f0 con 0x7f72dc0a2b80 2024-09-12T02:42:52.493 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T02:42:52.151+0000 7f54c1469640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T02:42:52.493 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T02:42:52.159+0000 7f54b9289640 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:42:52.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: Detected new or changed devices on smithi062 2024-09-12T02:42:52.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:52.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T02:42:52.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: osdmap e50: 8 total, 7 up, 8 in 2024-09-12T02:42:52.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:42:52.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:52.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:42:52.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:52.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:52.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:52.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi062 to 5696M 2024-09-12T02:42:52.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:52.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:52.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:52.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:52.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: from='osd.7 ' entity='osd.7' 2024-09-12T02:42:52.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:42:52.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:42:52.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:52 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:52.793 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: Detected new or changed devices on smithi062 2024-09-12T02:42:52.793 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:52.793 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T02:42:52.793 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: osdmap e50: 8 total, 7 up, 8 in 2024-09-12T02:42:52.793 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:42:52.794 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:52.794 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:42:52.794 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:52.794 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:52.794 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:52.794 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi062 to 5696M 2024-09-12T02:42:52.794 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:52.794 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:52.794 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:52.794 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:52.794 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: from='osd.7 ' entity='osd.7' 2024-09-12T02:42:52.794 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:42:52.794 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:42:52.795 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:52 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:52.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: Detected new or changed devices on smithi062 2024-09-12T02:42:52.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:52.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T02:42:52.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: osdmap e50: 8 total, 7 up, 8 in 2024-09-12T02:42:52.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:42:52.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:52.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:42:52.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:52.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:52.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:42:52.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi062 to 5696M 2024-09-12T02:42:52.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:52.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:52.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:52.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:42:52.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: from='osd.7 ' entity='osd.7' 2024-09-12T02:42:52.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:42:52.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:42:52.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:52 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:53.547 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:53 smithi176 ceph-mon[35713]: purged_snaps scrub starts 2024-09-12T02:42:53.547 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:53 smithi176 ceph-mon[35713]: purged_snaps scrub ok 2024-09-12T02:42:53.547 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:53 smithi176 ceph-mon[35713]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:42:53.547 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:53 smithi176 ceph-mon[35713]: osd.7 [v2:172.21.15.62:6816/750933013,v1:172.21.15.62:6817/750933013] boot 2024-09-12T02:42:53.547 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:53 smithi176 ceph-mon[35713]: osdmap e51: 8 total, 8 up, 8 in 2024-09-12T02:42:53.547 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:53 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:42:53.547 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:53 smithi176 ceph-mon[35713]: pgmap v182: 1 pgs: 1 unknown; 577 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:42:53.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:53 smithi062 ceph-mon[35527]: purged_snaps scrub starts 2024-09-12T02:42:53.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:53 smithi062 ceph-mon[35527]: purged_snaps scrub ok 2024-09-12T02:42:53.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:53 smithi062 ceph-mon[35527]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:42:53.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:53 smithi062 ceph-mon[35527]: osd.7 [v2:172.21.15.62:6816/750933013,v1:172.21.15.62:6817/750933013] boot 2024-09-12T02:42:53.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:53 smithi062 ceph-mon[35527]: osdmap e51: 8 total, 8 up, 8 in 2024-09-12T02:42:53.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:53 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:42:53.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:53 smithi062 ceph-mon[35527]: pgmap v182: 1 pgs: 1 unknown; 577 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:42:53.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:53 smithi018 ceph-mon[30616]: purged_snaps scrub starts 2024-09-12T02:42:53.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:53 smithi018 ceph-mon[30616]: purged_snaps scrub ok 2024-09-12T02:42:53.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:53 smithi018 ceph-mon[30616]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:42:53.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:53 smithi018 ceph-mon[30616]: osd.7 [v2:172.21.15.62:6816/750933013,v1:172.21.15.62:6817/750933013] boot 2024-09-12T02:42:53.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:53 smithi018 ceph-mon[30616]: osdmap e51: 8 total, 8 up, 8 in 2024-09-12T02:42:53.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:53 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:42:53.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:53 smithi018 ceph-mon[30616]: pgmap v182: 1 pgs: 1 unknown; 577 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:42:54.770 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:54 smithi176 ceph-mon[35713]: osdmap e52: 8 total, 8 up, 8 in 2024-09-12T02:42:54.770 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:54 smithi176 ceph-mon[35713]: osdmap e53: 8 total, 8 up, 8 in 2024-09-12T02:42:54.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:54 smithi062 ceph-mon[35527]: osdmap e52: 8 total, 8 up, 8 in 2024-09-12T02:42:54.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:54 smithi062 ceph-mon[35527]: osdmap e53: 8 total, 8 up, 8 in 2024-09-12T02:42:54.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:54 smithi018 ceph-mon[30616]: osdmap e52: 8 total, 8 up, 8 in 2024-09-12T02:42:54.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:54 smithi018 ceph-mon[30616]: osdmap e53: 8 total, 8 up, 8 in 2024-09-12T02:42:55.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:55 smithi062 ceph-mon[35527]: from='client.? 172.21.15.176:0/2489248644' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0426a455-ed11-4d6a-8e1d-c8aa2ee65cae"}]: dispatch 2024-09-12T02:42:55.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:55 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0426a455-ed11-4d6a-8e1d-c8aa2ee65cae"}]: dispatch 2024-09-12T02:42:55.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:55 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0426a455-ed11-4d6a-8e1d-c8aa2ee65cae"}]': finished 2024-09-12T02:42:55.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:55 smithi062 ceph-mon[35527]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T02:42:55.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:55 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:42:55.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:55 smithi062 ceph-mon[35527]: from='client.? 172.21.15.176:0/1012680456' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:42:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:55 smithi018 ceph-mon[30616]: from='client.? 172.21.15.176:0/2489248644' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0426a455-ed11-4d6a-8e1d-c8aa2ee65cae"}]: dispatch 2024-09-12T02:42:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:55 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0426a455-ed11-4d6a-8e1d-c8aa2ee65cae"}]: dispatch 2024-09-12T02:42:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:55 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0426a455-ed11-4d6a-8e1d-c8aa2ee65cae"}]': finished 2024-09-12T02:42:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:55 smithi018 ceph-mon[30616]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T02:42:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:55 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:42:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:55 smithi018 ceph-mon[30616]: from='client.? 172.21.15.176:0/1012680456' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:42:55.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:55 smithi176 ceph-mon[35713]: from='client.? 172.21.15.176:0/2489248644' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0426a455-ed11-4d6a-8e1d-c8aa2ee65cae"}]: dispatch 2024-09-12T02:42:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:55 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0426a455-ed11-4d6a-8e1d-c8aa2ee65cae"}]: dispatch 2024-09-12T02:42:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:55 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0426a455-ed11-4d6a-8e1d-c8aa2ee65cae"}]': finished 2024-09-12T02:42:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:55 smithi176 ceph-mon[35713]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T02:42:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:55 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:42:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:55 smithi176 ceph-mon[35713]: from='client.? 172.21.15.176:0/1012680456' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:42:56.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:56 smithi062 ceph-mon[35527]: pgmap v186: 1 pgs: 1 unknown; 577 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:42:56.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:56 smithi062 ceph-mon[35527]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-12T02:42:56.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:56 smithi062 ceph-mon[35527]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T02:42:56.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:56 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:42:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:56 smithi018 ceph-mon[30616]: pgmap v186: 1 pgs: 1 unknown; 577 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:42:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:56 smithi018 ceph-mon[30616]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-12T02:42:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:56 smithi018 ceph-mon[30616]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T02:42:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:56 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:42:56.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:56 smithi176 ceph-mon[35713]: pgmap v186: 1 pgs: 1 unknown; 577 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:42:56.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:56 smithi176 ceph-mon[35713]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-12T02:42:56.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:56 smithi176 ceph-mon[35713]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T02:42:56.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:56 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:42:57.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:57 smithi018 ceph-mon[30616]: osdmap e56: 9 total, 8 up, 9 in 2024-09-12T02:42:57.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:57 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:42:57.948 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:57 smithi062 ceph-mon[35527]: osdmap e56: 9 total, 8 up, 9 in 2024-09-12T02:42:57.948 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:57 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:42:57.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:57 smithi176 ceph-mon[35713]: osdmap e56: 9 total, 8 up, 9 in 2024-09-12T02:42:57.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:57 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:42:58.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:58 smithi018 ceph-mon[30616]: pgmap v189: 1 pgs: 1 unknown; 577 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:42:58.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:58 smithi176 ceph-mon[35713]: pgmap v189: 1 pgs: 1 unknown; 577 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:42:59.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:58 smithi062 ceph-mon[35527]: pgmap v189: 1 pgs: 1 unknown; 577 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:42:59.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:59 smithi018 ceph-mon[30616]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:42:59.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:59 smithi018 ceph-mon[30616]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-12T02:42:59.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:42:59 smithi018 ceph-mon[30616]: Cluster is now healthy 2024-09-12T02:42:59.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:59 smithi176 ceph-mon[35713]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:42:59.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:59 smithi176 ceph-mon[35713]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-12T02:42:59.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:42:59 smithi176 ceph-mon[35713]: Cluster is now healthy 2024-09-12T02:43:00.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:59 smithi062 ceph-mon[35527]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:00.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:59 smithi062 ceph-mon[35527]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-12T02:43:00.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:42:59 smithi062 ceph-mon[35527]: Cluster is now healthy 2024-09-12T02:43:01.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:01 smithi018 ceph-mon[30616]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:01.915 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:01 smithi176 ceph-mon[35713]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:02.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:01 smithi062 ceph-mon[35527]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:03.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:03 smithi018 ceph-mon[30616]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:03.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:03 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:43:03.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:03 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:03.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:03 smithi018 ceph-mon[30616]: Deploying daemon osd.8 on smithi176 2024-09-12T02:43:03.957 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:03 smithi176 ceph-mon[35713]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:03.958 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:03 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:43:03.958 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:03 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:03.958 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:03 smithi176 ceph-mon[35713]: Deploying daemon osd.8 on smithi176 2024-09-12T02:43:04.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:03 smithi062 ceph-mon[35527]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:04.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:03 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:43:04.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:03 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:04.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:03 smithi062 ceph-mon[35527]: Deploying daemon osd.8 on smithi176 2024-09-12T02:43:05.720 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:05 smithi176 ceph-mon[35713]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:05.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:05 smithi018 ceph-mon[30616]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:06.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:05 smithi062 ceph-mon[35527]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:07.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:07 smithi062 ceph-mon[35527]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:07.831 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:07 smithi176 ceph-mon[35713]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:08.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:07 smithi018 ceph-mon[30616]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:09.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:09 smithi176 ceph-mon[35713]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:09.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:09.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:09.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:10.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:09 smithi062 ceph-mon[35527]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:10.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:10.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:10.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:10.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:09 smithi018 ceph-mon[30616]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:10.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:10.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:10.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:11.719 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:11 smithi176 ceph-mon[35713]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:11.763 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:43:11.762+0000 7f72e9ffb640 1 -- 172.21.15.176:0/3673745876 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f72ec0626f0 con 0x7f72dc0a2b80 2024-09-12T02:43:11.763 INFO:teuthology.orchestra.run.smithi176.stdout:Created osd(s) 8 on host 'smithi176' 2024-09-12T02:43:11.765 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:43:11.765+0000 7f72f2b39640 1 -- 172.21.15.176:0/3673745876 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f72dc0a2b80 msgr2=0x7f72dc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:11.765 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:43:11.765+0000 7f72f2b39640 1 --2- 172.21.15.176:0/3673745876 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f72dc0a2b80 0x7f72dc0a5040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f72e0006fd0 tx=0x7f72e0008040 comp rx=0 tx=0).stop 2024-09-12T02:43:11.766 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:43:11.765+0000 7f72f2b39640 1 -- 172.21.15.176:0/3673745876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72ec1026c0 msgr2=0x7f72ec19f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:11.766 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:43:11.765+0000 7f72f2b39640 1 --2- 172.21.15.176:0/3673745876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72ec1026c0 0x7f72ec19f3c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009fd0 tx=0x7f72e400b260 comp rx=0 tx=0).stop 2024-09-12T02:43:11.766 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:43:11.765+0000 7f72f2b39640 1 -- 172.21.15.176:0/3673745876 shutdown_connections 2024-09-12T02:43:11.766 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:43:11.765+0000 7f72f2b39640 1 --2- 172.21.15.176:0/3673745876 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f72dc0a2b80 0x7f72dc0a5040 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:11.766 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:43:11.765+0000 7f72f2b39640 1 --2- 172.21.15.176:0/3673745876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72ec1026c0 0x7f72ec19f3c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:11.766 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:43:11.765+0000 7f72f2b39640 1 --2- 172.21.15.176:0/3673745876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72ec101d00 0x7f72ec19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:11.766 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:43:11.765+0000 7f72f2b39640 1 --2- 172.21.15.176:0/3673745876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72ec100b00 0x7f72ec06b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:11.766 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:43:11.765+0000 7f72f2b39640 1 -- 172.21.15.176:0/3673745876 >> 172.21.15.176:0/3673745876 conn(0x7f72ec0fc270 msgr2=0x7f72ec1051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:11.767 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:43:11.765+0000 7f72f2b39640 1 -- 172.21.15.176:0/3673745876 shutdown_connections 2024-09-12T02:43:11.767 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:43:11.765+0000 7f72f2b39640 1 -- 172.21.15.176:0/3673745876 wait complete. 2024-09-12T02:43:12.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:11 smithi062 ceph-mon[35527]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:12.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:11 smithi018 ceph-mon[30616]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:12.485 DEBUG:teuthology.orchestra.run.smithi176:osd.8> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.8.service 2024-09-12T02:43:12.488 INFO:tasks.cephadm:Deploying osd.9 on smithi018 with /dev/vg_nvme/lv_1... 2024-09-12T02:43:12.488 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:43:12.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:12.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:12.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:12.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:12.875 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:43:13.007 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:13.007 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:13.007 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:13.007 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:14.801 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:14 smithi018 ceph-mon[30616]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:14.964 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:14 smithi176 ceph-mon[35713]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:14.964 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 02:43:14 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T02:43:14.769+0000 7f7665f8f640 -1 osd.8 0 log_to_monitors true 2024-09-12T02:43:15.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:14 smithi062 ceph-mon[35527]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:15.724 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:15 smithi018 ceph-mon[30616]: from='osd.8 [v2:172.21.15.176:6816/8496953,v1:172.21.15.176:6817/8496953]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:43:15.725 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:15 smithi018 ceph-mon[30616]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:43:15.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:15 smithi176 ceph-mon[35713]: from='osd.8 [v2:172.21.15.176:6816/8496953,v1:172.21.15.176:6817/8496953]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:43:15.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:15 smithi176 ceph-mon[35713]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:43:16.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:15 smithi062 ceph-mon[35527]: from='osd.8 [v2:172.21.15.176:6816/8496953,v1:172.21.15.176:6817/8496953]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:43:16.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:15 smithi062 ceph-mon[35527]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:43:16.653 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:43:16.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_1 2024-09-12T02:43:16.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:16.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:43:16.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: from='osd.8 [v2:172.21.15.176:6816/8496953,v1:172.21.15.176:6817/8496953]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:43:16.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: osdmap e57: 9 total, 8 up, 9 in 2024-09-12T02:43:16.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:43:16.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:43:16.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:16.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:16.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:16.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:16.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:16.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:16.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:16.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:16.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:16.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:16.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:16.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:16.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:16.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:16.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:43:16.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: from='osd.8 [v2:172.21.15.176:6816/8496953,v1:172.21.15.176:6817/8496953]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:43:16.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: osdmap e57: 9 total, 8 up, 9 in 2024-09-12T02:43:16.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:43:16.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:43:16.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:16.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:16.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:16.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:16.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:16.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:16.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:16.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:16.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:16.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:16.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:16.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:16.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:17.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:17.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:43:17.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: from='osd.8 [v2:172.21.15.176:6816/8496953,v1:172.21.15.176:6817/8496953]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:43:17.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: osdmap e57: 9 total, 8 up, 9 in 2024-09-12T02:43:17.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:43:17.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:43:17.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:17.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:17.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:17.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:17.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:17.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:17.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:17.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:17.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:17.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:17.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:17.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:17.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:17.098 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:43:17.596 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 02:43:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T02:43:17.269+0000 7f7661f12640 -1 osd.8 0 waiting for initial osdmap 2024-09-12T02:43:17.597 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 02:43:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T02:43:17.278+0000 7f7659d32640 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:43:17.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.716+0000 7f38c2200640 1 -- 172.21.15.18:0/3008122916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38bc105920 msgr2=0x7f38bc10c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:17.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.716+0000 7f38c2200640 1 --2- 172.21.15.18:0/3008122916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38bc105920 0x7f38bc10c240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f38b4009ca0 tx=0x7f38b402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.716+0000 7f38c2200640 1 -- 172.21.15.18:0/3008122916 shutdown_connections 2024-09-12T02:43:17.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.716+0000 7f38c2200640 1 --2- 172.21.15.18:0/3008122916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38bc105920 0x7f38bc10c240 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.716+0000 7f38c2200640 1 --2- 172.21.15.18:0/3008122916 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc104f60 0x7f38bc1053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.716+0000 7f38c2200640 1 --2- 172.21.15.18:0/3008122916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38bc103e00 0x7f38bc104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.716+0000 7f38c2200640 1 -- 172.21.15.18:0/3008122916 >> 172.21.15.18:0/3008122916 conn(0x7f38bc0ff5b0 msgr2=0x7f38bc1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:17.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.716+0000 7f38c2200640 1 -- 172.21.15.18:0/3008122916 shutdown_connections 2024-09-12T02:43:17.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.716+0000 7f38c2200640 1 -- 172.21.15.18:0/3008122916 wait complete. 2024-09-12T02:43:17.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.717+0000 7f38c2200640 1 Processor -- start 2024-09-12T02:43:17.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.717+0000 7f38c2200640 1 -- start start 2024-09-12T02:43:17.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.718+0000 7f38c2200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc103e00 0x7f38bc19a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:17.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.718+0000 7f38c2200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38bc104f60 0x7f38bc19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:17.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.718+0000 7f38c2200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38bc105920 0x7f38bc1a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:17.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.718+0000 7f38c2200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38bc10fb00 con 0x7f38bc104f60 2024-09-12T02:43:17.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.718+0000 7f38c2200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f38bc10f980 con 0x7f38bc105920 2024-09-12T02:43:17.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.718+0000 7f38c2200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f38bc10fc80 con 0x7f38bc103e00 2024-09-12T02:43:17.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.718+0000 7f38baa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38bc104f60 0x7f38bc19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:17.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.718+0000 7f38bb400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc103e00 0x7f38bc19a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:17.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.718+0000 7f38baa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38bc104f60 0x7f38bc19a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52712/0 (socket says 172.21.15.18:52712) 2024-09-12T02:43:17.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.718+0000 7f38baa00640 1 -- 172.21.15.18:0/3367186425 learned_addr learned my addr 172.21.15.18:0/3367186425 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:43:17.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.718+0000 7f38bb400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc103e00 0x7f38bc19a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:38864/0 (socket says 172.21.15.18:38864) 2024-09-12T02:43:17.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.718+0000 7f38bbe00640 1 --2- 172.21.15.18:0/3367186425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38bc105920 0x7f38bc1a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:17.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.718+0000 7f38bb400640 1 -- 172.21.15.18:0/3367186425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38bc105920 msgr2=0x7f38bc1a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:17.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.718+0000 7f38bb400640 1 --2- 172.21.15.18:0/3367186425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38bc105920 0x7f38bc1a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.718+0000 7f38bb400640 1 -- 172.21.15.18:0/3367186425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38bc104f60 msgr2=0x7f38bc19a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:17.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.718+0000 7f38bb400640 1 --2- 172.21.15.18:0/3367186425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38bc104f60 0x7f38bc19a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.718+0000 7f38bb400640 1 -- 172.21.15.18:0/3367186425 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38bc1a1c90 con 0x7f38bc103e00 2024-09-12T02:43:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.719+0000 7f38bb400640 1 --2- 172.21.15.18:0/3367186425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc103e00 0x7f38bc19a060 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00e9f0 tx=0x7f38ac00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.719+0000 7f38b3e00640 1 -- 172.21.15.18:0/3367186425 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac00ccc0 con 0x7f38bc103e00 2024-09-12T02:43:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.719+0000 7f38b3e00640 1 -- 172.21.15.18:0/3367186425 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38ac010910 con 0x7f38bc103e00 2024-09-12T02:43:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.719+0000 7f38c2200640 1 -- 172.21.15.18:0/3367186425 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38bc1a1f80 con 0x7f38bc103e00 2024-09-12T02:43:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.719+0000 7f38b3e00640 1 -- 172.21.15.18:0/3367186425 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac018960 con 0x7f38bc103e00 2024-09-12T02:43:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.719+0000 7f38c2200640 1 -- 172.21.15.18:0/3367186425 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38bc1a23d0 con 0x7f38bc103e00 2024-09-12T02:43:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.720+0000 7f38c2200640 1 -- 172.21.15.18:0/3367186425 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38bc10b0c0 con 0x7f38bc103e00 2024-09-12T02:43:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.723+0000 7f38b3e00640 1 -- 172.21.15.18:0/3367186425 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f38ac010ac0 con 0x7f38bc103e00 2024-09-12T02:43:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.724+0000 7f38b3e00640 1 --2- 172.21.15.18:0/3367186425 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f38a00a2bb0 0x7f38a00a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.724+0000 7f38b3e00640 1 -- 172.21.15.18:0/3367186425 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5862+0+0 (secure 0 0 0) 0x7f38ac0ceab0 con 0x7f38bc103e00 2024-09-12T02:43:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.724+0000 7f38baa00640 1 --2- 172.21.15.18:0/3367186425 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f38a00a2bb0 0x7f38a00a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.724+0000 7f38baa00640 1 --2- 172.21.15.18:0/3367186425 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f38a00a2bb0 0x7f38a00a5070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f38bc19b580 tx=0x7f38a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:17.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.728+0000 7f38b3e00640 1 -- 172.21.15.18:0/3367186425 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f38ac09bcb0 con 0x7f38bc103e00 2024-09-12T02:43:17.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:17 smithi018 ceph-mon[30616]: Detected new or changed devices on smithi176 2024-09-12T02:43:17.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:17 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi176 to 5696M 2024-09-12T02:43:17.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:17 smithi018 ceph-mon[30616]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-12T02:43:17.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:17 smithi018 ceph-mon[30616]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:17.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:17 smithi018 ceph-mon[30616]: osdmap e58: 9 total, 8 up, 9 in 2024-09-12T02:43:17.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:17 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:43:17.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:17 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:43:17.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:17 smithi018 ceph-mon[30616]: from='osd.8 ' entity='osd.8' 2024-09-12T02:43:17.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:17.923+0000 7f38c2200640 1 -- 172.21.15.18:0/3367186425 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f38bc062630 con 0x7f38a00a2bb0 2024-09-12T02:43:17.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:17 smithi176 ceph-mon[35713]: Detected new or changed devices on smithi176 2024-09-12T02:43:17.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:17 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi176 to 5696M 2024-09-12T02:43:17.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:17 smithi176 ceph-mon[35713]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-12T02:43:17.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:17 smithi176 ceph-mon[35713]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:17.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:17 smithi176 ceph-mon[35713]: osdmap e58: 9 total, 8 up, 9 in 2024-09-12T02:43:17.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:17 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:43:17.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:17 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:43:17.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:17 smithi176 ceph-mon[35713]: from='osd.8 ' entity='osd.8' 2024-09-12T02:43:18.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:17 smithi062 ceph-mon[35527]: Detected new or changed devices on smithi176 2024-09-12T02:43:18.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:17 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi176 to 5696M 2024-09-12T02:43:18.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:17 smithi062 ceph-mon[35527]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-12T02:43:18.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:17 smithi062 ceph-mon[35527]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:18.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:17 smithi062 ceph-mon[35527]: osdmap e58: 9 total, 8 up, 9 in 2024-09-12T02:43:18.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:17 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:43:18.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:17 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:43:18.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:17 smithi062 ceph-mon[35527]: from='osd.8 ' entity='osd.8' 2024-09-12T02:43:18.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:18 smithi018 ceph-mon[30616]: purged_snaps scrub starts 2024-09-12T02:43:18.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:18 smithi018 ceph-mon[30616]: purged_snaps scrub ok 2024-09-12T02:43:18.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:18 smithi018 ceph-mon[30616]: osd.8 [v2:172.21.15.176:6816/8496953,v1:172.21.15.176:6817/8496953] boot 2024-09-12T02:43:18.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:18 smithi018 ceph-mon[30616]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T02:43:18.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:18 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:43:18.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:18 smithi018 ceph-mon[30616]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:43:18.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:18 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:43:18.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:18 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:43:18.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:18 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:18.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:18 smithi176 ceph-mon[35713]: purged_snaps scrub starts 2024-09-12T02:43:18.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:18 smithi176 ceph-mon[35713]: purged_snaps scrub ok 2024-09-12T02:43:18.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:18 smithi176 ceph-mon[35713]: osd.8 [v2:172.21.15.176:6816/8496953,v1:172.21.15.176:6817/8496953] boot 2024-09-12T02:43:18.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:18 smithi176 ceph-mon[35713]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T02:43:18.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:18 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:43:18.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:18 smithi176 ceph-mon[35713]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:43:18.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:18 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:43:18.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:18 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:43:18.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:18 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:19.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:18 smithi062 ceph-mon[35527]: purged_snaps scrub starts 2024-09-12T02:43:19.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:18 smithi062 ceph-mon[35527]: purged_snaps scrub ok 2024-09-12T02:43:19.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:18 smithi062 ceph-mon[35527]: osd.8 [v2:172.21.15.176:6816/8496953,v1:172.21.15.176:6817/8496953] boot 2024-09-12T02:43:19.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:18 smithi062 ceph-mon[35527]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T02:43:19.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:18 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:43:19.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:18 smithi062 ceph-mon[35527]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:43:19.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:18 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:43:19.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:18 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:43:19.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:18 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:19.815 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:19 smithi018 ceph-mon[30616]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:19.815 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:19 smithi018 ceph-mon[30616]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T02:43:19.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:19 smithi176 ceph-mon[35713]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:19.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:19 smithi176 ceph-mon[35713]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T02:43:20.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:19 smithi062 ceph-mon[35527]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:43:20.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:19 smithi062 ceph-mon[35527]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T02:43:20.880 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:20 smithi176 ceph-mon[35713]: osdmap e61: 9 total, 9 up, 9 in 2024-09-12T02:43:21.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:20 smithi062 ceph-mon[35527]: osdmap e61: 9 total, 9 up, 9 in 2024-09-12T02:43:21.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:20 smithi018 ceph-mon[30616]: osdmap e61: 9 total, 9 up, 9 in 2024-09-12T02:43:21.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:21 smithi018 ceph-mon[30616]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:21.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:21 smithi018 ceph-mon[30616]: osdmap e62: 9 total, 9 up, 9 in 2024-09-12T02:43:21.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:21 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2727151209' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "241aa2cf-0765-465d-b400-4911e653412a"}]: dispatch 2024-09-12T02:43:21.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:21 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2727151209' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "241aa2cf-0765-465d-b400-4911e653412a"}]': finished 2024-09-12T02:43:21.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:21 smithi018 ceph-mon[30616]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T02:43:21.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:21 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:43:21.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:21 smithi176 ceph-mon[35713]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:21.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:21 smithi176 ceph-mon[35713]: osdmap e62: 9 total, 9 up, 9 in 2024-09-12T02:43:21.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:21 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2727151209' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "241aa2cf-0765-465d-b400-4911e653412a"}]: dispatch 2024-09-12T02:43:21.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:21 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2727151209' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "241aa2cf-0765-465d-b400-4911e653412a"}]': finished 2024-09-12T02:43:21.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:21 smithi176 ceph-mon[35713]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T02:43:21.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:21 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:43:22.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:21 smithi062 ceph-mon[35527]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:22.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:21 smithi062 ceph-mon[35527]: osdmap e62: 9 total, 9 up, 9 in 2024-09-12T02:43:22.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:21 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2727151209' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "241aa2cf-0765-465d-b400-4911e653412a"}]: dispatch 2024-09-12T02:43:22.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:21 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2727151209' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "241aa2cf-0765-465d-b400-4911e653412a"}]': finished 2024-09-12T02:43:22.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:21 smithi062 ceph-mon[35527]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T02:43:22.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:21 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:43:22.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:22 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/278787856' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:43:23.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:22 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/278787856' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:43:23.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:22 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/278787856' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:43:23.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:23 smithi176 ceph-mon[35713]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:43:24.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:23 smithi062 ceph-mon[35527]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:43:24.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:23 smithi018 ceph-mon[30616]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:43:25.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:25 smithi176 ceph-mon[35713]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:43:25.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:25 smithi018 ceph-mon[30616]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:43:26.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:25 smithi062 ceph-mon[35527]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:43:27.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:27 smithi018 ceph-mon[30616]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-12T02:43:27.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:27 smithi176 ceph-mon[35713]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-12T02:43:28.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:27 smithi062 ceph-mon[35527]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-12T02:43:29.836 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:29 smithi018 ceph-mon[30616]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:43:29.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:29 smithi176 ceph-mon[35713]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:43:30.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:29 smithi062 ceph-mon[35527]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:43:31.714 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:31 smithi018 ceph-mon[30616]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:43:31.715 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:31 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:43:31.715 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:31 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:31.715 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:31 smithi018 ceph-mon[30616]: Deploying daemon osd.9 on smithi018 2024-09-12T02:43:31.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:31 smithi176 ceph-mon[35713]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:43:31.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:31 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:43:31.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:31 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:31.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:31 smithi176 ceph-mon[35713]: Deploying daemon osd.9 on smithi018 2024-09-12T02:43:32.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:31 smithi062 ceph-mon[35527]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:43:32.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:31 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:43:32.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:31 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:32.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:31 smithi062 ceph-mon[35527]: Deploying daemon osd.9 on smithi018 2024-09-12T02:43:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:33 smithi018 ceph-mon[30616]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-12T02:43:33.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:33 smithi176 ceph-mon[35713]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-12T02:43:34.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:33 smithi062 ceph-mon[35527]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-12T02:43:35.779 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:35 smithi018 ceph-mon[30616]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:35.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:35 smithi176 ceph-mon[35713]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:36.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:35 smithi062 ceph-mon[35527]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:37.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:37 smithi176 ceph-mon[35713]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:38.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:37 smithi062 ceph-mon[35527]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:38.091 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:37 smithi018 ceph-mon[30616]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:39.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:39 smithi018 ceph-mon[30616]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:39.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:39 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:39.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:39 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:39.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:39 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:39.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:39 smithi176 ceph-mon[35713]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:39.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:39 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:39.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:39 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:39.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:39 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:40.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:39 smithi062 ceph-mon[35527]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:40.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:39 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:40.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:39 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:40.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:39 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:41.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:41 smithi018 ceph-mon[30616]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:41.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:41 smithi176 ceph-mon[35713]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:42.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:41 smithi062 ceph-mon[35527]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:43.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:43.341+0000 7f38b3e00640 1 -- 172.21.15.18:0/3367186425 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f38bc062630 con 0x7f38a00a2bb0 2024-09-12T02:43:43.350 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 9 on host 'smithi018' 2024-09-12T02:43:43.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:43.343+0000 7f38c2200640 1 -- 172.21.15.18:0/3367186425 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f38a00a2bb0 msgr2=0x7f38a00a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:43.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:43.343+0000 7f38c2200640 1 --2- 172.21.15.18:0/3367186425 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f38a00a2bb0 0x7f38a00a5070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f38bc19b580 tx=0x7f38a8005f90 comp rx=0 tx=0).stop 2024-09-12T02:43:43.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:43.343+0000 7f38c2200640 1 -- 172.21.15.18:0/3367186425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc103e00 msgr2=0x7f38bc19a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:43.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:43.344+0000 7f38c2200640 1 --2- 172.21.15.18:0/3367186425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc103e00 0x7f38bc19a060 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00e9f0 tx=0x7f38ac00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:43:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:43.344+0000 7f38c2200640 1 -- 172.21.15.18:0/3367186425 shutdown_connections 2024-09-12T02:43:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:43.344+0000 7f38c2200640 1 --2- 172.21.15.18:0/3367186425 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f38a00a2bb0 0x7f38a00a5070 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:43.344+0000 7f38c2200640 1 --2- 172.21.15.18:0/3367186425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38bc105920 0x7f38bc1a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:43.344+0000 7f38c2200640 1 --2- 172.21.15.18:0/3367186425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38bc104f60 0x7f38bc19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:43.344+0000 7f38c2200640 1 --2- 172.21.15.18:0/3367186425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc103e00 0x7f38bc19a060 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:43.344+0000 7f38c2200640 1 -- 172.21.15.18:0/3367186425 >> 172.21.15.18:0/3367186425 conn(0x7f38bc0ff5b0 msgr2=0x7f38bc108290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:43.344+0000 7f38c2200640 1 -- 172.21.15.18:0/3367186425 shutdown_connections 2024-09-12T02:43:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:43:43.344+0000 7f38c2200640 1 -- 172.21.15.18:0/3367186425 wait complete. 2024-09-12T02:43:43.370 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:43 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:43.371 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:43 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:43.371 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:43 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:43.371 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:43 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:43.371 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:43 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:43.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:43 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:43.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:43 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:43.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:43 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:43.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:43 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:43.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:43 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:43.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:43 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:43.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:43 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:43.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:43 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:43.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:43 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:43.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:43 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:43.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:43 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:43.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:43 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:43.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:43 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:43.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:43 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:43.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:43 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:43.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:43 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:43.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:43 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:43.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:43 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:43.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:43 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:44.208 DEBUG:teuthology.orchestra.run.smithi018:osd.9> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.9.service 2024-09-12T02:43:44.212 INFO:tasks.cephadm:Deploying osd.10 on smithi062 with /dev/vg_nvme/lv_1... 2024-09-12T02:43:44.212 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:43:44.473 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:43:44.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:44 smithi062 ceph-mon[35527]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:44.630 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:44 smithi018 ceph-mon[30616]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:44.631 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 02:43:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T02:43:44.410+0000 7f3a0bc8d640 -1 osd.9 0 log_to_monitors true 2024-09-12T02:43:44.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:44 smithi176 ceph-mon[35713]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:45.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:45 smithi018 ceph-mon[30616]: from='osd.9 [v2:172.21.15.18:6826/422514390,v1:172.21.15.18:6827/422514390]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:43:45.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:45 smithi018 ceph-mon[30616]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:43:45.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:45 smithi176 ceph-mon[35713]: from='osd.9 [v2:172.21.15.18:6826/422514390,v1:172.21.15.18:6827/422514390]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:43:45.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:45 smithi176 ceph-mon[35713]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:43:45.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:45 smithi062 ceph-mon[35527]: from='osd.9 [v2:172.21.15.18:6826/422514390,v1:172.21.15.18:6827/422514390]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:43:45.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:45 smithi062 ceph-mon[35527]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:43:46.575 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:46 smithi062 ceph-mon[35527]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:46.576 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:46 smithi062 ceph-mon[35527]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:43:46.576 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:46 smithi062 ceph-mon[35527]: osdmap e64: 10 total, 9 up, 10 in 2024-09-12T02:43:46.576 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:46 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:43:46.576 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:46 smithi062 ceph-mon[35527]: from='osd.9 [v2:172.21.15.18:6826/422514390,v1:172.21.15.18:6827/422514390]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-12T02:43:46.576 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:46 smithi062 ceph-mon[35527]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-12T02:43:46.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:46 smithi018 ceph-mon[30616]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:46.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:46 smithi018 ceph-mon[30616]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:43:46.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:46 smithi018 ceph-mon[30616]: osdmap e64: 10 total, 9 up, 10 in 2024-09-12T02:43:46.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:46 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:43:46.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:46 smithi018 ceph-mon[30616]: from='osd.9 [v2:172.21.15.18:6826/422514390,v1:172.21.15.18:6827/422514390]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-12T02:43:46.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:46 smithi018 ceph-mon[30616]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-12T02:43:46.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 02:43:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T02:43:46.407+0000 7f3a06c00640 -1 osd.9 0 waiting for initial osdmap 2024-09-12T02:43:46.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 02:43:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T02:43:46.424+0000 7f3a01c00640 -1 osd.9 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:43:46.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:46 smithi176 ceph-mon[35713]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:46.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:46 smithi176 ceph-mon[35713]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:43:46.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:46 smithi176 ceph-mon[35713]: osdmap e64: 10 total, 9 up, 10 in 2024-09-12T02:43:46.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:46 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:43:46.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:46 smithi176 ceph-mon[35713]: from='osd.9 [v2:172.21.15.18:6826/422514390,v1:172.21.15.18:6827/422514390]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-12T02:43:46.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:46 smithi176 ceph-mon[35713]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-12T02:43:47.316 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:43:47.341 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi062:vg_nvme/lv_1 2024-09-12T02:43:47.583 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:47 smithi062 ceph-mon[35527]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-12T02:43:47.583 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:47 smithi062 ceph-mon[35527]: osdmap e65: 10 total, 9 up, 10 in 2024-09-12T02:43:47.583 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:47 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:43:47.583 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:47 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:43:47.598 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:43:47.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:47 smithi018 ceph-mon[30616]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-12T02:43:47.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:47 smithi018 ceph-mon[30616]: osdmap e65: 10 total, 9 up, 10 in 2024-09-12T02:43:47.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:47 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:43:47.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:47 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:43:47.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:47 smithi176 ceph-mon[35713]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-12T02:43:47.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:47 smithi176 ceph-mon[35713]: osdmap e65: 10 total, 9 up, 10 in 2024-09-12T02:43:47.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:47 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:43:47.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:47 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:43:48.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.067+0000 7fe9aa5c3640 1 -- 172.21.15.62:0/3265319139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9a4103870 msgr2=0x7fe9a410a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:48.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.067+0000 7fe9aa5c3640 1 --2- 172.21.15.62:0/3265319139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9a4103870 0x7fe9a410a100 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009ca0 tx=0x7fe99c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:43:48.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.067+0000 7fe9aa5c3640 1 -- 172.21.15.62:0/3265319139 shutdown_connections 2024-09-12T02:43:48.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.067+0000 7fe9aa5c3640 1 --2- 172.21.15.62:0/3265319139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9a4103870 0x7fe9a410a100 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:48.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.067+0000 7fe9aa5c3640 1 --2- 172.21.15.62:0/3265319139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9a4102eb0 0x7fe9a4103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:48.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.067+0000 7fe9aa5c3640 1 --2- 172.21.15.62:0/3265319139 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9a40ffed0 0x7fe9a41002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:48.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.067+0000 7fe9aa5c3640 1 -- 172.21.15.62:0/3265319139 >> 172.21.15.62:0/3265319139 conn(0x7fe9a40fba40 msgr2=0x7fe9a40fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:43:48.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.067+0000 7fe9aa5c3640 1 -- 172.21.15.62:0/3265319139 shutdown_connections 2024-09-12T02:43:48.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.067+0000 7fe9aa5c3640 1 -- 172.21.15.62:0/3265319139 wait complete. 2024-09-12T02:43:48.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.068+0000 7fe9aa5c3640 1 Processor -- start 2024-09-12T02:43:48.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.068+0000 7fe9aa5c3640 1 -- start start 2024-09-12T02:43:48.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.068+0000 7fe9aa5c3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9a40ffed0 0x7fe9a4197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:48.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.068+0000 7fe9aa5c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9a4102eb0 0x7fe9a4198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:48.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.068+0000 7fe9aa5c3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9a4103870 0x7fe9a419f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:48.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.068+0000 7fe9aa5c3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a410d8b0 con 0x7fe9a4102eb0 2024-09-12T02:43:48.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.068+0000 7fe9aa5c3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a410d730 con 0x7fe9a4103870 2024-09-12T02:43:48.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.068+0000 7fe9aa5c3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a410da30 con 0x7fe9a40ffed0 2024-09-12T02:43:48.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.069+0000 7fe9a8b60640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9a4103870 0x7fe9a419f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:48.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.069+0000 7fe9a8b60640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9a4103870 0x7fe9a419f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41018/0 (socket says 172.21.15.62:41018) 2024-09-12T02:43:48.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.069+0000 7fe9a8b60640 1 -- 172.21.15.62:0/56778656 learned_addr learned my addr 172.21.15.62:0/56778656 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:43:48.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.069+0000 7fe9a3fff640 1 --2- 172.21.15.62:0/56778656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9a40ffed0 0x7fe9a4197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:48.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.069+0000 7fe9a37fe640 1 --2- 172.21.15.62:0/56778656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9a4102eb0 0x7fe9a4198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:48.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.069+0000 7fe9a8b60640 1 -- 172.21.15.62:0/56778656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9a40ffed0 msgr2=0x7fe9a4197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:48.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.069+0000 7fe9a8b60640 1 --2- 172.21.15.62:0/56778656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9a40ffed0 0x7fe9a4197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:48.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.069+0000 7fe9a8b60640 1 -- 172.21.15.62:0/56778656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9a4102eb0 msgr2=0x7fe9a4198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:43:48.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.069+0000 7fe9a8b60640 1 --2- 172.21.15.62:0/56778656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9a4102eb0 0x7fe9a4198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:43:48.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.069+0000 7fe9a8b60640 1 -- 172.21.15.62:0/56778656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a419fb30 con 0x7fe9a4103870 2024-09-12T02:43:48.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.069+0000 7fe9a37fe640 1 --2- 172.21.15.62:0/56778656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9a4102eb0 0x7fe9a4198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:43:48.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.069+0000 7fe9a8b60640 1 --2- 172.21.15.62:0/56778656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9a4103870 0x7fe9a419f4c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe99c006010 tx=0x7fe99c003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:48.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.069+0000 7fe9a17fa640 1 -- 172.21.15.62:0/56778656 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c031710 con 0x7fe9a4103870 2024-09-12T02:43:48.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.069+0000 7fe9a17fa640 1 -- 172.21.15.62:0/56778656 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe99c0318b0 con 0x7fe9a4103870 2024-09-12T02:43:48.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.069+0000 7fe9aa5c3640 1 -- 172.21.15.62:0/56778656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a419fdc0 con 0x7fe9a4103870 2024-09-12T02:43:48.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.069+0000 7fe9a17fa640 1 -- 172.21.15.62:0/56778656 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c030ba0 con 0x7fe9a4103870 2024-09-12T02:43:48.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.069+0000 7fe9aa5c3640 1 -- 172.21.15.62:0/56778656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a41a0270 con 0x7fe9a4103870 2024-09-12T02:43:48.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.070+0000 7fe9aa5c3640 1 -- 172.21.15.62:0/56778656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a4109060 con 0x7fe9a4103870 2024-09-12T02:43:48.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.071+0000 7fe9a17fa640 1 -- 172.21.15.62:0/56778656 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe99c004040 con 0x7fe9a4103870 2024-09-12T02:43:48.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.072+0000 7fe9a17fa640 1 --2- 172.21.15.62:0/56778656 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe98c0a2bb0 0x7fe98c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:43:48.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.072+0000 7fe9a17fa640 1 -- 172.21.15.62:0/56778656 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6261+0+0 (secure 0 0 0) 0x7fe99c0efd30 con 0x7fe9a4103870 2024-09-12T02:43:48.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.072+0000 7fe9a3fff640 1 --2- 172.21.15.62:0/56778656 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe98c0a2bb0 0x7fe98c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:43:48.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.073+0000 7fe9a3fff640 1 --2- 172.21.15.62:0/56778656 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe98c0a2bb0 0x7fe98c0a5070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe9a406a590 tx=0x7fe994005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:43:48.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.076+0000 7fe9a17fa640 1 -- 172.21.15.62:0/56778656 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe99c0bd520 con 0x7fe9a4103870 2024-09-12T02:43:48.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:43:48.269+0000 7fe9aa5c3640 1 -- 172.21.15.62:0/56778656 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe9a4062630 con 0x7fe98c0a2bb0 2024-09-12T02:43:48.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: purged_snaps scrub starts 2024-09-12T02:43:48.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: purged_snaps scrub ok 2024-09-12T02:43:48.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:48.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: osd.9 [v2:172.21.15.18:6826/422514390,v1:172.21.15.18:6827/422514390] boot 2024-09-12T02:43:48.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: osdmap e66: 10 total, 10 up, 10 in 2024-09-12T02:43:48.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:43:48.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:48.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:48.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:48.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:48.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:48.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:48.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:48.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:48.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:48.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:48.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:43:48.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:43:48.535 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: purged_snaps scrub starts 2024-09-12T02:43:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: purged_snaps scrub ok 2024-09-12T02:43:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: osd.9 [v2:172.21.15.18:6826/422514390,v1:172.21.15.18:6827/422514390] boot 2024-09-12T02:43:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: osdmap e66: 10 total, 10 up, 10 in 2024-09-12T02:43:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:43:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:48.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:48.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:48.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:48.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:48.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:48.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:48.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:43:48.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:43:48.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: purged_snaps scrub starts 2024-09-12T02:43:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: purged_snaps scrub ok 2024-09-12T02:43:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:43:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: osd.9 [v2:172.21.15.18:6826/422514390,v1:172.21.15.18:6827/422514390] boot 2024-09-12T02:43:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: osdmap e66: 10 total, 10 up, 10 in 2024-09-12T02:43:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:43:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:43:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:43:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:43:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:43:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:49.704 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:49 smithi062 ceph-mon[35527]: Detected new or changed devices on smithi018 2024-09-12T02:43:49.705 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:49 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-12T02:43:49.705 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:49 smithi062 ceph-mon[35527]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:43:49.705 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:49 smithi062 ceph-mon[35527]: osdmap e67: 10 total, 10 up, 10 in 2024-09-12T02:43:49.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:49 smithi176 ceph-mon[35713]: Detected new or changed devices on smithi018 2024-09-12T02:43:49.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:49 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-12T02:43:49.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:49 smithi176 ceph-mon[35713]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:43:49.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:49 smithi176 ceph-mon[35713]: osdmap e67: 10 total, 10 up, 10 in 2024-09-12T02:43:49.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:49 smithi018 ceph-mon[30616]: Detected new or changed devices on smithi018 2024-09-12T02:43:49.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:49 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-12T02:43:49.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:49 smithi018 ceph-mon[30616]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:43:49.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:49 smithi018 ceph-mon[30616]: osdmap e67: 10 total, 10 up, 10 in 2024-09-12T02:43:50.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:50 smithi176 ceph-mon[35713]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:43:50.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:50 smithi062 ceph-mon[35527]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:43:50.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:50 smithi018 ceph-mon[30616]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:43:51.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:51 smithi176 ceph-mon[35713]: from='client.? 172.21.15.62:0/73864149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1d4ab1f-0ec4-4641-bab0-f39d15857615"}]: dispatch 2024-09-12T02:43:51.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:51 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1d4ab1f-0ec4-4641-bab0-f39d15857615"}]: dispatch 2024-09-12T02:43:51.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:51 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1d4ab1f-0ec4-4641-bab0-f39d15857615"}]': finished 2024-09-12T02:43:51.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:51 smithi176 ceph-mon[35713]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T02:43:51.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:51 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:43:51.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:51 smithi176 ceph-mon[35713]: from='client.? 172.21.15.62:0/799629978' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:43:51.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:51 smithi062 ceph-mon[35527]: from='client.? 172.21.15.62:0/73864149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1d4ab1f-0ec4-4641-bab0-f39d15857615"}]: dispatch 2024-09-12T02:43:51.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:51 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1d4ab1f-0ec4-4641-bab0-f39d15857615"}]: dispatch 2024-09-12T02:43:51.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:51 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1d4ab1f-0ec4-4641-bab0-f39d15857615"}]': finished 2024-09-12T02:43:51.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:51 smithi062 ceph-mon[35527]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T02:43:51.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:51 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:43:51.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:51 smithi062 ceph-mon[35527]: from='client.? 172.21.15.62:0/799629978' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:43:51.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:51 smithi018 ceph-mon[30616]: from='client.? 172.21.15.62:0/73864149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1d4ab1f-0ec4-4641-bab0-f39d15857615"}]: dispatch 2024-09-12T02:43:51.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:51 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1d4ab1f-0ec4-4641-bab0-f39d15857615"}]: dispatch 2024-09-12T02:43:51.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:51 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1d4ab1f-0ec4-4641-bab0-f39d15857615"}]': finished 2024-09-12T02:43:51.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:51 smithi018 ceph-mon[30616]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T02:43:51.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:51 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:43:51.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:51 smithi018 ceph-mon[30616]: from='client.? 172.21.15.62:0/799629978' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:43:52.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:52 smithi176 ceph-mon[35713]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:43:52.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:52 smithi062 ceph-mon[35527]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:43:52.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:52 smithi018 ceph-mon[30616]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:43:54.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:54 smithi176 ceph-mon[35713]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:43:54.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:54 smithi062 ceph-mon[35527]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:43:54.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:54 smithi018 ceph-mon[30616]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:43:56.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:56 smithi176 ceph-mon[35713]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:43:56.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:56 smithi062 ceph-mon[35527]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:43:56.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:56 smithi018 ceph-mon[30616]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:43:58.643 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:58 smithi062 ceph-mon[35527]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:43:58.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:58 smithi176 ceph-mon[35713]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:43:58.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:58 smithi018 ceph-mon[30616]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:43:59.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:59 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:43:59.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:43:59 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:59.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:59 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:43:59.740 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:43:59 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:59.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:59 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:43:59.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:43:59 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:00.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:00 smithi176 ceph-mon[35713]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:00.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:00 smithi176 ceph-mon[35713]: Deploying daemon osd.10 on smithi062 2024-09-12T02:44:00.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:00 smithi062 ceph-mon[35527]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:00.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:00 smithi062 ceph-mon[35527]: Deploying daemon osd.10 on smithi062 2024-09-12T02:44:00.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:00 smithi018 ceph-mon[30616]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:00.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:00 smithi018 ceph-mon[30616]: Deploying daemon osd.10 on smithi062 2024-09-12T02:44:02.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:02 smithi176 ceph-mon[35713]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:02.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:02 smithi062 ceph-mon[35527]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:02.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:02 smithi018 ceph-mon[30616]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:04.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:04 smithi176 ceph-mon[35713]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:04.733 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:04 smithi062 ceph-mon[35527]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:04.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:04 smithi018 ceph-mon[30616]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:05.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:05.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:05.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:05.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:05.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:05.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:05.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:06.714 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:06 smithi018 ceph-mon[30616]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:06.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:06 smithi176 ceph-mon[35713]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:06.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:06 smithi062 ceph-mon[35527]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:08.701 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:08 smithi062 ceph-mon[35527]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:08.702 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:08 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:08.702 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:08 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:08.702 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:08 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:08.702 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:08 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:08.702 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:08 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:08.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:08 smithi176 ceph-mon[35713]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:08.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:08 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:08.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:08 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:08.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:08 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:08.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:08 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:08.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:08 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:08.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:08 smithi018 ceph-mon[30616]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:08.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:08 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:08.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:08 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:08.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:08 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:08.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:08 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:08.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:08 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:08.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:44:08.973+0000 7fe9a17fa640 1 -- 172.21.15.62:0/56778656 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fe9a4062630 con 0x7fe98c0a2bb0 2024-09-12T02:44:08.974 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 10 on host 'smithi062' 2024-09-12T02:44:08.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:44:08.975+0000 7fe9aa5c3640 1 -- 172.21.15.62:0/56778656 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe98c0a2bb0 msgr2=0x7fe98c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:08.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:44:08.975+0000 7fe9aa5c3640 1 --2- 172.21.15.62:0/56778656 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe98c0a2bb0 0x7fe98c0a5070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe9a406a590 tx=0x7fe994005f90 comp rx=0 tx=0).stop 2024-09-12T02:44:08.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:44:08.975+0000 7fe9aa5c3640 1 -- 172.21.15.62:0/56778656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9a4103870 msgr2=0x7fe9a419f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:08.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:44:08.975+0000 7fe9aa5c3640 1 --2- 172.21.15.62:0/56778656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9a4103870 0x7fe9a419f4c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe99c006010 tx=0x7fe99c003f10 comp rx=0 tx=0).stop 2024-09-12T02:44:08.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:44:08.975+0000 7fe9aa5c3640 1 -- 172.21.15.62:0/56778656 shutdown_connections 2024-09-12T02:44:08.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:44:08.975+0000 7fe9aa5c3640 1 --2- 172.21.15.62:0/56778656 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe98c0a2bb0 0x7fe98c0a5070 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:44:08.975+0000 7fe9aa5c3640 1 --2- 172.21.15.62:0/56778656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9a4103870 0x7fe9a419f4c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:44:08.975+0000 7fe9aa5c3640 1 --2- 172.21.15.62:0/56778656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9a4102eb0 0x7fe9a4198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:44:08.975+0000 7fe9aa5c3640 1 --2- 172.21.15.62:0/56778656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9a40ffed0 0x7fe9a4197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:08.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:44:08.975+0000 7fe9aa5c3640 1 -- 172.21.15.62:0/56778656 >> 172.21.15.62:0/56778656 conn(0x7fe9a40fba40 msgr2=0x7fe9a4106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:08.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:44:08.975+0000 7fe9aa5c3640 1 -- 172.21.15.62:0/56778656 shutdown_connections 2024-09-12T02:44:08.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:44:08.975+0000 7fe9aa5c3640 1 -- 172.21.15.62:0/56778656 wait complete. 2024-09-12T02:44:09.644 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:09.644 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:09.644 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:09 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:09.671 DEBUG:teuthology.orchestra.run.smithi062:osd.10> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.10.service 2024-09-12T02:44:09.675 INFO:tasks.cephadm:Deploying osd.11 on smithi176 with /dev/vg_nvme/lv_1... 2024-09-12T02:44:09.676 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:44:09.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:09.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:09.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:09 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:09.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:09.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:09.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:09 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:09.932 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:44:10.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:10 smithi176 ceph-mon[35713]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:10.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:10 smithi062 ceph-mon[35527]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:10.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:10 smithi018 ceph-mon[30616]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:11.473 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 02:44:11 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T02:44:11.445+0000 7f61b619c640 -1 osd.10 0 log_to_monitors true 2024-09-12T02:44:11.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:11 smithi176 ceph-mon[35713]: from='osd.10 [v2:172.21.15.62:6824/269877918,v1:172.21.15.62:6825/269877918]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:44:11.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:11 smithi176 ceph-mon[35713]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:44:11.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:11 smithi062 ceph-mon[35527]: from='osd.10 [v2:172.21.15.62:6824/269877918,v1:172.21.15.62:6825/269877918]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:44:11.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:11 smithi062 ceph-mon[35527]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:44:11.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:11 smithi018 ceph-mon[30616]: from='osd.10 [v2:172.21.15.62:6824/269877918,v1:172.21.15.62:6825/269877918]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:44:11.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:11 smithi018 ceph-mon[30616]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:44:12.592 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:12 smithi176 ceph-mon[35713]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:12.592 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:12 smithi176 ceph-mon[35713]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:44:12.592 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:12 smithi176 ceph-mon[35713]: from='osd.10 [v2:172.21.15.62:6824/269877918,v1:172.21.15.62:6825/269877918]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:44:12.593 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:12 smithi176 ceph-mon[35713]: osdmap e69: 11 total, 10 up, 11 in 2024-09-12T02:44:12.593 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:44:12.593 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:12 smithi176 ceph-mon[35713]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:44:12.595 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T02:44:12.621 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi176:vg_nvme/lv_1 2024-09-12T02:44:12.783 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 02:44:12 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T02:44:12.480+0000 7f61b211f640 -1 osd.10 0 waiting for initial osdmap 2024-09-12T02:44:12.783 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 02:44:12 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T02:44:12.498+0000 7f61adf47640 -1 osd.10 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:44:12.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:12 smithi062 ceph-mon[35527]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:12.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:12 smithi062 ceph-mon[35527]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:44:12.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:12 smithi062 ceph-mon[35527]: from='osd.10 [v2:172.21.15.62:6824/269877918,v1:172.21.15.62:6825/269877918]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:44:12.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:12 smithi062 ceph-mon[35527]: osdmap e69: 11 total, 10 up, 11 in 2024-09-12T02:44:12.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:44:12.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:12 smithi062 ceph-mon[35527]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:44:12.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:12 smithi018 ceph-mon[30616]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:12.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:12 smithi018 ceph-mon[30616]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:44:12.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:12 smithi018 ceph-mon[30616]: from='osd.10 [v2:172.21.15.62:6824/269877918,v1:172.21.15.62:6825/269877918]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:44:12.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:12 smithi018 ceph-mon[30616]: osdmap e69: 11 total, 10 up, 11 in 2024-09-12T02:44:12.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:44:12.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:12 smithi018 ceph-mon[30616]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T02:44:12.873 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:44:13.359 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.355+0000 7f9702901640 1 -- 172.21.15.176:0/1576516219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96fc102690 msgr2=0x7f96fc108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.359 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.355+0000 7f9702901640 1 --2- 172.21.15.176:0/1576516219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96fc102690 0x7f96fc108f20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009ca0 tx=0x7f96f402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.359 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.355+0000 7f9702901640 1 -- 172.21.15.176:0/1576516219 shutdown_connections 2024-09-12T02:44:13.359 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.355+0000 7f9702901640 1 --2- 172.21.15.176:0/1576516219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96fc102690 0x7f96fc108f20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.360 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.355+0000 7f9702901640 1 --2- 172.21.15.176:0/1576516219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96fc101cd0 0x7f96fc102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.360 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.355+0000 7f9702901640 1 --2- 172.21.15.176:0/1576516219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96fc100ad0 0x7f96fc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.360 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.355+0000 7f9702901640 1 -- 172.21.15.176:0/1576516219 >> 172.21.15.176:0/1576516219 conn(0x7f96fc0fc280 msgr2=0x7f96fc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:13.360 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.355+0000 7f9702901640 1 -- 172.21.15.176:0/1576516219 shutdown_connections 2024-09-12T02:44:13.360 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.355+0000 7f9702901640 1 -- 172.21.15.176:0/1576516219 wait complete. 2024-09-12T02:44:13.360 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.356+0000 7f9702901640 1 Processor -- start 2024-09-12T02:44:13.360 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.356+0000 7f9702901640 1 -- start start 2024-09-12T02:44:13.360 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.356+0000 7f9702901640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96fc100ad0 0x7f96fc10b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.360 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.356+0000 7f9702901640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96fc101cd0 0x7f96fc109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.361 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.356+0000 7f9702901640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96fc102690 0x7f96fc109fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.361 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.356+0000 7f9702901640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f96fc10d8c0 con 0x7f96fc101cd0 2024-09-12T02:44:13.361 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.356+0000 7f9702901640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f96fc10d740 con 0x7f96fc100ad0 2024-09-12T02:44:13.361 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.356+0000 7f9702901640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f96fc10da40 con 0x7f96fc102690 2024-09-12T02:44:13.361 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.356+0000 7f9700e9e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96fc102690 0x7f96fc109fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.361 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.356+0000 7f9700e9e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96fc102690 0x7f96fc109fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:34308/0 (socket says 172.21.15.176:34308) 2024-09-12T02:44:13.361 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.356+0000 7f9700e9e640 1 -- 172.21.15.176:0/1590425973 learned_addr learned my addr 172.21.15.176:0/1590425973 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-12T02:44:13.361 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.356+0000 7f96fb7fe640 1 --2- 172.21.15.176:0/1590425973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96fc101cd0 0x7f96fc109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.361 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.356+0000 7f96fbfff640 1 --2- 172.21.15.176:0/1590425973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96fc100ad0 0x7f96fc10b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.361 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.357+0000 7f9700e9e640 1 -- 172.21.15.176:0/1590425973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96fc100ad0 msgr2=0x7f96fc10b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.362 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.357+0000 7f9700e9e640 1 --2- 172.21.15.176:0/1590425973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96fc100ad0 0x7f96fc10b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.362 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.357+0000 7f9700e9e640 1 -- 172.21.15.176:0/1590425973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96fc101cd0 msgr2=0x7f96fc109aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:13.362 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.357+0000 7f9700e9e640 1 --2- 172.21.15.176:0/1590425973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96fc101cd0 0x7f96fc109aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:13.362 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.357+0000 7f9700e9e640 1 -- 172.21.15.176:0/1590425973 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96fc10a8a0 con 0x7f96fc102690 2024-09-12T02:44:13.362 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.357+0000 7f9700e9e640 1 --2- 172.21.15.176:0/1590425973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96fc102690 0x7f96fc109fe0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f96f4005e30 tx=0x7f96f4031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:13.362 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.357+0000 7f96f97fa640 1 -- 172.21.15.176:0/1590425973 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f4003b70 con 0x7f96fc102690 2024-09-12T02:44:13.362 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.357+0000 7f96f97fa640 1 -- 172.21.15.176:0/1590425973 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96f4003d10 con 0x7f96fc102690 2024-09-12T02:44:13.362 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.357+0000 7f9702901640 1 -- 172.21.15.176:0/1590425973 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96fc1a2040 con 0x7f96fc102690 2024-09-12T02:44:13.362 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.357+0000 7f96f97fa640 1 -- 172.21.15.176:0/1590425973 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f402fd30 con 0x7f96fc102690 2024-09-12T02:44:13.362 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.357+0000 7f9702901640 1 -- 172.21.15.176:0/1590425973 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96fc1a25d0 con 0x7f96fc102690 2024-09-12T02:44:13.362 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.358+0000 7f9702901640 1 -- 172.21.15.176:0/1590425973 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96fc100ed0 con 0x7f96fc102690 2024-09-12T02:44:13.363 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.359+0000 7f96f97fa640 1 -- 172.21.15.176:0/1590425973 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f96f4004050 con 0x7f96fc102690 2024-09-12T02:44:13.363 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.360+0000 7f96f97fa640 1 --2- 172.21.15.176:0/1590425973 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f96e80a2b80 0x7f96e80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:13.363 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.360+0000 7f96f97fa640 1 -- 172.21.15.176:0/1590425973 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6414+0+0 (secure 0 0 0) 0x7f96f40efcd0 con 0x7f96fc102690 2024-09-12T02:44:13.364 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.360+0000 7f96fbfff640 1 --2- 172.21.15.176:0/1590425973 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f96e80a2b80 0x7f96e80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:13.364 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.361+0000 7f96fbfff640 1 --2- 172.21.15.176:0/1590425973 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f96e80a2b80 0x7f96e80a5040 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f96fc101b30 tx=0x7f96ec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:13.364 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.364+0000 7f96f97fa640 1 -- 172.21.15.176:0/1590425973 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f96f40bd3a0 con 0x7f96fc102690 2024-09-12T02:44:13.544 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:13.543+0000 7f9702901640 1 -- 172.21.15.176:0/1590425973 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f96fc062630 con 0x7f96e80a2b80 2024-09-12T02:44:13.545 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:13 smithi176 ceph-mon[35713]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T02:44:13.545 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:13 smithi176 ceph-mon[35713]: osdmap e70: 11 total, 10 up, 11 in 2024-09-12T02:44:13.545 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:44:13.545 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:44:13.545 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:13.545 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:13.545 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:13.545 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:13.545 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:13.545 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:13.545 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:13.545 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:13.545 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:13.546 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:13.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:13 smithi062 ceph-mon[35527]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T02:44:13.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:13 smithi062 ceph-mon[35527]: osdmap e70: 11 total, 10 up, 11 in 2024-09-12T02:44:13.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:44:13.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:44:13.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:13.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:13.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:13.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:13.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:13.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:13.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:13.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:13.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:13.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:13.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:13 smithi018 ceph-mon[30616]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T02:44:13.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:13 smithi018 ceph-mon[30616]: osdmap e70: 11 total, 10 up, 11 in 2024-09-12T02:44:13.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:44:13.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:44:13.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:13.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:13.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:13.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:13.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:13.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:13.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:13.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:13.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:13.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:14.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:14 smithi062 ceph-mon[35527]: purged_snaps scrub starts 2024-09-12T02:44:14.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:14 smithi062 ceph-mon[35527]: purged_snaps scrub ok 2024-09-12T02:44:14.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:14 smithi062 ceph-mon[35527]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:14.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:14 smithi062 ceph-mon[35527]: Detected new or changed devices on smithi062 2024-09-12T02:44:14.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:14 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi062 to 4272M 2024-09-12T02:44:14.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:14 smithi062 ceph-mon[35527]: osd.10 [v2:172.21.15.62:6824/269877918,v1:172.21.15.62:6825/269877918] boot 2024-09-12T02:44:14.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:14 smithi062 ceph-mon[35527]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T02:44:14.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:14 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:44:14.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:14 smithi062 ceph-mon[35527]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:44:14.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:14 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:44:14.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:14 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:44:14.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:14 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:14.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:14 smithi018 ceph-mon[30616]: purged_snaps scrub starts 2024-09-12T02:44:14.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:14 smithi018 ceph-mon[30616]: purged_snaps scrub ok 2024-09-12T02:44:14.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:14 smithi018 ceph-mon[30616]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:14.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:14 smithi018 ceph-mon[30616]: Detected new or changed devices on smithi062 2024-09-12T02:44:14.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:14 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi062 to 4272M 2024-09-12T02:44:14.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:14 smithi018 ceph-mon[30616]: osd.10 [v2:172.21.15.62:6824/269877918,v1:172.21.15.62:6825/269877918] boot 2024-09-12T02:44:14.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:14 smithi018 ceph-mon[30616]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T02:44:14.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:14 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:44:14.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:14 smithi018 ceph-mon[30616]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:44:14.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:14 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:44:14.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:14 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:44:14.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:14 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:14.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:14 smithi176 ceph-mon[35713]: purged_snaps scrub starts 2024-09-12T02:44:14.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:14 smithi176 ceph-mon[35713]: purged_snaps scrub ok 2024-09-12T02:44:14.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:14 smithi176 ceph-mon[35713]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:44:14.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:14 smithi176 ceph-mon[35713]: Detected new or changed devices on smithi062 2024-09-12T02:44:14.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:14 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi062 to 4272M 2024-09-12T02:44:14.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:14 smithi176 ceph-mon[35713]: osd.10 [v2:172.21.15.62:6824/269877918,v1:172.21.15.62:6825/269877918] boot 2024-09-12T02:44:14.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:14 smithi176 ceph-mon[35713]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T02:44:14.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:14 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:44:14.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:14 smithi176 ceph-mon[35713]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:44:14.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:14 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:44:14.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:14 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:44:14.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:14 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:15.699 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:15 smithi176 ceph-mon[35713]: osdmap e72: 11 total, 11 up, 11 in 2024-09-12T02:44:15.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:15 smithi062 ceph-mon[35527]: osdmap e72: 11 total, 11 up, 11 in 2024-09-12T02:44:15.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:15 smithi018 ceph-mon[30616]: osdmap e72: 11 total, 11 up, 11 in 2024-09-12T02:44:16.589 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:16 smithi176 ceph-mon[35713]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:16.590 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:16 smithi176 ceph-mon[35713]: osdmap e73: 11 total, 11 up, 11 in 2024-09-12T02:44:16.590 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:16 smithi176 ceph-mon[35713]: from='client.? 172.21.15.176:0/3381352802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d122f1bf-bd4f-45d5-b07c-7301b005977c"}]: dispatch 2024-09-12T02:44:16.590 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:16 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d122f1bf-bd4f-45d5-b07c-7301b005977c"}]: dispatch 2024-09-12T02:44:16.590 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:16 smithi176 ceph-mon[35713]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d122f1bf-bd4f-45d5-b07c-7301b005977c"}]': finished 2024-09-12T02:44:16.590 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:16 smithi176 ceph-mon[35713]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T02:44:16.590 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:16.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:16 smithi062 ceph-mon[35527]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:16.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:16 smithi062 ceph-mon[35527]: osdmap e73: 11 total, 11 up, 11 in 2024-09-12T02:44:16.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:16 smithi062 ceph-mon[35527]: from='client.? 172.21.15.176:0/3381352802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d122f1bf-bd4f-45d5-b07c-7301b005977c"}]: dispatch 2024-09-12T02:44:16.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:16 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d122f1bf-bd4f-45d5-b07c-7301b005977c"}]: dispatch 2024-09-12T02:44:16.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:16 smithi062 ceph-mon[35527]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d122f1bf-bd4f-45d5-b07c-7301b005977c"}]': finished 2024-09-12T02:44:16.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:16 smithi062 ceph-mon[35527]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T02:44:16.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:16.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:16 smithi018 ceph-mon[30616]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:16.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:16 smithi018 ceph-mon[30616]: osdmap e73: 11 total, 11 up, 11 in 2024-09-12T02:44:16.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:16 smithi018 ceph-mon[30616]: from='client.? 172.21.15.176:0/3381352802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d122f1bf-bd4f-45d5-b07c-7301b005977c"}]: dispatch 2024-09-12T02:44:16.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:16 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d122f1bf-bd4f-45d5-b07c-7301b005977c"}]: dispatch 2024-09-12T02:44:16.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:16 smithi018 ceph-mon[30616]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d122f1bf-bd4f-45d5-b07c-7301b005977c"}]': finished 2024-09-12T02:44:16.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:16 smithi018 ceph-mon[30616]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T02:44:16.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:17.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:17 smithi062 ceph-mon[35527]: from='client.? 172.21.15.176:0/892258761' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:44:17.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:17 smithi062 ceph-mon[35527]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T02:44:17.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:17 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:17.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:17 smithi018 ceph-mon[30616]: from='client.? 172.21.15.176:0/892258761' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:44:17.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:17 smithi018 ceph-mon[30616]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T02:44:17.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:17 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:17.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:17 smithi176 ceph-mon[35713]: from='client.? 172.21.15.176:0/892258761' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:44:17.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:17 smithi176 ceph-mon[35713]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T02:44:17.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:17 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:18.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:18 smithi062 ceph-mon[35527]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:18.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:18 smithi062 ceph-mon[35527]: osdmap e76: 12 total, 11 up, 12 in 2024-09-12T02:44:18.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:18 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:18.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:18 smithi018 ceph-mon[30616]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:18.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:18 smithi018 ceph-mon[30616]: osdmap e76: 12 total, 11 up, 12 in 2024-09-12T02:44:18.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:18 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:18.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:18 smithi176 ceph-mon[35713]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:18.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:18 smithi176 ceph-mon[35713]: osdmap e76: 12 total, 11 up, 12 in 2024-09-12T02:44:18.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:18 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:20.781 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:20 smithi176 ceph-mon[35713]: pgmap v250: 1 pgs: 1 peering; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:44:20.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:20 smithi062 ceph-mon[35527]: pgmap v250: 1 pgs: 1 peering; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:44:20.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:20 smithi018 ceph-mon[30616]: pgmap v250: 1 pgs: 1 peering; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:44:22.709 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:22 smithi176 ceph-mon[35713]: pgmap v251: 1 pgs: 1 peering; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-12T02:44:22.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:22 smithi062 ceph-mon[35527]: pgmap v251: 1 pgs: 1 peering; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-12T02:44:22.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:22 smithi018 ceph-mon[30616]: pgmap v251: 1 pgs: 1 peering; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-12T02:44:24.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:24 smithi062 ceph-mon[35527]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-12T02:44:24.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:24 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:44:24.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:24 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:24.813 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:24 smithi176 ceph-mon[35713]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-12T02:44:24.813 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:24 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:44:24.813 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:24 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:24.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:24 smithi018 ceph-mon[30616]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-12T02:44:24.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:24 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:44:24.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:24 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:25.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:25 smithi062 ceph-mon[35527]: Deploying daemon osd.11 on smithi176 2024-09-12T02:44:25.808 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:25 smithi176 ceph-mon[35713]: Deploying daemon osd.11 on smithi176 2024-09-12T02:44:25.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:25 smithi018 ceph-mon[30616]: Deploying daemon osd.11 on smithi176 2024-09-12T02:44:26.778 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:26 smithi018 ceph-mon[30616]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:44:26.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:26 smithi062 ceph-mon[35527]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:44:26.832 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:26 smithi176 ceph-mon[35713]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:44:28.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:28 smithi018 ceph-mon[30616]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-12T02:44:28.726 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:28 smithi176 ceph-mon[35713]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-12T02:44:28.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:28 smithi062 ceph-mon[35527]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-12T02:44:30.714 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:30 smithi176 ceph-mon[35713]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:30.714 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:30 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:30.715 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:30 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:30.715 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:30 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:30.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:30 smithi018 ceph-mon[30616]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:30.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:30 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:30.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:30 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:30.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:30 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:30.854 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:30 smithi062 ceph-mon[35527]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:30.854 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:30 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:30.854 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:30 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:30.854 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:30 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:32.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:32 smithi176 ceph-mon[35713]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:32.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:32 smithi018 ceph-mon[30616]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:33.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:32 smithi062 ceph-mon[35527]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:33.472 INFO:teuthology.orchestra.run.smithi176.stdout:Created osd(s) 11 on host 'smithi176' 2024-09-12T02:44:33.472 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:33.471+0000 7f96f97fa640 1 -- 172.21.15.176:0/1590425973 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f96fc062630 con 0x7f96e80a2b80 2024-09-12T02:44:33.474 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:33.473+0000 7f9702901640 1 -- 172.21.15.176:0/1590425973 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f96e80a2b80 msgr2=0x7f96e80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:33.474 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:33.473+0000 7f9702901640 1 --2- 172.21.15.176:0/1590425973 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f96e80a2b80 0x7f96e80a5040 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f96fc101b30 tx=0x7f96ec00b390 comp rx=0 tx=0).stop 2024-09-12T02:44:33.474 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:33.473+0000 7f9702901640 1 -- 172.21.15.176:0/1590425973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96fc102690 msgr2=0x7f96fc109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:33.474 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:33.473+0000 7f9702901640 1 --2- 172.21.15.176:0/1590425973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96fc102690 0x7f96fc109fe0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f96f4005e30 tx=0x7f96f4031ee0 comp rx=0 tx=0).stop 2024-09-12T02:44:33.475 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:33.473+0000 7f9702901640 1 -- 172.21.15.176:0/1590425973 shutdown_connections 2024-09-12T02:44:33.475 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:33.473+0000 7f9702901640 1 --2- 172.21.15.176:0/1590425973 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f96e80a2b80 0x7f96e80a5040 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:33.475 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:33.473+0000 7f9702901640 1 --2- 172.21.15.176:0/1590425973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96fc102690 0x7f96fc109fe0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:33.475 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:33.473+0000 7f9702901640 1 --2- 172.21.15.176:0/1590425973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96fc101cd0 0x7f96fc109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:33.475 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:33.473+0000 7f9702901640 1 --2- 172.21.15.176:0/1590425973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96fc100ad0 0x7f96fc10b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:33.475 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:33.473+0000 7f9702901640 1 -- 172.21.15.176:0/1590425973 >> 172.21.15.176:0/1590425973 conn(0x7f96fc0fc280 msgr2=0x7f96fc105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:33.475 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:33.474+0000 7f9702901640 1 -- 172.21.15.176:0/1590425973 shutdown_connections 2024-09-12T02:44:33.475 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:33.474+0000 7f9702901640 1 -- 172.21.15.176:0/1590425973 wait complete. 2024-09-12T02:44:34.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:33 smithi062 ceph-mon[35527]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:34.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:33 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:34.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:33 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:34.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:33 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:34.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:33 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:34.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:33 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:34.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:33 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:34.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:33 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:34.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:33 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:34.067 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:33 smithi176 ceph-mon[35713]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:34.067 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:33 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:34.067 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:33 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:34.067 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:33 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:34.067 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:33 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:34.067 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:33 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:34.068 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:33 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:34.068 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:33 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:34.068 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:33 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:34.098 DEBUG:teuthology.orchestra.run.smithi176:osd.11> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.11.service 2024-09-12T02:44:34.100 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-12T02:44:34.100 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T02:44:34.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:33 smithi018 ceph-mon[30616]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:34.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:33 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:34.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:33 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:34.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:33 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:34.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:33 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:34.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:33 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:34.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:33 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:34.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:33 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:34.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:33 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:34.489 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.194+0000 7f987aa00640 1 -- 172.21.15.18:0/1760816841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98741037c0 msgr2=0x7f987410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.194+0000 7f987aa00640 1 --2- 172.21.15.18:0/1760816841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98741037c0 0x7f987410a050 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f986c009ca0 tx=0x7f986c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:44:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.194+0000 7f987aa00640 1 -- 172.21.15.18:0/1760816841 shutdown_connections 2024-09-12T02:44:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.194+0000 7f987aa00640 1 --2- 172.21.15.18:0/1760816841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98741037c0 0x7f987410a050 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.194+0000 7f987aa00640 1 --2- 172.21.15.18:0/1760816841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9874102e00 0x7f9874103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.194+0000 7f987aa00640 1 --2- 172.21.15.18:0/1760816841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9874101c00 0x7f9874102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.194+0000 7f987aa00640 1 -- 172.21.15.18:0/1760816841 >> 172.21.15.18:0/1760816841 conn(0x7f98740fd390 msgr2=0x7f98740ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.194+0000 7f987aa00640 1 -- 172.21.15.18:0/1760816841 shutdown_connections 2024-09-12T02:44:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.194+0000 7f987aa00640 1 -- 172.21.15.18:0/1760816841 wait complete. 2024-09-12T02:44:35.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.195+0000 7f987aa00640 1 Processor -- start 2024-09-12T02:44:35.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.196+0000 7f987aa00640 1 -- start start 2024-09-12T02:44:35.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.196+0000 7f987aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9874101c00 0x7f987419a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:35.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.196+0000 7f987aa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9874102e00 0x7f987419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:35.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.196+0000 7f987aa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98741037c0 0x7f98741a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:35.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.196+0000 7f987aa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f987410d8b0 con 0x7f9874101c00 2024-09-12T02:44:35.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.196+0000 7f987aa00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f987410d730 con 0x7f9874102e00 2024-09-12T02:44:35.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.196+0000 7f987aa00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f987410da30 con 0x7f98741037c0 2024-09-12T02:44:35.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.196+0000 7f9873e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9874101c00 0x7f987419a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:35.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.196+0000 7f9873400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9874102e00 0x7f987419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:35.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.196+0000 7f9878a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98741037c0 0x7f98741a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.196+0000 7f9873400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9874102e00 0x7f987419a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:49298/0 (socket says 172.21.15.18:49298) 2024-09-12T02:44:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.196+0000 7f9873400640 1 -- 172.21.15.18:0/1390230253 learned_addr learned my addr 172.21.15.18:0/1390230253 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:44:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.196+0000 7f9873e00640 1 --2- 172.21.15.18:0/1390230253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9874101c00 0x7f987419a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36318/0 (socket says 172.21.15.18:36318) 2024-09-12T02:44:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.197+0000 7f9878a00640 1 -- 172.21.15.18:0/1390230253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9874102e00 msgr2=0x7f987419a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.197+0000 7f9878a00640 1 --2- 172.21.15.18:0/1390230253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9874102e00 0x7f987419a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.197+0000 7f9878a00640 1 -- 172.21.15.18:0/1390230253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9874101c00 msgr2=0x7f987419a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.197+0000 7f9878a00640 1 --2- 172.21.15.18:0/1390230253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9874101c00 0x7f987419a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.197+0000 7f9878a00640 1 -- 172.21.15.18:0/1390230253 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98741a1ca0 con 0x7f98741037c0 2024-09-12T02:44:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.197+0000 7f9873400640 1 --2- 172.21.15.18:0/1390230253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9874102e00 0x7f987419a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:44:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.197+0000 7f9873e00640 1 --2- 172.21.15.18:0/1390230253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9874101c00 0x7f987419a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:44:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.197+0000 7f9878a00640 1 --2- 172.21.15.18:0/1390230253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98741037c0 0x7f98741a1630 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f986c031ae0 tx=0x7f986c031750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.197+0000 7f9870c00640 1 -- 172.21.15.18:0/1390230253 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c003b70 con 0x7f98741037c0 2024-09-12T02:44:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.197+0000 7f9870c00640 1 -- 172.21.15.18:0/1390230253 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f986c003d10 con 0x7f98741037c0 2024-09-12T02:44:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.197+0000 7f987aa00640 1 -- 172.21.15.18:0/1390230253 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98741a1f30 con 0x7f98741037c0 2024-09-12T02:44:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.197+0000 7f9870c00640 1 -- 172.21.15.18:0/1390230253 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c02fb10 con 0x7f98741037c0 2024-09-12T02:44:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.197+0000 7f987aa00640 1 -- 172.21.15.18:0/1390230253 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98741a23e0 con 0x7f98741037c0 2024-09-12T02:44:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.198+0000 7f987aa00640 1 -- 172.21.15.18:0/1390230253 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98741a2640 con 0x7f98741037c0 2024-09-12T02:44:35.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.200+0000 7f9870c00640 1 -- 172.21.15.18:0/1390230253 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f986c02fcb0 con 0x7f98741037c0 2024-09-12T02:44:35.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.201+0000 7f9870c00640 1 --2- 172.21.15.18:0/1390230253 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f98580a2bb0 0x7f98580a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:35.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.201+0000 7f9870c00640 1 -- 172.21.15.18:0/1390230253 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6809+0+0 (secure 0 0 0) 0x7f986c0efd90 con 0x7f98741037c0 2024-09-12T02:44:35.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.202+0000 7f9873e00640 1 --2- 172.21.15.18:0/1390230253 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f98580a2bb0 0x7f98580a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:35.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.202+0000 7f9873e00640 1 --2- 172.21.15.18:0/1390230253 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f98580a2bb0 0x7f98580a5070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9874102c60 tx=0x7f9864005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.205+0000 7f9870c00640 1 -- 172.21.15.18:0/1390230253 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f986c0bd230 con 0x7f98741037c0 2024-09-12T02:44:35.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.395+0000 7f987aa00640 1 -- 172.21.15.18:0/1390230253 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f98741a29d0 con 0x7f98741037c0 2024-09-12T02:44:35.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.396+0000 7f9870c00640 1 -- 172.21.15.18:0/1390230253 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7f986c0bcb30 con 0x7f98741037c0 2024-09-12T02:44:35.398 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:44:35.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.398+0000 7f987aa00640 1 -- 172.21.15.18:0/1390230253 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f98580a2bb0 msgr2=0x7f98580a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:35.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.398+0000 7f987aa00640 1 --2- 172.21.15.18:0/1390230253 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f98580a2bb0 0x7f98580a5070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9874102c60 tx=0x7f9864005f90 comp rx=0 tx=0).stop 2024-09-12T02:44:35.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.398+0000 7f987aa00640 1 -- 172.21.15.18:0/1390230253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98741037c0 msgr2=0x7f98741a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:35.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.398+0000 7f987aa00640 1 --2- 172.21.15.18:0/1390230253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98741037c0 0x7f98741a1630 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f986c031ae0 tx=0x7f986c031750 comp rx=0 tx=0).stop 2024-09-12T02:44:35.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.398+0000 7f987aa00640 1 -- 172.21.15.18:0/1390230253 shutdown_connections 2024-09-12T02:44:35.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.398+0000 7f987aa00640 1 --2- 172.21.15.18:0/1390230253 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f98580a2bb0 0x7f98580a5070 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:35.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.398+0000 7f987aa00640 1 --2- 172.21.15.18:0/1390230253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98741037c0 0x7f98741a1630 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:35.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.398+0000 7f987aa00640 1 --2- 172.21.15.18:0/1390230253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9874102e00 0x7f987419a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:35.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.398+0000 7f987aa00640 1 --2- 172.21.15.18:0/1390230253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9874101c00 0x7f987419a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:35.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.398+0000 7f987aa00640 1 -- 172.21.15.18:0/1390230253 >> 172.21.15.18:0/1390230253 conn(0x7f98740fd390 msgr2=0x7f9874074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:35.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.398+0000 7f987aa00640 1 -- 172.21.15.18:0/1390230253 shutdown_connections 2024-09-12T02:44:35.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:35.398+0000 7f987aa00640 1 -- 172.21.15.18:0/1390230253 wait complete. 2024-09-12T02:44:35.410 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 02:44:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T02:44:35.312+0000 7f861d81e640 -1 osd.11 0 log_to_monitors true 2024-09-12T02:44:36.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:35 smithi062 ceph-mon[35527]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:36.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:35 smithi062 ceph-mon[35527]: from='osd.11 [v2:172.21.15.176:6824/770358485,v1:172.21.15.176:6825/770358485]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:44:36.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:35 smithi062 ceph-mon[35527]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:44:36.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:35 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1390230253' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:44:36.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:35 smithi018 ceph-mon[30616]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:36.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:35 smithi018 ceph-mon[30616]: from='osd.11 [v2:172.21.15.176:6824/770358485,v1:172.21.15.176:6825/770358485]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:44:36.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:35 smithi018 ceph-mon[30616]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:44:36.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:35 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1390230253' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:44:36.104 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:35 smithi176 ceph-mon[35713]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:36.104 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:35 smithi176 ceph-mon[35713]: from='osd.11 [v2:172.21.15.176:6824/770358485,v1:172.21.15.176:6825/770358485]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:44:36.104 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:35 smithi176 ceph-mon[35713]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:44:36.104 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:35 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1390230253' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:44:36.348 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":76,"num_osds":12,"num_up_osds":11,"osd_up_since":1726109053,"num_in_osds":12,"osd_in_since":1726109056,"num_remapped_pgs":0} 2024-09-12T02:44:37.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:36 smithi062 ceph-mon[35527]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:44:37.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:36 smithi062 ceph-mon[35527]: osdmap e77: 12 total, 11 up, 12 in 2024-09-12T02:44:37.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:36 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:37.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:36 smithi062 ceph-mon[35527]: from='osd.11 [v2:172.21.15.176:6824/770358485,v1:172.21.15.176:6825/770358485]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:44:37.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:36 smithi062 ceph-mon[35527]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:44:37.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:36 smithi018 ceph-mon[30616]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:44:37.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:36 smithi018 ceph-mon[30616]: osdmap e77: 12 total, 11 up, 12 in 2024-09-12T02:44:37.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:36 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:37.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:36 smithi018 ceph-mon[30616]: from='osd.11 [v2:172.21.15.176:6824/770358485,v1:172.21.15.176:6825/770358485]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:44:37.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:36 smithi018 ceph-mon[30616]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:44:37.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:36 smithi176 ceph-mon[35713]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:44:37.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:36 smithi176 ceph-mon[35713]: osdmap e77: 12 total, 11 up, 12 in 2024-09-12T02:44:37.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:36 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:37.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:36 smithi176 ceph-mon[35713]: from='osd.11 [v2:172.21.15.176:6824/770358485,v1:172.21.15.176:6825/770358485]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:44:37.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:36 smithi176 ceph-mon[35713]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-12T02:44:37.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 02:44:36 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T02:44:36.760+0000 7f86197a1640 -1 osd.11 0 waiting for initial osdmap 2024-09-12T02:44:37.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 02:44:36 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T02:44:36.772+0000 7f86155c9640 -1 osd.11 78 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:44:37.350 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T02:44:37.732 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:38.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:37 smithi062 ceph-mon[35527]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:38.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:37 smithi062 ceph-mon[35527]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-12T02:44:38.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:37 smithi062 ceph-mon[35527]: osdmap e78: 12 total, 11 up, 12 in 2024-09-12T02:44:38.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:38.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:38.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:37 smithi062 ceph-mon[35527]: Detected new or changed devices on smithi176 2024-09-12T02:44:38.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:38.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:38.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:38.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:38.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:38.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:38.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:37 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi176 to 4272M 2024-09-12T02:44:38.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:38.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:38.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:38.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:38.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:37 smithi018 ceph-mon[30616]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:38.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:37 smithi018 ceph-mon[30616]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-12T02:44:38.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:37 smithi018 ceph-mon[30616]: osdmap e78: 12 total, 11 up, 12 in 2024-09-12T02:44:38.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:38.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:38.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:37 smithi018 ceph-mon[30616]: Detected new or changed devices on smithi176 2024-09-12T02:44:38.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:38.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:37 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi176 to 4272M 2024-09-12T02:44:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:37 smithi176 ceph-mon[35713]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:37 smithi176 ceph-mon[35713]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-12T02:44:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:37 smithi176 ceph-mon[35713]: osdmap e78: 12 total, 11 up, 12 in 2024-09-12T02:44:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:37 smithi176 ceph-mon[35713]: Detected new or changed devices on smithi176 2024-09-12T02:44:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:38.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:38.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:38.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:44:38.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:37 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi176 to 4272M 2024-09-12T02:44:38.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:38.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:38.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:38.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:38.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.367+0000 7ff88a200640 1 -- 172.21.15.18:0/3867559862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff884103e00 msgr2=0x7ff884104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:38.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.367+0000 7ff88a200640 1 --2- 172.21.15.18:0/3867559862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff884103e00 0x7ff884104200 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff874009900 tx=0x7ff87402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:44:38.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.368+0000 7ff88a200640 1 -- 172.21.15.18:0/3867559862 shutdown_connections 2024-09-12T02:44:38.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.368+0000 7ff88a200640 1 --2- 172.21.15.18:0/3867559862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884105920 0x7ff88410c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:38.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.368+0000 7ff88a200640 1 --2- 172.21.15.18:0/3867559862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff884104f60 0x7ff8841053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:38.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.368+0000 7ff88a200640 1 --2- 172.21.15.18:0/3867559862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff884103e00 0x7ff884104200 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:38.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.368+0000 7ff88a200640 1 -- 172.21.15.18:0/3867559862 >> 172.21.15.18:0/3867559862 conn(0x7ff8840ff5b0 msgr2=0x7ff8841019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:38.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.368+0000 7ff88a200640 1 -- 172.21.15.18:0/3867559862 shutdown_connections 2024-09-12T02:44:38.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.368+0000 7ff88a200640 1 -- 172.21.15.18:0/3867559862 wait complete. 2024-09-12T02:44:38.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.369+0000 7ff88a200640 1 Processor -- start 2024-09-12T02:44:38.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.369+0000 7ff88a200640 1 -- start start 2024-09-12T02:44:38.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.369+0000 7ff88a200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff884103e00 0x7ff88419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:38.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.369+0000 7ff88a200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884104f60 0x7ff88419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:38.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.369+0000 7ff88a200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff884105920 0x7ff8841a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:38.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.369+0000 7ff88a200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff88410fab0 con 0x7ff884104f60 2024-09-12T02:44:38.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.369+0000 7ff88a200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff88410f930 con 0x7ff884103e00 2024-09-12T02:44:38.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.369+0000 7ff88a200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff88410fc30 con 0x7ff884105920 2024-09-12T02:44:38.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.369+0000 7ff882a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884104f60 0x7ff88419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:38.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.370+0000 7ff882a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884104f60 0x7ff88419a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36334/0 (socket says 172.21.15.18:36334) 2024-09-12T02:44:38.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.370+0000 7ff882a00640 1 -- 172.21.15.18:0/646410644 learned_addr learned my addr 172.21.15.18:0/646410644 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:44:38.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.370+0000 7ff883400640 1 --2- 172.21.15.18:0/646410644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff884103e00 0x7ff88419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:38.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.370+0000 7ff883e00640 1 --2- 172.21.15.18:0/646410644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff884105920 0x7ff8841a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:38.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.370+0000 7ff882a00640 1 -- 172.21.15.18:0/646410644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff884105920 msgr2=0x7ff8841a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:38.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.370+0000 7ff882a00640 1 --2- 172.21.15.18:0/646410644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff884105920 0x7ff8841a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:38.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.370+0000 7ff882a00640 1 -- 172.21.15.18:0/646410644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff884103e00 msgr2=0x7ff88419a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:38.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.370+0000 7ff882a00640 1 --2- 172.21.15.18:0/646410644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff884103e00 0x7ff88419a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:38.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.370+0000 7ff882a00640 1 -- 172.21.15.18:0/646410644 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8841a1d50 con 0x7ff884104f60 2024-09-12T02:44:38.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.370+0000 7ff883400640 1 --2- 172.21.15.18:0/646410644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff884103e00 0x7ff88419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:44:38.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.370+0000 7ff882a00640 1 --2- 172.21.15.18:0/646410644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884104f60 0x7ff88419a660 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff87000e9c0 tx=0x7ff87000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:38.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.371+0000 7ff87be00640 1 -- 172.21.15.18:0/646410644 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87000ccc0 con 0x7ff884104f60 2024-09-12T02:44:38.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.371+0000 7ff87be00640 1 -- 172.21.15.18:0/646410644 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8700035f0 con 0x7ff884104f60 2024-09-12T02:44:38.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.371+0000 7ff88a200640 1 -- 172.21.15.18:0/646410644 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8841a1fe0 con 0x7ff884104f60 2024-09-12T02:44:38.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.371+0000 7ff87be00640 1 -- 172.21.15.18:0/646410644 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87000ce60 con 0x7ff884104f60 2024-09-12T02:44:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.371+0000 7ff88a200640 1 -- 172.21.15.18:0/646410644 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8841a24f0 con 0x7ff884104f60 2024-09-12T02:44:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.372+0000 7ff88a200640 1 -- 172.21.15.18:0/646410644 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff88410b1f0 con 0x7ff884104f60 2024-09-12T02:44:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.374+0000 7ff87be00640 1 -- 172.21.15.18:0/646410644 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff8700037a0 con 0x7ff884104f60 2024-09-12T02:44:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.376+0000 7ff87be00640 1 --2- 172.21.15.18:0/646410644 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff8680a2c30 0x7ff8680a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.376+0000 7ff87be00640 1 -- 172.21.15.18:0/646410644 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7ff8700ceef0 con 0x7ff884104f60 2024-09-12T02:44:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.376+0000 7ff883400640 1 --2- 172.21.15.18:0/646410644 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff8680a2c30 0x7ff8680a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.377+0000 7ff883400640 1 --2- 172.21.15.18:0/646410644 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff8680a2c30 0x7ff8680a50f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff8740314e0 tx=0x7ff874000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.380+0000 7ff87be00640 1 -- 172.21.15.18:0/646410644 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff87009c250 con 0x7ff884104f60 2024-09-12T02:44:38.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.567+0000 7ff88a200640 1 -- 172.21.15.18:0/646410644 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff884062e90 con 0x7ff884104f60 2024-09-12T02:44:38.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.567+0000 7ff87be00640 1 -- 172.21.15.18:0/646410644 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) ==== 74+0+133 (secure 0 0 0) 0x7ff87009bb50 con 0x7ff884104f60 2024-09-12T02:44:38.569 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:44:38.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.570+0000 7ff88a200640 1 -- 172.21.15.18:0/646410644 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff8680a2c30 msgr2=0x7ff8680a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:38.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.570+0000 7ff88a200640 1 --2- 172.21.15.18:0/646410644 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff8680a2c30 0x7ff8680a50f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff8740314e0 tx=0x7ff874000bc0 comp rx=0 tx=0).stop 2024-09-12T02:44:38.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.570+0000 7ff88a200640 1 -- 172.21.15.18:0/646410644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884104f60 msgr2=0x7ff88419a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:38.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.570+0000 7ff88a200640 1 --2- 172.21.15.18:0/646410644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884104f60 0x7ff88419a660 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff87000e9c0 tx=0x7ff87000edc0 comp rx=0 tx=0).stop 2024-09-12T02:44:38.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.570+0000 7ff88a200640 1 -- 172.21.15.18:0/646410644 shutdown_connections 2024-09-12T02:44:38.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.570+0000 7ff88a200640 1 --2- 172.21.15.18:0/646410644 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff8680a2c30 0x7ff8680a50f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:38.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.570+0000 7ff88a200640 1 --2- 172.21.15.18:0/646410644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff884105920 0x7ff8841a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.570+0000 7ff88a200640 1 --2- 172.21.15.18:0/646410644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884104f60 0x7ff88419a660 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.570+0000 7ff88a200640 1 --2- 172.21.15.18:0/646410644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff884103e00 0x7ff88419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.570+0000 7ff88a200640 1 -- 172.21.15.18:0/646410644 >> 172.21.15.18:0/646410644 conn(0x7ff8840ff5b0 msgr2=0x7ff8841083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.570+0000 7ff88a200640 1 -- 172.21.15.18:0/646410644 shutdown_connections 2024-09-12T02:44:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:38.570+0000 7ff88a200640 1 -- 172.21.15.18:0/646410644 wait complete. 2024-09-12T02:44:39.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:38 smithi062 ceph-mon[35527]: purged_snaps scrub starts 2024-09-12T02:44:39.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:38 smithi062 ceph-mon[35527]: purged_snaps scrub ok 2024-09-12T02:44:39.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:38 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:39.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:38 smithi062 ceph-mon[35527]: osd.11 [v2:172.21.15.176:6824/770358485,v1:172.21.15.176:6825/770358485] boot 2024-09-12T02:44:39.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:38 smithi062 ceph-mon[35527]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:44:39.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:38 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:39.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:38 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/646410644' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:44:39.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:38 smithi018 ceph-mon[30616]: purged_snaps scrub starts 2024-09-12T02:44:39.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:38 smithi018 ceph-mon[30616]: purged_snaps scrub ok 2024-09-12T02:44:39.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:38 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:39.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:38 smithi018 ceph-mon[30616]: osd.11 [v2:172.21.15.176:6824/770358485,v1:172.21.15.176:6825/770358485] boot 2024-09-12T02:44:39.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:38 smithi018 ceph-mon[30616]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:44:39.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:38 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:39.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:38 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/646410644' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:44:39.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:38 smithi176 ceph-mon[35713]: purged_snaps scrub starts 2024-09-12T02:44:39.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:38 smithi176 ceph-mon[35713]: purged_snaps scrub ok 2024-09-12T02:44:39.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:38 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:39.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:38 smithi176 ceph-mon[35713]: osd.11 [v2:172.21.15.176:6824/770358485,v1:172.21.15.176:6825/770358485] boot 2024-09-12T02:44:39.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:38 smithi176 ceph-mon[35713]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:44:39.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:38 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:44:39.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:38 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/646410644' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:44:39.651 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":79,"num_osds":12,"num_up_osds":12,"osd_up_since":1726109077,"num_in_osds":12,"osd_in_since":1726109056,"num_remapped_pgs":0} 2024-09-12T02:44:39.652 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:44:40.026 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:40.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:39 smithi018 ceph-mon[30616]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:40.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:39 smithi018 ceph-mon[30616]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:44:40.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:39 smithi176 ceph-mon[35713]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:40.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:39 smithi176 ceph-mon[35713]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:44:40.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:39 smithi062 ceph-mon[35527]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:44:40.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:39 smithi062 ceph-mon[35527]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:44:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.651+0000 7f73db000640 1 -- 172.21.15.18:0/908936079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73d4102360 msgr2=0x7f73d410e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.651+0000 7f73db000640 1 --2- 172.21.15.18:0/908936079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73d4102360 0x7f73d410e890 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f73cc009cd0 tx=0x7f73cc02a8e0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.651+0000 7f73db000640 1 -- 172.21.15.18:0/908936079 shutdown_connections 2024-09-12T02:44:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.651+0000 7f73db000640 1 --2- 172.21.15.18:0/908936079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73d4102360 0x7f73d410e890 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.651+0000 7f73db000640 1 --2- 172.21.15.18:0/908936079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73d41019c0 0x7f73d4101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.651+0000 7f73db000640 1 --2- 172.21.15.18:0/908936079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d41079c0 0x7f73d4107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.651+0000 7f73db000640 1 -- 172.21.15.18:0/908936079 >> 172.21.15.18:0/908936079 conn(0x7f73d40fd740 msgr2=0x7f73d40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.651+0000 7f73db000640 1 -- 172.21.15.18:0/908936079 shutdown_connections 2024-09-12T02:44:40.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.651+0000 7f73db000640 1 -- 172.21.15.18:0/908936079 wait complete. 2024-09-12T02:44:40.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.652+0000 7f73db000640 1 Processor -- start 2024-09-12T02:44:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.652+0000 7f73db000640 1 -- start start 2024-09-12T02:44:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.652+0000 7f73db000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d41019c0 0x7f73d419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.652+0000 7f73db000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73d4102360 0x7f73d419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.653+0000 7f73db000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73d41079c0 0x7f73d419ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.653+0000 7f73db000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f73d4111e10 con 0x7f73d41079c0 2024-09-12T02:44:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.653+0000 7f73db000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f73d4111c90 con 0x7f73d41019c0 2024-09-12T02:44:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.653+0000 7f73db000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f73d4111f90 con 0x7f73d4102360 2024-09-12T02:44:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.653+0000 7f73d9c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d41019c0 0x7f73d419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.653+0000 7f73d9c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d41019c0 0x7f73d419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:49328/0 (socket says 172.21.15.18:49328) 2024-09-12T02:44:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.653+0000 7f73d9c00640 1 -- 172.21.15.18:0/679194384 learned_addr learned my addr 172.21.15.18:0/679194384 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:44:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.653+0000 7f73da600640 1 --2- 172.21.15.18:0/679194384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73d41079c0 0x7f73d419ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.653+0000 7f73d9200640 1 --2- 172.21.15.18:0/679194384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73d4102360 0x7f73d419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.653+0000 7f73d9c00640 1 -- 172.21.15.18:0/679194384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73d4102360 msgr2=0x7f73d419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.653+0000 7f73d9c00640 1 --2- 172.21.15.18:0/679194384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73d4102360 0x7f73d419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.653+0000 7f73d9c00640 1 -- 172.21.15.18:0/679194384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73d41079c0 msgr2=0x7f73d419ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.653+0000 7f73d9c00640 1 --2- 172.21.15.18:0/679194384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73d41079c0 0x7f73d419ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.653+0000 7f73d9c00640 1 -- 172.21.15.18:0/679194384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d419f430 con 0x7f73d41019c0 2024-09-12T02:44:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.653+0000 7f73d9200640 1 --2- 172.21.15.18:0/679194384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73d4102360 0x7f73d419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:44:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.654+0000 7f73d9c00640 1 --2- 172.21.15.18:0/679194384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d41019c0 0x7f73d419a480 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f73c800e9f0 tx=0x7f73c800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.654+0000 7f73d2000640 1 -- 172.21.15.18:0/679194384 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c800cd80 con 0x7f73d41019c0 2024-09-12T02:44:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.654+0000 7f73d2000640 1 -- 172.21.15.18:0/679194384 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73c8010910 con 0x7f73d41019c0 2024-09-12T02:44:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.654+0000 7f73db000640 1 -- 172.21.15.18:0/679194384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73d419f720 con 0x7f73d41019c0 2024-09-12T02:44:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.654+0000 7f73d2000640 1 -- 172.21.15.18:0/679194384 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c80188f0 con 0x7f73d41019c0 2024-09-12T02:44:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.654+0000 7f73db000640 1 -- 172.21.15.18:0/679194384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73d41a7000 con 0x7f73d41019c0 2024-09-12T02:44:40.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.655+0000 7f73db000640 1 -- 172.21.15.18:0/679194384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73d4101e20 con 0x7f73d41019c0 2024-09-12T02:44:40.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.657+0000 7f73d2000640 1 -- 172.21.15.18:0/679194384 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f73c8010ac0 con 0x7f73d41019c0 2024-09-12T02:44:40.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.658+0000 7f73d2000640 1 --2- 172.21.15.18:0/679194384 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f73bc0a2b80 0x7f73bc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:40.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.659+0000 7f73d2000640 1 -- 172.21.15.18:0/679194384 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7f73c80cf400 con 0x7f73d41019c0 2024-09-12T02:44:40.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.659+0000 7f73d9200640 1 --2- 172.21.15.18:0/679194384 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f73bc0a2b80 0x7f73bc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:40.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.659+0000 7f73d9200640 1 --2- 172.21.15.18:0/679194384 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f73bc0a2b80 0x7f73bc0a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f73d410ecb0 tx=0x7f73c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:40.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.661+0000 7f73d2000640 1 -- 172.21.15.18:0/679194384 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73c809c760 con 0x7f73d41019c0 2024-09-12T02:44:40.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.848+0000 7f73db000640 1 -- 172.21.15.18:0/679194384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73d41a72a0 con 0x7f73d41019c0 2024-09-12T02:44:40.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.849+0000 7f73d2000640 1 -- 172.21.15.18:0/679194384 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+18384 (secure 0 0 0) 0x7f73c809c060 con 0x7f73d41019c0 2024-09-12T02:44:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:44:40.851 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":80,"fsid":"c7666100-70af-11ef-bcea-c7b262605968","created":"2024-09-12T02:37:14.139566+0000","modified":"2024-09-12T02:44:38.776795+0000","last_up_change":"2024-09-12T02:44:37.774835+0000","last_in_change":"2024-09-12T02:44:16.028970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:40:35.157621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a61ecdc1-ceb9-43cb-a67d-b197888cca42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6803","nonce":2278662522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6805","nonce":2278662522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6809","nonce":2278662522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6807","nonce":2278662522}]},"public_addr":"172.21.15.18:6803/2278662522","cluster_addr":"172.21.15.18:6805/2278662522","heartbeat_back_addr":"172.21.15.18:6809/2278662522","heartbeat_front_addr":"172.21.15.18:6807/2278662522","state":["exists","up"]},{"osd":1,"uuid":"1b84f4be-23ce-466c-b974-b9851521785d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6801","nonce":3139630617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6803","nonce":3139630617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6807","nonce":3139630617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6805","nonce":3139630617}]},"public_addr":"172.21.15.62:6801/3139630617","cluster_addr":"172.21.15.62:6803/3139630617","heartbeat_back_addr":"172.21.15.62:6807/3139630617","heartbeat_front_addr":"172.21.15.62:6805/3139630617","state":["exists","up"]},{"osd":2,"uuid":"f7bdf028-db32-4d92-a039-bada37c3a146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6801","nonce":2704054654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6803","nonce":2704054654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6807","nonce":2704054654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6805","nonce":2704054654}]},"public_addr":"172.21.15.176:6801/2704054654","cluster_addr":"172.21.15.176:6803/2704054654","heartbeat_back_addr":"172.21.15.176:6807/2704054654","heartbeat_front_addr":"172.21.15.176:6805/2704054654","state":["exists","up"]},{"osd":3,"uuid":"39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6811","nonce":3378134261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6813","nonce":3378134261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6817","nonce":3378134261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6815","nonce":3378134261}]},"public_addr":"172.21.15.18:6811/3378134261","cluster_addr":"172.21.15.18:6813/3378134261","heartbeat_back_addr":"172.21.15.18:6817/3378134261","heartbeat_front_addr":"172.21.15.18:6815/3378134261","state":["exists","up"]},{"osd":4,"uuid":"66a2c8a0-1a99-4c6d-b56a-f1f6c3199655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6809","nonce":1416302860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6811","nonce":1416302860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6815","nonce":1416302860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6813","nonce":1416302860}]},"public_addr":"172.21.15.62:6809/1416302860","cluster_addr":"172.21.15.62:6811/1416302860","heartbeat_back_addr":"172.21.15.62:6815/1416302860","heartbeat_front_addr":"172.21.15.62:6813/1416302860","state":["exists","up"]},{"osd":5,"uuid":"c4070ecf-703a-4f5f-9a2b-63473ff7f98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6809","nonce":2234269387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6811","nonce":2234269387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6815","nonce":2234269387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6813","nonce":2234269387}]},"public_addr":"172.21.15.176:6809/2234269387","cluster_addr":"172.21.15.176:6811/2234269387","heartbeat_back_addr":"172.21.15.176:6815/2234269387","heartbeat_front_addr":"172.21.15.176:6813/2234269387","state":["exists","up"]},{"osd":6,"uuid":"12a08874-041e-4734-bc33-68ebfce97b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6819","nonce":3613955982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6821","nonce":3613955982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6825","nonce":3613955982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6823","nonce":3613955982}]},"public_addr":"172.21.15.18:6819/3613955982","cluster_addr":"172.21.15.18:6821/3613955982","heartbeat_back_addr":"172.21.15.18:6825/3613955982","heartbeat_front_addr":"172.21.15.18:6823/3613955982","state":["exists","up"]},{"osd":7,"uuid":"86a5b47c-143f-4848-892f-c7b6a17a2799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6817","nonce":750933013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6819","nonce":750933013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6823","nonce":750933013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6821","nonce":750933013}]},"public_addr":"172.21.15.62:6817/750933013","cluster_addr":"172.21.15.62:6819/750933013","heartbeat_back_addr":"172.21.15.62:6823/750933013","heartbeat_front_addr":"172.21.15.62:6821/750933013","state":["exists","up"]},{"osd":8,"uuid":"0426a455-ed11-4d6a-8e1d-c8aa2ee65cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6817","nonce":8496953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6819","nonce":8496953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6823","nonce":8496953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6821","nonce":8496953}]},"public_addr":"172.21.15.176:6817/8496953","cluster_addr":"172.21.15.176:6819/8496953","heartbeat_back_addr":"172.21.15.176:6823/8496953","heartbeat_front_addr":"172.21.15.176:6821/8496953","state":["exists","up"]},{"osd":9,"uuid":"241aa2cf-0765-465d-b400-4911e653412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6827","nonce":422514390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6829","nonce":422514390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6833","nonce":422514390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6831","nonce":422514390}]},"public_addr":"172.21.15.18:6827/422514390","cluster_addr":"172.21.15.18:6829/422514390","heartbeat_back_addr":"172.21.15.18:6833/422514390","heartbeat_front_addr":"172.21.15.18:6831/422514390","state":["exists","up"]},{"osd":10,"uuid":"b1d4ab1f-0ec4-4641-bab0-f39d15857615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6825","nonce":269877918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6827","nonce":269877918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6831","nonce":269877918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6829","nonce":269877918}]},"public_addr":"172.21.15.62:6825/269877918","cluster_addr":"172.21.15.62:6827/269877918","heartbeat_back_addr":"172.21.15.62:6831/269877918","heartbeat_front_addr":"172.21.15.62:6829/269877918","state":["exists","up"]},{"osd":11,"uuid":"d122f1bf-bd4f-45d5-b07c-7301b005977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6825","nonce":770358485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6827","nonce":770358485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6831","nonce":770358485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6829","nonce":770358485}]},"public_addr":"172.21.15.176:6825/770358485","cluster_addr":"172.21.15.176:6827/770358485","heartbeat_back_addr":"172.21.15.176:6831/770358485","heartbeat_front_addr":"172.21.15.176:6829/770358485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:39:42.435560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:09.100602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:32.884117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:01.733821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:29.812775+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:53.846503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:24.363464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:51.023614+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:15.782652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:45.378178+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:12.469173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:36.303058+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2679362143":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/4236556151":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6801/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6800/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/1197309398":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/3024661873":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/2429098892":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6801/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6800/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/1531572357":"2024-09-13T02:37:40.790128+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:44:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.851+0000 7f73db000640 1 -- 172.21.15.18:0/679194384 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f73bc0a2b80 msgr2=0x7f73bc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.851+0000 7f73db000640 1 --2- 172.21.15.18:0/679194384 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f73bc0a2b80 0x7f73bc0a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f73d410ecb0 tx=0x7f73c0005f90 comp rx=0 tx=0).stop 2024-09-12T02:44:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.851+0000 7f73db000640 1 -- 172.21.15.18:0/679194384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d41019c0 msgr2=0x7f73d419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.851+0000 7f73db000640 1 --2- 172.21.15.18:0/679194384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d41019c0 0x7f73d419a480 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f73c800e9f0 tx=0x7f73c800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.851+0000 7f73db000640 1 -- 172.21.15.18:0/679194384 shutdown_connections 2024-09-12T02:44:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.851+0000 7f73db000640 1 --2- 172.21.15.18:0/679194384 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f73bc0a2b80 0x7f73bc0a5040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.851+0000 7f73db000640 1 --2- 172.21.15.18:0/679194384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73d41079c0 0x7f73d419ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.851+0000 7f73db000640 1 --2- 172.21.15.18:0/679194384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73d4102360 0x7f73d419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.851+0000 7f73db000640 1 --2- 172.21.15.18:0/679194384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d41019c0 0x7f73d419a480 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.851+0000 7f73db000640 1 -- 172.21.15.18:0/679194384 >> 172.21.15.18:0/679194384 conn(0x7f73d40fd740 msgr2=0x7f73d40fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.852+0000 7f73db000640 1 -- 172.21.15.18:0/679194384 shutdown_connections 2024-09-12T02:44:40.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:40.852+0000 7f73db000640 1 -- 172.21.15.18:0/679194384 wait complete. 2024-09-12T02:44:41.753 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:40:35.157621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:44:41.754 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-12T02:44:42.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:41 smithi018 ceph-mon[30616]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:42.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:41 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/679194384' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:44:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:42.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:41 smithi176 ceph-mon[35713]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:42.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:41 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/679194384' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:44:42.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:41 smithi062 ceph-mon[35527]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:42.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:41 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/679194384' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:44:42.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.723+0000 7f0e2ce00640 1 -- 172.21.15.18:0/328868328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e28076720 msgr2=0x7f0e28076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:42.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.723+0000 7f0e2ce00640 1 --2- 172.21.15.18:0/328868328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e28076720 0x7f0e28076b00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009900 tx=0x7f0e1802a410 comp rx=0 tx=0).stop 2024-09-12T02:44:42.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.723+0000 7f0e2ce00640 1 -- 172.21.15.18:0/328868328 shutdown_connections 2024-09-12T02:44:42.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.723+0000 7f0e2ce00640 1 --2- 172.21.15.18:0/328868328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e28112a30 0x7f0e28114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:42.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.723+0000 7f0e2ce00640 1 --2- 172.21.15.18:0/328868328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e28077040 0x7f0e281124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:42.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.723+0000 7f0e2ce00640 1 --2- 172.21.15.18:0/328868328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e28076720 0x7f0e28076b00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:42.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.723+0000 7f0e2ce00640 1 -- 172.21.15.18:0/328868328 >> 172.21.15.18:0/328868328 conn(0x7f0e280ffa90 msgr2=0x7f0e28101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:42.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.723+0000 7f0e2ce00640 1 -- 172.21.15.18:0/328868328 shutdown_connections 2024-09-12T02:44:42.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.723+0000 7f0e2ce00640 1 -- 172.21.15.18:0/328868328 wait complete. 2024-09-12T02:44:42.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.724+0000 7f0e2ce00640 1 Processor -- start 2024-09-12T02:44:42.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.724+0000 7f0e2ce00640 1 -- start start 2024-09-12T02:44:42.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.724+0000 7f0e2ce00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e28076720 0x7f0e281a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:42.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.724+0000 7f0e2ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e28077040 0x7f0e281a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:42.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.724+0000 7f0e2ce00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e28112a30 0x7f0e2819e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:42.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.724+0000 7f0e2ce00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0e28118610 con 0x7f0e28077040 2024-09-12T02:44:42.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.724+0000 7f0e2ce00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0e28118490 con 0x7f0e28076720 2024-09-12T02:44:42.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.724+0000 7f0e2ce00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0e28118790 con 0x7f0e28112a30 2024-09-12T02:44:42.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.725+0000 7f0e1d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e28077040 0x7f0e281a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:42.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.725+0000 7f0e1d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e28077040 0x7f0e281a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36374/0 (socket says 172.21.15.18:36374) 2024-09-12T02:44:42.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.725+0000 7f0e1d400640 1 -- 172.21.15.18:0/247632102 learned_addr learned my addr 172.21.15.18:0/247632102 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:44:42.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.725+0000 7f0e25e00640 1 --2- 172.21.15.18:0/247632102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e28076720 0x7f0e281a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:42.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.725+0000 7f0e26800640 1 --2- 172.21.15.18:0/247632102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e28112a30 0x7f0e2819e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:42.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.725+0000 7f0e1d400640 1 -- 172.21.15.18:0/247632102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e28112a30 msgr2=0x7f0e2819e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:42.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.725+0000 7f0e1d400640 1 --2- 172.21.15.18:0/247632102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e28112a30 0x7f0e2819e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:42.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.725+0000 7f0e1d400640 1 -- 172.21.15.18:0/247632102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e28076720 msgr2=0x7f0e281a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:42.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.725+0000 7f0e1d400640 1 --2- 172.21.15.18:0/247632102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e28076720 0x7f0e281a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:42.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.725+0000 7f0e1d400640 1 -- 172.21.15.18:0/247632102 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2819efa0 con 0x7f0e28077040 2024-09-12T02:44:42.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.725+0000 7f0e1d400640 1 --2- 172.21.15.18:0/247632102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e28077040 0x7f0e281a4bf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000e9f0 tx=0x7f0e1000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:42.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.726+0000 7f0e1f400640 1 -- 172.21.15.18:0/247632102 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1000cd80 con 0x7f0e28077040 2024-09-12T02:44:42.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.726+0000 7f0e1f400640 1 -- 172.21.15.18:0/247632102 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e10010910 con 0x7f0e28077040 2024-09-12T02:44:42.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.726+0000 7f0e2ce00640 1 -- 172.21.15.18:0/247632102 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e2819f290 con 0x7f0e28077040 2024-09-12T02:44:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.726+0000 7f0e1f400640 1 -- 172.21.15.18:0/247632102 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10018990 con 0x7f0e28077040 2024-09-12T02:44:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.726+0000 7f0e2ce00640 1 -- 172.21.15.18:0/247632102 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e281ab580 con 0x7f0e28077040 2024-09-12T02:44:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.727+0000 7f0e2ce00640 1 -- 172.21.15.18:0/247632102 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e28076b00 con 0x7f0e28077040 2024-09-12T02:44:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.729+0000 7f0e1f400640 1 -- 172.21.15.18:0/247632102 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0e10010ac0 con 0x7f0e28077040 2024-09-12T02:44:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.730+0000 7f0e1f400640 1 --2- 172.21.15.18:0/247632102 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0e0c0a2c00 0x7f0e0c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.730+0000 7f0e1f400640 1 -- 172.21.15.18:0/247632102 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7f0e100ceeb0 con 0x7f0e28077040 2024-09-12T02:44:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.730+0000 7f0e25e00640 1 --2- 172.21.15.18:0/247632102 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0e0c0a2c00 0x7f0e0c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.731+0000 7f0e25e00640 1 --2- 172.21.15.18:0/247632102 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0e0c0a2c00 0x7f0e0c0a50c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e18006010 tx=0x7f0e18000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:42.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.734+0000 7f0e1f400640 1 -- 172.21.15.18:0/247632102 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e1009bbc0 con 0x7f0e28077040 2024-09-12T02:44:42.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.920+0000 7f0e2ce00640 1 -- 172.21.15.18:0/247632102 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0e2802d7c0 con 0x7f0e28077040 2024-09-12T02:44:42.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.921+0000 7f0e1f400640 1 -- 172.21.15.18:0/247632102 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7f0e1009fec0 con 0x7f0e28077040 2024-09-12T02:44:42.922 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-12T02:44:42.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.923+0000 7f0e2ce00640 1 -- 172.21.15.18:0/247632102 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0e0c0a2c00 msgr2=0x7f0e0c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:42.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.923+0000 7f0e2ce00640 1 --2- 172.21.15.18:0/247632102 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0e0c0a2c00 0x7f0e0c0a50c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e18006010 tx=0x7f0e18000bc0 comp rx=0 tx=0).stop 2024-09-12T02:44:42.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.923+0000 7f0e2ce00640 1 -- 172.21.15.18:0/247632102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e28077040 msgr2=0x7f0e281a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:42.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.923+0000 7f0e2ce00640 1 --2- 172.21.15.18:0/247632102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e28077040 0x7f0e281a4bf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000e9f0 tx=0x7f0e1000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:44:42.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.923+0000 7f0e2ce00640 1 -- 172.21.15.18:0/247632102 shutdown_connections 2024-09-12T02:44:42.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.923+0000 7f0e2ce00640 1 --2- 172.21.15.18:0/247632102 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0e0c0a2c00 0x7f0e0c0a50c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:42.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.923+0000 7f0e2ce00640 1 --2- 172.21.15.18:0/247632102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e28112a30 0x7f0e2819e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:42.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.923+0000 7f0e2ce00640 1 --2- 172.21.15.18:0/247632102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e28077040 0x7f0e281a4bf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:42.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.923+0000 7f0e2ce00640 1 --2- 172.21.15.18:0/247632102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e28076720 0x7f0e281a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:42.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.923+0000 7f0e2ce00640 1 -- 172.21.15.18:0/247632102 >> 172.21.15.18:0/247632102 conn(0x7f0e280ffa90 msgr2=0x7f0e28101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:42.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.924+0000 7f0e2ce00640 1 -- 172.21.15.18:0/247632102 shutdown_connections 2024-09-12T02:44:42.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:42.924+0000 7f0e2ce00640 1 -- 172.21.15.18:0/247632102 wait complete. 2024-09-12T02:44:43.818 INFO:tasks.cephadm:Adding mds.a on smithi018 2024-09-12T02:44:43.818 INFO:tasks.cephadm:Adding mds.d on smithi018 2024-09-12T02:44:43.818 INFO:tasks.cephadm:Adding mds.g on smithi018 2024-09-12T02:44:43.819 INFO:tasks.cephadm:Adding mds.j on smithi018 2024-09-12T02:44:43.819 INFO:tasks.cephadm:Adding mds.b on smithi062 2024-09-12T02:44:43.819 INFO:tasks.cephadm:Adding mds.e on smithi062 2024-09-12T02:44:43.819 INFO:tasks.cephadm:Adding mds.h on smithi062 2024-09-12T02:44:43.819 INFO:tasks.cephadm:Adding mds.k on smithi062 2024-09-12T02:44:43.819 INFO:tasks.cephadm:Adding mds.c on smithi176 2024-09-12T02:44:43.819 INFO:tasks.cephadm:Adding mds.f on smithi176 2024-09-12T02:44:43.819 INFO:tasks.cephadm:Adding mds.i on smithi176 2024-09-12T02:44:43.819 INFO:tasks.cephadm:Adding mds.l on smithi176 2024-09-12T02:44:43.819 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l' 2024-09-12T02:44:44.076 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:44:44.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:43 smithi018 ceph-mon[30616]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:44.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:43 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/247632102' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:44:44.196 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:43 smithi176 ceph-mon[35713]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:44.196 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:43 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/247632102' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:44:44.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:43 smithi062 ceph-mon[35527]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:44.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:43 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/247632102' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:44:44.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.546+0000 7fac4e1d6640 1 -- 172.21.15.176:0/3542706626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac48105030 msgr2=0x7fac48107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:44.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.546+0000 7fac4e1d6640 1 --2- 172.21.15.176:0/3542706626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac48105030 0x7fac48107420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fac38009900 tx=0x7fac3802a410 comp rx=0 tx=0).stop 2024-09-12T02:44:44.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.546+0000 7fac4e1d6640 1 -- 172.21.15.176:0/3542706626 shutdown_connections 2024-09-12T02:44:44.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.546+0000 7fac4e1d6640 1 --2- 172.21.15.176:0/3542706626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac48107960 0x7fac48109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:44.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.546+0000 7fac4e1d6640 1 --2- 172.21.15.176:0/3542706626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac48105030 0x7fac48107420 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:44.561 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.546+0000 7fac4e1d6640 1 --2- 172.21.15.176:0/3542706626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac48102700 0x7fac48104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:44.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.546+0000 7fac4e1d6640 1 -- 172.21.15.176:0/3542706626 >> 172.21.15.176:0/3542706626 conn(0x7fac480fc280 msgr2=0x7fac480fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:44.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.546+0000 7fac4e1d6640 1 -- 172.21.15.176:0/3542706626 shutdown_connections 2024-09-12T02:44:44.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.546+0000 7fac4e1d6640 1 -- 172.21.15.176:0/3542706626 wait complete. 2024-09-12T02:44:44.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.547+0000 7fac4e1d6640 1 Processor -- start 2024-09-12T02:44:44.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.547+0000 7fac4e1d6640 1 -- start start 2024-09-12T02:44:44.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.547+0000 7fac4e1d6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac48102700 0x7fac48197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:44.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.547+0000 7fac4e1d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac48105030 0x7fac481984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:44.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.547+0000 7fac4e1d6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac48107960 0x7fac4819f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:44.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.547+0000 7fac4e1d6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fac4810d8d0 con 0x7fac48105030 2024-09-12T02:44:44.562 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.547+0000 7fac4e1d6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fac4810d750 con 0x7fac48107960 2024-09-12T02:44:44.563 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.547+0000 7fac4e1d6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fac4810da50 con 0x7fac48102700 2024-09-12T02:44:44.563 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.547+0000 7fac477fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac48102700 0x7fac48197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:44.563 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.547+0000 7fac477fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac48102700 0x7fac48197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:48844/0 (socket says 172.21.15.176:48844) 2024-09-12T02:44:44.563 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.547+0000 7fac477fe640 1 -- 172.21.15.176:0/2726339018 learned_addr learned my addr 172.21.15.176:0/2726339018 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-12T02:44:44.563 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.547+0000 7fac47fff640 1 --2- 172.21.15.176:0/2726339018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac48107960 0x7fac4819f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:44.563 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.547+0000 7fac46ffd640 1 --2- 172.21.15.176:0/2726339018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac48105030 0x7fac481984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:44.563 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.548+0000 7fac477fe640 1 -- 172.21.15.176:0/2726339018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac48107960 msgr2=0x7fac4819f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:44.563 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.548+0000 7fac477fe640 1 --2- 172.21.15.176:0/2726339018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac48107960 0x7fac4819f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:44.563 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.548+0000 7fac477fe640 1 -- 172.21.15.176:0/2726339018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac48105030 msgr2=0x7fac481984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:44.563 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.548+0000 7fac477fe640 1 --2- 172.21.15.176:0/2726339018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac48105030 0x7fac481984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:44.563 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.548+0000 7fac477fe640 1 -- 172.21.15.176:0/2726339018 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4819fbb0 con 0x7fac48102700 2024-09-12T02:44:44.564 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.548+0000 7fac477fe640 1 --2- 172.21.15.176:0/2726339018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac48102700 0x7fac48197f80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00c970 tx=0x7fac3c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:44.564 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.548+0000 7fac44ff9640 1 -- 172.21.15.176:0/2726339018 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c007bb0 con 0x7fac48102700 2024-09-12T02:44:44.564 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.548+0000 7fac44ff9640 1 -- 172.21.15.176:0/2726339018 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac3c007d50 con 0x7fac48102700 2024-09-12T02:44:44.564 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.548+0000 7fac4e1d6640 1 -- 172.21.15.176:0/2726339018 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac4819fea0 con 0x7fac48102700 2024-09-12T02:44:44.564 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.548+0000 7fac44ff9640 1 -- 172.21.15.176:0/2726339018 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c00f450 con 0x7fac48102700 2024-09-12T02:44:44.564 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.548+0000 7fac4e1d6640 1 -- 172.21.15.176:0/2726339018 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac481a0320 con 0x7fac48102700 2024-09-12T02:44:44.564 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.549+0000 7fac4e1d6640 1 -- 172.21.15.176:0/2726339018 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac480fdd70 con 0x7fac48102700 2024-09-12T02:44:44.564 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.550+0000 7fac44ff9640 1 -- 172.21.15.176:0/2726339018 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fac3c005020 con 0x7fac48102700 2024-09-12T02:44:44.564 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.551+0000 7fac44ff9640 1 --2- 172.21.15.176:0/2726339018 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fac300a2bb0 0x7fac300a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:44.564 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.551+0000 7fac44ff9640 1 -- 172.21.15.176:0/2726339018 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7fac3c0ce950 con 0x7fac48102700 2024-09-12T02:44:44.564 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.551+0000 7fac46ffd640 1 --2- 172.21.15.176:0/2726339018 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fac300a2bb0 0x7fac300a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:44.565 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.552+0000 7fac46ffd640 1 --2- 172.21.15.176:0/2726339018 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fac300a2bb0 0x7fac300a5070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fac38006010 tx=0x7fac38000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:44.565 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.555+0000 7fac44ff9640 1 -- 172.21.15.176:0/2726339018 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac3c014030 con 0x7fac48102700 2024-09-12T02:44:44.767 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.767+0000 7fac4e1d6640 1 -- 172.21.15.176:0/2726339018 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l", "target": ["mon-mgr", ""]}) -- 0x7fac48062730 con 0x7fac300a2bb0 2024-09-12T02:44:44.776 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.775+0000 7fac44ff9640 1 -- 172.21.15.176:0/2726339018 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fac48062730 con 0x7fac300a2bb0 2024-09-12T02:44:44.776 INFO:teuthology.orchestra.run.smithi176.stdout:Scheduled mds.all update... 2024-09-12T02:44:44.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.778+0000 7fac4e1d6640 1 -- 172.21.15.176:0/2726339018 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fac300a2bb0 msgr2=0x7fac300a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:44.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.778+0000 7fac4e1d6640 1 --2- 172.21.15.176:0/2726339018 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fac300a2bb0 0x7fac300a5070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fac38006010 tx=0x7fac38000bc0 comp rx=0 tx=0).stop 2024-09-12T02:44:44.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.778+0000 7fac4e1d6640 1 -- 172.21.15.176:0/2726339018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac48102700 msgr2=0x7fac48197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:44.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.778+0000 7fac4e1d6640 1 --2- 172.21.15.176:0/2726339018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac48102700 0x7fac48197f80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00c970 tx=0x7fac3c00ce30 comp rx=0 tx=0).stop 2024-09-12T02:44:44.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.778+0000 7fac4e1d6640 1 -- 172.21.15.176:0/2726339018 shutdown_connections 2024-09-12T02:44:44.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.778+0000 7fac4e1d6640 1 --2- 172.21.15.176:0/2726339018 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fac300a2bb0 0x7fac300a5070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:44.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.778+0000 7fac4e1d6640 1 --2- 172.21.15.176:0/2726339018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac48107960 0x7fac4819f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:44.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.778+0000 7fac4e1d6640 1 --2- 172.21.15.176:0/2726339018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac48105030 0x7fac481984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:44.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.778+0000 7fac4e1d6640 1 --2- 172.21.15.176:0/2726339018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac48102700 0x7fac48197f80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:44.780 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.778+0000 7fac4e1d6640 1 -- 172.21.15.176:0/2726339018 >> 172.21.15.176:0/2726339018 conn(0x7fac480fc280 msgr2=0x7fac48103180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:44.780 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.778+0000 7fac4e1d6640 1 -- 172.21.15.176:0/2726339018 shutdown_connections 2024-09-12T02:44:44.780 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T02:44:44.778+0000 7fac4e1d6640 1 -- 172.21.15.176:0/2726339018 wait complete. 2024-09-12T02:44:45.427 DEBUG:teuthology.orchestra.run.smithi018:mds.a> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.a.service 2024-09-12T02:44:45.431 DEBUG:teuthology.orchestra.run.smithi018:mds.d> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.d.service 2024-09-12T02:44:45.477 DEBUG:teuthology.orchestra.run.smithi018:mds.g> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.g.service 2024-09-12T02:44:45.522 DEBUG:teuthology.orchestra.run.smithi018:mds.j> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.j.service 2024-09-12T02:44:45.641 DEBUG:teuthology.orchestra.run.smithi062:mds.b> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.b.service 2024-09-12T02:44:45.643 DEBUG:teuthology.orchestra.run.smithi062:mds.e> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.e.service 2024-09-12T02:44:45.692 DEBUG:teuthology.orchestra.run.smithi062:mds.h> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.h.service 2024-09-12T02:44:45.735 DEBUG:teuthology.orchestra.run.smithi062:mds.k> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.k.service 2024-09-12T02:44:45.778 DEBUG:teuthology.orchestra.run.smithi176:mds.c> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.c.service 2024-09-12T02:44:45.781 DEBUG:teuthology.orchestra.run.smithi176:mds.f> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.f.service 2024-09-12T02:44:45.823 DEBUG:teuthology.orchestra.run.smithi176:mds.i> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.i.service 2024-09-12T02:44:45.867 DEBUG:teuthology.orchestra.run.smithi176:mds.l> sudo journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.l.service 2024-09-12T02:44:45.909 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-12T02:44:45.910 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:44:46.025 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:45 smithi176 ceph-mon[35713]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:46.025 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:45 smithi176 ceph-mon[35713]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:44:46.026 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:45 smithi176 ceph-mon[35713]: Saving service mds.all spec with placement smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l;count:12 2024-09-12T02:44:46.026 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:46.026 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:46.026 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:46.026 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:46.026 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:46.027 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:44:46.027 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:44:46.027 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:45 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:46.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:45 smithi062 ceph-mon[35527]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:46.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:45 smithi062 ceph-mon[35527]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:44:46.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:45 smithi062 ceph-mon[35527]: Saving service mds.all spec with placement smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l;count:12 2024-09-12T02:44:46.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:46.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:46.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:46.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:46.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:46.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:44:46.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:44:46.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:45 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:46.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:45 smithi018 ceph-mon[30616]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:46.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:45 smithi018 ceph-mon[30616]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:44:46.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:45 smithi018 ceph-mon[30616]: Saving service mds.all spec with placement smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l;count:12 2024-09-12T02:44:46.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:46.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:46.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:46.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:46.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:46.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:44:46.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:44:46.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:45 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:46.287 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:46.931 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:46 smithi176 ceph-mon[35713]: Deploying daemon mds.l on smithi176 2024-09-12T02:44:47.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:46 smithi062 ceph-mon[35527]: Deploying daemon mds.l on smithi176 2024-09-12T02:44:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.937+0000 7fadec600640 1 -- 172.21.15.18:0/2279818581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fade4103ff0 msgr2=0x7fade41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.937+0000 7fadec600640 1 --2- 172.21.15.18:0/2279818581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fade4103ff0 0x7fade41043d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009900 tx=0x7fadd802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:44:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.937+0000 7fadec600640 1 -- 172.21.15.18:0/2279818581 shutdown_connections 2024-09-12T02:44:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.937+0000 7fadec600640 1 --2- 172.21.15.18:0/2279818581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade4109120 0x7fade4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.937+0000 7fadec600640 1 --2- 172.21.15.18:0/2279818581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fade41049a0 0x7fade41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.937+0000 7fadec600640 1 --2- 172.21.15.18:0/2279818581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fade4103ff0 0x7fade41043d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.937+0000 7fadec600640 1 -- 172.21.15.18:0/2279818581 >> 172.21.15.18:0/2279818581 conn(0x7fade40ffa90 msgr2=0x7fade4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.938+0000 7fadec600640 1 -- 172.21.15.18:0/2279818581 shutdown_connections 2024-09-12T02:44:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.938+0000 7fadec600640 1 -- 172.21.15.18:0/2279818581 wait complete. 2024-09-12T02:44:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.938+0000 7fadec600640 1 Processor -- start 2024-09-12T02:44:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.939+0000 7fadec600640 1 -- start start 2024-09-12T02:44:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.939+0000 7fadec600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade4103ff0 0x7fade419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.939+0000 7fadec600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fade41049a0 0x7fade419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.939+0000 7fadec600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fade4109120 0x7fade419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.939+0000 7fadec600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fade4114120 con 0x7fade41049a0 2024-09-12T02:44:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.939+0000 7fadec600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fade4113fa0 con 0x7fade4103ff0 2024-09-12T02:44:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.939+0000 7fadec600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fade41142a0 con 0x7fade4109120 2024-09-12T02:44:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.939+0000 7fade9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fade41049a0 0x7fade419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.939+0000 7fade9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fade41049a0 0x7fade419ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55500/0 (socket says 172.21.15.18:55500) 2024-09-12T02:44:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.939+0000 7fade9200640 1 -- 172.21.15.18:0/329619848 learned_addr learned my addr 172.21.15.18:0/329619848 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:44:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.939+0000 7fadea600640 1 --2- 172.21.15.18:0/329619848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fade4109120 0x7fade419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.939+0000 7fade9c00640 1 --2- 172.21.15.18:0/329619848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade4103ff0 0x7fade419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.940+0000 7fade9200640 1 -- 172.21.15.18:0/329619848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fade4109120 msgr2=0x7fade419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.940+0000 7fade9200640 1 --2- 172.21.15.18:0/329619848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fade4109120 0x7fade419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.940+0000 7fade9200640 1 -- 172.21.15.18:0/329619848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade4103ff0 msgr2=0x7fade419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.940+0000 7fade9200640 1 --2- 172.21.15.18:0/329619848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade4103ff0 0x7fade419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.940+0000 7fade9200640 1 -- 172.21.15.18:0/329619848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade419f590 con 0x7fade41049a0 2024-09-12T02:44:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.940+0000 7fade9200640 1 --2- 172.21.15.18:0/329619848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fade41049a0 0x7fade419ab20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fadd000e9f0 tx=0x7fadd000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.940+0000 7fade2000640 1 -- 172.21.15.18:0/329619848 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd000cd80 con 0x7fade41049a0 2024-09-12T02:44:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.940+0000 7fade2000640 1 -- 172.21.15.18:0/329619848 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadd0010910 con 0x7fade41049a0 2024-09-12T02:44:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.940+0000 7fadec600640 1 -- 172.21.15.18:0/329619848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade419f880 con 0x7fade41049a0 2024-09-12T02:44:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.940+0000 7fade2000640 1 -- 172.21.15.18:0/329619848 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0018990 con 0x7fade41049a0 2024-09-12T02:44:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.940+0000 7fadec600640 1 -- 172.21.15.18:0/329619848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade41a7160 con 0x7fade41049a0 2024-09-12T02:44:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.941+0000 7fadec600640 1 -- 172.21.15.18:0/329619848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade41043d0 con 0x7fade41049a0 2024-09-12T02:44:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.943+0000 7fade2000640 1 -- 172.21.15.18:0/329619848 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fadd0010ac0 con 0x7fade41049a0 2024-09-12T02:44:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.945+0000 7fade2000640 1 --2- 172.21.15.18:0/329619848 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fadcc0a2c00 0x7fadcc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.945+0000 7fade2000640 1 -- 172.21.15.18:0/329619848 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7fadd00cef60 con 0x7fade41049a0 2024-09-12T02:44:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.945+0000 7fade9c00640 1 --2- 172.21.15.18:0/329619848 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fadcc0a2c00 0x7fadcc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.946+0000 7fade9c00640 1 --2- 172.21.15.18:0/329619848 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fadcc0a2c00 0x7fadcc0a50c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fadd8005ab0 tx=0x7fadd8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:46.949+0000 7fade2000640 1 -- 172.21.15.18:0/329619848 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fadd009c2c0 con 0x7fade41049a0 2024-09-12T02:44:47.079 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:46 smithi018 ceph-mon[30616]: Deploying daemon mds.l on smithi176 2024-09-12T02:44:47.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:47.172+0000 7fadec600640 1 -- 172.21.15.18:0/329619848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fade402d7c0 con 0x7fade41049a0 2024-09-12T02:44:47.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:47.172+0000 7fade2000640 1 -- 172.21.15.18:0/329619848 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fadd009bbc0 con 0x7fade41049a0 2024-09-12T02:44:47.173 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:44:47.173 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":1,"btime":"2024-09-12T02:37:14:139320+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-12T02:44:47.173 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 1 2024-09-12T02:44:47.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:47.174+0000 7fadec600640 1 -- 172.21.15.18:0/329619848 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fadcc0a2c00 msgr2=0x7fadcc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:47.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:47.174+0000 7fadec600640 1 --2- 172.21.15.18:0/329619848 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fadcc0a2c00 0x7fadcc0a50c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fadd8005ab0 tx=0x7fadd8005a20 comp rx=0 tx=0).stop 2024-09-12T02:44:47.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:47.174+0000 7fadec600640 1 -- 172.21.15.18:0/329619848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fade41049a0 msgr2=0x7fade419ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:47.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:47.174+0000 7fadec600640 1 --2- 172.21.15.18:0/329619848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fade41049a0 0x7fade419ab20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fadd000e9f0 tx=0x7fadd000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:44:47.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:47.174+0000 7fadec600640 1 -- 172.21.15.18:0/329619848 shutdown_connections 2024-09-12T02:44:47.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:47.174+0000 7fadec600640 1 --2- 172.21.15.18:0/329619848 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fadcc0a2c00 0x7fadcc0a50c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:47.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:47.174+0000 7fadec600640 1 --2- 172.21.15.18:0/329619848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fade4109120 0x7fade419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:47.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:47.174+0000 7fadec600640 1 --2- 172.21.15.18:0/329619848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fade41049a0 0x7fade419ab20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:47.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:47.174+0000 7fadec600640 1 --2- 172.21.15.18:0/329619848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade4103ff0 0x7fade419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:47.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:47.174+0000 7fadec600640 1 -- 172.21.15.18:0/329619848 >> 172.21.15.18:0/329619848 conn(0x7fade40ffa90 msgr2=0x7fade4100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:47.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:47.175+0000 7fadec600640 1 -- 172.21.15.18:0/329619848 shutdown_connections 2024-09-12T02:44:47.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:47.175+0000 7fadec600640 1 -- 172.21.15.18:0/329619848 wait complete. 2024-09-12T02:44:47.479 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 02:44:47 smithi176 systemd[1]: Starting Ceph mds.l for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T02:44:47.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:47 smithi018 ceph-mon[30616]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:47 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/329619848' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:47.862 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:47 smithi176 ceph-mon[35713]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:47.862 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:47 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/329619848' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:47.862 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 02:44:47 smithi176 podman[65468]: 2024-09-12 02:44:47.510080396 +0000 UTC m=+0.015957660 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:44:47.862 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 02:44:47 smithi176 podman[65468]: 2024-09-12 02:44:47.61756648 +0000 UTC m=+0.123443726 container create 448d622eafb0781b1aaaa51e406979860a6dac4b10afd2d3b9f10a2914d386c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-l, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T02:44:47.862 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 02:44:47 smithi176 podman[65468]: 2024-09-12 02:44:47.862334491 +0000 UTC m=+0.368211740 container init 448d622eafb0781b1aaaa51e406979860a6dac4b10afd2d3b9f10a2914d386c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-l, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T02:44:48.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:47 smithi062 ceph-mon[35527]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:48.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:47 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/329619848' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:48.229 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 02:44:47 smithi176 podman[65468]: 2024-09-12 02:44:47.865195272 +0000 UTC m=+0.371072523 container start 448d622eafb0781b1aaaa51e406979860a6dac4b10afd2d3b9f10a2914d386c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-l, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-12T02:44:48.229 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 02:44:47 smithi176 ceph-mds[65487]: -- 172.21.15.176:0/2616210953 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ff217fb860 con 0x55ff217d9400 2024-09-12T02:44:48.229 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 02:44:47 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-l[65483]: starting mds.l at 2024-09-12T02:44:48.229 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 02:44:47 smithi176 bash[65468]: 448d622eafb0781b1aaaa51e406979860a6dac4b10afd2d3b9f10a2914d386c0 2024-09-12T02:44:48.229 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 02:44:47 smithi176 systemd[1]: Started Ceph mds.l for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:44:49.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:48 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.176:6832/1988054318,v1:172.21.15.176:6833/1988054318] up:boot 2024-09-12T02:44:49.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:48 smithi062 ceph-mon[35527]: fsmap 1 up:standby 2024-09-12T02:44:49.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:44:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:44:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:44:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:48 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:48 smithi062 ceph-mon[35527]: Deploying daemon mds.k on smithi062 2024-09-12T02:44:49.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:48 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.176:6832/1988054318,v1:172.21.15.176:6833/1988054318] up:boot 2024-09-12T02:44:49.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:48 smithi176 ceph-mon[35713]: fsmap 1 up:standby 2024-09-12T02:44:49.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:44:49.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:49.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:49.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:49.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:44:49.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:44:49.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:48 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:49.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:48 smithi176 ceph-mon[35713]: Deploying daemon mds.k on smithi062 2024-09-12T02:44:49.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:48 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.176:6832/1988054318,v1:172.21.15.176:6833/1988054318] up:boot 2024-09-12T02:44:49.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:48 smithi018 ceph-mon[30616]: fsmap 1 up:standby 2024-09-12T02:44:49.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:44:49.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:49.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:49.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:49.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:44:49.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:44:49.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:48 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:49.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:48 smithi018 ceph-mon[30616]: Deploying daemon mds.k on smithi062 2024-09-12T02:44:50.235 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:44:50.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:50 smithi062 ceph-mon[35527]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:50.284 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 02:44:50 smithi062 systemd[1]: Starting Ceph mds.k for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T02:44:50.290 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:50 smithi018 ceph-mon[30616]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:50.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:50 smithi176 ceph-mon[35713]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:50.619 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:50.659 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 02:44:50 smithi062 podman[65031]: 2024-09-12 02:44:50.253520622 +0000 UTC m=+0.015589498 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:44:50.659 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 02:44:50 smithi062 podman[65031]: 2024-09-12 02:44:50.405278193 +0000 UTC m=+0.167347111 container create a638e8e00816f5c638829ffce8f662d79d0c4188f89a02f1ab79d58c927e3811 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-k, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-12T02:44:50.659 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 02:44:50 smithi062 podman[65031]: 2024-09-12 02:44:50.657883545 +0000 UTC m=+0.419952421 container init a638e8e00816f5c638829ffce8f662d79d0c4188f89a02f1ab79d58c927e3811 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-k, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-09-12T02:44:51.034 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 02:44:50 smithi062 podman[65031]: 2024-09-12 02:44:50.660766808 +0000 UTC m=+0.422835692 container start a638e8e00816f5c638829ffce8f662d79d0c4188f89a02f1ab79d58c927e3811 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-k, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-12T02:44:51.034 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 02:44:50 smithi062 ceph-mds[65050]: -- 172.21.15.62:0/2071555198 <== mon.2 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559265597860 con 0x559265574800 2024-09-12T02:44:51.034 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 02:44:50 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-k[65046]: starting mds.k at 2024-09-12T02:44:51.034 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 02:44:50 smithi062 bash[65031]: a638e8e00816f5c638829ffce8f662d79d0c4188f89a02f1ab79d58c927e3811 2024-09-12T02:44:51.034 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 02:44:50 smithi062 systemd[1]: Started Ceph mds.k for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:44:51.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.207+0000 7f3dd4e00640 1 -- 172.21.15.18:0/651562490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3dd01049a0 msgr2=0x7f3dd01089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.207+0000 7f3dd4e00640 1 --2- 172.21.15.18:0/651562490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3dd01049a0 0x7f3dd01089f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009900 tx=0x7f3dbc02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:44:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.207+0000 7f3dd4e00640 1 -- 172.21.15.18:0/651562490 shutdown_connections 2024-09-12T02:44:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.207+0000 7f3dd4e00640 1 --2- 172.21.15.18:0/651562490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3dd0109120 0x7f3dd0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.207+0000 7f3dd4e00640 1 --2- 172.21.15.18:0/651562490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3dd01049a0 0x7f3dd01089f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.207+0000 7f3dd4e00640 1 --2- 172.21.15.18:0/651562490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd0103ff0 0x7f3dd01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.207+0000 7f3dd4e00640 1 -- 172.21.15.18:0/651562490 >> 172.21.15.18:0/651562490 conn(0x7f3dd00ffa90 msgr2=0x7f3dd0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.207+0000 7f3dd4e00640 1 -- 172.21.15.18:0/651562490 shutdown_connections 2024-09-12T02:44:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.207+0000 7f3dd4e00640 1 -- 172.21.15.18:0/651562490 wait complete. 2024-09-12T02:44:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.208+0000 7f3dd4e00640 1 Processor -- start 2024-09-12T02:44:51.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.208+0000 7f3dd4e00640 1 -- start start 2024-09-12T02:44:51.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.208+0000 7f3dd4e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3dd0103ff0 0x7f3dd019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:51.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.208+0000 7f3dd4e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd01049a0 0x7f3dd019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.208+0000 7f3dd4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3dd0109120 0x7f3dd019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.208+0000 7f3dd4e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd0114190 con 0x7f3dd0109120 2024-09-12T02:44:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.208+0000 7f3dd4e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd0114010 con 0x7f3dd01049a0 2024-09-12T02:44:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.208+0000 7f3dd4e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd0114310 con 0x7f3dd0103ff0 2024-09-12T02:44:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.209+0000 7f3dcd400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd01049a0 0x7f3dd019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.209+0000 7f3dcde00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3dd0103ff0 0x7f3dd019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.209+0000 7f3dce800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3dd0109120 0x7f3dd019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.209+0000 7f3dcd400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd01049a0 0x7f3dd019ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:58290/0 (socket says 172.21.15.18:58290) 2024-09-12T02:44:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.209+0000 7f3dcd400640 1 -- 172.21.15.18:0/1927175160 learned_addr learned my addr 172.21.15.18:0/1927175160 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:44:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.209+0000 7f3dcd400640 1 -- 172.21.15.18:0/1927175160 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3dd0103ff0 msgr2=0x7f3dd019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.209+0000 7f3dcd400640 1 --2- 172.21.15.18:0/1927175160 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3dd0103ff0 0x7f3dd019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.209+0000 7f3dcd400640 1 -- 172.21.15.18:0/1927175160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3dd0109120 msgr2=0x7f3dd019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.209+0000 7f3dcd400640 1 --2- 172.21.15.18:0/1927175160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3dd0109120 0x7f3dd019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.209+0000 7f3dcd400640 1 -- 172.21.15.18:0/1927175160 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd019f5a0 con 0x7f3dd01049a0 2024-09-12T02:44:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.210+0000 7f3dcd400640 1 --2- 172.21.15.18:0/1927175160 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd01049a0 0x7f3dd019ab30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc004770 tx=0x7f3dbc003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.210+0000 7f3dc6a00640 1 -- 172.21.15.18:0/1927175160 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc03f070 con 0x7f3dd01049a0 2024-09-12T02:44:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.210+0000 7f3dd4e00640 1 -- 172.21.15.18:0/1927175160 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd019f830 con 0x7f3dd01049a0 2024-09-12T02:44:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.210+0000 7f3dc6a00640 1 -- 172.21.15.18:0/1927175160 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dbc031ca0 con 0x7f3dd01049a0 2024-09-12T02:44:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.210+0000 7f3dc6a00640 1 -- 172.21.15.18:0/1927175160 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc035030 con 0x7f3dd01049a0 2024-09-12T02:44:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.210+0000 7f3dd4e00640 1 -- 172.21.15.18:0/1927175160 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd01a7170 con 0x7f3dd01049a0 2024-09-12T02:44:51.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.211+0000 7f3dd4e00640 1 -- 172.21.15.18:0/1927175160 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd01043d0 con 0x7f3dd01049a0 2024-09-12T02:44:51.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.213+0000 7f3dc6a00640 1 -- 172.21.15.18:0/1927175160 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3dbc042070 con 0x7f3dd01049a0 2024-09-12T02:44:51.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.214+0000 7f3dc6a00640 1 --2- 172.21.15.18:0/1927175160 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3db40a2b80 0x7f3db40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:51.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.214+0000 7f3dc6a00640 1 -- 172.21.15.18:0/1927175160 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7f3dbc0ef220 con 0x7f3dd01049a0 2024-09-12T02:44:51.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.215+0000 7f3dcde00640 1 --2- 172.21.15.18:0/1927175160 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3db40a2b80 0x7f3db40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:51.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.215+0000 7f3dcde00640 1 --2- 172.21.15.18:0/1927175160 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3db40a2b80 0x7f3db40a5040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00095f0 tx=0x7f3dc0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:51.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.218+0000 7f3dc6a00640 1 -- 172.21.15.18:0/1927175160 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3dbc0bbff0 con 0x7f3dd01049a0 2024-09-12T02:44:51.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.451+0000 7f3dd4e00640 1 -- 172.21.15.18:0/1927175160 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dd01a7340 con 0x7f3dd01049a0 2024-09-12T02:44:51.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.451+0000 7f3dc6a00640 1 -- 172.21.15.18:0/1927175160 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7f3dbc0c02f0 con 0x7f3dd01049a0 2024-09-12T02:44:51.452 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:44:51.452 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":3,"btime":"2024-09-12T02:44:51:003241+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:44:51.452 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 3 2024-09-12T02:44:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.454+0000 7f3dd4e00640 1 -- 172.21.15.18:0/1927175160 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3db40a2b80 msgr2=0x7f3db40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.454+0000 7f3dd4e00640 1 --2- 172.21.15.18:0/1927175160 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3db40a2b80 0x7f3db40a5040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00095f0 tx=0x7f3dc0005f90 comp rx=0 tx=0).stop 2024-09-12T02:44:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.454+0000 7f3dd4e00640 1 -- 172.21.15.18:0/1927175160 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd01049a0 msgr2=0x7f3dd019ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.454+0000 7f3dd4e00640 1 --2- 172.21.15.18:0/1927175160 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd01049a0 0x7f3dd019ab30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc004770 tx=0x7f3dbc003c10 comp rx=0 tx=0).stop 2024-09-12T02:44:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.454+0000 7f3dd4e00640 1 -- 172.21.15.18:0/1927175160 shutdown_connections 2024-09-12T02:44:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.454+0000 7f3dd4e00640 1 --2- 172.21.15.18:0/1927175160 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3db40a2b80 0x7f3db40a5040 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.454+0000 7f3dd4e00640 1 --2- 172.21.15.18:0/1927175160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3dd0109120 0x7f3dd019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:51.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.454+0000 7f3dd4e00640 1 --2- 172.21.15.18:0/1927175160 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd01049a0 0x7f3dd019ab30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:51.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.454+0000 7f3dd4e00640 1 --2- 172.21.15.18:0/1927175160 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3dd0103ff0 0x7f3dd019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:51.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.454+0000 7f3dd4e00640 1 -- 172.21.15.18:0/1927175160 >> 172.21.15.18:0/1927175160 conn(0x7f3dd00ffa90 msgr2=0x7f3dd0101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:51.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.454+0000 7f3dd4e00640 1 -- 172.21.15.18:0/1927175160 shutdown_connections 2024-09-12T02:44:51.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:51.454+0000 7f3dd4e00640 1 -- 172.21.15.18:0/1927175160 wait complete. 2024-09-12T02:44:52.016 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:51 smithi018 ceph-mon[30616]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:52.016 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:51 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:52.017 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:51 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:52.017 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:51 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:52.020 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:51 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:44:52.020 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:51 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:44:52.020 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:51 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:52.020 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:51 smithi018 ceph-mon[30616]: Deploying daemon mds.j on smithi018 2024-09-12T02:44:52.021 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:51 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.62:6832/1160389785,v1:172.21.15.62:6833/1160389785] up:boot 2024-09-12T02:44:52.021 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:51 smithi018 ceph-mon[30616]: fsmap 2 up:standby 2024-09-12T02:44:52.021 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:51 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:44:52.021 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:51 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1927175160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:52.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:51 smithi176 ceph-mon[35713]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:52.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:51 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:52.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:51 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:52.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:51 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:52.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:51 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:44:52.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:51 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:44:52.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:51 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:52.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:51 smithi176 ceph-mon[35713]: Deploying daemon mds.j on smithi018 2024-09-12T02:44:52.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:51 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.62:6832/1160389785,v1:172.21.15.62:6833/1160389785] up:boot 2024-09-12T02:44:52.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:51 smithi176 ceph-mon[35713]: fsmap 2 up:standby 2024-09-12T02:44:52.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:51 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:44:52.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:51 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1927175160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:52.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:51 smithi062 ceph-mon[35527]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:52.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:51 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:52.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:51 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:52.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:51 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:52.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:51 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:44:52.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:51 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:44:52.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:51 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:52.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:51 smithi062 ceph-mon[35527]: Deploying daemon mds.j on smithi018 2024-09-12T02:44:52.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:51 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.62:6832/1160389785,v1:172.21.15.62:6833/1160389785] up:boot 2024-09-12T02:44:52.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:51 smithi062 ceph-mon[35527]: fsmap 2 up:standby 2024-09-12T02:44:52.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:51 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:44:52.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:51 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1927175160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:54.062 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:53 smithi062 ceph-mon[35527]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:54.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:53 smithi018 ceph-mon[30616]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:54.101 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 02:44:53 smithi018 podman[69777]: 2024-09-12 02:44:53.909853888 +0000 UTC m=+0.148819797 container create 27b489837ab4f00bd786b4d1294d7816d8d57f8945cc36ad1d664fa0aebc44fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-j, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T02:44:54.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:53 smithi176 ceph-mon[35713]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:54.601 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 02:44:54 smithi018 podman[69777]: 2024-09-12 02:44:54.32961286 +0000 UTC m=+0.568578775 container init 27b489837ab4f00bd786b4d1294d7816d8d57f8945cc36ad1d664fa0aebc44fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T02:44:54.601 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 02:44:54 smithi018 podman[69777]: 2024-09-12 02:44:54.336110588 +0000 UTC m=+0.575076498 container start 27b489837ab4f00bd786b4d1294d7816d8d57f8945cc36ad1d664fa0aebc44fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-j, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:44:54.601 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 02:44:54 smithi018 ceph-mds[69795]: -- 172.21.15.18:0/1165279019 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5608c9aa6680 con 0x5608c9a7b400 2024-09-12T02:44:54.601 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 02:44:54 smithi018 ceph-mds[69795]: -- 172.21.15.18:0/1165279019 <== mon.0 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5608c9a9dc20 con 0x5608c9a7b400 2024-09-12T02:44:54.601 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 02:44:54 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-j[69791]: starting mds.j at 2024-09-12T02:44:54.601 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 02:44:54 smithi018 bash[69777]: 27b489837ab4f00bd786b4d1294d7816d8d57f8945cc36ad1d664fa0aebc44fe 2024-09-12T02:44:54.601 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 02:44:54 smithi018 systemd[1]: Started Ceph mds.j for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:44:55.642 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:44:55.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:55 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:55.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:55 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:55.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:55 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:55.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:55 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:44:55.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:55 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:44:55.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:55 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:55.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:55 smithi062 ceph-mon[35527]: Deploying daemon mds.d on smithi018 2024-09-12T02:44:55.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:55 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.18:6834/43234729,v1:172.21.15.18:6835/43234729] up:boot 2024-09-12T02:44:55.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:55 smithi062 ceph-mon[35527]: fsmap 3 up:standby 2024-09-12T02:44:55.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:55 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:44:55.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:55 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:55 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:55 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:55 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:44:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:55 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:44:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:55 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:55 smithi018 ceph-mon[30616]: Deploying daemon mds.d on smithi018 2024-09-12T02:44:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:55 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.18:6834/43234729,v1:172.21.15.18:6835/43234729] up:boot 2024-09-12T02:44:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:55 smithi018 ceph-mon[30616]: fsmap 3 up:standby 2024-09-12T02:44:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:55 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:44:55.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:55 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:55 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:55 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:55 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:44:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:55 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:44:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:55 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:55 smithi176 ceph-mon[35713]: Deploying daemon mds.d on smithi018 2024-09-12T02:44:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:55 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.18:6834/43234729,v1:172.21.15.18:6835/43234729] up:boot 2024-09-12T02:44:55.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:55 smithi176 ceph-mon[35713]: fsmap 3 up:standby 2024-09-12T02:44:55.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:55 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:44:56.498 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:44:56.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:56 smithi018 ceph-mon[30616]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:56.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:56 smithi176 ceph-mon[35713]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:57.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:56 smithi062 ceph-mon[35527]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:57.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.218+0000 7f2073a00640 1 -- 172.21.15.18:0/3885806344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f206c1027a0 msgr2=0x7f206c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:57.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.218+0000 7f2073a00640 1 --2- 172.21.15.18:0/3885806344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f206c1027a0 0x7f206c1067f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2058009900 tx=0x7f205802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:44:57.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.219+0000 7f2073a00640 1 -- 172.21.15.18:0/3885806344 shutdown_connections 2024-09-12T02:44:57.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.219+0000 7f2073a00640 1 --2- 172.21.15.18:0/3885806344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c106f20 0x7f206c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:57.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.219+0000 7f2073a00640 1 --2- 172.21.15.18:0/3885806344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f206c1027a0 0x7f206c1067f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:57.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.219+0000 7f2073a00640 1 --2- 172.21.15.18:0/3885806344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f206c101df0 0x7f206c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:57.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.219+0000 7f2073a00640 1 -- 172.21.15.18:0/3885806344 >> 172.21.15.18:0/3885806344 conn(0x7f206c0fd8b0 msgr2=0x7f206c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:57.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.219+0000 7f2073a00640 1 -- 172.21.15.18:0/3885806344 shutdown_connections 2024-09-12T02:44:57.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.219+0000 7f2073a00640 1 -- 172.21.15.18:0/3885806344 wait complete. 2024-09-12T02:44:57.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.220+0000 7f2073a00640 1 Processor -- start 2024-09-12T02:44:57.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.220+0000 7f2073a00640 1 -- start start 2024-09-12T02:44:57.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.221+0000 7f2073a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f206c101df0 0x7f206c19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:57.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.221+0000 7f2073a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c1027a0 0x7f206c19ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:57.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.221+0000 7f2073a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f206c106f20 0x7f206c19efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:57.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.221+0000 7f2073a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f206c075f80 con 0x7f206c106f20 2024-09-12T02:44:57.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.221+0000 7f2073a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f206c075e00 con 0x7f206c101df0 2024-09-12T02:44:57.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.221+0000 7f2073a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f206c076100 con 0x7f206c1027a0 2024-09-12T02:44:57.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.221+0000 7f2071000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f206c101df0 0x7f206c19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:57.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.221+0000 7f2071000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f206c101df0 0x7f206c19a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:60426/0 (socket says 172.21.15.18:60426) 2024-09-12T02:44:57.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.221+0000 7f2071000640 1 -- 172.21.15.18:0/502437248 learned_addr learned my addr 172.21.15.18:0/502437248 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:44:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.221+0000 7f206be00640 1 --2- 172.21.15.18:0/502437248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c1027a0 0x7f206c19ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.221+0000 7f2071a00640 1 --2- 172.21.15.18:0/502437248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f206c106f20 0x7f206c19efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.221+0000 7f2071000640 1 -- 172.21.15.18:0/502437248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c1027a0 msgr2=0x7f206c19ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.221+0000 7f2071000640 1 --2- 172.21.15.18:0/502437248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c1027a0 0x7f206c19ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.221+0000 7f2071000640 1 -- 172.21.15.18:0/502437248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f206c106f20 msgr2=0x7f206c19efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.221+0000 7f2071000640 1 --2- 172.21.15.18:0/502437248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f206c106f20 0x7f206c19efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.222+0000 7f2071000640 1 -- 172.21.15.18:0/502437248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206c19f6b0 con 0x7f206c101df0 2024-09-12T02:44:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.222+0000 7f2071a00640 1 --2- 172.21.15.18:0/502437248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f206c106f20 0x7f206c19efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:44:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.222+0000 7f2071000640 1 --2- 172.21.15.18:0/502437248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f206c101df0 0x7f206c19a700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f206000e9f0 tx=0x7f206000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.222+0000 7f2069600640 1 -- 172.21.15.18:0/502437248 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206000cd80 con 0x7f206c101df0 2024-09-12T02:44:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.222+0000 7f2073a00640 1 -- 172.21.15.18:0/502437248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f206c19f9a0 con 0x7f206c101df0 2024-09-12T02:44:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.222+0000 7f2073a00640 1 -- 172.21.15.18:0/502437248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f206c1103e0 con 0x7f206c101df0 2024-09-12T02:44:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.223+0000 7f2069600640 1 -- 172.21.15.18:0/502437248 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2060010910 con 0x7f206c101df0 2024-09-12T02:44:57.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.223+0000 7f2069600640 1 -- 172.21.15.18:0/502437248 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20600188f0 con 0x7f206c101df0 2024-09-12T02:44:57.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.224+0000 7f2073a00640 1 -- 172.21.15.18:0/502437248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f204c005290 con 0x7f206c101df0 2024-09-12T02:44:57.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.226+0000 7f2069600640 1 -- 172.21.15.18:0/502437248 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2060018bd0 con 0x7f206c101df0 2024-09-12T02:44:57.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.227+0000 7f2069600640 1 --2- 172.21.15.18:0/502437248 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f20540a2c00 0x7f20540a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:44:57.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.227+0000 7f2069600640 1 -- 172.21.15.18:0/502437248 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7f20600cee60 con 0x7f206c101df0 2024-09-12T02:44:57.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.227+0000 7f206be00640 1 --2- 172.21.15.18:0/502437248 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f20540a2c00 0x7f20540a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:44:57.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.228+0000 7f206be00640 1 --2- 172.21.15.18:0/502437248 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f20540a2c00 0x7f20540a50c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2058009230 tx=0x7f20580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:44:57.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.231+0000 7f2069600640 1 -- 172.21.15.18:0/502437248 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f206009c1c0 con 0x7f206c101df0 2024-09-12T02:44:57.492 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 12 02:44:57 smithi018 systemd[1]: Starting Ceph mds.d for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T02:44:57.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.491+0000 7f2073a00640 1 -- 172.21.15.18:0/502437248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f204c005580 con 0x7f206c101df0 2024-09-12T02:44:57.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.492+0000 7f2069600640 1 -- 172.21.15.18:0/502437248 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3082 (secure 0 0 0) 0x7f206009bac0 con 0x7f206c101df0 2024-09-12T02:44:57.493 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:44:57.493 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":4,"btime":"2024-09-12T02:44:54:810002+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/43234729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":43234729},{"type":"v1","addr":"172.21.15.18:6835","nonce":43234729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-09-12T02:44:57.493 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 4 2024-09-12T02:44:57.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.494+0000 7f2073a00640 1 -- 172.21.15.18:0/502437248 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f20540a2c00 msgr2=0x7f20540a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:57.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.494+0000 7f2073a00640 1 --2- 172.21.15.18:0/502437248 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f20540a2c00 0x7f20540a50c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2058009230 tx=0x7f20580058d0 comp rx=0 tx=0).stop 2024-09-12T02:44:57.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.494+0000 7f2073a00640 1 -- 172.21.15.18:0/502437248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f206c101df0 msgr2=0x7f206c19a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:44:57.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.494+0000 7f2073a00640 1 --2- 172.21.15.18:0/502437248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f206c101df0 0x7f206c19a700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f206000e9f0 tx=0x7f206000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:44:57.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.495+0000 7f2073a00640 1 -- 172.21.15.18:0/502437248 shutdown_connections 2024-09-12T02:44:57.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.495+0000 7f2073a00640 1 --2- 172.21.15.18:0/502437248 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f20540a2c00 0x7f20540a50c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:57.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.495+0000 7f2073a00640 1 --2- 172.21.15.18:0/502437248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f206c106f20 0x7f206c19efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:57.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.495+0000 7f2073a00640 1 --2- 172.21.15.18:0/502437248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c1027a0 0x7f206c19ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:57.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.495+0000 7f2073a00640 1 --2- 172.21.15.18:0/502437248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f206c101df0 0x7f206c19a700 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:44:57.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.495+0000 7f2073a00640 1 -- 172.21.15.18:0/502437248 >> 172.21.15.18:0/502437248 conn(0x7f206c0fd8b0 msgr2=0x7f206c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:44:57.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.495+0000 7f2073a00640 1 -- 172.21.15.18:0/502437248 shutdown_connections 2024-09-12T02:44:57.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:44:57.495+0000 7f2073a00640 1 -- 172.21.15.18:0/502437248 wait complete. 2024-09-12T02:44:57.763 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:57 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/502437248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:57.763 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 12 02:44:57 smithi018 podman[70170]: 2024-09-12 02:44:57.487284472 +0000 UTC m=+0.034724659 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:44:57.763 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 12 02:44:57 smithi018 podman[70170]: 2024-09-12 02:44:57.619667499 +0000 UTC m=+0.167107664 container create 04132871406c8e397602cffb91af713bbe6217c6874f49366a4c1b5a76ab8b4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-d, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:44:57.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:57 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/502437248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:58.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:57 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/502437248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:44:58.788 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:58 smithi018 ceph-mon[30616]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:58.788 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 12 02:44:58 smithi018 podman[70170]: 2024-09-12 02:44:58.49206131 +0000 UTC m=+1.039501497 container init 04132871406c8e397602cffb91af713bbe6217c6874f49366a4c1b5a76ab8b4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-12T02:44:58.788 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 12 02:44:58 smithi018 podman[70170]: 2024-09-12 02:44:58.49881669 +0000 UTC m=+1.046256856 container start 04132871406c8e397602cffb91af713bbe6217c6874f49366a4c1b5a76ab8b4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-d, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-12T02:44:58.789 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 12 02:44:58 smithi018 ceph-mds[70212]: -- 172.21.15.18:0/4148659330 <== mon.0 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b4d26b860 con 0x559b4d249400 2024-09-12T02:44:58.789 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 12 02:44:58 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-d[70199]: starting mds.d at 2024-09-12T02:44:58.789 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 12 02:44:58 smithi018 bash[70170]: 04132871406c8e397602cffb91af713bbe6217c6874f49366a4c1b5a76ab8b4c 2024-09-12T02:44:58.789 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 12 02:44:58 smithi018 systemd[1]: Started Ceph mds.d for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:44:58.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:58 smithi062 ceph-mon[35527]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:58.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:58 smithi176 ceph-mon[35713]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:44:59.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:59 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.18:6836/747069368,v1:172.21.15.18:6837/747069368] up:boot 2024-09-12T02:44:59.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:59 smithi062 ceph-mon[35527]: fsmap 4 up:standby 2024-09-12T02:44:59.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:59 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:44:59.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:59 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:59.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:59 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:59.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:59 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:59.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:59 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:44:59.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:59 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:44:59.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:44:59 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:59.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:59 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.18:6836/747069368,v1:172.21.15.18:6837/747069368] up:boot 2024-09-12T02:44:59.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:59 smithi018 ceph-mon[30616]: fsmap 4 up:standby 2024-09-12T02:44:59.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:59 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:44:59.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:59 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:59.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:59 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:59.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:59 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:59.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:59 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:44:59.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:59 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:44:59.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:44:59 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:59.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:59 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.18:6836/747069368,v1:172.21.15.18:6837/747069368] up:boot 2024-09-12T02:44:59.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:59 smithi176 ceph-mon[35713]: fsmap 4 up:standby 2024-09-12T02:44:59.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:59 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:44:59.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:59 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:59.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:59 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:59.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:59 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:44:59.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:59 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:44:59.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:59 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:44:59.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:44:59 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:00.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:00 smithi018 ceph-mon[30616]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:00.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:00 smithi018 ceph-mon[30616]: Deploying daemon mds.e on smithi062 2024-09-12T02:45:00.974 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:00 smithi062 ceph-mon[35527]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:00.975 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:00 smithi062 ceph-mon[35527]: Deploying daemon mds.e on smithi062 2024-09-12T02:45:00.975 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 02:45:00 smithi062 systemd[1]: Starting Ceph mds.e for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T02:45:00.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:00 smithi176 ceph-mon[35713]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:00.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:00 smithi176 ceph-mon[35713]: Deploying daemon mds.e on smithi062 2024-09-12T02:45:01.041 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:45:01.280 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 02:45:00 smithi062 podman[65351]: 2024-09-12 02:45:00.87714486 +0000 UTC m=+0.015778502 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:45:01.280 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 02:45:01 smithi062 podman[65351]: 2024-09-12 02:45:01.00224407 +0000 UTC m=+0.140877712 container create d964d8b0ca40d42ed720bcdd577d92adf5655c3632c16092b8fe4dea2218bb16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-12T02:45:01.431 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:01.533 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 02:45:01 smithi062 podman[65351]: 2024-09-12 02:45:01.28012344 +0000 UTC m=+0.418757085 container init d964d8b0ca40d42ed720bcdd577d92adf5655c3632c16092b8fe4dea2218bb16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-e, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T02:45:01.534 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 02:45:01 smithi062 podman[65351]: 2024-09-12 02:45:01.283234192 +0000 UTC m=+0.421867843 container start d964d8b0ca40d42ed720bcdd577d92adf5655c3632c16092b8fe4dea2218bb16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-e, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-12T02:45:01.534 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 02:45:01 smithi062 ceph-mds[65370]: -- 172.21.15.62:0/3141011247 <== mon.2 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5590ca033860 con 0x5590ca010800 2024-09-12T02:45:01.534 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 02:45:01 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-e[65366]: starting mds.e at 2024-09-12T02:45:01.534 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 02:45:01 smithi062 bash[65351]: d964d8b0ca40d42ed720bcdd577d92adf5655c3632c16092b8fe4dea2218bb16 2024-09-12T02:45:01.534 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 02:45:01 smithi062 systemd[1]: Started Ceph mds.e for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:45:02.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.045+0000 7fd1c2200640 1 -- 172.21.15.18:0/357393235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1bc103ff0 msgr2=0x7fd1bc1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:02.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.045+0000 7fd1c2200640 1 --2- 172.21.15.18:0/357393235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1bc103ff0 0x7fd1bc1043d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac009900 tx=0x7fd1ac02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:45:02.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.045+0000 7fd1c2200640 1 -- 172.21.15.18:0/357393235 shutdown_connections 2024-09-12T02:45:02.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.045+0000 7fd1c2200640 1 --2- 172.21.15.18:0/357393235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1bc109120 0x7fd1bc110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:02.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.045+0000 7fd1c2200640 1 --2- 172.21.15.18:0/357393235 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1bc1049a0 0x7fd1bc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:02.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.045+0000 7fd1c2200640 1 --2- 172.21.15.18:0/357393235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1bc103ff0 0x7fd1bc1043d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:02.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.045+0000 7fd1c2200640 1 -- 172.21.15.18:0/357393235 >> 172.21.15.18:0/357393235 conn(0x7fd1bc0ffa90 msgr2=0x7fd1bc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:02.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.045+0000 7fd1c2200640 1 -- 172.21.15.18:0/357393235 shutdown_connections 2024-09-12T02:45:02.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.045+0000 7fd1c2200640 1 -- 172.21.15.18:0/357393235 wait complete. 2024-09-12T02:45:02.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.046+0000 7fd1c2200640 1 Processor -- start 2024-09-12T02:45:02.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.047+0000 7fd1c2200640 1 -- start start 2024-09-12T02:45:02.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.047+0000 7fd1c2200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1bc103ff0 0x7fd1bc19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:02.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.047+0000 7fd1c2200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1bc1049a0 0x7fd1bc19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:02.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.047+0000 7fd1c2200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1bc109120 0x7fd1bc19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:02.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.047+0000 7fd1c2200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd1bc114190 con 0x7fd1bc109120 2024-09-12T02:45:02.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.047+0000 7fd1c2200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd1bc114010 con 0x7fd1bc103ff0 2024-09-12T02:45:02.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.047+0000 7fd1c2200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd1bc114310 con 0x7fd1bc1049a0 2024-09-12T02:45:02.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.047+0000 7fd1baa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1bc1049a0 0x7fd1bc19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:02.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.047+0000 7fd1bb400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1bc103ff0 0x7fd1bc19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:02.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.047+0000 7fd1baa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1bc1049a0 0x7fd1bc19abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:42620/0 (socket says 172.21.15.18:42620) 2024-09-12T02:45:02.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.047+0000 7fd1baa00640 1 -- 172.21.15.18:0/3612179872 learned_addr learned my addr 172.21.15.18:0/3612179872 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:02.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.047+0000 7fd1bbe00640 1 --2- 172.21.15.18:0/3612179872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1bc109120 0x7fd1bc19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:02.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.048+0000 7fd1baa00640 1 -- 172.21.15.18:0/3612179872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1bc103ff0 msgr2=0x7fd1bc19a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:02.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.048+0000 7fd1baa00640 1 --2- 172.21.15.18:0/3612179872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1bc103ff0 0x7fd1bc19a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:02.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.048+0000 7fd1baa00640 1 -- 172.21.15.18:0/3612179872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1bc109120 msgr2=0x7fd1bc19ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:02.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.048+0000 7fd1baa00640 1 --2- 172.21.15.18:0/3612179872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1bc109120 0x7fd1bc19ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:02.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.048+0000 7fd1baa00640 1 -- 172.21.15.18:0/3612179872 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1bc19f640 con 0x7fd1bc1049a0 2024-09-12T02:45:02.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.048+0000 7fd1bb400640 1 --2- 172.21.15.18:0/3612179872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1bc103ff0 0x7fd1bc19a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:02.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.048+0000 7fd1baa00640 1 --2- 172.21.15.18:0/3612179872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1bc1049a0 0x7fd1bc19abd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd1a800e9f0 tx=0x7fd1a800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:02.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.048+0000 7fd1b3e00640 1 -- 172.21.15.18:0/3612179872 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a800cd80 con 0x7fd1bc1049a0 2024-09-12T02:45:02.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.048+0000 7fd1b3e00640 1 -- 172.21.15.18:0/3612179872 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1a8005500 con 0x7fd1bc1049a0 2024-09-12T02:45:02.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.048+0000 7fd1c2200640 1 -- 172.21.15.18:0/3612179872 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1bc19f930 con 0x7fd1bc1049a0 2024-09-12T02:45:02.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.048+0000 7fd1b3e00640 1 -- 172.21.15.18:0/3612179872 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8010690 con 0x7fd1bc1049a0 2024-09-12T02:45:02.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.048+0000 7fd1c2200640 1 -- 172.21.15.18:0/3612179872 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1bc1a7210 con 0x7fd1bc1049a0 2024-09-12T02:45:02.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.050+0000 7fd1c2200640 1 -- 172.21.15.18:0/3612179872 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1bc1043d0 con 0x7fd1bc1049a0 2024-09-12T02:45:02.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.051+0000 7fd1b3e00640 1 -- 172.21.15.18:0/3612179872 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd1a80046c0 con 0x7fd1bc1049a0 2024-09-12T02:45:02.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.053+0000 7fd1b3e00640 1 --2- 172.21.15.18:0/3612179872 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd1a00a2c00 0x7fd1a00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:02.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.053+0000 7fd1b3e00640 1 -- 172.21.15.18:0/3612179872 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7fd1a80cefc0 con 0x7fd1bc1049a0 2024-09-12T02:45:02.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.053+0000 7fd1bb400640 1 --2- 172.21.15.18:0/3612179872 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd1a00a2c00 0x7fd1a00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:02.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.054+0000 7fd1bb400640 1 --2- 172.21.15.18:0/3612179872 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd1a00a2c00 0x7fd1a00a50c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac000c00 tx=0x7fd1ac031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:02.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.056+0000 7fd1b3e00640 1 -- 172.21.15.18:0/3612179872 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd1a809c320 con 0x7fd1bc1049a0 2024-09-12T02:45:02.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.278+0000 7fd1c2200640 1 -- 172.21.15.18:0/3612179872 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1bc10bd70 con 0x7fd1bc1049a0 2024-09-12T02:45:02.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.279+0000 7fd1b3e00640 1 -- 172.21.15.18:0/3612179872 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4726 (secure 0 0 0) 0x7fd1a8086070 con 0x7fd1bc1049a0 2024-09-12T02:45:02.279 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:45:02.279 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":6,"btime":"2024-09-12T02:45:01:561375+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/747069368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":747069368},{"type":"v1","addr":"172.21.15.18:6837","nonce":747069368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/43234729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":43234729},{"type":"v1","addr":"172.21.15.18:6835","nonce":43234729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/564392030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":564392030},{"type":"v1","addr":"172.21.15.62:6835","nonce":564392030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-12T02:45:02.280 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 6 2024-09-12T02:45:02.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.281+0000 7fd1c2200640 1 -- 172.21.15.18:0/3612179872 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd1a00a2c00 msgr2=0x7fd1a00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.281+0000 7fd1c2200640 1 --2- 172.21.15.18:0/3612179872 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd1a00a2c00 0x7fd1a00a50c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac000c00 tx=0x7fd1ac031510 comp rx=0 tx=0).stop 2024-09-12T02:45:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.281+0000 7fd1c2200640 1 -- 172.21.15.18:0/3612179872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1bc1049a0 msgr2=0x7fd1bc19abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.281+0000 7fd1c2200640 1 --2- 172.21.15.18:0/3612179872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1bc1049a0 0x7fd1bc19abd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd1a800e9f0 tx=0x7fd1a800edf0 comp rx=0 tx=0).stop 2024-09-12T02:45:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.281+0000 7fd1c2200640 1 -- 172.21.15.18:0/3612179872 shutdown_connections 2024-09-12T02:45:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.281+0000 7fd1c2200640 1 --2- 172.21.15.18:0/3612179872 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd1a00a2c00 0x7fd1a00a50c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.281+0000 7fd1c2200640 1 --2- 172.21.15.18:0/3612179872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1bc109120 0x7fd1bc19ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.281+0000 7fd1c2200640 1 --2- 172.21.15.18:0/3612179872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1bc1049a0 0x7fd1bc19abd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.281+0000 7fd1c2200640 1 --2- 172.21.15.18:0/3612179872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1bc103ff0 0x7fd1bc19a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.281+0000 7fd1c2200640 1 -- 172.21.15.18:0/3612179872 >> 172.21.15.18:0/3612179872 conn(0x7fd1bc0ffa90 msgr2=0x7fd1bc100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.281+0000 7fd1c2200640 1 -- 172.21.15.18:0/3612179872 shutdown_connections 2024-09-12T02:45:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:02.281+0000 7fd1c2200640 1 -- 172.21.15.18:0/3612179872 wait complete. 2024-09-12T02:45:02.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:02 smithi176 ceph-mon[35713]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:02.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:02 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:02.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:02 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:02.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:02 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:02.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:02 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:02.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:02 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:02.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:02 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:02.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:02 smithi176 ceph-mon[35713]: Deploying daemon mds.f on smithi176 2024-09-12T02:45:02.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:02 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.62:6834/564392030,v1:172.21.15.62:6835/564392030] up:boot 2024-09-12T02:45:02.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:02 smithi176 ceph-mon[35713]: fsmap 5 up:standby 2024-09-12T02:45:02.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:02 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:45:02.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:02 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3612179872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:02.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:02 smithi018 ceph-mon[30616]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:02.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:02 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:02.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:02 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:02.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:02 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:02.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:02 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:02.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:02 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:02.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:02 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:02.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:02 smithi018 ceph-mon[30616]: Deploying daemon mds.f on smithi176 2024-09-12T02:45:02.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:02 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.62:6834/564392030,v1:172.21.15.62:6835/564392030] up:boot 2024-09-12T02:45:02.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:02 smithi018 ceph-mon[30616]: fsmap 5 up:standby 2024-09-12T02:45:02.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:02 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:45:02.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:02 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3612179872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:02.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:02 smithi062 ceph-mon[35527]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:02.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:02 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:02.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:02 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:02.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:02 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:02.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:02 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:02.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:02 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:02.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:02 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:02.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:02 smithi062 ceph-mon[35527]: Deploying daemon mds.f on smithi176 2024-09-12T02:45:02.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:02 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.62:6834/564392030,v1:172.21.15.62:6835/564392030] up:boot 2024-09-12T02:45:02.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:02 smithi062 ceph-mon[35527]: fsmap 5 up:standby 2024-09-12T02:45:02.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:02 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:45:02.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:02 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3612179872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:03.478 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 02:45:03 smithi176 systemd[1]: Starting Ceph mds.f for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T02:45:03.789 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 02:45:03 smithi176 podman[65773]: 2024-09-12 02:45:03.527687964 +0000 UTC m=+0.107290595 container create 5ee4c6c9ec25a8f381751a6e384c7256710f7b637e790bb9e859aa9be43a8a94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:45:03.789 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 02:45:03 smithi176 podman[65773]: 2024-09-12 02:45:03.436510875 +0000 UTC m=+0.016113518 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:45:03.789 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 02:45:03 smithi176 podman[65773]: 2024-09-12 02:45:03.788820326 +0000 UTC m=+0.368422963 container init 5ee4c6c9ec25a8f381751a6e384c7256710f7b637e790bb9e859aa9be43a8a94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T02:45:04.228 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 02:45:03 smithi176 podman[65773]: 2024-09-12 02:45:03.7917873 +0000 UTC m=+0.371389928 container start 5ee4c6c9ec25a8f381751a6e384c7256710f7b637e790bb9e859aa9be43a8a94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-f, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:45:04.229 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 02:45:03 smithi176 ceph-mds[65792]: -- 172.21.15.176:0/1929300030 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aa1a411860 con 0x55aa1a3ef400 2024-09-12T02:45:04.229 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 02:45:03 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-f[65788]: starting mds.f at 2024-09-12T02:45:04.229 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 02:45:03 smithi176 bash[65773]: 5ee4c6c9ec25a8f381751a6e384c7256710f7b637e790bb9e859aa9be43a8a94 2024-09-12T02:45:04.229 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 02:45:03 smithi176 systemd[1]: Started Ceph mds.f for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:45:04.613 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:04 smithi176 ceph-mon[35713]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:04.613 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:04 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:04.613 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:04 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:04.613 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:04 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:04.613 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:04 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:04.613 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:04 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:04.613 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:04 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:04.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:04 smithi062 ceph-mon[35527]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:04.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:04 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:04.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:04 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:04.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:04 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:04.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:04 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:04.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:04 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:04.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:04 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:04.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:04 smithi018 ceph-mon[30616]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:04.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:04 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:04.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:04 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:04.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:04 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:04.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:04 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:04.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:04 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:04.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:04 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:05.059 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:45:05.446 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:05.655 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:05 smithi176 ceph-mon[35713]: Deploying daemon mds.c on smithi176 2024-09-12T02:45:05.655 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:05 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.176:6834/3199321182,v1:172.21.15.176:6835/3199321182] up:boot 2024-09-12T02:45:05.655 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:05 smithi176 ceph-mon[35713]: fsmap 6 up:standby 2024-09-12T02:45:05.655 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:05 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:45:05.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:05 smithi062 ceph-mon[35527]: Deploying daemon mds.c on smithi176 2024-09-12T02:45:05.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:05 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.176:6834/3199321182,v1:172.21.15.176:6835/3199321182] up:boot 2024-09-12T02:45:05.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:05 smithi062 ceph-mon[35527]: fsmap 6 up:standby 2024-09-12T02:45:05.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:05 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:45:05.786 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:05 smithi018 ceph-mon[30616]: Deploying daemon mds.c on smithi176 2024-09-12T02:45:05.787 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:05 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.176:6834/3199321182,v1:172.21.15.176:6835/3199321182] up:boot 2024-09-12T02:45:05.787 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:05 smithi018 ceph-mon[30616]: fsmap 6 up:standby 2024-09-12T02:45:05.787 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:05 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:45:05.979 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 02:45:05 smithi176 systemd[1]: Starting Ceph mds.c for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T02:45:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.043+0000 7f484a400640 1 -- 172.21.15.18:0/2880286048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4844103ff0 msgr2=0x7f48441043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.043+0000 7f484a400640 1 --2- 172.21.15.18:0/2880286048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4844103ff0 0x7f48441043d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4834009900 tx=0x7f483402a400 comp rx=0 tx=0).stop 2024-09-12T02:45:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.043+0000 7f484a400640 1 -- 172.21.15.18:0/2880286048 shutdown_connections 2024-09-12T02:45:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.043+0000 7f484a400640 1 --2- 172.21.15.18:0/2880286048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4844109120 0x7f4844110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.043+0000 7f484a400640 1 --2- 172.21.15.18:0/2880286048 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48441049a0 0x7f48441089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.043+0000 7f484a400640 1 --2- 172.21.15.18:0/2880286048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4844103ff0 0x7f48441043d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.043+0000 7f484a400640 1 -- 172.21.15.18:0/2880286048 >> 172.21.15.18:0/2880286048 conn(0x7f48440ffa90 msgr2=0x7f4844101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.044+0000 7f484a400640 1 -- 172.21.15.18:0/2880286048 shutdown_connections 2024-09-12T02:45:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.044+0000 7f484a400640 1 -- 172.21.15.18:0/2880286048 wait complete. 2024-09-12T02:45:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.045+0000 7f484a400640 1 Processor -- start 2024-09-12T02:45:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.045+0000 7f484a400640 1 -- start start 2024-09-12T02:45:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.045+0000 7f484a400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4844103ff0 0x7f484419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.045+0000 7f484a400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48441049a0 0x7f484419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.045+0000 7f484a400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4844109120 0x7f484419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.045+0000 7f484a400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4844114170 con 0x7f4844103ff0 2024-09-12T02:45:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.045+0000 7f484a400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4844113ff0 con 0x7f48441049a0 2024-09-12T02:45:06.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.045+0000 7f484a400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f48441142f0 con 0x7f4844109120 2024-09-12T02:45:06.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.045+0000 7f4843400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4844103ff0 0x7f484419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:06.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.045+0000 7f4843400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4844103ff0 0x7f484419a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40254/0 (socket says 172.21.15.18:40254) 2024-09-12T02:45:06.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.046+0000 7f4843e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4844109120 0x7f484419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:06.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.046+0000 7f4843400640 1 -- 172.21.15.18:0/3869096152 learned_addr learned my addr 172.21.15.18:0/3869096152 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:06.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.046+0000 7f483be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48441049a0 0x7f484419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:06.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.046+0000 7f4843400640 1 -- 172.21.15.18:0/3869096152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4844109120 msgr2=0x7f484419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:06.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.046+0000 7f4843400640 1 --2- 172.21.15.18:0/3869096152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4844109120 0x7f484419ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:06.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.046+0000 7f4843400640 1 -- 172.21.15.18:0/3869096152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48441049a0 msgr2=0x7f484419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:06.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.046+0000 7f4843400640 1 --2- 172.21.15.18:0/3869096152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48441049a0 0x7f484419abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:06.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.046+0000 7f4843400640 1 -- 172.21.15.18:0/3869096152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f484419f620 con 0x7f4844103ff0 2024-09-12T02:45:06.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.046+0000 7f4843400640 1 --2- 172.21.15.18:0/3869096152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4844103ff0 0x7f484419a670 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4834004770 tx=0x7f4834003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:06.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.046+0000 7f4840c00640 1 -- 172.21.15.18:0/3869096152 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483403f070 con 0x7f4844103ff0 2024-09-12T02:45:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.047+0000 7f4840c00640 1 -- 172.21.15.18:0/3869096152 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4834031ca0 con 0x7f4844103ff0 2024-09-12T02:45:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.047+0000 7f4840c00640 1 -- 172.21.15.18:0/3869096152 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4834035030 con 0x7f4844103ff0 2024-09-12T02:45:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.047+0000 7f484a400640 1 -- 172.21.15.18:0/3869096152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f484419f8b0 con 0x7f4844103ff0 2024-09-12T02:45:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.047+0000 7f484a400640 1 -- 172.21.15.18:0/3869096152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48441a71f0 con 0x7f4844103ff0 2024-09-12T02:45:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.048+0000 7f484a400640 1 -- 172.21.15.18:0/3869096152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48441043d0 con 0x7f4844103ff0 2024-09-12T02:45:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.050+0000 7f4840c00640 1 -- 172.21.15.18:0/3869096152 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4834042070 con 0x7f4844103ff0 2024-09-12T02:45:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.052+0000 7f4840c00640 1 --2- 172.21.15.18:0/3869096152 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f48280a2b80 0x7f48280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.052+0000 7f4840c00640 1 -- 172.21.15.18:0/3869096152 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7f48340ef220 con 0x7f4844103ff0 2024-09-12T02:45:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.052+0000 7f483be00640 1 --2- 172.21.15.18:0/3869096152 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f48280a2b80 0x7f48280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.053+0000 7f483be00640 1 --2- 172.21.15.18:0/3869096152 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f48280a2b80 0x7f48280a5040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f48440fff40 tx=0x7f482c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.056+0000 7f4840c00640 1 -- 172.21.15.18:0/3869096152 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f48340bbff0 con 0x7f4844103ff0 2024-09-12T02:45:06.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.277+0000 7f484a400640 1 -- 172.21.15.18:0/3869096152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f484410c300 con 0x7f4844103ff0 2024-09-12T02:45:06.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.278+0000 7f4840c00640 1 -- 172.21.15.18:0/3869096152 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5554 (secure 0 0 0) 0x7f48340c02f0 con 0x7f4844103ff0 2024-09-12T02:45:06.279 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:45:06.279 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":7,"btime":"2024-09-12T02:45:04:438795+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/747069368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":747069368},{"type":"v1","addr":"172.21.15.18:6837","nonce":747069368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/43234729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":43234729},{"type":"v1","addr":"172.21.15.18:6835","nonce":43234729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/564392030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":564392030},{"type":"v1","addr":"172.21.15.62:6835","nonce":564392030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3199321182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3199321182},{"type":"v1","addr":"172.21.15.176:6835","nonce":3199321182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-12T02:45:06.279 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 7 2024-09-12T02:45:06.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.280+0000 7f484a400640 1 -- 172.21.15.18:0/3869096152 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f48280a2b80 msgr2=0x7f48280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:06.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.280+0000 7f484a400640 1 --2- 172.21.15.18:0/3869096152 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f48280a2b80 0x7f48280a5040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f48440fff40 tx=0x7f482c005f90 comp rx=0 tx=0).stop 2024-09-12T02:45:06.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.280+0000 7f484a400640 1 -- 172.21.15.18:0/3869096152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4844103ff0 msgr2=0x7f484419a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:06.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.280+0000 7f484a400640 1 --2- 172.21.15.18:0/3869096152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4844103ff0 0x7f484419a670 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4834004770 tx=0x7f4834003c10 comp rx=0 tx=0).stop 2024-09-12T02:45:06.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.280+0000 7f484a400640 1 -- 172.21.15.18:0/3869096152 shutdown_connections 2024-09-12T02:45:06.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.280+0000 7f484a400640 1 --2- 172.21.15.18:0/3869096152 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f48280a2b80 0x7f48280a5040 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:06.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.280+0000 7f484a400640 1 --2- 172.21.15.18:0/3869096152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4844109120 0x7f484419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:06.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.280+0000 7f484a400640 1 --2- 172.21.15.18:0/3869096152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48441049a0 0x7f484419abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:06.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.280+0000 7f484a400640 1 --2- 172.21.15.18:0/3869096152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4844103ff0 0x7f484419a670 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:06.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.280+0000 7f484a400640 1 -- 172.21.15.18:0/3869096152 >> 172.21.15.18:0/3869096152 conn(0x7f48440ffa90 msgr2=0x7f4844100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:06.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.281+0000 7f484a400640 1 -- 172.21.15.18:0/3869096152 shutdown_connections 2024-09-12T02:45:06.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:06.281+0000 7f484a400640 1 -- 172.21.15.18:0/3869096152 wait complete. 2024-09-12T02:45:06.318 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 02:45:06 smithi176 podman[66078]: 2024-09-12 02:45:05.961664815 +0000 UTC m=+0.015888079 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:45:06.319 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 02:45:06 smithi176 podman[66078]: 2024-09-12 02:45:06.082389492 +0000 UTC m=+0.136612756 container create 3e6e43c73e3a93bfb43e955f769a4b1e273c17b554ba53376bb563302c903c8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-12T02:45:06.319 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 02:45:06 smithi176 podman[66078]: 2024-09-12 02:45:06.318618335 +0000 UTC m=+0.372841600 container init 3e6e43c73e3a93bfb43e955f769a4b1e273c17b554ba53376bb563302c903c8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-c, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T02:45:06.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:06 smithi018 ceph-mon[30616]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:06.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:06 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3869096152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:06.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:06 smithi176 ceph-mon[35713]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:06.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:06 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3869096152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:06.729 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 02:45:06 smithi176 podman[66078]: 2024-09-12 02:45:06.321428906 +0000 UTC m=+0.375652170 container start 3e6e43c73e3a93bfb43e955f769a4b1e273c17b554ba53376bb563302c903c8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True) 2024-09-12T02:45:06.729 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 02:45:06 smithi176 ceph-mds[66097]: -- 172.21.15.176:0/61432869 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56140c9fbc20 con 0x56140c9d9000 2024-09-12T02:45:06.729 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 02:45:06 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-c[66093]: starting mds.c at 2024-09-12T02:45:06.729 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 02:45:06 smithi176 bash[66078]: 3e6e43c73e3a93bfb43e955f769a4b1e273c17b554ba53376bb563302c903c8d 2024-09-12T02:45:06.729 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 02:45:06 smithi176 systemd[1]: Started Ceph mds.c for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:45:06.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:06 smithi062 ceph-mon[35527]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:06.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:06 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3869096152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:07.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:07 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] up:boot 2024-09-12T02:45:07.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:07 smithi176 ceph-mon[35713]: fsmap 7 up:standby 2024-09-12T02:45:07.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:45:07.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:07.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:07.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:07.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:07.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:07.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:07 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:07.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:07 smithi176 ceph-mon[35713]: Deploying daemon mds.h on smithi062 2024-09-12T02:45:07.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:07 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] up:boot 2024-09-12T02:45:07.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:07 smithi062 ceph-mon[35527]: fsmap 7 up:standby 2024-09-12T02:45:07.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:45:07.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:07.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:07.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:07.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:07.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:07.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:07 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:07.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:07 smithi062 ceph-mon[35527]: Deploying daemon mds.h on smithi062 2024-09-12T02:45:07.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:07 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] up:boot 2024-09-12T02:45:07.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:07 smithi018 ceph-mon[30616]: fsmap 7 up:standby 2024-09-12T02:45:07.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:45:07.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:07.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:07.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:07.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:07.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:07.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:07 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:07.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:07 smithi018 ceph-mon[30616]: Deploying daemon mds.h on smithi062 2024-09-12T02:45:08.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:08 smithi062 ceph-mon[35527]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:08.764 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 02:45:08 smithi062 systemd[1]: Starting Ceph mds.h for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T02:45:08.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:08 smithi018 ceph-mon[30616]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:08.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:08 smithi176 ceph-mon[35713]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:09.033 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 02:45:08 smithi062 podman[65652]: 2024-09-12 02:45:08.66596294 +0000 UTC m=+0.016052964 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:45:09.033 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 02:45:08 smithi062 podman[65652]: 2024-09-12 02:45:08.791592127 +0000 UTC m=+0.141682150 container create 71fddda72f21348dcfc1d9453bb505fb1360f5d0fc14cadd5f4098946880f8a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:45:09.122 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:45:09.369 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 02:45:09 smithi062 podman[65652]: 2024-09-12 02:45:09.077654224 +0000 UTC m=+0.427744249 container init 71fddda72f21348dcfc1d9453bb505fb1360f5d0fc14cadd5f4098946880f8a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-h, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:45:09.369 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 02:45:09 smithi062 podman[65652]: 2024-09-12 02:45:09.080508245 +0000 UTC m=+0.430598275 container start 71fddda72f21348dcfc1d9453bb505fb1360f5d0fc14cadd5f4098946880f8a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-h, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-12T02:45:09.369 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 02:45:09 smithi062 ceph-mds[65671]: -- 172.21.15.62:0/146603698 <== mon.2 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56247b129860 con 0x56247b107000 2024-09-12T02:45:09.369 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 02:45:09 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-h[65667]: starting mds.h at 2024-09-12T02:45:09.369 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 02:45:09 smithi062 bash[65652]: 71fddda72f21348dcfc1d9453bb505fb1360f5d0fc14cadd5f4098946880f8a7 2024-09-12T02:45:09.369 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 02:45:09 smithi062 systemd[1]: Started Ceph mds.h for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:45:09.536 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:10.290 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:10 smithi018 ceph-mon[30616]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:10.290 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:10.290 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:10.290 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:10.290 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:10.290 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:10.291 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:10.291 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:10 smithi018 ceph-mon[30616]: Deploying daemon mds.i on smithi176 2024-09-12T02:45:10.291 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:10 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] up:boot 2024-09-12T02:45:10.291 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:10 smithi018 ceph-mon[30616]: fsmap 8 up:standby 2024-09-12T02:45:10.291 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:10 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:45:10.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.289+0000 7f8028800640 1 -- 172.21.15.18:0/413660194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8020109140 msgr2=0x7f8020110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:10.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.289+0000 7f8028800640 1 --2- 172.21.15.18:0/413660194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8020109140 0x7f8020110cc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f801c009ca0 tx=0x7f801c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:45:10.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.289+0000 7f8028800640 1 -- 172.21.15.18:0/413660194 shutdown_connections 2024-09-12T02:45:10.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.289+0000 7f8028800640 1 --2- 172.21.15.18:0/413660194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8020109140 0x7f8020110cc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:10.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.289+0000 7f8028800640 1 --2- 172.21.15.18:0/413660194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80201049c0 0x7f8020108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:10.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.289+0000 7f8028800640 1 --2- 172.21.15.18:0/413660194 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8020104010 0x7f80201043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:10.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.289+0000 7f8028800640 1 -- 172.21.15.18:0/413660194 >> 172.21.15.18:0/413660194 conn(0x7f80200ffa50 msgr2=0x7f8020101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:10.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.289+0000 7f8028800640 1 -- 172.21.15.18:0/413660194 shutdown_connections 2024-09-12T02:45:10.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.289+0000 7f8028800640 1 -- 172.21.15.18:0/413660194 wait complete. 2024-09-12T02:45:10.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.290+0000 7f8028800640 1 Processor -- start 2024-09-12T02:45:10.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.290+0000 7f8028800640 1 -- start start 2024-09-12T02:45:10.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.291+0000 7f8028800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8020104010 0x7f802019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:10.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.291+0000 7f8028800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80201049c0 0x7f802019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:10.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.291+0000 7f8028800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8020109140 0x7f802019ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:10.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.291+0000 7f8028800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f80201141c0 con 0x7f80201049c0 2024-09-12T02:45:10.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.291+0000 7f8028800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8020114040 con 0x7f8020104010 2024-09-12T02:45:10.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.291+0000 7f8028800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8020114340 con 0x7f8020109140 2024-09-12T02:45:10.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.291+0000 7f8025400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80201049c0 0x7f802019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:10.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.291+0000 7f8025e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8020104010 0x7f802019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:10.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.291+0000 7f8025e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8020104010 0x7f802019a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:43224/0 (socket says 172.21.15.18:43224) 2024-09-12T02:45:10.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.291+0000 7f8025400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80201049c0 0x7f802019ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40264/0 (socket says 172.21.15.18:40264) 2024-09-12T02:45:10.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.291+0000 7f8025e00640 1 -- 172.21.15.18:0/3991716614 learned_addr learned my addr 172.21.15.18:0/3991716614 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:10.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.291+0000 7f8026800640 1 --2- 172.21.15.18:0/3991716614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8020109140 0x7f802019ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.292+0000 7f8025400640 1 -- 172.21.15.18:0/3991716614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8020109140 msgr2=0x7f802019ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.292+0000 7f8025400640 1 --2- 172.21.15.18:0/3991716614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8020109140 0x7f802019ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.292+0000 7f8025400640 1 -- 172.21.15.18:0/3991716614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8020104010 msgr2=0x7f802019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.292+0000 7f8025400640 1 --2- 172.21.15.18:0/3991716614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8020104010 0x7f802019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.292+0000 7f8025400640 1 -- 172.21.15.18:0/3991716614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802019f670 con 0x7f80201049c0 2024-09-12T02:45:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.292+0000 7f8025400640 1 --2- 172.21.15.18:0/3991716614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80201049c0 0x7f802019ac00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f801000e9f0 tx=0x7f801000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.292+0000 7f801aa00640 1 -- 172.21.15.18:0/3991716614 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801000ccc0 con 0x7f80201049c0 2024-09-12T02:45:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.292+0000 7f801aa00640 1 -- 172.21.15.18:0/3991716614 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8010010910 con 0x7f80201049c0 2024-09-12T02:45:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.292+0000 7f8028800640 1 -- 172.21.15.18:0/3991716614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f802019f960 con 0x7f80201049c0 2024-09-12T02:45:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.292+0000 7f801aa00640 1 -- 172.21.15.18:0/3991716614 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8010018960 con 0x7f80201049c0 2024-09-12T02:45:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.292+0000 7f8028800640 1 -- 172.21.15.18:0/3991716614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80201a7240 con 0x7f80201049c0 2024-09-12T02:45:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.293+0000 7f8028800640 1 -- 172.21.15.18:0/3991716614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80201043f0 con 0x7f80201049c0 2024-09-12T02:45:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.295+0000 7f801aa00640 1 -- 172.21.15.18:0/3991716614 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8010010ac0 con 0x7f80201049c0 2024-09-12T02:45:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.296+0000 7f801aa00640 1 --2- 172.21.15.18:0/3991716614 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f80080a2c00 0x7f80080a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:10.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.297+0000 7f801aa00640 1 -- 172.21.15.18:0/3991716614 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7f80100ceef0 con 0x7f80201049c0 2024-09-12T02:45:10.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.297+0000 7f8025e00640 1 --2- 172.21.15.18:0/3991716614 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f80080a2c00 0x7f80080a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:10.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.298+0000 7f8025e00640 1 --2- 172.21.15.18:0/3991716614 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f80080a2c00 0x7f80080a50c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8014009cd0 tx=0x7f8014005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:10.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.301+0000 7f801aa00640 1 -- 172.21.15.18:0/3991716614 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f801009bc00 con 0x7f80201049c0 2024-09-12T02:45:10.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:10 smithi176 ceph-mon[35713]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:10.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:10 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:10.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:10 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:10.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:10 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:10.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:10 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:10.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:10 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:10.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:10 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:10.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:10 smithi176 ceph-mon[35713]: Deploying daemon mds.i on smithi176 2024-09-12T02:45:10.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:10 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] up:boot 2024-09-12T02:45:10.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:10 smithi176 ceph-mon[35713]: fsmap 8 up:standby 2024-09-12T02:45:10.481 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:10 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:45:10.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.525+0000 7f8028800640 1 -- 172.21.15.18:0/3991716614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f802010bdf0 con 0x7f80201049c0 2024-09-12T02:45:10.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.525+0000 7f801aa00640 1 -- 172.21.15.18:0/3991716614 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7207 (secure 0 0 0) 0x7f801009ff00 con 0x7f80201049c0 2024-09-12T02:45:10.526 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:45:10.526 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"btime":"2024-09-12T02:45:09:484299+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/747069368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":747069368},{"type":"v1","addr":"172.21.15.18:6837","nonce":747069368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/43234729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":43234729},{"type":"v1","addr":"172.21.15.18:6835","nonce":43234729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/564392030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":564392030},{"type":"v1","addr":"172.21.15.62:6835","nonce":564392030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3199321182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3199321182},{"type":"v1","addr":"172.21.15.176:6835","nonce":3199321182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/3520593627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3520593627},{"type":"v1","addr":"172.21.15.62:6837","nonce":3520593627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4286557016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4286557016},{"type":"v1","addr":"172.21.15.176:6837","nonce":4286557016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-12T02:45:10.526 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-09-12T02:45:10.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.528+0000 7f8028800640 1 -- 172.21.15.18:0/3991716614 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f80080a2c00 msgr2=0x7f80080a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:10.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.528+0000 7f8028800640 1 --2- 172.21.15.18:0/3991716614 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f80080a2c00 0x7f80080a50c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8014009cd0 tx=0x7f8014005f90 comp rx=0 tx=0).stop 2024-09-12T02:45:10.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.528+0000 7f8028800640 1 -- 172.21.15.18:0/3991716614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80201049c0 msgr2=0x7f802019ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:10.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.528+0000 7f8028800640 1 --2- 172.21.15.18:0/3991716614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80201049c0 0x7f802019ac00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f801000e9f0 tx=0x7f801000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:45:10.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.528+0000 7f8028800640 1 -- 172.21.15.18:0/3991716614 shutdown_connections 2024-09-12T02:45:10.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.528+0000 7f8028800640 1 --2- 172.21.15.18:0/3991716614 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f80080a2c00 0x7f80080a50c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:10.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.528+0000 7f8028800640 1 --2- 172.21.15.18:0/3991716614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8020109140 0x7f802019ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:10.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.528+0000 7f8028800640 1 --2- 172.21.15.18:0/3991716614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80201049c0 0x7f802019ac00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:10.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.528+0000 7f8028800640 1 --2- 172.21.15.18:0/3991716614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8020104010 0x7f802019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:10.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.528+0000 7f8028800640 1 -- 172.21.15.18:0/3991716614 >> 172.21.15.18:0/3991716614 conn(0x7f80200ffa50 msgr2=0x7f8020100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:10.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.528+0000 7f8028800640 1 -- 172.21.15.18:0/3991716614 shutdown_connections 2024-09-12T02:45:10.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:10.528+0000 7f8028800640 1 -- 172.21.15.18:0/3991716614 wait complete. 2024-09-12T02:45:10.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:10 smithi062 ceph-mon[35527]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:10.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:10 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:10.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:10 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:10.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:10 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:10.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:10 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:10.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:10 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:10.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:10 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:10.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:10 smithi062 ceph-mon[35527]: Deploying daemon mds.i on smithi176 2024-09-12T02:45:10.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:10 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] up:boot 2024-09-12T02:45:10.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:10 smithi062 ceph-mon[35527]: fsmap 8 up:standby 2024-09-12T02:45:10.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:10 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:45:11.472 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:11 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3991716614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:11.472 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 02:45:11 smithi176 systemd[1]: Starting Ceph mds.i for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T02:45:11.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:11 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3991716614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:11.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:11 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3991716614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:11.729 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 02:45:11 smithi176 podman[66377]: 2024-09-12 02:45:11.374498276 +0000 UTC m=+0.016158393 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:45:11.729 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 02:45:11 smithi176 podman[66377]: 2024-09-12 02:45:11.48757695 +0000 UTC m=+0.129237065 container create 5fbba7b093089e1f779d5c13f9a40afc6cf10e7678f21e6e7098b7efba1e7238 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-12T02:45:12.229 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 02:45:11 smithi176 podman[66377]: 2024-09-12 02:45:11.74049942 +0000 UTC m=+0.382159535 container init 5fbba7b093089e1f779d5c13f9a40afc6cf10e7678f21e6e7098b7efba1e7238 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-i, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T02:45:12.229 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 02:45:11 smithi176 podman[66377]: 2024-09-12 02:45:11.743219212 +0000 UTC m=+0.384879328 container start 5fbba7b093089e1f779d5c13f9a40afc6cf10e7678f21e6e7098b7efba1e7238 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-i, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-12T02:45:12.229 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 02:45:11 smithi176 ceph-mds[66396]: -- 172.21.15.176:0/1853276716 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55948d95d860 con 0x55948d93a800 2024-09-12T02:45:12.229 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 02:45:11 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-i[66392]: starting mds.i at 2024-09-12T02:45:12.229 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 02:45:11 smithi176 bash[66377]: 5fbba7b093089e1f779d5c13f9a40afc6cf10e7678f21e6e7098b7efba1e7238 2024-09-12T02:45:12.229 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 02:45:11 smithi176 systemd[1]: Started Ceph mds.i for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:45:12.515 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:12 smithi018 ceph-mon[30616]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:12.515 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:12.515 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:12.515 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:12.515 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:12.515 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:12.516 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:12.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:12 smithi062 ceph-mon[35527]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:12.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:12.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:12.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:12.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:12.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:12.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:12.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:12 smithi176 ceph-mon[35713]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:12.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:12.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:12.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:12.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:12.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:12.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:13.343 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:45:13.502 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:13 smithi018 ceph-mon[30616]: Deploying daemon mds.g on smithi018 2024-09-12T02:45:13.502 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:13 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] up:boot 2024-09-12T02:45:13.502 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:13 smithi018 ceph-mon[30616]: fsmap 9 up:standby 2024-09-12T02:45:13.502 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:13 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:45:13.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:13 smithi062 ceph-mon[35527]: Deploying daemon mds.g on smithi018 2024-09-12T02:45:13.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:13 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] up:boot 2024-09-12T02:45:13.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:13 smithi062 ceph-mon[35527]: fsmap 9 up:standby 2024-09-12T02:45:13.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:13 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:45:13.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:13 smithi176 ceph-mon[35713]: Deploying daemon mds.g on smithi018 2024-09-12T02:45:13.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:13 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] up:boot 2024-09-12T02:45:13.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:13 smithi176 ceph-mon[35713]: fsmap 9 up:standby 2024-09-12T02:45:13.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:13 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:45:14.183 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:14.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:14 smithi062 ceph-mon[35527]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:14.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:14 smithi018 ceph-mon[30616]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:14.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:14 smithi176 ceph-mon[35713]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:15.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.076+0000 7f3054c00640 1 -- 172.21.15.18:0/1867837897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3050074eb0 msgr2=0x7f3050112490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:15.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.076+0000 7f3054c00640 1 --2- 172.21.15.18:0/1867837897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3050074eb0 0x7f3050112490 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3038009900 tx=0x7f303802a480 comp rx=0 tx=0).stop 2024-09-12T02:45:15.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.076+0000 7f3054c00640 1 -- 172.21.15.18:0/1867837897 shutdown_connections 2024-09-12T02:45:15.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.076+0000 7f3054c00640 1 --2- 172.21.15.18:0/1867837897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30501129d0 0x7f3050114dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:15.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.076+0000 7f3054c00640 1 --2- 172.21.15.18:0/1867837897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3050074eb0 0x7f3050112490 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:15.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.076+0000 7f3054c00640 1 --2- 172.21.15.18:0/1867837897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3050074590 0x7f3050074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:15.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.076+0000 7f3054c00640 1 -- 172.21.15.18:0/1867837897 >> 172.21.15.18:0/1867837897 conn(0x7f30500fd6e0 msgr2=0x7f30500ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:15.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.076+0000 7f3054c00640 1 -- 172.21.15.18:0/1867837897 shutdown_connections 2024-09-12T02:45:15.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.076+0000 7f3054c00640 1 -- 172.21.15.18:0/1867837897 wait complete. 2024-09-12T02:45:15.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.077+0000 7f3054c00640 1 Processor -- start 2024-09-12T02:45:15.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.077+0000 7f3054c00640 1 -- start start 2024-09-12T02:45:15.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.078+0000 7f3054c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3050074590 0x7f30501a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:15.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.078+0000 7f3054c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3050074eb0 0x7f30501a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:15.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.078+0000 7f3054c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30501129d0 0x7f305019e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:15.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.078+0000 7f3054c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f30501183f0 con 0x7f3050074590 2024-09-12T02:45:15.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.078+0000 7f3054c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3050118270 con 0x7f30501129d0 2024-09-12T02:45:15.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.078+0000 7f3054c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3050118570 con 0x7f3050074eb0 2024-09-12T02:45:15.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.078+0000 7f304f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3050074590 0x7f30501a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:15.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.078+0000 7f304f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3050074590 0x7f30501a4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59310/0 (socket says 172.21.15.18:59310) 2024-09-12T02:45:15.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.078+0000 7f304f400640 1 -- 172.21.15.18:0/413931077 learned_addr learned my addr 172.21.15.18:0/413931077 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:15.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.078+0000 7f3047e00640 1 --2- 172.21.15.18:0/413931077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3050074eb0 0x7f30501a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:15.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.078+0000 7f304fe00640 1 --2- 172.21.15.18:0/413931077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30501129d0 0x7f305019e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:15.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.079+0000 7f304f400640 1 -- 172.21.15.18:0/413931077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3050074eb0 msgr2=0x7f30501a4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:15.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.079+0000 7f304f400640 1 --2- 172.21.15.18:0/413931077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3050074eb0 0x7f30501a4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:15.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.079+0000 7f304f400640 1 -- 172.21.15.18:0/413931077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30501129d0 msgr2=0x7f305019e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:15.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.079+0000 7f304f400640 1 --2- 172.21.15.18:0/413931077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30501129d0 0x7f305019e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:15.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.079+0000 7f304f400640 1 -- 172.21.15.18:0/413931077 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305019ef50 con 0x7f3050074590 2024-09-12T02:45:15.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.079+0000 7f304f400640 1 --2- 172.21.15.18:0/413931077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3050074590 0x7f30501a4610 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f304000e9f0 tx=0x7f304000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:15.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.079+0000 7f304cc00640 1 -- 172.21.15.18:0/413931077 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304000cd80 con 0x7f3050074590 2024-09-12T02:45:15.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.079+0000 7f304cc00640 1 -- 172.21.15.18:0/413931077 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3040010910 con 0x7f3050074590 2024-09-12T02:45:15.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.079+0000 7f3054c00640 1 -- 172.21.15.18:0/413931077 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f305019f240 con 0x7f3050074590 2024-09-12T02:45:15.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.079+0000 7f304cc00640 1 -- 172.21.15.18:0/413931077 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3040018990 con 0x7f3050074590 2024-09-12T02:45:15.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.080+0000 7f3054c00640 1 -- 172.21.15.18:0/413931077 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30501ab590 con 0x7f3050074590 2024-09-12T02:45:15.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.080+0000 7f3054c00640 1 -- 172.21.15.18:0/413931077 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3050075cd0 con 0x7f3050074590 2024-09-12T02:45:15.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.083+0000 7f304cc00640 1 -- 172.21.15.18:0/413931077 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3040010ac0 con 0x7f3050074590 2024-09-12T02:45:15.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.084+0000 7f304cc00640 1 --2- 172.21.15.18:0/413931077 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f30340a2b80 0x7f30340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:15.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.084+0000 7f304cc00640 1 -- 172.21.15.18:0/413931077 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7f30400cf370 con 0x7f3050074590 2024-09-12T02:45:15.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.084+0000 7f3047e00640 1 --2- 172.21.15.18:0/413931077 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f30340a2b80 0x7f30340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:15.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.085+0000 7f3047e00640 1 --2- 172.21.15.18:0/413931077 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f30340a2b80 0x7f30340a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3038000c00 tx=0x7f3038005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:15.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.087+0000 7f304cc00640 1 -- 172.21.15.18:0/413931077 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f304009c080 con 0x7f3050074590 2024-09-12T02:45:15.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.313+0000 7f3054c00640 1 -- 172.21.15.18:0/413931077 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f305019fc10 con 0x7f3050074590 2024-09-12T02:45:15.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.314+0000 7f304cc00640 1 -- 172.21.15.18:0/413931077 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8037 (secure 0 0 0) 0x7f30400a0380 con 0x7f3050074590 2024-09-12T02:45:15.315 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:45:15.315 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":10,"btime":"2024-09-12T02:45:12:233549+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/747069368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":747069368},{"type":"v1","addr":"172.21.15.18:6837","nonce":747069368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/43234729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":43234729},{"type":"v1","addr":"172.21.15.18:6835","nonce":43234729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/564392030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":564392030},{"type":"v1","addr":"172.21.15.62:6835","nonce":564392030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3199321182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3199321182},{"type":"v1","addr":"172.21.15.176:6835","nonce":3199321182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/3520593627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3520593627},{"type":"v1","addr":"172.21.15.62:6837","nonce":3520593627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4286557016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4286557016},{"type":"v1","addr":"172.21.15.176:6837","nonce":4286557016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6839/3957634398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":3957634398},{"type":"v1","addr":"172.21.15.176:6839","nonce":3957634398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T02:45:15.315 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 10 2024-09-12T02:45:15.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.316+0000 7f3054c00640 1 -- 172.21.15.18:0/413931077 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f30340a2b80 msgr2=0x7f30340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:15.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.316+0000 7f3054c00640 1 --2- 172.21.15.18:0/413931077 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f30340a2b80 0x7f30340a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3038000c00 tx=0x7f3038005b50 comp rx=0 tx=0).stop 2024-09-12T02:45:15.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.316+0000 7f3054c00640 1 -- 172.21.15.18:0/413931077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3050074590 msgr2=0x7f30501a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:15.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.316+0000 7f3054c00640 1 --2- 172.21.15.18:0/413931077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3050074590 0x7f30501a4610 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f304000e9f0 tx=0x7f304000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:45:15.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.317+0000 7f3054c00640 1 -- 172.21.15.18:0/413931077 shutdown_connections 2024-09-12T02:45:15.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.317+0000 7f3054c00640 1 --2- 172.21.15.18:0/413931077 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f30340a2b80 0x7f30340a5040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:15.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.317+0000 7f3054c00640 1 --2- 172.21.15.18:0/413931077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30501129d0 0x7f305019e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:15.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.317+0000 7f3054c00640 1 --2- 172.21.15.18:0/413931077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3050074eb0 0x7f30501a4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:15.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.317+0000 7f3054c00640 1 --2- 172.21.15.18:0/413931077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3050074590 0x7f30501a4610 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:15.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.317+0000 7f3054c00640 1 -- 172.21.15.18:0/413931077 >> 172.21.15.18:0/413931077 conn(0x7f30500fd6e0 msgr2=0x7f30500fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:15.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.317+0000 7f3054c00640 1 -- 172.21.15.18:0/413931077 shutdown_connections 2024-09-12T02:45:15.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:15.317+0000 7f3054c00640 1 -- 172.21.15.18:0/413931077 wait complete. 2024-09-12T02:45:15.601 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 12 02:45:15 smithi018 podman[70930]: 2024-09-12 02:45:15.295267868 +0000 UTC m=+0.027106276 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:45:15.865 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 12 02:45:15 smithi018 podman[70930]: 2024-09-12 02:45:15.608933276 +0000 UTC m=+0.340771660 container create 6383b0afb323e75cfb81903129c203e9fa38f33206ecbc5a529a0be5215e4f36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-g, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-12T02:45:16.254 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 12 02:45:15 smithi018 podman[70930]: 2024-09-12 02:45:15.865549739 +0000 UTC m=+0.597388147 container init 6383b0afb323e75cfb81903129c203e9fa38f33206ecbc5a529a0be5215e4f36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3) 2024-09-12T02:45:16.255 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 12 02:45:15 smithi018 podman[70930]: 2024-09-12 02:45:15.872147877 +0000 UTC m=+0.603986263 container start 6383b0afb323e75cfb81903129c203e9fa38f33206ecbc5a529a0be5215e4f36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-12T02:45:16.255 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 12 02:45:15 smithi018 ceph-mds[70962]: -- 172.21.15.18:0/238145707 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f522be4680 con 0x55f522bb9000 2024-09-12T02:45:16.255 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 12 02:45:15 smithi018 ceph-mds[70962]: -- 172.21.15.18:0/238145707 <== mon.0 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f522bdbc20 con 0x55f522bb9000 2024-09-12T02:45:16.255 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 12 02:45:15 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-g[70958]: starting mds.g at 2024-09-12T02:45:16.255 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 12 02:45:15 smithi018 bash[70930]: 6383b0afb323e75cfb81903129c203e9fa38f33206ecbc5a529a0be5215e4f36 2024-09-12T02:45:16.255 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 12 02:45:16 smithi018 systemd[1]: Started Ceph mds.g for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:45:16.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:16 smithi062 ceph-mon[35527]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:16.537 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:16 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/413931077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:16.537 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:16.537 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:16.537 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:16.537 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:16.537 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:16.537 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:16 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:16.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:16 smithi018 ceph-mon[30616]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:16.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:16 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/413931077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:16.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:16.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:16.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:16.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:16.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:16.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:16 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:16.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:16 smithi176 ceph-mon[35713]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:16.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:16 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/413931077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:16.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:16.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:16.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:16.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:16.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:16.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:16 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:17.313 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:17 smithi018 ceph-mon[30616]: Deploying daemon mds.a on smithi018 2024-09-12T02:45:17.313 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:17 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.18:6838/4056752027,v1:172.21.15.18:6839/4056752027] up:boot 2024-09-12T02:45:17.313 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:17 smithi018 ceph-mon[30616]: fsmap 10 up:standby 2024-09-12T02:45:17.313 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:17 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:45:17.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:17 smithi062 ceph-mon[35527]: Deploying daemon mds.a on smithi018 2024-09-12T02:45:17.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:17 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.18:6838/4056752027,v1:172.21.15.18:6839/4056752027] up:boot 2024-09-12T02:45:17.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:17 smithi062 ceph-mon[35527]: fsmap 10 up:standby 2024-09-12T02:45:17.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:17 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:45:17.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:17 smithi176 ceph-mon[35713]: Deploying daemon mds.a on smithi018 2024-09-12T02:45:17.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:17 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.18:6838/4056752027,v1:172.21.15.18:6839/4056752027] up:boot 2024-09-12T02:45:17.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:17 smithi176 ceph-mon[35713]: fsmap 10 up:standby 2024-09-12T02:45:17.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:17 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:45:18.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:18 smithi062 ceph-mon[35527]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:18.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:18 smithi018 ceph-mon[30616]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:18.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:18 smithi176 ceph-mon[35713]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:18.850 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:45:19.351 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 02:45:19 smithi018 systemd[1]: Starting Ceph mds.a for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T02:45:19.709 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 02:45:19 smithi018 podman[71278]: 2024-09-12 02:45:19.268294666 +0000 UTC m=+0.031232974 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:45:19.709 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 02:45:19 smithi018 podman[71278]: 2024-09-12 02:45:19.397946221 +0000 UTC m=+0.160884526 container create 1ee1e9374c0d463287141c0045097a3cdc9180011a99c59210e61560ce055dd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-12T02:45:19.709 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 02:45:19 smithi018 podman[71278]: 2024-09-12 02:45:19.709469048 +0000 UTC m=+0.472407356 container init 1ee1e9374c0d463287141c0045097a3cdc9180011a99c59210e61560ce055dd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T02:45:19.867 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:20.011 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 02:45:19 smithi018 podman[71278]: 2024-09-12 02:45:19.715933686 +0000 UTC m=+0.478871993 container start 1ee1e9374c0d463287141c0045097a3cdc9180011a99c59210e61560ce055dd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T02:45:20.011 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 02:45:19 smithi018 ceph-mds[71324]: -- 172.21.15.18:0/2415629520 <== mon.0 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556a08a53860 con 0x556a08a30800 2024-09-12T02:45:20.011 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 02:45:19 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-a[71320]: starting mds.a at 2024-09-12T02:45:20.012 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 02:45:19 smithi018 bash[71278]: 1ee1e9374c0d463287141c0045097a3cdc9180011a99c59210e61560ce055dd6 2024-09-12T02:45:20.012 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 02:45:19 smithi018 systemd[1]: Started Ceph mds.a for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:45:20.518 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:20 smithi018 ceph-mon[30616]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:20.519 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:20 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:20.519 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:20 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:20.519 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:20 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:20.519 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:20 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:20.519 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:20 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:20.519 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:20 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:20.531 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:20 smithi176 ceph-mon[35713]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:20.531 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:20 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:20.531 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:20 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:20.531 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:20 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:20.531 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:20 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:20.531 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:20 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:20.531 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:20 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:20.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:20 smithi062 ceph-mon[35527]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:20.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:20 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:20.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:20 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:20.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:20 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:20.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:20 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:45:20.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:20 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:45:20.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:20 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:20.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.510+0000 7f47d0e00640 1 -- 172.21.15.18:0/822753003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47cc074eb0 msgr2=0x7f47cc112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.510+0000 7f47d0e00640 1 --2- 172.21.15.18:0/822753003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47cc074eb0 0x7f47cc112650 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f47b8009900 tx=0x7f47b802a480 comp rx=0 tx=0).stop 2024-09-12T02:45:20.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.510+0000 7f47d0e00640 1 -- 172.21.15.18:0/822753003 shutdown_connections 2024-09-12T02:45:20.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.510+0000 7f47d0e00640 1 --2- 172.21.15.18:0/822753003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47cc112b90 0x7f47cc114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.511+0000 7f47d0e00640 1 --2- 172.21.15.18:0/822753003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47cc074eb0 0x7f47cc112650 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.511+0000 7f47d0e00640 1 --2- 172.21.15.18:0/822753003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47cc074590 0x7f47cc074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.511+0000 7f47d0e00640 1 -- 172.21.15.18:0/822753003 >> 172.21.15.18:0/822753003 conn(0x7f47cc0fd8c0 msgr2=0x7f47cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.511+0000 7f47d0e00640 1 -- 172.21.15.18:0/822753003 shutdown_connections 2024-09-12T02:45:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.511+0000 7f47d0e00640 1 -- 172.21.15.18:0/822753003 wait complete. 2024-09-12T02:45:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.511+0000 7f47d0e00640 1 Processor -- start 2024-09-12T02:45:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.512+0000 7f47d0e00640 1 -- start start 2024-09-12T02:45:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.512+0000 7f47d0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47cc074590 0x7f47cc1a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.512+0000 7f47d0e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47cc074eb0 0x7f47cc1a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.512+0000 7f47d0e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47cc112b90 0x7f47cc19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.512+0000 7f47d0e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc118590 con 0x7f47cc074590 2024-09-12T02:45:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.512+0000 7f47d0e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc118410 con 0x7f47cc112b90 2024-09-12T02:45:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.512+0000 7f47d0e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc118710 con 0x7f47cc074eb0 2024-09-12T02:45:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.512+0000 7f47c9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47cc074590 0x7f47cc1a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.512+0000 7f47c9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47cc074590 0x7f47cc1a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59364/0 (socket says 172.21.15.18:59364) 2024-09-12T02:45:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.512+0000 7f47c9e00640 1 -- 172.21.15.18:0/205894186 learned_addr learned my addr 172.21.15.18:0/205894186 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.512+0000 7f47ca800640 1 --2- 172.21.15.18:0/205894186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47cc112b90 0x7f47cc19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.513+0000 7f47c9400640 1 --2- 172.21.15.18:0/205894186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47cc074eb0 0x7f47cc1a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.513+0000 7f47ca800640 1 -- 172.21.15.18:0/205894186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47cc074eb0 msgr2=0x7f47cc1a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.513+0000 7f47ca800640 1 --2- 172.21.15.18:0/205894186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47cc074eb0 0x7f47cc1a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.513+0000 7f47ca800640 1 -- 172.21.15.18:0/205894186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47cc074590 msgr2=0x7f47cc1a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.513+0000 7f47ca800640 1 --2- 172.21.15.18:0/205894186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47cc074590 0x7f47cc1a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.513+0000 7f47ca800640 1 -- 172.21.15.18:0/205894186 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47cc19f000 con 0x7f47cc112b90 2024-09-12T02:45:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.513+0000 7f47c9e00640 1 --2- 172.21.15.18:0/205894186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47cc074590 0x7f47cc1a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.513+0000 7f47ca800640 1 --2- 172.21.15.18:0/205894186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47cc112b90 0x7f47cc19e8d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f47c4005fd0 tx=0x7f47c400dea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.513+0000 7f47c2a00640 1 -- 172.21.15.18:0/205894186 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c4017020 con 0x7f47cc112b90 2024-09-12T02:45:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.513+0000 7f47c2a00640 1 -- 172.21.15.18:0/205894186 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47c400bd40 con 0x7f47cc112b90 2024-09-12T02:45:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.513+0000 7f47d0e00640 1 -- 172.21.15.18:0/205894186 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47cc19f2f0 con 0x7f47cc112b90 2024-09-12T02:45:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.513+0000 7f47c2a00640 1 -- 172.21.15.18:0/205894186 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c400f920 con 0x7f47cc112b90 2024-09-12T02:45:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.514+0000 7f47d0e00640 1 -- 172.21.15.18:0/205894186 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47cc1ab5e0 con 0x7f47cc112b90 2024-09-12T02:45:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.515+0000 7f47d0e00640 1 -- 172.21.15.18:0/205894186 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47cc074970 con 0x7f47cc112b90 2024-09-12T02:45:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.516+0000 7f47c2a00640 1 -- 172.21.15.18:0/205894186 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f47c401a020 con 0x7f47cc112b90 2024-09-12T02:45:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.518+0000 7f47c2a00640 1 --2- 172.21.15.18:0/205894186 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47b00a2c00 0x7f47b00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.518+0000 7f47c2a00640 1 -- 172.21.15.18:0/205894186 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7f47c40cec00 con 0x7f47cc112b90 2024-09-12T02:45:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.518+0000 7f47c9e00640 1 --2- 172.21.15.18:0/205894186 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47b00a2c00 0x7f47b00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.519+0000 7f47c9e00640 1 --2- 172.21.15.18:0/205894186 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47b00a2c00 0x7f47b00a50c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f47cc19fa10 tx=0x7f47bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:20.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.522+0000 7f47c2a00640 1 -- 172.21.15.18:0/205894186 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47c4021020 con 0x7f47cc112b90 2024-09-12T02:45:20.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.746+0000 7f47d0e00640 1 -- 172.21.15.18:0/205894186 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47cc02d7c0 con 0x7f47cc112b90 2024-09-12T02:45:20.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.747+0000 7f47c2a00640 1 -- 172.21.15.18:0/205894186 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9686 (secure 0 0 0) 0x7f47c409bf60 con 0x7f47cc112b90 2024-09-12T02:45:20.748 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:45:20.748 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":12,"btime":"2024-09-12T02:45:20:262494+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/747069368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":747069368},{"type":"v1","addr":"172.21.15.18:6837","nonce":747069368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/4056752027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4056752027},{"type":"v1","addr":"172.21.15.18:6839","nonce":4056752027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/43234729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":43234729},{"type":"v1","addr":"172.21.15.18:6835","nonce":43234729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/564392030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":564392030},{"type":"v1","addr":"172.21.15.62:6835","nonce":564392030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3199321182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3199321182},{"type":"v1","addr":"172.21.15.176:6835","nonce":3199321182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/3520593627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3520593627},{"type":"v1","addr":"172.21.15.62:6837","nonce":3520593627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4286557016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4286557016},{"type":"v1","addr":"172.21.15.176:6837","nonce":4286557016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6839/3957634398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":3957634398},{"type":"v1","addr":"172.21.15.176:6839","nonce":3957634398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/823308007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":823308007},{"type":"v1","addr":"172.21.15.18:6841","nonce":823308007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2024-09-12T02:45:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 12 2024-09-12T02:45:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.749+0000 7f47d0e00640 1 -- 172.21.15.18:0/205894186 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47b00a2c00 msgr2=0x7f47b00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.749+0000 7f47d0e00640 1 --2- 172.21.15.18:0/205894186 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47b00a2c00 0x7f47b00a50c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f47cc19fa10 tx=0x7f47bc005f90 comp rx=0 tx=0).stop 2024-09-12T02:45:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.749+0000 7f47d0e00640 1 -- 172.21.15.18:0/205894186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47cc112b90 msgr2=0x7f47cc19e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.749+0000 7f47d0e00640 1 --2- 172.21.15.18:0/205894186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47cc112b90 0x7f47cc19e8d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f47c4005fd0 tx=0x7f47c400dea0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.749+0000 7f47d0e00640 1 -- 172.21.15.18:0/205894186 shutdown_connections 2024-09-12T02:45:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.749+0000 7f47d0e00640 1 --2- 172.21.15.18:0/205894186 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47b00a2c00 0x7f47b00a50c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.749+0000 7f47d0e00640 1 --2- 172.21.15.18:0/205894186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47cc112b90 0x7f47cc19e8d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.749+0000 7f47d0e00640 1 --2- 172.21.15.18:0/205894186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47cc074eb0 0x7f47cc1a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.749+0000 7f47d0e00640 1 --2- 172.21.15.18:0/205894186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47cc074590 0x7f47cc1a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.749+0000 7f47d0e00640 1 -- 172.21.15.18:0/205894186 >> 172.21.15.18:0/205894186 conn(0x7f47cc0fd8c0 msgr2=0x7f47cc0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.750+0000 7f47d0e00640 1 -- 172.21.15.18:0/205894186 shutdown_connections 2024-09-12T02:45:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:20.750+0000 7f47d0e00640 1 -- 172.21.15.18:0/205894186 wait complete. 2024-09-12T02:45:21.392 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:21 smithi062 ceph-mon[35527]: Deploying daemon mds.b on smithi062 2024-09-12T02:45:21.392 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:21 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] up:boot 2024-09-12T02:45:21.392 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:21 smithi062 ceph-mon[35527]: fsmap 11 up:standby 2024-09-12T02:45:21.392 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:21 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:45:21.392 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:21 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/205894186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:21.502 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:21 smithi018 ceph-mon[30616]: Deploying daemon mds.b on smithi062 2024-09-12T02:45:21.502 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:21 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] up:boot 2024-09-12T02:45:21.502 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:21 smithi018 ceph-mon[30616]: fsmap 11 up:standby 2024-09-12T02:45:21.502 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:21 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:45:21.502 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:21 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/205894186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:21.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:21 smithi176 ceph-mon[35713]: Deploying daemon mds.b on smithi062 2024-09-12T02:45:21.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:21 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] up:boot 2024-09-12T02:45:21.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:21 smithi176 ceph-mon[35713]: fsmap 11 up:standby 2024-09-12T02:45:21.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:21 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:45:21.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:21 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/205894186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:22.033 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 02:45:21 smithi062 systemd[1]: Starting Ceph mds.b for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T02:45:22.389 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:22 smithi062 ceph-mon[35527]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:22.389 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 02:45:22 smithi062 podman[65954]: 2024-09-12 02:45:22.006817981 +0000 UTC m=+0.015872572 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:45:22.389 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 02:45:22 smithi062 podman[65954]: 2024-09-12 02:45:22.119616816 +0000 UTC m=+0.128671406 container create de9f39a716ffaaa0994b41fd5463cc8fa6b64ba540b663e88343d2d04350f20b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T02:45:22.389 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 02:45:22 smithi062 podman[65954]: 2024-09-12 02:45:22.388943263 +0000 UTC m=+0.397997853 container init de9f39a716ffaaa0994b41fd5463cc8fa6b64ba540b663e88343d2d04350f20b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-12T02:45:22.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:22 smithi018 ceph-mon[30616]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:22.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:22 smithi176 ceph-mon[35713]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:22.783 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 02:45:22 smithi062 podman[65954]: 2024-09-12 02:45:22.392143716 +0000 UTC m=+0.401198315 container start de9f39a716ffaaa0994b41fd5463cc8fa6b64ba540b663e88343d2d04350f20b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T02:45:22.783 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 02:45:22 smithi062 ceph-mds[65973]: -- 172.21.15.62:0/2955983074 <== mon.2 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5630f9f2b860 con 0x5630f9f09400 2024-09-12T02:45:22.783 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 02:45:22 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-b[65969]: starting mds.b at 2024-09-12T02:45:22.783 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 02:45:22 smithi062 bash[65954]: de9f39a716ffaaa0994b41fd5463cc8fa6b64ba540b663e88343d2d04350f20b 2024-09-12T02:45:22.783 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 02:45:22 smithi062 systemd[1]: Started Ceph mds.b for c7666100-70af-11ef-bcea-c7b262605968. 2024-09-12T02:45:23.542 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:45:23.602 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:23 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:23.602 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:23 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:23.602 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:23 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:23.602 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:23 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:23.603 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:23 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:23.603 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:23 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:45:23.603 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:23 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] up:boot 2024-09-12T02:45:23.603 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:23 smithi176 ceph-mon[35713]: fsmap 12 up:standby 2024-09-12T02:45:23.603 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:23 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:45:23.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:23 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:23.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:23 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:23.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:23 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:23.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:23 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:23.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:23 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:23.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:23 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:45:23.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:23 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] up:boot 2024-09-12T02:45:23.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:23 smithi062 ceph-mon[35527]: fsmap 12 up:standby 2024-09-12T02:45:23.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:23 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:45:23.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:23 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:23.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:23 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:23.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:23 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:23.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:23 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:23.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:23 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:23.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:23 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:45:23.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:23 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] up:boot 2024-09-12T02:45:23.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:23 smithi018 ceph-mon[30616]: fsmap 12 up:standby 2024-09-12T02:45:23.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:23 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:45:24.303 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:24.777 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:24 smithi018 ceph-mon[30616]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:24.777 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:24 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:24.777 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:24 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:24.777 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:24 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:24.777 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:24 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:24.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.889+0000 7f904cc00640 1 -- 172.21.15.18:0/2040909717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9048103ff0 msgr2=0x7f90481043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:24.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.889+0000 7f904cc00640 1 --2- 172.21.15.18:0/2040909717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9048103ff0 0x7f90481043d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9038009ca0 tx=0x7f903802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:45:24.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.890+0000 7f904cc00640 1 -- 172.21.15.18:0/2040909717 shutdown_connections 2024-09-12T02:45:24.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.890+0000 7f904cc00640 1 --2- 172.21.15.18:0/2040909717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9048109120 0x7f9048110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:24.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.890+0000 7f904cc00640 1 --2- 172.21.15.18:0/2040909717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90481049a0 0x7f90481089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:24.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.890+0000 7f904cc00640 1 --2- 172.21.15.18:0/2040909717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9048103ff0 0x7f90481043d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:24.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.890+0000 7f904cc00640 1 -- 172.21.15.18:0/2040909717 >> 172.21.15.18:0/2040909717 conn(0x7f90480ffa90 msgr2=0x7f9048101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:24.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.890+0000 7f904cc00640 1 -- 172.21.15.18:0/2040909717 shutdown_connections 2024-09-12T02:45:24.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.890+0000 7f904cc00640 1 -- 172.21.15.18:0/2040909717 wait complete. 2024-09-12T02:45:24.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.891+0000 7f904cc00640 1 Processor -- start 2024-09-12T02:45:24.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.891+0000 7f904cc00640 1 -- start start 2024-09-12T02:45:24.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.891+0000 7f904cc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9048103ff0 0x7f904819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:24.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.891+0000 7f904cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90481049a0 0x7f904819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:24.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.891+0000 7f904cc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9048109120 0x7f904819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:24.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.891+0000 7f904cc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9048114140 con 0x7f90481049a0 2024-09-12T02:45:24.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.891+0000 7f904cc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9048113fc0 con 0x7f9048109120 2024-09-12T02:45:24.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.891+0000 7f904cc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f90481142c0 con 0x7f9048103ff0 2024-09-12T02:45:24.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.892+0000 7f9046800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9048109120 0x7f904819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:24.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.892+0000 7f9046800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9048109120 0x7f904819eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:50340/0 (socket says 172.21.15.18:50340) 2024-09-12T02:45:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.892+0000 7f9046800640 1 -- 172.21.15.18:0/1516734582 learned_addr learned my addr 172.21.15.18:0/1516734582 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.892+0000 7f903d400640 1 --2- 172.21.15.18:0/1516734582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90481049a0 0x7f904819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.892+0000 7f9045e00640 1 --2- 172.21.15.18:0/1516734582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9048103ff0 0x7f904819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.892+0000 7f9046800640 1 -- 172.21.15.18:0/1516734582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9048103ff0 msgr2=0x7f904819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.892+0000 7f9046800640 1 --2- 172.21.15.18:0/1516734582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9048103ff0 0x7f904819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.892+0000 7f9046800640 1 -- 172.21.15.18:0/1516734582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90481049a0 msgr2=0x7f904819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.892+0000 7f9046800640 1 --2- 172.21.15.18:0/1516734582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90481049a0 0x7f904819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.892+0000 7f9046800640 1 -- 172.21.15.18:0/1516734582 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904819f5b0 con 0x7f9048109120 2024-09-12T02:45:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.892+0000 7f903d400640 1 --2- 172.21.15.18:0/1516734582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90481049a0 0x7f904819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.892+0000 7f9046800640 1 --2- 172.21.15.18:0/1516734582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9048109120 0x7f904819eed0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f904000e970 tx=0x7f904000ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.893+0000 7f903f400640 1 -- 172.21.15.18:0/1516734582 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904000ccc0 con 0x7f9048109120 2024-09-12T02:45:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.893+0000 7f903f400640 1 -- 172.21.15.18:0/1516734582 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f904000ce60 con 0x7f9048109120 2024-09-12T02:45:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.893+0000 7f903f400640 1 -- 172.21.15.18:0/1516734582 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9040010490 con 0x7f9048109120 2024-09-12T02:45:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.893+0000 7f904cc00640 1 -- 172.21.15.18:0/1516734582 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f904819f8a0 con 0x7f9048109120 2024-09-12T02:45:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.893+0000 7f904cc00640 1 -- 172.21.15.18:0/1516734582 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90481a7180 con 0x7f9048109120 2024-09-12T02:45:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.894+0000 7f904cc00640 1 -- 172.21.15.18:0/1516734582 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90481043d0 con 0x7f9048109120 2024-09-12T02:45:24.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.896+0000 7f903f400640 1 -- 172.21.15.18:0/1516734582 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9040005000 con 0x7f9048109120 2024-09-12T02:45:24.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.897+0000 7f903f400640 1 --2- 172.21.15.18:0/1516734582 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f902c0a2b80 0x7f902c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:24.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.898+0000 7f903f400640 1 -- 172.21.15.18:0/1516734582 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7f90400cf2a0 con 0x7f9048109120 2024-09-12T02:45:24.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.898+0000 7f9045e00640 1 --2- 172.21.15.18:0/1516734582 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f902c0a2b80 0x7f902c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:24.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.898+0000 7f9045e00640 1 --2- 172.21.15.18:0/1516734582 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f902c0a2b80 0x7f902c0a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9038006010 tx=0x7f9038009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:24.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:24.899+0000 7f903f400640 1 -- 172.21.15.18:0/1516734582 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f90400541b0 con 0x7f9048109120 2024-09-12T02:45:24.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:24 smithi176 ceph-mon[35713]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:24.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:24 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:24.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:24 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:24.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:24 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:24.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:24 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:25.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:24 smithi062 ceph-mon[35527]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:25.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:24 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:25.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:24 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:25.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:24 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:25.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:24 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:25.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:25.169+0000 7f904cc00640 1 -- 172.21.15.18:0/1516734582 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f904819b960 con 0x7f9048109120 2024-09-12T02:45:25.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:25.170+0000 7f903f400640 1 -- 172.21.15.18:0/1516734582 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10512 (secure 0 0 0) 0x7f904819b960 con 0x7f9048109120 2024-09-12T02:45:25.170 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:45:25.171 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":13,"btime":"2024-09-12T02:45:23:275127+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/747069368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":747069368},{"type":"v1","addr":"172.21.15.18:6837","nonce":747069368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/4056752027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4056752027},{"type":"v1","addr":"172.21.15.18:6839","nonce":4056752027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/43234729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":43234729},{"type":"v1","addr":"172.21.15.18:6835","nonce":43234729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/564392030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":564392030},{"type":"v1","addr":"172.21.15.62:6835","nonce":564392030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3199321182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3199321182},{"type":"v1","addr":"172.21.15.176:6835","nonce":3199321182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/3520593627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3520593627},{"type":"v1","addr":"172.21.15.62:6837","nonce":3520593627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4286557016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4286557016},{"type":"v1","addr":"172.21.15.176:6837","nonce":4286557016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6839/3957634398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":3957634398},{"type":"v1","addr":"172.21.15.176:6839","nonce":3957634398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/823308007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":823308007},{"type":"v1","addr":"172.21.15.18:6841","nonce":823308007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/3744347102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3744347102},{"type":"v1","addr":"172.21.15.62:6839","nonce":3744347102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-12T02:45:25.171 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 13 2024-09-12T02:45:25.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:25.173+0000 7f904cc00640 1 -- 172.21.15.18:0/1516734582 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f902c0a2b80 msgr2=0x7f902c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:25.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:25.173+0000 7f904cc00640 1 --2- 172.21.15.18:0/1516734582 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f902c0a2b80 0x7f902c0a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9038006010 tx=0x7f9038009360 comp rx=0 tx=0).stop 2024-09-12T02:45:25.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:25.173+0000 7f904cc00640 1 -- 172.21.15.18:0/1516734582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9048109120 msgr2=0x7f904819eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:25.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:25.173+0000 7f904cc00640 1 --2- 172.21.15.18:0/1516734582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9048109120 0x7f904819eed0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f904000e970 tx=0x7f904000ed70 comp rx=0 tx=0).stop 2024-09-12T02:45:25.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:25.173+0000 7f904cc00640 1 -- 172.21.15.18:0/1516734582 shutdown_connections 2024-09-12T02:45:25.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:25.173+0000 7f904cc00640 1 --2- 172.21.15.18:0/1516734582 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f902c0a2b80 0x7f902c0a5040 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:25.173+0000 7f904cc00640 1 --2- 172.21.15.18:0/1516734582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9048109120 0x7f904819eed0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:25.173+0000 7f904cc00640 1 --2- 172.21.15.18:0/1516734582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90481049a0 0x7f904819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:25.173+0000 7f904cc00640 1 --2- 172.21.15.18:0/1516734582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9048103ff0 0x7f904819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:25.173+0000 7f904cc00640 1 -- 172.21.15.18:0/1516734582 >> 172.21.15.18:0/1516734582 conn(0x7f90480ffa90 msgr2=0x7f9048100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:25.173+0000 7f904cc00640 1 -- 172.21.15.18:0/1516734582 shutdown_connections 2024-09-12T02:45:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:25.173+0000 7f904cc00640 1 -- 172.21.15.18:0/1516734582 wait complete. 2024-09-12T02:45:25.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:25 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1516734582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:25.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:25 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1516734582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:26.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:25 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1516734582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:26.041 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-12T02:45:26.435 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:26.934 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:26 smithi018 ceph-mon[30616]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:26.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:26.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:26.935 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:26 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:26.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:26 smithi176 ceph-mon[35713]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:26.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:26 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:26.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:26 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:26.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:26 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:27.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:26 smithi062 ceph-mon[35527]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:27.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:26 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:27.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:26 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:27.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:26 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:27.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.195+0000 7fde03e00640 1 -- 172.21.15.18:0/503900002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde04102360 msgr2=0x7fde0410e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.195+0000 7fde03e00640 1 --2- 172.21.15.18:0/503900002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde04102360 0x7fde0410e890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009be0 tx=0x7fddfc02a6c0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.195+0000 7fde03e00640 1 -- 172.21.15.18:0/503900002 shutdown_connections 2024-09-12T02:45:27.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.195+0000 7fde03e00640 1 --2- 172.21.15.18:0/503900002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde04102360 0x7fde0410e890 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.195+0000 7fde03e00640 1 --2- 172.21.15.18:0/503900002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde041019c0 0x7fde04101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.195+0000 7fde03e00640 1 --2- 172.21.15.18:0/503900002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde041079c0 0x7fde04107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.195+0000 7fde03e00640 1 -- 172.21.15.18:0/503900002 >> 172.21.15.18:0/503900002 conn(0x7fde040fd740 msgr2=0x7fde040ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:27.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.195+0000 7fde03e00640 1 -- 172.21.15.18:0/503900002 shutdown_connections 2024-09-12T02:45:27.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.195+0000 7fde03e00640 1 -- 172.21.15.18:0/503900002 wait complete. 2024-09-12T02:45:27.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.196+0000 7fde03e00640 1 Processor -- start 2024-09-12T02:45:27.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.197+0000 7fde03e00640 1 -- start start 2024-09-12T02:45:27.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.197+0000 7fde03e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde041019c0 0x7fde0419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.197+0000 7fde03e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde04102360 0x7fde0419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.197+0000 7fde03e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde041079c0 0x7fde0419ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.197+0000 7fde03e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fde04111d70 con 0x7fde041079c0 2024-09-12T02:45:27.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.197+0000 7fde03e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fde04111bf0 con 0x7fde041019c0 2024-09-12T02:45:27.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.197+0000 7fde03e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fde04111ef0 con 0x7fde04102360 2024-09-12T02:45:27.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.197+0000 7fde02a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde041019c0 0x7fde0419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.197+0000 7fde02000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde04102360 0x7fde0419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.197+0000 7fde02a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde041019c0 0x7fde0419a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:50360/0 (socket says 172.21.15.18:50360) 2024-09-12T02:45:27.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.197+0000 7fde02000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde04102360 0x7fde0419a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:37868/0 (socket says 172.21.15.18:37868) 2024-09-12T02:45:27.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.197+0000 7fde02000640 1 -- 172.21.15.18:0/1212984647 learned_addr learned my addr 172.21.15.18:0/1212984647 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:27.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.197+0000 7fde03400640 1 --2- 172.21.15.18:0/1212984647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde041079c0 0x7fde0419ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.198+0000 7fde02a00640 1 -- 172.21.15.18:0/1212984647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde04102360 msgr2=0x7fde0419a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.198+0000 7fde02a00640 1 --2- 172.21.15.18:0/1212984647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde04102360 0x7fde0419a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.198+0000 7fde02a00640 1 -- 172.21.15.18:0/1212984647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde041079c0 msgr2=0x7fde0419ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.198+0000 7fde02a00640 1 --2- 172.21.15.18:0/1212984647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde041079c0 0x7fde0419ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.198+0000 7fde02a00640 1 -- 172.21.15.18:0/1212984647 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0419f3a0 con 0x7fde041019c0 2024-09-12T02:45:27.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.198+0000 7fde02000640 1 --2- 172.21.15.18:0/1212984647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde04102360 0x7fde0419a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:27.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.198+0000 7fde02a00640 1 --2- 172.21.15.18:0/1212984647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde041019c0 0x7fde0419a3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fddf4005fd0 tx=0x7fddf400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:27.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.199+0000 7fde08a00640 1 -- 172.21.15.18:0/1212984647 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf400cd00 con 0x7fde041019c0 2024-09-12T02:45:27.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.199+0000 7fde08a00640 1 -- 172.21.15.18:0/1212984647 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddf40035f0 con 0x7fde041019c0 2024-09-12T02:45:27.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.199+0000 7fde08a00640 1 -- 172.21.15.18:0/1212984647 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf4010670 con 0x7fde041019c0 2024-09-12T02:45:27.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.199+0000 7fde03e00640 1 -- 172.21.15.18:0/1212984647 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde0419f690 con 0x7fde041019c0 2024-09-12T02:45:27.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.199+0000 7fde03e00640 1 -- 172.21.15.18:0/1212984647 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde041a6f70 con 0x7fde041019c0 2024-09-12T02:45:27.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.200+0000 7fde03e00640 1 -- 172.21.15.18:0/1212984647 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde04101e20 con 0x7fde041019c0 2024-09-12T02:45:27.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.202+0000 7fde08a00640 1 -- 172.21.15.18:0/1212984647 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fddf40037a0 con 0x7fde041019c0 2024-09-12T02:45:27.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.204+0000 7fde08a00640 1 --2- 172.21.15.18:0/1212984647 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fdde80a2c00 0x7fdde80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:27.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.204+0000 7fde08a00640 1 -- 172.21.15.18:0/1212984647 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7fddf40ced10 con 0x7fde041019c0 2024-09-12T02:45:27.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.204+0000 7fde02000640 1 --2- 172.21.15.18:0/1212984647 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fdde80a2c00 0x7fdde80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:27.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.205+0000 7fde02000640 1 --2- 172.21.15.18:0/1212984647 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fdde80a2c00 0x7fdde80a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fde0410e5e0 tx=0x7fddf0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:27.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.207+0000 7fde08a00640 1 -- 172.21.15.18:0/1212984647 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fddf40d4020 con 0x7fde041019c0 2024-09-12T02:45:27.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.413+0000 7fde03e00640 1 -- 172.21.15.18:0/1212984647 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fde041a72c0 con 0x7fde041019c0 2024-09-12T02:45:27.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.414+0000 7fde08a00640 1 -- 172.21.15.18:0/1212984647 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) ==== 84+0+65 (secure 0 0 0) 0x7fddf4009510 con 0x7fde041019c0 2024-09-12T02:45:27.428 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:45:27.428 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-12T02:45:27.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T02:45:27.429 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-09-12T02:45:27.429 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-09-12T02:45:27.429 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T02:45:27.429 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-12T02:45:27.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.416+0000 7fde03e00640 1 -- 172.21.15.18:0/1212984647 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fdde80a2c00 msgr2=0x7fdde80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.416+0000 7fde03e00640 1 --2- 172.21.15.18:0/1212984647 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fdde80a2c00 0x7fdde80a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fde0410e5e0 tx=0x7fddf0005f90 comp rx=0 tx=0).stop 2024-09-12T02:45:27.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.416+0000 7fde03e00640 1 -- 172.21.15.18:0/1212984647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde041019c0 msgr2=0x7fde0419a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:27.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.416+0000 7fde03e00640 1 --2- 172.21.15.18:0/1212984647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde041019c0 0x7fde0419a3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fddf4005fd0 tx=0x7fddf400ee50 comp rx=0 tx=0).stop 2024-09-12T02:45:27.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.417+0000 7fde03e00640 1 -- 172.21.15.18:0/1212984647 shutdown_connections 2024-09-12T02:45:27.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.417+0000 7fde03e00640 1 --2- 172.21.15.18:0/1212984647 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fdde80a2c00 0x7fdde80a50c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.417+0000 7fde03e00640 1 --2- 172.21.15.18:0/1212984647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde041079c0 0x7fde0419ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.417+0000 7fde03e00640 1 --2- 172.21.15.18:0/1212984647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde04102360 0x7fde0419a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.417+0000 7fde03e00640 1 --2- 172.21.15.18:0/1212984647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde041019c0 0x7fde0419a3f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:27.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.417+0000 7fde03e00640 1 -- 172.21.15.18:0/1212984647 >> 172.21.15.18:0/1212984647 conn(0x7fde040fd740 msgr2=0x7fde040fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:27.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.417+0000 7fde03e00640 1 -- 172.21.15.18:0/1212984647 shutdown_connections 2024-09-12T02:45:27.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:27.417+0000 7fde03e00640 1 -- 172.21.15.18:0/1212984647 wait complete. 2024-09-12T02:45:27.870 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:27.870 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:45:27.870 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:27.870 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:27 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:45:27.870 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:27 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1212984647' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:45:27.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:27.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:45:27.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:27.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:27 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:45:27.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:27 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1212984647' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:45:28.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:28.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:45:28.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:28.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:27 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:45:28.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:27 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1212984647' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:45:28.306 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:45:28.306 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:45:28.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:28 smithi018 ceph-mon[30616]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:28.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:28 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:28.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:28 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:28.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:28 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:28.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:28 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:28.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:28 smithi062 ceph-mon[35527]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:28.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:28 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:28.935 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:28 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:28.935 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:28 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:28.935 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:28 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:28.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:28 smithi176 ceph-mon[35713]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:28.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:28 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:28.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:28 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:28.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:28 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:28.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:28 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:29.432 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:30.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.221+0000 7fd6f6000640 1 -- 172.21.15.18:0/901592133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6f0109140 msgr2=0x7fd6f0110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:30.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.221+0000 7fd6f6000640 1 --2- 172.21.15.18:0/901592133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6f0109140 0x7fd6f0110cc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009ca0 tx=0x7fd6e802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.221+0000 7fd6f6000640 1 -- 172.21.15.18:0/901592133 shutdown_connections 2024-09-12T02:45:30.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.221+0000 7fd6f6000640 1 --2- 172.21.15.18:0/901592133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6f0109140 0x7fd6f0110cc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.221+0000 7fd6f6000640 1 --2- 172.21.15.18:0/901592133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6f01049c0 0x7fd6f0108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.221+0000 7fd6f6000640 1 --2- 172.21.15.18:0/901592133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6f0104010 0x7fd6f01043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.221+0000 7fd6f6000640 1 -- 172.21.15.18:0/901592133 >> 172.21.15.18:0/901592133 conn(0x7fd6f00ffa50 msgr2=0x7fd6f0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:30.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.221+0000 7fd6f6000640 1 -- 172.21.15.18:0/901592133 shutdown_connections 2024-09-12T02:45:30.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.221+0000 7fd6f6000640 1 -- 172.21.15.18:0/901592133 wait complete. 2024-09-12T02:45:30.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.222+0000 7fd6f6000640 1 Processor -- start 2024-09-12T02:45:30.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.222+0000 7fd6f6000640 1 -- start start 2024-09-12T02:45:30.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.223+0000 7fd6f6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6f0104010 0x7fd6f019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:30.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.223+0000 7fd6f6000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6f01049c0 0x7fd6f019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:30.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.223+0000 7fd6f6000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6f0109140 0x7fd6f019ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:30.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.223+0000 7fd6f6000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f01141c0 con 0x7fd6f0104010 2024-09-12T02:45:30.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.223+0000 7fd6f6000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f0114040 con 0x7fd6f0109140 2024-09-12T02:45:30.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.223+0000 7fd6f6000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f0114340 con 0x7fd6f01049c0 2024-09-12T02:45:30.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.223+0000 7fd6e7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6f01049c0 0x7fd6f019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:30.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.223+0000 7fd6ef400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6f0104010 0x7fd6f019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:30.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.223+0000 7fd6e7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6f01049c0 0x7fd6f019ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:37884/0 (socket says 172.21.15.18:37884) 2024-09-12T02:45:30.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.223+0000 7fd6e7e00640 1 -- 172.21.15.18:0/1214397155 learned_addr learned my addr 172.21.15.18:0/1214397155 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:30.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.223+0000 7fd6efe00640 1 --2- 172.21.15.18:0/1214397155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6f0109140 0x7fd6f019ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:30.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.224+0000 7fd6ef400640 1 -- 172.21.15.18:0/1214397155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6f01049c0 msgr2=0x7fd6f019ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:30.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.224+0000 7fd6ef400640 1 --2- 172.21.15.18:0/1214397155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6f01049c0 0x7fd6f019ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.224+0000 7fd6ef400640 1 -- 172.21.15.18:0/1214397155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6f0109140 msgr2=0x7fd6f019ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:30.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.224+0000 7fd6ef400640 1 --2- 172.21.15.18:0/1214397155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6f0109140 0x7fd6f019ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:30.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.224+0000 7fd6ef400640 1 -- 172.21.15.18:0/1214397155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f019f670 con 0x7fd6f0104010 2024-09-12T02:45:30.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.224+0000 7fd6e7e00640 1 --2- 172.21.15.18:0/1214397155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6f01049c0 0x7fd6f019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:30.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.224+0000 7fd6ef400640 1 --2- 172.21.15.18:0/1214397155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6f0104010 0x7fd6f019a6c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000d720 tx=0x7fd6e000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:30.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.224+0000 7fd6ecc00640 1 -- 172.21.15.18:0/1214397155 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0017070 con 0x7fd6f0104010 2024-09-12T02:45:30.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.224+0000 7fd6ecc00640 1 -- 172.21.15.18:0/1214397155 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6e000de30 con 0x7fd6f0104010 2024-09-12T02:45:30.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.224+0000 7fd6ecc00640 1 -- 172.21.15.18:0/1214397155 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00047a0 con 0x7fd6f0104010 2024-09-12T02:45:30.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.224+0000 7fd6f6000640 1 -- 172.21.15.18:0/1214397155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f019f960 con 0x7fd6f0104010 2024-09-12T02:45:30.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.225+0000 7fd6f6000640 1 -- 172.21.15.18:0/1214397155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f01a7240 con 0x7fd6f0104010 2024-09-12T02:45:30.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.226+0000 7fd6f6000640 1 -- 172.21.15.18:0/1214397155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f01043f0 con 0x7fd6f0104010 2024-09-12T02:45:30.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.227+0000 7fd6ecc00640 1 -- 172.21.15.18:0/1214397155 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd6e00099d0 con 0x7fd6f0104010 2024-09-12T02:45:30.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.229+0000 7fd6ecc00640 1 --2- 172.21.15.18:0/1214397155 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd6d40a2c00 0x7fd6d40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:30.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.229+0000 7fd6ecc00640 1 -- 172.21.15.18:0/1214397155 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7fd6e00ce7f0 con 0x7fd6f0104010 2024-09-12T02:45:30.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.229+0000 7fd6e7e00640 1 --2- 172.21.15.18:0/1214397155 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd6d40a2c00 0x7fd6d40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:30.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.230+0000 7fd6e7e00640 1 --2- 172.21.15.18:0/1214397155 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd6d40a2c00 0x7fd6d40a50c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd6f010aab0 tx=0x7fd6d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:30.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.233+0000 7fd6ecc00640 1 -- 172.21.15.18:0/1214397155 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd6e0020020 con 0x7fd6f0104010 2024-09-12T02:45:30.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:30.463+0000 7fd6f6000640 1 -- 172.21.15.18:0/1214397155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd6f002d7c0 con 0x7fd6f0104010 2024-09-12T02:45:30.464 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:30 smithi018 ceph-mon[30616]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:30.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:30 smithi176 ceph-mon[35713]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:30.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:30 smithi062 ceph-mon[35527]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:31.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:31.371+0000 7fd6ecc00640 1 -- 172.21.15.18:0/1214397155 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) ==== 138+0+0 (secure 0 0 0) 0x7fd6e009bb50 con 0x7fd6f0104010 2024-09-12T02:45:31.373 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-09-12T02:45:31.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:31.375+0000 7fd6f6000640 1 -- 172.21.15.18:0/1214397155 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd6d40a2c00 msgr2=0x7fd6d40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:31.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:31.375+0000 7fd6f6000640 1 --2- 172.21.15.18:0/1214397155 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd6d40a2c00 0x7fd6d40a50c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd6f010aab0 tx=0x7fd6d8005f90 comp rx=0 tx=0).stop 2024-09-12T02:45:31.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:31.375+0000 7fd6f6000640 1 -- 172.21.15.18:0/1214397155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6f0104010 msgr2=0x7fd6f019a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:31.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:31.375+0000 7fd6f6000640 1 --2- 172.21.15.18:0/1214397155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6f0104010 0x7fd6f019a6c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000d720 tx=0x7fd6e000dbe0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:31.375+0000 7fd6f6000640 1 -- 172.21.15.18:0/1214397155 shutdown_connections 2024-09-12T02:45:31.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:31.375+0000 7fd6f6000640 1 --2- 172.21.15.18:0/1214397155 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd6d40a2c00 0x7fd6d40a50c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:31.375+0000 7fd6f6000640 1 --2- 172.21.15.18:0/1214397155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6f0109140 0x7fd6f019ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:31.375+0000 7fd6f6000640 1 --2- 172.21.15.18:0/1214397155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6f01049c0 0x7fd6f019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:31.375+0000 7fd6f6000640 1 --2- 172.21.15.18:0/1214397155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6f0104010 0x7fd6f019a6c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:31.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:31.375+0000 7fd6f6000640 1 -- 172.21.15.18:0/1214397155 >> 172.21.15.18:0/1214397155 conn(0x7fd6f00ffa50 msgr2=0x7fd6f0100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:31.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:31.375+0000 7fd6f6000640 1 -- 172.21.15.18:0/1214397155 shutdown_connections 2024-09-12T02:45:31.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:31.376+0000 7fd6f6000640 1 -- 172.21.15.18:0/1214397155 wait complete. 2024-09-12T02:45:31.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:31 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1214397155' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:45:31.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:31 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:31.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:31 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:31.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:31 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:31.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:31 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:45:31.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:31 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:31.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:31 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1214397155' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:45:31.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:31 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:31.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:31 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:31.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:31 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:31.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:31 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:45:31.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:31 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:31.797 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:31 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1214397155' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:45:31.797 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:31 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:31.797 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:31 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:31.797 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:31 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:31.797 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:31 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:45:31.797 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:31 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:45:32.340 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-12T02:45:32.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:32 smithi018 ceph-mon[30616]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:32.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:32 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1214397155' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:45:32.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:32 smithi018 ceph-mon[30616]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:45:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:32 smithi176 ceph-mon[35713]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:32 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1214397155' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:45:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:32 smithi176 ceph-mon[35713]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:45:32.731 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:32.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:32 smithi062 ceph-mon[35527]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:32.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:32 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1214397155' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:45:32.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:32 smithi062 ceph-mon[35527]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:45:33.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.396+0000 7fd306a00640 1 -- 172.21.15.18:0/1885042670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300109140 msgr2=0x7fd300110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.396+0000 7fd306a00640 1 --2- 172.21.15.18:0/1885042670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300109140 0x7fd300110cc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009ca0 tx=0x7fd2f802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.397+0000 7fd306a00640 1 -- 172.21.15.18:0/1885042670 shutdown_connections 2024-09-12T02:45:33.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.397+0000 7fd306a00640 1 --2- 172.21.15.18:0/1885042670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300109140 0x7fd300110cc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.397+0000 7fd306a00640 1 --2- 172.21.15.18:0/1885042670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3001049c0 0x7fd300108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.397+0000 7fd306a00640 1 --2- 172.21.15.18:0/1885042670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd300104010 0x7fd3001043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.397+0000 7fd306a00640 1 -- 172.21.15.18:0/1885042670 >> 172.21.15.18:0/1885042670 conn(0x7fd3000ffa50 msgr2=0x7fd300101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:33.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.397+0000 7fd306a00640 1 -- 172.21.15.18:0/1885042670 shutdown_connections 2024-09-12T02:45:33.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.397+0000 7fd306a00640 1 -- 172.21.15.18:0/1885042670 wait complete. 2024-09-12T02:45:33.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.398+0000 7fd306a00640 1 Processor -- start 2024-09-12T02:45:33.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.398+0000 7fd306a00640 1 -- start start 2024-09-12T02:45:33.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.399+0000 7fd306a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd300104010 0x7fd30019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.399+0000 7fd306a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3001049c0 0x7fd30019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.399+0000 7fd306a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd300109140 0x7fd30019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.399+0000 7fd306a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd300114150 con 0x7fd3001049c0 2024-09-12T02:45:33.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.399+0000 7fd306a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd300113fd0 con 0x7fd300109140 2024-09-12T02:45:33.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.399+0000 7fd306a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd3001142d0 con 0x7fd300104010 2024-09-12T02:45:33.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.399+0000 7fd2f7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3001049c0 0x7fd30019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:33.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.399+0000 7fd304a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd300109140 0x7fd30019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:33.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.399+0000 7fd2ffe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd300104010 0x7fd30019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:33.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.399+0000 7fd2f7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3001049c0 0x7fd30019ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56544/0 (socket says 172.21.15.18:56544) 2024-09-12T02:45:33.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.399+0000 7fd2f7e00640 1 -- 172.21.15.18:0/941158740 learned_addr learned my addr 172.21.15.18:0/941158740 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:33.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.399+0000 7fd2ffe00640 1 -- 172.21.15.18:0/941158740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd300109140 msgr2=0x7fd30019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.399+0000 7fd2ffe00640 1 --2- 172.21.15.18:0/941158740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd300109140 0x7fd30019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.399+0000 7fd2ffe00640 1 -- 172.21.15.18:0/941158740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3001049c0 msgr2=0x7fd30019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:33.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.399+0000 7fd2ffe00640 1 --2- 172.21.15.18:0/941158740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3001049c0 0x7fd30019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:33.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.399+0000 7fd2ffe00640 1 -- 172.21.15.18:0/941158740 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30019f5a0 con 0x7fd300104010 2024-09-12T02:45:33.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.399+0000 7fd2f7e00640 1 --2- 172.21.15.18:0/941158740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3001049c0 0x7fd30019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:33.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.400+0000 7fd2ffe00640 1 --2- 172.21.15.18:0/941158740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd300104010 0x7fd30019a5f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd2f000d6d0 tx=0x7fd2f000db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:33.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.400+0000 7fd2fd600640 1 -- 172.21.15.18:0/941158740 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0017070 con 0x7fd300104010 2024-09-12T02:45:33.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.400+0000 7fd306a00640 1 -- 172.21.15.18:0/941158740 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd30019f890 con 0x7fd300104010 2024-09-12T02:45:33.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.400+0000 7fd2fd600640 1 -- 172.21.15.18:0/941158740 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2f0009820 con 0x7fd300104010 2024-09-12T02:45:33.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.400+0000 7fd2fd600640 1 -- 172.21.15.18:0/941158740 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0004cd0 con 0x7fd300104010 2024-09-12T02:45:33.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.400+0000 7fd306a00640 1 -- 172.21.15.18:0/941158740 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3001a7170 con 0x7fd300104010 2024-09-12T02:45:33.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.401+0000 7fd306a00640 1 -- 172.21.15.18:0/941158740 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3001043f0 con 0x7fd300104010 2024-09-12T02:45:33.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.403+0000 7fd2fd600640 1 -- 172.21.15.18:0/941158740 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd2f00099d0 con 0x7fd300104010 2024-09-12T02:45:33.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.404+0000 7fd2fd600640 1 --2- 172.21.15.18:0/941158740 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd2e40a2b80 0x7fd2e40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:33.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.404+0000 7fd2fd600640 1 -- 172.21.15.18:0/941158740 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7497+0+0 (secure 0 0 0) 0x7fd2f00ce8a0 con 0x7fd300104010 2024-09-12T02:45:33.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.404+0000 7fd2f7e00640 1 --2- 172.21.15.18:0/941158740 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd2e40a2b80 0x7fd2e40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:33.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.405+0000 7fd2f7e00640 1 --2- 172.21.15.18:0/941158740 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd2e40a2b80 0x7fd2e40a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd30010ab10 tx=0x7fd2e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:33.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.409+0000 7fd2fd600640 1 -- 172.21.15.18:0/941158740 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd2f009b440 con 0x7fd300104010 2024-09-12T02:45:33.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:33.592+0000 7fd306a00640 1 -- 172.21.15.18:0/941158740 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fd30019b950 con 0x7fd300104010 2024-09-12T02:45:33.594 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:33 smithi018 ceph-mon[30616]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:45:33.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:33 smithi176 ceph-mon[35713]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:45:33.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:33 smithi062 ceph-mon[35527]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:45:34.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:34.400+0000 7fd2fd600640 1 -- 172.21.15.18:0/941158740 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v84) ==== 171+0+0 (secure 0 0 0) 0x7fd2f009f740 con 0x7fd300104010 2024-09-12T02:45:34.403 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-09-12T02:45:34.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:34.406+0000 7fd306a00640 1 -- 172.21.15.18:0/941158740 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd2e40a2b80 msgr2=0x7fd2e40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:34.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:34.406+0000 7fd306a00640 1 --2- 172.21.15.18:0/941158740 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd2e40a2b80 0x7fd2e40a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd30010ab10 tx=0x7fd2e8005f90 comp rx=0 tx=0).stop 2024-09-12T02:45:34.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:34.406+0000 7fd306a00640 1 -- 172.21.15.18:0/941158740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd300104010 msgr2=0x7fd30019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:34.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:34.406+0000 7fd306a00640 1 --2- 172.21.15.18:0/941158740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd300104010 0x7fd30019a5f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd2f000d6d0 tx=0x7fd2f000db90 comp rx=0 tx=0).stop 2024-09-12T02:45:34.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:34.406+0000 7fd306a00640 1 -- 172.21.15.18:0/941158740 shutdown_connections 2024-09-12T02:45:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:34.406+0000 7fd306a00640 1 --2- 172.21.15.18:0/941158740 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd2e40a2b80 0x7fd2e40a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:34.406+0000 7fd306a00640 1 --2- 172.21.15.18:0/941158740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd300109140 0x7fd30019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:34.406+0000 7fd306a00640 1 --2- 172.21.15.18:0/941158740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3001049c0 0x7fd30019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:34.406+0000 7fd306a00640 1 --2- 172.21.15.18:0/941158740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd300104010 0x7fd30019a5f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:34.406+0000 7fd306a00640 1 -- 172.21.15.18:0/941158740 >> 172.21.15.18:0/941158740 conn(0x7fd3000ffa50 msgr2=0x7fd300100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:34.407+0000 7fd306a00640 1 -- 172.21.15.18:0/941158740 shutdown_connections 2024-09-12T02:45:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:34.407+0000 7fd306a00640 1 -- 172.21.15.18:0/941158740 wait complete. 2024-09-12T02:45:34.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:34 smithi176 ceph-mon[35713]: pgmap v293: 33 pgs: 7 active+clean, 6 creating+peering, 20 unknown; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:34.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:34 smithi176 ceph-mon[35713]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:45:34.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:34 smithi176 ceph-mon[35713]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:45:34.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:34 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/941158740' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T02:45:34.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:34 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T02:45:34.756 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:34 smithi018 ceph-mon[30616]: pgmap v293: 33 pgs: 7 active+clean, 6 creating+peering, 20 unknown; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:34.756 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:34 smithi018 ceph-mon[30616]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:45:34.756 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:34 smithi018 ceph-mon[30616]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:45:34.756 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:34 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/941158740' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T02:45:34.757 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:34 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T02:45:34.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:34 smithi062 ceph-mon[35527]: pgmap v293: 33 pgs: 7 active+clean, 6 creating+peering, 20 unknown; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:34.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:34 smithi062 ceph-mon[35527]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:45:34.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:34 smithi062 ceph-mon[35527]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:45:34.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:34 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/941158740' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T02:45:34.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:34 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T02:45:35.324 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:45:35.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:35 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T02:45:35.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:35 smithi018 ceph-mon[30616]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:45:35.723 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:35.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:35 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T02:45:35.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:35 smithi176 ceph-mon[35713]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:45:35.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:35 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T02:45:35.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:35 smithi062 ceph-mon[35527]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:45:36.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.326+0000 7f40cb800640 1 -- 172.21.15.18:0/925205634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40c4076720 msgr2=0x7f40c4076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:36.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.326+0000 7f40cb800640 1 --2- 172.21.15.18:0/925205634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40c4076720 0x7f40c4076b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009900 tx=0x7f40b402a410 comp rx=0 tx=0).stop 2024-09-12T02:45:36.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.326+0000 7f40cb800640 1 -- 172.21.15.18:0/925205634 shutdown_connections 2024-09-12T02:45:36.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.326+0000 7f40cb800640 1 --2- 172.21.15.18:0/925205634 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40c4112a30 0x7f40c4114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.326+0000 7f40cb800640 1 --2- 172.21.15.18:0/925205634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40c4077040 0x7f40c41124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.326+0000 7f40cb800640 1 --2- 172.21.15.18:0/925205634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40c4076720 0x7f40c4076b00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.326+0000 7f40cb800640 1 -- 172.21.15.18:0/925205634 >> 172.21.15.18:0/925205634 conn(0x7f40c40ffa90 msgr2=0x7f40c4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:36.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.326+0000 7f40cb800640 1 -- 172.21.15.18:0/925205634 shutdown_connections 2024-09-12T02:45:36.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.326+0000 7f40cb800640 1 -- 172.21.15.18:0/925205634 wait complete. 2024-09-12T02:45:36.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.327+0000 7f40cb800640 1 Processor -- start 2024-09-12T02:45:36.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.327+0000 7f40cb800640 1 -- start start 2024-09-12T02:45:36.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.327+0000 7f40cb800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40c4076720 0x7f40c41a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:36.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.327+0000 7f40cb800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40c4077040 0x7f40c41a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:36.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.328+0000 7f40cb800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40c4112a30 0x7f40c419e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:36.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.328+0000 7f40cb800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f40c4118610 con 0x7f40c4076720 2024-09-12T02:45:36.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.328+0000 7f40cb800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f40c4118490 con 0x7f40c4112a30 2024-09-12T02:45:36.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.328+0000 7f40cb800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f40c4118790 con 0x7f40c4077040 2024-09-12T02:45:36.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.328+0000 7f40c8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40c4076720 0x7f40c41a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:36.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.328+0000 7f40c8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40c4076720 0x7f40c41a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59708/0 (socket says 172.21.15.18:59708) 2024-09-12T02:45:36.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.328+0000 7f40c8e00640 1 -- 172.21.15.18:0/804838412 learned_addr learned my addr 172.21.15.18:0/804838412 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:36.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.328+0000 7f40c9800640 1 --2- 172.21.15.18:0/804838412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40c4112a30 0x7f40c419e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:36.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.328+0000 7f40bbe00640 1 --2- 172.21.15.18:0/804838412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40c4077040 0x7f40c41a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:36.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.328+0000 7f40c8e00640 1 -- 172.21.15.18:0/804838412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40c4077040 msgr2=0x7f40c41a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:36.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.328+0000 7f40c8e00640 1 --2- 172.21.15.18:0/804838412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40c4077040 0x7f40c41a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.328+0000 7f40c8e00640 1 -- 172.21.15.18:0/804838412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40c4112a30 msgr2=0x7f40c419e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:36.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.328+0000 7f40c8e00640 1 --2- 172.21.15.18:0/804838412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40c4112a30 0x7f40c419e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:36.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.328+0000 7f40c8e00640 1 -- 172.21.15.18:0/804838412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c419efa0 con 0x7f40c4076720 2024-09-12T02:45:36.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.329+0000 7f40c8e00640 1 --2- 172.21.15.18:0/804838412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40c4076720 0x7f40c41a46b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f40b4004770 tx=0x7f40b4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:36.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.329+0000 7f40c2000640 1 -- 172.21.15.18:0/804838412 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b403f070 con 0x7f40c4076720 2024-09-12T02:45:36.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.329+0000 7f40c2000640 1 -- 172.21.15.18:0/804838412 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40b4031ca0 con 0x7f40c4076720 2024-09-12T02:45:36.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.329+0000 7f40cb800640 1 -- 172.21.15.18:0/804838412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c419f230 con 0x7f40c4076720 2024-09-12T02:45:36.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.329+0000 7f40c2000640 1 -- 172.21.15.18:0/804838412 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4035030 con 0x7f40c4076720 2024-09-12T02:45:36.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.329+0000 7f40cb800640 1 -- 172.21.15.18:0/804838412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c41ab580 con 0x7f40c4076720 2024-09-12T02:45:36.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.330+0000 7f40cb800640 1 -- 172.21.15.18:0/804838412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40c4076b00 con 0x7f40c4076720 2024-09-12T02:45:36.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.333+0000 7f40c2000640 1 -- 172.21.15.18:0/804838412 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f40b4042070 con 0x7f40c4076720 2024-09-12T02:45:36.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.334+0000 7f40c2000640 1 --2- 172.21.15.18:0/804838412 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40a80a2c00 0x7f40a80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:36.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.334+0000 7f40c2000640 1 -- 172.21.15.18:0/804838412 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7879+0+0 (secure 0 0 0) 0x7f40b40efa60 con 0x7f40c4076720 2024-09-12T02:45:36.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.334+0000 7f40bbe00640 1 --2- 172.21.15.18:0/804838412 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40a80a2c00 0x7f40a80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:36.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.335+0000 7f40bbe00640 1 --2- 172.21.15.18:0/804838412 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40a80a2c00 0x7f40a80a50c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0095f0 tx=0x7f40ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:36.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.336+0000 7f40c2000640 1 -- 172.21.15.18:0/804838412 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f40b40bc540 con 0x7f40c4076720 2024-09-12T02:45:36.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:36.562+0000 7f40cb800640 1 -- 172.21.15.18:0/804838412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f40c419fda0 con 0x7f40c4076720 2024-09-12T02:45:36.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:36 smithi018 ceph-mon[30616]: pgmap v296: 97 pgs: 21 active+clean, 26 creating+peering, 50 unknown; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:36.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:36 smithi018 ceph-mon[30616]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:45:36.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:36 smithi176 ceph-mon[35713]: pgmap v296: 97 pgs: 21 active+clean, 26 creating+peering, 50 unknown; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:36.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:36 smithi176 ceph-mon[35713]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:45:36.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:36 smithi062 ceph-mon[35527]: pgmap v296: 97 pgs: 21 active+clean, 26 creating+peering, 50 unknown; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:36.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:36 smithi062 ceph-mon[35527]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:45:37.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:37.419+0000 7f40c2000640 1 -- 172.21.15.18:0/804838412 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f40b40c0840 con 0x7f40c4076720 2024-09-12T02:45:37.422 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T02:45:37.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:37.423+0000 7f40cb800640 1 -- 172.21.15.18:0/804838412 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40a80a2c00 msgr2=0x7f40a80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:37.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:37.423+0000 7f40cb800640 1 --2- 172.21.15.18:0/804838412 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40a80a2c00 0x7f40a80a50c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0095f0 tx=0x7f40ac005f90 comp rx=0 tx=0).stop 2024-09-12T02:45:37.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:37.423+0000 7f40cb800640 1 -- 172.21.15.18:0/804838412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40c4076720 msgr2=0x7f40c41a46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:37.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:37.423+0000 7f40cb800640 1 --2- 172.21.15.18:0/804838412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40c4076720 0x7f40c41a46b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f40b4004770 tx=0x7f40b4003c10 comp rx=0 tx=0).stop 2024-09-12T02:45:37.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:37.423+0000 7f40cb800640 1 -- 172.21.15.18:0/804838412 shutdown_connections 2024-09-12T02:45:37.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:37.423+0000 7f40cb800640 1 --2- 172.21.15.18:0/804838412 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40a80a2c00 0x7f40a80a50c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:37.423+0000 7f40cb800640 1 --2- 172.21.15.18:0/804838412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40c4112a30 0x7f40c419e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:37.423+0000 7f40cb800640 1 --2- 172.21.15.18:0/804838412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40c4077040 0x7f40c41a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:37.423+0000 7f40cb800640 1 --2- 172.21.15.18:0/804838412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40c4076720 0x7f40c41a46b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:37.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:37.423+0000 7f40cb800640 1 -- 172.21.15.18:0/804838412 >> 172.21.15.18:0/804838412 conn(0x7f40c40ffa90 msgr2=0x7f40c4101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:37.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:37.423+0000 7f40cb800640 1 -- 172.21.15.18:0/804838412 shutdown_connections 2024-09-12T02:45:37.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:37.423+0000 7f40cb800640 1 -- 172.21.15.18:0/804838412 wait complete. 2024-09-12T02:45:37.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:37 smithi176 ceph-mon[35713]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T02:45:37.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:37 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/804838412' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:45:37.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:37 smithi176 ceph-mon[35713]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:45:37.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:37 smithi062 ceph-mon[35527]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T02:45:37.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:37 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/804838412' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:45:37.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:37 smithi062 ceph-mon[35527]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:45:37.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:37 smithi018 ceph-mon[30616]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T02:45:37.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:37 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/804838412' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:45:37.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:37 smithi018 ceph-mon[30616]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:45:38.571 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-12T02:45:38.571 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-12T02:45:38.623 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:38 smithi018 ceph-mon[30616]: pgmap v299: 97 pgs: 54 active+clean, 20 creating+peering, 23 unknown; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:38.623 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:38 smithi018 ceph-mon[30616]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T02:45:38.623 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:38 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/804838412' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:45:38.623 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:38 smithi018 ceph-mon[30616]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:45:38.624 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:38 smithi018 ceph-mon[30616]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:45:38.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:38 smithi176 ceph-mon[35713]: pgmap v299: 97 pgs: 54 active+clean, 20 creating+peering, 23 unknown; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:38.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:38 smithi176 ceph-mon[35713]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T02:45:38.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:38 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/804838412' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:45:38.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:38 smithi176 ceph-mon[35713]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:45:38.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:38 smithi176 ceph-mon[35713]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:45:38.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:38 smithi062 ceph-mon[35527]: pgmap v299: 97 pgs: 54 active+clean, 20 creating+peering, 23 unknown; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:38.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:38 smithi062 ceph-mon[35527]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T02:45:38.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:38 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/804838412' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:45:38.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:38 smithi062 ceph-mon[35527]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:45:38.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:38 smithi062 ceph-mon[35527]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:45:38.958 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:39.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:39 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] up:active 2024-09-12T02:45:39.713 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:39 smithi018 ceph-mon[30616]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:45:39.713 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:39 smithi018 ceph-mon[30616]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:45:39.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:39 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] up:active 2024-09-12T02:45:39.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:39 smithi176 ceph-mon[35713]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:45:39.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:39 smithi176 ceph-mon[35713]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:45:39.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:39 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] up:active 2024-09-12T02:45:39.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:39 smithi062 ceph-mon[35527]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:45:39.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:39 smithi062 ceph-mon[35527]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:45:39.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.833+0000 7fea66400640 1 -- 172.21.15.18:0/2415044347 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea60074620 msgr2=0x7fea60074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:39.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.833+0000 7fea66400640 1 --2- 172.21.15.18:0/2415044347 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea60074620 0x7fea60074a00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fea50009900 tx=0x7fea5002a480 comp rx=0 tx=0).stop 2024-09-12T02:45:39.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.833+0000 7fea66400640 1 -- 172.21.15.18:0/2415044347 shutdown_connections 2024-09-12T02:45:39.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.833+0000 7fea66400640 1 --2- 172.21.15.18:0/2415044347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6010e3b0 0x7fea60110800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:39.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.833+0000 7fea66400640 1 --2- 172.21.15.18:0/2415044347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea60074f40 0x7fea6010de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:39.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.833+0000 7fea66400640 1 --2- 172.21.15.18:0/2415044347 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea60074620 0x7fea60074a00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:39.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.833+0000 7fea66400640 1 -- 172.21.15.18:0/2415044347 >> 172.21.15.18:0/2415044347 conn(0x7fea600fd8b0 msgr2=0x7fea600ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:39.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.833+0000 7fea66400640 1 -- 172.21.15.18:0/2415044347 shutdown_connections 2024-09-12T02:45:39.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.833+0000 7fea66400640 1 -- 172.21.15.18:0/2415044347 wait complete. 2024-09-12T02:45:39.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.834+0000 7fea66400640 1 Processor -- start 2024-09-12T02:45:39.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.834+0000 7fea66400640 1 -- start start 2024-09-12T02:45:39.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.835+0000 7fea66400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea60074620 0x7fea601a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:39.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.835+0000 7fea66400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea60074f40 0x7fea601a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:39.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.835+0000 7fea66400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea6010e3b0 0x7fea6019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:39.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.835+0000 7fea66400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fea601141b0 con 0x7fea60074f40 2024-09-12T02:45:39.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.835+0000 7fea66400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fea60114030 con 0x7fea60074620 2024-09-12T02:45:39.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.835+0000 7fea66400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fea60114330 con 0x7fea6010e3b0 2024-09-12T02:45:39.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.835+0000 7fea57e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea60074f40 0x7fea601a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:39.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.835+0000 7fea57e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea60074f40 0x7fea601a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59730/0 (socket says 172.21.15.18:59730) 2024-09-12T02:45:39.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.835+0000 7fea57e00640 1 -- 172.21.15.18:0/2902869873 learned_addr learned my addr 172.21.15.18:0/2902869873 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:39.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.835+0000 7fea5f400640 1 --2- 172.21.15.18:0/2902869873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea60074620 0x7fea601a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:39.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.835+0000 7fea5fe00640 1 --2- 172.21.15.18:0/2902869873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea6010e3b0 0x7fea6019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:39.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.836+0000 7fea5f400640 1 -- 172.21.15.18:0/2902869873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea6010e3b0 msgr2=0x7fea6019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:39.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.836+0000 7fea5f400640 1 --2- 172.21.15.18:0/2902869873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea6010e3b0 0x7fea6019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:39.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.836+0000 7fea5f400640 1 -- 172.21.15.18:0/2902869873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea60074f40 msgr2=0x7fea601a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:39.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.836+0000 7fea5f400640 1 --2- 172.21.15.18:0/2902869873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea60074f40 0x7fea601a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:39.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.836+0000 7fea5f400640 1 -- 172.21.15.18:0/2902869873 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6019acc0 con 0x7fea60074620 2024-09-12T02:45:39.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.836+0000 7fea5f400640 1 --2- 172.21.15.18:0/2902869873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea60074620 0x7fea601a03d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fea5002a9a0 tx=0x7fea50003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:39.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.836+0000 7fea5cc00640 1 -- 172.21.15.18:0/2902869873 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5003f070 con 0x7fea60074620 2024-09-12T02:45:39.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.836+0000 7fea66400640 1 -- 172.21.15.18:0/2902869873 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea6019af50 con 0x7fea60074620 2024-09-12T02:45:39.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.836+0000 7fea66400640 1 -- 172.21.15.18:0/2902869873 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea601a72a0 con 0x7fea60074620 2024-09-12T02:45:39.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.837+0000 7fea5cc00640 1 -- 172.21.15.18:0/2902869873 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea50031c90 con 0x7fea60074620 2024-09-12T02:45:39.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.837+0000 7fea5cc00640 1 -- 172.21.15.18:0/2902869873 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea50049060 con 0x7fea60074620 2024-09-12T02:45:39.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.838+0000 7fea66400640 1 -- 172.21.15.18:0/2902869873 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea3c005290 con 0x7fea60074620 2024-09-12T02:45:39.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.841+0000 7fea5cc00640 1 -- 172.21.15.18:0/2902869873 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fea50042070 con 0x7fea60074620 2024-09-12T02:45:39.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.842+0000 7fea5cc00640 1 --2- 172.21.15.18:0/2902869873 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fea440a2c00 0x7fea440a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:39.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.842+0000 7fea5cc00640 1 -- 172.21.15.18:0/2902869873 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 7979+0+0 (secure 0 0 0) 0x7fea500ef160 con 0x7fea60074620 2024-09-12T02:45:39.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.843+0000 7fea57e00640 1 --2- 172.21.15.18:0/2902869873 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fea440a2c00 0x7fea440a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:39.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.843+0000 7fea5cc00640 1 -- 172.21.15.18:0/2902869873 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea500bbb20 con 0x7fea60074620 2024-09-12T02:45:39.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:39.843+0000 7fea57e00640 1 --2- 172.21.15.18:0/2902869873 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fea440a2c00 0x7fea440a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fea600fff80 tx=0x7fea48005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:40.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:40.035+0000 7fea66400640 1 -- 172.21.15.18:0/2902869873 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fea3c005580 con 0x7fea60074620 2024-09-12T02:45:40.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:40.441+0000 7fea5cc00640 1 -- 172.21.15.18:0/2902869873 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v88) ==== 157+0+0 (secure 0 0 0) 0x7fea500bfe20 con 0x7fea60074620 2024-09-12T02:45:40.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:40.443+0000 7fea66400640 1 -- 172.21.15.18:0/2902869873 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fea440a2c00 msgr2=0x7fea440a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:40.443+0000 7fea66400640 1 --2- 172.21.15.18:0/2902869873 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fea440a2c00 0x7fea440a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fea600fff80 tx=0x7fea48005f90 comp rx=0 tx=0).stop 2024-09-12T02:45:40.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:40.443+0000 7fea66400640 1 -- 172.21.15.18:0/2902869873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea60074620 msgr2=0x7fea601a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:40.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:40.443+0000 7fea66400640 1 --2- 172.21.15.18:0/2902869873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea60074620 0x7fea601a03d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fea5002a9a0 tx=0x7fea50003b90 comp rx=0 tx=0).stop 2024-09-12T02:45:40.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:40.443+0000 7fea66400640 1 -- 172.21.15.18:0/2902869873 shutdown_connections 2024-09-12T02:45:40.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:40.443+0000 7fea66400640 1 --2- 172.21.15.18:0/2902869873 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fea440a2c00 0x7fea440a50c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:40.443+0000 7fea66400640 1 --2- 172.21.15.18:0/2902869873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea6010e3b0 0x7fea6019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:40.443+0000 7fea66400640 1 --2- 172.21.15.18:0/2902869873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea60074f40 0x7fea601a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:40.443+0000 7fea66400640 1 --2- 172.21.15.18:0/2902869873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea60074620 0x7fea601a03d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:40.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:40.443+0000 7fea66400640 1 -- 172.21.15.18:0/2902869873 >> 172.21.15.18:0/2902869873 conn(0x7fea600fd8b0 msgr2=0x7fea600ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:40.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:40.444+0000 7fea66400640 1 -- 172.21.15.18:0/2902869873 shutdown_connections 2024-09-12T02:45:40.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:40.444+0000 7fea66400640 1 -- 172.21.15.18:0/2902869873 wait complete. 2024-09-12T02:45:40.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:40 smithi176 ceph-mon[35713]: pgmap v301: 97 pgs: 70 active+clean, 20 creating+peering, 7 unknown; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 486 B/s wr, 5 op/s 2024-09-12T02:45:40.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:40 smithi176 ceph-mon[35713]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:45:40.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:40 smithi176 ceph-mon[35713]: Cluster is now healthy 2024-09-12T02:45:40.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:40 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2902869873' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T02:45:40.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:40 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T02:45:40.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:40 smithi062 ceph-mon[35527]: pgmap v301: 97 pgs: 70 active+clean, 20 creating+peering, 7 unknown; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 486 B/s wr, 5 op/s 2024-09-12T02:45:40.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:40 smithi062 ceph-mon[35527]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:45:40.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:40 smithi062 ceph-mon[35527]: Cluster is now healthy 2024-09-12T02:45:40.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:40 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2902869873' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T02:45:40.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:40 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T02:45:40.809 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:40 smithi018 ceph-mon[30616]: pgmap v301: 97 pgs: 70 active+clean, 20 creating+peering, 7 unknown; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 486 B/s wr, 5 op/s 2024-09-12T02:45:40.809 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:40 smithi018 ceph-mon[30616]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:45:40.809 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:40 smithi018 ceph-mon[30616]: Cluster is now healthy 2024-09-12T02:45:40.809 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:40 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2902869873' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T02:45:40.809 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:40 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T02:45:41.391 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:45:41.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:41 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T02:45:41.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:41 smithi176 ceph-mon[35713]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T02:45:41.776 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:41.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:41 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T02:45:41.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:41 smithi062 ceph-mon[35527]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T02:45:41.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:41 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T02:45:41.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:41 smithi018 ceph-mon[30616]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T02:45:42.512 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:42 smithi018 ceph-mon[30616]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-12T02:45:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.510+0000 7fd31fe00640 1 -- 172.21.15.18:0/3734080758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3201079c0 msgr2=0x7fd320107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.510+0000 7fd31fe00640 1 --2- 172.21.15.18:0/3734080758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3201079c0 0x7fd320107da0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd310009930 tx=0x7fd31002a420 comp rx=0 tx=0).stop 2024-09-12T02:45:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.510+0000 7fd31fe00640 1 -- 172.21.15.18:0/3734080758 shutdown_connections 2024-09-12T02:45:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.510+0000 7fd31fe00640 1 --2- 172.21.15.18:0/3734080758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd320102360 0x7fd32010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.510+0000 7fd31fe00640 1 --2- 172.21.15.18:0/3734080758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3201019c0 0x7fd320101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.510+0000 7fd31fe00640 1 --2- 172.21.15.18:0/3734080758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3201079c0 0x7fd320107da0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.510+0000 7fd31fe00640 1 -- 172.21.15.18:0/3734080758 >> 172.21.15.18:0/3734080758 conn(0x7fd3200fd740 msgr2=0x7fd3200ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.510+0000 7fd31fe00640 1 -- 172.21.15.18:0/3734080758 shutdown_connections 2024-09-12T02:45:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.510+0000 7fd31fe00640 1 -- 172.21.15.18:0/3734080758 wait complete. 2024-09-12T02:45:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.511+0000 7fd31fe00640 1 Processor -- start 2024-09-12T02:45:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.511+0000 7fd31fe00640 1 -- start start 2024-09-12T02:45:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.512+0000 7fd31fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3201019c0 0x7fd320198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.512+0000 7fd31fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd320102360 0x7fd3201987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.512+0000 7fd31fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3201079c0 0x7fd32019cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.512+0000 7fd31fe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd320111dd0 con 0x7fd3201079c0 2024-09-12T02:45:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.512+0000 7fd31fe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd320111c50 con 0x7fd320102360 2024-09-12T02:45:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.512+0000 7fd31fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd320111f50 con 0x7fd3201019c0 2024-09-12T02:45:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.512+0000 7fd31f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3201079c0 0x7fd32019cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.512+0000 7fd31f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3201079c0 0x7fd32019cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59742/0 (socket says 172.21.15.18:59742) 2024-09-12T02:45:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.512+0000 7fd31f400640 1 -- 172.21.15.18:0/1106776185 learned_addr learned my addr 172.21.15.18:0/1106776185 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.512+0000 7fd31ea00640 1 --2- 172.21.15.18:0/1106776185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3201019c0 0x7fd320198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.512+0000 7fd31e000640 1 --2- 172.21.15.18:0/1106776185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd320102360 0x7fd3201987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.513+0000 7fd31f400640 1 -- 172.21.15.18:0/1106776185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3201019c0 msgr2=0x7fd320198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.513+0000 7fd31f400640 1 --2- 172.21.15.18:0/1106776185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3201019c0 0x7fd320198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.513+0000 7fd31f400640 1 -- 172.21.15.18:0/1106776185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd320102360 msgr2=0x7fd3201987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.513+0000 7fd31f400640 1 --2- 172.21.15.18:0/1106776185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd320102360 0x7fd3201987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.513+0000 7fd31f400640 1 -- 172.21.15.18:0/1106776185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32019d220 con 0x7fd3201079c0 2024-09-12T02:45:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.513+0000 7fd31f400640 1 --2- 172.21.15.18:0/1106776185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3201079c0 0x7fd32019cb40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd31800cce0 tx=0x7fd31800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.513+0000 7fd317400640 1 -- 172.21.15.18:0/1106776185 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31800f450 con 0x7fd3201079c0 2024-09-12T02:45:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.513+0000 7fd317400640 1 -- 172.21.15.18:0/1106776185 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd31800fad0 con 0x7fd3201079c0 2024-09-12T02:45:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.513+0000 7fd317400640 1 -- 172.21.15.18:0/1106776185 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318018c10 con 0x7fd3201079c0 2024-09-12T02:45:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.513+0000 7fd31fe00640 1 -- 172.21.15.18:0/1106776185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32019d510 con 0x7fd3201079c0 2024-09-12T02:45:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.513+0000 7fd31fe00640 1 -- 172.21.15.18:0/1106776185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3201a4df0 con 0x7fd3201079c0 2024-09-12T02:45:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.514+0000 7fd31fe00640 1 -- 172.21.15.18:0/1106776185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd320101e20 con 0x7fd3201079c0 2024-09-12T02:45:42.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.516+0000 7fd317400640 1 -- 172.21.15.18:0/1106776185 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd31800f5f0 con 0x7fd3201079c0 2024-09-12T02:45:42.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.518+0000 7fd317400640 1 --2- 172.21.15.18:0/1106776185 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd3040a2c00 0x7fd3040a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:42.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.518+0000 7fd317400640 1 -- 172.21.15.18:0/1106776185 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8277+0+0 (secure 0 0 0) 0x7fd3180cf5f0 con 0x7fd3201079c0 2024-09-12T02:45:42.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.518+0000 7fd31ea00640 1 --2- 172.21.15.18:0/1106776185 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd3040a2c00 0x7fd3040a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:42.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.519+0000 7fd31ea00640 1 --2- 172.21.15.18:0/1106776185 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd3040a2c00 0x7fd3040a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd310006010 tx=0x7fd310000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:42.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.522+0000 7fd317400640 1 -- 172.21.15.18:0/1106776185 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd318014030 con 0x7fd3201079c0 2024-09-12T02:45:42.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:42.708+0000 7fd31fe00640 1 -- 172.21.15.18:0/1106776185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd32002d7c0 con 0x7fd3201079c0 2024-09-12T02:45:42.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:42 smithi176 ceph-mon[35713]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-12T02:45:42.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:42 smithi062 ceph-mon[35527]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-12T02:45:43.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:43 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1106776185' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:45:43.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:43 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1106776185' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:45:43.784 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 02:45:43 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-b[65969]: 2024-09-12T02:45:43.283+0000 7fc913cd1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:45:43.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:43 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1106776185' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:45:44.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:44.460+0000 7fd317400640 1 -- 172.21.15.18:0/1106776185 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v90) ==== 228+0+0 (secure 0 0 0) 0x7fd31809c4c0 con 0x7fd3201079c0 2024-09-12T02:45:44.462 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data_ec' created 2024-09-12T02:45:44.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:44.464+0000 7fd31fe00640 1 -- 172.21.15.18:0/1106776185 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd3040a2c00 msgr2=0x7fd3040a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:44.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:44.464+0000 7fd31fe00640 1 --2- 172.21.15.18:0/1106776185 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd3040a2c00 0x7fd3040a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd310006010 tx=0x7fd310000bc0 comp rx=0 tx=0).stop 2024-09-12T02:45:44.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:44.464+0000 7fd31fe00640 1 -- 172.21.15.18:0/1106776185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3201079c0 msgr2=0x7fd32019cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:44.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:44.464+0000 7fd31fe00640 1 --2- 172.21.15.18:0/1106776185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3201079c0 0x7fd32019cb40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd31800cce0 tx=0x7fd31800a620 comp rx=0 tx=0).stop 2024-09-12T02:45:44.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:44.465+0000 7fd31fe00640 1 -- 172.21.15.18:0/1106776185 shutdown_connections 2024-09-12T02:45:44.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:44.465+0000 7fd31fe00640 1 --2- 172.21.15.18:0/1106776185 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fd3040a2c00 0x7fd3040a50c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:44.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:44.465+0000 7fd31fe00640 1 --2- 172.21.15.18:0/1106776185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3201079c0 0x7fd32019cb40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:44.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:44.465+0000 7fd31fe00640 1 --2- 172.21.15.18:0/1106776185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd320102360 0x7fd3201987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:44.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:44.465+0000 7fd31fe00640 1 --2- 172.21.15.18:0/1106776185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3201019c0 0x7fd320198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:44.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:44.465+0000 7fd31fe00640 1 -- 172.21.15.18:0/1106776185 >> 172.21.15.18:0/1106776185 conn(0x7fd3200fd740 msgr2=0x7fd3200fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:44.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:44.465+0000 7fd31fe00640 1 -- 172.21.15.18:0/1106776185 shutdown_connections 2024-09-12T02:45:44.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:44.465+0000 7fd31fe00640 1 -- 172.21.15.18:0/1106776185 wait complete. 2024-09-12T02:45:44.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:44 smithi176 ceph-mon[35713]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T02:45:44.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:44 smithi176 ceph-mon[35713]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T02:45:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:44 smithi062 ceph-mon[35527]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T02:45:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:44 smithi062 ceph-mon[35527]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T02:45:44.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:44 smithi018 ceph-mon[30616]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T02:45:44.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:44 smithi018 ceph-mon[30616]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T02:45:45.566 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-12T02:45:45.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:45 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1106776185' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:45:45.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:45 smithi176 ceph-mon[35713]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T02:45:45.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:45 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1106776185' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:45:45.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:45 smithi062 ceph-mon[35527]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T02:45:45.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:45 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1106776185' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:45:45.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:45 smithi018 ceph-mon[30616]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T02:45:45.945 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:46.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.615+0000 7fbb29e00640 1 -- 172.21.15.18:0/2118334137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb24112870 msgr2=0x7fbb24114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:46.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.615+0000 7fbb29e00640 1 --2- 172.21.15.18:0/2118334137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb24112870 0x7fbb24114c60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009ca0 tx=0x7fbb1c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:45:46.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.615+0000 7fbb29e00640 1 -- 172.21.15.18:0/2118334137 shutdown_connections 2024-09-12T02:45:46.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.615+0000 7fbb29e00640 1 --2- 172.21.15.18:0/2118334137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb24112870 0x7fbb24114c60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:46.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.615+0000 7fbb29e00640 1 --2- 172.21.15.18:0/2118334137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb24077040 0x7fbb24112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:46.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.615+0000 7fbb29e00640 1 --2- 172.21.15.18:0/2118334137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb24076720 0x7fbb24076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:46.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.615+0000 7fbb29e00640 1 -- 172.21.15.18:0/2118334137 >> 172.21.15.18:0/2118334137 conn(0x7fbb240ff8d0 msgr2=0x7fbb24101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:46.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.615+0000 7fbb29e00640 1 -- 172.21.15.18:0/2118334137 shutdown_connections 2024-09-12T02:45:46.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.615+0000 7fbb29e00640 1 -- 172.21.15.18:0/2118334137 wait complete. 2024-09-12T02:45:46.618 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:46 smithi018 ceph-mon[30616]: pgmap v307: 129 pgs: 2 creating+peering, 30 unknown, 97 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 3 op/s 2024-09-12T02:45:46.618 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:46 smithi018 ceph-mon[30616]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:45:46.618 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:46 smithi018 ceph-mon[30616]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T02:45:46.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.616+0000 7fbb29e00640 1 Processor -- start 2024-09-12T02:45:46.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.616+0000 7fbb29e00640 1 -- start start 2024-09-12T02:45:46.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.617+0000 7fbb29e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb24076720 0x7fbb241a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:46.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.617+0000 7fbb29e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb24077040 0x7fbb241a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:46.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.617+0000 7fbb29e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb24112870 0x7fbb2419e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:46.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.617+0000 7fbb29e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbb241183c0 con 0x7fbb24076720 2024-09-12T02:45:46.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.617+0000 7fbb29e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbb24118240 con 0x7fbb24077040 2024-09-12T02:45:46.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.617+0000 7fbb29e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbb24118540 con 0x7fbb24112870 2024-09-12T02:45:46.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.617+0000 7fbb23e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb24077040 0x7fbb241a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:46.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.617+0000 7fbb23e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb24077040 0x7fbb241a4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:39762/0 (socket says 172.21.15.18:39762) 2024-09-12T02:45:46.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.617+0000 7fbb23e00640 1 -- 172.21.15.18:0/3277378202 learned_addr learned my addr 172.21.15.18:0/3277378202 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:46.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.617+0000 7fbb29400640 1 --2- 172.21.15.18:0/3277378202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb24112870 0x7fbb2419e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:46.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.617+0000 7fbb28a00640 1 --2- 172.21.15.18:0/3277378202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb24076720 0x7fbb241a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:46.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.618+0000 7fbb23e00640 1 -- 172.21.15.18:0/3277378202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb24112870 msgr2=0x7fbb2419e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:46.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.618+0000 7fbb23e00640 1 --2- 172.21.15.18:0/3277378202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb24112870 0x7fbb2419e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:46.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.618+0000 7fbb23e00640 1 -- 172.21.15.18:0/3277378202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb24076720 msgr2=0x7fbb241a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:46.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.618+0000 7fbb23e00640 1 --2- 172.21.15.18:0/3277378202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb24076720 0x7fbb241a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:46.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.618+0000 7fbb23e00640 1 -- 172.21.15.18:0/3277378202 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb2419ef40 con 0x7fbb24077040 2024-09-12T02:45:46.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.618+0000 7fbb29400640 1 --2- 172.21.15.18:0/3277378202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb24112870 0x7fbb2419e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:45:46.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.618+0000 7fbb28a00640 1 --2- 172.21.15.18:0/3277378202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb24076720 0x7fbb241a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:46.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.618+0000 7fbb23e00640 1 --2- 172.21.15.18:0/3277378202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb24077040 0x7fbb241a4b40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000e9f0 tx=0x7fbb1000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:46.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.618+0000 7fbb21600640 1 -- 172.21.15.18:0/3277378202 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1000cd80 con 0x7fbb24077040 2024-09-12T02:45:46.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.618+0000 7fbb29e00640 1 -- 172.21.15.18:0/3277378202 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb2419f230 con 0x7fbb24077040 2024-09-12T02:45:46.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.618+0000 7fbb21600640 1 -- 172.21.15.18:0/3277378202 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb10010910 con 0x7fbb24077040 2024-09-12T02:45:46.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.618+0000 7fbb21600640 1 -- 172.21.15.18:0/3277378202 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb100188f0 con 0x7fbb24077040 2024-09-12T02:45:46.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.618+0000 7fbb29e00640 1 -- 172.21.15.18:0/3277378202 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb241ab580 con 0x7fbb24077040 2024-09-12T02:45:46.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.619+0000 7fbb29e00640 1 -- 172.21.15.18:0/3277378202 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb24077e60 con 0x7fbb24077040 2024-09-12T02:45:46.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.622+0000 7fbb21600640 1 -- 172.21.15.18:0/3277378202 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbb10010ac0 con 0x7fbb24077040 2024-09-12T02:45:46.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.623+0000 7fbb21600640 1 --2- 172.21.15.18:0/3277378202 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fbb0c0a2b80 0x7fbb0c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:46.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.623+0000 7fbb21600640 1 -- 172.21.15.18:0/3277378202 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8770+0+0 (secure 0 0 0) 0x7fbb100cfbe0 con 0x7fbb24077040 2024-09-12T02:45:46.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.624+0000 7fbb28a00640 1 --2- 172.21.15.18:0/3277378202 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fbb0c0a2b80 0x7fbb0c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:46.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.624+0000 7fbb28a00640 1 --2- 172.21.15.18:0/3277378202 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fbb0c0a2b80 0x7fbb0c0a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009c20 tx=0x7fbb18005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:46.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.625+0000 7fbb21600640 1 -- 172.21.15.18:0/3277378202 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb1009c8c0 con 0x7fbb24077040 2024-09-12T02:45:46.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:46 smithi176 ceph-mon[35713]: pgmap v307: 129 pgs: 2 creating+peering, 30 unknown, 97 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 3 op/s 2024-09-12T02:45:46.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:46 smithi176 ceph-mon[35713]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:45:46.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:46 smithi176 ceph-mon[35713]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T02:45:46.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:46 smithi062 ceph-mon[35527]: pgmap v307: 129 pgs: 2 creating+peering, 30 unknown, 97 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 3 op/s 2024-09-12T02:45:46.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:46 smithi062 ceph-mon[35527]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:45:46.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:46 smithi062 ceph-mon[35527]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T02:45:46.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:46.807+0000 7fbb29e00640 1 -- 172.21.15.18:0/3277378202 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fbb24076b00 con 0x7fbb24077040 2024-09-12T02:45:47.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:47.489+0000 7fbb21600640 1 -- 172.21.15.18:0/3277378202 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v93) ==== 169+0+0 (secure 0 0 0) 0x7fbb24076b00 con 0x7fbb24077040 2024-09-12T02:45:47.491 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 4 allow_ec_overwrites to true 2024-09-12T02:45:47.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:47.492+0000 7fbb29e00640 1 -- 172.21.15.18:0/3277378202 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fbb0c0a2b80 msgr2=0x7fbb0c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:47.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:47.492+0000 7fbb29e00640 1 --2- 172.21.15.18:0/3277378202 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fbb0c0a2b80 0x7fbb0c0a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009c20 tx=0x7fbb18005f90 comp rx=0 tx=0).stop 2024-09-12T02:45:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:47.492+0000 7fbb29e00640 1 -- 172.21.15.18:0/3277378202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb24077040 msgr2=0x7fbb241a4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:47.492+0000 7fbb29e00640 1 --2- 172.21.15.18:0/3277378202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb24077040 0x7fbb241a4b40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000e9f0 tx=0x7fbb1000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:45:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:47.492+0000 7fbb29e00640 1 -- 172.21.15.18:0/3277378202 shutdown_connections 2024-09-12T02:45:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:47.492+0000 7fbb29e00640 1 --2- 172.21.15.18:0/3277378202 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fbb0c0a2b80 0x7fbb0c0a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:47.492+0000 7fbb29e00640 1 --2- 172.21.15.18:0/3277378202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb24112870 0x7fbb2419e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:47.492+0000 7fbb29e00640 1 --2- 172.21.15.18:0/3277378202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb24077040 0x7fbb241a4b40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:47.492+0000 7fbb29e00640 1 --2- 172.21.15.18:0/3277378202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb24076720 0x7fbb241a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:47.492+0000 7fbb29e00640 1 -- 172.21.15.18:0/3277378202 >> 172.21.15.18:0/3277378202 conn(0x7fbb240ff8d0 msgr2=0x7fbb24101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:47.492+0000 7fbb29e00640 1 -- 172.21.15.18:0/3277378202 shutdown_connections 2024-09-12T02:45:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:47.492+0000 7fbb29e00640 1 -- 172.21.15.18:0/3277378202 wait complete. 2024-09-12T02:45:47.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:47 smithi062 ceph-mon[35527]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T02:45:47.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:47 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3277378202' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T02:45:47.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:47 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T02:45:47.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:47 smithi018 ceph-mon[30616]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T02:45:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:47 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3277378202' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T02:45:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:47 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T02:45:47.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:47 smithi176 ceph-mon[35713]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T02:45:47.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:47 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3277378202' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T02:45:47.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:47 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T02:45:48.545 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-12T02:45:48.782 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:48 smithi018 ceph-mon[30616]: pgmap v310: 129 pgs: 5 creating+peering, 18 unknown, 106 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-12T02:45:48.783 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:48 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T02:45:48.783 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:48 smithi018 ceph-mon[30616]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T02:45:48.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:48 smithi062 ceph-mon[35527]: pgmap v310: 129 pgs: 5 creating+peering, 18 unknown, 106 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-12T02:45:48.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:48 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T02:45:48.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:48 smithi062 ceph-mon[35527]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T02:45:48.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:48 smithi176 ceph-mon[35713]: pgmap v310: 129 pgs: 5 creating+peering, 18 unknown, 106 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-12T02:45:48.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:48 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T02:45:48.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:48 smithi176 ceph-mon[35713]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T02:45:49.116 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:49.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.750+0000 7fb6aa800640 1 -- 172.21.15.18:0/2428035793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6a41034b0 msgr2=0x7fb6a410b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:49.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.750+0000 7fb6aa800640 1 --2- 172.21.15.18:0/2428035793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6a41034b0 0x7fb6a410b9a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb690009900 tx=0x7fb69002a480 comp rx=0 tx=0).stop 2024-09-12T02:45:49.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.750+0000 7fb6aa800640 1 -- 172.21.15.18:0/2428035793 shutdown_connections 2024-09-12T02:45:49.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.750+0000 7fb6aa800640 1 --2- 172.21.15.18:0/2428035793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6a410bfc0 0x7fb6a410e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:49.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.750+0000 7fb6aa800640 1 --2- 172.21.15.18:0/2428035793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6a41034b0 0x7fb6a410b9a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:49.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.750+0000 7fb6aa800640 1 --2- 172.21.15.18:0/2428035793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6a4102b90 0x7fb6a4102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:49.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.750+0000 7fb6aa800640 1 -- 172.21.15.18:0/2428035793 >> 172.21.15.18:0/2428035793 conn(0x7fb6a40fc610 msgr2=0x7fb6a40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:49.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.750+0000 7fb6aa800640 1 -- 172.21.15.18:0/2428035793 shutdown_connections 2024-09-12T02:45:49.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.750+0000 7fb6aa800640 1 -- 172.21.15.18:0/2428035793 wait complete. 2024-09-12T02:45:49.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.751+0000 7fb6aa800640 1 Processor -- start 2024-09-12T02:45:49.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.751+0000 7fb6aa800640 1 -- start start 2024-09-12T02:45:49.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.752+0000 7fb6aa800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6a4102b90 0x7fb6a41007f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:49.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.752+0000 7fb6aa800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6a41034b0 0x7fb6a4100d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:49.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.752+0000 7fb6aa800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6a410bfc0 0x7fb6a4101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:49.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.752+0000 7fb6aa800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a4111e10 con 0x7fb6a4102b90 2024-09-12T02:45:49.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.752+0000 7fb6aa800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a4111c90 con 0x7fb6a41034b0 2024-09-12T02:45:49.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.752+0000 7fb6aa800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a4111f90 con 0x7fb6a410bfc0 2024-09-12T02:45:49.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.752+0000 7fb6a9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6a4102b90 0x7fb6a41007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:49.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.752+0000 7fb6a9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6a4102b90 0x7fb6a41007f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57036/0 (socket says 172.21.15.18:57036) 2024-09-12T02:45:49.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.752+0000 7fb6a9400640 1 -- 172.21.15.18:0/2393982092 learned_addr learned my addr 172.21.15.18:0/2393982092 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:49.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.752+0000 7fb6a9e00640 1 --2- 172.21.15.18:0/2393982092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6a410bfc0 0x7fb6a4101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:49.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.752+0000 7fb6a8a00640 1 --2- 172.21.15.18:0/2393982092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6a41034b0 0x7fb6a4100d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:49.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.752+0000 7fb6a9400640 1 -- 172.21.15.18:0/2393982092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6a410bfc0 msgr2=0x7fb6a4101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:49.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.752+0000 7fb6a9400640 1 --2- 172.21.15.18:0/2393982092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6a410bfc0 0x7fb6a4101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:49.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.752+0000 7fb6a9400640 1 -- 172.21.15.18:0/2393982092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6a41034b0 msgr2=0x7fb6a4100d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:49.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.752+0000 7fb6a9400640 1 --2- 172.21.15.18:0/2393982092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6a41034b0 0x7fb6a4100d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:49.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.752+0000 7fb6a9400640 1 -- 172.21.15.18:0/2393982092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a41aace0 con 0x7fb6a4102b90 2024-09-12T02:45:49.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.752+0000 7fb6a8a00640 1 --2- 172.21.15.18:0/2393982092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6a41034b0 0x7fb6a4100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:45:49.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.753+0000 7fb6a9400640 1 --2- 172.21.15.18:0/2393982092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6a4102b90 0x7fb6a41007f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb69800eb90 tx=0x7fb69800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:49.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.753+0000 7fb6a2000640 1 -- 172.21.15.18:0/2393982092 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb698004d20 con 0x7fb6a4102b90 2024-09-12T02:45:49.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.753+0000 7fb6a2000640 1 -- 172.21.15.18:0/2393982092 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb69800ee90 con 0x7fb6a4102b90 2024-09-12T02:45:49.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.753+0000 7fb6a2000640 1 -- 172.21.15.18:0/2393982092 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb698010830 con 0x7fb6a4102b90 2024-09-12T02:45:49.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.753+0000 7fb6aa800640 1 -- 172.21.15.18:0/2393982092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a41aaf10 con 0x7fb6a4102b90 2024-09-12T02:45:49.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.753+0000 7fb6aa800640 1 -- 172.21.15.18:0/2393982092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6a41ab310 con 0x7fb6a4102b90 2024-09-12T02:45:49.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.754+0000 7fb6aa800640 1 -- 172.21.15.18:0/2393982092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6a406a850 con 0x7fb6a4102b90 2024-09-12T02:45:49.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.758+0000 7fb6a2000640 1 -- 172.21.15.18:0/2393982092 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb698005000 con 0x7fb6a4102b90 2024-09-12T02:45:49.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.759+0000 7fb6a2000640 1 --2- 172.21.15.18:0/2393982092 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb68c0a2c00 0x7fb68c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:49.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.759+0000 7fb6a2000640 1 -- 172.21.15.18:0/2393982092 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8770+0+0 (secure 0 0 0) 0x7fb6980cfb60 con 0x7fb6a4102b90 2024-09-12T02:45:49.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.759+0000 7fb6a8a00640 1 --2- 172.21.15.18:0/2393982092 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb68c0a2c00 0x7fb68c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:49.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.760+0000 7fb6a8a00640 1 --2- 172.21.15.18:0/2393982092 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb68c0a2c00 0x7fb68c0a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb690006010 tx=0x7fb690005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:49.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.762+0000 7fb6a2000640 1 -- 172.21.15.18:0/2393982092 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb69809c840 con 0x7fb6a4102b90 2024-09-12T02:45:49.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:49.987+0000 7fb6aa800640 1 -- 172.21.15.18:0/2393982092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fb6a4101d20 con 0x7fb6a4102b90 2024-09-12T02:45:50.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:50.489+0000 7fb6a2000640 1 -- 172.21.15.18:0/2393982092 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7fb69809c140 con 0x7fb6a4102b90 2024-09-12T02:45:50.491 INFO:teuthology.orchestra.run.smithi018.stderr:added data pool 4 to fsmap 2024-09-12T02:45:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:50.492+0000 7fb6aa800640 1 -- 172.21.15.18:0/2393982092 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb68c0a2c00 msgr2=0x7fb68c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:50.492+0000 7fb6aa800640 1 --2- 172.21.15.18:0/2393982092 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb68c0a2c00 0x7fb68c0a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb690006010 tx=0x7fb690005a40 comp rx=0 tx=0).stop 2024-09-12T02:45:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:50.492+0000 7fb6aa800640 1 -- 172.21.15.18:0/2393982092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6a4102b90 msgr2=0x7fb6a41007f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:50.492+0000 7fb6aa800640 1 --2- 172.21.15.18:0/2393982092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6a4102b90 0x7fb6a41007f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb69800eb90 tx=0x7fb69800c6a0 comp rx=0 tx=0).stop 2024-09-12T02:45:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:50.492+0000 7fb6aa800640 1 -- 172.21.15.18:0/2393982092 shutdown_connections 2024-09-12T02:45:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:50.492+0000 7fb6aa800640 1 --2- 172.21.15.18:0/2393982092 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb68c0a2c00 0x7fb68c0a50c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:50.492+0000 7fb6aa800640 1 --2- 172.21.15.18:0/2393982092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6a410bfc0 0x7fb6a4101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:50.492+0000 7fb6aa800640 1 --2- 172.21.15.18:0/2393982092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6a41034b0 0x7fb6a4100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:50.492+0000 7fb6aa800640 1 --2- 172.21.15.18:0/2393982092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6a4102b90 0x7fb6a41007f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:50.492+0000 7fb6aa800640 1 -- 172.21.15.18:0/2393982092 >> 172.21.15.18:0/2393982092 conn(0x7fb6a40fc610 msgr2=0x7fb6a40fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:50.493+0000 7fb6aa800640 1 -- 172.21.15.18:0/2393982092 shutdown_connections 2024-09-12T02:45:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:50.493+0000 7fb6aa800640 1 -- 172.21.15.18:0/2393982092 wait complete. 2024-09-12T02:45:50.781 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:50 smithi176 ceph-mon[35713]: pgmap v312: 129 pgs: 5 creating+peering, 5 unknown, 119 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:50.781 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:50 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2393982092' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T02:45:50.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:50 smithi062 ceph-mon[35527]: pgmap v312: 129 pgs: 5 creating+peering, 5 unknown, 119 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:50.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:50 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2393982092' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T02:45:50.833 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:50 smithi018 ceph-mon[30616]: pgmap v312: 129 pgs: 5 creating+peering, 5 unknown, 119 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:50.833 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:50 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2393982092' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T02:45:51.516 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:45:51.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:51 smithi062 ceph-mon[35527]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T02:45:51.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:51 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2393982092' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T02:45:51.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:51 smithi062 ceph-mon[35527]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:45:51.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:51 smithi018 ceph-mon[30616]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T02:45:51.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:51 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2393982092' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T02:45:51.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:51 smithi018 ceph-mon[30616]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:45:51.895 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:51.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:51 smithi176 ceph-mon[35713]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T02:45:51.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:51 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2393982092' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T02:45:51.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:51 smithi176 ceph-mon[35713]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:45:52.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.526+0000 7f7b5e600640 1 -- 172.21.15.18:0/993317517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b58101de0 msgr2=0x7f7b581021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:52.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.526+0000 7f7b5e600640 1 --2- 172.21.15.18:0/993317517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b58101de0 0x7f7b581021c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009900 tx=0x7f7b4802a410 comp rx=0 tx=0).stop 2024-09-12T02:45:52.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.526+0000 7f7b5e600640 1 -- 172.21.15.18:0/993317517 shutdown_connections 2024-09-12T02:45:52.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.526+0000 7f7b5e600640 1 --2- 172.21.15.18:0/993317517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b58106f10 0x7f7b5810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:52.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.526+0000 7f7b5e600640 1 --2- 172.21.15.18:0/993317517 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b58102790 0x7f7b581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:52.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.526+0000 7f7b5e600640 1 --2- 172.21.15.18:0/993317517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b58101de0 0x7f7b581021c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:52.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.526+0000 7f7b5e600640 1 -- 172.21.15.18:0/993317517 >> 172.21.15.18:0/993317517 conn(0x7f7b580fd8c0 msgr2=0x7f7b580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:52.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.526+0000 7f7b5e600640 1 -- 172.21.15.18:0/993317517 shutdown_connections 2024-09-12T02:45:52.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.526+0000 7f7b5e600640 1 -- 172.21.15.18:0/993317517 wait complete. 2024-09-12T02:45:52.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.527+0000 7f7b5e600640 1 Processor -- start 2024-09-12T02:45:52.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.527+0000 7f7b5e600640 1 -- start start 2024-09-12T02:45:52.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.527+0000 7f7b5e600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b58101de0 0x7f7b5819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:52.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.527+0000 7f7b5e600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b58102790 0x7f7b5819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:52.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.527+0000 7f7b5e600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b58106f10 0x7f7b5819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:52.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.527+0000 7f7b5e600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7b58111f30 con 0x7f7b58106f10 2024-09-12T02:45:52.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.527+0000 7f7b5e600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7b58111db0 con 0x7f7b58101de0 2024-09-12T02:45:52.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.527+0000 7f7b5e600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7b581120b0 con 0x7f7b58102790 2024-09-12T02:45:52.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.528+0000 7f7b57e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b58106f10 0x7f7b5819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:52.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.528+0000 7f7b57400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b58101de0 0x7f7b5819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:52.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.528+0000 7f7b57400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b58101de0 0x7f7b5819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:39800/0 (socket says 172.21.15.18:39800) 2024-09-12T02:45:52.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.528+0000 7f7b57400640 1 -- 172.21.15.18:0/1399914978 learned_addr learned my addr 172.21.15.18:0/1399914978 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:52.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.528+0000 7f7b4fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b58102790 0x7f7b5819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:52.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.528+0000 7f7b57e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b58106f10 0x7f7b5819ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57060/0 (socket says 172.21.15.18:57060) 2024-09-12T02:45:52.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.528+0000 7f7b57400640 1 -- 172.21.15.18:0/1399914978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b58102790 msgr2=0x7f7b5819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:52.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.528+0000 7f7b57400640 1 --2- 172.21.15.18:0/1399914978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b58102790 0x7f7b5819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:52.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.528+0000 7f7b57400640 1 -- 172.21.15.18:0/1399914978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b58106f10 msgr2=0x7f7b5819ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:52.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.528+0000 7f7b57400640 1 --2- 172.21.15.18:0/1399914978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b58106f10 0x7f7b5819ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:52.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.528+0000 7f7b57400640 1 -- 172.21.15.18:0/1399914978 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5819f600 con 0x7f7b58101de0 2024-09-12T02:45:52.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.528+0000 7f7b57400640 1 --2- 172.21.15.18:0/1399914978 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b58101de0 0x7f7b5819a650 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b48006010 tx=0x7f7b48004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:52.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.529+0000 7f7b54c00640 1 -- 172.21.15.18:0/1399914978 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4803f030 con 0x7f7b58101de0 2024-09-12T02:45:52.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.529+0000 7f7b5e600640 1 -- 172.21.15.18:0/1399914978 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b5819f890 con 0x7f7b58101de0 2024-09-12T02:45:52.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.529+0000 7f7b54c00640 1 -- 172.21.15.18:0/1399914978 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b48004440 con 0x7f7b58101de0 2024-09-12T02:45:52.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.529+0000 7f7b54c00640 1 -- 172.21.15.18:0/1399914978 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b48035070 con 0x7f7b58101de0 2024-09-12T02:45:52.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.529+0000 7f7b5e600640 1 -- 172.21.15.18:0/1399914978 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b581a71d0 con 0x7f7b58101de0 2024-09-12T02:45:52.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.530+0000 7f7b5e600640 1 -- 172.21.15.18:0/1399914978 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b581021c0 con 0x7f7b58101de0 2024-09-12T02:45:52.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.532+0000 7f7b54c00640 1 -- 172.21.15.18:0/1399914978 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7b48042030 con 0x7f7b58101de0 2024-09-12T02:45:52.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.533+0000 7f7b54c00640 1 --2- 172.21.15.18:0/1399914978 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7b3c0a2b80 0x7f7b3c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:52.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.533+0000 7f7b54c00640 1 -- 172.21.15.18:0/1399914978 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8802+0+0 (secure 0 0 0) 0x7f7b480ef890 con 0x7f7b58101de0 2024-09-12T02:45:52.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.533+0000 7f7b4fe00640 1 --2- 172.21.15.18:0/1399914978 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7b3c0a2b80 0x7f7b3c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:52.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.534+0000 7f7b4fe00640 1 --2- 172.21.15.18:0/1399914978 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7b3c0a2b80 0x7f7b3c0a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7b58076480 tx=0x7f7b40005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:52.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.535+0000 7f7b54c00640 1 -- 172.21.15.18:0/1399914978 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7b480bbf00 con 0x7f7b58101de0 2024-09-12T02:45:52.558 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:52 smithi018 ceph-mon[30616]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:52.559 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:52 smithi018 ceph-mon[30616]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T02:45:52.559 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:52 smithi018 ceph-mon[30616]: Cluster is now healthy 2024-09-12T02:45:52.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.757+0000 7f7b5e600640 1 -- 172.21.15.18:0/1399914978 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b581a73a0 con 0x7f7b58101de0 2024-09-12T02:45:52.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.758+0000 7f7b54c00640 1 -- 172.21.15.18:0/1399914978 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11830 (secure 0 0 0) 0x7f7b480c0200 con 0x7f7b58101de0 2024-09-12T02:45:52.760 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:45:52.760 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"btime":"2024-09-12T02:45:50:483892+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/747069368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":747069368},{"type":"v1","addr":"172.21.15.18:6837","nonce":747069368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/4056752027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4056752027},{"type":"v1","addr":"172.21.15.18:6839","nonce":4056752027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/43234729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":43234729},{"type":"v1","addr":"172.21.15.18:6835","nonce":43234729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/564392030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":564392030},{"type":"v1","addr":"172.21.15.62:6835","nonce":564392030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3199321182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3199321182},{"type":"v1","addr":"172.21.15.176:6835","nonce":3199321182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/3520593627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3520593627},{"type":"v1","addr":"172.21.15.62:6837","nonce":3520593627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4286557016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4286557016},{"type":"v1","addr":"172.21.15.176:6837","nonce":4286557016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6839/3957634398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":3957634398},{"type":"v1","addr":"172.21.15.176:6839","nonce":3957634398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/823308007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":823308007},{"type":"v1","addr":"172.21.15.18:6841","nonce":823308007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:45:36.564696+0000","modified":"2024-09-12T02:45:49.989738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24527},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/3744347102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3744347102},{"type":"v1","addr":"172.21.15.62:6839","nonce":3744347102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24527,"qdb_cluster":[24527]},"id":1}]} 2024-09-12T02:45:52.761 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 17 2024-09-12T02:45:52.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.761+0000 7f7b5e600640 1 -- 172.21.15.18:0/1399914978 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7b3c0a2b80 msgr2=0x7f7b3c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:52.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.761+0000 7f7b5e600640 1 --2- 172.21.15.18:0/1399914978 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7b3c0a2b80 0x7f7b3c0a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7b58076480 tx=0x7f7b40005f90 comp rx=0 tx=0).stop 2024-09-12T02:45:52.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.761+0000 7f7b5e600640 1 -- 172.21.15.18:0/1399914978 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b58101de0 msgr2=0x7f7b5819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:52.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.761+0000 7f7b5e600640 1 --2- 172.21.15.18:0/1399914978 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b58101de0 0x7f7b5819a650 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b48006010 tx=0x7f7b48004040 comp rx=0 tx=0).stop 2024-09-12T02:45:52.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.761+0000 7f7b5e600640 1 -- 172.21.15.18:0/1399914978 shutdown_connections 2024-09-12T02:45:52.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.761+0000 7f7b5e600640 1 --2- 172.21.15.18:0/1399914978 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7b3c0a2b80 0x7f7b3c0a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:52.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.761+0000 7f7b5e600640 1 --2- 172.21.15.18:0/1399914978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b58106f10 0x7f7b5819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:52.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.761+0000 7f7b5e600640 1 --2- 172.21.15.18:0/1399914978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b58102790 0x7f7b5819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:52.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.761+0000 7f7b5e600640 1 --2- 172.21.15.18:0/1399914978 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b58101de0 0x7f7b5819a650 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:52.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.761+0000 7f7b5e600640 1 -- 172.21.15.18:0/1399914978 >> 172.21.15.18:0/1399914978 conn(0x7f7b580fd8c0 msgr2=0x7f7b580fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:52.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.761+0000 7f7b5e600640 1 -- 172.21.15.18:0/1399914978 shutdown_connections 2024-09-12T02:45:52.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:52.761+0000 7f7b5e600640 1 -- 172.21.15.18:0/1399914978 wait complete. 2024-09-12T02:45:52.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:52 smithi062 ceph-mon[35527]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:52.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:52 smithi062 ceph-mon[35527]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T02:45:52.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:52 smithi062 ceph-mon[35527]: Cluster is now healthy 2024-09-12T02:45:52.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:52 smithi176 ceph-mon[35713]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:52.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:52 smithi176 ceph-mon[35713]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T02:45:52.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:52 smithi176 ceph-mon[35713]: Cluster is now healthy 2024-09-12T02:45:53.661 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:45:53.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:53 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1399914978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:53.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:53 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1399914978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:53.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:53 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1399914978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:54.042 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:54.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.685+0000 7eff86200640 1 -- 172.21.15.18:0/3317132524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff801049c0 msgr2=0x7eff80108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:54.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.685+0000 7eff86200640 1 --2- 172.21.15.18:0/3317132524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff801049c0 0x7eff80108a10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7eff68009860 tx=0x7eff6802a340 comp rx=0 tx=0).stop 2024-09-12T02:45:54.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.685+0000 7eff86200640 1 -- 172.21.15.18:0/3317132524 shutdown_connections 2024-09-12T02:45:54.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.685+0000 7eff86200640 1 --2- 172.21.15.18:0/3317132524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff80109140 0x7eff80110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:54.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.685+0000 7eff86200640 1 --2- 172.21.15.18:0/3317132524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff801049c0 0x7eff80108a10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:54.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.685+0000 7eff86200640 1 --2- 172.21.15.18:0/3317132524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff80104010 0x7eff801043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:54.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.685+0000 7eff86200640 1 -- 172.21.15.18:0/3317132524 >> 172.21.15.18:0/3317132524 conn(0x7eff800ffa50 msgr2=0x7eff80101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:54.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.685+0000 7eff86200640 1 -- 172.21.15.18:0/3317132524 shutdown_connections 2024-09-12T02:45:54.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.685+0000 7eff86200640 1 -- 172.21.15.18:0/3317132524 wait complete. 2024-09-12T02:45:54.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.686+0000 7eff86200640 1 Processor -- start 2024-09-12T02:45:54.707 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:54 smithi018 ceph-mon[30616]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:54.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.686+0000 7eff86200640 1 -- start start 2024-09-12T02:45:54.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.686+0000 7eff86200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff80104010 0x7eff8019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:54.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.686+0000 7eff86200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff801049c0 0x7eff8019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:54.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.686+0000 7eff86200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff80109140 0x7eff8019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:54.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.686+0000 7eff86200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7eff80114160 con 0x7eff801049c0 2024-09-12T02:45:54.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.686+0000 7eff86200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7eff80113fe0 con 0x7eff80109140 2024-09-12T02:45:54.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.686+0000 7eff86200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7eff801142e0 con 0x7eff80104010 2024-09-12T02:45:54.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.687+0000 7eff77e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff801049c0 0x7eff8019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:54.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.687+0000 7eff77e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff801049c0 0x7eff8019aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57078/0 (socket says 172.21.15.18:57078) 2024-09-12T02:45:54.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.687+0000 7eff77e00640 1 -- 172.21.15.18:0/2253640531 learned_addr learned my addr 172.21.15.18:0/2253640531 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:54.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.687+0000 7eff7f400640 1 --2- 172.21.15.18:0/2253640531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff80104010 0x7eff8019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:54.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.687+0000 7eff7fe00640 1 --2- 172.21.15.18:0/2253640531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff80109140 0x7eff8019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:54.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.687+0000 7eff77e00640 1 -- 172.21.15.18:0/2253640531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff80104010 msgr2=0x7eff8019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:54.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.687+0000 7eff77e00640 1 --2- 172.21.15.18:0/2253640531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff80104010 0x7eff8019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:54.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.687+0000 7eff77e00640 1 -- 172.21.15.18:0/2253640531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff80109140 msgr2=0x7eff8019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:54.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.687+0000 7eff77e00640 1 --2- 172.21.15.18:0/2253640531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff80109140 0x7eff8019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:54.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.687+0000 7eff77e00640 1 -- 172.21.15.18:0/2253640531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff8019f610 con 0x7eff801049c0 2024-09-12T02:45:54.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.687+0000 7eff77e00640 1 --2- 172.21.15.18:0/2253640531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff801049c0 0x7eff8019aba0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7eff68035040 tx=0x7eff68033b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:54.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.688+0000 7eff7cc00640 1 -- 172.21.15.18:0/2253640531 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff68037040 con 0x7eff801049c0 2024-09-12T02:45:54.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.688+0000 7eff7cc00640 1 -- 172.21.15.18:0/2253640531 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff68040070 con 0x7eff801049c0 2024-09-12T02:45:54.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.688+0000 7eff7cc00640 1 -- 172.21.15.18:0/2253640531 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff680039b0 con 0x7eff801049c0 2024-09-12T02:45:54.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.688+0000 7eff86200640 1 -- 172.21.15.18:0/2253640531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff8019f8a0 con 0x7eff801049c0 2024-09-12T02:45:54.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.688+0000 7eff86200640 1 -- 172.21.15.18:0/2253640531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff8019fd30 con 0x7eff801049c0 2024-09-12T02:45:54.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.689+0000 7eff86200640 1 -- 172.21.15.18:0/2253640531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff801043f0 con 0x7eff801049c0 2024-09-12T02:45:54.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.691+0000 7eff7cc00640 1 -- 172.21.15.18:0/2253640531 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7eff680305e0 con 0x7eff801049c0 2024-09-12T02:45:54.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.692+0000 7eff7cc00640 1 --2- 172.21.15.18:0/2253640531 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7eff640a2c00 0x7eff640a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:54.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.692+0000 7eff7cc00640 1 -- 172.21.15.18:0/2253640531 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8802+0+0 (secure 0 0 0) 0x7eff680ef1f0 con 0x7eff801049c0 2024-09-12T02:45:54.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.692+0000 7eff7f400640 1 --2- 172.21.15.18:0/2253640531 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7eff640a2c00 0x7eff640a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:54.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.693+0000 7eff7f400640 1 --2- 172.21.15.18:0/2253640531 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7eff640a2c00 0x7eff640a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7eff70009530 tx=0x7eff70009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:54.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.696+0000 7eff7cc00640 1 -- 172.21.15.18:0/2253640531 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7eff680bbeb0 con 0x7eff801049c0 2024-09-12T02:45:54.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:54 smithi062 ceph-mon[35527]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:54.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.888+0000 7eff86200640 1 -- 172.21.15.18:0/2253640531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff8002d7c0 con 0x7eff801049c0 2024-09-12T02:45:54.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.889+0000 7eff7cc00640 1 -- 172.21.15.18:0/2253640531 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24128 (secure 0 0 0) 0x7eff680bb7b0 con 0x7eff801049c0 2024-09-12T02:45:54.891 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:45:54.891 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":94,"fsid":"c7666100-70af-11ef-bcea-c7b262605968","created":"2024-09-12T02:37:14.139566+0000","modified":"2024-09-12T02:45:49.989543+0000","last_up_change":"2024-09-12T02:44:37.774835+0000","last_in_change":"2024-09-12T02:44:16.028970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:40:35.157621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:45:31.022530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:45:34.131637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:45:43.992286+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a61ecdc1-ceb9-43cb-a67d-b197888cca42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6803","nonce":2278662522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6805","nonce":2278662522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6809","nonce":2278662522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6807","nonce":2278662522}]},"public_addr":"172.21.15.18:6803/2278662522","cluster_addr":"172.21.15.18:6805/2278662522","heartbeat_back_addr":"172.21.15.18:6809/2278662522","heartbeat_front_addr":"172.21.15.18:6807/2278662522","state":["exists","up"]},{"osd":1,"uuid":"1b84f4be-23ce-466c-b974-b9851521785d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6801","nonce":3139630617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6803","nonce":3139630617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6807","nonce":3139630617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6805","nonce":3139630617}]},"public_addr":"172.21.15.62:6801/3139630617","cluster_addr":"172.21.15.62:6803/3139630617","heartbeat_back_addr":"172.21.15.62:6807/3139630617","heartbeat_front_addr":"172.21.15.62:6805/3139630617","state":["exists","up"]},{"osd":2,"uuid":"f7bdf028-db32-4d92-a039-bada37c3a146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6801","nonce":2704054654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6803","nonce":2704054654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6807","nonce":2704054654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6805","nonce":2704054654}]},"public_addr":"172.21.15.176:6801/2704054654","cluster_addr":"172.21.15.176:6803/2704054654","heartbeat_back_addr":"172.21.15.176:6807/2704054654","heartbeat_front_addr":"172.21.15.176:6805/2704054654","state":["exists","up"]},{"osd":3,"uuid":"39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6811","nonce":3378134261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6813","nonce":3378134261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6817","nonce":3378134261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6815","nonce":3378134261}]},"public_addr":"172.21.15.18:6811/3378134261","cluster_addr":"172.21.15.18:6813/3378134261","heartbeat_back_addr":"172.21.15.18:6817/3378134261","heartbeat_front_addr":"172.21.15.18:6815/3378134261","state":["exists","up"]},{"osd":4,"uuid":"66a2c8a0-1a99-4c6d-b56a-f1f6c3199655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6809","nonce":1416302860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6811","nonce":1416302860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6815","nonce":1416302860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6813","nonce":1416302860}]},"public_addr":"172.21.15.62:6809/1416302860","cluster_addr":"172.21.15.62:6811/1416302860","heartbeat_back_addr":"172.21.15.62:6815/1416302860","heartbeat_front_addr":"172.21.15.62:6813/1416302860","state":["exists","up"]},{"osd":5,"uuid":"c4070ecf-703a-4f5f-9a2b-63473ff7f98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6809","nonce":2234269387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6811","nonce":2234269387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6815","nonce":2234269387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6813","nonce":2234269387}]},"public_addr":"172.21.15.176:6809/2234269387","cluster_addr":"172.21.15.176:6811/2234269387","heartbeat_back_addr":"172.21.15.176:6815/2234269387","heartbeat_front_addr":"172.21.15.176:6813/2234269387","state":["exists","up"]},{"osd":6,"uuid":"12a08874-041e-4734-bc33-68ebfce97b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6819","nonce":3613955982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6821","nonce":3613955982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6825","nonce":3613955982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6823","nonce":3613955982}]},"public_addr":"172.21.15.18:6819/3613955982","cluster_addr":"172.21.15.18:6821/3613955982","heartbeat_back_addr":"172.21.15.18:6825/3613955982","heartbeat_front_addr":"172.21.15.18:6823/3613955982","state":["exists","up"]},{"osd":7,"uuid":"86a5b47c-143f-4848-892f-c7b6a17a2799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6817","nonce":750933013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6819","nonce":750933013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6823","nonce":750933013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6821","nonce":750933013}]},"public_addr":"172.21.15.62:6817/750933013","cluster_addr":"172.21.15.62:6819/750933013","heartbeat_back_addr":"172.21.15.62:6823/750933013","heartbeat_front_addr":"172.21.15.62:6821/750933013","state":["exists","up"]},{"osd":8,"uuid":"0426a455-ed11-4d6a-8e1d-c8aa2ee65cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6817","nonce":8496953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6819","nonce":8496953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6823","nonce":8496953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6821","nonce":8496953}]},"public_addr":"172.21.15.176:6817/8496953","cluster_addr":"172.21.15.176:6819/8496953","heartbeat_back_addr":"172.21.15.176:6823/8496953","heartbeat_front_addr":"172.21.15.176:6821/8496953","state":["exists","up"]},{"osd":9,"uuid":"241aa2cf-0765-465d-b400-4911e653412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6827","nonce":422514390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6829","nonce":422514390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6833","nonce":422514390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6831","nonce":422514390}]},"public_addr":"172.21.15.18:6827/422514390","cluster_addr":"172.21.15.18:6829/422514390","heartbeat_back_addr":"172.21.15.18:6833/422514390","heartbeat_front_addr":"172.21.15.18:6831/422514390","state":["exists","up"]},{"osd":10,"uuid":"b1d4ab1f-0ec4-4641-bab0-f39d15857615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6825","nonce":269877918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6827","nonce":269877918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6831","nonce":269877918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6829","nonce":269877918}]},"public_addr":"172.21.15.62:6825/269877918","cluster_addr":"172.21.15.62:6827/269877918","heartbeat_back_addr":"172.21.15.62:6831/269877918","heartbeat_front_addr":"172.21.15.62:6829/269877918","state":["exists","up"]},{"osd":11,"uuid":"d122f1bf-bd4f-45d5-b07c-7301b005977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6825","nonce":770358485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6827","nonce":770358485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6831","nonce":770358485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6829","nonce":770358485}]},"public_addr":"172.21.15.176:6825/770358485","cluster_addr":"172.21.15.176:6827/770358485","heartbeat_back_addr":"172.21.15.176:6831/770358485","heartbeat_front_addr":"172.21.15.176:6829/770358485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:39:42.435560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:09.100602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:32.884117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:01.733821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:29.812775+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:53.846503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:24.363464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:51.023614+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:15.782652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:45.378178+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:12.469173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:36.303058+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2679362143":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/4236556151":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6801/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6800/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/1197309398":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/3024661873":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/2429098892":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6801/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6800/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/1531572357":"2024-09-13T02:37:40.790128+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:45:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.892+0000 7eff86200640 1 -- 172.21.15.18:0/2253640531 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7eff640a2c00 msgr2=0x7eff640a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.892+0000 7eff86200640 1 --2- 172.21.15.18:0/2253640531 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7eff640a2c00 0x7eff640a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7eff70009530 tx=0x7eff70009260 comp rx=0 tx=0).stop 2024-09-12T02:45:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.892+0000 7eff86200640 1 -- 172.21.15.18:0/2253640531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff801049c0 msgr2=0x7eff8019aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.892+0000 7eff86200640 1 --2- 172.21.15.18:0/2253640531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff801049c0 0x7eff8019aba0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7eff68035040 tx=0x7eff68033b60 comp rx=0 tx=0).stop 2024-09-12T02:45:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.892+0000 7eff86200640 1 -- 172.21.15.18:0/2253640531 shutdown_connections 2024-09-12T02:45:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.892+0000 7eff86200640 1 --2- 172.21.15.18:0/2253640531 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7eff640a2c00 0x7eff640a50c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.892+0000 7eff86200640 1 --2- 172.21.15.18:0/2253640531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff80109140 0x7eff8019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.892+0000 7eff86200640 1 --2- 172.21.15.18:0/2253640531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff801049c0 0x7eff8019aba0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.892+0000 7eff86200640 1 --2- 172.21.15.18:0/2253640531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff80104010 0x7eff8019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.892+0000 7eff86200640 1 -- 172.21.15.18:0/2253640531 >> 172.21.15.18:0/2253640531 conn(0x7eff800ffa50 msgr2=0x7eff80100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:54.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.893+0000 7eff86200640 1 -- 172.21.15.18:0/2253640531 shutdown_connections 2024-09-12T02:45:54.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:54.893+0000 7eff86200640 1 -- 172.21.15.18:0/2253640531 wait complete. 2024-09-12T02:45:54.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:54 smithi176 ceph-mon[35713]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:55.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:55 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2253640531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:45:55.810 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:55 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2253640531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:45:55.848 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:45:55.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:55 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2253640531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:45:56.233 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:56.724 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:56 smithi018 ceph-mon[30616]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:56.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:56 smithi062 ceph-mon[35527]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:56.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.840+0000 7f7cedc00640 1 -- 172.21.15.18:0/1099769677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ce81019c0 msgr2=0x7f7ce8101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:56.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.840+0000 7f7cedc00640 1 --2- 172.21.15.18:0/1099769677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ce81019c0 0x7f7ce8101e20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009900 tx=0x7f7cd402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:45:56.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.840+0000 7f7cedc00640 1 -- 172.21.15.18:0/1099769677 shutdown_connections 2024-09-12T02:45:56.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.840+0000 7f7cedc00640 1 --2- 172.21.15.18:0/1099769677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ce8102360 0x7f7ce810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:56.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.840+0000 7f7cedc00640 1 --2- 172.21.15.18:0/1099769677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ce81019c0 0x7f7ce8101e20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:56.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.840+0000 7f7cedc00640 1 --2- 172.21.15.18:0/1099769677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ce81079c0 0x7f7ce8107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:56.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.840+0000 7f7cedc00640 1 -- 172.21.15.18:0/1099769677 >> 172.21.15.18:0/1099769677 conn(0x7f7ce80fd740 msgr2=0x7f7ce80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:56.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.840+0000 7f7cedc00640 1 -- 172.21.15.18:0/1099769677 shutdown_connections 2024-09-12T02:45:56.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.840+0000 7f7cedc00640 1 -- 172.21.15.18:0/1099769677 wait complete. 2024-09-12T02:45:56.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.841+0000 7f7cedc00640 1 Processor -- start 2024-09-12T02:45:56.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.841+0000 7f7cedc00640 1 -- start start 2024-09-12T02:45:56.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.842+0000 7f7cedc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ce81019c0 0x7f7ce819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:56.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.842+0000 7f7cedc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ce8102360 0x7f7ce819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:56.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.842+0000 7f7cedc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ce81079c0 0x7f7ce819edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:56.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.842+0000 7f7cedc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce8111dc0 con 0x7f7ce81019c0 2024-09-12T02:45:56.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.842+0000 7f7cedc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce8111c40 con 0x7f7ce8102360 2024-09-12T02:45:56.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.842+0000 7f7cedc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce8111f40 con 0x7f7ce81079c0 2024-09-12T02:45:56.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.842+0000 7f7ce7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ce81019c0 0x7f7ce819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:56.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.842+0000 7f7ce7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ce81019c0 0x7f7ce819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50820/0 (socket says 172.21.15.18:50820) 2024-09-12T02:45:56.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.842+0000 7f7ce7e00640 1 -- 172.21.15.18:0/3952820267 learned_addr learned my addr 172.21.15.18:0/3952820267 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:56.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.842+0000 7f7ce7400640 1 --2- 172.21.15.18:0/3952820267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ce8102360 0x7f7ce819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:56.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.842+0000 7f7ced200640 1 --2- 172.21.15.18:0/3952820267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ce81079c0 0x7f7ce819edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:56.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.843+0000 7f7ce7e00640 1 -- 172.21.15.18:0/3952820267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ce81079c0 msgr2=0x7f7ce819edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:56.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.843+0000 7f7ce7e00640 1 --2- 172.21.15.18:0/3952820267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ce81079c0 0x7f7ce819edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.843+0000 7f7ce7e00640 1 -- 172.21.15.18:0/3952820267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ce8102360 msgr2=0x7f7ce819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.843+0000 7f7ce7e00640 1 --2- 172.21.15.18:0/3952820267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ce8102360 0x7f7ce819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.843+0000 7f7ce7e00640 1 -- 172.21.15.18:0/3952820267 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce819f4a0 con 0x7f7ce81019c0 2024-09-12T02:45:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.843+0000 7f7ce7e00640 1 --2- 172.21.15.18:0/3952820267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ce81019c0 0x7f7ce819a4f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800e9f0 tx=0x7f7cd800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.843+0000 7f7ce4c00640 1 -- 172.21.15.18:0/3952820267 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd800cd80 con 0x7f7ce81019c0 2024-09-12T02:45:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.843+0000 7f7cedc00640 1 -- 172.21.15.18:0/3952820267 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce819f790 con 0x7f7ce81019c0 2024-09-12T02:45:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.843+0000 7f7ce4c00640 1 -- 172.21.15.18:0/3952820267 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cd8010910 con 0x7f7ce81019c0 2024-09-12T02:45:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.843+0000 7f7ce4c00640 1 -- 172.21.15.18:0/3952820267 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8018990 con 0x7f7ce81019c0 2024-09-12T02:45:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.843+0000 7f7cedc00640 1 -- 172.21.15.18:0/3952820267 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce81a7070 con 0x7f7ce81019c0 2024-09-12T02:45:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.845+0000 7f7cedc00640 1 -- 172.21.15.18:0/3952820267 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce8101e20 con 0x7f7ce81019c0 2024-09-12T02:45:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.848+0000 7f7ce4c00640 1 -- 172.21.15.18:0/3952820267 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7cd8010ac0 con 0x7f7ce81019c0 2024-09-12T02:45:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.849+0000 7f7ce4c00640 1 --2- 172.21.15.18:0/3952820267 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7ccc0a2b80 0x7f7ccc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.849+0000 7f7ce4c00640 1 -- 172.21.15.18:0/3952820267 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8802+0+0 (secure 0 0 0) 0x7f7cd80cf970 con 0x7f7ce81019c0 2024-09-12T02:45:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.850+0000 7f7ce7400640 1 --2- 172.21.15.18:0/3952820267 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7ccc0a2b80 0x7f7ccc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.850+0000 7f7ce7400640 1 --2- 172.21.15.18:0/3952820267 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7ccc0a2b80 0x7f7ccc0a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009230 tx=0x7f7cd40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:56.852+0000 7f7ce4c00640 1 -- 172.21.15.18:0/3952820267 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7cd809bfe0 con 0x7f7ce81019c0 2024-09-12T02:45:56.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:56 smithi176 ceph-mon[35713]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:57.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:57.051+0000 7f7cedc00640 1 -- 172.21.15.18:0/3952820267 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ce81a7310 con 0x7f7ce81019c0 2024-09-12T02:45:57.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:57.053+0000 7f7ce4c00640 1 -- 172.21.15.18:0/3952820267 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24128 (secure 0 0 0) 0x7f7cd80a02e0 con 0x7f7ce81019c0 2024-09-12T02:45:57.055 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:45:57.055 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":94,"fsid":"c7666100-70af-11ef-bcea-c7b262605968","created":"2024-09-12T02:37:14.139566+0000","modified":"2024-09-12T02:45:49.989543+0000","last_up_change":"2024-09-12T02:44:37.774835+0000","last_in_change":"2024-09-12T02:44:16.028970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:40:35.157621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:45:31.022530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:45:34.131637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:45:43.992286+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a61ecdc1-ceb9-43cb-a67d-b197888cca42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6803","nonce":2278662522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6805","nonce":2278662522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6809","nonce":2278662522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6807","nonce":2278662522}]},"public_addr":"172.21.15.18:6803/2278662522","cluster_addr":"172.21.15.18:6805/2278662522","heartbeat_back_addr":"172.21.15.18:6809/2278662522","heartbeat_front_addr":"172.21.15.18:6807/2278662522","state":["exists","up"]},{"osd":1,"uuid":"1b84f4be-23ce-466c-b974-b9851521785d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6801","nonce":3139630617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6803","nonce":3139630617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6807","nonce":3139630617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6805","nonce":3139630617}]},"public_addr":"172.21.15.62:6801/3139630617","cluster_addr":"172.21.15.62:6803/3139630617","heartbeat_back_addr":"172.21.15.62:6807/3139630617","heartbeat_front_addr":"172.21.15.62:6805/3139630617","state":["exists","up"]},{"osd":2,"uuid":"f7bdf028-db32-4d92-a039-bada37c3a146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6801","nonce":2704054654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6803","nonce":2704054654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6807","nonce":2704054654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6805","nonce":2704054654}]},"public_addr":"172.21.15.176:6801/2704054654","cluster_addr":"172.21.15.176:6803/2704054654","heartbeat_back_addr":"172.21.15.176:6807/2704054654","heartbeat_front_addr":"172.21.15.176:6805/2704054654","state":["exists","up"]},{"osd":3,"uuid":"39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6811","nonce":3378134261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6813","nonce":3378134261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6817","nonce":3378134261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6815","nonce":3378134261}]},"public_addr":"172.21.15.18:6811/3378134261","cluster_addr":"172.21.15.18:6813/3378134261","heartbeat_back_addr":"172.21.15.18:6817/3378134261","heartbeat_front_addr":"172.21.15.18:6815/3378134261","state":["exists","up"]},{"osd":4,"uuid":"66a2c8a0-1a99-4c6d-b56a-f1f6c3199655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6809","nonce":1416302860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6811","nonce":1416302860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6815","nonce":1416302860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6813","nonce":1416302860}]},"public_addr":"172.21.15.62:6809/1416302860","cluster_addr":"172.21.15.62:6811/1416302860","heartbeat_back_addr":"172.21.15.62:6815/1416302860","heartbeat_front_addr":"172.21.15.62:6813/1416302860","state":["exists","up"]},{"osd":5,"uuid":"c4070ecf-703a-4f5f-9a2b-63473ff7f98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6809","nonce":2234269387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6811","nonce":2234269387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6815","nonce":2234269387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6813","nonce":2234269387}]},"public_addr":"172.21.15.176:6809/2234269387","cluster_addr":"172.21.15.176:6811/2234269387","heartbeat_back_addr":"172.21.15.176:6815/2234269387","heartbeat_front_addr":"172.21.15.176:6813/2234269387","state":["exists","up"]},{"osd":6,"uuid":"12a08874-041e-4734-bc33-68ebfce97b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6819","nonce":3613955982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6821","nonce":3613955982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6825","nonce":3613955982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6823","nonce":3613955982}]},"public_addr":"172.21.15.18:6819/3613955982","cluster_addr":"172.21.15.18:6821/3613955982","heartbeat_back_addr":"172.21.15.18:6825/3613955982","heartbeat_front_addr":"172.21.15.18:6823/3613955982","state":["exists","up"]},{"osd":7,"uuid":"86a5b47c-143f-4848-892f-c7b6a17a2799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6817","nonce":750933013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6819","nonce":750933013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6823","nonce":750933013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6821","nonce":750933013}]},"public_addr":"172.21.15.62:6817/750933013","cluster_addr":"172.21.15.62:6819/750933013","heartbeat_back_addr":"172.21.15.62:6823/750933013","heartbeat_front_addr":"172.21.15.62:6821/750933013","state":["exists","up"]},{"osd":8,"uuid":"0426a455-ed11-4d6a-8e1d-c8aa2ee65cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6817","nonce":8496953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6819","nonce":8496953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6823","nonce":8496953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6821","nonce":8496953}]},"public_addr":"172.21.15.176:6817/8496953","cluster_addr":"172.21.15.176:6819/8496953","heartbeat_back_addr":"172.21.15.176:6823/8496953","heartbeat_front_addr":"172.21.15.176:6821/8496953","state":["exists","up"]},{"osd":9,"uuid":"241aa2cf-0765-465d-b400-4911e653412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6827","nonce":422514390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6829","nonce":422514390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6833","nonce":422514390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6831","nonce":422514390}]},"public_addr":"172.21.15.18:6827/422514390","cluster_addr":"172.21.15.18:6829/422514390","heartbeat_back_addr":"172.21.15.18:6833/422514390","heartbeat_front_addr":"172.21.15.18:6831/422514390","state":["exists","up"]},{"osd":10,"uuid":"b1d4ab1f-0ec4-4641-bab0-f39d15857615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6825","nonce":269877918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6827","nonce":269877918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6831","nonce":269877918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6829","nonce":269877918}]},"public_addr":"172.21.15.62:6825/269877918","cluster_addr":"172.21.15.62:6827/269877918","heartbeat_back_addr":"172.21.15.62:6831/269877918","heartbeat_front_addr":"172.21.15.62:6829/269877918","state":["exists","up"]},{"osd":11,"uuid":"d122f1bf-bd4f-45d5-b07c-7301b005977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6825","nonce":770358485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6827","nonce":770358485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6831","nonce":770358485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6829","nonce":770358485}]},"public_addr":"172.21.15.176:6825/770358485","cluster_addr":"172.21.15.176:6827/770358485","heartbeat_back_addr":"172.21.15.176:6831/770358485","heartbeat_front_addr":"172.21.15.176:6829/770358485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:39:42.435560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:09.100602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:32.884117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:01.733821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:29.812775+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:53.846503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:24.363464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:51.023614+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:15.782652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:45.378178+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:12.469173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:36.303058+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2679362143":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/4236556151":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6801/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6800/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/1197309398":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/3024661873":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/2429098892":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6801/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6800/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/1531572357":"2024-09-13T02:37:40.790128+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:45:57.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:57.057+0000 7f7cedc00640 1 -- 172.21.15.18:0/3952820267 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7ccc0a2b80 msgr2=0x7f7ccc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:57.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:57.057+0000 7f7cedc00640 1 --2- 172.21.15.18:0/3952820267 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7ccc0a2b80 0x7f7ccc0a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009230 tx=0x7f7cd40058d0 comp rx=0 tx=0).stop 2024-09-12T02:45:57.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:57.057+0000 7f7cedc00640 1 -- 172.21.15.18:0/3952820267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ce81019c0 msgr2=0x7f7ce819a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:57.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:57.057+0000 7f7cedc00640 1 --2- 172.21.15.18:0/3952820267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ce81019c0 0x7f7ce819a4f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800e9f0 tx=0x7f7cd800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:45:57.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:57.057+0000 7f7cedc00640 1 -- 172.21.15.18:0/3952820267 shutdown_connections 2024-09-12T02:45:57.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:57.057+0000 7f7cedc00640 1 --2- 172.21.15.18:0/3952820267 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7ccc0a2b80 0x7f7ccc0a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:57.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:57.057+0000 7f7cedc00640 1 --2- 172.21.15.18:0/3952820267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ce81079c0 0x7f7ce819edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:57.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:57.057+0000 7f7cedc00640 1 --2- 172.21.15.18:0/3952820267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ce8102360 0x7f7ce819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:57.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:57.057+0000 7f7cedc00640 1 --2- 172.21.15.18:0/3952820267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ce81019c0 0x7f7ce819a4f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:57.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:57.057+0000 7f7cedc00640 1 -- 172.21.15.18:0/3952820267 >> 172.21.15.18:0/3952820267 conn(0x7f7ce80fd740 msgr2=0x7f7ce80fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:57.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:57.057+0000 7f7cedc00640 1 -- 172.21.15.18:0/3952820267 shutdown_connections 2024-09-12T02:45:57.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:57.057+0000 7f7cedc00640 1 -- 172.21.15.18:0/3952820267 wait complete. 2024-09-12T02:45:57.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:57 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3952820267' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:45:57.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:57 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3952820267' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:45:57.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:57 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3952820267' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:45:58.057 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:45:58.437 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:45:58.779 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:58 smithi018 ceph-mon[30616]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:58.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:58 smithi062 ceph-mon[35527]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:58.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:58 smithi176 ceph-mon[35713]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:45:59.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.030+0000 7fa2df200640 1 -- 172.21.15.18:0/2271855239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2d8108f60 msgr2=0x7fa2d8110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:59.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.030+0000 7fa2df200640 1 --2- 172.21.15.18:0/2271855239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2d8108f60 0x7fa2d8110ae0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009ca0 tx=0x7fa2d402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.030+0000 7fa2df200640 1 -- 172.21.15.18:0/2271855239 shutdown_connections 2024-09-12T02:45:59.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.030+0000 7fa2df200640 1 --2- 172.21.15.18:0/2271855239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2d8108f60 0x7fa2d8110ae0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.030+0000 7fa2df200640 1 --2- 172.21.15.18:0/2271855239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2d81047e0 0x7fa2d8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.030+0000 7fa2df200640 1 --2- 172.21.15.18:0/2271855239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d8103e30 0x7fa2d8104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.030+0000 7fa2df200640 1 -- 172.21.15.18:0/2271855239 >> 172.21.15.18:0/2271855239 conn(0x7fa2d80ff8d0 msgr2=0x7fa2d8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:59.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.030+0000 7fa2df200640 1 -- 172.21.15.18:0/2271855239 shutdown_connections 2024-09-12T02:45:59.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.030+0000 7fa2df200640 1 -- 172.21.15.18:0/2271855239 wait complete. 2024-09-12T02:45:59.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.031+0000 7fa2df200640 1 Processor -- start 2024-09-12T02:45:59.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.031+0000 7fa2df200640 1 -- start start 2024-09-12T02:45:59.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.032+0000 7fa2df200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2d8103e30 0x7fa2d819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.032+0000 7fa2df200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2d81047e0 0x7fa2d819a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.032+0000 7fa2df200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d8108f60 0x7fa2d819ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.032+0000 7fa2df200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d8114010 con 0x7fa2d81047e0 2024-09-12T02:45:59.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.032+0000 7fa2df200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d8113e90 con 0x7fa2d8108f60 2024-09-12T02:45:59.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.032+0000 7fa2df200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d8114190 con 0x7fa2d8103e30 2024-09-12T02:45:59.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.032+0000 7fa2dd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2d81047e0 0x7fa2d819a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.032+0000 7fa2dd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2d81047e0 0x7fa2d819a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50836/0 (socket says 172.21.15.18:50836) 2024-09-12T02:45:59.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.032+0000 7fa2dd400640 1 -- 172.21.15.18:0/716955831 learned_addr learned my addr 172.21.15.18:0/716955831 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:45:59.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.032+0000 7fa2dde00640 1 --2- 172.21.15.18:0/716955831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2d8103e30 0x7fa2d819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.032+0000 7fa2de800640 1 --2- 172.21.15.18:0/716955831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d8108f60 0x7fa2d819ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.032+0000 7fa2dd400640 1 -- 172.21.15.18:0/716955831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2d8103e30 msgr2=0x7fa2d819a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:59.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.032+0000 7fa2dd400640 1 --2- 172.21.15.18:0/716955831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2d8103e30 0x7fa2d819a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.032+0000 7fa2dd400640 1 -- 172.21.15.18:0/716955831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d8108f60 msgr2=0x7fa2d819ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:59.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.032+0000 7fa2dd400640 1 --2- 172.21.15.18:0/716955831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d8108f60 0x7fa2d819ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.032+0000 7fa2dd400640 1 -- 172.21.15.18:0/716955831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d819f3a0 con 0x7fa2d81047e0 2024-09-12T02:45:59.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.033+0000 7fa2dd400640 1 --2- 172.21.15.18:0/716955831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2d81047e0 0x7fa2d819a930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800e9f0 tx=0x7fa2c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:59.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.033+0000 7fa2d2a00640 1 -- 172.21.15.18:0/716955831 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800cd80 con 0x7fa2d81047e0 2024-09-12T02:45:59.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.033+0000 7fa2df200640 1 -- 172.21.15.18:0/716955831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d819f690 con 0x7fa2d81047e0 2024-09-12T02:45:59.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.033+0000 7fa2d2a00640 1 -- 172.21.15.18:0/716955831 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c8005500 con 0x7fa2d81047e0 2024-09-12T02:45:59.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.033+0000 7fa2d2a00640 1 -- 172.21.15.18:0/716955831 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8010690 con 0x7fa2d81047e0 2024-09-12T02:45:59.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.033+0000 7fa2df200640 1 -- 172.21.15.18:0/716955831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d81a6f70 con 0x7fa2d81047e0 2024-09-12T02:45:59.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.034+0000 7fa2df200640 1 -- 172.21.15.18:0/716955831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d8104210 con 0x7fa2d81047e0 2024-09-12T02:45:59.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.036+0000 7fa2d2a00640 1 -- 172.21.15.18:0/716955831 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa2c80046c0 con 0x7fa2d81047e0 2024-09-12T02:45:59.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.038+0000 7fa2d2a00640 1 --2- 172.21.15.18:0/716955831 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa2c00a2b80 0x7fa2c00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:45:59.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.038+0000 7fa2d2a00640 1 -- 172.21.15.18:0/716955831 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8802+0+0 (secure 0 0 0) 0x7fa2c80cf680 con 0x7fa2d81047e0 2024-09-12T02:45:59.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.038+0000 7fa2dde00640 1 --2- 172.21.15.18:0/716955831 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa2c00a2b80 0x7fa2c00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:45:59.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.039+0000 7fa2dde00640 1 --2- 172.21.15.18:0/716955831 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa2c00a2b80 0x7fa2c00a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0095f0 tx=0x7fa2cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:45:59.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.042+0000 7fa2d2a00640 1 -- 172.21.15.18:0/716955831 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa2c809c340 con 0x7fa2d81047e0 2024-09-12T02:45:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.263+0000 7fa2df200640 1 -- 172.21.15.18:0/716955831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2d81a71d0 con 0x7fa2d81047e0 2024-09-12T02:45:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.264+0000 7fa2d2a00640 1 -- 172.21.15.18:0/716955831 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11830 (secure 0 0 0) 0x7fa2c809bc40 con 0x7fa2d81047e0 2024-09-12T02:45:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:45:59.266 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"btime":"2024-09-12T02:45:50:483892+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/747069368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":747069368},{"type":"v1","addr":"172.21.15.18:6837","nonce":747069368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/4056752027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4056752027},{"type":"v1","addr":"172.21.15.18:6839","nonce":4056752027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/43234729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":43234729},{"type":"v1","addr":"172.21.15.18:6835","nonce":43234729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/564392030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":564392030},{"type":"v1","addr":"172.21.15.62:6835","nonce":564392030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3199321182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3199321182},{"type":"v1","addr":"172.21.15.176:6835","nonce":3199321182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/3520593627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3520593627},{"type":"v1","addr":"172.21.15.62:6837","nonce":3520593627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4286557016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4286557016},{"type":"v1","addr":"172.21.15.176:6837","nonce":4286557016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6839/3957634398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":3957634398},{"type":"v1","addr":"172.21.15.176:6839","nonce":3957634398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/823308007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":823308007},{"type":"v1","addr":"172.21.15.18:6841","nonce":823308007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:45:36.564696+0000","modified":"2024-09-12T02:45:49.989738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24527},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/3744347102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3744347102},{"type":"v1","addr":"172.21.15.62:6839","nonce":3744347102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24527,"qdb_cluster":[24527]},"id":1}]} 2024-09-12T02:45:59.266 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 17 2024-09-12T02:45:59.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.266+0000 7fa2df200640 1 -- 172.21.15.18:0/716955831 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa2c00a2b80 msgr2=0x7fa2c00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:59.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.266+0000 7fa2df200640 1 --2- 172.21.15.18:0/716955831 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa2c00a2b80 0x7fa2c00a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0095f0 tx=0x7fa2cc005f90 comp rx=0 tx=0).stop 2024-09-12T02:45:59.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.266+0000 7fa2df200640 1 -- 172.21.15.18:0/716955831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2d81047e0 msgr2=0x7fa2d819a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:45:59.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.266+0000 7fa2df200640 1 --2- 172.21.15.18:0/716955831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2d81047e0 0x7fa2d819a930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800e9f0 tx=0x7fa2c800edf0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.266+0000 7fa2df200640 1 -- 172.21.15.18:0/716955831 shutdown_connections 2024-09-12T02:45:59.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.266+0000 7fa2df200640 1 --2- 172.21.15.18:0/716955831 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa2c00a2b80 0x7fa2c00a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.267+0000 7fa2df200640 1 --2- 172.21.15.18:0/716955831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d8108f60 0x7fa2d819ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.267+0000 7fa2df200640 1 --2- 172.21.15.18:0/716955831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2d81047e0 0x7fa2d819a930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.267+0000 7fa2df200640 1 --2- 172.21.15.18:0/716955831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2d8103e30 0x7fa2d819a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:45:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.267+0000 7fa2df200640 1 -- 172.21.15.18:0/716955831 >> 172.21.15.18:0/716955831 conn(0x7fa2d80ff8d0 msgr2=0x7fa2d8101ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:45:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.267+0000 7fa2df200640 1 -- 172.21.15.18:0/716955831 shutdown_connections 2024-09-12T02:45:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:45:59.267+0000 7fa2df200640 1 -- 172.21.15.18:0/716955831 wait complete. 2024-09-12T02:45:59.665 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:45:59 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/716955831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:59.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:45:59 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/716955831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:45:59.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:45:59 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/716955831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:00.201 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:46:00.583 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:00.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:00 smithi062 ceph-mon[35527]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:00.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:00 smithi018 ceph-mon[30616]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:00.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:00 smithi176 ceph-mon[35713]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:01.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.300+0000 7f3f73c00640 1 -- 172.21.15.18:0/4228423054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c1049a0 msgr2=0x7f3f6c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:01.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.300+0000 7f3f73c00640 1 --2- 172.21.15.18:0/4228423054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c1049a0 0x7f3f6c1089f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009900 tx=0x7f3f5802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.300+0000 7f3f73c00640 1 -- 172.21.15.18:0/4228423054 shutdown_connections 2024-09-12T02:46:01.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.300+0000 7f3f73c00640 1 --2- 172.21.15.18:0/4228423054 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f6c109120 0x7f3f6c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.300+0000 7f3f73c00640 1 --2- 172.21.15.18:0/4228423054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c1049a0 0x7f3f6c1089f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.300+0000 7f3f73c00640 1 --2- 172.21.15.18:0/4228423054 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f6c103ff0 0x7f3f6c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.300+0000 7f3f73c00640 1 -- 172.21.15.18:0/4228423054 >> 172.21.15.18:0/4228423054 conn(0x7f3f6c0ffa90 msgr2=0x7f3f6c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.300+0000 7f3f73c00640 1 -- 172.21.15.18:0/4228423054 shutdown_connections 2024-09-12T02:46:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.300+0000 7f3f73c00640 1 -- 172.21.15.18:0/4228423054 wait complete. 2024-09-12T02:46:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.301+0000 7f3f73c00640 1 Processor -- start 2024-09-12T02:46:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.301+0000 7f3f73c00640 1 -- start start 2024-09-12T02:46:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.302+0000 7f3f73c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f6c103ff0 0x7f3f6c19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.302+0000 7f3f73c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c1049a0 0x7f3f6c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.302+0000 7f3f73c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f6c109120 0x7f3f6c19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.302+0000 7f3f73c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c114190 con 0x7f3f6c1049a0 2024-09-12T02:46:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.302+0000 7f3f73c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c114010 con 0x7f3f6c109120 2024-09-12T02:46:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.302+0000 7f3f73c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c114310 con 0x7f3f6c103ff0 2024-09-12T02:46:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.302+0000 7f3f6be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c1049a0 0x7f3f6c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.302+0000 7f3f6be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c1049a0 0x7f3f6c19ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50854/0 (socket says 172.21.15.18:50854) 2024-09-12T02:46:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.302+0000 7f3f6be00640 1 -- 172.21.15.18:0/3925085614 learned_addr learned my addr 172.21.15.18:0/3925085614 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.302+0000 7f3f71200640 1 --2- 172.21.15.18:0/3925085614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f6c103ff0 0x7f3f6c19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.302+0000 7f3f71c00640 1 --2- 172.21.15.18:0/3925085614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f6c109120 0x7f3f6c19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.302+0000 7f3f6be00640 1 -- 172.21.15.18:0/3925085614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f6c103ff0 msgr2=0x7f3f6c19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.302+0000 7f3f6be00640 1 --2- 172.21.15.18:0/3925085614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f6c103ff0 0x7f3f6c19a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.302+0000 7f3f6be00640 1 -- 172.21.15.18:0/3925085614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f6c109120 msgr2=0x7f3f6c19eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.302+0000 7f3f6be00640 1 --2- 172.21.15.18:0/3925085614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f6c109120 0x7f3f6c19eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.302+0000 7f3f6be00640 1 -- 172.21.15.18:0/3925085614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6c19f5a0 con 0x7f3f6c1049a0 2024-09-12T02:46:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.303+0000 7f3f6be00640 1 --2- 172.21.15.18:0/3925085614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c1049a0 0x7f3f6c19ab30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3f58004770 tx=0x7f3f58003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.303+0000 7f3f69600640 1 -- 172.21.15.18:0/3925085614 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5803f070 con 0x7f3f6c1049a0 2024-09-12T02:46:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.303+0000 7f3f73c00640 1 -- 172.21.15.18:0/3925085614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f6c19f830 con 0x7f3f6c1049a0 2024-09-12T02:46:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.303+0000 7f3f69600640 1 -- 172.21.15.18:0/3925085614 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f58031ca0 con 0x7f3f6c1049a0 2024-09-12T02:46:01.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.303+0000 7f3f69600640 1 -- 172.21.15.18:0/3925085614 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f58035030 con 0x7f3f6c1049a0 2024-09-12T02:46:01.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.303+0000 7f3f73c00640 1 -- 172.21.15.18:0/3925085614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f6c1a7170 con 0x7f3f6c1049a0 2024-09-12T02:46:01.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.304+0000 7f3f73c00640 1 -- 172.21.15.18:0/3925085614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f6c1054d0 con 0x7f3f6c1049a0 2024-09-12T02:46:01.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.306+0000 7f3f69600640 1 -- 172.21.15.18:0/3925085614 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3f58042070 con 0x7f3f6c1049a0 2024-09-12T02:46:01.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.308+0000 7f3f69600640 1 --2- 172.21.15.18:0/3925085614 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3f540a2b80 0x7f3f540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:01.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.308+0000 7f3f69600640 1 -- 172.21.15.18:0/3925085614 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8802+0+0 (secure 0 0 0) 0x7f3f580efe80 con 0x7f3f6c1049a0 2024-09-12T02:46:01.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.308+0000 7f3f71200640 1 --2- 172.21.15.18:0/3925085614 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3f540a2b80 0x7f3f540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:01.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.309+0000 7f3f71200640 1 --2- 172.21.15.18:0/3925085614 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3f540a2b80 0x7f3f540a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3f600095f0 tx=0x7f3f60005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:01.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.310+0000 7f3f69600640 1 -- 172.21.15.18:0/3925085614 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3f580bc5b0 con 0x7f3f6c1049a0 2024-09-12T02:46:01.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.500+0000 7f3f73c00640 1 -- 172.21.15.18:0/3925085614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f6c1a7340 con 0x7f3f6c1049a0 2024-09-12T02:46:01.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.502+0000 7f3f69600640 1 -- 172.21.15.18:0/3925085614 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24128 (secure 0 0 0) 0x7f3f580c08b0 con 0x7f3f6c1049a0 2024-09-12T02:46:01.503 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:46:01.504 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":94,"fsid":"c7666100-70af-11ef-bcea-c7b262605968","created":"2024-09-12T02:37:14.139566+0000","modified":"2024-09-12T02:45:49.989543+0000","last_up_change":"2024-09-12T02:44:37.774835+0000","last_in_change":"2024-09-12T02:44:16.028970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:40:35.157621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:45:31.022530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:45:34.131637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:45:43.992286+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a61ecdc1-ceb9-43cb-a67d-b197888cca42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6803","nonce":2278662522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6805","nonce":2278662522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6809","nonce":2278662522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6807","nonce":2278662522}]},"public_addr":"172.21.15.18:6803/2278662522","cluster_addr":"172.21.15.18:6805/2278662522","heartbeat_back_addr":"172.21.15.18:6809/2278662522","heartbeat_front_addr":"172.21.15.18:6807/2278662522","state":["exists","up"]},{"osd":1,"uuid":"1b84f4be-23ce-466c-b974-b9851521785d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6801","nonce":3139630617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6803","nonce":3139630617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6807","nonce":3139630617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6805","nonce":3139630617}]},"public_addr":"172.21.15.62:6801/3139630617","cluster_addr":"172.21.15.62:6803/3139630617","heartbeat_back_addr":"172.21.15.62:6807/3139630617","heartbeat_front_addr":"172.21.15.62:6805/3139630617","state":["exists","up"]},{"osd":2,"uuid":"f7bdf028-db32-4d92-a039-bada37c3a146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6801","nonce":2704054654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6803","nonce":2704054654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6807","nonce":2704054654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6805","nonce":2704054654}]},"public_addr":"172.21.15.176:6801/2704054654","cluster_addr":"172.21.15.176:6803/2704054654","heartbeat_back_addr":"172.21.15.176:6807/2704054654","heartbeat_front_addr":"172.21.15.176:6805/2704054654","state":["exists","up"]},{"osd":3,"uuid":"39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6811","nonce":3378134261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6813","nonce":3378134261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6817","nonce":3378134261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6815","nonce":3378134261}]},"public_addr":"172.21.15.18:6811/3378134261","cluster_addr":"172.21.15.18:6813/3378134261","heartbeat_back_addr":"172.21.15.18:6817/3378134261","heartbeat_front_addr":"172.21.15.18:6815/3378134261","state":["exists","up"]},{"osd":4,"uuid":"66a2c8a0-1a99-4c6d-b56a-f1f6c3199655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6809","nonce":1416302860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6811","nonce":1416302860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6815","nonce":1416302860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6813","nonce":1416302860}]},"public_addr":"172.21.15.62:6809/1416302860","cluster_addr":"172.21.15.62:6811/1416302860","heartbeat_back_addr":"172.21.15.62:6815/1416302860","heartbeat_front_addr":"172.21.15.62:6813/1416302860","state":["exists","up"]},{"osd":5,"uuid":"c4070ecf-703a-4f5f-9a2b-63473ff7f98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6809","nonce":2234269387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6811","nonce":2234269387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6815","nonce":2234269387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6813","nonce":2234269387}]},"public_addr":"172.21.15.176:6809/2234269387","cluster_addr":"172.21.15.176:6811/2234269387","heartbeat_back_addr":"172.21.15.176:6815/2234269387","heartbeat_front_addr":"172.21.15.176:6813/2234269387","state":["exists","up"]},{"osd":6,"uuid":"12a08874-041e-4734-bc33-68ebfce97b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6819","nonce":3613955982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6821","nonce":3613955982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6825","nonce":3613955982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6823","nonce":3613955982}]},"public_addr":"172.21.15.18:6819/3613955982","cluster_addr":"172.21.15.18:6821/3613955982","heartbeat_back_addr":"172.21.15.18:6825/3613955982","heartbeat_front_addr":"172.21.15.18:6823/3613955982","state":["exists","up"]},{"osd":7,"uuid":"86a5b47c-143f-4848-892f-c7b6a17a2799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6817","nonce":750933013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6819","nonce":750933013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6823","nonce":750933013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6821","nonce":750933013}]},"public_addr":"172.21.15.62:6817/750933013","cluster_addr":"172.21.15.62:6819/750933013","heartbeat_back_addr":"172.21.15.62:6823/750933013","heartbeat_front_addr":"172.21.15.62:6821/750933013","state":["exists","up"]},{"osd":8,"uuid":"0426a455-ed11-4d6a-8e1d-c8aa2ee65cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6817","nonce":8496953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6819","nonce":8496953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6823","nonce":8496953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6821","nonce":8496953}]},"public_addr":"172.21.15.176:6817/8496953","cluster_addr":"172.21.15.176:6819/8496953","heartbeat_back_addr":"172.21.15.176:6823/8496953","heartbeat_front_addr":"172.21.15.176:6821/8496953","state":["exists","up"]},{"osd":9,"uuid":"241aa2cf-0765-465d-b400-4911e653412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6827","nonce":422514390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6829","nonce":422514390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6833","nonce":422514390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6831","nonce":422514390}]},"public_addr":"172.21.15.18:6827/422514390","cluster_addr":"172.21.15.18:6829/422514390","heartbeat_back_addr":"172.21.15.18:6833/422514390","heartbeat_front_addr":"172.21.15.18:6831/422514390","state":["exists","up"]},{"osd":10,"uuid":"b1d4ab1f-0ec4-4641-bab0-f39d15857615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6825","nonce":269877918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6827","nonce":269877918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6831","nonce":269877918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6829","nonce":269877918}]},"public_addr":"172.21.15.62:6825/269877918","cluster_addr":"172.21.15.62:6827/269877918","heartbeat_back_addr":"172.21.15.62:6831/269877918","heartbeat_front_addr":"172.21.15.62:6829/269877918","state":["exists","up"]},{"osd":11,"uuid":"d122f1bf-bd4f-45d5-b07c-7301b005977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6825","nonce":770358485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6827","nonce":770358485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6831","nonce":770358485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6829","nonce":770358485}]},"public_addr":"172.21.15.176:6825/770358485","cluster_addr":"172.21.15.176:6827/770358485","heartbeat_back_addr":"172.21.15.176:6831/770358485","heartbeat_front_addr":"172.21.15.176:6829/770358485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:39:42.435560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:09.100602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:32.884117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:01.733821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:29.812775+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:53.846503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:24.363464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:51.023614+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:15.782652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:45.378178+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:12.469173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:36.303058+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2679362143":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/4236556151":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6801/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6800/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/1197309398":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/3024661873":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/2429098892":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6801/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6800/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/1531572357":"2024-09-13T02:37:40.790128+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:46:01.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.504+0000 7f3f73c00640 1 -- 172.21.15.18:0/3925085614 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3f540a2b80 msgr2=0x7f3f540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:01.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.504+0000 7f3f73c00640 1 --2- 172.21.15.18:0/3925085614 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3f540a2b80 0x7f3f540a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3f600095f0 tx=0x7f3f60005f90 comp rx=0 tx=0).stop 2024-09-12T02:46:01.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.504+0000 7f3f73c00640 1 -- 172.21.15.18:0/3925085614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c1049a0 msgr2=0x7f3f6c19ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:01.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.504+0000 7f3f73c00640 1 --2- 172.21.15.18:0/3925085614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c1049a0 0x7f3f6c19ab30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3f58004770 tx=0x7f3f58003c10 comp rx=0 tx=0).stop 2024-09-12T02:46:01.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.504+0000 7f3f73c00640 1 -- 172.21.15.18:0/3925085614 shutdown_connections 2024-09-12T02:46:01.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.504+0000 7f3f73c00640 1 --2- 172.21.15.18:0/3925085614 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f3f540a2b80 0x7f3f540a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.504+0000 7f3f73c00640 1 --2- 172.21.15.18:0/3925085614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f6c109120 0x7f3f6c19eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.504+0000 7f3f73c00640 1 --2- 172.21.15.18:0/3925085614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c1049a0 0x7f3f6c19ab30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.504+0000 7f3f73c00640 1 --2- 172.21.15.18:0/3925085614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f6c103ff0 0x7f3f6c19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:01.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.504+0000 7f3f73c00640 1 -- 172.21.15.18:0/3925085614 >> 172.21.15.18:0/3925085614 conn(0x7f3f6c0ffa90 msgr2=0x7f3f6c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:01.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.505+0000 7f3f73c00640 1 -- 172.21.15.18:0/3925085614 shutdown_connections 2024-09-12T02:46:01.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:01.505+0000 7f3f73c00640 1 -- 172.21.15.18:0/3925085614 wait complete. 2024-09-12T02:46:01.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:01 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3925085614' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:46:01.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:01 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3925085614' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:46:01.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:01 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3925085614' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:46:02.703 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:45:36.564696+0000', 'modified': '2024-09-12T02:45:49.989738+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24527}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24527': {'gid': 24527, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.62:6839/3744347102', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6838', 'nonce': 3744347102}, {'type': 'v1', 'addr': '172.21.15.62:6839', 'nonce': 3744347102}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24527, 'qdb_cluster': [24527]} 2024-09-12T02:46:02.703 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:46:02.704 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:46:02.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:02 smithi062 ceph-mon[35527]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:02.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:02 smithi018 ceph-mon[30616]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:02.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:02 smithi176 ceph-mon[35713]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:03.083 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:03.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.626+0000 7f6552600640 1 -- 172.21.15.18:0/2683248445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f654c104010 msgr2=0x7f654c1043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.626+0000 7f6552600640 1 --2- 172.21.15.18:0/2683248445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f654c104010 0x7f654c1043f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f653c009900 tx=0x7f653c02a410 comp rx=0 tx=0).stop 2024-09-12T02:46:03.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.626+0000 7f6552600640 1 -- 172.21.15.18:0/2683248445 shutdown_connections 2024-09-12T02:46:03.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.626+0000 7f6552600640 1 --2- 172.21.15.18:0/2683248445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f654c109140 0x7f654c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.626+0000 7f6552600640 1 --2- 172.21.15.18:0/2683248445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f654c1049c0 0x7f654c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.626+0000 7f6552600640 1 --2- 172.21.15.18:0/2683248445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f654c104010 0x7f654c1043f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.626+0000 7f6552600640 1 -- 172.21.15.18:0/2683248445 >> 172.21.15.18:0/2683248445 conn(0x7f654c0ffa50 msgr2=0x7f654c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:03.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.626+0000 7f6552600640 1 -- 172.21.15.18:0/2683248445 shutdown_connections 2024-09-12T02:46:03.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.626+0000 7f6552600640 1 -- 172.21.15.18:0/2683248445 wait complete. 2024-09-12T02:46:03.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.627+0000 7f6552600640 1 Processor -- start 2024-09-12T02:46:03.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.627+0000 7f6552600640 1 -- start start 2024-09-12T02:46:03.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.627+0000 7f6552600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f654c104010 0x7f654c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.627+0000 7f6552600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f654c1049c0 0x7f654c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.627+0000 7f6552600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f654c109140 0x7f654c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.627+0000 7f6552600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f654c114140 con 0x7f654c109140 2024-09-12T02:46:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.627+0000 7f6552600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f654c113fc0 con 0x7f654c104010 2024-09-12T02:46:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.627+0000 7f6552600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f654c1142c0 con 0x7f654c1049c0 2024-09-12T02:46:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.628+0000 7f654b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f654c104010 0x7f654c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.628+0000 7f654b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f654c104010 0x7f654c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:48382/0 (socket says 172.21.15.18:48382) 2024-09-12T02:46:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.628+0000 7f654b400640 1 -- 172.21.15.18:0/3444087516 learned_addr learned my addr 172.21.15.18:0/3444087516 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.628+0000 7f654aa00640 1 --2- 172.21.15.18:0/3444087516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f654c1049c0 0x7f654c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.628+0000 7f654be00640 1 --2- 172.21.15.18:0/3444087516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f654c109140 0x7f654c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.628+0000 7f654b400640 1 -- 172.21.15.18:0/3444087516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f654c1049c0 msgr2=0x7f654c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.628+0000 7f654b400640 1 --2- 172.21.15.18:0/3444087516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f654c1049c0 0x7f654c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.628+0000 7f654b400640 1 -- 172.21.15.18:0/3444087516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f654c109140 msgr2=0x7f654c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.628+0000 7f654b400640 1 --2- 172.21.15.18:0/3444087516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f654c109140 0x7f654c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.628+0000 7f654b400640 1 -- 172.21.15.18:0/3444087516 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f654c19f5b0 con 0x7f654c104010 2024-09-12T02:46:03.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.628+0000 7f654b400640 1 --2- 172.21.15.18:0/3444087516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f654c104010 0x7f654c19a600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f653c006010 tx=0x7f653c0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:03.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.629+0000 7f6543e00640 1 -- 172.21.15.18:0/3444087516 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c03f030 con 0x7f654c104010 2024-09-12T02:46:03.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.629+0000 7f6543e00640 1 -- 172.21.15.18:0/3444087516 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f653c003ce0 con 0x7f654c104010 2024-09-12T02:46:03.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.629+0000 7f6552600640 1 -- 172.21.15.18:0/3444087516 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f654c19f840 con 0x7f654c104010 2024-09-12T02:46:03.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.629+0000 7f6543e00640 1 -- 172.21.15.18:0/3444087516 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c035070 con 0x7f654c104010 2024-09-12T02:46:03.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.629+0000 7f6552600640 1 -- 172.21.15.18:0/3444087516 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f654c1a7180 con 0x7f654c104010 2024-09-12T02:46:03.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.632+0000 7f6543e00640 1 -- 172.21.15.18:0/3444087516 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f653c042030 con 0x7f654c104010 2024-09-12T02:46:03.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.632+0000 7f6555224740 1 Processor -- start 2024-09-12T02:46:03.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.632+0000 7f6555224740 1 -- start start 2024-09-12T02:46:03.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.633+0000 7f6555224740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443ee330 0x55e2443ee710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.633+0000 7f6555224740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443eec50 0x55e2443f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.633+0000 7f6555224740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443f9510 0x55e2443fb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.633+0000 7f6555224740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e2443540b0 con 0x55e2443ee330 2024-09-12T02:46:03.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.633+0000 7f6555224740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e2442fbab0 con 0x55e2443eec50 2024-09-12T02:46:03.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.633+0000 7f6555224740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e244350070 con 0x55e2443f9510 2024-09-12T02:46:03.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.633+0000 7f654be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443ee330 0x55e2443ee710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.633+0000 7f654be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443ee330 0x55e2443ee710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50888/0 (socket says 172.21.15.18:50888) 2024-09-12T02:46:03.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.633+0000 7f654be00640 1 -- 172.21.15.18:0/3590645689 learned_addr learned my addr 172.21.15.18:0/3590645689 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:03.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.633+0000 7f654aa00640 1 --2- 172.21.15.18:0/3590645689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443f9510 0x55e2443fb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.633+0000 7f654b400640 1 --2- 172.21.15.18:0/3590645689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443eec50 0x55e2443f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.634+0000 7f654aa00640 1 -- 172.21.15.18:0/3590645689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443eec50 msgr2=0x55e2443f8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:03.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.634+0000 7f654aa00640 1 --2- 172.21.15.18:0/3590645689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443eec50 0x55e2443f8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.634+0000 7f654aa00640 1 -- 172.21.15.18:0/3590645689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443ee330 msgr2=0x55e2443ee710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:03.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.634+0000 7f654aa00640 1 --2- 172.21.15.18:0/3590645689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443ee330 0x55e2443ee710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.634+0000 7f654aa00640 1 -- 172.21.15.18:0/3590645689 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2443084a0 con 0x55e2443f9510 2024-09-12T02:46:03.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.634+0000 7f6543e00640 1 --2- 172.21.15.18:0/3444087516 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f65300a2c00 0x7f65300a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.634+0000 7f654aa00640 1 --2- 172.21.15.18:0/3590645689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443f9510 0x55e2443fb900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6538005d00 tx=0x7f65380107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5beadd7641390ca3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:03.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.634+0000 7f6543e00640 1 -- 172.21.15.18:0/3444087516 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8802+0+0 (secure 0 0 0) 0x7f653c0ef7c0 con 0x7f654c104010 2024-09-12T02:46:03.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.634+0000 7f654be00640 1 --2- 172.21.15.18:0/3444087516 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f65300a2c00 0x7f65300a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.634+0000 7f6540c00640 1 -- 172.21.15.18:0/3590645689 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653801c480 con 0x55e2443f9510 2024-09-12T02:46:03.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.634+0000 7f6540c00640 1 -- 172.21.15.18:0/3590645689 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f653801cb00 con 0x55e2443f9510 2024-09-12T02:46:03.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.634+0000 7f6540c00640 1 -- 172.21.15.18:0/3590645689 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538011b80 con 0x55e2443f9510 2024-09-12T02:46:03.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.635+0000 7f6555224740 1 -- 172.21.15.18:0/3590645689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443f9510 msgr2=0x55e2443fb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.635+0000 7f654be00640 1 --2- 172.21.15.18:0/3444087516 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f65300a2c00 0x7f65300a50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6544005f40 tx=0x7f6544009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:03.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.635+0000 7f6555224740 1 --2- 172.21.15.18:0/3590645689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443f9510 0x55e2443fb900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6538005d00 tx=0x7f65380107a0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.635+0000 7f6555224740 1 -- 172.21.15.18:0/3590645689 shutdown_connections 2024-09-12T02:46:03.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.635+0000 7f6555224740 1 --2- 172.21.15.18:0/3590645689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443f9510 0x55e2443fb900 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.635+0000 7f6555224740 1 --2- 172.21.15.18:0/3590645689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443eec50 0x55e2443f8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.635+0000 7f6555224740 1 --2- 172.21.15.18:0/3590645689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443ee330 0x55e2443ee710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.635+0000 7f6555224740 1 -- 172.21.15.18:0/3590645689 >> 172.21.15.18:0/3590645689 conn(0x55e2443ea8c0 msgr2=0x55e2443eaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:03.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.635+0000 7f6555224740 1 -- 172.21.15.18:0/3590645689 shutdown_connections 2024-09-12T02:46:03.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.636+0000 7f6555224740 1 -- 172.21.15.18:0/3590645689 wait complete. 2024-09-12T02:46:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.636+0000 7f6555224740 1 -- start start 2024-09-12T02:46:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.636+0000 7f6555224740 1 Processor -- start 2024-09-12T02:46:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.637+0000 7f6555224740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443ee330 0x55e2443f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.637+0000 7f6555224740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443eec50 0x55e2443f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.637+0000 7f6555224740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443f9510 0x55e2443f7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.637+0000 7f6555224740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e2443fc060 con 0x55e2443f9510 2024-09-12T02:46:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.637+0000 7f6555224740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e2442dc920 con 0x55e2443eec50 2024-09-12T02:46:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.637+0000 7f6555224740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e2443fc1e0 con 0x55e2443ee330 2024-09-12T02:46:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.637+0000 7f6555224740 10 client.0 _ll_register_callbacks cb 0x55e2443008a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.637+0000 7f654b400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443ee330 0x55e2443f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.637+0000 7f654be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443f9510 0x55e2443f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.637+0000 7f654aa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443eec50 0x55e2443f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.637+0000 7f654b400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443ee330 0x55e2443f65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:52670/0 (socket says 172.21.15.18:52670) 2024-09-12T02:46:03.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.637+0000 7f654b400640 1 -- 172.21.15.18:0/2987090154 learned_addr learned my addr 172.21.15.18:0/2987090154 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:03.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.637+0000 7f654b400640 1 -- 172.21.15.18:0/2987090154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443eec50 msgr2=0x55e2443f6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:03.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.637+0000 7f654b400640 1 --2- 172.21.15.18:0/2987090154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443eec50 0x55e2443f6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.637+0000 7f654b400640 1 -- 172.21.15.18:0/2987090154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443f9510 msgr2=0x55e2443f7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:03.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.637+0000 7f654b400640 1 --2- 172.21.15.18:0/2987090154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443f9510 0x55e2443f7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.637+0000 7f654b400640 1 -- 172.21.15.18:0/2987090154 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2440c52b0 con 0x55e2443ee330 2024-09-12T02:46:03.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.638+0000 7f654aa00640 1 --2- 172.21.15.18:0/2987090154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443eec50 0x55e2443f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:03.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.638+0000 7f654b400640 1 --2- 172.21.15.18:0/2987090154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443ee330 0x55e2443f65b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f653c0c4580 tx=0x7f653c005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e21f7ab378e70c78 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:03.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.638+0000 7f6535600640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:46:03.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.638+0000 7f6535600640 1 -- 172.21.15.18:0/2987090154 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c049070 con 0x55e2443ee330 2024-09-12T02:46:03.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.638+0000 7f6535600640 1 -- 172.21.15.18:0/2987090154 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8802+0+0 (secure 0 0 0) 0x7f653c0bc150 con 0x55e2443ee330 2024-09-12T02:46:03.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.638+0000 7f6555224740 1 -- 172.21.15.18:0/2987090154 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f653801cb00 con 0x55e2443ee330 2024-09-12T02:46:03.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.638+0000 7f6535600640 1 -- 172.21.15.18:0/2987090154 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f653c0b8190 con 0x55e2443ee330 2024-09-12T02:46:03.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.638+0000 7f6555224740 10 client.24628 fetch_fsmap learned FSMap version 17 2024-09-12T02:46:03.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.638+0000 7f6555224740 1 -- 172.21.15.18:0/2987090154 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55e2443fc060 con 0x55e2443ee330 2024-09-12T02:46:03.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.638+0000 7f6535600640 1 -- 172.21.15.18:0/2987090154 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f653801cb00 con 0x55e2443ee330 2024-09-12T02:46:03.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.639+0000 7f6535600640 1 -- 172.21.15.18:0/2987090154 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f653c0c4620 con 0x55e2443ee330 2024-09-12T02:46:03.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.639+0000 7f6555224740 10 client.24628 fetch_fsmap finished waiting for FSMap version 17 2024-09-12T02:46:03.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.639+0000 7f6555224740 10 client.24628 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:46:03.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.639+0000 7f6555224740 20 client.24628 populate_metadata read hostname 'smithi018' 2024-09-12T02:46:03.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.639+0000 7f6555224740 1 --2- 172.21.15.18:0/2987090154 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e24440a4d0 0x55e24440b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.639+0000 7f6555224740 4 client.24628 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:46:03.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.639+0000 7f6555224740 1 -- 172.21.15.18:0/2987090154 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e244361620 con 0x55e24440a4d0 2024-09-12T02:46:03.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.639+0000 7f654aa00640 1 --2- 172.21.15.18:0/2987090154 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e24440a4d0 0x55e24440b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.640+0000 7f654aa00640 1 --2- 172.21.15.18:0/2987090154 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e24440a4d0 0x55e24440b940 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bb6a122d741d7f9 server_cookie=783d90184289f42a in_seq=0 out_seq=0 2024-09-12T02:46:03.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.640+0000 7f6535600640 10 client.24628 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:46:03.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.641+0000 7f6535600640 1 -- 172.21.15.18:0/2987090154 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e244361620 con 0x55e24440a4d0 2024-09-12T02:46:03.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.641+0000 7f6535600640 10 client.24628 handle_command_reply: tid=0 2024-09-12T02:46:03.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.641+0000 7f6555224740 1 client.24628 shutdown 2024-09-12T02:46:03.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.641+0000 7f6555224740 1 -- 172.21.15.18:0/2987090154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443ee330 msgr2=0x55e2443f65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.641+0000 7f6555224740 1 --2- 172.21.15.18:0/2987090154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443ee330 0x55e2443f65b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f653c0c4580 tx=0x7f653c005bd0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.641+0000 7f6555224740 1 -- 172.21.15.18:0/2987090154 shutdown_connections 2024-09-12T02:46:03.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.641+0000 7f6555224740 1 --2- 172.21.15.18:0/2987090154 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e24440a4d0 0x55e24440b940 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.641+0000 7f6555224740 1 --2- 172.21.15.18:0/2987090154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443f9510 0x55e2443f7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.641+0000 7f6555224740 1 --2- 172.21.15.18:0/2987090154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443eec50 0x55e2443f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.641+0000 7f6555224740 1 --2- 172.21.15.18:0/2987090154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443ee330 0x55e2443f65b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.641+0000 7f6535600640 0 client.24628 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:46:03.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.641+0000 7f6555224740 1 -- 172.21.15.18:0/2987090154 >> 172.21.15.18:0/2987090154 conn(0x55e2443ea8c0 msgr2=0x55e2443f05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:03.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.641+0000 7f6555224740 1 -- 172.21.15.18:0/2987090154 shutdown_connections 2024-09-12T02:46:03.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.642+0000 7f6555224740 1 -- 172.21.15.18:0/2987090154 wait complete. 2024-09-12T02:46:03.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.642+0000 7f6555224740 20 client.24628 trim_cache size 0 max 16384 2024-09-12T02:46:03.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.660+0000 7f6555224740 1 Processor -- start 2024-09-12T02:46:03.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.660+0000 7f6555224740 1 -- start start 2024-09-12T02:46:03.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.661+0000 7f6555224740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443ee330 0x55e244409710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.661+0000 7f6555224740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443eec50 0x55e2443f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.661+0000 7f6555224740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443f9510 0x55e2443f3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.661+0000 7f6555224740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e244409c80 con 0x55e2443eec50 2024-09-12T02:46:03.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.661+0000 7f6555224740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e24440a350 con 0x55e2443ee330 2024-09-12T02:46:03.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.661+0000 7f6555224740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e24440aa20 con 0x55e2443f9510 2024-09-12T02:46:03.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.661+0000 7f654aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443eec50 0x55e2443f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.661+0000 7f654aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443eec50 0x55e2443f6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50894/0 (socket says 172.21.15.18:50894) 2024-09-12T02:46:03.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.661+0000 7f654aa00640 1 -- 172.21.15.18:0/368331149 learned_addr learned my addr 172.21.15.18:0/368331149 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:03.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.661+0000 7f654b400640 1 --2- 172.21.15.18:0/368331149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443ee330 0x55e244409710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.661+0000 7f654be00640 1 --2- 172.21.15.18:0/368331149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443f9510 0x55e2443f3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.661+0000 7f654aa00640 1 -- 172.21.15.18:0/368331149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443f9510 msgr2=0x55e2443f3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:03.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.661+0000 7f654aa00640 1 --2- 172.21.15.18:0/368331149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443f9510 0x55e2443f3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.661+0000 7f654aa00640 1 -- 172.21.15.18:0/368331149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443ee330 msgr2=0x55e244409710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:03.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.661+0000 7f654aa00640 1 --2- 172.21.15.18:0/368331149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443ee330 0x55e244409710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.661+0000 7f654aa00640 1 -- 172.21.15.18:0/368331149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2443f4b60 con 0x55e2443eec50 2024-09-12T02:46:03.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.661+0000 7f654be00640 1 --2- 172.21.15.18:0/368331149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443f9510 0x55e2443f3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:03.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.662+0000 7f654aa00640 1 --2- 172.21.15.18:0/368331149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443eec50 0x55e2443f6ea0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6538005d00 tx=0x7f6538011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87671dace8007171 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:03.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.662+0000 7f6537e00640 1 -- 172.21.15.18:0/368331149 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653800b810 con 0x55e2443eec50 2024-09-12T02:46:03.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.662+0000 7f6537e00640 1 -- 172.21.15.18:0/368331149 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6538005030 con 0x55e2443eec50 2024-09-12T02:46:03.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.662+0000 7f6537e00640 1 -- 172.21.15.18:0/368331149 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653801c6e0 con 0x55e2443eec50 2024-09-12T02:46:03.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.663+0000 7f6555224740 1 -- 172.21.15.18:0/368331149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443eec50 msgr2=0x55e2443f6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.663+0000 7f6555224740 1 --2- 172.21.15.18:0/368331149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443eec50 0x55e2443f6ea0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6538005d00 tx=0x7f6538011700 comp rx=0 tx=0).stop 2024-09-12T02:46:03.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.663+0000 7f6555224740 1 -- 172.21.15.18:0/368331149 shutdown_connections 2024-09-12T02:46:03.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.663+0000 7f6555224740 1 --2- 172.21.15.18:0/368331149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443f9510 0x55e2443f3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.663+0000 7f6555224740 1 --2- 172.21.15.18:0/368331149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443eec50 0x55e2443f6ea0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.663+0000 7f6555224740 1 --2- 172.21.15.18:0/368331149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443ee330 0x55e244409710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.663+0000 7f6555224740 1 -- 172.21.15.18:0/368331149 >> 172.21.15.18:0/368331149 conn(0x55e2443ea8c0 msgr2=0x55e244409000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:03.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.663+0000 7f6555224740 1 -- 172.21.15.18:0/368331149 shutdown_connections 2024-09-12T02:46:03.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.663+0000 7f6555224740 1 -- 172.21.15.18:0/368331149 wait complete. 2024-09-12T02:46:03.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.663+0000 7f6555224740 1 -- start start 2024-09-12T02:46:03.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.664+0000 7f6555224740 1 Processor -- start 2024-09-12T02:46:03.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.664+0000 7f6555224740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443ee330 0x55e244413ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.664+0000 7f6555224740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443eec50 0x55e244413ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.664+0000 7f6555224740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443f9510 0x55e244414530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.664+0000 7f6555224740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e24440b7c0 con 0x55e2443ee330 2024-09-12T02:46:03.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.664+0000 7f6555224740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e24440b0f0 con 0x55e2443f9510 2024-09-12T02:46:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.664+0000 7f6555224740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e24440be90 con 0x55e2443eec50 2024-09-12T02:46:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.664+0000 7f6555224740 10 client.0 _ll_register_callbacks cb 0x7f653c03b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:46:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.664+0000 7f654be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443f9510 0x55e244414530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.664+0000 7f654be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443f9510 0x55e244414530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:48424/0 (socket says 172.21.15.18:48424) 2024-09-12T02:46:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.664+0000 7f654be00640 1 -- 172.21.15.18:0/2106638213 learned_addr learned my addr 172.21.15.18:0/2106638213 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.665+0000 7f654aa00640 1 --2- 172.21.15.18:0/2106638213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443eec50 0x55e244413ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.665+0000 7f654b400640 1 --2- 172.21.15.18:0/2106638213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443ee330 0x55e244413ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.665+0000 7f654be00640 1 -- 172.21.15.18:0/2106638213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443eec50 msgr2=0x55e244413ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.665+0000 7f654be00640 1 --2- 172.21.15.18:0/2106638213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443eec50 0x55e244413ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.665+0000 7f654be00640 1 -- 172.21.15.18:0/2106638213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443ee330 msgr2=0x55e244413ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:46:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.665+0000 7f654be00640 1 --2- 172.21.15.18:0/2106638213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443ee330 0x55e244413ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.665+0000 7f654be00640 1 -- 172.21.15.18:0/2106638213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e24440eae0 con 0x55e2443f9510 2024-09-12T02:46:03.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.665+0000 7f654b400640 1 --2- 172.21.15.18:0/2106638213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443ee330 0x55e244413ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:03.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.665+0000 7f654be00640 1 --2- 172.21.15.18:0/2106638213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443f9510 0x55e244414530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6544011e30 tx=0x7f6544004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b379f4d4498c4837 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:03.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.665+0000 7f6535600640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:46:03.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.665+0000 7f6535600640 1 -- 172.21.15.18:0/2106638213 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654402f060 con 0x55e2443f9510 2024-09-12T02:46:03.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.665+0000 7f6555224740 1 -- 172.21.15.18:0/2106638213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6538005030 con 0x55e2443f9510 2024-09-12T02:46:03.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.666+0000 7f6535600640 1 -- 172.21.15.18:0/2106638213 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8802+0+0 (secure 0 0 0) 0x7f6544003970 con 0x55e2443f9510 2024-09-12T02:46:03.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.666+0000 7f6535600640 1 -- 172.21.15.18:0/2106638213 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f6544036050 con 0x55e2443f9510 2024-09-12T02:46:03.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.666+0000 7f6555224740 10 client.24629 fetch_fsmap learned FSMap version 17 2024-09-12T02:46:03.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.666+0000 7f6555224740 1 -- 172.21.15.18:0/2106638213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55e244474fe0 con 0x55e2443f9510 2024-09-12T02:46:03.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.666+0000 7f6535600640 1 -- 172.21.15.18:0/2106638213 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6538005030 con 0x55e2443f9510 2024-09-12T02:46:03.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.666+0000 7f6535600640 1 -- 172.21.15.18:0/2106638213 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f6544029030 con 0x55e2443f9510 2024-09-12T02:46:03.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.666+0000 7f6555224740 10 client.24629 fetch_fsmap finished waiting for FSMap version 17 2024-09-12T02:46:03.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.666+0000 7f6555224740 10 client.24629 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:46:03.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.666+0000 7f6555224740 20 client.24629 populate_metadata read hostname 'smithi018' 2024-09-12T02:46:03.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.666+0000 7f6555224740 1 --2- 172.21.15.18:0/2106638213 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e244479c10 0x55e244478920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:03.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.666+0000 7f6555224740 4 client.24629 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:46:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.666+0000 7f6555224740 1 -- 172.21.15.18:0/2106638213 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "status"}) -- 0x55e24435bb30 con 0x55e244479c10 2024-09-12T02:46:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.667+0000 7f654b400640 1 --2- 172.21.15.18:0/2106638213 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e244479c10 0x55e244478920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.667+0000 7f654b400640 1 --2- 172.21.15.18:0/2106638213 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e244479c10 0x55e244478920 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4f26952f9fb4580 server_cookie=872901560d8bbb0b in_seq=0 out_seq=0 2024-09-12T02:46:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.667+0000 7f6535600640 10 client.24629 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:46:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.667+0000 7f6535600640 1 -- 172.21.15.18:0/2106638213 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55e24435bb30 con 0x55e244479c10 2024-09-12T02:46:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.668+0000 7f6535600640 10 client.24629 handle_command_reply: tid=0 2024-09-12T02:46:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.668+0000 7f6555224740 1 client.24629 shutdown 2024-09-12T02:46:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.668+0000 7f6555224740 1 -- 172.21.15.18:0/2106638213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443f9510 msgr2=0x55e244414530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.668+0000 7f6555224740 1 --2- 172.21.15.18:0/2106638213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443f9510 0x55e244414530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6544011e30 tx=0x7f6544004a40 comp rx=0 tx=0).stop 2024-09-12T02:46:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.668+0000 7f6555224740 1 -- 172.21.15.18:0/2106638213 shutdown_connections 2024-09-12T02:46:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.668+0000 7f6555224740 1 --2- 172.21.15.18:0/2106638213 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e244479c10 0x55e244478920 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.668+0000 7f6555224740 1 --2- 172.21.15.18:0/2106638213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e2443f9510 0x55e244414530 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.668+0000 7f6555224740 1 --2- 172.21.15.18:0/2106638213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e2443eec50 0x55e244413ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.668+0000 7f6555224740 1 --2- 172.21.15.18:0/2106638213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2443ee330 0x55e244413ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.668+0000 7f6555224740 1 -- 172.21.15.18:0/2106638213 >> 172.21.15.18:0/2106638213 conn(0x55e2443ea8c0 msgr2=0x55e2443e9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:03.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.668+0000 7f6535600640 0 client.24629 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:46:03.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.668+0000 7f6555224740 1 -- 172.21.15.18:0/2106638213 shutdown_connections 2024-09-12T02:46:03.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.668+0000 7f6555224740 1 -- 172.21.15.18:0/2106638213 wait complete. 2024-09-12T02:46:03.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.668+0000 7f6555224740 20 client.24629 trim_cache size 0 max 16384 2024-09-12T02:46:03.677 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T02:46:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "c7666100-70af-11ef-bcea-c7b262605968", 2024-09-12T02:46:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-12T02:46:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24527, 2024-09-12T02:46:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-12T02:46:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-12T02:46:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-12T02:46:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 26.244176177, 2024-09-12T02:46:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 17, 2024-09-12T02:46:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 94, 2024-09-12T02:46:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 94, 2024-09-12T02:46:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 41.251284769000002 2024-09-12T02:46:03.679 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T02:46:03.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.669+0000 7f6552600640 1 -- 172.21.15.18:0/3444087516 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f65300a2c00 msgr2=0x7f65300a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.669+0000 7f6552600640 1 --2- 172.21.15.18:0/3444087516 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f65300a2c00 0x7f65300a50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6544005f40 tx=0x7f6544009600 comp rx=0 tx=0).stop 2024-09-12T02:46:03.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.669+0000 7f6552600640 1 -- 172.21.15.18:0/3444087516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f654c104010 msgr2=0x7f654c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:03.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.669+0000 7f6552600640 1 --2- 172.21.15.18:0/3444087516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f654c104010 0x7f654c19a600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f653c006010 tx=0x7f653c0042f0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.669+0000 7f6552600640 1 -- 172.21.15.18:0/3444087516 shutdown_connections 2024-09-12T02:46:03.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.669+0000 7f6552600640 1 --2- 172.21.15.18:0/3444087516 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f65300a2c00 0x7f65300a50c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.669+0000 7f6552600640 1 --2- 172.21.15.18:0/3444087516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f654c109140 0x7f654c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.669+0000 7f6552600640 1 --2- 172.21.15.18:0/3444087516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f654c1049c0 0x7f654c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.669+0000 7f6552600640 1 --2- 172.21.15.18:0/3444087516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f654c104010 0x7f654c19a600 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:03.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.669+0000 7f6552600640 1 -- 172.21.15.18:0/3444087516 >> 172.21.15.18:0/3444087516 conn(0x7f654c0ffa50 msgr2=0x7f654c100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:03.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.669+0000 7f6552600640 1 -- 172.21.15.18:0/3444087516 shutdown_connections 2024-09-12T02:46:03.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:03.669+0000 7f6552600640 1 -- 172.21.15.18:0/3444087516 wait complete. 2024-09-12T02:46:04.655 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:46:04.655 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:46:04.655 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T02:46:04.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:04 smithi062 ceph-mon[35527]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:04.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:04 smithi018 ceph-mon[30616]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:04.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:04 smithi176 ceph-mon[35713]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:05.035 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.618+0000 7f31bf000640 1 -- 172.21.15.18:0/518255975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31b8102790 msgr2=0x7f31b81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.618+0000 7f31bf000640 1 --2- 172.21.15.18:0/518255975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31b8102790 0x7f31b81067e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f31a4009860 tx=0x7f31a402a340 comp rx=0 tx=0).stop 2024-09-12T02:46:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.618+0000 7f31bf000640 1 -- 172.21.15.18:0/518255975 shutdown_connections 2024-09-12T02:46:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.618+0000 7f31bf000640 1 --2- 172.21.15.18:0/518255975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31b8106f10 0x7f31b810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:05.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.618+0000 7f31bf000640 1 --2- 172.21.15.18:0/518255975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31b8102790 0x7f31b81067e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:05.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.618+0000 7f31bf000640 1 --2- 172.21.15.18:0/518255975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31b8101de0 0x7f31b81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:05.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.618+0000 7f31bf000640 1 -- 172.21.15.18:0/518255975 >> 172.21.15.18:0/518255975 conn(0x7f31b80fd8c0 msgr2=0x7f31b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:05.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.618+0000 7f31bf000640 1 -- 172.21.15.18:0/518255975 shutdown_connections 2024-09-12T02:46:05.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.618+0000 7f31bf000640 1 -- 172.21.15.18:0/518255975 wait complete. 2024-09-12T02:46:05.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.619+0000 7f31bf000640 1 Processor -- start 2024-09-12T02:46:05.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.619+0000 7f31bf000640 1 -- start start 2024-09-12T02:46:05.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31bf000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31b8101de0 0x7f31b819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:05.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31bf000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31b8102790 0x7f31b819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:05.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31bf000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31b8106f10 0x7f31b819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:05.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31bf000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f31b8111f30 con 0x7f31b8106f10 2024-09-12T02:46:05.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31bf000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f31b8111db0 con 0x7f31b8101de0 2024-09-12T02:46:05.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31bf000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f31b81120b0 con 0x7f31b8102790 2024-09-12T02:46:05.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31bd000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31b8106f10 0x7f31b819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:05.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31b7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31b8101de0 0x7f31b819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:05.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31b7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31b8101de0 0x7f31b819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:53878/0 (socket says 172.21.15.18:53878) 2024-09-12T02:46:05.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31b7e00640 1 -- 172.21.15.18:0/3083237102 learned_addr learned my addr 172.21.15.18:0/3083237102 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:05.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31bd000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31b8106f10 0x7f31b819ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41648/0 (socket says 172.21.15.18:41648) 2024-09-12T02:46:05.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31b7400640 1 --2- 172.21.15.18:0/3083237102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31b8102790 0x7f31b819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:05.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31b7e00640 1 -- 172.21.15.18:0/3083237102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31b8102790 msgr2=0x7f31b819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:05.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31b7e00640 1 --2- 172.21.15.18:0/3083237102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31b8102790 0x7f31b819abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:05.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31b7e00640 1 -- 172.21.15.18:0/3083237102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31b8106f10 msgr2=0x7f31b819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:05.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31b7e00640 1 --2- 172.21.15.18:0/3083237102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31b8106f10 0x7f31b819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:05.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31b7e00640 1 -- 172.21.15.18:0/3083237102 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b819f660 con 0x7f31b8101de0 2024-09-12T02:46:05.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31b7400640 1 --2- 172.21.15.18:0/3083237102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31b8102790 0x7f31b819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.620+0000 7f31bd000640 1 --2- 172.21.15.18:0/3083237102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31b8106f10 0x7f31b819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.621+0000 7f31b7e00640 1 --2- 172.21.15.18:0/3083237102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31b8101de0 0x7f31b819a6b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f31a800e9c0 tx=0x7f31a800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.621+0000 7f31b4c00640 1 -- 172.21.15.18:0/3083237102 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a800ccc0 con 0x7f31b8101de0 2024-09-12T02:46:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.621+0000 7f31bf000640 1 -- 172.21.15.18:0/3083237102 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b819f950 con 0x7f31b8101de0 2024-09-12T02:46:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.621+0000 7f31b4c00640 1 -- 172.21.15.18:0/3083237102 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31a8005500 con 0x7f31b8101de0 2024-09-12T02:46:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.621+0000 7f31b4c00640 1 -- 172.21.15.18:0/3083237102 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a8010430 con 0x7f31b8101de0 2024-09-12T02:46:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.621+0000 7f31bf000640 1 -- 172.21.15.18:0/3083237102 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b81a7230 con 0x7f31b8101de0 2024-09-12T02:46:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.622+0000 7f31bf000640 1 -- 172.21.15.18:0/3083237102 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b81021c0 con 0x7f31b8101de0 2024-09-12T02:46:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.624+0000 7f31b4c00640 1 -- 172.21.15.18:0/3083237102 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f31a80046c0 con 0x7f31b8101de0 2024-09-12T02:46:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.625+0000 7f31b4c00640 1 --2- 172.21.15.18:0/3083237102 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f319c0a2b80 0x7f319c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.625+0000 7f31b4c00640 1 -- 172.21.15.18:0/3083237102 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8802+0+0 (secure 0 0 0) 0x7f31a80cf680 con 0x7f31b8101de0 2024-09-12T02:46:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.626+0000 7f31b7400640 1 --2- 172.21.15.18:0/3083237102 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f319c0a2b80 0x7f319c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.626+0000 7f31b7400640 1 --2- 172.21.15.18:0/3083237102 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f319c0a2b80 0x7f319c0a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f31a4000c00 tx=0x7f31a40058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.630+0000 7f31b4c00640 1 -- 172.21.15.18:0/3083237102 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f31a809c340 con 0x7f31b8101de0 2024-09-12T02:46:05.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.851+0000 7f31bf000640 1 -- 172.21.15.18:0/3083237102 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f31b81a7460 con 0x7f31b8101de0 2024-09-12T02:46:05.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.851+0000 7f31b4c00640 1 -- 172.21.15.18:0/3083237102 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f31a809bc40 con 0x7f31b8101de0 2024-09-12T02:46:05.853 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T02:46:05.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.854+0000 7f31bf000640 1 -- 172.21.15.18:0/3083237102 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f319c0a2b80 msgr2=0x7f319c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:05.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.854+0000 7f31bf000640 1 --2- 172.21.15.18:0/3083237102 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f319c0a2b80 0x7f319c0a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f31a4000c00 tx=0x7f31a40058b0 comp rx=0 tx=0).stop 2024-09-12T02:46:05.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.854+0000 7f31bf000640 1 -- 172.21.15.18:0/3083237102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31b8101de0 msgr2=0x7f31b819a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.854+0000 7f31bf000640 1 --2- 172.21.15.18:0/3083237102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31b8101de0 0x7f31b819a6b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f31a800e9c0 tx=0x7f31a800ee80 comp rx=0 tx=0).stop 2024-09-12T02:46:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.854+0000 7f31bf000640 1 -- 172.21.15.18:0/3083237102 shutdown_connections 2024-09-12T02:46:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.854+0000 7f31bf000640 1 --2- 172.21.15.18:0/3083237102 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f319c0a2b80 0x7f319c0a5040 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.854+0000 7f31bf000640 1 --2- 172.21.15.18:0/3083237102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31b8106f10 0x7f31b819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.854+0000 7f31bf000640 1 --2- 172.21.15.18:0/3083237102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31b8102790 0x7f31b819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.854+0000 7f31bf000640 1 --2- 172.21.15.18:0/3083237102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31b8101de0 0x7f31b819a6b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.854+0000 7f31bf000640 1 -- 172.21.15.18:0/3083237102 >> 172.21.15.18:0/3083237102 conn(0x7f31b80fd8c0 msgr2=0x7f31b80fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.854+0000 7f31bf000640 1 -- 172.21.15.18:0/3083237102 shutdown_connections 2024-09-12T02:46:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:05.854+0000 7f31bf000640 1 -- 172.21.15.18:0/3083237102 wait complete. 2024-09-12T02:46:06.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:06 smithi018 ceph-mon[30616]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:06.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:06 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3083237102' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:46:06.736 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:46:06.737 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:46:06.737 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-12T02:46:06.737 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-12T02:46:06.737 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:46:06.737 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:46:06.737 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:46:06.737 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:46:06.737 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T02:46:06.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:06.738 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-12T02:46:06.774 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:46:06.774 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:46:06.774 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:46:06.774 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:46:06.774 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-12T02:46:06.775 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:46:06.775 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:46:06.775 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:46:06.775 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-12T02:46:06.775 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:46:06.775 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:46:06.775 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-12T02:46:06.775 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:46:06.775 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:46:06.775 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-12T02:46:06.775 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:46:06.775 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42172sec preferred_lft 42172sec 2024-09-12T02:46:06.775 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-12T02:46:06.776 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:46:06.776 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:46:06.776 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:46:06.776 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-12T02:46:06.776 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:46:06.777 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:46:06.777 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-12T02:46:06.777 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:46:06.777 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2024-09-12T02:46:06.777 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2024-09-12T02:46:06.777 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:46:06.777 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-12T02:46:06.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:46:06.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:06 smithi176 ceph-mon[35713]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:06.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:06 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3083237102' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:46:07.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:06 smithi062 ceph-mon[35527]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:07.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:06 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3083237102' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:46:07.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:46:07.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:07.211 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:46:07.267 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-12T02:46:07.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:07.271 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-12T02:46:07.349 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-12T02:46:07.349 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:46:07.349 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:46:07.350 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:46:07.350 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:46:07.350 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:46:07.350 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-12T02:46:07.350 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:46:07.350 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:46:07.350 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:46:07.350 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-12T02:46:07.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:46:07.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:46:07.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:07.948 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-12T02:46:07.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:07.985 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-09-12T02:46:08.060 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:46:08.061 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-12T02:46:08.061 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:46:08.061 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-12T02:46:08.061 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-12T02:46:08.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:46:08.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:46:08.241 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-12T02:46:08.241 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:46:08.242 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-12T02:46:08.242 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-12T02:46:08.242 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:46:08.242 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-12T02:46:08.242 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-12T02:46:08.242 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-12T02:46:08.242 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-12T02:46:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:46:08.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:46:08.485 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:46:08.485 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-12T02:46:08.485 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-12T02:46:08.485 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:46:08.485 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-12T02:46:08.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:46:08.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:46:08.654 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-12T02:46:08.655 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:46:08.655 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:46:08.690 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T02:46:08.690 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:46:08.690 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:46:08.765 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-09-12T02:46:08.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:08 smithi018 ceph-mon[30616]: pgmap v322: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:08.863 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:46:08.942 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-09-12T02:46:08.942 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-09-12T02:46:08.942 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-09-12T02:46:08.942 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-09-12T02:46:08.942 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-09-12T02:46:08.942 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-09-12T02:46:08.942 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-09-12T02:46:08.943 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-09-12T02:46:08.943 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-09-12T02:46:08.943 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-09-12T02:46:08.943 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-09-12T02:46:08.943 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/selinux 2024-09-12T02:46:08.943 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:46:08.943 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-09-12T02:46:08.943 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-09-12T02:46:08.943 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-09-12T02:46:08.944 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-09-12T02:46:08.944 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-09-12T02:46:08.944 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-09-12T02:46:08.944 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:46:08.944 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:46:08.944 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:46:08.944 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:46:08.944 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-09-12T02:46:08.944 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-09-12T02:46:08.944 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay 2024-09-12T02:46:08.944 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/6d0ac1a0849fb8f97956c53acf6be19f562741fb32fd7940f5f6ed1a599cf4c8/merged 2024-09-12T02:46:08.945 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/9d73384b8bb53b8013a43e2d979dee45c7c4b20a570967f802a23de6c0572b57/merged 2024-09-12T02:46:08.945 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/0 2024-09-12T02:46:08.945 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:46:08.945 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/457a5e11748fc923d790022ac3169c30471451a5b06c92874fdb2279b3f3bb8e/merged 2024-09-12T02:46:08.945 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/3c64db7556c70639b9d9d2f313a5939a8dd72cbe9de9926006794850cb2dc59b/merged 2024-09-12T02:46:08.945 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/d4c3503b889b6e89e67b9805371067153f95984191f34ef9f0da0afc37b9de1e/merged 2024-09-12T02:46:08.945 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/5f4917692af1b64ea5d0fd39935e19a6a888c95a3f0c85902be753f19a80ff77/merged 2024-09-12T02:46:08.945 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/40be30e54e234c93ce5db4b9366971925e8a178d34977b259ebf7ef67b96a1e9/merged 2024-09-12T02:46:08.945 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/f3a2277e56bacb3c8ef263da6527c594b83d7f0a8c4a2313bf218edf340162cb/merged 2024-09-12T02:46:08.945 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/3b00e94e805bfebe8dbf96c973d23bfea0b717edfb22128c435531863115b8c4/merged 2024-09-12T02:46:08.946 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/a8fe879cd3339fd14191c2f779a32066a80ab253dae8edd244423fea2e26cacc/merged 2024-09-12T02:46:08.946 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-09-12T02:46:08.946 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:46:08.946 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:46:08.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:08.947 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-09-12T02:46:08.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:08 smithi176 ceph-mon[35713]: pgmap v322: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:09.022 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:46:09.023 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-12T02:46:09.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:08 smithi062 ceph-mon[35527]: pgmap v322: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:09.067 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-09-12T02:46:09.128 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:46:09.165 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-09-12T02:46:09.165 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-09-12T02:46:09.166 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-09-12T02:46:09.166 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-09-12T02:46:09.166 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-09-12T02:46:09.166 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-09-12T02:46:09.166 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-09-12T02:46:09.166 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-09-12T02:46:09.166 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-09-12T02:46:09.166 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-09-12T02:46:09.166 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-09-12T02:46:09.166 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/selinux 2024-09-12T02:46:09.166 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:46:09.166 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-09-12T02:46:09.166 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-09-12T02:46:09.167 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-09-12T02:46:09.167 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-09-12T02:46:09.167 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-09-12T02:46:09.167 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-09-12T02:46:09.167 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:46:09.167 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:46:09.167 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:46:09.167 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:46:09.167 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-09-12T02:46:09.167 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-09-12T02:46:09.167 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay 2024-09-12T02:46:09.167 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/6d0ac1a0849fb8f97956c53acf6be19f562741fb32fd7940f5f6ed1a599cf4c8/merged 2024-09-12T02:46:09.168 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/9d73384b8bb53b8013a43e2d979dee45c7c4b20a570967f802a23de6c0572b57/merged 2024-09-12T02:46:09.168 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/0 2024-09-12T02:46:09.168 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:46:09.168 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/457a5e11748fc923d790022ac3169c30471451a5b06c92874fdb2279b3f3bb8e/merged 2024-09-12T02:46:09.168 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/3c64db7556c70639b9d9d2f313a5939a8dd72cbe9de9926006794850cb2dc59b/merged 2024-09-12T02:46:09.168 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/d4c3503b889b6e89e67b9805371067153f95984191f34ef9f0da0afc37b9de1e/merged 2024-09-12T02:46:09.168 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/5f4917692af1b64ea5d0fd39935e19a6a888c95a3f0c85902be753f19a80ff77/merged 2024-09-12T02:46:09.168 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/40be30e54e234c93ce5db4b9366971925e8a178d34977b259ebf7ef67b96a1e9/merged 2024-09-12T02:46:09.168 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/f3a2277e56bacb3c8ef263da6527c594b83d7f0a8c4a2313bf218edf340162cb/merged 2024-09-12T02:46:09.168 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/3b00e94e805bfebe8dbf96c973d23bfea0b717edfb22128c435531863115b8c4/merged 2024-09-12T02:46:09.168 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/a8fe879cd3339fd14191c2f779a32066a80ab253dae8edd244423fea2e26cacc/merged 2024-09-12T02:46:09.168 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-09-12T02:46:09.168 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:46:09.169 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:46:09.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:09.170 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-09-12T02:46:09.276 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:2024-09-12T02:46:09.276+0000 7f8db392a480 -1 init, newargv = 0x562219a58430 newargc=15 2024-09-12T02:46:09.277 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[74543]: starting ceph client 2024-09-12T02:46:09.287 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[74543]: starting fuse 2024-09-12T02:46:10.350 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-09-12T02:46:10.409 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:46:10.446 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-09-12T02:46:10.446 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-09-12T02:46:10.446 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-09-12T02:46:10.446 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-09-12T02:46:10.446 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-09-12T02:46:10.446 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-09-12T02:46:10.446 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-09-12T02:46:10.447 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-09-12T02:46:10.447 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-09-12T02:46:10.447 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-09-12T02:46:10.447 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-09-12T02:46:10.447 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/selinux 2024-09-12T02:46:10.447 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:46:10.447 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-09-12T02:46:10.447 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-09-12T02:46:10.447 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-09-12T02:46:10.447 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-09-12T02:46:10.447 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-09-12T02:46:10.447 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-09-12T02:46:10.447 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:46:10.448 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:46:10.448 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:46:10.448 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:46:10.448 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-09-12T02:46:10.448 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-09-12T02:46:10.448 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay 2024-09-12T02:46:10.448 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/6d0ac1a0849fb8f97956c53acf6be19f562741fb32fd7940f5f6ed1a599cf4c8/merged 2024-09-12T02:46:10.448 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/9d73384b8bb53b8013a43e2d979dee45c7c4b20a570967f802a23de6c0572b57/merged 2024-09-12T02:46:10.448 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/0 2024-09-12T02:46:10.448 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:46:10.448 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/457a5e11748fc923d790022ac3169c30471451a5b06c92874fdb2279b3f3bb8e/merged 2024-09-12T02:46:10.449 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/3c64db7556c70639b9d9d2f313a5939a8dd72cbe9de9926006794850cb2dc59b/merged 2024-09-12T02:46:10.449 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/d4c3503b889b6e89e67b9805371067153f95984191f34ef9f0da0afc37b9de1e/merged 2024-09-12T02:46:10.449 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/5f4917692af1b64ea5d0fd39935e19a6a888c95a3f0c85902be753f19a80ff77/merged 2024-09-12T02:46:10.449 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/40be30e54e234c93ce5db4b9366971925e8a178d34977b259ebf7ef67b96a1e9/merged 2024-09-12T02:46:10.449 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/f3a2277e56bacb3c8ef263da6527c594b83d7f0a8c4a2313bf218edf340162cb/merged 2024-09-12T02:46:10.449 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/3b00e94e805bfebe8dbf96c973d23bfea0b717edfb22128c435531863115b8c4/merged 2024-09-12T02:46:10.449 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/containers/storage/overlay/a8fe879cd3339fd14191c2f779a32066a80ab253dae8edd244423fea2e26cacc/merged 2024-09-12T02:46:10.449 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-09-12T02:46:10.449 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:46:10.449 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:46:10.449 INFO:teuthology.orchestra.run.smithi018.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-12T02:46:10.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:10.450 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-09-12T02:46:10.526 INFO:teuthology.orchestra.run.smithi018.stdout:120 2024-09-12T02:46:10.526 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-12T02:46:10.526 DEBUG:teuthology.orchestra.run.smithi018:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:46:10.526 DEBUG:teuthology.orchestra.run.smithi018:> import glob 2024-09-12T02:46:10.526 DEBUG:teuthology.orchestra.run.smithi018:> import re 2024-09-12T02:46:10.526 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-09-12T02:46:10.527 DEBUG:teuthology.orchestra.run.smithi018:> import subprocess 2024-09-12T02:46:10.527 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-12T02:46:10.527 DEBUG:teuthology.orchestra.run.smithi018:> def _find_admin_socket(client_name): 2024-09-12T02:46:10.527 DEBUG:teuthology.orchestra.run.smithi018:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-12T02:46:10.527 DEBUG:teuthology.orchestra.run.smithi018:> files = glob.glob(asok_path) 2024-09-12T02:46:10.527 DEBUG:teuthology.orchestra.run.smithi018:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-12T02:46:10.527 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-12T02:46:10.527 DEBUG:teuthology.orchestra.run.smithi018:> # Given a non-glob path, it better be there 2024-09-12T02:46:10.527 DEBUG:teuthology.orchestra.run.smithi018:> if "*" not in asok_path: 2024-09-12T02:46:10.527 DEBUG:teuthology.orchestra.run.smithi018:> assert(len(files) == 1) 2024-09-12T02:46:10.527 DEBUG:teuthology.orchestra.run.smithi018:> return files[0] 2024-09-12T02:46:10.527 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-12T02:46:10.527 DEBUG:teuthology.orchestra.run.smithi018:> for f in files: 2024-09-12T02:46:10.527 DEBUG:teuthology.orchestra.run.smithi018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:46:10.527 DEBUG:teuthology.orchestra.run.smithi018:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:46:10.528 DEBUG:teuthology.orchestra.run.smithi018:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:46:10.528 DEBUG:teuthology.orchestra.run.smithi018:> contents = proc_f.read() 2024-09-12T02:46:10.528 DEBUG:teuthology.orchestra.run.smithi018:> if mountpoint in contents: 2024-09-12T02:46:10.528 DEBUG:teuthology.orchestra.run.smithi018:> return f 2024-09-12T02:46:10.528 DEBUG:teuthology.orchestra.run.smithi018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:46:10.528 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-12T02:46:10.528 DEBUG:teuthology.orchestra.run.smithi018:> print(_find_admin_socket("client.admin")) 2024-09-12T02:46:10.528 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-09-12T02:46:10.692 INFO:teuthology.orchestra.run.smithi018.stdout:/var/run/ceph/ceph-client.admin.74543.asok 2024-09-12T02:46:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:46:10.704 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:10 smithi018 ceph-mon[30616]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:10.706 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.74543.asok 2024-09-12T02:46:10.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:10.707 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.74543.asok status 2024-09-12T02:46:10.894 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T02:46:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": { 2024-09-12T02:46:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:46:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:46:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: "entity_id": "admin", 2024-09-12T02:46:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": "smithi018", 2024-09-12T02:46:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-12T02:46:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: "pid": "74543", 2024-09-12T02:46:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: "root": "/" 2024-09-12T02:46:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T02:46:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_count": 0, 2024-09-12T02:46:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_pinned_count": 0, 2024-09-12T02:46:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 14625, 2024-09-12T02:46:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: "inst": { 2024-09-12T02:46:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: "name": { 2024-09-12T02:46:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "client", 2024-09-12T02:46:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: "num": 14625 2024-09-12T02:46:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T02:46:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-09-12T02:46:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-12T02:46:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:46:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4158402344 2024-09-12T02:46:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T02:46:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T02:46:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-09-12T02:46:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-12T02:46:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:46:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4158402344 2024-09-12T02:46:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T02:46:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: "inst_str": "client.14625 192.168.0.1:0/4158402344", 2024-09-12T02:46:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: "addr_str": "192.168.0.1:0/4158402344", 2024-09-12T02:46:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: "inode_count": 1, 2024-09-12T02:46:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_epoch": 17, 2024-09-12T02:46:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch": 94, 2024-09-12T02:46:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:46:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklisted": false, 2024-09-12T02:46:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs" 2024-09-12T02:46:10.897 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T02:46:10.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:10.907 DEBUG:teuthology.orchestra.run.smithi018:> stat --file-system '--printf=%T 2024-09-12T02:46:10.907 DEBUG:teuthology.orchestra.run.smithi018:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:46:10.943 INFO:teuthology.orchestra.run.smithi018.stdout:fuseblk 2024-09-12T02:46:10.944 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:46:10.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:10.944 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:46:10.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:10 smithi176 ceph-mon[35713]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:11.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:10 smithi062 ceph-mon[35527]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:46:11.042 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-12T02:46:11.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:46:11.151 INFO:teuthology.orchestra.run.smithi018.stdout:# file: . 2024-09-12T02:46:11.151 INFO:teuthology.orchestra.run.smithi018.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-12T02:46:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:46:11.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:46:11.159 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:46:11.159 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:11.196 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T02:46:11.547 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-12T02:46:11.548 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-12T02:46:11.548 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-12T02:46:11.548 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-12T02:46:11.622 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:11.811 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]}]: dispatch 2024-09-12T02:46:11.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]: dispatch 2024-09-12T02:46:11.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-12T02:46:11.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-09-12T02:46:11.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]: dispatch 2024-09-12T02:46:11.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-09-12T02:46:11.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-12T02:46:11.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-12T02:46:11.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-12T02:46:11.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-12T02:46:11.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]}]: dispatch 2024-09-12T02:46:11.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]: dispatch 2024-09-12T02:46:11.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-12T02:46:11.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-09-12T02:46:11.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]: dispatch 2024-09-12T02:46:11.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-09-12T02:46:12.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-12T02:46:12.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-12T02:46:12.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-12T02:46:12.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-12T02:46:12.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]}]: dispatch 2024-09-12T02:46:12.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]: dispatch 2024-09-12T02:46:12.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-12T02:46:12.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-09-12T02:46:12.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]: dispatch 2024-09-12T02:46:12.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-09-12T02:46:12.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.246+0000 7f227c200640 1 -- 172.21.15.18:0/3791379807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2274076720 msgr2=0x7f2274076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:12.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.246+0000 7f227c200640 1 --2- 172.21.15.18:0/3791379807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2274076720 0x7f2274076b00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2268009860 tx=0x7f226802a340 comp rx=0 tx=0).stop 2024-09-12T02:46:12.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.246+0000 7f227c200640 1 -- 172.21.15.18:0/3791379807 shutdown_connections 2024-09-12T02:46:12.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.246+0000 7f227c200640 1 --2- 172.21.15.18:0/3791379807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2274112a30 0x7f2274114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.246+0000 7f227c200640 1 --2- 172.21.15.18:0/3791379807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2274077040 0x7f22741124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.246+0000 7f227c200640 1 --2- 172.21.15.18:0/3791379807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2274076720 0x7f2274076b00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.246+0000 7f227c200640 1 -- 172.21.15.18:0/3791379807 >> 172.21.15.18:0/3791379807 conn(0x7f22740ffa90 msgr2=0x7f2274101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.246+0000 7f227c200640 1 -- 172.21.15.18:0/3791379807 shutdown_connections 2024-09-12T02:46:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.246+0000 7f227c200640 1 -- 172.21.15.18:0/3791379807 wait complete. 2024-09-12T02:46:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.247+0000 7f227c200640 1 Processor -- start 2024-09-12T02:46:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.247+0000 7f227c200640 1 -- start start 2024-09-12T02:46:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.248+0000 7f227c200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2274076720 0x7f22741a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.248+0000 7f227c200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2274077040 0x7f22741a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.248+0000 7f227c200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2274112a30 0x7f227419e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.248+0000 7f227c200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22741185a0 con 0x7f2274076720 2024-09-12T02:46:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.248+0000 7f227c200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2274118420 con 0x7f2274077040 2024-09-12T02:46:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.248+0000 7f227c200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2274118720 con 0x7f2274112a30 2024-09-12T02:46:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.248+0000 7f2279800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2274076720 0x7f22741a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.248+0000 7f2279800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2274076720 0x7f22741a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41662/0 (socket says 172.21.15.18:41662) 2024-09-12T02:46:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.248+0000 7f2279800640 1 -- 172.21.15.18:0/687880579 learned_addr learned my addr 172.21.15.18:0/687880579 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.248+0000 7f2278e00640 1 --2- 172.21.15.18:0/687880579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2274077040 0x7f22741a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.248+0000 7f227a200640 1 --2- 172.21.15.18:0/687880579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2274112a30 0x7f227419e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.248+0000 7f2279800640 1 -- 172.21.15.18:0/687880579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2274112a30 msgr2=0x7f227419e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.248+0000 7f2279800640 1 --2- 172.21.15.18:0/687880579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2274112a30 0x7f227419e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.248+0000 7f2279800640 1 -- 172.21.15.18:0/687880579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2274077040 msgr2=0x7f22741a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.248+0000 7f2279800640 1 --2- 172.21.15.18:0/687880579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2274077040 0x7f22741a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.248+0000 7f2279800640 1 -- 172.21.15.18:0/687880579 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227419efc0 con 0x7f2274076720 2024-09-12T02:46:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.249+0000 7f2279800640 1 --2- 172.21.15.18:0/687880579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2274076720 0x7f22741a46d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2268035040 tx=0x7f2268033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.249+0000 7f2272000640 1 -- 172.21.15.18:0/687880579 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226803f020 con 0x7f2274076720 2024-09-12T02:46:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.249+0000 7f2272000640 1 -- 172.21.15.18:0/687880579 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2268032770 con 0x7f2274076720 2024-09-12T02:46:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.249+0000 7f227c200640 1 -- 172.21.15.18:0/687880579 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227419f250 con 0x7f2274076720 2024-09-12T02:46:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.249+0000 7f227c200640 1 -- 172.21.15.18:0/687880579 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22741ab5a0 con 0x7f2274076720 2024-09-12T02:46:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.249+0000 7f2272000640 1 -- 172.21.15.18:0/687880579 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268037040 con 0x7f2274076720 2024-09-12T02:46:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.250+0000 7f227c200640 1 -- 172.21.15.18:0/687880579 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2274076b00 con 0x7f2274076720 2024-09-12T02:46:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.252+0000 7f2272000640 1 -- 172.21.15.18:0/687880579 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2268042020 con 0x7f2274076720 2024-09-12T02:46:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.253+0000 7f2272000640 1 --2- 172.21.15.18:0/687880579 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f225c0a2b80 0x7f225c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.254+0000 7f2272000640 1 -- 172.21.15.18:0/687880579 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9092+0+0 (secure 0 0 0) 0x7f22680ef540 con 0x7f2274076720 2024-09-12T02:46:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.254+0000 7f2278e00640 1 --2- 172.21.15.18:0/687880579 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f225c0a2b80 0x7f225c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.254+0000 7f2278e00640 1 --2- 172.21.15.18:0/687880579 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f225c0a2b80 0x7f225c0a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2274079300 tx=0x7f2260005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.258+0000 7f2272000640 1 -- 172.21.15.18:0/687880579 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2268049020 con 0x7f2274076720 2024-09-12T02:46:12.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.456+0000 7f227c200640 1 -- 172.21.15.18:0/687880579 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f227410dc20 con 0x7f2274076720 2024-09-12T02:46:12.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.456+0000 7f2272000640 1 -- 172.21.15.18:0/687880579 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v95) ==== 81+0+590 (secure 0 0 0) 0x7f22680bc0e0 con 0x7f2274076720 2024-09-12T02:46:12.457 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2679362143 2024-09-13T02:38:10.525951+0000 2024-09-12T02:46:12.457 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/4236556151 2024-09-13T02:38:10.525951+0000 2024-09-12T02:46:12.457 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/3271799053 2024-09-13T02:38:10.525951+0000 2024-09-12T02:46:12.457 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/3271799053 2024-09-13T02:38:10.525951+0000 2024-09-12T02:46:12.457 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/1197309398 2024-09-13T02:37:40.790128+0000 2024-09-12T02:46:12.457 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/3024661873 2024-09-13T02:38:10.525951+0000 2024-09-12T02:46:12.457 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2429098892 2024-09-13T02:37:40.790128+0000 2024-09-12T02:46:12.458 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/601880715 2024-09-13T02:37:40.790128+0000 2024-09-12T02:46:12.458 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/601880715 2024-09-13T02:37:40.790128+0000 2024-09-12T02:46:12.458 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/1531572357 2024-09-13T02:37:40.790128+0000 2024-09-12T02:46:12.458 INFO:teuthology.orchestra.run.smithi018.stderr:listed 10 entries 2024-09-12T02:46:12.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.459+0000 7f227c200640 1 -- 172.21.15.18:0/687880579 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f225c0a2b80 msgr2=0x7f225c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:12.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.459+0000 7f227c200640 1 --2- 172.21.15.18:0/687880579 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f225c0a2b80 0x7f225c0a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2274079300 tx=0x7f2260005f90 comp rx=0 tx=0).stop 2024-09-12T02:46:12.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.459+0000 7f227c200640 1 -- 172.21.15.18:0/687880579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2274076720 msgr2=0x7f22741a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:12.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.459+0000 7f227c200640 1 --2- 172.21.15.18:0/687880579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2274076720 0x7f22741a46d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2268035040 tx=0x7f2268033d90 comp rx=0 tx=0).stop 2024-09-12T02:46:12.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.459+0000 7f227c200640 1 -- 172.21.15.18:0/687880579 shutdown_connections 2024-09-12T02:46:12.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.459+0000 7f227c200640 1 --2- 172.21.15.18:0/687880579 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f225c0a2b80 0x7f225c0a5040 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.459+0000 7f227c200640 1 --2- 172.21.15.18:0/687880579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2274112a30 0x7f227419e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.459+0000 7f227c200640 1 --2- 172.21.15.18:0/687880579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2274077040 0x7f22741a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.459+0000 7f227c200640 1 --2- 172.21.15.18:0/687880579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2274076720 0x7f22741a46d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:12.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.459+0000 7f227c200640 1 -- 172.21.15.18:0/687880579 >> 172.21.15.18:0/687880579 conn(0x7f22740ffa90 msgr2=0x7f2274101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:12.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.459+0000 7f227c200640 1 -- 172.21.15.18:0/687880579 shutdown_connections 2024-09-12T02:46:12.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:12.459+0000 7f227c200640 1 -- 172.21.15.18:0/687880579 wait complete. 2024-09-12T02:46:12.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:12 smithi018 ceph-mon[30616]: pgmap v324: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-12T02:46:12.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-12T02:46:12.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-12T02:46:12.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-12T02:46:12.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-12T02:46:12.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]}]': finished 2024-09-12T02:46:12.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2024-09-12T02:46:12.854 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-12T02:46:12.854 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-12T02:46:12.854 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]': finished 2024-09-12T02:46:12.854 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-09-12T02:46:12.854 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:12 smithi018 ceph-mon[30616]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T02:46:12.854 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:12 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/687880579' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:46:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:12 smithi176 ceph-mon[35713]: pgmap v324: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-12T02:46:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-12T02:46:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-12T02:46:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-12T02:46:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-12T02:46:12.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]}]': finished 2024-09-12T02:46:12.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2024-09-12T02:46:12.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-12T02:46:12.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-12T02:46:12.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]': finished 2024-09-12T02:46:12.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-09-12T02:46:12.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:12 smithi176 ceph-mon[35713]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T02:46:12.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:12 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/687880579' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:46:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:12 smithi062 ceph-mon[35527]: pgmap v324: 129 pgs: 129 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-12T02:46:13.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-12T02:46:13.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-12T02:46:13.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-12T02:46:13.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-12T02:46:13.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]}]': finished 2024-09-12T02:46:13.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2024-09-12T02:46:13.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-12T02:46:13.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-12T02:46:13.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]': finished 2024-09-12T02:46:13.036 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-09-12T02:46:13.036 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:12 smithi062 ceph-mon[35527]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T02:46:13.036 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:12 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/687880579' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:46:13.404 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:46:13.404 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:46:13.442 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T02:46:13.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:13 smithi018 ceph-mon[30616]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T02:46:13.863 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:13.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:13 smithi176 ceph-mon[35713]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T02:46:14.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:13 smithi062 ceph-mon[35527]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T02:46:14.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.481+0000 7f53a6200640 1 -- 172.21.15.18:0/1040637076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53a0108f60 msgr2=0x7f53a0110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:14.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.481+0000 7f53a6200640 1 --2- 172.21.15.18:0/1040637076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53a0108f60 0x7f53a0110ae0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5398009be0 tx=0x7f539802a6c0 comp rx=0 tx=0).stop 2024-09-12T02:46:14.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.481+0000 7f53a6200640 1 -- 172.21.15.18:0/1040637076 shutdown_connections 2024-09-12T02:46:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.481+0000 7f53a6200640 1 --2- 172.21.15.18:0/1040637076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53a0108f60 0x7f53a0110ae0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.481+0000 7f53a6200640 1 --2- 172.21.15.18:0/1040637076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53a01047e0 0x7f53a0108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.481+0000 7f53a6200640 1 --2- 172.21.15.18:0/1040637076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53a0103e30 0x7f53a0104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.481+0000 7f53a6200640 1 -- 172.21.15.18:0/1040637076 >> 172.21.15.18:0/1040637076 conn(0x7f53a00ff8d0 msgr2=0x7f53a0101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.481+0000 7f53a6200640 1 -- 172.21.15.18:0/1040637076 shutdown_connections 2024-09-12T02:46:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.481+0000 7f53a6200640 1 -- 172.21.15.18:0/1040637076 wait complete. 2024-09-12T02:46:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.482+0000 7f53a6200640 1 Processor -- start 2024-09-12T02:46:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.482+0000 7f53a6200640 1 -- start start 2024-09-12T02:46:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.482+0000 7f53a6200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53a0103e30 0x7f53a019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.482+0000 7f53a6200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53a01047e0 0x7f53a019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.482+0000 7f53a6200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53a0108f60 0x7f53a019ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.482+0000 7f53a6200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f53a0113f70 con 0x7f53a0103e30 2024-09-12T02:46:14.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.483+0000 7f53a6200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f53a0113df0 con 0x7f53a01047e0 2024-09-12T02:46:14.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.483+0000 7f53a6200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f53a01140f0 con 0x7f53a0108f60 2024-09-12T02:46:14.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.483+0000 7f53a4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53a0103e30 0x7f53a019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:14.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.483+0000 7f53a4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53a0103e30 0x7f53a019a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41668/0 (socket says 172.21.15.18:41668) 2024-09-12T02:46:14.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.483+0000 7f53a4e00640 1 -- 172.21.15.18:0/1262433999 learned_addr learned my addr 172.21.15.18:0/1262433999 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:14.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.483+0000 7f53a5800640 1 --2- 172.21.15.18:0/1262433999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53a0108f60 0x7f53a019ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:14.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.483+0000 7f539fe00640 1 --2- 172.21.15.18:0/1262433999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53a01047e0 0x7f53a019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:14.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.483+0000 7f53a4e00640 1 -- 172.21.15.18:0/1262433999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53a0108f60 msgr2=0x7f53a019ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:14.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.483+0000 7f53a4e00640 1 --2- 172.21.15.18:0/1262433999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53a0108f60 0x7f53a019ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:14.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.483+0000 7f53a4e00640 1 -- 172.21.15.18:0/1262433999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53a01047e0 msgr2=0x7f53a019a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:14.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.483+0000 7f53a4e00640 1 --2- 172.21.15.18:0/1262433999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53a01047e0 0x7f53a019a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:14.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.483+0000 7f53a4e00640 1 -- 172.21.15.18:0/1262433999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a019f3c0 con 0x7f53a0103e30 2024-09-12T02:46:14.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.483+0000 7f53a4e00640 1 --2- 172.21.15.18:0/1262433999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53a0103e30 0x7f53a019a410 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f539400ea60 tx=0x7f539400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:14.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.484+0000 7f539d600640 1 -- 172.21.15.18:0/1262433999 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539400cd20 con 0x7f53a0103e30 2024-09-12T02:46:14.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.484+0000 7f53a6200640 1 -- 172.21.15.18:0/1262433999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a019f6b0 con 0x7f53a0103e30 2024-09-12T02:46:14.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.484+0000 7f539d600640 1 -- 172.21.15.18:0/1262433999 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53940035f0 con 0x7f53a0103e30 2024-09-12T02:46:14.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.484+0000 7f539d600640 1 -- 172.21.15.18:0/1262433999 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394010690 con 0x7f53a0103e30 2024-09-12T02:46:14.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.484+0000 7f53a6200640 1 -- 172.21.15.18:0/1262433999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a01a6f90 con 0x7f53a0103e30 2024-09-12T02:46:14.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.485+0000 7f53a6200640 1 -- 172.21.15.18:0/1262433999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53a0104210 con 0x7f53a0103e30 2024-09-12T02:46:14.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.487+0000 7f539d600640 1 -- 172.21.15.18:0/1262433999 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f53940037a0 con 0x7f53a0103e30 2024-09-12T02:46:14.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.488+0000 7f539d600640 1 --2- 172.21.15.18:0/1262433999 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f53880a2b80 0x7f53880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:14.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.488+0000 7f539d600640 1 -- 172.21.15.18:0/1262433999 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7f53940cf6e0 con 0x7f53a0103e30 2024-09-12T02:46:14.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.488+0000 7f539fe00640 1 --2- 172.21.15.18:0/1262433999 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f53880a2b80 0x7f53880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:14.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.489+0000 7f539fe00640 1 --2- 172.21.15.18:0/1262433999 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f53880a2b80 0x7f53880a5040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f53a00ffcf0 tx=0x7f538c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:14.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.492+0000 7f539d600640 1 -- 172.21.15.18:0/1262433999 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f539409c280 con 0x7f53a0103e30 2024-09-12T02:46:14.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.691+0000 7f53a6200640 1 -- 172.21.15.18:0/1262433999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f53a002d7c0 con 0x7f53a0103e30 2024-09-12T02:46:14.692 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:14 smithi018 ceph-mon[30616]: pgmap v327: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-12T02:46:14.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.692+0000 7f539d600640 1 -- 172.21.15.18:0/1262433999 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v96) ==== 81+0+590 (secure 0 0 0) 0x7f539409bb80 con 0x7f53a0103e30 2024-09-12T02:46:14.693 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2679362143 2024-09-13T02:38:10.525951+0000 2024-09-12T02:46:14.693 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/4236556151 2024-09-13T02:38:10.525951+0000 2024-09-12T02:46:14.693 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/3271799053 2024-09-13T02:38:10.525951+0000 2024-09-12T02:46:14.693 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/3271799053 2024-09-13T02:38:10.525951+0000 2024-09-12T02:46:14.693 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/1197309398 2024-09-13T02:37:40.790128+0000 2024-09-12T02:46:14.693 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/3024661873 2024-09-13T02:38:10.525951+0000 2024-09-12T02:46:14.693 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2429098892 2024-09-13T02:37:40.790128+0000 2024-09-12T02:46:14.693 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/601880715 2024-09-13T02:37:40.790128+0000 2024-09-12T02:46:14.693 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/601880715 2024-09-13T02:37:40.790128+0000 2024-09-12T02:46:14.693 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/1531572357 2024-09-13T02:37:40.790128+0000 2024-09-12T02:46:14.694 INFO:teuthology.orchestra.run.smithi018.stderr:listed 10 entries 2024-09-12T02:46:14.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.694+0000 7f53a6200640 1 -- 172.21.15.18:0/1262433999 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f53880a2b80 msgr2=0x7f53880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:14.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.694+0000 7f53a6200640 1 --2- 172.21.15.18:0/1262433999 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f53880a2b80 0x7f53880a5040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f53a00ffcf0 tx=0x7f538c009260 comp rx=0 tx=0).stop 2024-09-12T02:46:14.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.694+0000 7f53a6200640 1 -- 172.21.15.18:0/1262433999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53a0103e30 msgr2=0x7f53a019a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:14.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.694+0000 7f53a6200640 1 --2- 172.21.15.18:0/1262433999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53a0103e30 0x7f53a019a410 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f539400ea60 tx=0x7f539400ee60 comp rx=0 tx=0).stop 2024-09-12T02:46:14.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.694+0000 7f53a6200640 1 -- 172.21.15.18:0/1262433999 shutdown_connections 2024-09-12T02:46:14.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.694+0000 7f53a6200640 1 --2- 172.21.15.18:0/1262433999 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f53880a2b80 0x7f53880a5040 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:14.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.694+0000 7f53a6200640 1 --2- 172.21.15.18:0/1262433999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53a0108f60 0x7f53a019ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:14.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.694+0000 7f53a6200640 1 --2- 172.21.15.18:0/1262433999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53a01047e0 0x7f53a019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:14.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.694+0000 7f53a6200640 1 --2- 172.21.15.18:0/1262433999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53a0103e30 0x7f53a019a410 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:14.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.694+0000 7f53a6200640 1 -- 172.21.15.18:0/1262433999 >> 172.21.15.18:0/1262433999 conn(0x7f53a00ff8d0 msgr2=0x7f53a0100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:14.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.694+0000 7f53a6200640 1 -- 172.21.15.18:0/1262433999 shutdown_connections 2024-09-12T02:46:14.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:14.694+0000 7f53a6200640 1 -- 172.21.15.18:0/1262433999 wait complete. 2024-09-12T02:46:14.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:14 smithi176 ceph-mon[35713]: pgmap v327: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-12T02:46:15.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:14 smithi062 ceph-mon[35527]: pgmap v327: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-12T02:46:15.682 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi018.front.sepia.ceph.com... 2024-09-12T02:46:15.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:15.682 DEBUG:teuthology.orchestra.run.smithi018:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:46:15.738 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[74543]: fuse finished with error 0 and tester_r 0 2024-09-12T02:46:15.742 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:46:15.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:15 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1262433999' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:46:15.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:15 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1262433999' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:46:16.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:15 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1262433999' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:46:16.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:16 smithi018 ceph-mon[30616]: pgmap v328: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:16.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:16 smithi176 ceph-mon[35713]: pgmap v328: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:17.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:16 smithi062 ceph-mon[35527]: pgmap v328: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:18.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:18 smithi018 ceph-mon[30616]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:18.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:18 smithi176 ceph-mon[35713]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:19.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:18 smithi062 ceph-mon[35527]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:20.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:20 smithi018 ceph-mon[30616]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:20.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:20 smithi176 ceph-mon[35713]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:21.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:20 smithi062 ceph-mon[35527]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:21.843 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-12T02:46:21.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:46:21.843 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-12T02:46:21.900 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:46:22.285 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:22.787 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:22 smithi018 ceph-mon[30616]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 338 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:22.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.900+0000 7f67b5c00640 1 -- 172.21.15.18:0/3422675341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67b0112a30 msgr2=0x7f67b0114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:22.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.900+0000 7f67b5c00640 1 --2- 172.21.15.18:0/3422675341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67b0112a30 0x7f67b0114e20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f67a8009ca0 tx=0x7f67a802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.900+0000 7f67b5c00640 1 -- 172.21.15.18:0/3422675341 shutdown_connections 2024-09-12T02:46:22.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.900+0000 7f67b5c00640 1 --2- 172.21.15.18:0/3422675341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67b0112a30 0x7f67b0114e20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.900+0000 7f67b5c00640 1 --2- 172.21.15.18:0/3422675341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67b0077040 0x7f67b01124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.900+0000 7f67b5c00640 1 --2- 172.21.15.18:0/3422675341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b0076720 0x7f67b0076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.900+0000 7f67b5c00640 1 -- 172.21.15.18:0/3422675341 >> 172.21.15.18:0/3422675341 conn(0x7f67b00ffa90 msgr2=0x7f67b0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:22.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.900+0000 7f67b5c00640 1 -- 172.21.15.18:0/3422675341 shutdown_connections 2024-09-12T02:46:22.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.900+0000 7f67b5c00640 1 -- 172.21.15.18:0/3422675341 wait complete. 2024-09-12T02:46:22.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.901+0000 7f67b5c00640 1 Processor -- start 2024-09-12T02:46:22.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.901+0000 7f67b5c00640 1 -- start start 2024-09-12T02:46:22.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.902+0000 7f67b5c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b0076720 0x7f67b01a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.902+0000 7f67b5c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67b0077040 0x7f67b01a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.902+0000 7f67b5c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67b0112a30 0x7f67b019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.902+0000 7f67b5c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f67b0118590 con 0x7f67b0077040 2024-09-12T02:46:22.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.902+0000 7f67b5c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f67b0118410 con 0x7f67b0076720 2024-09-12T02:46:22.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.902+0000 7f67b5c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f67b0118710 con 0x7f67b0112a30 2024-09-12T02:46:22.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.902+0000 7f67ae000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67b0077040 0x7f67b01a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:22.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.902+0000 7f67ae000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67b0077040 0x7f67b01a4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60156/0 (socket says 172.21.15.18:60156) 2024-09-12T02:46:22.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.902+0000 7f67ae000640 1 -- 172.21.15.18:0/2634588157 learned_addr learned my addr 172.21.15.18:0/2634588157 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:22.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.902+0000 7f67af400640 1 --2- 172.21.15.18:0/2634588157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67b0112a30 0x7f67b019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:22.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.902+0000 7f67aea00640 1 --2- 172.21.15.18:0/2634588157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b0076720 0x7f67b01a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:22.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.903+0000 7f67ae000640 1 -- 172.21.15.18:0/2634588157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67b0112a30 msgr2=0x7f67b019e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:22.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.903+0000 7f67ae000640 1 --2- 172.21.15.18:0/2634588157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67b0112a30 0x7f67b019e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.903+0000 7f67ae000640 1 -- 172.21.15.18:0/2634588157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b0076720 msgr2=0x7f67b01a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:22.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.903+0000 7f67ae000640 1 --2- 172.21.15.18:0/2634588157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b0076720 0x7f67b01a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:22.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.903+0000 7f67ae000640 1 -- 172.21.15.18:0/2634588157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b019f000 con 0x7f67b0077040 2024-09-12T02:46:22.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.903+0000 7f67ae000640 1 --2- 172.21.15.18:0/2634588157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67b0077040 0x7f67b01a4c50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f679c00e9f0 tx=0x7f679c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:22.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.903+0000 7f67a7400640 1 -- 172.21.15.18:0/2634588157 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c00cd80 con 0x7f67b0077040 2024-09-12T02:46:22.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.903+0000 7f67a7400640 1 -- 172.21.15.18:0/2634588157 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f679c005500 con 0x7f67b0077040 2024-09-12T02:46:22.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.903+0000 7f67b5c00640 1 -- 172.21.15.18:0/2634588157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b019f2f0 con 0x7f67b0077040 2024-09-12T02:46:22.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.903+0000 7f67a7400640 1 -- 172.21.15.18:0/2634588157 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c010690 con 0x7f67b0077040 2024-09-12T02:46:22.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.903+0000 7f67b5c00640 1 -- 172.21.15.18:0/2634588157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b01ab5e0 con 0x7f67b0077040 2024-09-12T02:46:22.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.904+0000 7f67b5c00640 1 -- 172.21.15.18:0/2634588157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b0076b00 con 0x7f67b0077040 2024-09-12T02:46:22.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.907+0000 7f67a7400640 1 -- 172.21.15.18:0/2634588157 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f679c0046c0 con 0x7f67b0077040 2024-09-12T02:46:22.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.908+0000 7f67a7400640 1 --2- 172.21.15.18:0/2634588157 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f67940a2b80 0x7f67940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:22.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.909+0000 7f67a7400640 1 -- 172.21.15.18:0/2634588157 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7f679c0cf980 con 0x7f67b0077040 2024-09-12T02:46:22.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.909+0000 7f67aea00640 1 --2- 172.21.15.18:0/2634588157 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f67940a2b80 0x7f67940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:22.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.909+0000 7f67aea00640 1 --2- 172.21.15.18:0/2634588157 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f67940a2b80 0x7f67940a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f67b019fa10 tx=0x7f67a000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:22.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:22.910+0000 7f67a7400640 1 -- 172.21.15.18:0/2634588157 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f679c0541b0 con 0x7f67b0077040 2024-09-12T02:46:22.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:22 smithi176 ceph-mon[35713]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 338 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:23.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:22 smithi062 ceph-mon[35527]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 338 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:23.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:23.096+0000 7f67b5c00640 1 -- 172.21.15.18:0/2634588157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67b019fe00 con 0x7f67b0077040 2024-09-12T02:46:23.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:23.099+0000 7f67a7400640 1 -- 172.21.15.18:0/2634588157 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+24655 (secure 0 0 0) 0x7f67b019fe00 con 0x7f67b0077040 2024-09-12T02:46:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:46:23.100 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":96,"fsid":"c7666100-70af-11ef-bcea-c7b262605968","created":"2024-09-12T02:37:14.139566+0000","modified":"2024-09-12T02:46:12.546275+0000","last_up_change":"2024-09-12T02:44:37.774835+0000","last_in_change":"2024-09-12T02:44:16.028970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:40:35.157621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:45:31.022530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:45:34.131637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:45:43.992286+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a61ecdc1-ceb9-43cb-a67d-b197888cca42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6803","nonce":2278662522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6805","nonce":2278662522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6809","nonce":2278662522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6807","nonce":2278662522}]},"public_addr":"172.21.15.18:6803/2278662522","cluster_addr":"172.21.15.18:6805/2278662522","heartbeat_back_addr":"172.21.15.18:6809/2278662522","heartbeat_front_addr":"172.21.15.18:6807/2278662522","state":["exists","up"]},{"osd":1,"uuid":"1b84f4be-23ce-466c-b974-b9851521785d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6801","nonce":3139630617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6803","nonce":3139630617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6807","nonce":3139630617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6805","nonce":3139630617}]},"public_addr":"172.21.15.62:6801/3139630617","cluster_addr":"172.21.15.62:6803/3139630617","heartbeat_back_addr":"172.21.15.62:6807/3139630617","heartbeat_front_addr":"172.21.15.62:6805/3139630617","state":["exists","up"]},{"osd":2,"uuid":"f7bdf028-db32-4d92-a039-bada37c3a146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6801","nonce":2704054654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6803","nonce":2704054654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6807","nonce":2704054654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6805","nonce":2704054654}]},"public_addr":"172.21.15.176:6801/2704054654","cluster_addr":"172.21.15.176:6803/2704054654","heartbeat_back_addr":"172.21.15.176:6807/2704054654","heartbeat_front_addr":"172.21.15.176:6805/2704054654","state":["exists","up"]},{"osd":3,"uuid":"39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6811","nonce":3378134261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6813","nonce":3378134261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6817","nonce":3378134261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6815","nonce":3378134261}]},"public_addr":"172.21.15.18:6811/3378134261","cluster_addr":"172.21.15.18:6813/3378134261","heartbeat_back_addr":"172.21.15.18:6817/3378134261","heartbeat_front_addr":"172.21.15.18:6815/3378134261","state":["exists","up"]},{"osd":4,"uuid":"66a2c8a0-1a99-4c6d-b56a-f1f6c3199655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6809","nonce":1416302860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6811","nonce":1416302860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6815","nonce":1416302860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6813","nonce":1416302860}]},"public_addr":"172.21.15.62:6809/1416302860","cluster_addr":"172.21.15.62:6811/1416302860","heartbeat_back_addr":"172.21.15.62:6815/1416302860","heartbeat_front_addr":"172.21.15.62:6813/1416302860","state":["exists","up"]},{"osd":5,"uuid":"c4070ecf-703a-4f5f-9a2b-63473ff7f98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6809","nonce":2234269387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6811","nonce":2234269387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6815","nonce":2234269387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6813","nonce":2234269387}]},"public_addr":"172.21.15.176:6809/2234269387","cluster_addr":"172.21.15.176:6811/2234269387","heartbeat_back_addr":"172.21.15.176:6815/2234269387","heartbeat_front_addr":"172.21.15.176:6813/2234269387","state":["exists","up"]},{"osd":6,"uuid":"12a08874-041e-4734-bc33-68ebfce97b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6819","nonce":3613955982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6821","nonce":3613955982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6825","nonce":3613955982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6823","nonce":3613955982}]},"public_addr":"172.21.15.18:6819/3613955982","cluster_addr":"172.21.15.18:6821/3613955982","heartbeat_back_addr":"172.21.15.18:6825/3613955982","heartbeat_front_addr":"172.21.15.18:6823/3613955982","state":["exists","up"]},{"osd":7,"uuid":"86a5b47c-143f-4848-892f-c7b6a17a2799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6817","nonce":750933013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6819","nonce":750933013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6823","nonce":750933013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6821","nonce":750933013}]},"public_addr":"172.21.15.62:6817/750933013","cluster_addr":"172.21.15.62:6819/750933013","heartbeat_back_addr":"172.21.15.62:6823/750933013","heartbeat_front_addr":"172.21.15.62:6821/750933013","state":["exists","up"]},{"osd":8,"uuid":"0426a455-ed11-4d6a-8e1d-c8aa2ee65cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6817","nonce":8496953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6819","nonce":8496953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6823","nonce":8496953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6821","nonce":8496953}]},"public_addr":"172.21.15.176:6817/8496953","cluster_addr":"172.21.15.176:6819/8496953","heartbeat_back_addr":"172.21.15.176:6823/8496953","heartbeat_front_addr":"172.21.15.176:6821/8496953","state":["exists","up"]},{"osd":9,"uuid":"241aa2cf-0765-465d-b400-4911e653412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6827","nonce":422514390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6829","nonce":422514390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6833","nonce":422514390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6831","nonce":422514390}]},"public_addr":"172.21.15.18:6827/422514390","cluster_addr":"172.21.15.18:6829/422514390","heartbeat_back_addr":"172.21.15.18:6833/422514390","heartbeat_front_addr":"172.21.15.18:6831/422514390","state":["exists","up"]},{"osd":10,"uuid":"b1d4ab1f-0ec4-4641-bab0-f39d15857615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6825","nonce":269877918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6827","nonce":269877918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6831","nonce":269877918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6829","nonce":269877918}]},"public_addr":"172.21.15.62:6825/269877918","cluster_addr":"172.21.15.62:6827/269877918","heartbeat_back_addr":"172.21.15.62:6831/269877918","heartbeat_front_addr":"172.21.15.62:6829/269877918","state":["exists","up"]},{"osd":11,"uuid":"d122f1bf-bd4f-45d5-b07c-7301b005977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6825","nonce":770358485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6827","nonce":770358485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6831","nonce":770358485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6829","nonce":770358485}]},"public_addr":"172.21.15.176:6825/770358485","cluster_addr":"172.21.15.176:6827/770358485","heartbeat_back_addr":"172.21.15.176:6831/770358485","heartbeat_front_addr":"172.21.15.176:6829/770358485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:39:42.435560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:09.100602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:32.884117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:01.733821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:29.812775+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:53.846503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:24.363464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:51.023614+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:15.782652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:45.378178+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:12.469173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:36.303058+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":1,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2679362143":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/4236556151":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6801/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6800/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/1197309398":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/3024661873":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/2429098892":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6801/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6800/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/1531572357":"2024-09-13T02:37:40.790128+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:46:23.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:23.101+0000 7f67b5c00640 1 -- 172.21.15.18:0/2634588157 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f67940a2b80 msgr2=0x7f67940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:23.101+0000 7f67b5c00640 1 --2- 172.21.15.18:0/2634588157 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f67940a2b80 0x7f67940a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f67b019fa10 tx=0x7f67a000b410 comp rx=0 tx=0).stop 2024-09-12T02:46:23.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:23.101+0000 7f67b5c00640 1 -- 172.21.15.18:0/2634588157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67b0077040 msgr2=0x7f67b01a4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:23.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:23.101+0000 7f67b5c00640 1 --2- 172.21.15.18:0/2634588157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67b0077040 0x7f67b01a4c50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f679c00e9f0 tx=0x7f679c00edf0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:23.102+0000 7f67b5c00640 1 -- 172.21.15.18:0/2634588157 shutdown_connections 2024-09-12T02:46:23.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:23.102+0000 7f67b5c00640 1 --2- 172.21.15.18:0/2634588157 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f67940a2b80 0x7f67940a5040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:23.102+0000 7f67b5c00640 1 --2- 172.21.15.18:0/2634588157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67b0112a30 0x7f67b019e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:23.102+0000 7f67b5c00640 1 --2- 172.21.15.18:0/2634588157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67b0077040 0x7f67b01a4c50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:23.102+0000 7f67b5c00640 1 --2- 172.21.15.18:0/2634588157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67b0076720 0x7f67b01a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:23.102+0000 7f67b5c00640 1 -- 172.21.15.18:0/2634588157 >> 172.21.15.18:0/2634588157 conn(0x7f67b00ffa90 msgr2=0x7f67b0101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:23.102+0000 7f67b5c00640 1 -- 172.21.15.18:0/2634588157 shutdown_connections 2024-09-12T02:46:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:23.102+0000 7f67b5c00640 1 -- 172.21.15.18:0/2634588157 wait complete. 2024-09-12T02:46:23.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:23 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2634588157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:46:23.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:23 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2634588157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:46:24.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:23 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2634588157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:46:24.077 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:46:24.457 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:24.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:24 smithi018 ceph-mon[30616]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 304 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:24.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:24 smithi176 ceph-mon[35713]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 304 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:25.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:24 smithi062 ceph-mon[35527]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 304 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:25.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.053+0000 7fee74e00640 1 -- 172.21.15.18:0/677717035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee7010e3c0 msgr2=0x7fee70110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:25.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.053+0000 7fee74e00640 1 --2- 172.21.15.18:0/677717035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee7010e3c0 0x7fee70110810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fee68009be0 tx=0x7fee6802a750 comp rx=0 tx=0).stop 2024-09-12T02:46:25.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.053+0000 7fee74e00640 1 -- 172.21.15.18:0/677717035 shutdown_connections 2024-09-12T02:46:25.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.053+0000 7fee74e00640 1 --2- 172.21.15.18:0/677717035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee7010e3c0 0x7fee70110810 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.053+0000 7fee74e00640 1 --2- 172.21.15.18:0/677717035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee70074f40 0x7fee7010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.053+0000 7fee74e00640 1 --2- 172.21.15.18:0/677717035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee70074620 0x7fee70074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.053+0000 7fee74e00640 1 -- 172.21.15.18:0/677717035 >> 172.21.15.18:0/677717035 conn(0x7fee700fd8c0 msgr2=0x7fee700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:25.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.054+0000 7fee74e00640 1 -- 172.21.15.18:0/677717035 shutdown_connections 2024-09-12T02:46:25.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.054+0000 7fee74e00640 1 -- 172.21.15.18:0/677717035 wait complete. 2024-09-12T02:46:25.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.054+0000 7fee74e00640 1 Processor -- start 2024-09-12T02:46:25.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.055+0000 7fee74e00640 1 -- start start 2024-09-12T02:46:25.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.055+0000 7fee74e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee70074620 0x7fee7019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:25.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.055+0000 7fee74e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee70074f40 0x7fee7019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:25.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.055+0000 7fee74e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee7010e3c0 0x7fee7019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:25.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.055+0000 7fee74e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fee701141b0 con 0x7fee70074620 2024-09-12T02:46:25.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.055+0000 7fee74e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fee70114030 con 0x7fee70074f40 2024-09-12T02:46:25.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.055+0000 7fee74e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fee70114330 con 0x7fee7010e3c0 2024-09-12T02:46:25.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.055+0000 7fee6de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee70074620 0x7fee7019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:25.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.055+0000 7fee6de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee70074620 0x7fee7019a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45006/0 (socket says 172.21.15.18:45006) 2024-09-12T02:46:25.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.055+0000 7fee6de00640 1 -- 172.21.15.18:0/593949024 learned_addr learned my addr 172.21.15.18:0/593949024 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:25.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.055+0000 7fee6d400640 1 --2- 172.21.15.18:0/593949024 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee70074f40 0x7fee7019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:25.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.055+0000 7fee6e800640 1 --2- 172.21.15.18:0/593949024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee7010e3c0 0x7fee7019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:25.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.056+0000 7fee6de00640 1 -- 172.21.15.18:0/593949024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee7010e3c0 msgr2=0x7fee7019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:25.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.056+0000 7fee6de00640 1 --2- 172.21.15.18:0/593949024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee7010e3c0 0x7fee7019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.056+0000 7fee6de00640 1 -- 172.21.15.18:0/593949024 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee70074f40 msgr2=0x7fee7019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:25.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.056+0000 7fee6de00640 1 --2- 172.21.15.18:0/593949024 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee70074f40 0x7fee7019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.056+0000 7fee6de00640 1 -- 172.21.15.18:0/593949024 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7019f620 con 0x7fee70074620 2024-09-12T02:46:25.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.056+0000 7fee6e800640 1 --2- 172.21.15.18:0/593949024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee7010e3c0 0x7fee7019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:46:25.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.056+0000 7fee6de00640 1 --2- 172.21.15.18:0/593949024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee70074620 0x7fee7019a670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fee6000e9c0 tx=0x7fee6000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:25.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.056+0000 7fee66a00640 1 -- 172.21.15.18:0/593949024 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6000cd80 con 0x7fee70074620 2024-09-12T02:46:25.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.056+0000 7fee66a00640 1 -- 172.21.15.18:0/593949024 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee600035f0 con 0x7fee70074620 2024-09-12T02:46:25.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.056+0000 7fee66a00640 1 -- 172.21.15.18:0/593949024 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee60010670 con 0x7fee70074620 2024-09-12T02:46:25.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.056+0000 7fee74e00640 1 -- 172.21.15.18:0/593949024 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7019f910 con 0x7fee70074620 2024-09-12T02:46:25.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.056+0000 7fee74e00640 1 -- 172.21.15.18:0/593949024 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee701a71f0 con 0x7fee70074620 2024-09-12T02:46:25.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.057+0000 7fee74e00640 1 -- 172.21.15.18:0/593949024 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee70074a00 con 0x7fee70074620 2024-09-12T02:46:25.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.059+0000 7fee66a00640 1 -- 172.21.15.18:0/593949024 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fee600037a0 con 0x7fee70074620 2024-09-12T02:46:25.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.061+0000 7fee66a00640 1 --2- 172.21.15.18:0/593949024 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fee540a2c00 0x7fee540a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:25.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.062+0000 7fee66a00640 1 -- 172.21.15.18:0/593949024 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7fee600cf690 con 0x7fee70074620 2024-09-12T02:46:25.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.062+0000 7fee6d400640 1 --2- 172.21.15.18:0/593949024 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fee540a2c00 0x7fee540a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:25.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.062+0000 7fee6d400640 1 --2- 172.21.15.18:0/593949024 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fee540a2c00 0x7fee540a50c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fee7010f6e0 tx=0x7fee5c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:25.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.065+0000 7fee66a00640 1 -- 172.21.15.18:0/593949024 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee6009c230 con 0x7fee70074620 2024-09-12T02:46:25.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.251+0000 7fee74e00640 1 -- 172.21.15.18:0/593949024 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee7019b9d0 con 0x7fee70074620 2024-09-12T02:46:25.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.252+0000 7fee66a00640 1 -- 172.21.15.18:0/593949024 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+24655 (secure 0 0 0) 0x7fee6009bb30 con 0x7fee70074620 2024-09-12T02:46:25.253 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:46:25.253 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":96,"fsid":"c7666100-70af-11ef-bcea-c7b262605968","created":"2024-09-12T02:37:14.139566+0000","modified":"2024-09-12T02:46:12.546275+0000","last_up_change":"2024-09-12T02:44:37.774835+0000","last_in_change":"2024-09-12T02:44:16.028970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:40:35.157621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:45:31.022530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:45:34.131637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:45:43.992286+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a61ecdc1-ceb9-43cb-a67d-b197888cca42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6803","nonce":2278662522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6805","nonce":2278662522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6809","nonce":2278662522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6807","nonce":2278662522}]},"public_addr":"172.21.15.18:6803/2278662522","cluster_addr":"172.21.15.18:6805/2278662522","heartbeat_back_addr":"172.21.15.18:6809/2278662522","heartbeat_front_addr":"172.21.15.18:6807/2278662522","state":["exists","up"]},{"osd":1,"uuid":"1b84f4be-23ce-466c-b974-b9851521785d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6801","nonce":3139630617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6803","nonce":3139630617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6807","nonce":3139630617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6805","nonce":3139630617}]},"public_addr":"172.21.15.62:6801/3139630617","cluster_addr":"172.21.15.62:6803/3139630617","heartbeat_back_addr":"172.21.15.62:6807/3139630617","heartbeat_front_addr":"172.21.15.62:6805/3139630617","state":["exists","up"]},{"osd":2,"uuid":"f7bdf028-db32-4d92-a039-bada37c3a146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6801","nonce":2704054654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6803","nonce":2704054654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6807","nonce":2704054654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6805","nonce":2704054654}]},"public_addr":"172.21.15.176:6801/2704054654","cluster_addr":"172.21.15.176:6803/2704054654","heartbeat_back_addr":"172.21.15.176:6807/2704054654","heartbeat_front_addr":"172.21.15.176:6805/2704054654","state":["exists","up"]},{"osd":3,"uuid":"39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6811","nonce":3378134261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6813","nonce":3378134261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6817","nonce":3378134261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6815","nonce":3378134261}]},"public_addr":"172.21.15.18:6811/3378134261","cluster_addr":"172.21.15.18:6813/3378134261","heartbeat_back_addr":"172.21.15.18:6817/3378134261","heartbeat_front_addr":"172.21.15.18:6815/3378134261","state":["exists","up"]},{"osd":4,"uuid":"66a2c8a0-1a99-4c6d-b56a-f1f6c3199655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6809","nonce":1416302860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6811","nonce":1416302860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6815","nonce":1416302860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6813","nonce":1416302860}]},"public_addr":"172.21.15.62:6809/1416302860","cluster_addr":"172.21.15.62:6811/1416302860","heartbeat_back_addr":"172.21.15.62:6815/1416302860","heartbeat_front_addr":"172.21.15.62:6813/1416302860","state":["exists","up"]},{"osd":5,"uuid":"c4070ecf-703a-4f5f-9a2b-63473ff7f98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6809","nonce":2234269387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6811","nonce":2234269387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6815","nonce":2234269387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6813","nonce":2234269387}]},"public_addr":"172.21.15.176:6809/2234269387","cluster_addr":"172.21.15.176:6811/2234269387","heartbeat_back_addr":"172.21.15.176:6815/2234269387","heartbeat_front_addr":"172.21.15.176:6813/2234269387","state":["exists","up"]},{"osd":6,"uuid":"12a08874-041e-4734-bc33-68ebfce97b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6819","nonce":3613955982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6821","nonce":3613955982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6825","nonce":3613955982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6823","nonce":3613955982}]},"public_addr":"172.21.15.18:6819/3613955982","cluster_addr":"172.21.15.18:6821/3613955982","heartbeat_back_addr":"172.21.15.18:6825/3613955982","heartbeat_front_addr":"172.21.15.18:6823/3613955982","state":["exists","up"]},{"osd":7,"uuid":"86a5b47c-143f-4848-892f-c7b6a17a2799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6817","nonce":750933013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6819","nonce":750933013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6823","nonce":750933013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6821","nonce":750933013}]},"public_addr":"172.21.15.62:6817/750933013","cluster_addr":"172.21.15.62:6819/750933013","heartbeat_back_addr":"172.21.15.62:6823/750933013","heartbeat_front_addr":"172.21.15.62:6821/750933013","state":["exists","up"]},{"osd":8,"uuid":"0426a455-ed11-4d6a-8e1d-c8aa2ee65cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6817","nonce":8496953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6819","nonce":8496953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6823","nonce":8496953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6821","nonce":8496953}]},"public_addr":"172.21.15.176:6817/8496953","cluster_addr":"172.21.15.176:6819/8496953","heartbeat_back_addr":"172.21.15.176:6823/8496953","heartbeat_front_addr":"172.21.15.176:6821/8496953","state":["exists","up"]},{"osd":9,"uuid":"241aa2cf-0765-465d-b400-4911e653412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6827","nonce":422514390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6829","nonce":422514390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6833","nonce":422514390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6831","nonce":422514390}]},"public_addr":"172.21.15.18:6827/422514390","cluster_addr":"172.21.15.18:6829/422514390","heartbeat_back_addr":"172.21.15.18:6833/422514390","heartbeat_front_addr":"172.21.15.18:6831/422514390","state":["exists","up"]},{"osd":10,"uuid":"b1d4ab1f-0ec4-4641-bab0-f39d15857615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6825","nonce":269877918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6827","nonce":269877918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6831","nonce":269877918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6829","nonce":269877918}]},"public_addr":"172.21.15.62:6825/269877918","cluster_addr":"172.21.15.62:6827/269877918","heartbeat_back_addr":"172.21.15.62:6831/269877918","heartbeat_front_addr":"172.21.15.62:6829/269877918","state":["exists","up"]},{"osd":11,"uuid":"d122f1bf-bd4f-45d5-b07c-7301b005977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6825","nonce":770358485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6827","nonce":770358485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6831","nonce":770358485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6829","nonce":770358485}]},"public_addr":"172.21.15.176:6825/770358485","cluster_addr":"172.21.15.176:6827/770358485","heartbeat_back_addr":"172.21.15.176:6831/770358485","heartbeat_front_addr":"172.21.15.176:6829/770358485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:39:42.435560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:09.100602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:32.884117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:01.733821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:29.812775+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:53.846503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:24.363464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:51.023614+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:15.782652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:45.378178+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:12.469173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:36.303058+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":1,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2679362143":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/4236556151":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6801/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6800/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/1197309398":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/3024661873":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/2429098892":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6801/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6800/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/1531572357":"2024-09-13T02:37:40.790128+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:46:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.255+0000 7fee74e00640 1 -- 172.21.15.18:0/593949024 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fee540a2c00 msgr2=0x7fee540a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.255+0000 7fee74e00640 1 --2- 172.21.15.18:0/593949024 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fee540a2c00 0x7fee540a50c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fee7010f6e0 tx=0x7fee5c009110 comp rx=0 tx=0).stop 2024-09-12T02:46:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.255+0000 7fee74e00640 1 -- 172.21.15.18:0/593949024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee70074620 msgr2=0x7fee7019a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.255+0000 7fee74e00640 1 --2- 172.21.15.18:0/593949024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee70074620 0x7fee7019a670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fee6000e9c0 tx=0x7fee6000edc0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.255+0000 7fee74e00640 1 -- 172.21.15.18:0/593949024 shutdown_connections 2024-09-12T02:46:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.255+0000 7fee74e00640 1 --2- 172.21.15.18:0/593949024 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fee540a2c00 0x7fee540a50c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.255+0000 7fee74e00640 1 --2- 172.21.15.18:0/593949024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee7010e3c0 0x7fee7019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.255+0000 7fee74e00640 1 --2- 172.21.15.18:0/593949024 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee70074f40 0x7fee7019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.255+0000 7fee74e00640 1 --2- 172.21.15.18:0/593949024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee70074620 0x7fee7019a670 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:25.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.255+0000 7fee74e00640 1 -- 172.21.15.18:0/593949024 >> 172.21.15.18:0/593949024 conn(0x7fee700fd8c0 msgr2=0x7fee700fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:25.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.255+0000 7fee74e00640 1 -- 172.21.15.18:0/593949024 shutdown_connections 2024-09-12T02:46:25.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:25.255+0000 7fee74e00640 1 -- 172.21.15.18:0/593949024 wait complete. 2024-09-12T02:46:25.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:25 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/593949024' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:46:25.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:25 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/593949024' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:46:26.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:25 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/593949024' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:46:26.118 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:46:26.496 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:26.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:26 smithi018 ceph-mon[30616]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:26.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:26 smithi176 ceph-mon[35713]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:27.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:26 smithi062 ceph-mon[35527]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:46:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.099+0000 7f45fe600640 1 -- 172.21.15.18:0/3190967262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f8076720 msgr2=0x7f45f8076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.099+0000 7f45fe600640 1 --2- 172.21.15.18:0/3190967262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f8076720 0x7f45f8076b00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009900 tx=0x7f45ec02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.099+0000 7f45fe600640 1 -- 172.21.15.18:0/3190967262 shutdown_connections 2024-09-12T02:46:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.099+0000 7f45fe600640 1 --2- 172.21.15.18:0/3190967262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f8112870 0x7f45f8114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.099+0000 7f45fe600640 1 --2- 172.21.15.18:0/3190967262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f8077040 0x7f45f8112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.099+0000 7f45fe600640 1 --2- 172.21.15.18:0/3190967262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f8076720 0x7f45f8076b00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.099+0000 7f45fe600640 1 -- 172.21.15.18:0/3190967262 >> 172.21.15.18:0/3190967262 conn(0x7f45f80ff8d0 msgr2=0x7f45f8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.099+0000 7f45fe600640 1 -- 172.21.15.18:0/3190967262 shutdown_connections 2024-09-12T02:46:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.099+0000 7f45fe600640 1 -- 172.21.15.18:0/3190967262 wait complete. 2024-09-12T02:46:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.100+0000 7f45fe600640 1 Processor -- start 2024-09-12T02:46:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.101+0000 7f45fe600640 1 -- start start 2024-09-12T02:46:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.101+0000 7f45fe600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f8076720 0x7f45f81a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.101+0000 7f45fe600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f8077040 0x7f45f81a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.101+0000 7f45fe600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f8112870 0x7f45f819e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.101+0000 7f45fe600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f45f8118450 con 0x7f45f8076720 2024-09-12T02:46:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.101+0000 7f45fe600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f45f81182d0 con 0x7f45f8112870 2024-09-12T02:46:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.101+0000 7f45fe600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f45f81185d0 con 0x7f45f8077040 2024-09-12T02:46:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.101+0000 7f45fd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f8076720 0x7f45f81a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.101+0000 7f45fd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f8076720 0x7f45f81a4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45010/0 (socket says 172.21.15.18:45010) 2024-09-12T02:46:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.101+0000 7f45f7e00640 1 --2- 172.21.15.18:0/1778279145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f8077040 0x7f45f81a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.101+0000 7f45fd200640 1 -- 172.21.15.18:0/1778279145 learned_addr learned my addr 172.21.15.18:0/1778279145 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.101+0000 7f45fdc00640 1 --2- 172.21.15.18:0/1778279145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f8112870 0x7f45f819e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.102+0000 7f45f7e00640 1 -- 172.21.15.18:0/1778279145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f8112870 msgr2=0x7f45f819e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:27.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.102+0000 7f45f7e00640 1 --2- 172.21.15.18:0/1778279145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f8112870 0x7f45f819e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.102+0000 7f45f7e00640 1 -- 172.21.15.18:0/1778279145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f8076720 msgr2=0x7f45f81a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:27.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.102+0000 7f45f7e00640 1 --2- 172.21.15.18:0/1778279145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f8076720 0x7f45f81a4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.102+0000 7f45f7e00640 1 -- 172.21.15.18:0/1778279145 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f819ef70 con 0x7f45f8077040 2024-09-12T02:46:27.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.102+0000 7f45fd200640 1 --2- 172.21.15.18:0/1778279145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f8076720 0x7f45f81a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:27.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.102+0000 7f45f7e00640 1 --2- 172.21.15.18:0/1778279145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f8077040 0x7f45f81a4b70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f45e400e9f0 tx=0x7f45e400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:27.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.102+0000 7f45f5600640 1 -- 172.21.15.18:0/1778279145 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e400cd80 con 0x7f45f8077040 2024-09-12T02:46:27.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.103+0000 7f45fe600640 1 -- 172.21.15.18:0/1778279145 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f819f260 con 0x7f45f8077040 2024-09-12T02:46:27.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.103+0000 7f45f5600640 1 -- 172.21.15.18:0/1778279145 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45e40035f0 con 0x7f45f8077040 2024-09-12T02:46:27.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.103+0000 7f45fe600640 1 -- 172.21.15.18:0/1778279145 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f81ab5b0 con 0x7f45f8077040 2024-09-12T02:46:27.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.103+0000 7f45f5600640 1 -- 172.21.15.18:0/1778279145 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e4018690 con 0x7f45f8077040 2024-09-12T02:46:27.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.104+0000 7f45fe600640 1 -- 172.21.15.18:0/1778279145 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f8077e60 con 0x7f45f8077040 2024-09-12T02:46:27.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.106+0000 7f45f5600640 1 -- 172.21.15.18:0/1778279145 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f45e4004020 con 0x7f45f8077040 2024-09-12T02:46:27.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.107+0000 7f45f5600640 1 --2- 172.21.15.18:0/1778279145 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f45e00a2b80 0x7f45e00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:27.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.108+0000 7f45f5600640 1 -- 172.21.15.18:0/1778279145 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7f45e40cf690 con 0x7f45f8077040 2024-09-12T02:46:27.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.108+0000 7f45fd200640 1 --2- 172.21.15.18:0/1778279145 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f45e00a2b80 0x7f45e00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:27.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.108+0000 7f45fd200640 1 --2- 172.21.15.18:0/1778279145 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f45e00a2b80 0x7f45e00a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0096c0 tx=0x7f45ec0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:27.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.109+0000 7f45f5600640 1 -- 172.21.15.18:0/1778279145 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f45e409c2c0 con 0x7f45f8077040 2024-09-12T02:46:27.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.330+0000 7f45fe600640 1 -- 172.21.15.18:0/1778279145 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f45f81ab780 con 0x7f45f8077040 2024-09-12T02:46:27.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.606+0000 7f45f5600640 1 -- 172.21.15.18:0/1778279145 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f45e409bbc0 con 0x7f45f8077040 2024-09-12T02:46:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.608+0000 7f45fe600640 1 -- 172.21.15.18:0/1778279145 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f45e00a2b80 msgr2=0x7f45e00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.608+0000 7f45fe600640 1 --2- 172.21.15.18:0/1778279145 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f45e00a2b80 0x7f45e00a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0096c0 tx=0x7f45ec0046c0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.608+0000 7f45fe600640 1 -- 172.21.15.18:0/1778279145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f8077040 msgr2=0x7f45f81a4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.608+0000 7f45fe600640 1 --2- 172.21.15.18:0/1778279145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f8077040 0x7f45f81a4b70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f45e400e9f0 tx=0x7f45e400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.608+0000 7f45fe600640 1 -- 172.21.15.18:0/1778279145 shutdown_connections 2024-09-12T02:46:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.608+0000 7f45fe600640 1 --2- 172.21.15.18:0/1778279145 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f45e00a2b80 0x7f45e00a5040 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.608+0000 7f45fe600640 1 --2- 172.21.15.18:0/1778279145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f8112870 0x7f45f819e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.608+0000 7f45fe600640 1 --2- 172.21.15.18:0/1778279145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f8077040 0x7f45f81a4b70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.608+0000 7f45fe600640 1 --2- 172.21.15.18:0/1778279145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f8076720 0x7f45f81a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.608+0000 7f45fe600640 1 -- 172.21.15.18:0/1778279145 >> 172.21.15.18:0/1778279145 conn(0x7f45f80ff8d0 msgr2=0x7f45f8101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.609+0000 7f45fe600640 1 -- 172.21.15.18:0/1778279145 shutdown_connections 2024-09-12T02:46:27.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:27.609+0000 7f45fe600640 1 -- 172.21.15.18:0/1778279145 wait complete. 2024-09-12T02:46:27.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:27 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1778279145' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:46:27.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:27 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:46:27.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:27 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1778279145' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:46:27.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:27 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:46:28.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:27 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1778279145' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:46:28.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:27 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:46:28.401 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-12T02:46:28.402 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-12T02:46:28.794 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:28.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:28 smithi018 ceph-mon[30616]: pgmap v334: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-12T02:46:28.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:28 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:46:28.933 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:28 smithi018 ceph-mon[30616]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:46:28.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:28 smithi062 ceph-mon[35527]: pgmap v334: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-12T02:46:28.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:28 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:46:28.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:28 smithi062 ceph-mon[35527]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:46:28.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:28 smithi176 ceph-mon[35713]: pgmap v334: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-12T02:46:28.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:28 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:46:28.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:28 smithi176 ceph-mon[35713]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:46:29.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.421+0000 7f68abe00640 1 -- 172.21.15.18:0/2234995156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68ac1047e0 msgr2=0x7f68ac108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.421+0000 7f68abe00640 1 --2- 172.21.15.18:0/2234995156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68ac1047e0 0x7f68ac108830 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6894009900 tx=0x7f689402a410 comp rx=0 tx=0).stop 2024-09-12T02:46:29.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.421+0000 7f68abe00640 1 -- 172.21.15.18:0/2234995156 shutdown_connections 2024-09-12T02:46:29.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.421+0000 7f68abe00640 1 --2- 172.21.15.18:0/2234995156 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68ac108f60 0x7f68ac110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.421+0000 7f68abe00640 1 --2- 172.21.15.18:0/2234995156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68ac1047e0 0x7f68ac108830 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.421+0000 7f68abe00640 1 --2- 172.21.15.18:0/2234995156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68ac103e30 0x7f68ac104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.421+0000 7f68abe00640 1 -- 172.21.15.18:0/2234995156 >> 172.21.15.18:0/2234995156 conn(0x7f68ac0ff8d0 msgr2=0x7f68ac101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:29.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.421+0000 7f68abe00640 1 -- 172.21.15.18:0/2234995156 shutdown_connections 2024-09-12T02:46:29.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.421+0000 7f68abe00640 1 -- 172.21.15.18:0/2234995156 wait complete. 2024-09-12T02:46:29.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.422+0000 7f68abe00640 1 Processor -- start 2024-09-12T02:46:29.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.422+0000 7f68abe00640 1 -- start start 2024-09-12T02:46:29.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.423+0000 7f68abe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68ac103e30 0x7f68ac19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:29.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.423+0000 7f68abe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68ac1047e0 0x7f68ac19a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:29.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.423+0000 7f68abe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68ac108f60 0x7f68ac19ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:29.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.423+0000 7f68abe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f68ac113fc0 con 0x7f68ac103e30 2024-09-12T02:46:29.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.423+0000 7f68abe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f68ac113e40 con 0x7f68ac1047e0 2024-09-12T02:46:29.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.423+0000 7f68abe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f68ac114140 con 0x7f68ac108f60 2024-09-12T02:46:29.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.423+0000 7f68aaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68ac103e30 0x7f68ac19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:29.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.423+0000 7f68aaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68ac103e30 0x7f68ac19a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45016/0 (socket says 172.21.15.18:45016) 2024-09-12T02:46:29.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.423+0000 7f68aaa00640 1 -- 172.21.15.18:0/3001463451 learned_addr learned my addr 172.21.15.18:0/3001463451 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:29.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.423+0000 7f68a3e00640 1 --2- 172.21.15.18:0/3001463451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68ac1047e0 0x7f68ac19a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:29.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.423+0000 7f68aaa00640 1 -- 172.21.15.18:0/3001463451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68ac108f60 msgr2=0x7f68ac19ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.423+0000 7f68aaa00640 1 --2- 172.21.15.18:0/3001463451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68ac108f60 0x7f68ac19ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.423+0000 7f68aaa00640 1 -- 172.21.15.18:0/3001463451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68ac1047e0 msgr2=0x7f68ac19a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:29.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.423+0000 7f68aaa00640 1 --2- 172.21.15.18:0/3001463451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68ac1047e0 0x7f68ac19a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:29.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.423+0000 7f68aaa00640 1 -- 172.21.15.18:0/3001463451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68ac19f410 con 0x7f68ac103e30 2024-09-12T02:46:29.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.424+0000 7f68aaa00640 1 --2- 172.21.15.18:0/3001463451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68ac103e30 0x7f68ac19a460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f689c00e9f0 tx=0x7f689c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:29.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.424+0000 7f68a3400640 1 -- 172.21.15.18:0/3001463451 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c00cd80 con 0x7f68ac103e30 2024-09-12T02:46:29.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.424+0000 7f68a3400640 1 -- 172.21.15.18:0/3001463451 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f689c010910 con 0x7f68ac103e30 2024-09-12T02:46:29.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.424+0000 7f68abe00640 1 -- 172.21.15.18:0/3001463451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68ac19f700 con 0x7f68ac103e30 2024-09-12T02:46:29.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.424+0000 7f68a3400640 1 -- 172.21.15.18:0/3001463451 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c018990 con 0x7f68ac103e30 2024-09-12T02:46:29.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.424+0000 7f68abe00640 1 -- 172.21.15.18:0/3001463451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68ac1a6fe0 con 0x7f68ac103e30 2024-09-12T02:46:29.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.425+0000 7f68abe00640 1 -- 172.21.15.18:0/3001463451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68ac104210 con 0x7f68ac103e30 2024-09-12T02:46:29.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.427+0000 7f68a3400640 1 -- 172.21.15.18:0/3001463451 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f689c010ac0 con 0x7f68ac103e30 2024-09-12T02:46:29.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.428+0000 7f68a3400640 1 --2- 172.21.15.18:0/3001463451 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f68900a2b80 0x7f68900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:29.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.429+0000 7f68a3400640 1 -- 172.21.15.18:0/3001463451 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7f689c0cf7a0 con 0x7f68ac103e30 2024-09-12T02:46:29.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.429+0000 7f68a3e00640 1 --2- 172.21.15.18:0/3001463451 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f68900a2b80 0x7f68900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:29.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.430+0000 7f68a3e00640 1 --2- 172.21.15.18:0/3001463451 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f68900a2b80 0x7f68900a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6894009230 tx=0x7f68940058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:29.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.433+0000 7f68a3400640 1 -- 172.21.15.18:0/3001463451 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f689c09c340 con 0x7f68ac103e30 2024-09-12T02:46:29.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:29.663+0000 7f68abe00640 1 -- 172.21.15.18:0/3001463451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f68ac10bbb0 con 0x7f68ac103e30 2024-09-12T02:46:30.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:30.614+0000 7f68a3400640 1 -- 172.21.15.18:0/3001463451 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f689c09bc40 con 0x7f68ac103e30 2024-09-12T02:46:30.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:30.617+0000 7f68abe00640 1 -- 172.21.15.18:0/3001463451 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f68900a2b80 msgr2=0x7f68900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:30.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:30.617+0000 7f68abe00640 1 --2- 172.21.15.18:0/3001463451 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f68900a2b80 0x7f68900a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6894009230 tx=0x7f68940058d0 comp rx=0 tx=0).stop 2024-09-12T02:46:30.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:30.617+0000 7f68abe00640 1 -- 172.21.15.18:0/3001463451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68ac103e30 msgr2=0x7f68ac19a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:30.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:30.617+0000 7f68abe00640 1 --2- 172.21.15.18:0/3001463451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68ac103e30 0x7f68ac19a460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f689c00e9f0 tx=0x7f689c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:46:30.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:30.617+0000 7f68abe00640 1 -- 172.21.15.18:0/3001463451 shutdown_connections 2024-09-12T02:46:30.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:30.617+0000 7f68abe00640 1 --2- 172.21.15.18:0/3001463451 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f68900a2b80 0x7f68900a5040 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:30.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:30.617+0000 7f68abe00640 1 --2- 172.21.15.18:0/3001463451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68ac108f60 0x7f68ac19ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:30.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:30.617+0000 7f68abe00640 1 --2- 172.21.15.18:0/3001463451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68ac1047e0 0x7f68ac19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:30.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:30.617+0000 7f68abe00640 1 --2- 172.21.15.18:0/3001463451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68ac103e30 0x7f68ac19a460 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:30.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:30.617+0000 7f68abe00640 1 -- 172.21.15.18:0/3001463451 >> 172.21.15.18:0/3001463451 conn(0x7f68ac0ff8d0 msgr2=0x7f68ac100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:30.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:30.618+0000 7f68abe00640 1 -- 172.21.15.18:0/3001463451 shutdown_connections 2024-09-12T02:46:30.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:30.618+0000 7f68abe00640 1 -- 172.21.15.18:0/3001463451 wait complete. 2024-09-12T02:46:30.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:30 smithi176 ceph-mon[35713]: pgmap v335: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-12T02:46:30.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:30 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3001463451' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T02:46:31.025 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:30 smithi018 ceph-mon[30616]: pgmap v335: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-12T02:46:31.025 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:30 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3001463451' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T02:46:31.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:30 smithi062 ceph-mon[35527]: pgmap v335: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-12T02:46:31.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:30 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3001463451' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T02:46:31.482 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-12T02:46:31.782 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:31 smithi176 ceph-mon[35713]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:46:31.782 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:31 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3001463451' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T02:46:31.782 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:31 smithi176 ceph-mon[35713]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:46:31.782 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:31 smithi176 ceph-mon[35713]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:46:31.783 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:31 smithi176 ceph-mon[35713]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-09-12T02:46:31.783 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:31 smithi176 ceph-mon[35713]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-09-12T02:46:31.783 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:31 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:46:31.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:31 smithi018 ceph-mon[30616]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:46:31.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:31 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3001463451' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T02:46:31.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:31 smithi018 ceph-mon[30616]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:46:31.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:31 smithi018 ceph-mon[30616]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:46:31.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:31 smithi018 ceph-mon[30616]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-09-12T02:46:31.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:31 smithi018 ceph-mon[30616]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-09-12T02:46:31.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:31 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:46:31.906 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:31.954 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:31 smithi062 ceph-mon[35527]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:46:31.954 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:31 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3001463451' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T02:46:31.954 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:31 smithi062 ceph-mon[35527]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:46:31.954 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:31 smithi062 ceph-mon[35527]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:46:31.954 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:31 smithi062 ceph-mon[35527]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-09-12T02:46:31.954 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:31 smithi062 ceph-mon[35527]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-09-12T02:46:31.955 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:31 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:46:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:32 smithi018 ceph-mon[30616]: pgmap v336: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-12T02:46:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:32 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] up:active 2024-09-12T02:46:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:32 smithi018 ceph-mon[30616]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:46:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:32 smithi018 ceph-mon[30616]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-09-12T02:46:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:32 smithi018 ceph-mon[30616]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:creating} 9 up:standby 2024-09-12T02:46:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:32 smithi018 ceph-mon[30616]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-12T02:46:32.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:32 smithi176 ceph-mon[35713]: pgmap v336: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-12T02:46:32.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:32 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] up:active 2024-09-12T02:46:32.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:32 smithi176 ceph-mon[35713]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:46:32.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:32 smithi176 ceph-mon[35713]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-09-12T02:46:32.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:32 smithi176 ceph-mon[35713]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:creating} 9 up:standby 2024-09-12T02:46:32.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:32 smithi176 ceph-mon[35713]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-12T02:46:33.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:32 smithi062 ceph-mon[35527]: pgmap v336: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-12T02:46:33.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:32 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] up:active 2024-09-12T02:46:33.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:32 smithi062 ceph-mon[35527]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:46:33.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:32 smithi062 ceph-mon[35527]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-09-12T02:46:33.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:32 smithi062 ceph-mon[35527]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:creating} 9 up:standby 2024-09-12T02:46:33.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:32 smithi062 ceph-mon[35527]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-12T02:46:33.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.325+0000 7f0d97e00640 1 -- 172.21.15.18:0/2137801543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d90076720 msgr2=0x7f0d90076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.325+0000 7f0d97e00640 1 --2- 172.21.15.18:0/2137801543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d90076720 0x7f0d90076b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009ca0 tx=0x7f0d8402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.326+0000 7f0d97e00640 1 -- 172.21.15.18:0/2137801543 shutdown_connections 2024-09-12T02:46:33.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.326+0000 7f0d97e00640 1 --2- 172.21.15.18:0/2137801543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d90112a30 0x7f0d90114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.326+0000 7f0d97e00640 1 --2- 172.21.15.18:0/2137801543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d90077040 0x7f0d901124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.326+0000 7f0d97e00640 1 --2- 172.21.15.18:0/2137801543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d90076720 0x7f0d90076b00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.326+0000 7f0d97e00640 1 -- 172.21.15.18:0/2137801543 >> 172.21.15.18:0/2137801543 conn(0x7f0d900ffa90 msgr2=0x7f0d90101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:33.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.326+0000 7f0d97e00640 1 -- 172.21.15.18:0/2137801543 shutdown_connections 2024-09-12T02:46:33.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.326+0000 7f0d97e00640 1 -- 172.21.15.18:0/2137801543 wait complete. 2024-09-12T02:46:33.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.327+0000 7f0d97e00640 1 Processor -- start 2024-09-12T02:46:33.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.327+0000 7f0d97e00640 1 -- start start 2024-09-12T02:46:33.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.327+0000 7f0d97e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d90076720 0x7f0d901a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:33.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.327+0000 7f0d97e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d90077040 0x7f0d901a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:33.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.327+0000 7f0d97e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d90112a30 0x7f0d9019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:33.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.327+0000 7f0d97e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0d901185c0 con 0x7f0d90076720 2024-09-12T02:46:33.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.327+0000 7f0d97e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0d90118440 con 0x7f0d90112a30 2024-09-12T02:46:33.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.327+0000 7f0d97e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0d90118740 con 0x7f0d90077040 2024-09-12T02:46:33.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.327+0000 7f0d95400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d90076720 0x7f0d901a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:33.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.328+0000 7f0d95e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d90112a30 0x7f0d9019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:33.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.328+0000 7f0d94a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d90077040 0x7f0d901a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:33.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.328+0000 7f0d95e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d90112a30 0x7f0d9019e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:58806/0 (socket says 172.21.15.18:58806) 2024-09-12T02:46:33.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.328+0000 7f0d94a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d90077040 0x7f0d901a4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:38240/0 (socket says 172.21.15.18:38240) 2024-09-12T02:46:33.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.328+0000 7f0d95e00640 1 -- 172.21.15.18:0/2906564038 learned_addr learned my addr 172.21.15.18:0/2906564038 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:33.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.328+0000 7f0d95e00640 1 -- 172.21.15.18:0/2906564038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d90077040 msgr2=0x7f0d901a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.328+0000 7f0d95e00640 1 --2- 172.21.15.18:0/2906564038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d90077040 0x7f0d901a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.328+0000 7f0d95e00640 1 -- 172.21.15.18:0/2906564038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d90076720 msgr2=0x7f0d901a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.328+0000 7f0d95e00640 1 --2- 172.21.15.18:0/2906564038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d90076720 0x7f0d901a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.328+0000 7f0d95e00640 1 -- 172.21.15.18:0/2906564038 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9019f000 con 0x7f0d90112a30 2024-09-12T02:46:33.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.328+0000 7f0d95400640 1 --2- 172.21.15.18:0/2906564038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d90076720 0x7f0d901a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:33.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.328+0000 7f0d95e00640 1 --2- 172.21.15.18:0/2906564038 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d90112a30 0x7f0d9019e8d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800e940 tx=0x7f0d8800ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:33.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.329+0000 7f0d8e000640 1 -- 172.21.15.18:0/2906564038 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8800ccc0 con 0x7f0d90112a30 2024-09-12T02:46:33.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.329+0000 7f0d8e000640 1 -- 172.21.15.18:0/2906564038 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d88005500 con 0x7f0d90112a30 2024-09-12T02:46:33.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.329+0000 7f0d8e000640 1 -- 172.21.15.18:0/2906564038 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d88010690 con 0x7f0d90112a30 2024-09-12T02:46:33.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.329+0000 7f0d97e00640 1 -- 172.21.15.18:0/2906564038 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9019f2f0 con 0x7f0d90112a30 2024-09-12T02:46:33.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.329+0000 7f0d97e00640 1 -- 172.21.15.18:0/2906564038 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d901ab5e0 con 0x7f0d90112a30 2024-09-12T02:46:33.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.330+0000 7f0d97e00640 1 -- 172.21.15.18:0/2906564038 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d90076b00 con 0x7f0d90112a30 2024-09-12T02:46:33.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.332+0000 7f0d8e000640 1 -- 172.21.15.18:0/2906564038 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0d880046c0 con 0x7f0d90112a30 2024-09-12T02:46:33.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.333+0000 7f0d8e000640 1 --2- 172.21.15.18:0/2906564038 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0d780a2c00 0x7f0d780a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:33.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.333+0000 7f0d8e000640 1 -- 172.21.15.18:0/2906564038 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7f0d880cf5f0 con 0x7f0d90112a30 2024-09-12T02:46:33.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.333+0000 7f0d95400640 1 --2- 172.21.15.18:0/2906564038 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0d780a2c00 0x7f0d780a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:33.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.334+0000 7f0d95400640 1 --2- 172.21.15.18:0/2906564038 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0d780a2c00 0x7f0d780a50c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0d9019fa10 tx=0x7f0d84005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:33.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.335+0000 7f0d8e000640 1 -- 172.21.15.18:0/2906564038 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d8809c190 con 0x7f0d90112a30 2024-09-12T02:46:33.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.575+0000 7f0d97e00640 1 -- 172.21.15.18:0/2906564038 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f0d9002d7c0 con 0x7f0d90112a30 2024-09-12T02:46:33.634 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 02:46:33 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-b[65969]: 2024-09-12T02:46:33.287+0000 7fc913cd1640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-12T02:46:33.634 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 02:46:33 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-b[65969]: 2024-09-12T02:46:33.287+0000 7fc913cd1640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-12T02:46:33.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.653+0000 7f0d8e000640 1 -- 172.21.15.18:0/2906564038 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f0d8809ba90 con 0x7f0d90112a30 2024-09-12T02:46:33.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.656+0000 7f0d97e00640 1 -- 172.21.15.18:0/2906564038 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0d780a2c00 msgr2=0x7f0d780a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.656+0000 7f0d97e00640 1 --2- 172.21.15.18:0/2906564038 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0d780a2c00 0x7f0d780a50c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0d9019fa10 tx=0x7f0d84005f50 comp rx=0 tx=0).stop 2024-09-12T02:46:33.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.656+0000 7f0d97e00640 1 -- 172.21.15.18:0/2906564038 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d90112a30 msgr2=0x7f0d9019e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:33.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.656+0000 7f0d97e00640 1 --2- 172.21.15.18:0/2906564038 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d90112a30 0x7f0d9019e8d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800e940 tx=0x7f0d8800ee00 comp rx=0 tx=0).stop 2024-09-12T02:46:33.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.656+0000 7f0d97e00640 1 -- 172.21.15.18:0/2906564038 shutdown_connections 2024-09-12T02:46:33.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.656+0000 7f0d97e00640 1 --2- 172.21.15.18:0/2906564038 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f0d780a2c00 0x7f0d780a50c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.656+0000 7f0d97e00640 1 --2- 172.21.15.18:0/2906564038 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d90112a30 0x7f0d9019e8d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.656+0000 7f0d97e00640 1 --2- 172.21.15.18:0/2906564038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d90077040 0x7f0d901a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.656+0000 7f0d97e00640 1 --2- 172.21.15.18:0/2906564038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d90076720 0x7f0d901a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:33.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.656+0000 7f0d97e00640 1 -- 172.21.15.18:0/2906564038 >> 172.21.15.18:0/2906564038 conn(0x7f0d900ffa90 msgr2=0x7f0d90101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:33.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.656+0000 7f0d97e00640 1 -- 172.21.15.18:0/2906564038 shutdown_connections 2024-09-12T02:46:33.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:33.656+0000 7f0d97e00640 1 -- 172.21.15.18:0/2906564038 wait complete. 2024-09-12T02:46:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:33 smithi018 ceph-mon[30616]: pgmap v337: 129 pgs: 129 active+clean; 583 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 1 op/s 2024-09-12T02:46:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:33 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] up:active 2024-09-12T02:46:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:33 smithi018 ceph-mon[30616]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T02:46:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:33 smithi018 ceph-mon[30616]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-09-12T02:46:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:33 smithi018 ceph-mon[30616]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-09-12T02:46:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:33 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:33 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:33 smithi018 ceph-mon[30616]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-12T02:46:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:33 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:33 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:33.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:33 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2906564038' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:46:33.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:33 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:46:33.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:33 smithi176 ceph-mon[35713]: pgmap v337: 129 pgs: 129 active+clean; 583 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 1 op/s 2024-09-12T02:46:33.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:33 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] up:active 2024-09-12T02:46:33.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:33 smithi176 ceph-mon[35713]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T02:46:33.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:33 smithi176 ceph-mon[35713]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-09-12T02:46:33.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:33 smithi176 ceph-mon[35713]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-09-12T02:46:33.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:33 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:33.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:33 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:33.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:33 smithi176 ceph-mon[35713]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-12T02:46:33.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:33 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:33.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:33 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:33.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:33 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2906564038' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:46:33.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:33 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:46:34.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:33 smithi062 ceph-mon[35527]: pgmap v337: 129 pgs: 129 active+clean; 583 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 1 op/s 2024-09-12T02:46:34.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:33 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] up:active 2024-09-12T02:46:34.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:33 smithi062 ceph-mon[35527]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T02:46:34.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:33 smithi062 ceph-mon[35527]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-09-12T02:46:34.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:33 smithi062 ceph-mon[35527]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-09-12T02:46:34.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:33 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:34.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:33 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:34.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:33 smithi062 ceph-mon[35527]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-12T02:46:34.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:33 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:34.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:33 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:34.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:33 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2906564038' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:46:34.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:33 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:46:34.507 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-12T02:46:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:34 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:46:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:34 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] up:active 2024-09-12T02:46:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:34 smithi018 ceph-mon[30616]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T02:46:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:34 smithi018 ceph-mon[30616]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:46:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:34 smithi018 ceph-mon[30616]: Cluster is now healthy 2024-09-12T02:46:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:34 smithi018 ceph-mon[30616]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=c=up:active} 8 up:standby 2024-09-12T02:46:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:34 smithi018 ceph-mon[30616]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T02:46:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:34 smithi018 ceph-mon[30616]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-12T02:46:34.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:34 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:34.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:34 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:34.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:34 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:46:34.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:34 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] up:active 2024-09-12T02:46:34.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:34 smithi176 ceph-mon[35713]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T02:46:34.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:34 smithi176 ceph-mon[35713]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:46:34.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:34 smithi176 ceph-mon[35713]: Cluster is now healthy 2024-09-12T02:46:34.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:34 smithi176 ceph-mon[35713]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=c=up:active} 8 up:standby 2024-09-12T02:46:34.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:34 smithi176 ceph-mon[35713]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T02:46:34.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:34 smithi176 ceph-mon[35713]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-12T02:46:34.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:34 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:34.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:34 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:35.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:34 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:46:35.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:34 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] up:active 2024-09-12T02:46:35.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:34 smithi062 ceph-mon[35527]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T02:46:35.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:34 smithi062 ceph-mon[35527]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:46:35.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:34 smithi062 ceph-mon[35527]: Cluster is now healthy 2024-09-12T02:46:35.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:34 smithi062 ceph-mon[35527]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=c=up:active} 8 up:standby 2024-09-12T02:46:35.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:34 smithi062 ceph-mon[35527]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T02:46:35.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:34 smithi062 ceph-mon[35527]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-12T02:46:35.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:34 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:35.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:34 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:35.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.553+0000 7f7a5ae00640 1 -- 172.21.15.18:0/3553861471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a54077040 msgr2=0x7f7a54112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:35.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.553+0000 7f7a5ae00640 1 --2- 172.21.15.18:0/3553861471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a54077040 0x7f7a54112330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009900 tx=0x7f7a4002a410 comp rx=0 tx=0).stop 2024-09-12T02:46:35.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.553+0000 7f7a5ae00640 1 -- 172.21.15.18:0/3553861471 shutdown_connections 2024-09-12T02:46:35.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.553+0000 7f7a5ae00640 1 --2- 172.21.15.18:0/3553861471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a54112870 0x7f7a54114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:35.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.553+0000 7f7a5ae00640 1 --2- 172.21.15.18:0/3553861471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a54077040 0x7f7a54112330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:35.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.553+0000 7f7a5ae00640 1 --2- 172.21.15.18:0/3553861471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54076720 0x7f7a54076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:35.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.553+0000 7f7a5ae00640 1 -- 172.21.15.18:0/3553861471 >> 172.21.15.18:0/3553861471 conn(0x7f7a540ff910 msgr2=0x7f7a54101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:35.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.553+0000 7f7a5ae00640 1 -- 172.21.15.18:0/3553861471 shutdown_connections 2024-09-12T02:46:35.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.553+0000 7f7a5ae00640 1 -- 172.21.15.18:0/3553861471 wait complete. 2024-09-12T02:46:35.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.554+0000 7f7a5ae00640 1 Processor -- start 2024-09-12T02:46:35.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.555+0000 7f7a5ae00640 1 -- start start 2024-09-12T02:46:35.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.555+0000 7f7a5ae00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a54076720 0x7f7a541a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:35.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.555+0000 7f7a5ae00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54077040 0x7f7a541a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:35.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.555+0000 7f7a5ae00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a54112870 0x7f7a5419e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:35.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.555+0000 7f7a5ae00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7a541183e0 con 0x7f7a54076720 2024-09-12T02:46:35.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.555+0000 7f7a5ae00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7a54118260 con 0x7f7a54077040 2024-09-12T02:46:35.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.555+0000 7f7a5ae00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7a54118560 con 0x7f7a54112870 2024-09-12T02:46:35.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.555+0000 7f7a59a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a54076720 0x7f7a541a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:35.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.555+0000 7f7a59a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a54076720 0x7f7a541a4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37716/0 (socket says 172.21.15.18:37716) 2024-09-12T02:46:35.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.555+0000 7f7a59a00640 1 -- 172.21.15.18:0/2690786766 learned_addr learned my addr 172.21.15.18:0/2690786766 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:35.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.555+0000 7f7a59000640 1 --2- 172.21.15.18:0/2690786766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54077040 0x7f7a541a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:35.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.555+0000 7f7a5a400640 1 --2- 172.21.15.18:0/2690786766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a54112870 0x7f7a5419e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:35.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.556+0000 7f7a59a00640 1 -- 172.21.15.18:0/2690786766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a54112870 msgr2=0x7f7a5419e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:35.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.556+0000 7f7a59a00640 1 --2- 172.21.15.18:0/2690786766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a54112870 0x7f7a5419e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:35.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.556+0000 7f7a59a00640 1 -- 172.21.15.18:0/2690786766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54077040 msgr2=0x7f7a541a4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:35.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.556+0000 7f7a59a00640 1 --2- 172.21.15.18:0/2690786766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54077040 0x7f7a541a4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:35.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.556+0000 7f7a59a00640 1 -- 172.21.15.18:0/2690786766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5419ef50 con 0x7f7a54076720 2024-09-12T02:46:35.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.556+0000 7f7a59a00640 1 --2- 172.21.15.18:0/2690786766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a54076720 0x7f7a541a4630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800e9f0 tx=0x7f7a4800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:35.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.556+0000 7f7a52000640 1 -- 172.21.15.18:0/2690786766 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4800cd80 con 0x7f7a54076720 2024-09-12T02:46:35.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.556+0000 7f7a52000640 1 -- 172.21.15.18:0/2690786766 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a48010910 con 0x7f7a54076720 2024-09-12T02:46:35.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.556+0000 7f7a52000640 1 -- 172.21.15.18:0/2690786766 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48018990 con 0x7f7a54076720 2024-09-12T02:46:35.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.556+0000 7f7a5ae00640 1 -- 172.21.15.18:0/2690786766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a5419f240 con 0x7f7a54076720 2024-09-12T02:46:35.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.557+0000 7f7a5ae00640 1 -- 172.21.15.18:0/2690786766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a541ab490 con 0x7f7a54076720 2024-09-12T02:46:35.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.558+0000 7f7a5ae00640 1 -- 172.21.15.18:0/2690786766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a54077e60 con 0x7f7a54076720 2024-09-12T02:46:35.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.559+0000 7f7a52000640 1 -- 172.21.15.18:0/2690786766 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7a48010ac0 con 0x7f7a54076720 2024-09-12T02:46:35.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.561+0000 7f7a52000640 1 --2- 172.21.15.18:0/2690786766 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7a3c0a2c00 0x7f7a3c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:35.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.561+0000 7f7a52000640 1 -- 172.21.15.18:0/2690786766 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7f7a480cf670 con 0x7f7a54076720 2024-09-12T02:46:35.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.561+0000 7f7a59000640 1 --2- 172.21.15.18:0/2690786766 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7a3c0a2c00 0x7f7a3c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:35.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.562+0000 7f7a59000640 1 --2- 172.21.15.18:0/2690786766 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7a3c0a2c00 0x7f7a3c0a50c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009230 tx=0x7f7a400058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:35.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.565+0000 7f7a52000640 1 -- 172.21.15.18:0/2690786766 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a4809bbc0 con 0x7f7a54076720 2024-09-12T02:46:35.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:35.795+0000 7f7a5ae00640 1 -- 172.21.15.18:0/2690786766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f7a5410da60 con 0x7f7a54076720 2024-09-12T02:46:35.795 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:35 smithi018 ceph-mon[30616]: pgmap v338: 129 pgs: 129 active+clean; 583 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 7 op/s 2024-09-12T02:46:35.796 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:35 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] up:active 2024-09-12T02:46:35.796 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:35 smithi018 ceph-mon[30616]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-12T02:46:35.796 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:35 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:46:35.796 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:35 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:46:35.796 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:35 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:46:35.796 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:35 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:35.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:35 smithi176 ceph-mon[35713]: pgmap v338: 129 pgs: 129 active+clean; 583 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 7 op/s 2024-09-12T02:46:35.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:35 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] up:active 2024-09-12T02:46:35.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:35 smithi176 ceph-mon[35713]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-12T02:46:35.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:35 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:46:35.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:35 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:46:35.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:35 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:46:35.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:35 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:36.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:35 smithi062 ceph-mon[35527]: pgmap v338: 129 pgs: 129 active+clean; 583 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 7 op/s 2024-09-12T02:46:36.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:35 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] up:active 2024-09-12T02:46:36.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:35 smithi062 ceph-mon[35527]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-12T02:46:36.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:35 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:46:36.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:35 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:46:36.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:35 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:46:36.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:35 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:46:36.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:36.667+0000 7f7a52000640 1 -- 172.21.15.18:0/2690786766 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v29) ==== 115+0+0 (secure 0 0 0) 0x7f7a4809fec0 con 0x7f7a54076720 2024-09-12T02:46:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:36.671+0000 7f7a5ae00640 1 -- 172.21.15.18:0/2690786766 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7a3c0a2c00 msgr2=0x7f7a3c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:36.671+0000 7f7a5ae00640 1 --2- 172.21.15.18:0/2690786766 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7a3c0a2c00 0x7f7a3c0a50c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009230 tx=0x7f7a400058d0 comp rx=0 tx=0).stop 2024-09-12T02:46:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:36.671+0000 7f7a5ae00640 1 -- 172.21.15.18:0/2690786766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a54076720 msgr2=0x7f7a541a4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:36.671+0000 7f7a5ae00640 1 --2- 172.21.15.18:0/2690786766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a54076720 0x7f7a541a4630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800e9f0 tx=0x7f7a4800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:46:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:36.671+0000 7f7a5ae00640 1 -- 172.21.15.18:0/2690786766 shutdown_connections 2024-09-12T02:46:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:36.671+0000 7f7a5ae00640 1 --2- 172.21.15.18:0/2690786766 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f7a3c0a2c00 0x7f7a3c0a50c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:36.671+0000 7f7a5ae00640 1 --2- 172.21.15.18:0/2690786766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a54112870 0x7f7a5419e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:36.671+0000 7f7a5ae00640 1 --2- 172.21.15.18:0/2690786766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54077040 0x7f7a541a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:36.671+0000 7f7a5ae00640 1 --2- 172.21.15.18:0/2690786766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a54076720 0x7f7a541a4630 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:36.671+0000 7f7a5ae00640 1 -- 172.21.15.18:0/2690786766 >> 172.21.15.18:0/2690786766 conn(0x7f7a540ff910 msgr2=0x7f7a54101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:36.671+0000 7f7a5ae00640 1 -- 172.21.15.18:0/2690786766 shutdown_connections 2024-09-12T02:46:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:36.671+0000 7f7a5ae00640 1 -- 172.21.15.18:0/2690786766 wait complete. 2024-09-12T02:46:36.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:36 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2690786766' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:46:37.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:36 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2690786766' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:46:37.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:36 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2690786766' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:46:37.744 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-12T02:46:37.745 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-12T02:46:37.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:37 smithi176 ceph-mon[35713]: pgmap v339: 129 pgs: 129 active+clean; 585 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-09-12T02:46:37.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:37 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2690786766' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:46:37.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:37 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:46:38.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:37 smithi062 ceph-mon[35527]: pgmap v339: 129 pgs: 129 active+clean; 585 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-09-12T02:46:38.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:37 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2690786766' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:46:38.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:37 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:46:38.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:37 smithi018 ceph-mon[30616]: pgmap v339: 129 pgs: 129 active+clean; 585 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-09-12T02:46:38.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:37 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2690786766' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:46:38.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:37 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:46:38.127 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:38.783 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 02:46:38 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-b[65969]: 2024-09-12T02:46:38.288+0000 7fc913cd1640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-12T02:46:38.783 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 02:46:38 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-b[65969]: 2024-09-12T02:46:38.288+0000 7fc913cd1640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-12T02:46:38.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.889+0000 7fb6f8800640 1 -- 172.21.15.18:0/2709325263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6f0103ff0 msgr2=0x7fb6f01043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:38.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.889+0000 7fb6f8800640 1 --2- 172.21.15.18:0/2709325263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6f0103ff0 0x7fb6f01043d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009900 tx=0x7fb6e402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:46:38.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.889+0000 7fb6f8800640 1 -- 172.21.15.18:0/2709325263 shutdown_connections 2024-09-12T02:46:38.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.889+0000 7fb6f8800640 1 --2- 172.21.15.18:0/2709325263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6f0109120 0x7fb6f0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:38.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.889+0000 7fb6f8800640 1 --2- 172.21.15.18:0/2709325263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f01049a0 0x7fb6f01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:38.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.889+0000 7fb6f8800640 1 --2- 172.21.15.18:0/2709325263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6f0103ff0 0x7fb6f01043d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:38.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.889+0000 7fb6f8800640 1 -- 172.21.15.18:0/2709325263 >> 172.21.15.18:0/2709325263 conn(0x7fb6f00ffa90 msgr2=0x7fb6f0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:38.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.889+0000 7fb6f8800640 1 -- 172.21.15.18:0/2709325263 shutdown_connections 2024-09-12T02:46:38.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.889+0000 7fb6f8800640 1 -- 172.21.15.18:0/2709325263 wait complete. 2024-09-12T02:46:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.890+0000 7fb6f8800640 1 Processor -- start 2024-09-12T02:46:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.890+0000 7fb6f8800640 1 -- start start 2024-09-12T02:46:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.891+0000 7fb6f8800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6f0103ff0 0x7fb6f019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.891+0000 7fb6f8800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f01049a0 0x7fb6f019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.891+0000 7fb6f8800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6f0109120 0x7fb6f019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.891+0000 7fb6f8800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f01141c0 con 0x7fb6f0103ff0 2024-09-12T02:46:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.891+0000 7fb6f8800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f0114040 con 0x7fb6f01049a0 2024-09-12T02:46:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.891+0000 7fb6f8800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f0114340 con 0x7fb6f0109120 2024-09-12T02:46:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.891+0000 7fb6f5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6f0103ff0 0x7fb6f019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.891+0000 7fb6f5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6f0103ff0 0x7fb6f019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37736/0 (socket says 172.21.15.18:37736) 2024-09-12T02:46:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.891+0000 7fb6f5e00640 1 -- 172.21.15.18:0/3750851221 learned_addr learned my addr 172.21.15.18:0/3750851221 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.891+0000 7fb6f6800640 1 --2- 172.21.15.18:0/3750851221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6f0109120 0x7fb6f019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:38.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.891+0000 7fb6f5400640 1 --2- 172.21.15.18:0/3750851221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f01049a0 0x7fb6f019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:38.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.892+0000 7fb6f6800640 1 -- 172.21.15.18:0/3750851221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f01049a0 msgr2=0x7fb6f019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:38.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.892+0000 7fb6f6800640 1 --2- 172.21.15.18:0/3750851221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f01049a0 0x7fb6f019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:38.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.892+0000 7fb6f6800640 1 -- 172.21.15.18:0/3750851221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6f0103ff0 msgr2=0x7fb6f019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:38.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.892+0000 7fb6f6800640 1 --2- 172.21.15.18:0/3750851221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6f0103ff0 0x7fb6f019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:38.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.892+0000 7fb6f6800640 1 -- 172.21.15.18:0/3750851221 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f019f5f0 con 0x7fb6f0109120 2024-09-12T02:46:38.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.892+0000 7fb6f6800640 1 --2- 172.21.15.18:0/3750851221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6f0109120 0x7fb6f019ef10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec009fd0 tx=0x7fb6ec00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:38.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.892+0000 7fb6eaa00640 1 -- 172.21.15.18:0/3750851221 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec00ce20 con 0x7fb6f0109120 2024-09-12T02:46:38.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.892+0000 7fb6f8800640 1 -- 172.21.15.18:0/3750851221 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f019f8e0 con 0x7fb6f0109120 2024-09-12T02:46:38.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.892+0000 7fb6eaa00640 1 -- 172.21.15.18:0/3750851221 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6ec005020 con 0x7fb6f0109120 2024-09-12T02:46:38.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.892+0000 7fb6eaa00640 1 -- 172.21.15.18:0/3750851221 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec010720 con 0x7fb6f0109120 2024-09-12T02:46:38.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.892+0000 7fb6f8800640 1 -- 172.21.15.18:0/3750851221 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f01a71c0 con 0x7fb6f0109120 2024-09-12T02:46:38.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.893+0000 7fb6f8800640 1 -- 172.21.15.18:0/3750851221 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6f01043d0 con 0x7fb6f0109120 2024-09-12T02:46:38.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.895+0000 7fb6eaa00640 1 -- 172.21.15.18:0/3750851221 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb6ec005540 con 0x7fb6f0109120 2024-09-12T02:46:38.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.897+0000 7fb6eaa00640 1 --2- 172.21.15.18:0/3750851221 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb6d80a2c00 0x7fb6d80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:38.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.897+0000 7fb6eaa00640 1 -- 172.21.15.18:0/3750851221 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7fb6ec0cf940 con 0x7fb6f0109120 2024-09-12T02:46:38.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.897+0000 7fb6f5e00640 1 --2- 172.21.15.18:0/3750851221 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb6d80a2c00 0x7fb6d80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:38.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.898+0000 7fb6f5e00640 1 --2- 172.21.15.18:0/3750851221 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb6d80a2c00 0x7fb6d80a50c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40096c0 tx=0x7fb6e40046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:38.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:38.899+0000 7fb6eaa00640 1 -- 172.21.15.18:0/3750851221 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb6ec09c4e0 con 0x7fb6f0109120 2024-09-12T02:46:39.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:39.111+0000 7fb6f8800640 1 -- 172.21.15.18:0/3750851221 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb6f0062630 con 0x7fb6d80a2c00 2024-09-12T02:46:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:39.143+0000 7fb6eaa00640 1 -- 172.21.15.18:0/3750851221 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb6f0062630 con 0x7fb6d80a2c00 2024-09-12T02:46:39.143 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:46:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:46:39.118+0000 7fdc5a200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:46:39.144 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:46:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:46:39.118+0000 7fdc5a200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:46:39.144 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:46:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:46:39.118+0000 7fdc5a200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:46:39.144 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:46:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:46:39.118+0000 7fdc5a200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:46:39.144 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:46:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:46:39.118+0000 7fdc5a200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:46:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:39.145+0000 7fb6f8800640 1 -- 172.21.15.18:0/3750851221 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb6d80a2c00 msgr2=0x7fb6d80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:39.145+0000 7fb6f8800640 1 --2- 172.21.15.18:0/3750851221 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb6d80a2c00 0x7fb6d80a50c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40096c0 tx=0x7fb6e40046c0 comp rx=0 tx=0).stop 2024-09-12T02:46:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:39.145+0000 7fb6f8800640 1 -- 172.21.15.18:0/3750851221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6f0109120 msgr2=0x7fb6f019ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:39.145+0000 7fb6f8800640 1 --2- 172.21.15.18:0/3750851221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6f0109120 0x7fb6f019ef10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec009fd0 tx=0x7fb6ec00ef10 comp rx=0 tx=0).stop 2024-09-12T02:46:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:39.145+0000 7fb6f8800640 1 -- 172.21.15.18:0/3750851221 shutdown_connections 2024-09-12T02:46:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:39.145+0000 7fb6f8800640 1 --2- 172.21.15.18:0/3750851221 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb6d80a2c00 0x7fb6d80a50c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:39.146+0000 7fb6f8800640 1 --2- 172.21.15.18:0/3750851221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6f0109120 0x7fb6f019ef10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:39.146+0000 7fb6f8800640 1 --2- 172.21.15.18:0/3750851221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f01049a0 0x7fb6f019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:39.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:39.146+0000 7fb6f8800640 1 --2- 172.21.15.18:0/3750851221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6f0103ff0 0x7fb6f019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:39.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:39.146+0000 7fb6f8800640 1 -- 172.21.15.18:0/3750851221 >> 172.21.15.18:0/3750851221 conn(0x7fb6f00ffa90 msgr2=0x7fb6f0100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:39.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:39.146+0000 7fb6f8800640 1 -- 172.21.15.18:0/3750851221 shutdown_connections 2024-09-12T02:46:39.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:39.146+0000 7fb6f8800640 1 -- 172.21.15.18:0/3750851221 wait complete. 2024-09-12T02:46:39.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:39 smithi018 ceph-mon[30616]: pgmap v340: 129 pgs: 129 active+clean; 587 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-09-12T02:46:39.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:39 smithi018 ceph-mon[30616]: from='client.24694 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:46:39.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:39 smithi176 ceph-mon[35713]: pgmap v340: 129 pgs: 129 active+clean; 587 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-09-12T02:46:39.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:39 smithi176 ceph-mon[35713]: from='client.24694 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:46:39.995 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-12T02:46:40.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:39 smithi062 ceph-mon[35527]: pgmap v340: 129 pgs: 129 active+clean; 587 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-09-12T02:46:40.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:39 smithi062 ceph-mon[35527]: from='client.24694 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:46:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:41.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.055+0000 7fada3800640 1 -- 172.21.15.18:0/2933510655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad9c103ff0 msgr2=0x7fad9c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.055+0000 7fada3800640 1 --2- 172.21.15.18:0/2933510655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad9c103ff0 0x7fad9c1043d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fad90009900 tx=0x7fad9002a410 comp rx=0 tx=0).stop 2024-09-12T02:46:41.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.056+0000 7fada3800640 1 -- 172.21.15.18:0/2933510655 shutdown_connections 2024-09-12T02:46:41.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.056+0000 7fada3800640 1 --2- 172.21.15.18:0/2933510655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad9c109120 0x7fad9c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.056+0000 7fada3800640 1 --2- 172.21.15.18:0/2933510655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad9c1049a0 0x7fad9c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.056+0000 7fada3800640 1 --2- 172.21.15.18:0/2933510655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad9c103ff0 0x7fad9c1043d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.056+0000 7fada3800640 1 -- 172.21.15.18:0/2933510655 >> 172.21.15.18:0/2933510655 conn(0x7fad9c0ffa90 msgr2=0x7fad9c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:41.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.056+0000 7fada3800640 1 -- 172.21.15.18:0/2933510655 shutdown_connections 2024-09-12T02:46:41.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.056+0000 7fada3800640 1 -- 172.21.15.18:0/2933510655 wait complete. 2024-09-12T02:46:41.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.057+0000 7fada3800640 1 Processor -- start 2024-09-12T02:46:41.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.057+0000 7fada3800640 1 -- start start 2024-09-12T02:46:41.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.057+0000 7fada3800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad9c103ff0 0x7fad9c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.057+0000 7fada3800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad9c1049a0 0x7fad9c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.057+0000 7fada3800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad9c109120 0x7fad9c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.057+0000 7fada3800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c114170 con 0x7fad9c103ff0 2024-09-12T02:46:41.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.057+0000 7fada3800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c113ff0 con 0x7fad9c109120 2024-09-12T02:46:41.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.057+0000 7fada3800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c1142f0 con 0x7fad9c1049a0 2024-09-12T02:46:41.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.057+0000 7fada0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad9c103ff0 0x7fad9c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.057+0000 7fada0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad9c103ff0 0x7fad9c19a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37762/0 (socket says 172.21.15.18:37762) 2024-09-12T02:46:41.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.057+0000 7fada0e00640 1 -- 172.21.15.18:0/2839358677 learned_addr learned my addr 172.21.15.18:0/2839358677 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:41.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.058+0000 7fada1800640 1 --2- 172.21.15.18:0/2839358677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad9c109120 0x7fad9c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.058+0000 7fada0e00640 1 -- 172.21.15.18:0/2839358677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad9c1049a0 msgr2=0x7fad9c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.058+0000 7fada0e00640 1 --2- 172.21.15.18:0/2839358677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad9c1049a0 0x7fad9c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.058+0000 7fada0e00640 1 -- 172.21.15.18:0/2839358677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad9c109120 msgr2=0x7fad9c19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.058+0000 7fada0e00640 1 --2- 172.21.15.18:0/2839358677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad9c109120 0x7fad9c19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.058+0000 7fada0e00640 1 -- 172.21.15.18:0/2839358677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9c19f620 con 0x7fad9c103ff0 2024-09-12T02:46:41.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.058+0000 7fada0e00640 1 --2- 172.21.15.18:0/2839358677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad9c103ff0 0x7fad9c19a670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fad90004770 tx=0x7fad90003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:41.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.058+0000 7fad99600640 1 -- 172.21.15.18:0/2839358677 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9003f070 con 0x7fad9c103ff0 2024-09-12T02:46:41.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.059+0000 7fad99600640 1 -- 172.21.15.18:0/2839358677 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad90031ca0 con 0x7fad9c103ff0 2024-09-12T02:46:41.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.059+0000 7fad99600640 1 -- 172.21.15.18:0/2839358677 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad90035030 con 0x7fad9c103ff0 2024-09-12T02:46:41.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.059+0000 7fada3800640 1 -- 172.21.15.18:0/2839358677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad9c19f8b0 con 0x7fad9c103ff0 2024-09-12T02:46:41.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.059+0000 7fada3800640 1 -- 172.21.15.18:0/2839358677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad9c19fd40 con 0x7fad9c103ff0 2024-09-12T02:46:41.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.060+0000 7fada3800640 1 -- 172.21.15.18:0/2839358677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad9c1043d0 con 0x7fad9c103ff0 2024-09-12T02:46:41.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.062+0000 7fad99600640 1 -- 172.21.15.18:0/2839358677 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fad90042070 con 0x7fad9c103ff0 2024-09-12T02:46:41.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.063+0000 7fad99600640 1 --2- 172.21.15.18:0/2839358677 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fad840a2c00 0x7fad840a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:41.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.063+0000 7fad99600640 1 -- 172.21.15.18:0/2839358677 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7fad900ef720 con 0x7fad9c103ff0 2024-09-12T02:46:41.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.064+0000 7fad9be00640 1 --2- 172.21.15.18:0/2839358677 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fad840a2c00 0x7fad840a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:41.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.064+0000 7fad9be00640 1 --2- 172.21.15.18:0/2839358677 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fad840a2c00 0x7fad840a50c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fad880058c0 tx=0x7fad88005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:41.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.067+0000 7fad99600640 1 -- 172.21.15.18:0/2839358677 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fad900bc2c0 con 0x7fad9c103ff0 2024-09-12T02:46:41.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.280+0000 7fada3800640 1 -- 172.21.15.18:0/2839358677 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fad9c10c370 con 0x7fad840a2c00 2024-09-12T02:46:41.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.306+0000 7fad99600640 1 -- 172.21.15.18:0/2839358677 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fad8800e9e0 con 0x7fad840a2c00 2024-09-12T02:46:41.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.308+0000 7fada3800640 1 -- 172.21.15.18:0/2839358677 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fad840a2c00 msgr2=0x7fad840a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.308+0000 7fada3800640 1 --2- 172.21.15.18:0/2839358677 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fad840a2c00 0x7fad840a50c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fad880058c0 tx=0x7fad88005850 comp rx=0 tx=0).stop 2024-09-12T02:46:41.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.308+0000 7fada3800640 1 -- 172.21.15.18:0/2839358677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad9c103ff0 msgr2=0x7fad9c19a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:41.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.308+0000 7fada3800640 1 --2- 172.21.15.18:0/2839358677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad9c103ff0 0x7fad9c19a670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fad90004770 tx=0x7fad90003c10 comp rx=0 tx=0).stop 2024-09-12T02:46:41.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.308+0000 7fada3800640 1 -- 172.21.15.18:0/2839358677 shutdown_connections 2024-09-12T02:46:41.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.308+0000 7fada3800640 1 --2- 172.21.15.18:0/2839358677 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fad840a2c00 0x7fad840a50c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.308+0000 7fada3800640 1 --2- 172.21.15.18:0/2839358677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad9c109120 0x7fad9c19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.308+0000 7fada3800640 1 --2- 172.21.15.18:0/2839358677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad9c1049a0 0x7fad9c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.308+0000 7fada3800640 1 --2- 172.21.15.18:0/2839358677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad9c103ff0 0x7fad9c19a670 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:41.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.308+0000 7fada3800640 1 -- 172.21.15.18:0/2839358677 >> 172.21.15.18:0/2839358677 conn(0x7fad9c0ffa90 msgr2=0x7fad9c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:41.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.308+0000 7fada3800640 1 -- 172.21.15.18:0/2839358677 shutdown_connections 2024-09-12T02:46:41.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:41.309+0000 7fada3800640 1 -- 172.21.15.18:0/2839358677 wait complete. 2024-09-12T02:46:41.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:41 smithi176 ceph-mon[35713]: pgmap v341: 129 pgs: 129 active+clean; 593 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.8 KiB/s wr, 20 op/s 2024-09-12T02:46:41.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:41 smithi176 ceph-mon[35713]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:46:42.000 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:41 smithi018 ceph-mon[30616]: pgmap v341: 129 pgs: 129 active+clean; 593 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.8 KiB/s wr, 20 op/s 2024-09-12T02:46:42.000 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:41 smithi018 ceph-mon[30616]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:46:42.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:41 smithi062 ceph-mon[35527]: pgmap v341: 129 pgs: 129 active+clean; 593 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.8 KiB/s wr, 20 op/s 2024-09-12T02:46:42.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:41 smithi062 ceph-mon[35527]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:46:42.244 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-12T02:46:42.643 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:42.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:42 smithi176 ceph-mon[35713]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-12T02:46:43.014 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:42 smithi018 ceph-mon[30616]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-12T02:46:43.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:42 smithi062 ceph-mon[35527]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-12T02:46:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.283+0000 7fe8e7a00640 1 -- 172.21.15.18:0/144731241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0077040 msgr2=0x7fe8e01124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.283+0000 7fe8e7a00640 1 --2- 172.21.15.18:0/144731241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0077040 0x7fe8e01124f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009860 tx=0x7fe8c802a340 comp rx=0 tx=0).stop 2024-09-12T02:46:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.283+0000 7fe8e7a00640 1 -- 172.21.15.18:0/144731241 shutdown_connections 2024-09-12T02:46:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.283+0000 7fe8e7a00640 1 --2- 172.21.15.18:0/144731241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8e0112a30 0x7fe8e0114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.283+0000 7fe8e7a00640 1 --2- 172.21.15.18:0/144731241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0077040 0x7fe8e01124f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.283+0000 7fe8e7a00640 1 --2- 172.21.15.18:0/144731241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8e0076720 0x7fe8e0076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.283+0000 7fe8e7a00640 1 -- 172.21.15.18:0/144731241 >> 172.21.15.18:0/144731241 conn(0x7fe8e00ffa90 msgr2=0x7fe8e0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.283+0000 7fe8e7a00640 1 -- 172.21.15.18:0/144731241 shutdown_connections 2024-09-12T02:46:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.283+0000 7fe8e7a00640 1 -- 172.21.15.18:0/144731241 wait complete. 2024-09-12T02:46:43.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.284+0000 7fe8e7a00640 1 Processor -- start 2024-09-12T02:46:43.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.285+0000 7fe8e7a00640 1 -- start start 2024-09-12T02:46:43.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.285+0000 7fe8e7a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8e0076720 0x7fe8e01a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.285+0000 7fe8e7a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0077040 0x7fe8e01a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.285+0000 7fe8e7a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8e0112a30 0x7fe8e019e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.285+0000 7fe8e7a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e01185a0 con 0x7fe8e0077040 2024-09-12T02:46:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.285+0000 7fe8e7a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e0118420 con 0x7fe8e0112a30 2024-09-12T02:46:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.285+0000 7fe8e7a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e0118720 con 0x7fe8e0076720 2024-09-12T02:46:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.285+0000 7fe8e5000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8e0076720 0x7fe8e01a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.285+0000 7fe8d7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0077040 0x7fe8e01a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.285+0000 7fe8e5000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8e0076720 0x7fe8e01a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:56544/0 (socket says 172.21.15.18:56544) 2024-09-12T02:46:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.285+0000 7fe8e5000640 1 -- 172.21.15.18:0/2645456512 learned_addr learned my addr 172.21.15.18:0/2645456512 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.285+0000 7fe8e5a00640 1 --2- 172.21.15.18:0/2645456512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8e0112a30 0x7fe8e019e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.286+0000 7fe8e5000640 1 -- 172.21.15.18:0/2645456512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8e0112a30 msgr2=0x7fe8e019e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.286+0000 7fe8e5000640 1 --2- 172.21.15.18:0/2645456512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8e0112a30 0x7fe8e019e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.286+0000 7fe8e5000640 1 -- 172.21.15.18:0/2645456512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0077040 msgr2=0x7fe8e01a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.286+0000 7fe8e5000640 1 --2- 172.21.15.18:0/2645456512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0077040 0x7fe8e01a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.286+0000 7fe8e5000640 1 -- 172.21.15.18:0/2645456512 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e019efe0 con 0x7fe8e0076720 2024-09-12T02:46:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.286+0000 7fe8d7e00640 1 --2- 172.21.15.18:0/2645456512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0077040 0x7fe8e01a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.286+0000 7fe8e5a00640 1 --2- 172.21.15.18:0/2645456512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8e0112a30 0x7fe8e019e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.286+0000 7fe8e5000640 1 --2- 172.21.15.18:0/2645456512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8e0076720 0x7fe8e01a46f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000e9c0 tx=0x7fe8d000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.286+0000 7fe8de000640 1 -- 172.21.15.18:0/2645456512 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d000cde0 con 0x7fe8e0076720 2024-09-12T02:46:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.287+0000 7fe8e7a00640 1 -- 172.21.15.18:0/2645456512 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e019f2d0 con 0x7fe8e0076720 2024-09-12T02:46:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.287+0000 7fe8de000640 1 -- 172.21.15.18:0/2645456512 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8d00035f0 con 0x7fe8e0076720 2024-09-12T02:46:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.287+0000 7fe8de000640 1 -- 172.21.15.18:0/2645456512 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0010690 con 0x7fe8e0076720 2024-09-12T02:46:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.287+0000 7fe8e7a00640 1 -- 172.21.15.18:0/2645456512 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e01ab5c0 con 0x7fe8e0076720 2024-09-12T02:46:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.288+0000 7fe8e7a00640 1 -- 172.21.15.18:0/2645456512 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e0076b00 con 0x7fe8e0076720 2024-09-12T02:46:43.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.290+0000 7fe8de000640 1 -- 172.21.15.18:0/2645456512 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe8d00037a0 con 0x7fe8e0076720 2024-09-12T02:46:43.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.291+0000 7fe8de000640 1 --2- 172.21.15.18:0/2645456512 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe8c40a2c10 0x7fe8c40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:43.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.291+0000 7fe8de000640 1 -- 172.21.15.18:0/2645456512 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7fe8d00cf8a0 con 0x7fe8e0076720 2024-09-12T02:46:43.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.291+0000 7fe8d7e00640 1 --2- 172.21.15.18:0/2645456512 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe8c40a2c10 0x7fe8c40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:43.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.292+0000 7fe8d7e00640 1 --2- 172.21.15.18:0/2645456512 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe8c40a2c10 0x7fe8c40a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe8c802a930 tx=0x7fe8c80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.293+0000 7fe8de000640 1 -- 172.21.15.18:0/2645456512 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe8d009c2e0 con 0x7fe8e0076720 2024-09-12T02:46:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.508+0000 7fe8e7a00640 1 -- 172.21.15.18:0/2645456512 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fe8e0062630 con 0x7fe8c40a2c10 2024-09-12T02:46:43.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.514+0000 7fe8de000640 1 -- 172.21.15.18:0/2645456512 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fe8e0062630 con 0x7fe8c40a2c10 2024-09-12T02:46:43.514 INFO:teuthology.orchestra.run.smithi018.stdout:/volumes/qa/sv_0/6c5bf4ad-93c4-4833-9657-ef23c20cedd0 2024-09-12T02:46:43.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.516+0000 7fe8e7a00640 1 -- 172.21.15.18:0/2645456512 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe8c40a2c10 msgr2=0x7fe8c40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.516+0000 7fe8e7a00640 1 --2- 172.21.15.18:0/2645456512 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe8c40a2c10 0x7fe8c40a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe8c802a930 tx=0x7fe8c80058d0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.516+0000 7fe8e7a00640 1 -- 172.21.15.18:0/2645456512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8e0076720 msgr2=0x7fe8e01a46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:43.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.516+0000 7fe8e7a00640 1 --2- 172.21.15.18:0/2645456512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8e0076720 0x7fe8e01a46f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000e9c0 tx=0x7fe8d000ee80 comp rx=0 tx=0).stop 2024-09-12T02:46:43.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.516+0000 7fe8e7a00640 1 -- 172.21.15.18:0/2645456512 shutdown_connections 2024-09-12T02:46:43.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.516+0000 7fe8e7a00640 1 --2- 172.21.15.18:0/2645456512 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe8c40a2c10 0x7fe8c40a50d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.516+0000 7fe8e7a00640 1 --2- 172.21.15.18:0/2645456512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8e0112a30 0x7fe8e019e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.516+0000 7fe8e7a00640 1 --2- 172.21.15.18:0/2645456512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0077040 0x7fe8e01a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.516+0000 7fe8e7a00640 1 --2- 172.21.15.18:0/2645456512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8e0076720 0x7fe8e01a46f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:43.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.517+0000 7fe8e7a00640 1 -- 172.21.15.18:0/2645456512 >> 172.21.15.18:0/2645456512 conn(0x7fe8e00ffa90 msgr2=0x7fe8e0101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:43.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.517+0000 7fe8e7a00640 1 -- 172.21.15.18:0/2645456512 shutdown_connections 2024-09-12T02:46:43.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:43.517+0000 7fe8e7a00640 1 -- 172.21.15.18:0/2645456512 wait complete. 2024-09-12T02:46:43.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:43 smithi018 ceph-mon[30616]: pgmap v342: 129 pgs: 129 active+clean; 594 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-09-12T02:46:43.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:43 smithi018 ceph-mon[30616]: from='client.24709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:46:43.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:43 smithi176 ceph-mon[35713]: pgmap v342: 129 pgs: 129 active+clean; 594 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-09-12T02:46:43.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:43 smithi176 ceph-mon[35713]: from='client.24709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:46:44.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:43 smithi062 ceph-mon[35527]: pgmap v342: 129 pgs: 129 active+clean; 594 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-09-12T02:46:44.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:43 smithi062 ceph-mon[35527]: from='client.24709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:46:44.543 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-12T02:46:44.928 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:45.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.525+0000 7f4720600640 1 -- 172.21.15.18:0/4066378827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4718077040 msgr2=0x7f47181124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:45.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.525+0000 7f4720600640 1 --2- 172.21.15.18:0/4066378827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4718077040 0x7f47181124f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4704009900 tx=0x7f470402a410 comp rx=0 tx=0).stop 2024-09-12T02:46:45.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.525+0000 7f4720600640 1 -- 172.21.15.18:0/4066378827 shutdown_connections 2024-09-12T02:46:45.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.525+0000 7f4720600640 1 --2- 172.21.15.18:0/4066378827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4718112a30 0x7f4718114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.525+0000 7f4720600640 1 --2- 172.21.15.18:0/4066378827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4718077040 0x7f47181124f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.525+0000 7f4720600640 1 --2- 172.21.15.18:0/4066378827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4718076720 0x7f4718076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.525+0000 7f4720600640 1 -- 172.21.15.18:0/4066378827 >> 172.21.15.18:0/4066378827 conn(0x7f47180ffa90 msgr2=0x7f4718101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:45.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.526+0000 7f4720600640 1 -- 172.21.15.18:0/4066378827 shutdown_connections 2024-09-12T02:46:45.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.526+0000 7f4720600640 1 -- 172.21.15.18:0/4066378827 wait complete. 2024-09-12T02:46:45.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.527+0000 7f4720600640 1 Processor -- start 2024-09-12T02:46:45.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.527+0000 7f4720600640 1 -- start start 2024-09-12T02:46:45.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.527+0000 7f4720600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4718076720 0x7f47181a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.527+0000 7f4720600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4718077040 0x7f47181a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.527+0000 7f4720600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4718112a30 0x7f471819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.527+0000 7f4720600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f47181185a0 con 0x7f4718077040 2024-09-12T02:46:45.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.527+0000 7f4720600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4718118420 con 0x7f4718076720 2024-09-12T02:46:45.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.527+0000 7f4720600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4718118720 con 0x7f4718112a30 2024-09-12T02:46:45.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.528+0000 7f471d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4718077040 0x7f47181a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.528+0000 7f471d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4718077040 0x7f47181a4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38236/0 (socket says 172.21.15.18:38236) 2024-09-12T02:46:45.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.528+0000 7f471d200640 1 -- 172.21.15.18:0/2301431566 learned_addr learned my addr 172.21.15.18:0/2301431566 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:45.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.528+0000 7f471dc00640 1 --2- 172.21.15.18:0/2301431566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4718076720 0x7f47181a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.528+0000 7f471e600640 1 --2- 172.21.15.18:0/2301431566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4718112a30 0x7f471819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.528+0000 7f471dc00640 1 -- 172.21.15.18:0/2301431566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4718112a30 msgr2=0x7f471819e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:45.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.528+0000 7f471dc00640 1 --2- 172.21.15.18:0/2301431566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4718112a30 0x7f471819e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.528+0000 7f471dc00640 1 -- 172.21.15.18:0/2301431566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4718077040 msgr2=0x7f47181a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:45.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.528+0000 7f471dc00640 1 --2- 172.21.15.18:0/2301431566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4718077040 0x7f47181a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.528+0000 7f471dc00640 1 -- 172.21.15.18:0/2301431566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f471819f000 con 0x7f4718076720 2024-09-12T02:46:45.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.529+0000 7f471dc00640 1 --2- 172.21.15.18:0/2301431566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4718076720 0x7f47181a4710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f470c00e9f0 tx=0x7f470c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:45.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.529+0000 7f4716000640 1 -- 172.21.15.18:0/2301431566 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c00ccc0 con 0x7f4718076720 2024-09-12T02:46:45.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.529+0000 7f4720600640 1 -- 172.21.15.18:0/2301431566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f471819f2f0 con 0x7f4718076720 2024-09-12T02:46:45.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.529+0000 7f4716000640 1 -- 172.21.15.18:0/2301431566 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f470c010910 con 0x7f4718076720 2024-09-12T02:46:45.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.529+0000 7f4716000640 1 -- 172.21.15.18:0/2301431566 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c018960 con 0x7f4718076720 2024-09-12T02:46:45.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.529+0000 7f4720600640 1 -- 172.21.15.18:0/2301431566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47181ab5e0 con 0x7f4718076720 2024-09-12T02:46:45.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.530+0000 7f4720600640 1 -- 172.21.15.18:0/2301431566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4718076b00 con 0x7f4718076720 2024-09-12T02:46:45.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.532+0000 7f4716000640 1 -- 172.21.15.18:0/2301431566 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f470c010ac0 con 0x7f4718076720 2024-09-12T02:46:45.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.533+0000 7f4716000640 1 --2- 172.21.15.18:0/2301431566 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47000a2c10 0x7f47000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:45.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.533+0000 7f4716000640 1 -- 172.21.15.18:0/2301431566 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7f470c0cf920 con 0x7f4718076720 2024-09-12T02:46:45.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.534+0000 7f471d200640 1 --2- 172.21.15.18:0/2301431566 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47000a2c10 0x7f47000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:45.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.534+0000 7f471d200640 1 --2- 172.21.15.18:0/2301431566 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47000a2c10 0x7f47000a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f47180793e0 tx=0x7f4704005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:45.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.538+0000 7f4716000640 1 -- 172.21.15.18:0/2301431566 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f470c09bd10 con 0x7f4718076720 2024-09-12T02:46:45.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.752+0000 7f4720600640 1 -- 172.21.15.18:0/2301431566 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f4718062630 con 0x7f47000a2c10 2024-09-12T02:46:45.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.778+0000 7f4716000640 1 -- 172.21.15.18:0/2301431566 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4718062630 con 0x7f47000a2c10 2024-09-12T02:46:45.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.781+0000 7f4720600640 1 -- 172.21.15.18:0/2301431566 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47000a2c10 msgr2=0x7f47000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:45.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.781+0000 7f4720600640 1 --2- 172.21.15.18:0/2301431566 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47000a2c10 0x7f47000a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f47180793e0 tx=0x7f4704005a20 comp rx=0 tx=0).stop 2024-09-12T02:46:45.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.781+0000 7f4720600640 1 -- 172.21.15.18:0/2301431566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4718076720 msgr2=0x7f47181a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:45.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.781+0000 7f4720600640 1 --2- 172.21.15.18:0/2301431566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4718076720 0x7f47181a4710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f470c00e9f0 tx=0x7f470c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.781+0000 7f4720600640 1 -- 172.21.15.18:0/2301431566 shutdown_connections 2024-09-12T02:46:45.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.781+0000 7f4720600640 1 --2- 172.21.15.18:0/2301431566 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47000a2c10 0x7f47000a50d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.781+0000 7f4720600640 1 --2- 172.21.15.18:0/2301431566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4718112a30 0x7f471819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.781+0000 7f4720600640 1 --2- 172.21.15.18:0/2301431566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4718077040 0x7f47181a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.781+0000 7f4720600640 1 --2- 172.21.15.18:0/2301431566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4718076720 0x7f47181a4710 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.781+0000 7f4720600640 1 -- 172.21.15.18:0/2301431566 >> 172.21.15.18:0/2301431566 conn(0x7f47180ffa90 msgr2=0x7f4718101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.781+0000 7f4720600640 1 -- 172.21.15.18:0/2301431566 shutdown_connections 2024-09-12T02:46:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:45.781+0000 7f4720600640 1 -- 172.21.15.18:0/2301431566 wait complete. 2024-09-12T02:46:45.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:45 smithi176 ceph-mon[35713]: pgmap v343: 129 pgs: 129 active+clean; 612 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.0 KiB/s wr, 22 op/s 2024-09-12T02:46:46.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:45 smithi062 ceph-mon[35527]: pgmap v343: 129 pgs: 129 active+clean; 612 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.0 KiB/s wr, 22 op/s 2024-09-12T02:46:46.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:45 smithi018 ceph-mon[30616]: pgmap v343: 129 pgs: 129 active+clean; 612 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.0 KiB/s wr, 22 op/s 2024-09-12T02:46:46.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:46 smithi018 ceph-mon[30616]: from='client.24716 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:46:46.912 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-12T02:46:46.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:46 smithi176 ceph-mon[35713]: from='client.24716 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:46:47.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:46 smithi062 ceph-mon[35527]: from='client.24716 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:46:47.293 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:47.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:47 smithi176 ceph-mon[35713]: pgmap v344: 129 pgs: 129 active+clean; 612 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.9 KiB/s wr, 18 op/s 2024-09-12T02:46:48.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:47 smithi062 ceph-mon[35527]: pgmap v344: 129 pgs: 129 active+clean; 612 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.9 KiB/s wr, 18 op/s 2024-09-12T02:46:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.926+0000 7ffac6c00640 1 -- 172.21.15.18:0/3310735705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffac0076720 msgr2=0x7ffac0076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.926+0000 7ffac6c00640 1 --2- 172.21.15.18:0/3310735705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffac0076720 0x7ffac0076b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009900 tx=0x7ffab002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.926+0000 7ffac6c00640 1 -- 172.21.15.18:0/3310735705 shutdown_connections 2024-09-12T02:46:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.926+0000 7ffac6c00640 1 --2- 172.21.15.18:0/3310735705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffac0112a50 0x7ffac0114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.926+0000 7ffac6c00640 1 --2- 172.21.15.18:0/3310735705 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffac0077040 0x7ffac0112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.926+0000 7ffac6c00640 1 --2- 172.21.15.18:0/3310735705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffac0076720 0x7ffac0076b00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.926+0000 7ffac6c00640 1 -- 172.21.15.18:0/3310735705 >> 172.21.15.18:0/3310735705 conn(0x7ffac00ffa50 msgr2=0x7ffac0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.927+0000 7ffac6c00640 1 -- 172.21.15.18:0/3310735705 shutdown_connections 2024-09-12T02:46:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.927+0000 7ffac6c00640 1 -- 172.21.15.18:0/3310735705 wait complete. 2024-09-12T02:46:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.928+0000 7ffac6c00640 1 Processor -- start 2024-09-12T02:46:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.928+0000 7ffac6c00640 1 -- start start 2024-09-12T02:46:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.928+0000 7ffac6c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffac0076720 0x7ffac01a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.929+0000 7ffac6c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffac0077040 0x7ffac01a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.929+0000 7ffac6c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffac0112a50 0x7ffac019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.929+0000 7ffac6c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffac0118610 con 0x7ffac0076720 2024-09-12T02:46:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.929+0000 7ffac6c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffac0118490 con 0x7ffac0112a50 2024-09-12T02:46:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.929+0000 7ffac6c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffac0118790 con 0x7ffac0077040 2024-09-12T02:46:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.929+0000 7ffabfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffac0076720 0x7ffac01a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.929+0000 7ffabfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffac0076720 0x7ffac01a4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38250/0 (socket says 172.21.15.18:38250) 2024-09-12T02:46:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.929+0000 7ffabfe00640 1 -- 172.21.15.18:0/3747457003 learned_addr learned my addr 172.21.15.18:0/3747457003 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.929+0000 7ffab7e00640 1 --2- 172.21.15.18:0/3747457003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffac0077040 0x7ffac01a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.929+0000 7ffac4c00640 1 --2- 172.21.15.18:0/3747457003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffac0112a50 0x7ffac019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.929+0000 7ffabfe00640 1 -- 172.21.15.18:0/3747457003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffac0077040 msgr2=0x7ffac01a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.929+0000 7ffabfe00640 1 --2- 172.21.15.18:0/3747457003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffac0077040 0x7ffac01a4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.929+0000 7ffabfe00640 1 -- 172.21.15.18:0/3747457003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffac0112a50 msgr2=0x7ffac019e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.929+0000 7ffabfe00640 1 --2- 172.21.15.18:0/3747457003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffac0112a50 0x7ffac019e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.929+0000 7ffabfe00640 1 -- 172.21.15.18:0/3747457003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac019f050 con 0x7ffac0076720 2024-09-12T02:46:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.930+0000 7ffabfe00640 1 --2- 172.21.15.18:0/3747457003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffac0076720 0x7ffac01a4760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffab0004770 tx=0x7ffab0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.930+0000 7ffabd600640 1 -- 172.21.15.18:0/3747457003 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab003f070 con 0x7ffac0076720 2024-09-12T02:46:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.930+0000 7ffabd600640 1 -- 172.21.15.18:0/3747457003 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffab0031ca0 con 0x7ffac0076720 2024-09-12T02:46:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.930+0000 7ffac6c00640 1 -- 172.21.15.18:0/3747457003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac019f2e0 con 0x7ffac0076720 2024-09-12T02:46:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.930+0000 7ffabd600640 1 -- 172.21.15.18:0/3747457003 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab0035030 con 0x7ffac0076720 2024-09-12T02:46:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.930+0000 7ffac6c00640 1 -- 172.21.15.18:0/3747457003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac01ab630 con 0x7ffac0076720 2024-09-12T02:46:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.931+0000 7ffac6c00640 1 -- 172.21.15.18:0/3747457003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffac0076b00 con 0x7ffac0076720 2024-09-12T02:46:48.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.933+0000 7ffabd600640 1 -- 172.21.15.18:0/3747457003 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ffab0042070 con 0x7ffac0076720 2024-09-12T02:46:48.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.934+0000 7ffabd600640 1 --2- 172.21.15.18:0/3747457003 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ffaa40a2c10 0x7ffaa40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:48.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.935+0000 7ffabd600640 1 -- 172.21.15.18:0/3747457003 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7ffab00f0070 con 0x7ffac0076720 2024-09-12T02:46:48.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.935+0000 7ffab7e00640 1 --2- 172.21.15.18:0/3747457003 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ffaa40a2c10 0x7ffaa40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:48.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.935+0000 7ffab7e00640 1 --2- 172.21.15.18:0/3747457003 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ffaa40a2c10 0x7ffaa40a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffac01035f0 tx=0x7ffaa800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:48.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:47.937+0000 7ffabd600640 1 -- 172.21.15.18:0/3747457003 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffab00bc570 con 0x7ffac0076720 2024-09-12T02:46:48.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:47 smithi018 ceph-mon[30616]: pgmap v344: 129 pgs: 129 active+clean; 612 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.9 KiB/s wr, 18 op/s 2024-09-12T02:46:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:48.150+0000 7ffac6c00640 1 -- 172.21.15.18:0/3747457003 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7ffac01146c0 con 0x7ffaa40a2c10 2024-09-12T02:46:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:48.155+0000 7ffabd600640 1 -- 172.21.15.18:0/3747457003 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7ffac01146c0 con 0x7ffaa40a2c10 2024-09-12T02:46:48.155 INFO:teuthology.orchestra.run.smithi018.stdout:/volumes/qa/sv_1/86abb46b-ee82-4fa9-8957-2a3152e4d864 2024-09-12T02:46:48.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:48.157+0000 7ffac6c00640 1 -- 172.21.15.18:0/3747457003 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ffaa40a2c10 msgr2=0x7ffaa40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:48.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:48.157+0000 7ffac6c00640 1 --2- 172.21.15.18:0/3747457003 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ffaa40a2c10 0x7ffaa40a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffac01035f0 tx=0x7ffaa800b390 comp rx=0 tx=0).stop 2024-09-12T02:46:48.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:48.157+0000 7ffac6c00640 1 -- 172.21.15.18:0/3747457003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffac0076720 msgr2=0x7ffac01a4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:48.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:48.157+0000 7ffac6c00640 1 --2- 172.21.15.18:0/3747457003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffac0076720 0x7ffac01a4760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffab0004770 tx=0x7ffab0003c10 comp rx=0 tx=0).stop 2024-09-12T02:46:48.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:48.157+0000 7ffac6c00640 1 -- 172.21.15.18:0/3747457003 shutdown_connections 2024-09-12T02:46:48.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:48.157+0000 7ffac6c00640 1 --2- 172.21.15.18:0/3747457003 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ffaa40a2c10 0x7ffaa40a50d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:48.157+0000 7ffac6c00640 1 --2- 172.21.15.18:0/3747457003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffac0112a50 0x7ffac019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:48.157+0000 7ffac6c00640 1 --2- 172.21.15.18:0/3747457003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffac0077040 0x7ffac01a4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:48.157+0000 7ffac6c00640 1 --2- 172.21.15.18:0/3747457003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffac0076720 0x7ffac01a4760 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:48.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:48.157+0000 7ffac6c00640 1 -- 172.21.15.18:0/3747457003 >> 172.21.15.18:0/3747457003 conn(0x7ffac00ffa50 msgr2=0x7ffac0101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:48.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:48.158+0000 7ffac6c00640 1 -- 172.21.15.18:0/3747457003 shutdown_connections 2024-09-12T02:46:48.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:48.158+0000 7ffac6c00640 1 -- 172.21.15.18:0/3747457003 wait complete. 2024-09-12T02:46:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:48 smithi018 ceph-mon[30616]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:46:48.940 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:46:48.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:48 smithi176 ceph-mon[35713]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:46:49.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:48 smithi062 ceph-mon[35527]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:46:49.318 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.912+0000 7f4b1e400640 1 -- 172.21.15.18:0/3961578030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b18074620 msgr2=0x7f4b18074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.912+0000 7f4b1e400640 1 --2- 172.21.15.18:0/3961578030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b18074620 0x7f4b18074a00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009ca0 tx=0x7f4b0802a950 comp rx=0 tx=0).stop 2024-09-12T02:46:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.912+0000 7f4b1e400640 1 -- 172.21.15.18:0/3961578030 shutdown_connections 2024-09-12T02:46:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.912+0000 7f4b1e400640 1 --2- 172.21.15.18:0/3961578030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b1810e3c0 0x7f4b18110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.912+0000 7f4b1e400640 1 --2- 172.21.15.18:0/3961578030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b18074f40 0x7f4b1810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.912+0000 7f4b1e400640 1 --2- 172.21.15.18:0/3961578030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b18074620 0x7f4b18074a00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.912+0000 7f4b1e400640 1 -- 172.21.15.18:0/3961578030 >> 172.21.15.18:0/3961578030 conn(0x7f4b180fd8c0 msgr2=0x7f4b180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.912+0000 7f4b1e400640 1 -- 172.21.15.18:0/3961578030 shutdown_connections 2024-09-12T02:46:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.912+0000 7f4b1e400640 1 -- 172.21.15.18:0/3961578030 wait complete. 2024-09-12T02:46:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.913+0000 7f4b1e400640 1 Processor -- start 2024-09-12T02:46:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.913+0000 7f4b1e400640 1 -- start start 2024-09-12T02:46:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.914+0000 7f4b1e400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b18074620 0x7f4b1819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.914+0000 7f4b1e400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b18074f40 0x7f4b1819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.914+0000 7f4b1e400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b1810e3c0 0x7f4b1819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.914+0000 7f4b1e400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4b181141a0 con 0x7f4b18074f40 2024-09-12T02:46:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.914+0000 7f4b1e400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4b18114020 con 0x7f4b18074620 2024-09-12T02:46:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.914+0000 7f4b1e400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4b18114320 con 0x7f4b1810e3c0 2024-09-12T02:46:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.914+0000 7f4b17400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b18074620 0x7f4b1819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.914+0000 7f4b17400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b18074620 0x7f4b1819a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:48474/0 (socket says 172.21.15.18:48474) 2024-09-12T02:46:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.914+0000 7f4b17400640 1 -- 172.21.15.18:0/3680942528 learned_addr learned my addr 172.21.15.18:0/3680942528 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.914+0000 7f4b0ea00640 1 --2- 172.21.15.18:0/3680942528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b18074f40 0x7f4b1819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.914+0000 7f4b17e00640 1 --2- 172.21.15.18:0/3680942528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b1810e3c0 0x7f4b1819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.915+0000 7f4b17400640 1 -- 172.21.15.18:0/3680942528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b1810e3c0 msgr2=0x7f4b1819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.915+0000 7f4b17400640 1 --2- 172.21.15.18:0/3680942528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b1810e3c0 0x7f4b1819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.915+0000 7f4b17400640 1 -- 172.21.15.18:0/3680942528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b18074f40 msgr2=0x7f4b1819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.915+0000 7f4b17400640 1 --2- 172.21.15.18:0/3680942528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b18074f40 0x7f4b1819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.915+0000 7f4b17400640 1 -- 172.21.15.18:0/3680942528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1819f5f0 con 0x7f4b18074620 2024-09-12T02:46:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.915+0000 7f4b17400640 1 --2- 172.21.15.18:0/3680942528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b18074620 0x7f4b1819a640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b08005e30 tx=0x7f4b08003c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.915+0000 7f4b14c00640 1 -- 172.21.15.18:0/3680942528 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b08034040 con 0x7f4b18074620 2024-09-12T02:46:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.915+0000 7f4b1e400640 1 -- 172.21.15.18:0/3680942528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b1819f880 con 0x7f4b18074620 2024-09-12T02:46:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.915+0000 7f4b14c00640 1 -- 172.21.15.18:0/3680942528 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b0802fe20 con 0x7f4b18074620 2024-09-12T02:46:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.915+0000 7f4b14c00640 1 -- 172.21.15.18:0/3680942528 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b080047c0 con 0x7f4b18074620 2024-09-12T02:46:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.915+0000 7f4b1e400640 1 -- 172.21.15.18:0/3680942528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b181a71c0 con 0x7f4b18074620 2024-09-12T02:46:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.916+0000 7f4b1e400640 1 -- 172.21.15.18:0/3680942528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b18074a00 con 0x7f4b18074620 2024-09-12T02:46:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.918+0000 7f4b14c00640 1 -- 172.21.15.18:0/3680942528 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4b08037020 con 0x7f4b18074620 2024-09-12T02:46:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.919+0000 7f4b14c00640 1 --2- 172.21.15.18:0/3680942528 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4afc0a2c90 0x7f4afc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:49.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.920+0000 7f4b14c00640 1 -- 172.21.15.18:0/3680942528 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7f4b080f0280 con 0x7f4b18074620 2024-09-12T02:46:49.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.920+0000 7f4b0ea00640 1 --2- 172.21.15.18:0/3680942528 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4afc0a2c90 0x7f4afc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:49.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.920+0000 7f4b0ea00640 1 --2- 172.21.15.18:0/3680942528 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4afc0a2c90 0x7f4afc0a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4b1810f7b0 tx=0x7f4b00005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:49.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:49.924+0000 7f4b14c00640 1 -- 172.21.15.18:0/3680942528 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b080bcdd0 con 0x7f4b18074620 2024-09-12T02:46:49.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:49 smithi176 ceph-mon[35713]: pgmap v345: 129 pgs: 129 active+clean; 612 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.6 KiB/s wr, 15 op/s 2024-09-12T02:46:50.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:49 smithi062 ceph-mon[35527]: pgmap v345: 129 pgs: 129 active+clean; 612 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.6 KiB/s wr, 15 op/s 2024-09-12T02:46:50.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:49 smithi018 ceph-mon[30616]: pgmap v345: 129 pgs: 129 active+clean; 612 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.6 KiB/s wr, 15 op/s 2024-09-12T02:46:50.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:50.145+0000 7f4b1e400640 1 -- 172.21.15.18:0/3680942528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b18109540 con 0x7f4b18074620 2024-09-12T02:46:50.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:50.146+0000 7f4b14c00640 1 -- 172.21.15.18:0/3680942528 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11966 (secure 0 0 0) 0x7f4b080bc6d0 con 0x7f4b18074620 2024-09-12T02:46:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:46:50.148 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"btime":"2024-09-12T02:46:36:660732+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/747069368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":747069368},{"type":"v1","addr":"172.21.15.18:6837","nonce":747069368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/4056752027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4056752027},{"type":"v1","addr":"172.21.15.18:6839","nonce":4056752027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:45:36.564696+0000","modified":"2024-09-12T02:46:35.796320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24527,"mds_1":24526,"mds_2":24508,"mds_3":24493,"mds_4":24488},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/43234729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":43234729},{"type":"v1","addr":"172.21.15.18:6835","nonce":43234729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6835/564392030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":564392030},{"type":"v1","addr":"172.21.15.62:6835","nonce":564392030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6835/3199321182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3199321182},{"type":"v1","addr":"172.21.15.176:6835","nonce":3199321182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.62:6837/3520593627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3520593627},{"type":"v1","addr":"172.21.15.62:6837","nonce":3520593627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":23,"addr":"172.21.15.176:6837/4286557016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4286557016},{"type":"v1","addr":"172.21.15.176:6837","nonce":4286557016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.176:6839/3957634398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":3957634398},{"type":"v1","addr":"172.21.15.176:6839","nonce":3957634398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"a","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.18:6841/823308007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":823308007},{"type":"v1","addr":"172.21.15.18:6841","nonce":823308007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/3744347102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3744347102},{"type":"v1","addr":"172.21.15.62:6839","nonce":3744347102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24488,24527,24493,24508,24526]},"id":1}]} 2024-09-12T02:46:50.148 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 29 2024-09-12T02:46:50.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:50.149+0000 7f4b1e400640 1 -- 172.21.15.18:0/3680942528 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4afc0a2c90 msgr2=0x7f4afc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:50.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:50.149+0000 7f4b1e400640 1 --2- 172.21.15.18:0/3680942528 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4afc0a2c90 0x7f4afc0a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4b1810f7b0 tx=0x7f4b00005f90 comp rx=0 tx=0).stop 2024-09-12T02:46:50.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:50.149+0000 7f4b1e400640 1 -- 172.21.15.18:0/3680942528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b18074620 msgr2=0x7f4b1819a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:50.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:50.149+0000 7f4b1e400640 1 --2- 172.21.15.18:0/3680942528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b18074620 0x7f4b1819a640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b08005e30 tx=0x7f4b08003c90 comp rx=0 tx=0).stop 2024-09-12T02:46:50.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:50.149+0000 7f4b1e400640 1 -- 172.21.15.18:0/3680942528 shutdown_connections 2024-09-12T02:46:50.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:50.149+0000 7f4b1e400640 1 --2- 172.21.15.18:0/3680942528 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4afc0a2c90 0x7f4afc0a5150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:50.149+0000 7f4b1e400640 1 --2- 172.21.15.18:0/3680942528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b1810e3c0 0x7f4b1819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:50.149+0000 7f4b1e400640 1 --2- 172.21.15.18:0/3680942528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b18074f40 0x7f4b1819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:50.149+0000 7f4b1e400640 1 --2- 172.21.15.18:0/3680942528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b18074620 0x7f4b1819a640 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:50.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:50.149+0000 7f4b1e400640 1 -- 172.21.15.18:0/3680942528 >> 172.21.15.18:0/3680942528 conn(0x7f4b180fd8c0 msgr2=0x7f4b180fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:50.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:50.149+0000 7f4b1e400640 1 -- 172.21.15.18:0/3680942528 shutdown_connections 2024-09-12T02:46:50.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:50.149+0000 7f4b1e400640 1 -- 172.21.15.18:0/3680942528 wait complete. 2024-09-12T02:46:50.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:50 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3680942528' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:50.943 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:46:50.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:50 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3680942528' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:51.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:50 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3680942528' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:46:51.320 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:51.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.879+0000 7f4662800640 1 -- 172.21.15.18:0/4216958679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f465c10bfd0 msgr2=0x7f465c10e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:51.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.879+0000 7f4662800640 1 --2- 172.21.15.18:0/4216958679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f465c10bfd0 0x7f465c10e460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4654009ca0 tx=0x7f465402a940 comp rx=0 tx=0).stop 2024-09-12T02:46:51.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.879+0000 7f4662800640 1 -- 172.21.15.18:0/4216958679 shutdown_connections 2024-09-12T02:46:51.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.879+0000 7f4662800640 1 --2- 172.21.15.18:0/4216958679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f465c10bfd0 0x7f465c10e460 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.879+0000 7f4662800640 1 --2- 172.21.15.18:0/4216958679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f465c103550 0x7f465c10ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.879+0000 7f4662800640 1 --2- 172.21.15.18:0/4216958679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c102c30 0x7f465c103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.879+0000 7f4662800640 1 -- 172.21.15.18:0/4216958679 >> 172.21.15.18:0/4216958679 conn(0x7f465c0fc610 msgr2=0x7f465c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:51.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.879+0000 7f4662800640 1 -- 172.21.15.18:0/4216958679 shutdown_connections 2024-09-12T02:46:51.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.879+0000 7f4662800640 1 -- 172.21.15.18:0/4216958679 wait complete. 2024-09-12T02:46:51.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.880+0000 7f4662800640 1 Processor -- start 2024-09-12T02:46:51.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.881+0000 7f4662800640 1 -- start start 2024-09-12T02:46:51.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.881+0000 7f4662800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f465c102c30 0x7f465c19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.881+0000 7f4662800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c103550 0x7f465c19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.881+0000 7f4662800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f465c10bfd0 0x7f465c19ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.881+0000 7f4662800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f465c111dd0 con 0x7f465c103550 2024-09-12T02:46:51.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.881+0000 7f4662800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f465c111c50 con 0x7f465c10bfd0 2024-09-12T02:46:51.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.881+0000 7f4662800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f465c111f50 con 0x7f465c102c30 2024-09-12T02:46:51.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.881+0000 7f4660a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c103550 0x7f465c19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.881+0000 7f4660a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c103550 0x7f465c19a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38272/0 (socket says 172.21.15.18:38272) 2024-09-12T02:46:51.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.881+0000 7f4660a00640 1 -- 172.21.15.18:0/610087479 learned_addr learned my addr 172.21.15.18:0/610087479 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:51.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.881+0000 7f4661e00640 1 --2- 172.21.15.18:0/610087479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f465c10bfd0 0x7f465c19ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.881+0000 7f4661400640 1 --2- 172.21.15.18:0/610087479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f465c102c30 0x7f465c19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.882+0000 7f4660a00640 1 -- 172.21.15.18:0/610087479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f465c102c30 msgr2=0x7f465c19a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:51.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.882+0000 7f4660a00640 1 --2- 172.21.15.18:0/610087479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f465c102c30 0x7f465c19a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.882+0000 7f4660a00640 1 -- 172.21.15.18:0/610087479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f465c10bfd0 msgr2=0x7f465c19ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:51.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.882+0000 7f4660a00640 1 --2- 172.21.15.18:0/610087479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f465c10bfd0 0x7f465c19ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:51.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.882+0000 7f4660a00640 1 -- 172.21.15.18:0/610087479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c19f3f0 con 0x7f465c103550 2024-09-12T02:46:51.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.882+0000 7f4661e00640 1 --2- 172.21.15.18:0/610087479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f465c10bfd0 0x7f465c19ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.882+0000 7f4660a00640 1 --2- 172.21.15.18:0/610087479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c103550 0x7f465c19a980 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f464800e9f0 tx=0x7f464800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.882+0000 7f465a000640 1 -- 172.21.15.18:0/610087479 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464800cd80 con 0x7f465c103550 2024-09-12T02:46:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.882+0000 7f4662800640 1 -- 172.21.15.18:0/610087479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465c19f6e0 con 0x7f465c103550 2024-09-12T02:46:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.882+0000 7f465a000640 1 -- 172.21.15.18:0/610087479 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4648010910 con 0x7f465c103550 2024-09-12T02:46:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.883+0000 7f4662800640 1 -- 172.21.15.18:0/610087479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f465c1a6fc0 con 0x7f465c103550 2024-09-12T02:46:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.883+0000 7f465a000640 1 -- 172.21.15.18:0/610087479 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4648018930 con 0x7f465c103550 2024-09-12T02:46:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.884+0000 7f4662800640 1 -- 172.21.15.18:0/610087479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f465c103010 con 0x7f465c103550 2024-09-12T02:46:51.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.885+0000 7f465a000640 1 -- 172.21.15.18:0/610087479 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4648010ac0 con 0x7f465c103550 2024-09-12T02:46:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.887+0000 7f465a000640 1 --2- 172.21.15.18:0/610087479 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f46440a2c10 0x7f46440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.887+0000 7f465a000640 1 -- 172.21.15.18:0/610087479 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7f46480cf800 con 0x7f465c103550 2024-09-12T02:46:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.887+0000 7f4661400640 1 --2- 172.21.15.18:0/610087479 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f46440a2c10 0x7f46440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.888+0000 7f4661400640 1 --2- 172.21.15.18:0/610087479 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f46440a2c10 0x7f46440a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f46500095f0 tx=0x7f4650005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:51.891+0000 7f465a000640 1 -- 172.21.15.18:0/610087479 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f464809bbf0 con 0x7f465c103550 2024-09-12T02:46:51.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:51 smithi176 ceph-mon[35713]: pgmap v346: 129 pgs: 129 active+clean; 634 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2024-09-12T02:46:52.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:51 smithi062 ceph-mon[35527]: pgmap v346: 129 pgs: 129 active+clean; 634 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2024-09-12T02:46:52.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:52.079+0000 7f4662800640 1 -- 172.21.15.18:0/610087479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f465c1a71f0 con 0x7f465c103550 2024-09-12T02:46:52.081 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:51 smithi018 ceph-mon[30616]: pgmap v346: 129 pgs: 129 active+clean; 634 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2024-09-12T02:46:52.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:52.080+0000 7f465a000640 1 -- 172.21.15.18:0/610087479 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+24655 (secure 0 0 0) 0x7f464809fef0 con 0x7f465c103550 2024-09-12T02:46:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:46:52.082 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":96,"fsid":"c7666100-70af-11ef-bcea-c7b262605968","created":"2024-09-12T02:37:14.139566+0000","modified":"2024-09-12T02:46:12.546275+0000","last_up_change":"2024-09-12T02:44:37.774835+0000","last_in_change":"2024-09-12T02:44:16.028970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:40:35.157621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:45:31.022530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:45:34.131637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:45:43.992286+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a61ecdc1-ceb9-43cb-a67d-b197888cca42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6803","nonce":2278662522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6805","nonce":2278662522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6809","nonce":2278662522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6807","nonce":2278662522}]},"public_addr":"172.21.15.18:6803/2278662522","cluster_addr":"172.21.15.18:6805/2278662522","heartbeat_back_addr":"172.21.15.18:6809/2278662522","heartbeat_front_addr":"172.21.15.18:6807/2278662522","state":["exists","up"]},{"osd":1,"uuid":"1b84f4be-23ce-466c-b974-b9851521785d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6801","nonce":3139630617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6803","nonce":3139630617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6807","nonce":3139630617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6805","nonce":3139630617}]},"public_addr":"172.21.15.62:6801/3139630617","cluster_addr":"172.21.15.62:6803/3139630617","heartbeat_back_addr":"172.21.15.62:6807/3139630617","heartbeat_front_addr":"172.21.15.62:6805/3139630617","state":["exists","up"]},{"osd":2,"uuid":"f7bdf028-db32-4d92-a039-bada37c3a146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6801","nonce":2704054654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6803","nonce":2704054654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6807","nonce":2704054654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6805","nonce":2704054654}]},"public_addr":"172.21.15.176:6801/2704054654","cluster_addr":"172.21.15.176:6803/2704054654","heartbeat_back_addr":"172.21.15.176:6807/2704054654","heartbeat_front_addr":"172.21.15.176:6805/2704054654","state":["exists","up"]},{"osd":3,"uuid":"39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6811","nonce":3378134261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6813","nonce":3378134261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6817","nonce":3378134261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6815","nonce":3378134261}]},"public_addr":"172.21.15.18:6811/3378134261","cluster_addr":"172.21.15.18:6813/3378134261","heartbeat_back_addr":"172.21.15.18:6817/3378134261","heartbeat_front_addr":"172.21.15.18:6815/3378134261","state":["exists","up"]},{"osd":4,"uuid":"66a2c8a0-1a99-4c6d-b56a-f1f6c3199655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6809","nonce":1416302860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6811","nonce":1416302860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6815","nonce":1416302860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6813","nonce":1416302860}]},"public_addr":"172.21.15.62:6809/1416302860","cluster_addr":"172.21.15.62:6811/1416302860","heartbeat_back_addr":"172.21.15.62:6815/1416302860","heartbeat_front_addr":"172.21.15.62:6813/1416302860","state":["exists","up"]},{"osd":5,"uuid":"c4070ecf-703a-4f5f-9a2b-63473ff7f98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6809","nonce":2234269387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6811","nonce":2234269387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6815","nonce":2234269387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6813","nonce":2234269387}]},"public_addr":"172.21.15.176:6809/2234269387","cluster_addr":"172.21.15.176:6811/2234269387","heartbeat_back_addr":"172.21.15.176:6815/2234269387","heartbeat_front_addr":"172.21.15.176:6813/2234269387","state":["exists","up"]},{"osd":6,"uuid":"12a08874-041e-4734-bc33-68ebfce97b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6819","nonce":3613955982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6821","nonce":3613955982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6825","nonce":3613955982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6823","nonce":3613955982}]},"public_addr":"172.21.15.18:6819/3613955982","cluster_addr":"172.21.15.18:6821/3613955982","heartbeat_back_addr":"172.21.15.18:6825/3613955982","heartbeat_front_addr":"172.21.15.18:6823/3613955982","state":["exists","up"]},{"osd":7,"uuid":"86a5b47c-143f-4848-892f-c7b6a17a2799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6817","nonce":750933013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6819","nonce":750933013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6823","nonce":750933013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6821","nonce":750933013}]},"public_addr":"172.21.15.62:6817/750933013","cluster_addr":"172.21.15.62:6819/750933013","heartbeat_back_addr":"172.21.15.62:6823/750933013","heartbeat_front_addr":"172.21.15.62:6821/750933013","state":["exists","up"]},{"osd":8,"uuid":"0426a455-ed11-4d6a-8e1d-c8aa2ee65cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6817","nonce":8496953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6819","nonce":8496953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6823","nonce":8496953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6821","nonce":8496953}]},"public_addr":"172.21.15.176:6817/8496953","cluster_addr":"172.21.15.176:6819/8496953","heartbeat_back_addr":"172.21.15.176:6823/8496953","heartbeat_front_addr":"172.21.15.176:6821/8496953","state":["exists","up"]},{"osd":9,"uuid":"241aa2cf-0765-465d-b400-4911e653412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6827","nonce":422514390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6829","nonce":422514390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6833","nonce":422514390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6831","nonce":422514390}]},"public_addr":"172.21.15.18:6827/422514390","cluster_addr":"172.21.15.18:6829/422514390","heartbeat_back_addr":"172.21.15.18:6833/422514390","heartbeat_front_addr":"172.21.15.18:6831/422514390","state":["exists","up"]},{"osd":10,"uuid":"b1d4ab1f-0ec4-4641-bab0-f39d15857615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6825","nonce":269877918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6827","nonce":269877918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6831","nonce":269877918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6829","nonce":269877918}]},"public_addr":"172.21.15.62:6825/269877918","cluster_addr":"172.21.15.62:6827/269877918","heartbeat_back_addr":"172.21.15.62:6831/269877918","heartbeat_front_addr":"172.21.15.62:6829/269877918","state":["exists","up"]},{"osd":11,"uuid":"d122f1bf-bd4f-45d5-b07c-7301b005977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6825","nonce":770358485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6827","nonce":770358485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6831","nonce":770358485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6829","nonce":770358485}]},"public_addr":"172.21.15.176:6825/770358485","cluster_addr":"172.21.15.176:6827/770358485","heartbeat_back_addr":"172.21.15.176:6831/770358485","heartbeat_front_addr":"172.21.15.176:6829/770358485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:39:42.435560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:09.100602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:32.884117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:01.733821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:29.812775+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:53.846503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:24.363464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:51.023614+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:15.782652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:45.378178+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:12.469173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:36.303058+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":1,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2679362143":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/4236556151":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6801/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6800/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/1197309398":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/3024661873":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/2429098892":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6801/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6800/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/1531572357":"2024-09-13T02:37:40.790128+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:52.083+0000 7f4662800640 1 -- 172.21.15.18:0/610087479 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f46440a2c10 msgr2=0x7f46440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:52.083+0000 7f4662800640 1 --2- 172.21.15.18:0/610087479 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f46440a2c10 0x7f46440a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f46500095f0 tx=0x7f4650005f90 comp rx=0 tx=0).stop 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:52.083+0000 7f4662800640 1 -- 172.21.15.18:0/610087479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c103550 msgr2=0x7f465c19a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:52.083+0000 7f4662800640 1 --2- 172.21.15.18:0/610087479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c103550 0x7f465c19a980 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f464800e9f0 tx=0x7f464800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:52.083+0000 7f4662800640 1 -- 172.21.15.18:0/610087479 shutdown_connections 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:52.083+0000 7f4662800640 1 --2- 172.21.15.18:0/610087479 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f46440a2c10 0x7f46440a50d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:52.083+0000 7f4662800640 1 --2- 172.21.15.18:0/610087479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f465c10bfd0 0x7f465c19ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:52.083+0000 7f4662800640 1 --2- 172.21.15.18:0/610087479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465c103550 0x7f465c19a980 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:52.083+0000 7f4662800640 1 --2- 172.21.15.18:0/610087479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f465c102c30 0x7f465c19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:52.083+0000 7f4662800640 1 -- 172.21.15.18:0/610087479 >> 172.21.15.18:0/610087479 conn(0x7f465c0fc610 msgr2=0x7f465c10d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:52.083+0000 7f4662800640 1 -- 172.21.15.18:0/610087479 shutdown_connections 2024-09-12T02:46:52.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:52.084+0000 7f4662800640 1 -- 172.21.15.18:0/610087479 wait complete. 2024-09-12T02:46:53.003 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:52 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/610087479' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:46:53.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:52 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/610087479' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:46:53.048 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T02:46:53.048 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:46:53.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:52 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/610087479' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:46:53.428 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:53.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:53 smithi018 ceph-mon[30616]: pgmap v347: 129 pgs: 129 active+clean; 634 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-12T02:46:54.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:53 smithi062 ceph-mon[35527]: pgmap v347: 129 pgs: 129 active+clean; 634 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-12T02:46:54.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.064+0000 7f2c77200640 1 -- 172.21.15.18:0/3117532147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c78102360 msgr2=0x7f2c7810e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.064+0000 7f2c77200640 1 --2- 172.21.15.18:0/3117532147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c78102360 0x7f2c7810e890 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2c70009cd0 tx=0x7f2c7002a8f0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.064+0000 7f2c77200640 1 -- 172.21.15.18:0/3117532147 shutdown_connections 2024-09-12T02:46:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.064+0000 7f2c77200640 1 --2- 172.21.15.18:0/3117532147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c78102360 0x7f2c7810e890 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.064+0000 7f2c77200640 1 --2- 172.21.15.18:0/3117532147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c781019c0 0x7f2c78101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.064+0000 7f2c77200640 1 --2- 172.21.15.18:0/3117532147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c781079c0 0x7f2c78107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.064+0000 7f2c77200640 1 -- 172.21.15.18:0/3117532147 >> 172.21.15.18:0/3117532147 conn(0x7f2c780fd740 msgr2=0x7f2c780ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.064+0000 7f2c77200640 1 -- 172.21.15.18:0/3117532147 shutdown_connections 2024-09-12T02:46:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.064+0000 7f2c77200640 1 -- 172.21.15.18:0/3117532147 wait complete. 2024-09-12T02:46:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.065+0000 7f2c77200640 1 Processor -- start 2024-09-12T02:46:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.065+0000 7f2c77200640 1 -- start start 2024-09-12T02:46:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.066+0000 7f2c77200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c781019c0 0x7f2c781982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.066+0000 7f2c77200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c78102360 0x7f2c781987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.066+0000 7f2c77200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c781079c0 0x7f2c7819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.066+0000 7f2c77200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2c78111dc0 con 0x7f2c78102360 2024-09-12T02:46:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.066+0000 7f2c77200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2c78111c40 con 0x7f2c781079c0 2024-09-12T02:46:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.066+0000 7f2c77200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2c78111f40 con 0x7f2c781019c0 2024-09-12T02:46:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.066+0000 7f2c75400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c78102360 0x7f2c781987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.066+0000 7f2c75400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c78102360 0x7f2c781987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38286/0 (socket says 172.21.15.18:38286) 2024-09-12T02:46:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.066+0000 7f2c75400640 1 -- 172.21.15.18:0/162457460 learned_addr learned my addr 172.21.15.18:0/162457460 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.066+0000 7f2c75e00640 1 --2- 172.21.15.18:0/162457460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c781019c0 0x7f2c781982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.066+0000 7f2c76800640 1 --2- 172.21.15.18:0/162457460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c781079c0 0x7f2c7819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.067+0000 7f2c75400640 1 -- 172.21.15.18:0/162457460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c781019c0 msgr2=0x7f2c781982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:54.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.067+0000 7f2c75400640 1 --2- 172.21.15.18:0/162457460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c781019c0 0x7f2c781982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.067+0000 7f2c75400640 1 -- 172.21.15.18:0/162457460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c781079c0 msgr2=0x7f2c7819cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:54.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.067+0000 7f2c75400640 1 --2- 172.21.15.18:0/162457460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c781079c0 0x7f2c7819cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.067+0000 7f2c75400640 1 -- 172.21.15.18:0/162457460 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c7819d250 con 0x7f2c78102360 2024-09-12T02:46:54.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.067+0000 7f2c75400640 1 --2- 172.21.15.18:0/162457460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c78102360 0x7f2c781987e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400e9f0 tx=0x7f2c6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:54.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.067+0000 7f2c6ea00640 1 -- 172.21.15.18:0/162457460 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400cd80 con 0x7f2c78102360 2024-09-12T02:46:54.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.067+0000 7f2c6ea00640 1 -- 172.21.15.18:0/162457460 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c64005500 con 0x7f2c78102360 2024-09-12T02:46:54.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.067+0000 7f2c6ea00640 1 -- 172.21.15.18:0/162457460 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c64010690 con 0x7f2c78102360 2024-09-12T02:46:54.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.067+0000 7f2c77200640 1 -- 172.21.15.18:0/162457460 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c7819d540 con 0x7f2c78102360 2024-09-12T02:46:54.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.067+0000 7f2c77200640 1 -- 172.21.15.18:0/162457460 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c781a4e20 con 0x7f2c78102360 2024-09-12T02:46:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.069+0000 7f2c77200640 1 -- 172.21.15.18:0/162457460 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c78101e20 con 0x7f2c78102360 2024-09-12T02:46:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.071+0000 7f2c6ea00640 1 -- 172.21.15.18:0/162457460 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2c640046c0 con 0x7f2c78102360 2024-09-12T02:46:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.072+0000 7f2c6ea00640 1 --2- 172.21.15.18:0/162457460 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2c5c0a2c90 0x7f2c5c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.073+0000 7f2c6ea00640 1 -- 172.21.15.18:0/162457460 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7f2c640cf910 con 0x7f2c78102360 2024-09-12T02:46:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.073+0000 7f2c75e00640 1 --2- 172.21.15.18:0/162457460 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2c5c0a2c90 0x7f2c5c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.073+0000 7f2c75e00640 1 --2- 172.21.15.18:0/162457460 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2c5c0a2c90 0x7f2c5c0a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009b50 tx=0x7f2c68005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:54.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.076+0000 7f2c6ea00640 1 -- 172.21.15.18:0/162457460 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2c6409c350 con 0x7f2c78102360 2024-09-12T02:46:54.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:53 smithi176 ceph-mon[35713]: pgmap v347: 129 pgs: 129 active+clean; 634 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-12T02:46:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.259+0000 7f2c77200640 1 -- 172.21.15.18:0/162457460 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c78062630 con 0x7f2c5c0a2c90 2024-09-12T02:46:54.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.271+0000 7f2c6ea00640 1 -- 172.21.15.18:0/162457460 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340391 (secure 0 0 0) 0x7f2c78062630 con 0x7f2c5c0a2c90 2024-09-12T02:46:54.277 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:46:54.279 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-12T02:46:54.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.275+0000 7f2c77200640 1 -- 172.21.15.18:0/162457460 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2c5c0a2c90 msgr2=0x7f2c5c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:54.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.275+0000 7f2c77200640 1 --2- 172.21.15.18:0/162457460 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2c5c0a2c90 0x7f2c5c0a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009b50 tx=0x7f2c68005f90 comp rx=0 tx=0).stop 2024-09-12T02:46:54.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.275+0000 7f2c77200640 1 -- 172.21.15.18:0/162457460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c78102360 msgr2=0x7f2c781987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:54.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.275+0000 7f2c77200640 1 --2- 172.21.15.18:0/162457460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c78102360 0x7f2c781987e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400e9f0 tx=0x7f2c6400edf0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.276+0000 7f2c77200640 1 -- 172.21.15.18:0/162457460 shutdown_connections 2024-09-12T02:46:54.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.276+0000 7f2c77200640 1 --2- 172.21.15.18:0/162457460 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2c5c0a2c90 0x7f2c5c0a5150 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.276+0000 7f2c77200640 1 --2- 172.21.15.18:0/162457460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c781079c0 0x7f2c7819cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.276+0000 7f2c77200640 1 --2- 172.21.15.18:0/162457460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c78102360 0x7f2c781987e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.276+0000 7f2c77200640 1 --2- 172.21.15.18:0/162457460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c781019c0 0x7f2c781982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:54.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.276+0000 7f2c77200640 1 -- 172.21.15.18:0/162457460 >> 172.21.15.18:0/162457460 conn(0x7f2c780fd740 msgr2=0x7f2c780fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:54.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.276+0000 7f2c77200640 1 -- 172.21.15.18:0/162457460 shutdown_connections 2024-09-12T02:46:54.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:54.276+0000 7f2c77200640 1 -- 172.21.15.18:0/162457460 wait complete. 2024-09-12T02:46:55.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:54 smithi062 ceph-mon[35527]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:46:55.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:54 smithi018 ceph-mon[30616]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:46:55.172 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-09-12T02:46:52.631422+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649709,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":334,"num_read_kb":280,"num_write":422,"num_write_kb":3069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":346,"ondisk_log_size":346,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360156,"kb_used_data":15068,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124581668,"statfs":{"total":1151940427776,"available":1151571628032,"internally_reserved":0,"allocated":15429632,"data_stored":8472293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42080,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":100,"num_write":27,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003620"},"pg_stats":[{"pgid":"2.1f","version":"96'13","reported_seq":68,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:46.696203+0000","last_change":"2024-09-12T02:45:32.388516+0000","last_active":"2024-09-12T02:46:46.696203+0000","last_peered":"2024-09-12T02:46:46.696203+0000","last_clean":"2024-09-12T02:46:46.696203+0000","last_became_active":"2024-09-12T02:45:32.388066+0000","last_became_peered":"2024-09-12T02:45:32.388066+0000","last_unstale":"2024-09-12T02:46:46.696203+0000","last_undegraded":"2024-09-12T02:46:46.696203+0000","last_fullsized":"2024-09-12T02:46:46.696203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:51.222779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550759+0000","last_change":"2024-09-12T02:45:35.434469+0000","last_active":"2024-09-12T02:46:12.550759+0000","last_peered":"2024-09-12T02:46:12.550759+0000","last_clean":"2024-09-12T02:46:12.550759+0000","last_became_active":"2024-09-12T02:45:35.431803+0000","last_became_peered":"2024-09-12T02:45:35.431803+0000","last_unstale":"2024-09-12T02:46:12.550759+0000","last_undegraded":"2024-09-12T02:46:12.550759+0000","last_fullsized":"2024-09-12T02:46:12.550759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:00.826976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550560+0000","last_change":"2024-09-12T02:45:45.488223+0000","last_active":"2024-09-12T02:46:12.550560+0000","last_peered":"2024-09-12T02:46:12.550560+0000","last_clean":"2024-09-12T02:46:12.550560+0000","last_became_active":"2024-09-12T02:45:45.487868+0000","last_became_peered":"2024-09-12T02:45:45.487868+0000","last_unstale":"2024-09-12T02:46:12.550560+0000","last_undegraded":"2024-09-12T02:46:12.550560+0000","last_fullsized":"2024-09-12T02:46:12.550560+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:49.922975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"96'2","reported_seq":42,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550957+0000","last_change":"2024-09-12T02:45:32.479037+0000","last_active":"2024-09-12T02:46:12.550957+0000","last_peered":"2024-09-12T02:46:12.550957+0000","last_clean":"2024-09-12T02:46:12.550957+0000","last_became_active":"2024-09-12T02:45:32.477071+0000","last_became_peered":"2024-09-12T02:45:32.477071+0000","last_unstale":"2024-09-12T02:46:12.550957+0000","last_undegraded":"2024-09-12T02:46:12.550957+0000","last_fullsized":"2024-09-12T02:46:12.550957+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:29.512142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.559141+0000","last_change":"2024-09-12T02:45:35.418226+0000","last_active":"2024-09-12T02:46:12.559141+0000","last_peered":"2024-09-12T02:46:12.559141+0000","last_clean":"2024-09-12T02:46:12.559141+0000","last_became_active":"2024-09-12T02:45:35.417910+0000","last_became_peered":"2024-09-12T02:45:35.417910+0000","last_unstale":"2024-09-12T02:46:12.559141+0000","last_undegraded":"2024-09-12T02:46:12.559141+0000","last_fullsized":"2024-09-12T02:46:12.559141+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:06.788584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.950169+0000","last_change":"2024-09-12T02:45:45.487575+0000","last_active":"2024-09-12T02:46:12.950169+0000","last_peered":"2024-09-12T02:46:12.950169+0000","last_clean":"2024-09-12T02:46:12.950169+0000","last_became_active":"2024-09-12T02:45:45.487246+0000","last_became_peered":"2024-09-12T02:45:45.487246+0000","last_unstale":"2024-09-12T02:46:12.950169+0000","last_undegraded":"2024-09-12T02:46:12.950169+0000","last_fullsized":"2024-09-12T02:46:12.950169+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:06.068200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"96'12","reported_seq":53,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:34.670132+0000","last_change":"2024-09-12T02:45:32.393707+0000","last_active":"2024-09-12T02:46:34.670132+0000","last_peered":"2024-09-12T02:46:34.670132+0000","last_clean":"2024-09-12T02:46:34.670132+0000","last_became_active":"2024-09-12T02:45:32.393305+0000","last_became_peered":"2024-09-12T02:45:32.393305+0000","last_unstale":"2024-09-12T02:46:34.670132+0000","last_undegraded":"2024-09-12T02:46:34.670132+0000","last_fullsized":"2024-09-12T02:46:34.670132+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:02.755660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553048+0000","last_change":"2024-09-12T02:45:35.432556+0000","last_active":"2024-09-12T02:46:12.553048+0000","last_peered":"2024-09-12T02:46:12.553048+0000","last_clean":"2024-09-12T02:46:12.553048+0000","last_became_active":"2024-09-12T02:45:35.431164+0000","last_became_peered":"2024-09-12T02:45:35.431164+0000","last_unstale":"2024-09-12T02:46:12.553048+0000","last_undegraded":"2024-09-12T02:46:12.553048+0000","last_fullsized":"2024-09-12T02:46:12.553048+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:11.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.950725+0000","last_change":"2024-09-12T02:45:45.493518+0000","last_active":"2024-09-12T02:46:12.950725+0000","last_peered":"2024-09-12T02:46:12.950725+0000","last_clean":"2024-09-12T02:46:12.950725+0000","last_became_active":"2024-09-12T02:45:45.492902+0000","last_became_peered":"2024-09-12T02:45:45.492902+0000","last_unstale":"2024-09-12T02:46:12.950725+0000","last_undegraded":"2024-09-12T02:46:12.950725+0000","last_fullsized":"2024-09-12T02:46:12.950725+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:11.278901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"96'5","reported_seq":46,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.664927+0000","last_change":"2024-09-12T02:45:32.388552+0000","last_active":"2024-09-12T02:46:33.664927+0000","last_peered":"2024-09-12T02:46:33.664927+0000","last_clean":"2024-09-12T02:46:33.664927+0000","last_became_active":"2024-09-12T02:45:32.388168+0000","last_became_peered":"2024-09-12T02:45:32.388168+0000","last_unstale":"2024-09-12T02:46:33.664927+0000","last_undegraded":"2024-09-12T02:46:33.664927+0000","last_fullsized":"2024-09-12T02:46:33.664927+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:29.803240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.951959+0000","last_change":"2024-09-12T02:46:12.951385+0000","last_active":"2024-09-12T02:46:12.951959+0000","last_peered":"2024-09-12T02:46:12.951959+0000","last_clean":"2024-09-12T02:46:12.951959+0000","last_became_active":"2024-09-12T02:46:12.950977+0000","last_became_peered":"2024-09-12T02:46:12.950977+0000","last_unstale":"2024-09-12T02:46:12.951959+0000","last_undegraded":"2024-09-12T02:46:12.951959+0000","last_fullsized":"2024-09-12T02:46:12.951959+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:59.262026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.950577+0000","last_change":"2024-09-12T02:45:45.487534+0000","last_active":"2024-09-12T02:46:12.950577+0000","last_peered":"2024-09-12T02:46:12.950577+0000","last_clean":"2024-09-12T02:46:12.950577+0000","last_became_active":"2024-09-12T02:45:45.487101+0000","last_became_peered":"2024-09-12T02:45:45.487101+0000","last_unstale":"2024-09-12T02:46:12.950577+0000","last_undegraded":"2024-09-12T02:46:12.950577+0000","last_fullsized":"2024-09-12T02:46:12.950577+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:50.808850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555989+0000","last_change":"2024-09-12T02:45:35.432796+0000","last_active":"2024-09-12T02:46:12.555989+0000","last_peered":"2024-09-12T02:46:12.555989+0000","last_clean":"2024-09-12T02:46:12.555989+0000","last_became_active":"2024-09-12T02:45:35.432456+0000","last_became_peered":"2024-09-12T02:45:35.432456+0000","last_unstale":"2024-09-12T02:46:12.555989+0000","last_undegraded":"2024-09-12T02:46:12.555989+0000","last_fullsized":"2024-09-12T02:46:12.555989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:02.597515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"96'4","reported_seq":45,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:30.636289+0000","last_change":"2024-09-12T02:45:32.394657+0000","last_active":"2024-09-12T02:46:30.636289+0000","last_peered":"2024-09-12T02:46:30.636289+0000","last_clean":"2024-09-12T02:46:30.636289+0000","last_became_active":"2024-09-12T02:45:32.394277+0000","last_became_peered":"2024-09-12T02:45:32.394277+0000","last_unstale":"2024-09-12T02:46:30.636289+0000","last_undegraded":"2024-09-12T02:46:30.636289+0000","last_fullsized":"2024-09-12T02:46:30.636289+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:26.614900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.950689+0000","last_change":"2024-09-12T02:45:45.831567+0000","last_active":"2024-09-12T02:46:12.950689+0000","last_peered":"2024-09-12T02:46:12.950689+0000","last_clean":"2024-09-12T02:46:12.950689+0000","last_became_active":"2024-09-12T02:45:45.831124+0000","last_became_peered":"2024-09-12T02:45:45.831124+0000","last_unstale":"2024-09-12T02:46:12.950689+0000","last_undegraded":"2024-09-12T02:46:12.950689+0000","last_fullsized":"2024-09-12T02:46:12.950689+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:43.289387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550484+0000","last_change":"2024-09-12T02:45:35.435658+0000","last_active":"2024-09-12T02:46:12.550484+0000","last_peered":"2024-09-12T02:46:12.550484+0000","last_clean":"2024-09-12T02:46:12.550484+0000","last_became_active":"2024-09-12T02:45:35.434759+0000","last_became_peered":"2024-09-12T02:45:35.434759+0000","last_unstale":"2024-09-12T02:46:12.550484+0000","last_undegraded":"2024-09-12T02:46:12.550484+0000","last_fullsized":"2024-09-12T02:46:12.550484+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:49.384125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"96'3","reported_seq":43,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:32.644987+0000","last_change":"2024-09-12T02:45:32.394125+0000","last_active":"2024-09-12T02:46:32.644987+0000","last_peered":"2024-09-12T02:46:32.644987+0000","last_clean":"2024-09-12T02:46:32.644987+0000","last_became_active":"2024-09-12T02:45:32.393797+0000","last_became_peered":"2024-09-12T02:45:32.393797+0000","last_unstale":"2024-09-12T02:46:32.644987+0000","last_undegraded":"2024-09-12T02:46:32.644987+0000","last_fullsized":"2024-09-12T02:46:32.644987+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:41.553865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"96'1","reported_seq":23,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.951096+0000","last_change":"2024-09-12T02:45:45.495186+0000","last_active":"2024-09-12T02:46:12.951096+0000","last_peered":"2024-09-12T02:46:12.951096+0000","last_clean":"2024-09-12T02:46:12.951096+0000","last_became_active":"2024-09-12T02:45:45.494764+0000","last_became_peered":"2024-09-12T02:45:45.494764+0000","last_unstale":"2024-09-12T02:46:12.951096+0000","last_undegraded":"2024-09-12T02:46:12.951096+0000","last_fullsized":"2024-09-12T02:46:12.951096+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:59.623399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555151+0000","last_change":"2024-09-12T02:45:35.431606+0000","last_active":"2024-09-12T02:46:12.555151+0000","last_peered":"2024-09-12T02:46:12.555151+0000","last_clean":"2024-09-12T02:46:12.555151+0000","last_became_active":"2024-09-12T02:45:35.431259+0000","last_became_peered":"2024-09-12T02:45:35.431259+0000","last_unstale":"2024-09-12T02:46:12.555151+0000","last_undegraded":"2024-09-12T02:46:12.555151+0000","last_fullsized":"2024-09-12T02:46:12.555151+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:17.014610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"96'7","reported_seq":47,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.664438+0000","last_change":"2024-09-12T02:45:32.386098+0000","last_active":"2024-09-12T02:46:33.664438+0000","last_peered":"2024-09-12T02:46:33.664438+0000","last_clean":"2024-09-12T02:46:33.664438+0000","last_became_active":"2024-09-12T02:45:32.385762+0000","last_became_peered":"2024-09-12T02:45:32.385762+0000","last_unstale":"2024-09-12T02:46:33.664438+0000","last_undegraded":"2024-09-12T02:46:33.664438+0000","last_fullsized":"2024-09-12T02:46:33.664438+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:17.109916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555580+0000","last_change":"2024-09-12T02:45:45.492746+0000","last_active":"2024-09-12T02:46:12.555580+0000","last_peered":"2024-09-12T02:46:12.555580+0000","last_clean":"2024-09-12T02:46:12.555580+0000","last_became_active":"2024-09-12T02:45:45.492280+0000","last_became_peered":"2024-09-12T02:45:45.492280+0000","last_unstale":"2024-09-12T02:46:12.555580+0000","last_undegraded":"2024-09-12T02:46:12.555580+0000","last_fullsized":"2024-09-12T02:46:12.555580+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:56.585316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.554955+0000","last_change":"2024-09-12T02:45:35.430254+0000","last_active":"2024-09-12T02:46:12.554955+0000","last_peered":"2024-09-12T02:46:12.554955+0000","last_clean":"2024-09-12T02:46:12.554955+0000","last_became_active":"2024-09-12T02:45:35.429822+0000","last_became_peered":"2024-09-12T02:45:35.429822+0000","last_unstale":"2024-09-12T02:46:12.554955+0000","last_undegraded":"2024-09-12T02:46:12.554955+0000","last_fullsized":"2024-09-12T02:46:12.554955+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:45.750936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"96'2","reported_seq":41,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:30.637181+0000","last_change":"2024-09-12T02:45:32.476950+0000","last_active":"2024-09-12T02:46:30.637181+0000","last_peered":"2024-09-12T02:46:30.637181+0000","last_clean":"2024-09-12T02:46:30.637181+0000","last_became_active":"2024-09-12T02:45:32.476619+0000","last_became_peered":"2024-09-12T02:45:32.476619+0000","last_unstale":"2024-09-12T02:46:30.637181+0000","last_undegraded":"2024-09-12T02:46:30.637181+0000","last_fullsized":"2024-09-12T02:46:30.637181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:18.963069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.950725+0000","last_change":"2024-09-12T02:45:45.833226+0000","last_active":"2024-09-12T02:46:12.950725+0000","last_peered":"2024-09-12T02:46:12.950725+0000","last_clean":"2024-09-12T02:46:12.950725+0000","last_became_active":"2024-09-12T02:45:45.832716+0000","last_became_peered":"2024-09-12T02:45:45.832716+0000","last_unstale":"2024-09-12T02:46:12.950725+0000","last_undegraded":"2024-09-12T02:46:12.950725+0000","last_fullsized":"2024-09-12T02:46:12.950725+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:12.072765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.558648+0000","last_change":"2024-09-12T02:45:35.436301+0000","last_active":"2024-09-12T02:46:12.558648+0000","last_peered":"2024-09-12T02:46:12.558648+0000","last_clean":"2024-09-12T02:46:12.558648+0000","last_became_active":"2024-09-12T02:45:35.435999+0000","last_became_peered":"2024-09-12T02:45:35.435999+0000","last_unstale":"2024-09-12T02:46:12.558648+0000","last_undegraded":"2024-09-12T02:46:12.558648+0000","last_fullsized":"2024-09-12T02:46:12.558648+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:02.823154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"96'7","reported_seq":47,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.666085+0000","last_change":"2024-09-12T02:45:32.382231+0000","last_active":"2024-09-12T02:46:33.666085+0000","last_peered":"2024-09-12T02:46:33.666085+0000","last_clean":"2024-09-12T02:46:33.666085+0000","last_became_active":"2024-09-12T02:45:32.381821+0000","last_became_peered":"2024-09-12T02:45:32.381821+0000","last_unstale":"2024-09-12T02:46:33.666085+0000","last_undegraded":"2024-09-12T02:46:33.666085+0000","last_fullsized":"2024-09-12T02:46:33.666085+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:34:02.631429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550547+0000","last_change":"2024-09-12T02:45:45.481460+0000","last_active":"2024-09-12T02:46:12.550547+0000","last_peered":"2024-09-12T02:46:12.550547+0000","last_clean":"2024-09-12T02:46:12.550547+0000","last_became_active":"2024-09-12T02:45:45.480697+0000","last_became_peered":"2024-09-12T02:45:45.480697+0000","last_unstale":"2024-09-12T02:46:12.550547+0000","last_undegraded":"2024-09-12T02:46:12.550547+0000","last_fullsized":"2024-09-12T02:46:12.550547+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:34.985196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550970+0000","last_change":"2024-09-12T02:45:35.434844+0000","last_active":"2024-09-12T02:46:12.550970+0000","last_peered":"2024-09-12T02:46:12.550970+0000","last_clean":"2024-09-12T02:46:12.550970+0000","last_became_active":"2024-09-12T02:45:35.433513+0000","last_became_peered":"2024-09-12T02:45:35.433513+0000","last_unstale":"2024-09-12T02:46:12.550970+0000","last_undegraded":"2024-09-12T02:46:12.550970+0000","last_fullsized":"2024-09-12T02:46:12.550970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:01.473202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"96'12","reported_seq":52,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:46.439465+0000","last_change":"2024-09-12T02:45:32.389455+0000","last_active":"2024-09-12T02:46:46.439465+0000","last_peered":"2024-09-12T02:46:46.439465+0000","last_clean":"2024-09-12T02:46:46.439465+0000","last_became_active":"2024-09-12T02:45:32.388633+0000","last_became_peered":"2024-09-12T02:45:32.388633+0000","last_unstale":"2024-09-12T02:46:46.439465+0000","last_undegraded":"2024-09-12T02:46:46.439465+0000","last_fullsized":"2024-09-12T02:46:46.439465+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:34.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550029+0000","last_change":"2024-09-12T02:45:45.831697+0000","last_active":"2024-09-12T02:46:12.550029+0000","last_peered":"2024-09-12T02:46:12.550029+0000","last_clean":"2024-09-12T02:46:12.550029+0000","last_became_active":"2024-09-12T02:45:45.831167+0000","last_became_peered":"2024-09-12T02:45:45.831167+0000","last_unstale":"2024-09-12T02:46:12.550029+0000","last_undegraded":"2024-09-12T02:46:12.550029+0000","last_fullsized":"2024-09-12T02:46:12.550029+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:48.553773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.369218+0000","last_change":"2024-09-12T02:45:35.423196+0000","last_active":"2024-09-12T02:46:13.369218+0000","last_peered":"2024-09-12T02:46:13.369218+0000","last_clean":"2024-09-12T02:46:13.369218+0000","last_became_active":"2024-09-12T02:45:35.422778+0000","last_became_peered":"2024-09-12T02:45:35.422778+0000","last_unstale":"2024-09-12T02:46:13.369218+0000","last_undegraded":"2024-09-12T02:46:13.369218+0000","last_fullsized":"2024-09-12T02:46:13.369218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:37.092151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"96'4","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.666397+0000","last_change":"2024-09-12T02:46:12.558805+0000","last_active":"2024-09-12T02:46:33.666397+0000","last_peered":"2024-09-12T02:46:33.666397+0000","last_clean":"2024-09-12T02:46:33.666397+0000","last_became_active":"2024-09-12T02:46:12.558479+0000","last_became_peered":"2024-09-12T02:46:12.558479+0000","last_unstale":"2024-09-12T02:46:33.666397+0000","last_undegraded":"2024-09-12T02:46:33.666397+0000","last_fullsized":"2024-09-12T02:46:33.666397+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:28.757698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555406+0000","last_change":"2024-09-12T02:45:45.484466+0000","last_active":"2024-09-12T02:46:12.555406+0000","last_peered":"2024-09-12T02:46:12.555406+0000","last_clean":"2024-09-12T02:46:12.555406+0000","last_became_active":"2024-09-12T02:45:45.484003+0000","last_became_peered":"2024-09-12T02:45:45.484003+0000","last_unstale":"2024-09-12T02:46:12.555406+0000","last_undegraded":"2024-09-12T02:46:12.555406+0000","last_fullsized":"2024-09-12T02:46:12.555406+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:00.429837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553867+0000","last_change":"2024-09-12T02:45:35.432783+0000","last_active":"2024-09-12T02:46:12.553867+0000","last_peered":"2024-09-12T02:46:12.553867+0000","last_clean":"2024-09-12T02:46:12.553867+0000","last_became_active":"2024-09-12T02:45:35.432461+0000","last_became_peered":"2024-09-12T02:45:35.432461+0000","last_unstale":"2024-09-12T02:46:12.553867+0000","last_undegraded":"2024-09-12T02:46:12.553867+0000","last_fullsized":"2024-09-12T02:46:12.553867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:20.066115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"96'1","reported_seq":41,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555438+0000","last_change":"2024-09-12T02:45:32.478636+0000","last_active":"2024-09-12T02:46:12.555438+0000","last_peered":"2024-09-12T02:46:12.555438+0000","last_clean":"2024-09-12T02:46:12.555438+0000","last_became_active":"2024-09-12T02:45:32.477347+0000","last_became_peered":"2024-09-12T02:45:32.477347+0000","last_unstale":"2024-09-12T02:46:12.555438+0000","last_undegraded":"2024-09-12T02:46:12.555438+0000","last_fullsized":"2024-09-12T02:46:12.555438+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:02.872897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.554681+0000","last_change":"2024-09-12T02:45:45.831550+0000","last_active":"2024-09-12T02:46:12.554681+0000","last_peered":"2024-09-12T02:46:12.554681+0000","last_clean":"2024-09-12T02:46:12.554681+0000","last_became_active":"2024-09-12T02:45:45.831004+0000","last_became_peered":"2024-09-12T02:45:45.831004+0000","last_unstale":"2024-09-12T02:46:12.554681+0000","last_undegraded":"2024-09-12T02:46:12.554681+0000","last_fullsized":"2024-09-12T02:46:12.554681+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:24.183273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553923+0000","last_change":"2024-09-12T02:45:35.417296+0000","last_active":"2024-09-12T02:46:12.553923+0000","last_peered":"2024-09-12T02:46:12.553923+0000","last_clean":"2024-09-12T02:46:12.553923+0000","last_became_active":"2024-09-12T02:45:35.416963+0000","last_became_peered":"2024-09-12T02:45:35.416963+0000","last_unstale":"2024-09-12T02:46:12.553923+0000","last_undegraded":"2024-09-12T02:46:12.553923+0000","last_fullsized":"2024-09-12T02:46:12.553923+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:22.945974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"96'6","reported_seq":65,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:50.701986+0000","last_change":"2024-09-12T02:45:32.387264+0000","last_active":"2024-09-12T02:46:50.701986+0000","last_peered":"2024-09-12T02:46:50.701986+0000","last_clean":"2024-09-12T02:46:50.701986+0000","last_became_active":"2024-09-12T02:45:32.386900+0000","last_became_peered":"2024-09-12T02:45:32.386900+0000","last_unstale":"2024-09-12T02:46:50.701986+0000","last_undegraded":"2024-09-12T02:46:50.701986+0000","last_fullsized":"2024-09-12T02:46:50.701986+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:26.638049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.369235+0000","last_change":"2024-09-12T02:45:45.481793+0000","last_active":"2024-09-12T02:46:13.369235+0000","last_peered":"2024-09-12T02:46:13.369235+0000","last_clean":"2024-09-12T02:46:13.369235+0000","last_became_active":"2024-09-12T02:45:45.481265+0000","last_became_peered":"2024-09-12T02:45:45.481265+0000","last_unstale":"2024-09-12T02:46:13.369235+0000","last_undegraded":"2024-09-12T02:46:13.369235+0000","last_fullsized":"2024-09-12T02:46:13.369235+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:24.568713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553209+0000","last_change":"2024-09-12T02:45:35.432102+0000","last_active":"2024-09-12T02:46:12.553209+0000","last_peered":"2024-09-12T02:46:12.553209+0000","last_clean":"2024-09-12T02:46:12.553209+0000","last_became_active":"2024-09-12T02:45:35.431521+0000","last_became_peered":"2024-09-12T02:45:35.431521+0000","last_unstale":"2024-09-12T02:46:12.553209+0000","last_undegraded":"2024-09-12T02:46:12.553209+0000","last_fullsized":"2024-09-12T02:46:12.553209+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:40.669668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"96'5","reported_seq":62,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:48.698773+0000","last_change":"2024-09-12T02:45:32.479322+0000","last_active":"2024-09-12T02:46:48.698773+0000","last_peered":"2024-09-12T02:46:48.698773+0000","last_clean":"2024-09-12T02:46:48.698773+0000","last_became_active":"2024-09-12T02:45:32.478565+0000","last_became_peered":"2024-09-12T02:45:32.478565+0000","last_unstale":"2024-09-12T02:46:48.698773+0000","last_undegraded":"2024-09-12T02:46:48.698773+0000","last_fullsized":"2024-09-12T02:46:48.698773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:03.400545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.368976+0000","last_change":"2024-09-12T02:45:45.831894+0000","last_active":"2024-09-12T02:46:13.368976+0000","last_peered":"2024-09-12T02:46:13.368976+0000","last_clean":"2024-09-12T02:46:13.368976+0000","last_became_active":"2024-09-12T02:45:45.831365+0000","last_became_peered":"2024-09-12T02:45:45.831365+0000","last_unstale":"2024-09-12T02:46:13.368976+0000","last_undegraded":"2024-09-12T02:46:13.368976+0000","last_fullsized":"2024-09-12T02:46:13.368976+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:57.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.368356+0000","last_change":"2024-09-12T02:45:35.419676+0000","last_active":"2024-09-12T02:46:13.368356+0000","last_peered":"2024-09-12T02:46:13.368356+0000","last_clean":"2024-09-12T02:46:13.368356+0000","last_became_active":"2024-09-12T02:45:35.419371+0000","last_became_peered":"2024-09-12T02:45:35.419371+0000","last_unstale":"2024-09-12T02:46:13.368356+0000","last_undegraded":"2024-09-12T02:46:13.368356+0000","last_fullsized":"2024-09-12T02:46:13.368356+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:19.303214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"96'4","reported_seq":43,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:31.639553+0000","last_change":"2024-09-12T02:45:32.389855+0000","last_active":"2024-09-12T02:46:31.639553+0000","last_peered":"2024-09-12T02:46:31.639553+0000","last_clean":"2024-09-12T02:46:31.639553+0000","last_became_active":"2024-09-12T02:45:32.389457+0000","last_became_peered":"2024-09-12T02:45:32.389457+0000","last_unstale":"2024-09-12T02:46:31.639553+0000","last_undegraded":"2024-09-12T02:46:31.639553+0000","last_fullsized":"2024-09-12T02:46:31.639553+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:41.540961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.554393+0000","last_change":"2024-09-12T02:45:45.832346+0000","last_active":"2024-09-12T02:46:12.554393+0000","last_peered":"2024-09-12T02:46:12.554393+0000","last_clean":"2024-09-12T02:46:12.554393+0000","last_became_active":"2024-09-12T02:45:45.831810+0000","last_became_peered":"2024-09-12T02:45:45.831810+0000","last_unstale":"2024-09-12T02:46:12.554393+0000","last_undegraded":"2024-09-12T02:46:12.554393+0000","last_fullsized":"2024-09-12T02:46:12.554393+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:08.388606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550433+0000","last_change":"2024-09-12T02:45:35.437560+0000","last_active":"2024-09-12T02:46:12.550433+0000","last_peered":"2024-09-12T02:46:12.550433+0000","last_clean":"2024-09-12T02:46:12.550433+0000","last_became_active":"2024-09-12T02:45:35.435837+0000","last_became_peered":"2024-09-12T02:45:35.435837+0000","last_unstale":"2024-09-12T02:46:12.550433+0000","last_undegraded":"2024-09-12T02:46:12.550433+0000","last_fullsized":"2024-09-12T02:46:12.550433+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:21.171560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"96'6","reported_seq":48,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:34.672364+0000","last_change":"2024-09-12T02:45:32.385075+0000","last_active":"2024-09-12T02:46:34.672364+0000","last_peered":"2024-09-12T02:46:34.672364+0000","last_clean":"2024-09-12T02:46:34.672364+0000","last_became_active":"2024-09-12T02:45:32.384569+0000","last_became_peered":"2024-09-12T02:45:32.384569+0000","last_unstale":"2024-09-12T02:46:34.672364+0000","last_undegraded":"2024-09-12T02:46:34.672364+0000","last_fullsized":"2024-09-12T02:46:34.672364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:32.962756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":365,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555798+0000","last_change":"2024-09-12T02:44:18.042779+0000","last_active":"2024-09-12T02:46:12.555798+0000","last_peered":"2024-09-12T02:46:12.555798+0000","last_clean":"2024-09-12T02:46:12.555798+0000","last_became_active":"2024-09-12T02:44:18.042265+0000","last_became_peered":"2024-09-12T02:44:18.042265+0000","last_unstale":"2024-09-12T02:46:12.555798+0000","last_undegraded":"2024-09-12T02:46:12.555798+0000","last_fullsized":"2024-09-12T02:46:12.555798+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:40:35.543336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:40:35.543336+0000","last_clean_scrub_stamp":"2024-09-12T02:40:35.543336+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:22.348756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"96'1","reported_seq":23,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556830+0000","last_change":"2024-09-12T02:45:45.492737+0000","last_active":"2024-09-12T02:46:12.556830+0000","last_peered":"2024-09-12T02:46:12.556830+0000","last_clean":"2024-09-12T02:46:12.556830+0000","last_became_active":"2024-09-12T02:45:45.492280+0000","last_became_peered":"2024-09-12T02:45:45.492280+0000","last_unstale":"2024-09-12T02:46:12.556830+0000","last_undegraded":"2024-09-12T02:46:12.556830+0000","last_fullsized":"2024-09-12T02:46:12.556830+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:45.530066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556924+0000","last_change":"2024-09-12T02:45:35.431876+0000","last_active":"2024-09-12T02:46:12.556924+0000","last_peered":"2024-09-12T02:46:12.556924+0000","last_clean":"2024-09-12T02:46:12.556924+0000","last_became_active":"2024-09-12T02:45:35.431505+0000","last_became_peered":"2024-09-12T02:45:35.431505+0000","last_unstale":"2024-09-12T02:46:12.556924+0000","last_undegraded":"2024-09-12T02:46:12.556924+0000","last_fullsized":"2024-09-12T02:46:12.556924+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:30.370034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"96'6","reported_seq":65,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:48.696527+0000","last_change":"2024-09-12T02:45:32.477394+0000","last_active":"2024-09-12T02:46:48.696527+0000","last_peered":"2024-09-12T02:46:48.696527+0000","last_clean":"2024-09-12T02:46:48.696527+0000","last_became_active":"2024-09-12T02:45:32.477064+0000","last_became_peered":"2024-09-12T02:45:32.477064+0000","last_unstale":"2024-09-12T02:46:48.696527+0000","last_undegraded":"2024-09-12T02:46:48.696527+0000","last_fullsized":"2024-09-12T02:46:48.696527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:03.828652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553118+0000","last_change":"2024-09-12T02:45:45.481201+0000","last_active":"2024-09-12T02:46:12.553118+0000","last_peered":"2024-09-12T02:46:12.553118+0000","last_clean":"2024-09-12T02:46:12.553118+0000","last_became_active":"2024-09-12T02:45:45.480721+0000","last_became_peered":"2024-09-12T02:45:45.480721+0000","last_unstale":"2024-09-12T02:46:12.553118+0000","last_undegraded":"2024-09-12T02:46:12.553118+0000","last_fullsized":"2024-09-12T02:46:12.553118+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:12.780521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556841+0000","last_change":"2024-09-12T02:45:35.440920+0000","last_active":"2024-09-12T02:46:12.556841+0000","last_peered":"2024-09-12T02:46:12.556841+0000","last_clean":"2024-09-12T02:46:12.556841+0000","last_became_active":"2024-09-12T02:45:35.440566+0000","last_became_peered":"2024-09-12T02:45:35.440566+0000","last_unstale":"2024-09-12T02:46:12.556841+0000","last_undegraded":"2024-09-12T02:46:12.556841+0000","last_fullsized":"2024-09-12T02:46:12.556841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:19.171841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"96'3","reported_seq":43,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.666018+0000","last_change":"2024-09-12T02:45:32.388589+0000","last_active":"2024-09-12T02:46:33.666018+0000","last_peered":"2024-09-12T02:46:33.666018+0000","last_clean":"2024-09-12T02:46:33.666018+0000","last_became_active":"2024-09-12T02:45:32.388243+0000","last_became_peered":"2024-09-12T02:45:32.388243+0000","last_unstale":"2024-09-12T02:46:33.666018+0000","last_undegraded":"2024-09-12T02:46:33.666018+0000","last_fullsized":"2024-09-12T02:46:33.666018+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:23.747525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.558135+0000","last_change":"2024-09-12T02:45:45.494520+0000","last_active":"2024-09-12T02:46:12.558135+0000","last_peered":"2024-09-12T02:46:12.558135+0000","last_clean":"2024-09-12T02:46:12.558135+0000","last_became_active":"2024-09-12T02:45:45.494104+0000","last_became_peered":"2024-09-12T02:45:45.494104+0000","last_unstale":"2024-09-12T02:46:12.558135+0000","last_undegraded":"2024-09-12T02:46:12.558135+0000","last_fullsized":"2024-09-12T02:46:12.558135+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:14.056329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556989+0000","last_change":"2024-09-12T02:45:35.427871+0000","last_active":"2024-09-12T02:46:12.556989+0000","last_peered":"2024-09-12T02:46:12.556989+0000","last_clean":"2024-09-12T02:46:12.556989+0000","last_became_active":"2024-09-12T02:45:35.427499+0000","last_became_peered":"2024-09-12T02:45:35.427499+0000","last_unstale":"2024-09-12T02:46:12.556989+0000","last_undegraded":"2024-09-12T02:46:12.556989+0000","last_fullsized":"2024-09-12T02:46:12.556989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:15.515311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"96'5","reported_seq":45,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.666536+0000","last_change":"2024-09-12T02:45:32.389199+0000","last_active":"2024-09-12T02:46:33.666536+0000","last_peered":"2024-09-12T02:46:33.666536+0000","last_clean":"2024-09-12T02:46:33.666536+0000","last_became_active":"2024-09-12T02:45:32.388885+0000","last_became_peered":"2024-09-12T02:45:32.388885+0000","last_unstale":"2024-09-12T02:46:33.666536+0000","last_undegraded":"2024-09-12T02:46:33.666536+0000","last_fullsized":"2024-09-12T02:46:33.666536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.002707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.552923+0000","last_change":"2024-09-12T02:45:45.485171+0000","last_active":"2024-09-12T02:46:12.552923+0000","last_peered":"2024-09-12T02:46:12.552923+0000","last_clean":"2024-09-12T02:46:12.552923+0000","last_became_active":"2024-09-12T02:45:45.484540+0000","last_became_peered":"2024-09-12T02:45:45.484540+0000","last_unstale":"2024-09-12T02:46:12.552923+0000","last_undegraded":"2024-09-12T02:46:12.552923+0000","last_fullsized":"2024-09-12T02:46:12.552923+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:52.063588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.951994+0000","last_change":"2024-09-12T02:46:12.951994+0000","last_active":"2024-09-12T02:46:12.951994+0000","last_peered":"2024-09-12T02:46:12.951994+0000","last_clean":"2024-09-12T02:46:12.951994+0000","last_became_active":"2024-09-12T02:46:12.951653+0000","last_became_peered":"2024-09-12T02:46:12.951653+0000","last_unstale":"2024-09-12T02:46:12.951994+0000","last_undegraded":"2024-09-12T02:46:12.951994+0000","last_fullsized":"2024-09-12T02:46:12.951994+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:35.221403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"96'2","reported_seq":43,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:32.637133+0000","last_change":"2024-09-12T02:45:32.390592+0000","last_active":"2024-09-12T02:46:32.637133+0000","last_peered":"2024-09-12T02:46:32.637133+0000","last_clean":"2024-09-12T02:46:32.637133+0000","last_became_active":"2024-09-12T02:45:32.390211+0000","last_became_peered":"2024-09-12T02:45:32.390211+0000","last_unstale":"2024-09-12T02:46:32.637133+0000","last_undegraded":"2024-09-12T02:46:32.637133+0000","last_fullsized":"2024-09-12T02:46:32.637133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:04.437645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553527+0000","last_change":"2024-09-12T02:45:45.491332+0000","last_active":"2024-09-12T02:46:12.553527+0000","last_peered":"2024-09-12T02:46:12.553527+0000","last_clean":"2024-09-12T02:46:12.553527+0000","last_became_active":"2024-09-12T02:45:45.490943+0000","last_became_peered":"2024-09-12T02:45:45.490943+0000","last_unstale":"2024-09-12T02:46:12.553527+0000","last_undegraded":"2024-09-12T02:46:12.553527+0000","last_fullsized":"2024-09-12T02:46:12.553527+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:50.154253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553677+0000","last_change":"2024-09-12T02:45:35.426119+0000","last_active":"2024-09-12T02:46:12.553677+0000","last_peered":"2024-09-12T02:46:12.553677+0000","last_clean":"2024-09-12T02:46:12.553677+0000","last_became_active":"2024-09-12T02:45:35.425740+0000","last_became_peered":"2024-09-12T02:45:35.425740+0000","last_unstale":"2024-09-12T02:46:12.553677+0000","last_undegraded":"2024-09-12T02:46:12.553677+0000","last_fullsized":"2024-09-12T02:46:12.553677+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:36.451449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"96'17","reported_seq":74,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.664196+0000","last_change":"2024-09-12T02:46:12.565117+0000","last_active":"2024-09-12T02:46:33.664196+0000","last_peered":"2024-09-12T02:46:33.664196+0000","last_clean":"2024-09-12T02:46:33.664196+0000","last_became_active":"2024-09-12T02:46:12.558657+0000","last_became_peered":"2024-09-12T02:46:12.558657+0000","last_unstale":"2024-09-12T02:46:33.664196+0000","last_undegraded":"2024-09-12T02:46:33.664196+0000","last_fullsized":"2024-09-12T02:46:33.664196+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:27.956347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.369096+0000","last_change":"2024-09-12T02:45:45.493917+0000","last_active":"2024-09-12T02:46:13.369096+0000","last_peered":"2024-09-12T02:46:13.369096+0000","last_clean":"2024-09-12T02:46:13.369096+0000","last_became_active":"2024-09-12T02:45:45.493488+0000","last_became_peered":"2024-09-12T02:45:45.493488+0000","last_unstale":"2024-09-12T02:46:13.369096+0000","last_undegraded":"2024-09-12T02:46:13.369096+0000","last_fullsized":"2024-09-12T02:46:13.369096+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:27.092953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555573+0000","last_change":"2024-09-12T02:45:35.423430+0000","last_active":"2024-09-12T02:46:12.555573+0000","last_peered":"2024-09-12T02:46:12.555573+0000","last_clean":"2024-09-12T02:46:12.555573+0000","last_became_active":"2024-09-12T02:45:35.423097+0000","last_became_peered":"2024-09-12T02:45:35.423097+0000","last_unstale":"2024-09-12T02:46:12.555573+0000","last_undegraded":"2024-09-12T02:46:12.555573+0000","last_fullsized":"2024-09-12T02:46:12.555573+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:53.823140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"96'5","reported_seq":64,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:50.701885+0000","last_change":"2024-09-12T02:45:32.384965+0000","last_active":"2024-09-12T02:46:50.701885+0000","last_peered":"2024-09-12T02:46:50.701885+0000","last_clean":"2024-09-12T02:46:50.701885+0000","last_became_active":"2024-09-12T02:45:32.384369+0000","last_became_peered":"2024-09-12T02:45:32.384369+0000","last_unstale":"2024-09-12T02:46:50.701885+0000","last_undegraded":"2024-09-12T02:46:50.701885+0000","last_fullsized":"2024-09-12T02:46:50.701885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:43.022766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555604+0000","last_change":"2024-09-12T02:45:45.491338+0000","last_active":"2024-09-12T02:46:12.555604+0000","last_peered":"2024-09-12T02:46:12.555604+0000","last_clean":"2024-09-12T02:46:12.555604+0000","last_became_active":"2024-09-12T02:45:45.490578+0000","last_became_peered":"2024-09-12T02:45:45.490578+0000","last_unstale":"2024-09-12T02:46:12.555604+0000","last_undegraded":"2024-09-12T02:46:12.555604+0000","last_fullsized":"2024-09-12T02:46:12.555604+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:28.609202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556692+0000","last_change":"2024-09-12T02:45:35.429907+0000","last_active":"2024-09-12T02:46:12.556692+0000","last_peered":"2024-09-12T02:46:12.556692+0000","last_clean":"2024-09-12T02:46:12.556692+0000","last_became_active":"2024-09-12T02:45:35.429546+0000","last_became_peered":"2024-09-12T02:45:35.429546+0000","last_unstale":"2024-09-12T02:46:12.556692+0000","last_undegraded":"2024-09-12T02:46:12.556692+0000","last_fullsized":"2024-09-12T02:46:12.556692+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:50.471835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"96'5","reported_seq":45,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.666028+0000","last_change":"2024-09-12T02:45:32.390663+0000","last_active":"2024-09-12T02:46:33.666028+0000","last_peered":"2024-09-12T02:46:33.666028+0000","last_clean":"2024-09-12T02:46:33.666028+0000","last_became_active":"2024-09-12T02:45:32.390316+0000","last_became_peered":"2024-09-12T02:45:32.390316+0000","last_unstale":"2024-09-12T02:46:33.666028+0000","last_undegraded":"2024-09-12T02:46:33.666028+0000","last_fullsized":"2024-09-12T02:46:33.666028+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:11.605522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555529+0000","last_change":"2024-09-12T02:45:45.494111+0000","last_active":"2024-09-12T02:46:12.555529+0000","last_peered":"2024-09-12T02:46:12.555529+0000","last_clean":"2024-09-12T02:46:12.555529+0000","last_became_active":"2024-09-12T02:45:45.493709+0000","last_became_peered":"2024-09-12T02:45:45.493709+0000","last_unstale":"2024-09-12T02:46:12.555529+0000","last_undegraded":"2024-09-12T02:46:12.555529+0000","last_fullsized":"2024-09-12T02:46:12.555529+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:24.998025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.368654+0000","last_change":"2024-09-12T02:45:35.442187+0000","last_active":"2024-09-12T02:46:13.368654+0000","last_peered":"2024-09-12T02:46:13.368654+0000","last_clean":"2024-09-12T02:46:13.368654+0000","last_became_active":"2024-09-12T02:45:35.441751+0000","last_became_peered":"2024-09-12T02:45:35.441751+0000","last_unstale":"2024-09-12T02:46:13.368654+0000","last_undegraded":"2024-09-12T02:46:13.368654+0000","last_fullsized":"2024-09-12T02:46:13.368654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:53.014758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"96'9","reported_seq":51,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:34.670345+0000","last_change":"2024-09-12T02:45:32.394390+0000","last_active":"2024-09-12T02:46:34.670345+0000","last_peered":"2024-09-12T02:46:34.670345+0000","last_clean":"2024-09-12T02:46:34.670345+0000","last_became_active":"2024-09-12T02:45:32.392304+0000","last_became_peered":"2024-09-12T02:45:32.392304+0000","last_unstale":"2024-09-12T02:46:34.670345+0000","last_undegraded":"2024-09-12T02:46:34.670345+0000","last_fullsized":"2024-09-12T02:46:34.670345+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:16.412697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.554380+0000","last_change":"2024-09-12T02:45:45.491459+0000","last_active":"2024-09-12T02:46:12.554380+0000","last_peered":"2024-09-12T02:46:12.554380+0000","last_clean":"2024-09-12T02:46:12.554380+0000","last_became_active":"2024-09-12T02:45:45.490857+0000","last_became_peered":"2024-09-12T02:45:45.490857+0000","last_unstale":"2024-09-12T02:46:12.554380+0000","last_undegraded":"2024-09-12T02:46:12.554380+0000","last_fullsized":"2024-09-12T02:46:12.554380+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:39.712007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555244+0000","last_change":"2024-09-12T02:45:35.431311+0000","last_active":"2024-09-12T02:46:12.555244+0000","last_peered":"2024-09-12T02:46:12.555244+0000","last_clean":"2024-09-12T02:46:12.555244+0000","last_became_active":"2024-09-12T02:45:35.430446+0000","last_became_peered":"2024-09-12T02:45:35.430446+0000","last_unstale":"2024-09-12T02:46:12.555244+0000","last_undegraded":"2024-09-12T02:46:12.555244+0000","last_fullsized":"2024-09-12T02:46:12.555244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:28.526132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"96'31","reported_seq":107,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:48.701095+0000","last_change":"2024-09-12T02:45:32.395938+0000","last_active":"2024-09-12T02:46:48.701095+0000","last_peered":"2024-09-12T02:46:48.701095+0000","last_clean":"2024-09-12T02:46:48.701095+0000","last_became_active":"2024-09-12T02:45:32.395509+0000","last_became_peered":"2024-09-12T02:45:32.395509+0000","last_unstale":"2024-09-12T02:46:48.701095+0000","last_undegraded":"2024-09-12T02:46:48.701095+0000","last_fullsized":"2024-09-12T02:46:48.701095+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:17.401062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51899,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":69,"num_write":33,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555210+0000","last_change":"2024-09-12T02:45:45.493335+0000","last_active":"2024-09-12T02:46:12.555210+0000","last_peered":"2024-09-12T02:46:12.555210+0000","last_clean":"2024-09-12T02:46:12.555210+0000","last_became_active":"2024-09-12T02:45:45.490473+0000","last_became_peered":"2024-09-12T02:45:45.490473+0000","last_unstale":"2024-09-12T02:46:12.555210+0000","last_undegraded":"2024-09-12T02:46:12.555210+0000","last_fullsized":"2024-09-12T02:46:12.555210+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:10.375643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.951733+0000","last_change":"2024-09-12T02:46:12.951215+0000","last_active":"2024-09-12T02:46:12.951733+0000","last_peered":"2024-09-12T02:46:12.951733+0000","last_clean":"2024-09-12T02:46:12.951733+0000","last_became_active":"2024-09-12T02:46:12.950829+0000","last_became_peered":"2024-09-12T02:46:12.950829+0000","last_unstale":"2024-09-12T02:46:12.951733+0000","last_undegraded":"2024-09-12T02:46:12.951733+0000","last_fullsized":"2024-09-12T02:46:12.951733+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:42.251826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,4],"acting":[9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.15","version":"96'5","reported_seq":45,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:32.647405+0000","last_change":"2024-09-12T02:45:32.477587+0000","last_active":"2024-09-12T02:46:32.647405+0000","last_peered":"2024-09-12T02:46:32.647405+0000","last_clean":"2024-09-12T02:46:32.647405+0000","last_became_active":"2024-09-12T02:45:32.477084+0000","last_became_peered":"2024-09-12T02:45:32.477084+0000","last_unstale":"2024-09-12T02:46:32.647405+0000","last_undegraded":"2024-09-12T02:46:32.647405+0000","last_fullsized":"2024-09-12T02:46:32.647405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:24.363281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.950597+0000","last_change":"2024-09-12T02:45:45.493505+0000","last_active":"2024-09-12T02:46:12.950597+0000","last_peered":"2024-09-12T02:46:12.950597+0000","last_clean":"2024-09-12T02:46:12.950597+0000","last_became_active":"2024-09-12T02:45:45.492903+0000","last_became_peered":"2024-09-12T02:45:45.492903+0000","last_unstale":"2024-09-12T02:46:12.950597+0000","last_undegraded":"2024-09-12T02:46:12.950597+0000","last_fullsized":"2024-09-12T02:46:12.950597+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:23.365274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.559236+0000","last_change":"2024-09-12T02:45:35.422762+0000","last_active":"2024-09-12T02:46:12.559236+0000","last_peered":"2024-09-12T02:46:12.559236+0000","last_clean":"2024-09-12T02:46:12.559236+0000","last_became_active":"2024-09-12T02:45:35.422457+0000","last_became_peered":"2024-09-12T02:45:35.422457+0000","last_unstale":"2024-09-12T02:46:12.559236+0000","last_undegraded":"2024-09-12T02:46:12.559236+0000","last_fullsized":"2024-09-12T02:46:12.559236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:41.437234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"96'4","reported_seq":43,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.664166+0000","last_change":"2024-09-12T02:45:32.391699+0000","last_active":"2024-09-12T02:46:33.664166+0000","last_peered":"2024-09-12T02:46:33.664166+0000","last_clean":"2024-09-12T02:46:33.664166+0000","last_became_active":"2024-09-12T02:45:32.391114+0000","last_became_peered":"2024-09-12T02:45:32.391114+0000","last_unstale":"2024-09-12T02:46:33.664166+0000","last_undegraded":"2024-09-12T02:46:33.664166+0000","last_fullsized":"2024-09-12T02:46:33.664166+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:25.751549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.554739+0000","last_change":"2024-09-12T02:45:45.486896+0000","last_active":"2024-09-12T02:46:12.554739+0000","last_peered":"2024-09-12T02:46:12.554739+0000","last_clean":"2024-09-12T02:46:12.554739+0000","last_became_active":"2024-09-12T02:45:45.486465+0000","last_became_peered":"2024-09-12T02:45:45.486465+0000","last_unstale":"2024-09-12T02:46:12.554739+0000","last_undegraded":"2024-09-12T02:46:12.554739+0000","last_fullsized":"2024-09-12T02:46:12.554739+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:21.774968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553296+0000","last_change":"2024-09-12T02:45:35.424470+0000","last_active":"2024-09-12T02:46:12.553296+0000","last_peered":"2024-09-12T02:46:12.553296+0000","last_clean":"2024-09-12T02:46:12.553296+0000","last_became_active":"2024-09-12T02:45:35.424129+0000","last_became_peered":"2024-09-12T02:45:35.424129+0000","last_unstale":"2024-09-12T02:46:12.553296+0000","last_undegraded":"2024-09-12T02:46:12.553296+0000","last_fullsized":"2024-09-12T02:46:12.553296+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:25.541549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"96'4","reported_seq":73,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:48.695951+0000","last_change":"2024-09-12T02:45:32.388773+0000","last_active":"2024-09-12T02:46:48.695951+0000","last_peered":"2024-09-12T02:46:48.695951+0000","last_clean":"2024-09-12T02:46:48.695951+0000","last_became_active":"2024-09-12T02:45:32.388403+0000","last_became_peered":"2024-09-12T02:45:32.388403+0000","last_unstale":"2024-09-12T02:46:48.695951+0000","last_undegraded":"2024-09-12T02:46:48.695951+0000","last_fullsized":"2024-09-12T02:46:48.695951+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:20.756820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550117+0000","last_change":"2024-09-12T02:45:45.490632+0000","last_active":"2024-09-12T02:46:12.550117+0000","last_peered":"2024-09-12T02:46:12.550117+0000","last_clean":"2024-09-12T02:46:12.550117+0000","last_became_active":"2024-09-12T02:45:45.490098+0000","last_became_peered":"2024-09-12T02:45:45.490098+0000","last_unstale":"2024-09-12T02:46:12.550117+0000","last_undegraded":"2024-09-12T02:46:12.550117+0000","last_fullsized":"2024-09-12T02:46:12.550117+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:07.780423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.558511+0000","last_change":"2024-09-12T02:45:45.481451+0000","last_active":"2024-09-12T02:46:12.558511+0000","last_peered":"2024-09-12T02:46:12.558511+0000","last_clean":"2024-09-12T02:46:12.558511+0000","last_became_active":"2024-09-12T02:45:45.480969+0000","last_became_peered":"2024-09-12T02:45:45.480969+0000","last_unstale":"2024-09-12T02:46:12.558511+0000","last_undegraded":"2024-09-12T02:46:12.558511+0000","last_fullsized":"2024-09-12T02:46:12.558511+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:25.320414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.554975+0000","last_change":"2024-09-12T02:45:35.435918+0000","last_active":"2024-09-12T02:46:12.554975+0000","last_peered":"2024-09-12T02:46:12.554975+0000","last_clean":"2024-09-12T02:46:12.554975+0000","last_became_active":"2024-09-12T02:45:35.433911+0000","last_became_peered":"2024-09-12T02:45:35.433911+0000","last_unstale":"2024-09-12T02:46:12.554975+0000","last_undegraded":"2024-09-12T02:46:12.554975+0000","last_fullsized":"2024-09-12T02:46:12.554975+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:27.147122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"96'3","reported_seq":43,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.665587+0000","last_change":"2024-09-12T02:45:32.391021+0000","last_active":"2024-09-12T02:46:33.665587+0000","last_peered":"2024-09-12T02:46:33.665587+0000","last_clean":"2024-09-12T02:46:33.665587+0000","last_became_active":"2024-09-12T02:45:32.390532+0000","last_became_peered":"2024-09-12T02:45:32.390532+0000","last_unstale":"2024-09-12T02:46:33.665587+0000","last_undegraded":"2024-09-12T02:46:33.665587+0000","last_fullsized":"2024-09-12T02:46:33.665587+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:22.708802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555816+0000","last_change":"2024-09-12T02:45:45.494725+0000","last_active":"2024-09-12T02:46:12.555816+0000","last_peered":"2024-09-12T02:46:12.555816+0000","last_clean":"2024-09-12T02:46:12.555816+0000","last_became_active":"2024-09-12T02:45:45.494212+0000","last_became_peered":"2024-09-12T02:45:45.494212+0000","last_unstale":"2024-09-12T02:46:12.555816+0000","last_undegraded":"2024-09-12T02:46:12.555816+0000","last_fullsized":"2024-09-12T02:46:12.555816+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:52.305590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550186+0000","last_change":"2024-09-12T02:45:35.438200+0000","last_active":"2024-09-12T02:46:12.550186+0000","last_peered":"2024-09-12T02:46:12.550186+0000","last_clean":"2024-09-12T02:46:12.550186+0000","last_became_active":"2024-09-12T02:45:35.437585+0000","last_became_peered":"2024-09-12T02:45:35.437585+0000","last_unstale":"2024-09-12T02:46:12.550186+0000","last_undegraded":"2024-09-12T02:46:12.550186+0000","last_fullsized":"2024-09-12T02:46:12.550186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:57.675512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"96'3","reported_seq":43,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:31.643429+0000","last_change":"2024-09-12T02:45:32.385619+0000","last_active":"2024-09-12T02:46:31.643429+0000","last_peered":"2024-09-12T02:46:31.643429+0000","last_clean":"2024-09-12T02:46:31.643429+0000","last_became_active":"2024-09-12T02:45:32.384997+0000","last_became_peered":"2024-09-12T02:45:32.384997+0000","last_unstale":"2024-09-12T02:46:31.643429+0000","last_undegraded":"2024-09-12T02:46:31.643429+0000","last_fullsized":"2024-09-12T02:46:31.643429+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:11.716779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"96'7","reported_seq":46,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:32.648067+0000","last_change":"2024-09-12T02:45:32.388089+0000","last_active":"2024-09-12T02:46:32.648067+0000","last_peered":"2024-09-12T02:46:32.648067+0000","last_clean":"2024-09-12T02:46:32.648067+0000","last_became_active":"2024-09-12T02:45:32.387560+0000","last_became_peered":"2024-09-12T02:45:32.387560+0000","last_unstale":"2024-09-12T02:46:32.648067+0000","last_undegraded":"2024-09-12T02:46:32.648067+0000","last_fullsized":"2024-09-12T02:46:32.648067+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:14.290116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.558894+0000","last_change":"2024-09-12T02:46:12.558894+0000","last_active":"2024-09-12T02:46:12.558894+0000","last_peered":"2024-09-12T02:46:12.558894+0000","last_clean":"2024-09-12T02:46:12.558894+0000","last_became_active":"2024-09-12T02:46:12.558518+0000","last_became_peered":"2024-09-12T02:46:12.558518+0000","last_unstale":"2024-09-12T02:46:12.558894+0000","last_undegraded":"2024-09-12T02:46:12.558894+0000","last_fullsized":"2024-09-12T02:46:12.558894+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:00.171554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550842+0000","last_change":"2024-09-12T02:45:45.494098+0000","last_active":"2024-09-12T02:46:12.550842+0000","last_peered":"2024-09-12T02:46:12.550842+0000","last_clean":"2024-09-12T02:46:12.550842+0000","last_became_active":"2024-09-12T02:45:45.493698+0000","last_became_peered":"2024-09-12T02:45:45.493698+0000","last_unstale":"2024-09-12T02:46:12.550842+0000","last_undegraded":"2024-09-12T02:46:12.550842+0000","last_fullsized":"2024-09-12T02:46:12.550842+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:39.832159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"96'5","reported_seq":69,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:49.698005+0000","last_change":"2024-09-12T02:46:12.952787+0000","last_active":"2024-09-12T02:46:49.698005+0000","last_peered":"2024-09-12T02:46:49.698005+0000","last_clean":"2024-09-12T02:46:49.698005+0000","last_became_active":"2024-09-12T02:46:12.952373+0000","last_became_peered":"2024-09-12T02:46:12.952373+0000","last_unstale":"2024-09-12T02:46:49.698005+0000","last_undegraded":"2024-09-12T02:46:49.698005+0000","last_fullsized":"2024-09-12T02:46:49.698005+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:49.435438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.554922+0000","last_change":"2024-09-12T02:45:35.427334+0000","last_active":"2024-09-12T02:46:12.554922+0000","last_peered":"2024-09-12T02:46:12.554922+0000","last_clean":"2024-09-12T02:46:12.554922+0000","last_became_active":"2024-09-12T02:45:35.427010+0000","last_became_peered":"2024-09-12T02:45:35.427010+0000","last_unstale":"2024-09-12T02:46:12.554922+0000","last_undegraded":"2024-09-12T02:46:12.554922+0000","last_fullsized":"2024-09-12T02:46:12.554922+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:39.587384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550784+0000","last_change":"2024-09-12T02:45:45.482354+0000","last_active":"2024-09-12T02:46:12.550784+0000","last_peered":"2024-09-12T02:46:12.550784+0000","last_clean":"2024-09-12T02:46:12.550784+0000","last_became_active":"2024-09-12T02:45:45.481411+0000","last_became_peered":"2024-09-12T02:45:45.481411+0000","last_unstale":"2024-09-12T02:46:12.550784+0000","last_undegraded":"2024-09-12T02:46:12.550784+0000","last_fullsized":"2024-09-12T02:46:12.550784+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:43.049433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555056+0000","last_change":"2024-09-12T02:45:35.430793+0000","last_active":"2024-09-12T02:46:12.555056+0000","last_peered":"2024-09-12T02:46:12.555056+0000","last_clean":"2024-09-12T02:46:12.555056+0000","last_became_active":"2024-09-12T02:45:35.430468+0000","last_became_peered":"2024-09-12T02:45:35.430468+0000","last_unstale":"2024-09-12T02:46:12.555056+0000","last_undegraded":"2024-09-12T02:46:12.555056+0000","last_fullsized":"2024-09-12T02:46:12.555056+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:19.446186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.557140+0000","last_change":"2024-09-12T02:46:12.557140+0000","last_active":"2024-09-12T02:46:12.557140+0000","last_peered":"2024-09-12T02:46:12.557140+0000","last_clean":"2024-09-12T02:46:12.557140+0000","last_became_active":"2024-09-12T02:46:12.556649+0000","last_became_peered":"2024-09-12T02:46:12.556649+0000","last_unstale":"2024-09-12T02:46:12.557140+0000","last_undegraded":"2024-09-12T02:46:12.557140+0000","last_fullsized":"2024-09-12T02:46:12.557140+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:04.154036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550615+0000","last_change":"2024-09-12T02:45:35.438653+0000","last_active":"2024-09-12T02:46:12.550615+0000","last_peered":"2024-09-12T02:46:12.550615+0000","last_clean":"2024-09-12T02:46:12.550615+0000","last_became_active":"2024-09-12T02:45:35.438352+0000","last_became_peered":"2024-09-12T02:45:35.438352+0000","last_unstale":"2024-09-12T02:46:12.550615+0000","last_undegraded":"2024-09-12T02:46:12.550615+0000","last_fullsized":"2024-09-12T02:46:12.550615+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:34.665709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.558006+0000","last_change":"2024-09-12T02:45:35.424654+0000","last_active":"2024-09-12T02:46:12.558006+0000","last_peered":"2024-09-12T02:46:12.558006+0000","last_clean":"2024-09-12T02:46:12.558006+0000","last_became_active":"2024-09-12T02:45:35.423269+0000","last_became_peered":"2024-09-12T02:45:35.423269+0000","last_unstale":"2024-09-12T02:46:12.558006+0000","last_undegraded":"2024-09-12T02:46:12.558006+0000","last_fullsized":"2024-09-12T02:46:12.558006+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:16.595261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.369128+0000","last_change":"2024-09-12T02:45:35.428658+0000","last_active":"2024-09-12T02:46:13.369128+0000","last_peered":"2024-09-12T02:46:13.369128+0000","last_clean":"2024-09-12T02:46:13.369128+0000","last_became_active":"2024-09-12T02:45:35.428333+0000","last_became_peered":"2024-09-12T02:45:35.428333+0000","last_unstale":"2024-09-12T02:46:13.369128+0000","last_undegraded":"2024-09-12T02:46:13.369128+0000","last_fullsized":"2024-09-12T02:46:13.369128+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:41:38.418409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556428+0000","last_change":"2024-09-12T02:45:35.427806+0000","last_active":"2024-09-12T02:46:12.556428+0000","last_peered":"2024-09-12T02:46:12.556428+0000","last_clean":"2024-09-12T02:46:12.556428+0000","last_became_active":"2024-09-12T02:45:35.427418+0000","last_became_peered":"2024-09-12T02:45:35.427418+0000","last_unstale":"2024-09-12T02:46:12.556428+0000","last_undegraded":"2024-09-12T02:46:12.556428+0000","last_fullsized":"2024-09-12T02:46:12.556428+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:27.184153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.551099+0000","last_change":"2024-09-12T02:45:35.430350+0000","last_active":"2024-09-12T02:46:12.551099+0000","last_peered":"2024-09-12T02:46:12.551099+0000","last_clean":"2024-09-12T02:46:12.551099+0000","last_became_active":"2024-09-12T02:45:35.429807+0000","last_became_peered":"2024-09-12T02:45:35.429807+0000","last_unstale":"2024-09-12T02:46:12.551099+0000","last_undegraded":"2024-09-12T02:46:12.551099+0000","last_fullsized":"2024-09-12T02:46:12.551099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:41.043882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550873+0000","last_change":"2024-09-12T02:45:35.438354+0000","last_active":"2024-09-12T02:46:12.550873+0000","last_peered":"2024-09-12T02:46:12.550873+0000","last_clean":"2024-09-12T02:46:12.550873+0000","last_became_active":"2024-09-12T02:45:35.437987+0000","last_became_peered":"2024-09-12T02:45:35.437987+0000","last_unstale":"2024-09-12T02:46:12.550873+0000","last_undegraded":"2024-09-12T02:46:12.550873+0000","last_fullsized":"2024-09-12T02:46:12.550873+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:51.202605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553097+0000","last_change":"2024-09-12T02:45:35.438633+0000","last_active":"2024-09-12T02:46:12.553097+0000","last_peered":"2024-09-12T02:46:12.553097+0000","last_clean":"2024-09-12T02:46:12.553097+0000","last_became_active":"2024-09-12T02:45:35.438288+0000","last_became_peered":"2024-09-12T02:45:35.438288+0000","last_unstale":"2024-09-12T02:46:12.553097+0000","last_undegraded":"2024-09-12T02:46:12.553097+0000","last_fullsized":"2024-09-12T02:46:12.553097+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:22.037816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550253+0000","last_change":"2024-09-12T02:45:35.437493+0000","last_active":"2024-09-12T02:46:12.550253+0000","last_peered":"2024-09-12T02:46:12.550253+0000","last_clean":"2024-09-12T02:46:12.550253+0000","last_became_active":"2024-09-12T02:45:35.434830+0000","last_became_peered":"2024-09-12T02:45:35.434830+0000","last_unstale":"2024-09-12T02:46:12.550253+0000","last_undegraded":"2024-09-12T02:46:12.550253+0000","last_fullsized":"2024-09-12T02:46:12.550253+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:16.970119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.558495+0000","last_change":"2024-09-12T02:46:12.558495+0000","last_active":"2024-09-12T02:46:12.558495+0000","last_peered":"2024-09-12T02:46:12.558495+0000","last_clean":"2024-09-12T02:46:12.558495+0000","last_became_active":"2024-09-12T02:46:12.558172+0000","last_became_peered":"2024-09-12T02:46:12.558172+0000","last_unstale":"2024-09-12T02:46:12.558495+0000","last_undegraded":"2024-09-12T02:46:12.558495+0000","last_fullsized":"2024-09-12T02:46:12.558495+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:02.114483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,8],"acting":[1,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.368921+0000","last_change":"2024-09-12T02:45:35.428552+0000","last_active":"2024-09-12T02:46:13.368921+0000","last_peered":"2024-09-12T02:46:13.368921+0000","last_clean":"2024-09-12T02:46:13.368921+0000","last_became_active":"2024-09-12T02:45:35.428029+0000","last_became_peered":"2024-09-12T02:45:35.428029+0000","last_unstale":"2024-09-12T02:46:13.368921+0000","last_undegraded":"2024-09-12T02:46:13.368921+0000","last_fullsized":"2024-09-12T02:46:13.368921+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:57.669432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555626+0000","last_change":"2024-09-12T02:45:35.427928+0000","last_active":"2024-09-12T02:46:12.555626+0000","last_peered":"2024-09-12T02:46:12.555626+0000","last_clean":"2024-09-12T02:46:12.555626+0000","last_became_active":"2024-09-12T02:45:35.427452+0000","last_became_peered":"2024-09-12T02:45:35.427452+0000","last_unstale":"2024-09-12T02:46:12.555626+0000","last_undegraded":"2024-09-12T02:46:12.555626+0000","last_fullsized":"2024-09-12T02:46:12.555626+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:01.646899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.551121+0000","last_change":"2024-09-12T02:45:35.432714+0000","last_active":"2024-09-12T02:46:12.551121+0000","last_peered":"2024-09-12T02:46:12.551121+0000","last_clean":"2024-09-12T02:46:12.551121+0000","last_became_active":"2024-09-12T02:45:35.431698+0000","last_became_peered":"2024-09-12T02:45:35.431698+0000","last_unstale":"2024-09-12T02:46:12.551121+0000","last_undegraded":"2024-09-12T02:46:12.551121+0000","last_fullsized":"2024-09-12T02:46:12.551121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:34.925405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555766+0000","last_change":"2024-09-12T02:45:35.432157+0000","last_active":"2024-09-12T02:46:12.555766+0000","last_peered":"2024-09-12T02:46:12.555766+0000","last_clean":"2024-09-12T02:46:12.555766+0000","last_became_active":"2024-09-12T02:45:35.431847+0000","last_became_peered":"2024-09-12T02:45:35.431847+0000","last_unstale":"2024-09-12T02:46:12.555766+0000","last_undegraded":"2024-09-12T02:46:12.555766+0000","last_fullsized":"2024-09-12T02:46:12.555766+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:43.928689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556186+0000","last_change":"2024-09-12T02:45:35.429942+0000","last_active":"2024-09-12T02:46:12.556186+0000","last_peered":"2024-09-12T02:46:12.556186+0000","last_clean":"2024-09-12T02:46:12.556186+0000","last_became_active":"2024-09-12T02:45:35.429154+0000","last_became_peered":"2024-09-12T02:45:35.429154+0000","last_unstale":"2024-09-12T02:46:12.556186+0000","last_undegraded":"2024-09-12T02:46:12.556186+0000","last_fullsized":"2024-09-12T02:46:12.556186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:03.888466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.552068+0000","last_change":"2024-09-12T02:45:35.429241+0000","last_active":"2024-09-12T02:46:12.552068+0000","last_peered":"2024-09-12T02:46:12.552068+0000","last_clean":"2024-09-12T02:46:12.552068+0000","last_became_active":"2024-09-12T02:45:35.428927+0000","last_became_peered":"2024-09-12T02:45:35.428927+0000","last_unstale":"2024-09-12T02:46:12.552068+0000","last_undegraded":"2024-09-12T02:46:12.552068+0000","last_fullsized":"2024-09-12T02:46:12.552068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:04.306748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.557230+0000","last_change":"2024-09-12T02:45:35.424196+0000","last_active":"2024-09-12T02:46:12.557230+0000","last_peered":"2024-09-12T02:46:12.557230+0000","last_clean":"2024-09-12T02:46:12.557230+0000","last_became_active":"2024-09-12T02:45:35.423882+0000","last_became_peered":"2024-09-12T02:45:35.423882+0000","last_unstale":"2024-09-12T02:46:12.557230+0000","last_undegraded":"2024-09-12T02:46:12.557230+0000","last_fullsized":"2024-09-12T02:46:12.557230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:35.118183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.557801+0000","last_change":"2024-09-12T02:45:35.426770+0000","last_active":"2024-09-12T02:46:12.557801+0000","last_peered":"2024-09-12T02:46:12.557801+0000","last_clean":"2024-09-12T02:46:12.557801+0000","last_became_active":"2024-09-12T02:45:35.425905+0000","last_became_peered":"2024-09-12T02:45:35.425905+0000","last_unstale":"2024-09-12T02:46:12.557801+0000","last_undegraded":"2024-09-12T02:46:12.557801+0000","last_fullsized":"2024-09-12T02:46:12.557801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:35.447860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.368875+0000","last_change":"2024-09-12T02:45:35.423413+0000","last_active":"2024-09-12T02:46:13.368875+0000","last_peered":"2024-09-12T02:46:13.368875+0000","last_clean":"2024-09-12T02:46:13.368875+0000","last_became_active":"2024-09-12T02:45:35.423113+0000","last_became_peered":"2024-09-12T02:45:35.423113+0000","last_unstale":"2024-09-12T02:46:13.368875+0000","last_undegraded":"2024-09-12T02:46:13.368875+0000","last_fullsized":"2024-09-12T02:46:13.368875+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:24.194882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.951171+0000","last_change":"2024-09-12T02:45:35.427814+0000","last_active":"2024-09-12T02:46:12.951171+0000","last_peered":"2024-09-12T02:46:12.951171+0000","last_clean":"2024-09-12T02:46:12.951171+0000","last_became_active":"2024-09-12T02:45:35.427495+0000","last_became_peered":"2024-09-12T02:45:35.427495+0000","last_unstale":"2024-09-12T02:46:12.951171+0000","last_undegraded":"2024-09-12T02:46:12.951171+0000","last_fullsized":"2024-09-12T02:46:12.951171+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:36:59.459681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556896+0000","last_change":"2024-09-12T02:45:35.432816+0000","last_active":"2024-09-12T02:46:12.556896+0000","last_peered":"2024-09-12T02:46:12.556896+0000","last_clean":"2024-09-12T02:46:12.556896+0000","last_became_active":"2024-09-12T02:45:35.432415+0000","last_became_peered":"2024-09-12T02:45:35.432415+0000","last_unstale":"2024-09-12T02:46:12.556896+0000","last_undegraded":"2024-09-12T02:46:12.556896+0000","last_fullsized":"2024-09-12T02:46:12.556896+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:06.434342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.554370+0000","last_change":"2024-09-12T02:45:35.417788+0000","last_active":"2024-09-12T02:46:12.554370+0000","last_peered":"2024-09-12T02:46:12.554370+0000","last_clean":"2024-09-12T02:46:12.554370+0000","last_became_active":"2024-09-12T02:45:35.417382+0000","last_became_peered":"2024-09-12T02:45:35.417382+0000","last_unstale":"2024-09-12T02:46:12.554370+0000","last_undegraded":"2024-09-12T02:46:12.554370+0000","last_fullsized":"2024-09-12T02:46:12.554370+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:38.752047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.552943+0000","last_change":"2024-09-12T02:45:35.422546+0000","last_active":"2024-09-12T02:46:12.552943+0000","last_peered":"2024-09-12T02:46:12.552943+0000","last_clean":"2024-09-12T02:46:12.552943+0000","last_became_active":"2024-09-12T02:45:35.422184+0000","last_became_peered":"2024-09-12T02:45:35.422184+0000","last_unstale":"2024-09-12T02:46:12.552943+0000","last_undegraded":"2024-09-12T02:46:12.552943+0000","last_fullsized":"2024-09-12T02:46:12.552943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.022551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550180+0000","last_change":"2024-09-12T02:45:35.435371+0000","last_active":"2024-09-12T02:46:12.550180+0000","last_peered":"2024-09-12T02:46:12.550180+0000","last_clean":"2024-09-12T02:46:12.550180+0000","last_became_active":"2024-09-12T02:45:35.435054+0000","last_became_peered":"2024-09-12T02:45:35.435054+0000","last_unstale":"2024-09-12T02:46:12.550180+0000","last_undegraded":"2024-09-12T02:46:12.550180+0000","last_fullsized":"2024-09-12T02:46:12.550180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:18.099755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556306+0000","last_change":"2024-09-12T02:45:35.421617+0000","last_active":"2024-09-12T02:46:12.556306+0000","last_peered":"2024-09-12T02:46:12.556306+0000","last_clean":"2024-09-12T02:46:12.556306+0000","last_became_active":"2024-09-12T02:45:35.421247+0000","last_became_peered":"2024-09-12T02:45:35.421247+0000","last_unstale":"2024-09-12T02:46:12.556306+0000","last_undegraded":"2024-09-12T02:46:12.556306+0000","last_fullsized":"2024-09-12T02:46:12.556306+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:04.457638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.370227+0000","last_change":"2024-09-12T02:46:13.370227+0000","last_active":"2024-09-12T02:46:13.370227+0000","last_peered":"2024-09-12T02:46:13.370227+0000","last_clean":"2024-09-12T02:46:13.370227+0000","last_became_active":"2024-09-12T02:46:13.369826+0000","last_became_peered":"2024-09-12T02:46:13.369826+0000","last_unstale":"2024-09-12T02:46:13.370227+0000","last_undegraded":"2024-09-12T02:46:13.370227+0000","last_fullsized":"2024-09-12T02:46:13.370227+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:13.621494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555079+0000","last_change":"2024-09-12T02:45:35.441542+0000","last_active":"2024-09-12T02:46:12.555079+0000","last_peered":"2024-09-12T02:46:12.555079+0000","last_clean":"2024-09-12T02:46:12.555079+0000","last_became_active":"2024-09-12T02:45:35.441215+0000","last_became_peered":"2024-09-12T02:45:35.441215+0000","last_unstale":"2024-09-12T02:46:12.555079+0000","last_undegraded":"2024-09-12T02:46:12.555079+0000","last_fullsized":"2024-09-12T02:46:12.555079+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:42.978480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.951037+0000","last_change":"2024-09-12T02:45:35.425410+0000","last_active":"2024-09-12T02:46:12.951037+0000","last_peered":"2024-09-12T02:46:12.951037+0000","last_clean":"2024-09-12T02:46:12.951037+0000","last_became_active":"2024-09-12T02:45:35.424960+0000","last_became_peered":"2024-09-12T02:45:35.424960+0000","last_unstale":"2024-09-12T02:46:12.951037+0000","last_undegraded":"2024-09-12T02:46:12.951037+0000","last_fullsized":"2024-09-12T02:46:12.951037+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:45.162712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.558414+0000","last_change":"2024-09-12T02:45:35.415105+0000","last_active":"2024-09-12T02:46:12.558414+0000","last_peered":"2024-09-12T02:46:12.558414+0000","last_clean":"2024-09-12T02:46:12.558414+0000","last_became_active":"2024-09-12T02:45:35.414338+0000","last_became_peered":"2024-09-12T02:45:35.414338+0000","last_unstale":"2024-09-12T02:46:12.558414+0000","last_undegraded":"2024-09-12T02:46:12.558414+0000","last_fullsized":"2024-09-12T02:46:12.558414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:45.011716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.558654+0000","last_change":"2024-09-12T02:45:35.420637+0000","last_active":"2024-09-12T02:46:12.558654+0000","last_peered":"2024-09-12T02:46:12.558654+0000","last_clean":"2024-09-12T02:46:12.558654+0000","last_became_active":"2024-09-12T02:45:35.420354+0000","last_became_peered":"2024-09-12T02:45:35.420354+0000","last_unstale":"2024-09-12T02:46:12.558654+0000","last_undegraded":"2024-09-12T02:46:12.558654+0000","last_fullsized":"2024-09-12T02:46:12.558654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:15.807265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556094+0000","last_change":"2024-09-12T02:45:35.429505+0000","last_active":"2024-09-12T02:46:12.556094+0000","last_peered":"2024-09-12T02:46:12.556094+0000","last_clean":"2024-09-12T02:46:12.556094+0000","last_became_active":"2024-09-12T02:45:35.428728+0000","last_became_peered":"2024-09-12T02:45:35.428728+0000","last_unstale":"2024-09-12T02:46:12.556094+0000","last_undegraded":"2024-09-12T02:46:12.556094+0000","last_fullsized":"2024-09-12T02:46:12.556094+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:15.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59107,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":198,"num_read_kb":161,"num_write":239,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":177321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416412,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1114112,"data_stored":546718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678049,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28772,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716380,"statfs":{"total":95995035648,"available":95965573120,"internally_reserved":0,"allocated":1789952,"data_stored":1184928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841574,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1134592,"data_stored":550239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070508,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32276,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712876,"statfs":{"total":95995035648,"available":95961985024,"internally_reserved":0,"allocated":1118208,"data_stored":546409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332146,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37028,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708124,"statfs":{"total":95995035648,"available":95957118976,"internally_reserved":0,"allocated":1724416,"data_stored":1143020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495671,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":542040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757309,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28716,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716436,"statfs":{"total":95995035648,"available":95965630464,"internally_reserved":0,"allocated":1732608,"data_stored":1138209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920835,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1122304,"data_stored":546343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182472,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1118208,"data_stored":541355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1167360,"data_stored":594455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28168,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716984,"statfs":{"total":95995035648,"available":95966191616,"internally_reserved":0,"allocated":1171456,"data_stored":595081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1130496,"data_stored":543496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":54156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":53530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":53635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:46:55.179 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:46:55.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:54 smithi176 ceph-mon[35713]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:46:55.561 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:56.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:55 smithi062 ceph-mon[35527]: pgmap v348: 129 pgs: 129 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-12T02:46:56.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:55 smithi018 ceph-mon[30616]: pgmap v348: 129 pgs: 129 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-12T02:46:56.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.153+0000 7f2638a00640 1 -- 172.21.15.18:0/92471425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2634103ff0 msgr2=0x7f26341043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:56.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.153+0000 7f2638a00640 1 --2- 172.21.15.18:0/92471425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2634103ff0 0x7f26341043d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2624009900 tx=0x7f262402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.153+0000 7f2638a00640 1 -- 172.21.15.18:0/92471425 shutdown_connections 2024-09-12T02:46:56.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.153+0000 7f2638a00640 1 --2- 172.21.15.18:0/92471425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2634109120 0x7f2634110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.153+0000 7f2638a00640 1 --2- 172.21.15.18:0/92471425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26341049a0 0x7f26341089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.153+0000 7f2638a00640 1 --2- 172.21.15.18:0/92471425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2634103ff0 0x7f26341043d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.153+0000 7f2638a00640 1 -- 172.21.15.18:0/92471425 >> 172.21.15.18:0/92471425 conn(0x7f26340ffa90 msgr2=0x7f2634101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:56.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.153+0000 7f2638a00640 1 -- 172.21.15.18:0/92471425 shutdown_connections 2024-09-12T02:46:56.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.153+0000 7f2638a00640 1 -- 172.21.15.18:0/92471425 wait complete. 2024-09-12T02:46:56.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.154+0000 7f2638a00640 1 Processor -- start 2024-09-12T02:46:56.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.154+0000 7f2638a00640 1 -- start start 2024-09-12T02:46:56.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.154+0000 7f2638a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2634103ff0 0x7f263419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:56.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.154+0000 7f2638a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26341049a0 0x7f263419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:56.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.154+0000 7f2638a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2634109120 0x7f263419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:56.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.154+0000 7f2638a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2634114170 con 0x7f26341049a0 2024-09-12T02:46:56.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.154+0000 7f2638a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2634113ff0 con 0x7f2634103ff0 2024-09-12T02:46:56.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.154+0000 7f2638a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f26341142f0 con 0x7f2634109120 2024-09-12T02:46:56.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.155+0000 7f2631e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2634103ff0 0x7f263419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:56.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.155+0000 7f262be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26341049a0 0x7f263419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:56.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.155+0000 7f2631e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2634103ff0 0x7f263419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:54310/0 (socket says 172.21.15.18:54310) 2024-09-12T02:46:56.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.155+0000 7f2631e00640 1 -- 172.21.15.18:0/124746600 learned_addr learned my addr 172.21.15.18:0/124746600 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:56.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.155+0000 7f2632800640 1 --2- 172.21.15.18:0/124746600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2634109120 0x7f263419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:56.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.155+0000 7f2631e00640 1 -- 172.21.15.18:0/124746600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2634109120 msgr2=0x7f263419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:56.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.155+0000 7f2631e00640 1 --2- 172.21.15.18:0/124746600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2634109120 0x7f263419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.155+0000 7f2631e00640 1 -- 172.21.15.18:0/124746600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26341049a0 msgr2=0x7f263419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:56.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.155+0000 7f2631e00640 1 --2- 172.21.15.18:0/124746600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26341049a0 0x7f263419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.155+0000 7f2631e00640 1 -- 172.21.15.18:0/124746600 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263419f640 con 0x7f2634103ff0 2024-09-12T02:46:56.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.155+0000 7f262be00640 1 --2- 172.21.15.18:0/124746600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26341049a0 0x7f263419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:46:56.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.156+0000 7f2631e00640 1 --2- 172.21.15.18:0/124746600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2634103ff0 0x7f263419a690 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2624004770 tx=0x7f2624003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:56.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.156+0000 7f262aa00640 1 -- 172.21.15.18:0/124746600 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262403f070 con 0x7f2634103ff0 2024-09-12T02:46:56.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.156+0000 7f262aa00640 1 -- 172.21.15.18:0/124746600 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2624031ca0 con 0x7f2634103ff0 2024-09-12T02:46:56.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.156+0000 7f2638a00640 1 -- 172.21.15.18:0/124746600 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263419f8d0 con 0x7f2634103ff0 2024-09-12T02:46:56.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.156+0000 7f2638a00640 1 -- 172.21.15.18:0/124746600 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26341a7210 con 0x7f2634103ff0 2024-09-12T02:46:56.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.156+0000 7f262aa00640 1 -- 172.21.15.18:0/124746600 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2624035030 con 0x7f2634103ff0 2024-09-12T02:46:56.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.157+0000 7f2638a00640 1 -- 172.21.15.18:0/124746600 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2610005290 con 0x7f2634103ff0 2024-09-12T02:46:56.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.159+0000 7f262aa00640 1 -- 172.21.15.18:0/124746600 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2624042070 con 0x7f2634103ff0 2024-09-12T02:46:56.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.160+0000 7f262aa00640 1 --2- 172.21.15.18:0/124746600 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f26180a2c90 0x7f26180a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:56.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.160+0000 7f262aa00640 1 -- 172.21.15.18:0/124746600 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7f26240ef9a0 con 0x7f2634103ff0 2024-09-12T02:46:56.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.161+0000 7f262be00640 1 --2- 172.21.15.18:0/124746600 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f26180a2c90 0x7f26180a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:56.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.161+0000 7f262be00640 1 --2- 172.21.15.18:0/124746600 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f26180a2c90 0x7f26180a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f26340fff40 tx=0x7f261c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:56.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.164+0000 7f262aa00640 1 -- 172.21.15.18:0/124746600 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f26240bc3e0 con 0x7f2634103ff0 2024-09-12T02:46:56.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:55 smithi176 ceph-mon[35713]: pgmap v348: 129 pgs: 129 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-12T02:46:56.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.348+0000 7f2638a00640 1 -- 172.21.15.18:0/124746600 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2610000bc0 con 0x7f26180a2c90 2024-09-12T02:46:56.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.358+0000 7f262aa00640 1 -- 172.21.15.18:0/124746600 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340391 (secure 0 0 0) 0x7f2610000bc0 con 0x7f26180a2c90 2024-09-12T02:46:56.363 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:46:56.364 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-12T02:46:56.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.364+0000 7f2638a00640 1 -- 172.21.15.18:0/124746600 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f26180a2c90 msgr2=0x7f26180a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:56.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.364+0000 7f2638a00640 1 --2- 172.21.15.18:0/124746600 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f26180a2c90 0x7f26180a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f26340fff40 tx=0x7f261c005f90 comp rx=0 tx=0).stop 2024-09-12T02:46:56.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.364+0000 7f2638a00640 1 -- 172.21.15.18:0/124746600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2634103ff0 msgr2=0x7f263419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:56.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.364+0000 7f2638a00640 1 --2- 172.21.15.18:0/124746600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2634103ff0 0x7f263419a690 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2624004770 tx=0x7f2624003c10 comp rx=0 tx=0).stop 2024-09-12T02:46:56.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.364+0000 7f2638a00640 1 -- 172.21.15.18:0/124746600 shutdown_connections 2024-09-12T02:46:56.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.364+0000 7f2638a00640 1 --2- 172.21.15.18:0/124746600 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f26180a2c90 0x7f26180a5150 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.364+0000 7f2638a00640 1 --2- 172.21.15.18:0/124746600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2634109120 0x7f263419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.364+0000 7f2638a00640 1 --2- 172.21.15.18:0/124746600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26341049a0 0x7f263419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.364+0000 7f2638a00640 1 --2- 172.21.15.18:0/124746600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2634103ff0 0x7f263419a690 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:56.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.364+0000 7f2638a00640 1 -- 172.21.15.18:0/124746600 >> 172.21.15.18:0/124746600 conn(0x7f26340ffa90 msgr2=0x7f2634100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:56.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.364+0000 7f2638a00640 1 -- 172.21.15.18:0/124746600 shutdown_connections 2024-09-12T02:46:56.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:56.364+0000 7f2638a00640 1 -- 172.21.15.18:0/124746600 wait complete. 2024-09-12T02:46:57.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:56 smithi062 ceph-mon[35527]: from='client.24746 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:46:57.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:56 smithi018 ceph-mon[30616]: from='client.24746 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:46:57.172 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-09-12T02:46:54.632046+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653974,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":360,"num_read_kb":305,"num_write":427,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360160,"kb_used_data":15072,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124581664,"statfs":{"total":1151940427776,"available":1151571623936,"internally_reserved":0,"allocated":15433728,"data_stored":8476558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45835,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":131,"num_read_kb":124,"num_write":30,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003697"},"pg_stats":[{"pgid":"2.1f","version":"96'13","reported_seq":73,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:51.702819+0000","last_change":"2024-09-12T02:45:32.388516+0000","last_active":"2024-09-12T02:46:51.702819+0000","last_peered":"2024-09-12T02:46:51.702819+0000","last_clean":"2024-09-12T02:46:51.702819+0000","last_became_active":"2024-09-12T02:45:32.388066+0000","last_became_peered":"2024-09-12T02:45:32.388066+0000","last_unstale":"2024-09-12T02:46:51.702819+0000","last_undegraded":"2024-09-12T02:46:51.702819+0000","last_fullsized":"2024-09-12T02:46:51.702819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:51.222779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550759+0000","last_change":"2024-09-12T02:45:35.434469+0000","last_active":"2024-09-12T02:46:12.550759+0000","last_peered":"2024-09-12T02:46:12.550759+0000","last_clean":"2024-09-12T02:46:12.550759+0000","last_became_active":"2024-09-12T02:45:35.431803+0000","last_became_peered":"2024-09-12T02:45:35.431803+0000","last_unstale":"2024-09-12T02:46:12.550759+0000","last_undegraded":"2024-09-12T02:46:12.550759+0000","last_fullsized":"2024-09-12T02:46:12.550759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:00.826976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550560+0000","last_change":"2024-09-12T02:45:45.488223+0000","last_active":"2024-09-12T02:46:12.550560+0000","last_peered":"2024-09-12T02:46:12.550560+0000","last_clean":"2024-09-12T02:46:12.550560+0000","last_became_active":"2024-09-12T02:45:45.487868+0000","last_became_peered":"2024-09-12T02:45:45.487868+0000","last_unstale":"2024-09-12T02:46:12.550560+0000","last_undegraded":"2024-09-12T02:46:12.550560+0000","last_fullsized":"2024-09-12T02:46:12.550560+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:49.922975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"96'2","reported_seq":42,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550957+0000","last_change":"2024-09-12T02:45:32.479037+0000","last_active":"2024-09-12T02:46:12.550957+0000","last_peered":"2024-09-12T02:46:12.550957+0000","last_clean":"2024-09-12T02:46:12.550957+0000","last_became_active":"2024-09-12T02:45:32.477071+0000","last_became_peered":"2024-09-12T02:45:32.477071+0000","last_unstale":"2024-09-12T02:46:12.550957+0000","last_undegraded":"2024-09-12T02:46:12.550957+0000","last_fullsized":"2024-09-12T02:46:12.550957+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:29.512142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.559141+0000","last_change":"2024-09-12T02:45:35.418226+0000","last_active":"2024-09-12T02:46:12.559141+0000","last_peered":"2024-09-12T02:46:12.559141+0000","last_clean":"2024-09-12T02:46:12.559141+0000","last_became_active":"2024-09-12T02:45:35.417910+0000","last_became_peered":"2024-09-12T02:45:35.417910+0000","last_unstale":"2024-09-12T02:46:12.559141+0000","last_undegraded":"2024-09-12T02:46:12.559141+0000","last_fullsized":"2024-09-12T02:46:12.559141+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:06.788584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.950169+0000","last_change":"2024-09-12T02:45:45.487575+0000","last_active":"2024-09-12T02:46:12.950169+0000","last_peered":"2024-09-12T02:46:12.950169+0000","last_clean":"2024-09-12T02:46:12.950169+0000","last_became_active":"2024-09-12T02:45:45.487246+0000","last_became_peered":"2024-09-12T02:45:45.487246+0000","last_unstale":"2024-09-12T02:46:12.950169+0000","last_undegraded":"2024-09-12T02:46:12.950169+0000","last_fullsized":"2024-09-12T02:46:12.950169+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:06.068200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"96'12","reported_seq":53,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:34.670132+0000","last_change":"2024-09-12T02:45:32.393707+0000","last_active":"2024-09-12T02:46:34.670132+0000","last_peered":"2024-09-12T02:46:34.670132+0000","last_clean":"2024-09-12T02:46:34.670132+0000","last_became_active":"2024-09-12T02:45:32.393305+0000","last_became_peered":"2024-09-12T02:45:32.393305+0000","last_unstale":"2024-09-12T02:46:34.670132+0000","last_undegraded":"2024-09-12T02:46:34.670132+0000","last_fullsized":"2024-09-12T02:46:34.670132+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:02.755660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553048+0000","last_change":"2024-09-12T02:45:35.432556+0000","last_active":"2024-09-12T02:46:12.553048+0000","last_peered":"2024-09-12T02:46:12.553048+0000","last_clean":"2024-09-12T02:46:12.553048+0000","last_became_active":"2024-09-12T02:45:35.431164+0000","last_became_peered":"2024-09-12T02:45:35.431164+0000","last_unstale":"2024-09-12T02:46:12.553048+0000","last_undegraded":"2024-09-12T02:46:12.553048+0000","last_fullsized":"2024-09-12T02:46:12.553048+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:11.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.950725+0000","last_change":"2024-09-12T02:45:45.493518+0000","last_active":"2024-09-12T02:46:12.950725+0000","last_peered":"2024-09-12T02:46:12.950725+0000","last_clean":"2024-09-12T02:46:12.950725+0000","last_became_active":"2024-09-12T02:45:45.492902+0000","last_became_peered":"2024-09-12T02:45:45.492902+0000","last_unstale":"2024-09-12T02:46:12.950725+0000","last_undegraded":"2024-09-12T02:46:12.950725+0000","last_fullsized":"2024-09-12T02:46:12.950725+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:11.278901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"96'5","reported_seq":46,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.664927+0000","last_change":"2024-09-12T02:45:32.388552+0000","last_active":"2024-09-12T02:46:33.664927+0000","last_peered":"2024-09-12T02:46:33.664927+0000","last_clean":"2024-09-12T02:46:33.664927+0000","last_became_active":"2024-09-12T02:45:32.388168+0000","last_became_peered":"2024-09-12T02:45:32.388168+0000","last_unstale":"2024-09-12T02:46:33.664927+0000","last_undegraded":"2024-09-12T02:46:33.664927+0000","last_fullsized":"2024-09-12T02:46:33.664927+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:29.803240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.951959+0000","last_change":"2024-09-12T02:46:12.951385+0000","last_active":"2024-09-12T02:46:12.951959+0000","last_peered":"2024-09-12T02:46:12.951959+0000","last_clean":"2024-09-12T02:46:12.951959+0000","last_became_active":"2024-09-12T02:46:12.950977+0000","last_became_peered":"2024-09-12T02:46:12.950977+0000","last_unstale":"2024-09-12T02:46:12.951959+0000","last_undegraded":"2024-09-12T02:46:12.951959+0000","last_fullsized":"2024-09-12T02:46:12.951959+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:59.262026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.950577+0000","last_change":"2024-09-12T02:45:45.487534+0000","last_active":"2024-09-12T02:46:12.950577+0000","last_peered":"2024-09-12T02:46:12.950577+0000","last_clean":"2024-09-12T02:46:12.950577+0000","last_became_active":"2024-09-12T02:45:45.487101+0000","last_became_peered":"2024-09-12T02:45:45.487101+0000","last_unstale":"2024-09-12T02:46:12.950577+0000","last_undegraded":"2024-09-12T02:46:12.950577+0000","last_fullsized":"2024-09-12T02:46:12.950577+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:50.808850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555989+0000","last_change":"2024-09-12T02:45:35.432796+0000","last_active":"2024-09-12T02:46:12.555989+0000","last_peered":"2024-09-12T02:46:12.555989+0000","last_clean":"2024-09-12T02:46:12.555989+0000","last_became_active":"2024-09-12T02:45:35.432456+0000","last_became_peered":"2024-09-12T02:45:35.432456+0000","last_unstale":"2024-09-12T02:46:12.555989+0000","last_undegraded":"2024-09-12T02:46:12.555989+0000","last_fullsized":"2024-09-12T02:46:12.555989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:02.597515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"96'4","reported_seq":45,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:30.636289+0000","last_change":"2024-09-12T02:45:32.394657+0000","last_active":"2024-09-12T02:46:30.636289+0000","last_peered":"2024-09-12T02:46:30.636289+0000","last_clean":"2024-09-12T02:46:30.636289+0000","last_became_active":"2024-09-12T02:45:32.394277+0000","last_became_peered":"2024-09-12T02:45:32.394277+0000","last_unstale":"2024-09-12T02:46:30.636289+0000","last_undegraded":"2024-09-12T02:46:30.636289+0000","last_fullsized":"2024-09-12T02:46:30.636289+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:26.614900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.950689+0000","last_change":"2024-09-12T02:45:45.831567+0000","last_active":"2024-09-12T02:46:12.950689+0000","last_peered":"2024-09-12T02:46:12.950689+0000","last_clean":"2024-09-12T02:46:12.950689+0000","last_became_active":"2024-09-12T02:45:45.831124+0000","last_became_peered":"2024-09-12T02:45:45.831124+0000","last_unstale":"2024-09-12T02:46:12.950689+0000","last_undegraded":"2024-09-12T02:46:12.950689+0000","last_fullsized":"2024-09-12T02:46:12.950689+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:43.289387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550484+0000","last_change":"2024-09-12T02:45:35.435658+0000","last_active":"2024-09-12T02:46:12.550484+0000","last_peered":"2024-09-12T02:46:12.550484+0000","last_clean":"2024-09-12T02:46:12.550484+0000","last_became_active":"2024-09-12T02:45:35.434759+0000","last_became_peered":"2024-09-12T02:45:35.434759+0000","last_unstale":"2024-09-12T02:46:12.550484+0000","last_undegraded":"2024-09-12T02:46:12.550484+0000","last_fullsized":"2024-09-12T02:46:12.550484+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:49.384125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"96'3","reported_seq":43,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:32.644987+0000","last_change":"2024-09-12T02:45:32.394125+0000","last_active":"2024-09-12T02:46:32.644987+0000","last_peered":"2024-09-12T02:46:32.644987+0000","last_clean":"2024-09-12T02:46:32.644987+0000","last_became_active":"2024-09-12T02:45:32.393797+0000","last_became_peered":"2024-09-12T02:45:32.393797+0000","last_unstale":"2024-09-12T02:46:32.644987+0000","last_undegraded":"2024-09-12T02:46:32.644987+0000","last_fullsized":"2024-09-12T02:46:32.644987+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:41.553865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"96'1","reported_seq":23,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.951096+0000","last_change":"2024-09-12T02:45:45.495186+0000","last_active":"2024-09-12T02:46:12.951096+0000","last_peered":"2024-09-12T02:46:12.951096+0000","last_clean":"2024-09-12T02:46:12.951096+0000","last_became_active":"2024-09-12T02:45:45.494764+0000","last_became_peered":"2024-09-12T02:45:45.494764+0000","last_unstale":"2024-09-12T02:46:12.951096+0000","last_undegraded":"2024-09-12T02:46:12.951096+0000","last_fullsized":"2024-09-12T02:46:12.951096+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:59.623399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555151+0000","last_change":"2024-09-12T02:45:35.431606+0000","last_active":"2024-09-12T02:46:12.555151+0000","last_peered":"2024-09-12T02:46:12.555151+0000","last_clean":"2024-09-12T02:46:12.555151+0000","last_became_active":"2024-09-12T02:45:35.431259+0000","last_became_peered":"2024-09-12T02:45:35.431259+0000","last_unstale":"2024-09-12T02:46:12.555151+0000","last_undegraded":"2024-09-12T02:46:12.555151+0000","last_fullsized":"2024-09-12T02:46:12.555151+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:17.014610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"96'7","reported_seq":47,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.664438+0000","last_change":"2024-09-12T02:45:32.386098+0000","last_active":"2024-09-12T02:46:33.664438+0000","last_peered":"2024-09-12T02:46:33.664438+0000","last_clean":"2024-09-12T02:46:33.664438+0000","last_became_active":"2024-09-12T02:45:32.385762+0000","last_became_peered":"2024-09-12T02:45:32.385762+0000","last_unstale":"2024-09-12T02:46:33.664438+0000","last_undegraded":"2024-09-12T02:46:33.664438+0000","last_fullsized":"2024-09-12T02:46:33.664438+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:17.109916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555580+0000","last_change":"2024-09-12T02:45:45.492746+0000","last_active":"2024-09-12T02:46:12.555580+0000","last_peered":"2024-09-12T02:46:12.555580+0000","last_clean":"2024-09-12T02:46:12.555580+0000","last_became_active":"2024-09-12T02:45:45.492280+0000","last_became_peered":"2024-09-12T02:45:45.492280+0000","last_unstale":"2024-09-12T02:46:12.555580+0000","last_undegraded":"2024-09-12T02:46:12.555580+0000","last_fullsized":"2024-09-12T02:46:12.555580+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:56.585316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.554955+0000","last_change":"2024-09-12T02:45:35.430254+0000","last_active":"2024-09-12T02:46:12.554955+0000","last_peered":"2024-09-12T02:46:12.554955+0000","last_clean":"2024-09-12T02:46:12.554955+0000","last_became_active":"2024-09-12T02:45:35.429822+0000","last_became_peered":"2024-09-12T02:45:35.429822+0000","last_unstale":"2024-09-12T02:46:12.554955+0000","last_undegraded":"2024-09-12T02:46:12.554955+0000","last_fullsized":"2024-09-12T02:46:12.554955+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:45.750936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"96'2","reported_seq":41,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:30.637181+0000","last_change":"2024-09-12T02:45:32.476950+0000","last_active":"2024-09-12T02:46:30.637181+0000","last_peered":"2024-09-12T02:46:30.637181+0000","last_clean":"2024-09-12T02:46:30.637181+0000","last_became_active":"2024-09-12T02:45:32.476619+0000","last_became_peered":"2024-09-12T02:45:32.476619+0000","last_unstale":"2024-09-12T02:46:30.637181+0000","last_undegraded":"2024-09-12T02:46:30.637181+0000","last_fullsized":"2024-09-12T02:46:30.637181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:18.963069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.950725+0000","last_change":"2024-09-12T02:45:45.833226+0000","last_active":"2024-09-12T02:46:12.950725+0000","last_peered":"2024-09-12T02:46:12.950725+0000","last_clean":"2024-09-12T02:46:12.950725+0000","last_became_active":"2024-09-12T02:45:45.832716+0000","last_became_peered":"2024-09-12T02:45:45.832716+0000","last_unstale":"2024-09-12T02:46:12.950725+0000","last_undegraded":"2024-09-12T02:46:12.950725+0000","last_fullsized":"2024-09-12T02:46:12.950725+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:12.072765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.558648+0000","last_change":"2024-09-12T02:45:35.436301+0000","last_active":"2024-09-12T02:46:12.558648+0000","last_peered":"2024-09-12T02:46:12.558648+0000","last_clean":"2024-09-12T02:46:12.558648+0000","last_became_active":"2024-09-12T02:45:35.435999+0000","last_became_peered":"2024-09-12T02:45:35.435999+0000","last_unstale":"2024-09-12T02:46:12.558648+0000","last_undegraded":"2024-09-12T02:46:12.558648+0000","last_fullsized":"2024-09-12T02:46:12.558648+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:02.823154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"96'7","reported_seq":47,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.666085+0000","last_change":"2024-09-12T02:45:32.382231+0000","last_active":"2024-09-12T02:46:33.666085+0000","last_peered":"2024-09-12T02:46:33.666085+0000","last_clean":"2024-09-12T02:46:33.666085+0000","last_became_active":"2024-09-12T02:45:32.381821+0000","last_became_peered":"2024-09-12T02:45:32.381821+0000","last_unstale":"2024-09-12T02:46:33.666085+0000","last_undegraded":"2024-09-12T02:46:33.666085+0000","last_fullsized":"2024-09-12T02:46:33.666085+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:34:02.631429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550547+0000","last_change":"2024-09-12T02:45:45.481460+0000","last_active":"2024-09-12T02:46:12.550547+0000","last_peered":"2024-09-12T02:46:12.550547+0000","last_clean":"2024-09-12T02:46:12.550547+0000","last_became_active":"2024-09-12T02:45:45.480697+0000","last_became_peered":"2024-09-12T02:45:45.480697+0000","last_unstale":"2024-09-12T02:46:12.550547+0000","last_undegraded":"2024-09-12T02:46:12.550547+0000","last_fullsized":"2024-09-12T02:46:12.550547+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:34.985196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550970+0000","last_change":"2024-09-12T02:45:35.434844+0000","last_active":"2024-09-12T02:46:12.550970+0000","last_peered":"2024-09-12T02:46:12.550970+0000","last_clean":"2024-09-12T02:46:12.550970+0000","last_became_active":"2024-09-12T02:45:35.433513+0000","last_became_peered":"2024-09-12T02:45:35.433513+0000","last_unstale":"2024-09-12T02:46:12.550970+0000","last_undegraded":"2024-09-12T02:46:12.550970+0000","last_fullsized":"2024-09-12T02:46:12.550970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:01.473202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"96'14","reported_seq":54,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:49.440160+0000","last_change":"2024-09-12T02:45:32.389455+0000","last_active":"2024-09-12T02:46:49.440160+0000","last_peered":"2024-09-12T02:46:49.440160+0000","last_clean":"2024-09-12T02:46:49.440160+0000","last_became_active":"2024-09-12T02:45:32.388633+0000","last_became_peered":"2024-09-12T02:45:32.388633+0000","last_unstale":"2024-09-12T02:46:49.440160+0000","last_undegraded":"2024-09-12T02:46:49.440160+0000","last_fullsized":"2024-09-12T02:46:49.440160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:34.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550029+0000","last_change":"2024-09-12T02:45:45.831697+0000","last_active":"2024-09-12T02:46:12.550029+0000","last_peered":"2024-09-12T02:46:12.550029+0000","last_clean":"2024-09-12T02:46:12.550029+0000","last_became_active":"2024-09-12T02:45:45.831167+0000","last_became_peered":"2024-09-12T02:45:45.831167+0000","last_unstale":"2024-09-12T02:46:12.550029+0000","last_undegraded":"2024-09-12T02:46:12.550029+0000","last_fullsized":"2024-09-12T02:46:12.550029+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:48.553773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.369218+0000","last_change":"2024-09-12T02:45:35.423196+0000","last_active":"2024-09-12T02:46:13.369218+0000","last_peered":"2024-09-12T02:46:13.369218+0000","last_clean":"2024-09-12T02:46:13.369218+0000","last_became_active":"2024-09-12T02:45:35.422778+0000","last_became_peered":"2024-09-12T02:45:35.422778+0000","last_unstale":"2024-09-12T02:46:13.369218+0000","last_undegraded":"2024-09-12T02:46:13.369218+0000","last_fullsized":"2024-09-12T02:46:13.369218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:37.092151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"96'4","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.666397+0000","last_change":"2024-09-12T02:46:12.558805+0000","last_active":"2024-09-12T02:46:33.666397+0000","last_peered":"2024-09-12T02:46:33.666397+0000","last_clean":"2024-09-12T02:46:33.666397+0000","last_became_active":"2024-09-12T02:46:12.558479+0000","last_became_peered":"2024-09-12T02:46:12.558479+0000","last_unstale":"2024-09-12T02:46:33.666397+0000","last_undegraded":"2024-09-12T02:46:33.666397+0000","last_fullsized":"2024-09-12T02:46:33.666397+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:28.757698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555406+0000","last_change":"2024-09-12T02:45:45.484466+0000","last_active":"2024-09-12T02:46:12.555406+0000","last_peered":"2024-09-12T02:46:12.555406+0000","last_clean":"2024-09-12T02:46:12.555406+0000","last_became_active":"2024-09-12T02:45:45.484003+0000","last_became_peered":"2024-09-12T02:45:45.484003+0000","last_unstale":"2024-09-12T02:46:12.555406+0000","last_undegraded":"2024-09-12T02:46:12.555406+0000","last_fullsized":"2024-09-12T02:46:12.555406+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:00.429837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553867+0000","last_change":"2024-09-12T02:45:35.432783+0000","last_active":"2024-09-12T02:46:12.553867+0000","last_peered":"2024-09-12T02:46:12.553867+0000","last_clean":"2024-09-12T02:46:12.553867+0000","last_became_active":"2024-09-12T02:45:35.432461+0000","last_became_peered":"2024-09-12T02:45:35.432461+0000","last_unstale":"2024-09-12T02:46:12.553867+0000","last_undegraded":"2024-09-12T02:46:12.553867+0000","last_fullsized":"2024-09-12T02:46:12.553867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:20.066115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"96'1","reported_seq":41,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555438+0000","last_change":"2024-09-12T02:45:32.478636+0000","last_active":"2024-09-12T02:46:12.555438+0000","last_peered":"2024-09-12T02:46:12.555438+0000","last_clean":"2024-09-12T02:46:12.555438+0000","last_became_active":"2024-09-12T02:45:32.477347+0000","last_became_peered":"2024-09-12T02:45:32.477347+0000","last_unstale":"2024-09-12T02:46:12.555438+0000","last_undegraded":"2024-09-12T02:46:12.555438+0000","last_fullsized":"2024-09-12T02:46:12.555438+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:02.872897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.554681+0000","last_change":"2024-09-12T02:45:45.831550+0000","last_active":"2024-09-12T02:46:12.554681+0000","last_peered":"2024-09-12T02:46:12.554681+0000","last_clean":"2024-09-12T02:46:12.554681+0000","last_became_active":"2024-09-12T02:45:45.831004+0000","last_became_peered":"2024-09-12T02:45:45.831004+0000","last_unstale":"2024-09-12T02:46:12.554681+0000","last_undegraded":"2024-09-12T02:46:12.554681+0000","last_fullsized":"2024-09-12T02:46:12.554681+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:24.183273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553923+0000","last_change":"2024-09-12T02:45:35.417296+0000","last_active":"2024-09-12T02:46:12.553923+0000","last_peered":"2024-09-12T02:46:12.553923+0000","last_clean":"2024-09-12T02:46:12.553923+0000","last_became_active":"2024-09-12T02:45:35.416963+0000","last_became_peered":"2024-09-12T02:45:35.416963+0000","last_unstale":"2024-09-12T02:46:12.553923+0000","last_undegraded":"2024-09-12T02:46:12.553923+0000","last_fullsized":"2024-09-12T02:46:12.553923+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:22.945974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"96'6","reported_seq":65,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:50.701986+0000","last_change":"2024-09-12T02:45:32.387264+0000","last_active":"2024-09-12T02:46:50.701986+0000","last_peered":"2024-09-12T02:46:50.701986+0000","last_clean":"2024-09-12T02:46:50.701986+0000","last_became_active":"2024-09-12T02:45:32.386900+0000","last_became_peered":"2024-09-12T02:45:32.386900+0000","last_unstale":"2024-09-12T02:46:50.701986+0000","last_undegraded":"2024-09-12T02:46:50.701986+0000","last_fullsized":"2024-09-12T02:46:50.701986+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:26.638049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.369235+0000","last_change":"2024-09-12T02:45:45.481793+0000","last_active":"2024-09-12T02:46:13.369235+0000","last_peered":"2024-09-12T02:46:13.369235+0000","last_clean":"2024-09-12T02:46:13.369235+0000","last_became_active":"2024-09-12T02:45:45.481265+0000","last_became_peered":"2024-09-12T02:45:45.481265+0000","last_unstale":"2024-09-12T02:46:13.369235+0000","last_undegraded":"2024-09-12T02:46:13.369235+0000","last_fullsized":"2024-09-12T02:46:13.369235+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:24.568713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553209+0000","last_change":"2024-09-12T02:45:35.432102+0000","last_active":"2024-09-12T02:46:12.553209+0000","last_peered":"2024-09-12T02:46:12.553209+0000","last_clean":"2024-09-12T02:46:12.553209+0000","last_became_active":"2024-09-12T02:45:35.431521+0000","last_became_peered":"2024-09-12T02:45:35.431521+0000","last_unstale":"2024-09-12T02:46:12.553209+0000","last_undegraded":"2024-09-12T02:46:12.553209+0000","last_fullsized":"2024-09-12T02:46:12.553209+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:40.669668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"96'5","reported_seq":62,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:48.698773+0000","last_change":"2024-09-12T02:45:32.479322+0000","last_active":"2024-09-12T02:46:48.698773+0000","last_peered":"2024-09-12T02:46:48.698773+0000","last_clean":"2024-09-12T02:46:48.698773+0000","last_became_active":"2024-09-12T02:45:32.478565+0000","last_became_peered":"2024-09-12T02:45:32.478565+0000","last_unstale":"2024-09-12T02:46:48.698773+0000","last_undegraded":"2024-09-12T02:46:48.698773+0000","last_fullsized":"2024-09-12T02:46:48.698773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:03.400545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.368976+0000","last_change":"2024-09-12T02:45:45.831894+0000","last_active":"2024-09-12T02:46:13.368976+0000","last_peered":"2024-09-12T02:46:13.368976+0000","last_clean":"2024-09-12T02:46:13.368976+0000","last_became_active":"2024-09-12T02:45:45.831365+0000","last_became_peered":"2024-09-12T02:45:45.831365+0000","last_unstale":"2024-09-12T02:46:13.368976+0000","last_undegraded":"2024-09-12T02:46:13.368976+0000","last_fullsized":"2024-09-12T02:46:13.368976+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:57.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.368356+0000","last_change":"2024-09-12T02:45:35.419676+0000","last_active":"2024-09-12T02:46:13.368356+0000","last_peered":"2024-09-12T02:46:13.368356+0000","last_clean":"2024-09-12T02:46:13.368356+0000","last_became_active":"2024-09-12T02:45:35.419371+0000","last_became_peered":"2024-09-12T02:45:35.419371+0000","last_unstale":"2024-09-12T02:46:13.368356+0000","last_undegraded":"2024-09-12T02:46:13.368356+0000","last_fullsized":"2024-09-12T02:46:13.368356+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:19.303214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"96'4","reported_seq":43,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:31.639553+0000","last_change":"2024-09-12T02:45:32.389855+0000","last_active":"2024-09-12T02:46:31.639553+0000","last_peered":"2024-09-12T02:46:31.639553+0000","last_clean":"2024-09-12T02:46:31.639553+0000","last_became_active":"2024-09-12T02:45:32.389457+0000","last_became_peered":"2024-09-12T02:45:32.389457+0000","last_unstale":"2024-09-12T02:46:31.639553+0000","last_undegraded":"2024-09-12T02:46:31.639553+0000","last_fullsized":"2024-09-12T02:46:31.639553+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:41.540961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.554393+0000","last_change":"2024-09-12T02:45:45.832346+0000","last_active":"2024-09-12T02:46:12.554393+0000","last_peered":"2024-09-12T02:46:12.554393+0000","last_clean":"2024-09-12T02:46:12.554393+0000","last_became_active":"2024-09-12T02:45:45.831810+0000","last_became_peered":"2024-09-12T02:45:45.831810+0000","last_unstale":"2024-09-12T02:46:12.554393+0000","last_undegraded":"2024-09-12T02:46:12.554393+0000","last_fullsized":"2024-09-12T02:46:12.554393+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:08.388606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550433+0000","last_change":"2024-09-12T02:45:35.437560+0000","last_active":"2024-09-12T02:46:12.550433+0000","last_peered":"2024-09-12T02:46:12.550433+0000","last_clean":"2024-09-12T02:46:12.550433+0000","last_became_active":"2024-09-12T02:45:35.435837+0000","last_became_peered":"2024-09-12T02:45:35.435837+0000","last_unstale":"2024-09-12T02:46:12.550433+0000","last_undegraded":"2024-09-12T02:46:12.550433+0000","last_fullsized":"2024-09-12T02:46:12.550433+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:21.171560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"96'6","reported_seq":48,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:34.672364+0000","last_change":"2024-09-12T02:45:32.385075+0000","last_active":"2024-09-12T02:46:34.672364+0000","last_peered":"2024-09-12T02:46:34.672364+0000","last_clean":"2024-09-12T02:46:34.672364+0000","last_became_active":"2024-09-12T02:45:32.384569+0000","last_became_peered":"2024-09-12T02:45:32.384569+0000","last_unstale":"2024-09-12T02:46:34.672364+0000","last_undegraded":"2024-09-12T02:46:34.672364+0000","last_fullsized":"2024-09-12T02:46:34.672364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:32.962756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":365,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555798+0000","last_change":"2024-09-12T02:44:18.042779+0000","last_active":"2024-09-12T02:46:12.555798+0000","last_peered":"2024-09-12T02:46:12.555798+0000","last_clean":"2024-09-12T02:46:12.555798+0000","last_became_active":"2024-09-12T02:44:18.042265+0000","last_became_peered":"2024-09-12T02:44:18.042265+0000","last_unstale":"2024-09-12T02:46:12.555798+0000","last_undegraded":"2024-09-12T02:46:12.555798+0000","last_fullsized":"2024-09-12T02:46:12.555798+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:40:35.543336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:40:35.543336+0000","last_clean_scrub_stamp":"2024-09-12T02:40:35.543336+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:22.348756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"96'1","reported_seq":23,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556830+0000","last_change":"2024-09-12T02:45:45.492737+0000","last_active":"2024-09-12T02:46:12.556830+0000","last_peered":"2024-09-12T02:46:12.556830+0000","last_clean":"2024-09-12T02:46:12.556830+0000","last_became_active":"2024-09-12T02:45:45.492280+0000","last_became_peered":"2024-09-12T02:45:45.492280+0000","last_unstale":"2024-09-12T02:46:12.556830+0000","last_undegraded":"2024-09-12T02:46:12.556830+0000","last_fullsized":"2024-09-12T02:46:12.556830+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:45.530066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556924+0000","last_change":"2024-09-12T02:45:35.431876+0000","last_active":"2024-09-12T02:46:12.556924+0000","last_peered":"2024-09-12T02:46:12.556924+0000","last_clean":"2024-09-12T02:46:12.556924+0000","last_became_active":"2024-09-12T02:45:35.431505+0000","last_became_peered":"2024-09-12T02:45:35.431505+0000","last_unstale":"2024-09-12T02:46:12.556924+0000","last_undegraded":"2024-09-12T02:46:12.556924+0000","last_fullsized":"2024-09-12T02:46:12.556924+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:30.370034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"96'6","reported_seq":65,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:48.696527+0000","last_change":"2024-09-12T02:45:32.477394+0000","last_active":"2024-09-12T02:46:48.696527+0000","last_peered":"2024-09-12T02:46:48.696527+0000","last_clean":"2024-09-12T02:46:48.696527+0000","last_became_active":"2024-09-12T02:45:32.477064+0000","last_became_peered":"2024-09-12T02:45:32.477064+0000","last_unstale":"2024-09-12T02:46:48.696527+0000","last_undegraded":"2024-09-12T02:46:48.696527+0000","last_fullsized":"2024-09-12T02:46:48.696527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:03.828652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553118+0000","last_change":"2024-09-12T02:45:45.481201+0000","last_active":"2024-09-12T02:46:12.553118+0000","last_peered":"2024-09-12T02:46:12.553118+0000","last_clean":"2024-09-12T02:46:12.553118+0000","last_became_active":"2024-09-12T02:45:45.480721+0000","last_became_peered":"2024-09-12T02:45:45.480721+0000","last_unstale":"2024-09-12T02:46:12.553118+0000","last_undegraded":"2024-09-12T02:46:12.553118+0000","last_fullsized":"2024-09-12T02:46:12.553118+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:12.780521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556841+0000","last_change":"2024-09-12T02:45:35.440920+0000","last_active":"2024-09-12T02:46:12.556841+0000","last_peered":"2024-09-12T02:46:12.556841+0000","last_clean":"2024-09-12T02:46:12.556841+0000","last_became_active":"2024-09-12T02:45:35.440566+0000","last_became_peered":"2024-09-12T02:45:35.440566+0000","last_unstale":"2024-09-12T02:46:12.556841+0000","last_undegraded":"2024-09-12T02:46:12.556841+0000","last_fullsized":"2024-09-12T02:46:12.556841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:19.171841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"96'3","reported_seq":43,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.666018+0000","last_change":"2024-09-12T02:45:32.388589+0000","last_active":"2024-09-12T02:46:33.666018+0000","last_peered":"2024-09-12T02:46:33.666018+0000","last_clean":"2024-09-12T02:46:33.666018+0000","last_became_active":"2024-09-12T02:45:32.388243+0000","last_became_peered":"2024-09-12T02:45:32.388243+0000","last_unstale":"2024-09-12T02:46:33.666018+0000","last_undegraded":"2024-09-12T02:46:33.666018+0000","last_fullsized":"2024-09-12T02:46:33.666018+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:23.747525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.558135+0000","last_change":"2024-09-12T02:45:45.494520+0000","last_active":"2024-09-12T02:46:12.558135+0000","last_peered":"2024-09-12T02:46:12.558135+0000","last_clean":"2024-09-12T02:46:12.558135+0000","last_became_active":"2024-09-12T02:45:45.494104+0000","last_became_peered":"2024-09-12T02:45:45.494104+0000","last_unstale":"2024-09-12T02:46:12.558135+0000","last_undegraded":"2024-09-12T02:46:12.558135+0000","last_fullsized":"2024-09-12T02:46:12.558135+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:14.056329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556989+0000","last_change":"2024-09-12T02:45:35.427871+0000","last_active":"2024-09-12T02:46:12.556989+0000","last_peered":"2024-09-12T02:46:12.556989+0000","last_clean":"2024-09-12T02:46:12.556989+0000","last_became_active":"2024-09-12T02:45:35.427499+0000","last_became_peered":"2024-09-12T02:45:35.427499+0000","last_unstale":"2024-09-12T02:46:12.556989+0000","last_undegraded":"2024-09-12T02:46:12.556989+0000","last_fullsized":"2024-09-12T02:46:12.556989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:15.515311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"96'5","reported_seq":45,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.666536+0000","last_change":"2024-09-12T02:45:32.389199+0000","last_active":"2024-09-12T02:46:33.666536+0000","last_peered":"2024-09-12T02:46:33.666536+0000","last_clean":"2024-09-12T02:46:33.666536+0000","last_became_active":"2024-09-12T02:45:32.388885+0000","last_became_peered":"2024-09-12T02:45:32.388885+0000","last_unstale":"2024-09-12T02:46:33.666536+0000","last_undegraded":"2024-09-12T02:46:33.666536+0000","last_fullsized":"2024-09-12T02:46:33.666536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.002707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.552923+0000","last_change":"2024-09-12T02:45:45.485171+0000","last_active":"2024-09-12T02:46:12.552923+0000","last_peered":"2024-09-12T02:46:12.552923+0000","last_clean":"2024-09-12T02:46:12.552923+0000","last_became_active":"2024-09-12T02:45:45.484540+0000","last_became_peered":"2024-09-12T02:45:45.484540+0000","last_unstale":"2024-09-12T02:46:12.552923+0000","last_undegraded":"2024-09-12T02:46:12.552923+0000","last_fullsized":"2024-09-12T02:46:12.552923+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:52.063588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.951994+0000","last_change":"2024-09-12T02:46:12.951994+0000","last_active":"2024-09-12T02:46:12.951994+0000","last_peered":"2024-09-12T02:46:12.951994+0000","last_clean":"2024-09-12T02:46:12.951994+0000","last_became_active":"2024-09-12T02:46:12.951653+0000","last_became_peered":"2024-09-12T02:46:12.951653+0000","last_unstale":"2024-09-12T02:46:12.951994+0000","last_undegraded":"2024-09-12T02:46:12.951994+0000","last_fullsized":"2024-09-12T02:46:12.951994+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:35.221403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"96'2","reported_seq":43,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:32.637133+0000","last_change":"2024-09-12T02:45:32.390592+0000","last_active":"2024-09-12T02:46:32.637133+0000","last_peered":"2024-09-12T02:46:32.637133+0000","last_clean":"2024-09-12T02:46:32.637133+0000","last_became_active":"2024-09-12T02:45:32.390211+0000","last_became_peered":"2024-09-12T02:45:32.390211+0000","last_unstale":"2024-09-12T02:46:32.637133+0000","last_undegraded":"2024-09-12T02:46:32.637133+0000","last_fullsized":"2024-09-12T02:46:32.637133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:04.437645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553527+0000","last_change":"2024-09-12T02:45:45.491332+0000","last_active":"2024-09-12T02:46:12.553527+0000","last_peered":"2024-09-12T02:46:12.553527+0000","last_clean":"2024-09-12T02:46:12.553527+0000","last_became_active":"2024-09-12T02:45:45.490943+0000","last_became_peered":"2024-09-12T02:45:45.490943+0000","last_unstale":"2024-09-12T02:46:12.553527+0000","last_undegraded":"2024-09-12T02:46:12.553527+0000","last_fullsized":"2024-09-12T02:46:12.553527+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:50.154253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553677+0000","last_change":"2024-09-12T02:45:35.426119+0000","last_active":"2024-09-12T02:46:12.553677+0000","last_peered":"2024-09-12T02:46:12.553677+0000","last_clean":"2024-09-12T02:46:12.553677+0000","last_became_active":"2024-09-12T02:45:35.425740+0000","last_became_peered":"2024-09-12T02:45:35.425740+0000","last_unstale":"2024-09-12T02:46:12.553677+0000","last_undegraded":"2024-09-12T02:46:12.553677+0000","last_fullsized":"2024-09-12T02:46:12.553677+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:36.451449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"96'17","reported_seq":74,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.664196+0000","last_change":"2024-09-12T02:46:12.565117+0000","last_active":"2024-09-12T02:46:33.664196+0000","last_peered":"2024-09-12T02:46:33.664196+0000","last_clean":"2024-09-12T02:46:33.664196+0000","last_became_active":"2024-09-12T02:46:12.558657+0000","last_became_peered":"2024-09-12T02:46:12.558657+0000","last_unstale":"2024-09-12T02:46:33.664196+0000","last_undegraded":"2024-09-12T02:46:33.664196+0000","last_fullsized":"2024-09-12T02:46:33.664196+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:27.956347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.369096+0000","last_change":"2024-09-12T02:45:45.493917+0000","last_active":"2024-09-12T02:46:13.369096+0000","last_peered":"2024-09-12T02:46:13.369096+0000","last_clean":"2024-09-12T02:46:13.369096+0000","last_became_active":"2024-09-12T02:45:45.493488+0000","last_became_peered":"2024-09-12T02:45:45.493488+0000","last_unstale":"2024-09-12T02:46:13.369096+0000","last_undegraded":"2024-09-12T02:46:13.369096+0000","last_fullsized":"2024-09-12T02:46:13.369096+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:27.092953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555573+0000","last_change":"2024-09-12T02:45:35.423430+0000","last_active":"2024-09-12T02:46:12.555573+0000","last_peered":"2024-09-12T02:46:12.555573+0000","last_clean":"2024-09-12T02:46:12.555573+0000","last_became_active":"2024-09-12T02:45:35.423097+0000","last_became_peered":"2024-09-12T02:45:35.423097+0000","last_unstale":"2024-09-12T02:46:12.555573+0000","last_undegraded":"2024-09-12T02:46:12.555573+0000","last_fullsized":"2024-09-12T02:46:12.555573+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:53.823140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"96'5","reported_seq":64,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:50.701885+0000","last_change":"2024-09-12T02:45:32.384965+0000","last_active":"2024-09-12T02:46:50.701885+0000","last_peered":"2024-09-12T02:46:50.701885+0000","last_clean":"2024-09-12T02:46:50.701885+0000","last_became_active":"2024-09-12T02:45:32.384369+0000","last_became_peered":"2024-09-12T02:45:32.384369+0000","last_unstale":"2024-09-12T02:46:50.701885+0000","last_undegraded":"2024-09-12T02:46:50.701885+0000","last_fullsized":"2024-09-12T02:46:50.701885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:43.022766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555604+0000","last_change":"2024-09-12T02:45:45.491338+0000","last_active":"2024-09-12T02:46:12.555604+0000","last_peered":"2024-09-12T02:46:12.555604+0000","last_clean":"2024-09-12T02:46:12.555604+0000","last_became_active":"2024-09-12T02:45:45.490578+0000","last_became_peered":"2024-09-12T02:45:45.490578+0000","last_unstale":"2024-09-12T02:46:12.555604+0000","last_undegraded":"2024-09-12T02:46:12.555604+0000","last_fullsized":"2024-09-12T02:46:12.555604+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:28.609202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556692+0000","last_change":"2024-09-12T02:45:35.429907+0000","last_active":"2024-09-12T02:46:12.556692+0000","last_peered":"2024-09-12T02:46:12.556692+0000","last_clean":"2024-09-12T02:46:12.556692+0000","last_became_active":"2024-09-12T02:45:35.429546+0000","last_became_peered":"2024-09-12T02:45:35.429546+0000","last_unstale":"2024-09-12T02:46:12.556692+0000","last_undegraded":"2024-09-12T02:46:12.556692+0000","last_fullsized":"2024-09-12T02:46:12.556692+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:50.471835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"96'5","reported_seq":45,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.666028+0000","last_change":"2024-09-12T02:45:32.390663+0000","last_active":"2024-09-12T02:46:33.666028+0000","last_peered":"2024-09-12T02:46:33.666028+0000","last_clean":"2024-09-12T02:46:33.666028+0000","last_became_active":"2024-09-12T02:45:32.390316+0000","last_became_peered":"2024-09-12T02:45:32.390316+0000","last_unstale":"2024-09-12T02:46:33.666028+0000","last_undegraded":"2024-09-12T02:46:33.666028+0000","last_fullsized":"2024-09-12T02:46:33.666028+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:11.605522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555529+0000","last_change":"2024-09-12T02:45:45.494111+0000","last_active":"2024-09-12T02:46:12.555529+0000","last_peered":"2024-09-12T02:46:12.555529+0000","last_clean":"2024-09-12T02:46:12.555529+0000","last_became_active":"2024-09-12T02:45:45.493709+0000","last_became_peered":"2024-09-12T02:45:45.493709+0000","last_unstale":"2024-09-12T02:46:12.555529+0000","last_undegraded":"2024-09-12T02:46:12.555529+0000","last_fullsized":"2024-09-12T02:46:12.555529+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:24.998025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.368654+0000","last_change":"2024-09-12T02:45:35.442187+0000","last_active":"2024-09-12T02:46:13.368654+0000","last_peered":"2024-09-12T02:46:13.368654+0000","last_clean":"2024-09-12T02:46:13.368654+0000","last_became_active":"2024-09-12T02:45:35.441751+0000","last_became_peered":"2024-09-12T02:45:35.441751+0000","last_unstale":"2024-09-12T02:46:13.368654+0000","last_undegraded":"2024-09-12T02:46:13.368654+0000","last_fullsized":"2024-09-12T02:46:13.368654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:53.014758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"96'9","reported_seq":51,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:34.670345+0000","last_change":"2024-09-12T02:45:32.394390+0000","last_active":"2024-09-12T02:46:34.670345+0000","last_peered":"2024-09-12T02:46:34.670345+0000","last_clean":"2024-09-12T02:46:34.670345+0000","last_became_active":"2024-09-12T02:45:32.392304+0000","last_became_peered":"2024-09-12T02:45:32.392304+0000","last_unstale":"2024-09-12T02:46:34.670345+0000","last_undegraded":"2024-09-12T02:46:34.670345+0000","last_fullsized":"2024-09-12T02:46:34.670345+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:16.412697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.554380+0000","last_change":"2024-09-12T02:45:45.491459+0000","last_active":"2024-09-12T02:46:12.554380+0000","last_peered":"2024-09-12T02:46:12.554380+0000","last_clean":"2024-09-12T02:46:12.554380+0000","last_became_active":"2024-09-12T02:45:45.490857+0000","last_became_peered":"2024-09-12T02:45:45.490857+0000","last_unstale":"2024-09-12T02:46:12.554380+0000","last_undegraded":"2024-09-12T02:46:12.554380+0000","last_fullsized":"2024-09-12T02:46:12.554380+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:39.712007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555244+0000","last_change":"2024-09-12T02:45:35.431311+0000","last_active":"2024-09-12T02:46:12.555244+0000","last_peered":"2024-09-12T02:46:12.555244+0000","last_clean":"2024-09-12T02:46:12.555244+0000","last_became_active":"2024-09-12T02:45:35.430446+0000","last_became_peered":"2024-09-12T02:45:35.430446+0000","last_unstale":"2024-09-12T02:46:12.555244+0000","last_undegraded":"2024-09-12T02:46:12.555244+0000","last_fullsized":"2024-09-12T02:46:12.555244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:28.526132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"96'32","reported_seq":119,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:53.707227+0000","last_change":"2024-09-12T02:45:32.395938+0000","last_active":"2024-09-12T02:46:53.707227+0000","last_peered":"2024-09-12T02:46:53.707227+0000","last_clean":"2024-09-12T02:46:53.707227+0000","last_became_active":"2024-09-12T02:45:32.395509+0000","last_became_peered":"2024-09-12T02:45:32.395509+0000","last_unstale":"2024-09-12T02:46:53.707227+0000","last_undegraded":"2024-09-12T02:46:53.707227+0000","last_fullsized":"2024-09-12T02:46:53.707227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:17.401062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56164,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":79,"num_write":34,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555210+0000","last_change":"2024-09-12T02:45:45.493335+0000","last_active":"2024-09-12T02:46:12.555210+0000","last_peered":"2024-09-12T02:46:12.555210+0000","last_clean":"2024-09-12T02:46:12.555210+0000","last_became_active":"2024-09-12T02:45:45.490473+0000","last_became_peered":"2024-09-12T02:45:45.490473+0000","last_unstale":"2024-09-12T02:46:12.555210+0000","last_undegraded":"2024-09-12T02:46:12.555210+0000","last_fullsized":"2024-09-12T02:46:12.555210+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:10.375643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.951733+0000","last_change":"2024-09-12T02:46:12.951215+0000","last_active":"2024-09-12T02:46:12.951733+0000","last_peered":"2024-09-12T02:46:12.951733+0000","last_clean":"2024-09-12T02:46:12.951733+0000","last_became_active":"2024-09-12T02:46:12.950829+0000","last_became_peered":"2024-09-12T02:46:12.950829+0000","last_unstale":"2024-09-12T02:46:12.951733+0000","last_undegraded":"2024-09-12T02:46:12.951733+0000","last_fullsized":"2024-09-12T02:46:12.951733+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:42.251826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,4],"acting":[9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.15","version":"96'5","reported_seq":45,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:32.647405+0000","last_change":"2024-09-12T02:45:32.477587+0000","last_active":"2024-09-12T02:46:32.647405+0000","last_peered":"2024-09-12T02:46:32.647405+0000","last_clean":"2024-09-12T02:46:32.647405+0000","last_became_active":"2024-09-12T02:45:32.477084+0000","last_became_peered":"2024-09-12T02:45:32.477084+0000","last_unstale":"2024-09-12T02:46:32.647405+0000","last_undegraded":"2024-09-12T02:46:32.647405+0000","last_fullsized":"2024-09-12T02:46:32.647405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:24.363281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.950597+0000","last_change":"2024-09-12T02:45:45.493505+0000","last_active":"2024-09-12T02:46:12.950597+0000","last_peered":"2024-09-12T02:46:12.950597+0000","last_clean":"2024-09-12T02:46:12.950597+0000","last_became_active":"2024-09-12T02:45:45.492903+0000","last_became_peered":"2024-09-12T02:45:45.492903+0000","last_unstale":"2024-09-12T02:46:12.950597+0000","last_undegraded":"2024-09-12T02:46:12.950597+0000","last_fullsized":"2024-09-12T02:46:12.950597+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:23.365274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.559236+0000","last_change":"2024-09-12T02:45:35.422762+0000","last_active":"2024-09-12T02:46:12.559236+0000","last_peered":"2024-09-12T02:46:12.559236+0000","last_clean":"2024-09-12T02:46:12.559236+0000","last_became_active":"2024-09-12T02:45:35.422457+0000","last_became_peered":"2024-09-12T02:45:35.422457+0000","last_unstale":"2024-09-12T02:46:12.559236+0000","last_undegraded":"2024-09-12T02:46:12.559236+0000","last_fullsized":"2024-09-12T02:46:12.559236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:41.437234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"96'4","reported_seq":43,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.664166+0000","last_change":"2024-09-12T02:45:32.391699+0000","last_active":"2024-09-12T02:46:33.664166+0000","last_peered":"2024-09-12T02:46:33.664166+0000","last_clean":"2024-09-12T02:46:33.664166+0000","last_became_active":"2024-09-12T02:45:32.391114+0000","last_became_peered":"2024-09-12T02:45:32.391114+0000","last_unstale":"2024-09-12T02:46:33.664166+0000","last_undegraded":"2024-09-12T02:46:33.664166+0000","last_fullsized":"2024-09-12T02:46:33.664166+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:25.751549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.554739+0000","last_change":"2024-09-12T02:45:45.486896+0000","last_active":"2024-09-12T02:46:12.554739+0000","last_peered":"2024-09-12T02:46:12.554739+0000","last_clean":"2024-09-12T02:46:12.554739+0000","last_became_active":"2024-09-12T02:45:45.486465+0000","last_became_peered":"2024-09-12T02:45:45.486465+0000","last_unstale":"2024-09-12T02:46:12.554739+0000","last_undegraded":"2024-09-12T02:46:12.554739+0000","last_fullsized":"2024-09-12T02:46:12.554739+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:21.774968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553296+0000","last_change":"2024-09-12T02:45:35.424470+0000","last_active":"2024-09-12T02:46:12.553296+0000","last_peered":"2024-09-12T02:46:12.553296+0000","last_clean":"2024-09-12T02:46:12.553296+0000","last_became_active":"2024-09-12T02:45:35.424129+0000","last_became_peered":"2024-09-12T02:45:35.424129+0000","last_unstale":"2024-09-12T02:46:12.553296+0000","last_undegraded":"2024-09-12T02:46:12.553296+0000","last_fullsized":"2024-09-12T02:46:12.553296+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:25.541549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"96'4","reported_seq":83,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:53.703218+0000","last_change":"2024-09-12T02:45:32.388773+0000","last_active":"2024-09-12T02:46:53.703218+0000","last_peered":"2024-09-12T02:46:53.703218+0000","last_clean":"2024-09-12T02:46:53.703218+0000","last_became_active":"2024-09-12T02:45:32.388403+0000","last_became_peered":"2024-09-12T02:45:32.388403+0000","last_unstale":"2024-09-12T02:46:53.703218+0000","last_undegraded":"2024-09-12T02:46:53.703218+0000","last_fullsized":"2024-09-12T02:46:53.703218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:20.756820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550117+0000","last_change":"2024-09-12T02:45:45.490632+0000","last_active":"2024-09-12T02:46:12.550117+0000","last_peered":"2024-09-12T02:46:12.550117+0000","last_clean":"2024-09-12T02:46:12.550117+0000","last_became_active":"2024-09-12T02:45:45.490098+0000","last_became_peered":"2024-09-12T02:45:45.490098+0000","last_unstale":"2024-09-12T02:46:12.550117+0000","last_undegraded":"2024-09-12T02:46:12.550117+0000","last_fullsized":"2024-09-12T02:46:12.550117+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:07.780423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.558511+0000","last_change":"2024-09-12T02:45:45.481451+0000","last_active":"2024-09-12T02:46:12.558511+0000","last_peered":"2024-09-12T02:46:12.558511+0000","last_clean":"2024-09-12T02:46:12.558511+0000","last_became_active":"2024-09-12T02:45:45.480969+0000","last_became_peered":"2024-09-12T02:45:45.480969+0000","last_unstale":"2024-09-12T02:46:12.558511+0000","last_undegraded":"2024-09-12T02:46:12.558511+0000","last_fullsized":"2024-09-12T02:46:12.558511+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:25.320414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.554975+0000","last_change":"2024-09-12T02:45:35.435918+0000","last_active":"2024-09-12T02:46:12.554975+0000","last_peered":"2024-09-12T02:46:12.554975+0000","last_clean":"2024-09-12T02:46:12.554975+0000","last_became_active":"2024-09-12T02:45:35.433911+0000","last_became_peered":"2024-09-12T02:45:35.433911+0000","last_unstale":"2024-09-12T02:46:12.554975+0000","last_undegraded":"2024-09-12T02:46:12.554975+0000","last_fullsized":"2024-09-12T02:46:12.554975+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:27.147122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"96'3","reported_seq":43,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:33.665587+0000","last_change":"2024-09-12T02:45:32.391021+0000","last_active":"2024-09-12T02:46:33.665587+0000","last_peered":"2024-09-12T02:46:33.665587+0000","last_clean":"2024-09-12T02:46:33.665587+0000","last_became_active":"2024-09-12T02:45:32.390532+0000","last_became_peered":"2024-09-12T02:45:32.390532+0000","last_unstale":"2024-09-12T02:46:33.665587+0000","last_undegraded":"2024-09-12T02:46:33.665587+0000","last_fullsized":"2024-09-12T02:46:33.665587+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:22.708802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555816+0000","last_change":"2024-09-12T02:45:45.494725+0000","last_active":"2024-09-12T02:46:12.555816+0000","last_peered":"2024-09-12T02:46:12.555816+0000","last_clean":"2024-09-12T02:46:12.555816+0000","last_became_active":"2024-09-12T02:45:45.494212+0000","last_became_peered":"2024-09-12T02:45:45.494212+0000","last_unstale":"2024-09-12T02:46:12.555816+0000","last_undegraded":"2024-09-12T02:46:12.555816+0000","last_fullsized":"2024-09-12T02:46:12.555816+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:52.305590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550186+0000","last_change":"2024-09-12T02:45:35.438200+0000","last_active":"2024-09-12T02:46:12.550186+0000","last_peered":"2024-09-12T02:46:12.550186+0000","last_clean":"2024-09-12T02:46:12.550186+0000","last_became_active":"2024-09-12T02:45:35.437585+0000","last_became_peered":"2024-09-12T02:45:35.437585+0000","last_unstale":"2024-09-12T02:46:12.550186+0000","last_undegraded":"2024-09-12T02:46:12.550186+0000","last_fullsized":"2024-09-12T02:46:12.550186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:57.675512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"96'3","reported_seq":43,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:31.643429+0000","last_change":"2024-09-12T02:45:32.385619+0000","last_active":"2024-09-12T02:46:31.643429+0000","last_peered":"2024-09-12T02:46:31.643429+0000","last_clean":"2024-09-12T02:46:31.643429+0000","last_became_active":"2024-09-12T02:45:32.384997+0000","last_became_peered":"2024-09-12T02:45:32.384997+0000","last_unstale":"2024-09-12T02:46:31.643429+0000","last_undegraded":"2024-09-12T02:46:31.643429+0000","last_fullsized":"2024-09-12T02:46:31.643429+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:11.716779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"96'7","reported_seq":46,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:32.648067+0000","last_change":"2024-09-12T02:45:32.388089+0000","last_active":"2024-09-12T02:46:32.648067+0000","last_peered":"2024-09-12T02:46:32.648067+0000","last_clean":"2024-09-12T02:46:32.648067+0000","last_became_active":"2024-09-12T02:45:32.387560+0000","last_became_peered":"2024-09-12T02:45:32.387560+0000","last_unstale":"2024-09-12T02:46:32.648067+0000","last_undegraded":"2024-09-12T02:46:32.648067+0000","last_fullsized":"2024-09-12T02:46:32.648067+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:14.290116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.558894+0000","last_change":"2024-09-12T02:46:12.558894+0000","last_active":"2024-09-12T02:46:12.558894+0000","last_peered":"2024-09-12T02:46:12.558894+0000","last_clean":"2024-09-12T02:46:12.558894+0000","last_became_active":"2024-09-12T02:46:12.558518+0000","last_became_peered":"2024-09-12T02:46:12.558518+0000","last_unstale":"2024-09-12T02:46:12.558894+0000","last_undegraded":"2024-09-12T02:46:12.558894+0000","last_fullsized":"2024-09-12T02:46:12.558894+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:00.171554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550842+0000","last_change":"2024-09-12T02:45:45.494098+0000","last_active":"2024-09-12T02:46:12.550842+0000","last_peered":"2024-09-12T02:46:12.550842+0000","last_clean":"2024-09-12T02:46:12.550842+0000","last_became_active":"2024-09-12T02:45:45.493698+0000","last_became_peered":"2024-09-12T02:45:45.493698+0000","last_unstale":"2024-09-12T02:46:12.550842+0000","last_undegraded":"2024-09-12T02:46:12.550842+0000","last_fullsized":"2024-09-12T02:46:12.550842+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:39.832159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"96'5","reported_seq":69,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:49.698005+0000","last_change":"2024-09-12T02:46:12.952787+0000","last_active":"2024-09-12T02:46:49.698005+0000","last_peered":"2024-09-12T02:46:49.698005+0000","last_clean":"2024-09-12T02:46:49.698005+0000","last_became_active":"2024-09-12T02:46:12.952373+0000","last_became_peered":"2024-09-12T02:46:12.952373+0000","last_unstale":"2024-09-12T02:46:49.698005+0000","last_undegraded":"2024-09-12T02:46:49.698005+0000","last_fullsized":"2024-09-12T02:46:49.698005+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:49.435438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.554922+0000","last_change":"2024-09-12T02:45:35.427334+0000","last_active":"2024-09-12T02:46:12.554922+0000","last_peered":"2024-09-12T02:46:12.554922+0000","last_clean":"2024-09-12T02:46:12.554922+0000","last_became_active":"2024-09-12T02:45:35.427010+0000","last_became_peered":"2024-09-12T02:45:35.427010+0000","last_unstale":"2024-09-12T02:46:12.554922+0000","last_undegraded":"2024-09-12T02:46:12.554922+0000","last_fullsized":"2024-09-12T02:46:12.554922+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:39.587384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550784+0000","last_change":"2024-09-12T02:45:45.482354+0000","last_active":"2024-09-12T02:46:12.550784+0000","last_peered":"2024-09-12T02:46:12.550784+0000","last_clean":"2024-09-12T02:46:12.550784+0000","last_became_active":"2024-09-12T02:45:45.481411+0000","last_became_peered":"2024-09-12T02:45:45.481411+0000","last_unstale":"2024-09-12T02:46:12.550784+0000","last_undegraded":"2024-09-12T02:46:12.550784+0000","last_fullsized":"2024-09-12T02:46:12.550784+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:43.049433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555056+0000","last_change":"2024-09-12T02:45:35.430793+0000","last_active":"2024-09-12T02:46:12.555056+0000","last_peered":"2024-09-12T02:46:12.555056+0000","last_clean":"2024-09-12T02:46:12.555056+0000","last_became_active":"2024-09-12T02:45:35.430468+0000","last_became_peered":"2024-09-12T02:45:35.430468+0000","last_unstale":"2024-09-12T02:46:12.555056+0000","last_undegraded":"2024-09-12T02:46:12.555056+0000","last_fullsized":"2024-09-12T02:46:12.555056+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:19.446186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.557140+0000","last_change":"2024-09-12T02:46:12.557140+0000","last_active":"2024-09-12T02:46:12.557140+0000","last_peered":"2024-09-12T02:46:12.557140+0000","last_clean":"2024-09-12T02:46:12.557140+0000","last_became_active":"2024-09-12T02:46:12.556649+0000","last_became_peered":"2024-09-12T02:46:12.556649+0000","last_unstale":"2024-09-12T02:46:12.557140+0000","last_undegraded":"2024-09-12T02:46:12.557140+0000","last_fullsized":"2024-09-12T02:46:12.557140+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:04.154036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550615+0000","last_change":"2024-09-12T02:45:35.438653+0000","last_active":"2024-09-12T02:46:12.550615+0000","last_peered":"2024-09-12T02:46:12.550615+0000","last_clean":"2024-09-12T02:46:12.550615+0000","last_became_active":"2024-09-12T02:45:35.438352+0000","last_became_peered":"2024-09-12T02:45:35.438352+0000","last_unstale":"2024-09-12T02:46:12.550615+0000","last_undegraded":"2024-09-12T02:46:12.550615+0000","last_fullsized":"2024-09-12T02:46:12.550615+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:34.665709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.558006+0000","last_change":"2024-09-12T02:45:35.424654+0000","last_active":"2024-09-12T02:46:12.558006+0000","last_peered":"2024-09-12T02:46:12.558006+0000","last_clean":"2024-09-12T02:46:12.558006+0000","last_became_active":"2024-09-12T02:45:35.423269+0000","last_became_peered":"2024-09-12T02:45:35.423269+0000","last_unstale":"2024-09-12T02:46:12.558006+0000","last_undegraded":"2024-09-12T02:46:12.558006+0000","last_fullsized":"2024-09-12T02:46:12.558006+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:16.595261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.369128+0000","last_change":"2024-09-12T02:45:35.428658+0000","last_active":"2024-09-12T02:46:13.369128+0000","last_peered":"2024-09-12T02:46:13.369128+0000","last_clean":"2024-09-12T02:46:13.369128+0000","last_became_active":"2024-09-12T02:45:35.428333+0000","last_became_peered":"2024-09-12T02:45:35.428333+0000","last_unstale":"2024-09-12T02:46:13.369128+0000","last_undegraded":"2024-09-12T02:46:13.369128+0000","last_fullsized":"2024-09-12T02:46:13.369128+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:41:38.418409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556428+0000","last_change":"2024-09-12T02:45:35.427806+0000","last_active":"2024-09-12T02:46:12.556428+0000","last_peered":"2024-09-12T02:46:12.556428+0000","last_clean":"2024-09-12T02:46:12.556428+0000","last_became_active":"2024-09-12T02:45:35.427418+0000","last_became_peered":"2024-09-12T02:45:35.427418+0000","last_unstale":"2024-09-12T02:46:12.556428+0000","last_undegraded":"2024-09-12T02:46:12.556428+0000","last_fullsized":"2024-09-12T02:46:12.556428+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:27.184153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.551099+0000","last_change":"2024-09-12T02:45:35.430350+0000","last_active":"2024-09-12T02:46:12.551099+0000","last_peered":"2024-09-12T02:46:12.551099+0000","last_clean":"2024-09-12T02:46:12.551099+0000","last_became_active":"2024-09-12T02:45:35.429807+0000","last_became_peered":"2024-09-12T02:45:35.429807+0000","last_unstale":"2024-09-12T02:46:12.551099+0000","last_undegraded":"2024-09-12T02:46:12.551099+0000","last_fullsized":"2024-09-12T02:46:12.551099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:41.043882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550873+0000","last_change":"2024-09-12T02:45:35.438354+0000","last_active":"2024-09-12T02:46:12.550873+0000","last_peered":"2024-09-12T02:46:12.550873+0000","last_clean":"2024-09-12T02:46:12.550873+0000","last_became_active":"2024-09-12T02:45:35.437987+0000","last_became_peered":"2024-09-12T02:45:35.437987+0000","last_unstale":"2024-09-12T02:46:12.550873+0000","last_undegraded":"2024-09-12T02:46:12.550873+0000","last_fullsized":"2024-09-12T02:46:12.550873+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:51.202605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.553097+0000","last_change":"2024-09-12T02:45:35.438633+0000","last_active":"2024-09-12T02:46:12.553097+0000","last_peered":"2024-09-12T02:46:12.553097+0000","last_clean":"2024-09-12T02:46:12.553097+0000","last_became_active":"2024-09-12T02:45:35.438288+0000","last_became_peered":"2024-09-12T02:45:35.438288+0000","last_unstale":"2024-09-12T02:46:12.553097+0000","last_undegraded":"2024-09-12T02:46:12.553097+0000","last_fullsized":"2024-09-12T02:46:12.553097+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:22.037816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550253+0000","last_change":"2024-09-12T02:45:35.437493+0000","last_active":"2024-09-12T02:46:12.550253+0000","last_peered":"2024-09-12T02:46:12.550253+0000","last_clean":"2024-09-12T02:46:12.550253+0000","last_became_active":"2024-09-12T02:45:35.434830+0000","last_became_peered":"2024-09-12T02:45:35.434830+0000","last_unstale":"2024-09-12T02:46:12.550253+0000","last_undegraded":"2024-09-12T02:46:12.550253+0000","last_fullsized":"2024-09-12T02:46:12.550253+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:16.970119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.558495+0000","last_change":"2024-09-12T02:46:12.558495+0000","last_active":"2024-09-12T02:46:12.558495+0000","last_peered":"2024-09-12T02:46:12.558495+0000","last_clean":"2024-09-12T02:46:12.558495+0000","last_became_active":"2024-09-12T02:46:12.558172+0000","last_became_peered":"2024-09-12T02:46:12.558172+0000","last_unstale":"2024-09-12T02:46:12.558495+0000","last_undegraded":"2024-09-12T02:46:12.558495+0000","last_fullsized":"2024-09-12T02:46:12.558495+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:02.114483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,8],"acting":[1,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.368921+0000","last_change":"2024-09-12T02:45:35.428552+0000","last_active":"2024-09-12T02:46:13.368921+0000","last_peered":"2024-09-12T02:46:13.368921+0000","last_clean":"2024-09-12T02:46:13.368921+0000","last_became_active":"2024-09-12T02:45:35.428029+0000","last_became_peered":"2024-09-12T02:45:35.428029+0000","last_unstale":"2024-09-12T02:46:13.368921+0000","last_undegraded":"2024-09-12T02:46:13.368921+0000","last_fullsized":"2024-09-12T02:46:13.368921+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:57.669432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555626+0000","last_change":"2024-09-12T02:45:35.427928+0000","last_active":"2024-09-12T02:46:12.555626+0000","last_peered":"2024-09-12T02:46:12.555626+0000","last_clean":"2024-09-12T02:46:12.555626+0000","last_became_active":"2024-09-12T02:45:35.427452+0000","last_became_peered":"2024-09-12T02:45:35.427452+0000","last_unstale":"2024-09-12T02:46:12.555626+0000","last_undegraded":"2024-09-12T02:46:12.555626+0000","last_fullsized":"2024-09-12T02:46:12.555626+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:01.646899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.551121+0000","last_change":"2024-09-12T02:45:35.432714+0000","last_active":"2024-09-12T02:46:12.551121+0000","last_peered":"2024-09-12T02:46:12.551121+0000","last_clean":"2024-09-12T02:46:12.551121+0000","last_became_active":"2024-09-12T02:45:35.431698+0000","last_became_peered":"2024-09-12T02:45:35.431698+0000","last_unstale":"2024-09-12T02:46:12.551121+0000","last_undegraded":"2024-09-12T02:46:12.551121+0000","last_fullsized":"2024-09-12T02:46:12.551121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:34.925405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555766+0000","last_change":"2024-09-12T02:45:35.432157+0000","last_active":"2024-09-12T02:46:12.555766+0000","last_peered":"2024-09-12T02:46:12.555766+0000","last_clean":"2024-09-12T02:46:12.555766+0000","last_became_active":"2024-09-12T02:45:35.431847+0000","last_became_peered":"2024-09-12T02:45:35.431847+0000","last_unstale":"2024-09-12T02:46:12.555766+0000","last_undegraded":"2024-09-12T02:46:12.555766+0000","last_fullsized":"2024-09-12T02:46:12.555766+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:43.928689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556186+0000","last_change":"2024-09-12T02:45:35.429942+0000","last_active":"2024-09-12T02:46:12.556186+0000","last_peered":"2024-09-12T02:46:12.556186+0000","last_clean":"2024-09-12T02:46:12.556186+0000","last_became_active":"2024-09-12T02:45:35.429154+0000","last_became_peered":"2024-09-12T02:45:35.429154+0000","last_unstale":"2024-09-12T02:46:12.556186+0000","last_undegraded":"2024-09-12T02:46:12.556186+0000","last_fullsized":"2024-09-12T02:46:12.556186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:03.888466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.552068+0000","last_change":"2024-09-12T02:45:35.429241+0000","last_active":"2024-09-12T02:46:12.552068+0000","last_peered":"2024-09-12T02:46:12.552068+0000","last_clean":"2024-09-12T02:46:12.552068+0000","last_became_active":"2024-09-12T02:45:35.428927+0000","last_became_peered":"2024-09-12T02:45:35.428927+0000","last_unstale":"2024-09-12T02:46:12.552068+0000","last_undegraded":"2024-09-12T02:46:12.552068+0000","last_fullsized":"2024-09-12T02:46:12.552068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:04.306748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.557230+0000","last_change":"2024-09-12T02:45:35.424196+0000","last_active":"2024-09-12T02:46:12.557230+0000","last_peered":"2024-09-12T02:46:12.557230+0000","last_clean":"2024-09-12T02:46:12.557230+0000","last_became_active":"2024-09-12T02:45:35.423882+0000","last_became_peered":"2024-09-12T02:45:35.423882+0000","last_unstale":"2024-09-12T02:46:12.557230+0000","last_undegraded":"2024-09-12T02:46:12.557230+0000","last_fullsized":"2024-09-12T02:46:12.557230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:35.118183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.557801+0000","last_change":"2024-09-12T02:45:35.426770+0000","last_active":"2024-09-12T02:46:12.557801+0000","last_peered":"2024-09-12T02:46:12.557801+0000","last_clean":"2024-09-12T02:46:12.557801+0000","last_became_active":"2024-09-12T02:45:35.425905+0000","last_became_peered":"2024-09-12T02:45:35.425905+0000","last_unstale":"2024-09-12T02:46:12.557801+0000","last_undegraded":"2024-09-12T02:46:12.557801+0000","last_fullsized":"2024-09-12T02:46:12.557801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:35.447860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.368875+0000","last_change":"2024-09-12T02:45:35.423413+0000","last_active":"2024-09-12T02:46:13.368875+0000","last_peered":"2024-09-12T02:46:13.368875+0000","last_clean":"2024-09-12T02:46:13.368875+0000","last_became_active":"2024-09-12T02:45:35.423113+0000","last_became_peered":"2024-09-12T02:45:35.423113+0000","last_unstale":"2024-09-12T02:46:13.368875+0000","last_undegraded":"2024-09-12T02:46:13.368875+0000","last_fullsized":"2024-09-12T02:46:13.368875+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:24.194882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.951171+0000","last_change":"2024-09-12T02:45:35.427814+0000","last_active":"2024-09-12T02:46:12.951171+0000","last_peered":"2024-09-12T02:46:12.951171+0000","last_clean":"2024-09-12T02:46:12.951171+0000","last_became_active":"2024-09-12T02:45:35.427495+0000","last_became_peered":"2024-09-12T02:45:35.427495+0000","last_unstale":"2024-09-12T02:46:12.951171+0000","last_undegraded":"2024-09-12T02:46:12.951171+0000","last_fullsized":"2024-09-12T02:46:12.951171+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:36:59.459681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556896+0000","last_change":"2024-09-12T02:45:35.432816+0000","last_active":"2024-09-12T02:46:12.556896+0000","last_peered":"2024-09-12T02:46:12.556896+0000","last_clean":"2024-09-12T02:46:12.556896+0000","last_became_active":"2024-09-12T02:45:35.432415+0000","last_became_peered":"2024-09-12T02:45:35.432415+0000","last_unstale":"2024-09-12T02:46:12.556896+0000","last_undegraded":"2024-09-12T02:46:12.556896+0000","last_fullsized":"2024-09-12T02:46:12.556896+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:06.434342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.554370+0000","last_change":"2024-09-12T02:45:35.417788+0000","last_active":"2024-09-12T02:46:12.554370+0000","last_peered":"2024-09-12T02:46:12.554370+0000","last_clean":"2024-09-12T02:46:12.554370+0000","last_became_active":"2024-09-12T02:45:35.417382+0000","last_became_peered":"2024-09-12T02:45:35.417382+0000","last_unstale":"2024-09-12T02:46:12.554370+0000","last_undegraded":"2024-09-12T02:46:12.554370+0000","last_fullsized":"2024-09-12T02:46:12.554370+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:38.752047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.552943+0000","last_change":"2024-09-12T02:45:35.422546+0000","last_active":"2024-09-12T02:46:12.552943+0000","last_peered":"2024-09-12T02:46:12.552943+0000","last_clean":"2024-09-12T02:46:12.552943+0000","last_became_active":"2024-09-12T02:45:35.422184+0000","last_became_peered":"2024-09-12T02:45:35.422184+0000","last_unstale":"2024-09-12T02:46:12.552943+0000","last_undegraded":"2024-09-12T02:46:12.552943+0000","last_fullsized":"2024-09-12T02:46:12.552943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.022551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.550180+0000","last_change":"2024-09-12T02:45:35.435371+0000","last_active":"2024-09-12T02:46:12.550180+0000","last_peered":"2024-09-12T02:46:12.550180+0000","last_clean":"2024-09-12T02:46:12.550180+0000","last_became_active":"2024-09-12T02:45:35.435054+0000","last_became_peered":"2024-09-12T02:45:35.435054+0000","last_unstale":"2024-09-12T02:46:12.550180+0000","last_undegraded":"2024-09-12T02:46:12.550180+0000","last_fullsized":"2024-09-12T02:46:12.550180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:18.099755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556306+0000","last_change":"2024-09-12T02:45:35.421617+0000","last_active":"2024-09-12T02:46:12.556306+0000","last_peered":"2024-09-12T02:46:12.556306+0000","last_clean":"2024-09-12T02:46:12.556306+0000","last_became_active":"2024-09-12T02:45:35.421247+0000","last_became_peered":"2024-09-12T02:45:35.421247+0000","last_unstale":"2024-09-12T02:46:12.556306+0000","last_undegraded":"2024-09-12T02:46:12.556306+0000","last_fullsized":"2024-09-12T02:46:12.556306+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:04.457638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:13.370227+0000","last_change":"2024-09-12T02:46:13.370227+0000","last_active":"2024-09-12T02:46:13.370227+0000","last_peered":"2024-09-12T02:46:13.370227+0000","last_clean":"2024-09-12T02:46:13.370227+0000","last_became_active":"2024-09-12T02:46:13.369826+0000","last_became_peered":"2024-09-12T02:46:13.369826+0000","last_unstale":"2024-09-12T02:46:13.370227+0000","last_undegraded":"2024-09-12T02:46:13.370227+0000","last_fullsized":"2024-09-12T02:46:13.370227+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:13.621494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.555079+0000","last_change":"2024-09-12T02:45:35.441542+0000","last_active":"2024-09-12T02:46:12.555079+0000","last_peered":"2024-09-12T02:46:12.555079+0000","last_clean":"2024-09-12T02:46:12.555079+0000","last_became_active":"2024-09-12T02:45:35.441215+0000","last_became_peered":"2024-09-12T02:45:35.441215+0000","last_unstale":"2024-09-12T02:46:12.555079+0000","last_undegraded":"2024-09-12T02:46:12.555079+0000","last_fullsized":"2024-09-12T02:46:12.555079+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:42.978480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.951037+0000","last_change":"2024-09-12T02:45:35.425410+0000","last_active":"2024-09-12T02:46:12.951037+0000","last_peered":"2024-09-12T02:46:12.951037+0000","last_clean":"2024-09-12T02:46:12.951037+0000","last_became_active":"2024-09-12T02:45:35.424960+0000","last_became_peered":"2024-09-12T02:45:35.424960+0000","last_unstale":"2024-09-12T02:46:12.951037+0000","last_undegraded":"2024-09-12T02:46:12.951037+0000","last_fullsized":"2024-09-12T02:46:12.951037+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:45.162712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.558414+0000","last_change":"2024-09-12T02:45:35.415105+0000","last_active":"2024-09-12T02:46:12.558414+0000","last_peered":"2024-09-12T02:46:12.558414+0000","last_clean":"2024-09-12T02:46:12.558414+0000","last_became_active":"2024-09-12T02:45:35.414338+0000","last_became_peered":"2024-09-12T02:45:35.414338+0000","last_unstale":"2024-09-12T02:46:12.558414+0000","last_undegraded":"2024-09-12T02:46:12.558414+0000","last_fullsized":"2024-09-12T02:46:12.558414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:45.011716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.558654+0000","last_change":"2024-09-12T02:45:35.420637+0000","last_active":"2024-09-12T02:46:12.558654+0000","last_peered":"2024-09-12T02:46:12.558654+0000","last_clean":"2024-09-12T02:46:12.558654+0000","last_became_active":"2024-09-12T02:45:35.420354+0000","last_became_peered":"2024-09-12T02:45:35.420354+0000","last_unstale":"2024-09-12T02:46:12.558654+0000","last_undegraded":"2024-09-12T02:46:12.558654+0000","last_fullsized":"2024-09-12T02:46:12.558654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:15.807265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T02:46:12.556094+0000","last_change":"2024-09-12T02:45:35.429505+0000","last_active":"2024-09-12T02:46:12.556094+0000","last_peered":"2024-09-12T02:46:12.556094+0000","last_clean":"2024-09-12T02:46:12.556094+0000","last_became_active":"2024-09-12T02:45:35.428728+0000","last_became_peered":"2024-09-12T02:45:35.428728+0000","last_unstale":"2024-09-12T02:46:12.556094+0000","last_undegraded":"2024-09-12T02:46:12.556094+0000","last_fullsized":"2024-09-12T02:46:12.556094+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:15.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63372,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":224,"num_read_kb":186,"num_write":244,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":181586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416413,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1114112,"data_stored":546718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678050,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28776,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716376,"statfs":{"total":95995035648,"available":95965569024,"internally_reserved":0,"allocated":1794048,"data_stored":1189193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841575,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1134592,"data_stored":550239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070509,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32276,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712876,"statfs":{"total":95995035648,"available":95961985024,"internally_reserved":0,"allocated":1118208,"data_stored":546409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332146,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37028,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708124,"statfs":{"total":95995035648,"available":95957118976,"internally_reserved":0,"allocated":1724416,"data_stored":1143020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495671,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":542040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757309,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28716,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716436,"statfs":{"total":95995035648,"available":95965630464,"internally_reserved":0,"allocated":1732608,"data_stored":1138209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920835,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1122304,"data_stored":546343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182473,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1118208,"data_stored":541355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1167360,"data_stored":594455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28168,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716984,"statfs":{"total":95995035648,"available":95966191616,"internally_reserved":0,"allocated":1171456,"data_stored":595081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1130496,"data_stored":543496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":54156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":53530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":57900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:46:57.177 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T02:46:57.178 INFO:tasks.cephadm:Setting up client nodes... 2024-09-12T02:46:57.178 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-12T02:46:57.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:56 smithi176 ceph-mon[35713]: from='client.24746 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:46:57.601 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:46:57.843 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:57 smithi018 ceph-mon[30616]: pgmap v349: 129 pgs: 129 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-12T02:46:58.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:57 smithi062 ceph-mon[35527]: pgmap v349: 129 pgs: 129 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-12T02:46:58.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:57 smithi176 ceph-mon[35713]: pgmap v349: 129 pgs: 129 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-12T02:46:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.301+0000 7f71ec400640 1 -- 172.21.15.18:0/4192428666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e4105920 msgr2=0x7f71e410c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.301+0000 7f71ec400640 1 --2- 172.21.15.18:0/4192428666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e4105920 0x7f71e410c240 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009ca0 tx=0x7f71dc02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.301+0000 7f71ec400640 1 -- 172.21.15.18:0/4192428666 shutdown_connections 2024-09-12T02:46:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.301+0000 7f71ec400640 1 --2- 172.21.15.18:0/4192428666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e4105920 0x7f71e410c240 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.301+0000 7f71ec400640 1 --2- 172.21.15.18:0/4192428666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71e4104f60 0x7f71e41053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.301+0000 7f71ec400640 1 --2- 172.21.15.18:0/4192428666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e4103e00 0x7f71e4104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.301+0000 7f71ec400640 1 -- 172.21.15.18:0/4192428666 >> 172.21.15.18:0/4192428666 conn(0x7f71e40ff5b0 msgr2=0x7f71e41019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.301+0000 7f71ec400640 1 -- 172.21.15.18:0/4192428666 shutdown_connections 2024-09-12T02:46:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.301+0000 7f71ec400640 1 -- 172.21.15.18:0/4192428666 wait complete. 2024-09-12T02:46:58.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.302+0000 7f71ec400640 1 Processor -- start 2024-09-12T02:46:58.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.302+0000 7f71ec400640 1 -- start start 2024-09-12T02:46:58.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.302+0000 7f71ec400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e4103e00 0x7f71e419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.302+0000 7f71ec400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e4104f60 0x7f71e419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.302+0000 7f71ec400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71e4105920 0x7f71e41a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.302+0000 7f71ec400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f71e410fab0 con 0x7f71e4103e00 2024-09-12T02:46:58.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.302+0000 7f71ec400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f71e410f930 con 0x7f71e4105920 2024-09-12T02:46:58.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.302+0000 7f71ec400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f71e410fc30 con 0x7f71e4104f60 2024-09-12T02:46:58.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.303+0000 7f71e9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e4103e00 0x7f71e419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.303+0000 7f71e9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e4103e00 0x7f71e419a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42776/0 (socket says 172.21.15.18:42776) 2024-09-12T02:46:58.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.303+0000 7f71e9a00640 1 -- 172.21.15.18:0/1376461437 learned_addr learned my addr 172.21.15.18:0/1376461437 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:46:58.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.303+0000 7f71e9000640 1 --2- 172.21.15.18:0/1376461437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e4104f60 0x7f71e419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.303+0000 7f71ea400640 1 --2- 172.21.15.18:0/1376461437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71e4105920 0x7f71e41a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.303+0000 7f71e9a00640 1 -- 172.21.15.18:0/1376461437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e4104f60 msgr2=0x7f71e419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.303+0000 7f71e9a00640 1 --2- 172.21.15.18:0/1376461437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e4104f60 0x7f71e419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.303+0000 7f71e9a00640 1 -- 172.21.15.18:0/1376461437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71e4105920 msgr2=0x7f71e41a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.303+0000 7f71e9a00640 1 --2- 172.21.15.18:0/1376461437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71e4105920 0x7f71e41a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.303+0000 7f71e9a00640 1 -- 172.21.15.18:0/1376461437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e41a1cb0 con 0x7f71e4103e00 2024-09-12T02:46:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.304+0000 7f71e9a00640 1 --2- 172.21.15.18:0/1376461437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e4103e00 0x7f71e419a080 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f71d800e9f0 tx=0x7f71d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.304+0000 7f71e2000640 1 -- 172.21.15.18:0/1376461437 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d800cd80 con 0x7f71e4103e00 2024-09-12T02:46:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.304+0000 7f71e2000640 1 -- 172.21.15.18:0/1376461437 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71d8005500 con 0x7f71e4103e00 2024-09-12T02:46:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.304+0000 7f71e2000640 1 -- 172.21.15.18:0/1376461437 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d8010690 con 0x7f71e4103e00 2024-09-12T02:46:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.304+0000 7f71ec400640 1 -- 172.21.15.18:0/1376461437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e41a1fa0 con 0x7f71e4103e00 2024-09-12T02:46:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.304+0000 7f71ec400640 1 -- 172.21.15.18:0/1376461437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e41a23a0 con 0x7f71e4103e00 2024-09-12T02:46:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.305+0000 7f71ec400640 1 -- 172.21.15.18:0/1376461437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71e410b120 con 0x7f71e4103e00 2024-09-12T02:46:58.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.307+0000 7f71e2000640 1 -- 172.21.15.18:0/1376461437 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f71d80046c0 con 0x7f71e4103e00 2024-09-12T02:46:58.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.308+0000 7f71e2000640 1 --2- 172.21.15.18:0/1376461437 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f71cc0a2c40 0x7f71cc0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:46:58.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.308+0000 7f71e2000640 1 -- 172.21.15.18:0/1376461437 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7f71d80cf960 con 0x7f71e4103e00 2024-09-12T02:46:58.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.309+0000 7f71e9000640 1 --2- 172.21.15.18:0/1376461437 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f71cc0a2c40 0x7f71cc0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:46:58.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.309+0000 7f71e9000640 1 --2- 172.21.15.18:0/1376461437 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f71cc0a2c40 0x7f71cc0a5100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f71e419b5a0 tx=0x7f71d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:46:58.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.313+0000 7f71e2000640 1 -- 172.21.15.18:0/1376461437 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f71d809c3a0 con 0x7f71e4103e00 2024-09-12T02:46:58.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.564+0000 7f71ec400640 1 -- 172.21.15.18:0/1376461437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f71e402da30 con 0x7f71e4103e00 2024-09-12T02:46:58.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.566+0000 7f71e2000640 1 -- 172.21.15.18:0/1376461437 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f71d809bca0 con 0x7f71e4103e00 2024-09-12T02:46:58.568 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-12T02:46:58.568 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAiVuJm3kO+IRAAvPGCQdWeCnY3PKhTNQWqXg== 2024-09-12T02:46:58.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.570+0000 7f71ec400640 1 -- 172.21.15.18:0/1376461437 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f71cc0a2c40 msgr2=0x7f71cc0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.570+0000 7f71ec400640 1 --2- 172.21.15.18:0/1376461437 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f71cc0a2c40 0x7f71cc0a5100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f71e419b5a0 tx=0x7f71d0005f90 comp rx=0 tx=0).stop 2024-09-12T02:46:58.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.570+0000 7f71ec400640 1 -- 172.21.15.18:0/1376461437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e4103e00 msgr2=0x7f71e419a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:46:58.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.570+0000 7f71ec400640 1 --2- 172.21.15.18:0/1376461437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e4103e00 0x7f71e419a080 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f71d800e9f0 tx=0x7f71d800edf0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.570+0000 7f71ec400640 1 -- 172.21.15.18:0/1376461437 shutdown_connections 2024-09-12T02:46:58.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.570+0000 7f71ec400640 1 --2- 172.21.15.18:0/1376461437 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f71cc0a2c40 0x7f71cc0a5100 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.570+0000 7f71ec400640 1 --2- 172.21.15.18:0/1376461437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71e4105920 0x7f71e41a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.570+0000 7f71ec400640 1 --2- 172.21.15.18:0/1376461437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e4104f60 0x7f71e419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.570+0000 7f71ec400640 1 --2- 172.21.15.18:0/1376461437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e4103e00 0x7f71e419a080 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:46:58.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.570+0000 7f71ec400640 1 -- 172.21.15.18:0/1376461437 >> 172.21.15.18:0/1376461437 conn(0x7f71e40ff5b0 msgr2=0x7f71e41082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:46:58.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.570+0000 7f71ec400640 1 -- 172.21.15.18:0/1376461437 shutdown_connections 2024-09-12T02:46:58.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:46:58.570+0000 7f71ec400640 1 -- 172.21.15.18:0/1376461437 wait complete. 2024-09-12T02:46:58.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:58 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1376461437' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:46:58.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:46:58 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1376461437' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:46:59.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:58 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1376461437' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:46:59.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:46:58 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1376461437' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:46:59.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:58 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1376461437' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:46:59.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:46:58 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1376461437' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:46:59.483 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:46:59.483 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-12T02:46:59.483 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T02:46:59.565 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T02:46:59.565 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-12T02:46:59.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-12T02:46:59.982 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:00.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.578+0000 7f15ffe00640 1 -- 172.21.15.18:0/315484553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1600103e30 msgr2=0x7f1600104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:00.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.578+0000 7f15ffe00640 1 --2- 172.21.15.18:0/315484553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1600103e30 0x7f1600104210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009860 tx=0x7f15f002a340 comp rx=0 tx=0).stop 2024-09-12T02:47:00.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.578+0000 7f15ffe00640 1 -- 172.21.15.18:0/315484553 shutdown_connections 2024-09-12T02:47:00.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.578+0000 7f15ffe00640 1 --2- 172.21.15.18:0/315484553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1600108f60 0x7f1600110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:00.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.578+0000 7f15ffe00640 1 --2- 172.21.15.18:0/315484553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16001047e0 0x7f1600108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:00.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.578+0000 7f15ffe00640 1 --2- 172.21.15.18:0/315484553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1600103e30 0x7f1600104210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:00.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.578+0000 7f15ffe00640 1 -- 172.21.15.18:0/315484553 >> 172.21.15.18:0/315484553 conn(0x7f16000ff910 msgr2=0x7f1600101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:00.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.578+0000 7f15ffe00640 1 -- 172.21.15.18:0/315484553 shutdown_connections 2024-09-12T02:47:00.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.578+0000 7f15ffe00640 1 -- 172.21.15.18:0/315484553 wait complete. 2024-09-12T02:47:00.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.580+0000 7f15ffe00640 1 Processor -- start 2024-09-12T02:47:00.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.580+0000 7f15ffe00640 1 -- start start 2024-09-12T02:47:00.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.580+0000 7f15ffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1600103e30 0x7f160019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:00.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.580+0000 7f15ffe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16001047e0 0x7f160019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:00.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.580+0000 7f15ffe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1600108f60 0x7f160019ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:00.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.580+0000 7f15ffe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1600113fc0 con 0x7f1600103e30 2024-09-12T02:47:00.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.580+0000 7f15ffe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1600113e40 con 0x7f1600108f60 2024-09-12T02:47:00.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.580+0000 7f15ffe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1600114140 con 0x7f16001047e0 2024-09-12T02:47:00.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.581+0000 7f15fea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1600103e30 0x7f160019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:00.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.581+0000 7f15fea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1600103e30 0x7f160019a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42796/0 (socket says 172.21.15.18:42796) 2024-09-12T02:47:00.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.581+0000 7f15fea00640 1 -- 172.21.15.18:0/4258548563 learned_addr learned my addr 172.21.15.18:0/4258548563 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:00.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.581+0000 7f15ff400640 1 --2- 172.21.15.18:0/4258548563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1600108f60 0x7f160019ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:00.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.581+0000 7f15fe000640 1 --2- 172.21.15.18:0/4258548563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16001047e0 0x7f160019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:00.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.581+0000 7f15fea00640 1 -- 172.21.15.18:0/4258548563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16001047e0 msgr2=0x7f160019a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:00.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.581+0000 7f15fea00640 1 --2- 172.21.15.18:0/4258548563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16001047e0 0x7f160019a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:00.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.581+0000 7f15fea00640 1 -- 172.21.15.18:0/4258548563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1600108f60 msgr2=0x7f160019ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:00.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.581+0000 7f15fea00640 1 --2- 172.21.15.18:0/4258548563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1600108f60 0x7f160019ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:00.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.581+0000 7f15fea00640 1 -- 172.21.15.18:0/4258548563 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160019f430 con 0x7f1600103e30 2024-09-12T02:47:00.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.581+0000 7f15ff400640 1 --2- 172.21.15.18:0/4258548563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1600108f60 0x7f160019ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:00.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.581+0000 7f15fea00640 1 --2- 172.21.15.18:0/4258548563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1600103e30 0x7f160019a480 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f15f0035040 tx=0x7f15f0033b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:00.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.582+0000 7f15f7400640 1 -- 172.21.15.18:0/4258548563 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f0037040 con 0x7f1600103e30 2024-09-12T02:47:00.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.582+0000 7f15f7400640 1 -- 172.21.15.18:0/4258548563 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15f0040070 con 0x7f1600103e30 2024-09-12T02:47:00.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.582+0000 7f15ffe00640 1 -- 172.21.15.18:0/4258548563 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f160019f6c0 con 0x7f1600103e30 2024-09-12T02:47:00.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.582+0000 7f15f7400640 1 -- 172.21.15.18:0/4258548563 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f00039b0 con 0x7f1600103e30 2024-09-12T02:47:00.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.582+0000 7f15ffe00640 1 -- 172.21.15.18:0/4258548563 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16001a7000 con 0x7f1600103e30 2024-09-12T02:47:00.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.583+0000 7f15ffe00640 1 -- 172.21.15.18:0/4258548563 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1600105310 con 0x7f1600103e30 2024-09-12T02:47:00.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.585+0000 7f15f7400640 1 -- 172.21.15.18:0/4258548563 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f15f00305e0 con 0x7f1600103e30 2024-09-12T02:47:00.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.586+0000 7f15f7400640 1 --2- 172.21.15.18:0/4258548563 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f15e40a2c10 0x7f15e40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:00.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.586+0000 7f15f7400640 1 -- 172.21.15.18:0/4258548563 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7f15f00ef3e0 con 0x7f1600103e30 2024-09-12T02:47:00.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.586+0000 7f15fe000640 1 --2- 172.21.15.18:0/4258548563 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f15e40a2c10 0x7f15e40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:00.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.587+0000 7f15fe000640 1 --2- 172.21.15.18:0/4258548563 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f15e40a2c10 0x7f15e40a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f16000ffd30 tx=0x7f15ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:00.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.590+0000 7f15f7400640 1 -- 172.21.15.18:0/4258548563 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f15f00bbf90 con 0x7f1600103e30 2024-09-12T02:47:00.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.825+0000 7f15ffe00640 1 -- 172.21.15.18:0/4258548563 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f160010c140 con 0x7f1600103e30 2024-09-12T02:47:00.829 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:00 smithi018 ceph-mon[30616]: pgmap v350: 129 pgs: 129 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-12T02:47:00.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.831+0000 7f15f7400640 1 -- 172.21.15.18:0/4258548563 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263197 (secure 0 0 0) 0x7f15f00a4e20 con 0x7f1600103e30 2024-09-12T02:47:00.836 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:47:00.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.835+0000 7f15ffe00640 1 -- 172.21.15.18:0/4258548563 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f15e40a2c10 msgr2=0x7f15e40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:00.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.835+0000 7f15ffe00640 1 --2- 172.21.15.18:0/4258548563 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f15e40a2c10 0x7f15e40a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f16000ffd30 tx=0x7f15ec005f90 comp rx=0 tx=0).stop 2024-09-12T02:47:00.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.835+0000 7f15ffe00640 1 -- 172.21.15.18:0/4258548563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1600103e30 msgr2=0x7f160019a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:00.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.835+0000 7f15ffe00640 1 --2- 172.21.15.18:0/4258548563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1600103e30 0x7f160019a480 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f15f0035040 tx=0x7f15f0033b60 comp rx=0 tx=0).stop 2024-09-12T02:47:00.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.835+0000 7f15ffe00640 1 -- 172.21.15.18:0/4258548563 shutdown_connections 2024-09-12T02:47:00.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.835+0000 7f15ffe00640 1 --2- 172.21.15.18:0/4258548563 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f15e40a2c10 0x7f15e40a50d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:00.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.835+0000 7f15ffe00640 1 --2- 172.21.15.18:0/4258548563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1600108f60 0x7f160019ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:00.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.835+0000 7f15ffe00640 1 --2- 172.21.15.18:0/4258548563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16001047e0 0x7f160019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:00.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.835+0000 7f15ffe00640 1 --2- 172.21.15.18:0/4258548563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1600103e30 0x7f160019a480 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:00.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.835+0000 7f15ffe00640 1 -- 172.21.15.18:0/4258548563 >> 172.21.15.18:0/4258548563 conn(0x7f16000ff910 msgr2=0x7f1600100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:00.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.835+0000 7f15ffe00640 1 -- 172.21.15.18:0/4258548563 shutdown_connections 2024-09-12T02:47:00.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:00.836+0000 7f15ffe00640 1 -- 172.21.15.18:0/4258548563 wait complete. 2024-09-12T02:47:00.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:00 smithi176 ceph-mon[35713]: pgmap v350: 129 pgs: 129 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-12T02:47:01.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:00 smithi062 ceph-mon[35527]: pgmap v350: 129 pgs: 129 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-12T02:47:01.724 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":494888664},{"type":"v1","addr":"172.21.15.18:6801","nonce":494888664}]},"active_addr":"172.21.15.18:6801/494888664","active_change":"2024-09-12T02:38:10.526104+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.18:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":1185819845}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":880406453}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":4167793150}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":4191505851}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":3954214834}]}]} 2024-09-12T02:47:01.730 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-12T02:47:01.730 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-12T02:47:01.730 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:47:01.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:01 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/4258548563' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:47:01.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:01 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/4258548563' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:47:02.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:01 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/4258548563' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:47:02.111 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.693+0000 7f6ff3e00640 1 -- 172.21.15.18:0/3226788570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff410e260 msgr2=0x7f6ff4110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.693+0000 7f6ff3e00640 1 --2- 172.21.15.18:0/3226788570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff410e260 0x7f6ff4110650 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009860 tx=0x7f6fec02a3d0 comp rx=0 tx=0).stop 2024-09-12T02:47:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.693+0000 7f6ff3e00640 1 -- 172.21.15.18:0/3226788570 shutdown_connections 2024-09-12T02:47:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.693+0000 7f6ff3e00640 1 --2- 172.21.15.18:0/3226788570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff410e260 0x7f6ff4110650 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.693+0000 7f6ff3e00640 1 --2- 172.21.15.18:0/3226788570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff4074ee0 0x7f6ff410dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.693+0000 7f6ff3e00640 1 --2- 172.21.15.18:0/3226788570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ff40745c0 0x7f6ff40749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.693+0000 7f6ff3e00640 1 -- 172.21.15.18:0/3226788570 >> 172.21.15.18:0/3226788570 conn(0x7f6ff40fd740 msgr2=0x7f6ff40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.693+0000 7f6ff3e00640 1 -- 172.21.15.18:0/3226788570 shutdown_connections 2024-09-12T02:47:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.693+0000 7f6ff3e00640 1 -- 172.21.15.18:0/3226788570 wait complete. 2024-09-12T02:47:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.694+0000 7f6ff3e00640 1 Processor -- start 2024-09-12T02:47:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.695+0000 7f6ff3e00640 1 -- start start 2024-09-12T02:47:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.695+0000 7f6ff3e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff40745c0 0x7f6ff419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.695+0000 7f6ff3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ff4074ee0 0x7f6ff419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.695+0000 7f6ff3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff410e260 0x7f6ff419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.695+0000 7f6ff3e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff4114000 con 0x7f6ff410e260 2024-09-12T02:47:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.695+0000 7f6ff3e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff4113e80 con 0x7f6ff4074ee0 2024-09-12T02:47:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.695+0000 7f6ff3e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff4114180 con 0x7f6ff40745c0 2024-09-12T02:47:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.695+0000 7f6ff2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff40745c0 0x7f6ff419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.695+0000 7f6ff2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff40745c0 0x7f6ff419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:60046/0 (socket says 172.21.15.18:60046) 2024-09-12T02:47:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.695+0000 7f6ff2a00640 1 -- 172.21.15.18:0/2196525011 learned_addr learned my addr 172.21.15.18:0/2196525011 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.696+0000 7f6fea000640 1 --2- 172.21.15.18:0/2196525011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ff4074ee0 0x7f6ff419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.696+0000 7f6ff3400640 1 --2- 172.21.15.18:0/2196525011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff410e260 0x7f6ff419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.696+0000 7f6ff2a00640 1 -- 172.21.15.18:0/2196525011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ff4074ee0 msgr2=0x7f6ff419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.696+0000 7f6ff2a00640 1 --2- 172.21.15.18:0/2196525011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ff4074ee0 0x7f6ff419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.696+0000 7f6ff2a00640 1 -- 172.21.15.18:0/2196525011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff410e260 msgr2=0x7f6ff419ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.696+0000 7f6ff2a00640 1 --2- 172.21.15.18:0/2196525011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff410e260 0x7f6ff419ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.696+0000 7f6ff2a00640 1 -- 172.21.15.18:0/2196525011 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff419f440 con 0x7f6ff40745c0 2024-09-12T02:47:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.696+0000 7f6ff2a00640 1 --2- 172.21.15.18:0/2196525011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff40745c0 0x7f6ff419a490 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400eb90 tx=0x7f6fe400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.696+0000 7f6febe00640 1 -- 172.21.15.18:0/2196525011 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4004d20 con 0x7f6ff40745c0 2024-09-12T02:47:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.697+0000 7f6ff3e00640 1 -- 172.21.15.18:0/2196525011 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff419f730 con 0x7f6ff40745c0 2024-09-12T02:47:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.697+0000 7f6febe00640 1 -- 172.21.15.18:0/2196525011 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fe400ee90 con 0x7f6ff40745c0 2024-09-12T02:47:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.697+0000 7f6febe00640 1 -- 172.21.15.18:0/2196525011 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4010830 con 0x7f6ff40745c0 2024-09-12T02:47:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.697+0000 7f6ff3e00640 1 -- 172.21.15.18:0/2196525011 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff41a7010 con 0x7f6ff40745c0 2024-09-12T02:47:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.698+0000 7f6ff3e00640 1 -- 172.21.15.18:0/2196525011 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff40749a0 con 0x7f6ff40745c0 2024-09-12T02:47:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.699+0000 7f6febe00640 1 -- 172.21.15.18:0/2196525011 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6fe4005020 con 0x7f6ff40745c0 2024-09-12T02:47:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.701+0000 7f6febe00640 1 --2- 172.21.15.18:0/2196525011 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f6fd80a2c10 0x7f6fd80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:02.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.701+0000 7f6febe00640 1 -- 172.21.15.18:0/2196525011 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7f6fe40cfbd0 con 0x7f6ff40745c0 2024-09-12T02:47:02.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.701+0000 7f6fea000640 1 --2- 172.21.15.18:0/2196525011 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f6fd80a2c10 0x7f6fd80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:02.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.702+0000 7f6fea000640 1 --2- 172.21.15.18:0/2196525011 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f6fd80a2c10 0x7f6fd80a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0096c0 tx=0x7f6fdc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:02.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.705+0000 7f6febe00640 1 -- 172.21.15.18:0/2196525011 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6fe409c610 con 0x7f6ff40745c0 2024-09-12T02:47:02.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:02 smithi018 ceph-mon[30616]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-09-12T02:47:02.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.891+0000 7f6ff3e00640 1 -- 172.21.15.18:0/2196525011 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ff419b7f0 con 0x7f6ff40745c0 2024-09-12T02:47:02.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.894+0000 7f6febe00640 1 -- 172.21.15.18:0/2196525011 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+24655 (secure 0 0 0) 0x7f6fe409bf10 con 0x7f6ff40745c0 2024-09-12T02:47:02.895 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:47:02.895 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":96,"fsid":"c7666100-70af-11ef-bcea-c7b262605968","created":"2024-09-12T02:37:14.139566+0000","modified":"2024-09-12T02:46:12.546275+0000","last_up_change":"2024-09-12T02:44:37.774835+0000","last_in_change":"2024-09-12T02:44:16.028970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:40:35.157621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:45:31.022530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:45:34.131637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:45:43.992286+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a61ecdc1-ceb9-43cb-a67d-b197888cca42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6803","nonce":2278662522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6805","nonce":2278662522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6809","nonce":2278662522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6807","nonce":2278662522}]},"public_addr":"172.21.15.18:6803/2278662522","cluster_addr":"172.21.15.18:6805/2278662522","heartbeat_back_addr":"172.21.15.18:6809/2278662522","heartbeat_front_addr":"172.21.15.18:6807/2278662522","state":["exists","up"]},{"osd":1,"uuid":"1b84f4be-23ce-466c-b974-b9851521785d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6801","nonce":3139630617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6803","nonce":3139630617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6807","nonce":3139630617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6805","nonce":3139630617}]},"public_addr":"172.21.15.62:6801/3139630617","cluster_addr":"172.21.15.62:6803/3139630617","heartbeat_back_addr":"172.21.15.62:6807/3139630617","heartbeat_front_addr":"172.21.15.62:6805/3139630617","state":["exists","up"]},{"osd":2,"uuid":"f7bdf028-db32-4d92-a039-bada37c3a146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6801","nonce":2704054654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6803","nonce":2704054654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6807","nonce":2704054654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6805","nonce":2704054654}]},"public_addr":"172.21.15.176:6801/2704054654","cluster_addr":"172.21.15.176:6803/2704054654","heartbeat_back_addr":"172.21.15.176:6807/2704054654","heartbeat_front_addr":"172.21.15.176:6805/2704054654","state":["exists","up"]},{"osd":3,"uuid":"39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6811","nonce":3378134261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6813","nonce":3378134261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6817","nonce":3378134261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6815","nonce":3378134261}]},"public_addr":"172.21.15.18:6811/3378134261","cluster_addr":"172.21.15.18:6813/3378134261","heartbeat_back_addr":"172.21.15.18:6817/3378134261","heartbeat_front_addr":"172.21.15.18:6815/3378134261","state":["exists","up"]},{"osd":4,"uuid":"66a2c8a0-1a99-4c6d-b56a-f1f6c3199655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6809","nonce":1416302860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6811","nonce":1416302860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6815","nonce":1416302860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6813","nonce":1416302860}]},"public_addr":"172.21.15.62:6809/1416302860","cluster_addr":"172.21.15.62:6811/1416302860","heartbeat_back_addr":"172.21.15.62:6815/1416302860","heartbeat_front_addr":"172.21.15.62:6813/1416302860","state":["exists","up"]},{"osd":5,"uuid":"c4070ecf-703a-4f5f-9a2b-63473ff7f98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6809","nonce":2234269387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6811","nonce":2234269387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6815","nonce":2234269387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6813","nonce":2234269387}]},"public_addr":"172.21.15.176:6809/2234269387","cluster_addr":"172.21.15.176:6811/2234269387","heartbeat_back_addr":"172.21.15.176:6815/2234269387","heartbeat_front_addr":"172.21.15.176:6813/2234269387","state":["exists","up"]},{"osd":6,"uuid":"12a08874-041e-4734-bc33-68ebfce97b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6819","nonce":3613955982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6821","nonce":3613955982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6825","nonce":3613955982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6823","nonce":3613955982}]},"public_addr":"172.21.15.18:6819/3613955982","cluster_addr":"172.21.15.18:6821/3613955982","heartbeat_back_addr":"172.21.15.18:6825/3613955982","heartbeat_front_addr":"172.21.15.18:6823/3613955982","state":["exists","up"]},{"osd":7,"uuid":"86a5b47c-143f-4848-892f-c7b6a17a2799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6817","nonce":750933013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6819","nonce":750933013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6823","nonce":750933013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6821","nonce":750933013}]},"public_addr":"172.21.15.62:6817/750933013","cluster_addr":"172.21.15.62:6819/750933013","heartbeat_back_addr":"172.21.15.62:6823/750933013","heartbeat_front_addr":"172.21.15.62:6821/750933013","state":["exists","up"]},{"osd":8,"uuid":"0426a455-ed11-4d6a-8e1d-c8aa2ee65cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6817","nonce":8496953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6819","nonce":8496953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6823","nonce":8496953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6821","nonce":8496953}]},"public_addr":"172.21.15.176:6817/8496953","cluster_addr":"172.21.15.176:6819/8496953","heartbeat_back_addr":"172.21.15.176:6823/8496953","heartbeat_front_addr":"172.21.15.176:6821/8496953","state":["exists","up"]},{"osd":9,"uuid":"241aa2cf-0765-465d-b400-4911e653412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6827","nonce":422514390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6829","nonce":422514390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6833","nonce":422514390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6831","nonce":422514390}]},"public_addr":"172.21.15.18:6827/422514390","cluster_addr":"172.21.15.18:6829/422514390","heartbeat_back_addr":"172.21.15.18:6833/422514390","heartbeat_front_addr":"172.21.15.18:6831/422514390","state":["exists","up"]},{"osd":10,"uuid":"b1d4ab1f-0ec4-4641-bab0-f39d15857615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6825","nonce":269877918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6827","nonce":269877918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6831","nonce":269877918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6829","nonce":269877918}]},"public_addr":"172.21.15.62:6825/269877918","cluster_addr":"172.21.15.62:6827/269877918","heartbeat_back_addr":"172.21.15.62:6831/269877918","heartbeat_front_addr":"172.21.15.62:6829/269877918","state":["exists","up"]},{"osd":11,"uuid":"d122f1bf-bd4f-45d5-b07c-7301b005977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6825","nonce":770358485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6827","nonce":770358485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6831","nonce":770358485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6829","nonce":770358485}]},"public_addr":"172.21.15.176:6825/770358485","cluster_addr":"172.21.15.176:6827/770358485","heartbeat_back_addr":"172.21.15.176:6831/770358485","heartbeat_front_addr":"172.21.15.176:6829/770358485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:39:42.435560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:09.100602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:32.884117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:01.733821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:29.812775+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:53.846503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:24.363464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:51.023614+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:15.782652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:45.378178+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:12.469173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:36.303058+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":1,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2679362143":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/4236556151":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6801/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6800/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/1197309398":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/3024661873":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/2429098892":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6801/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6800/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/1531572357":"2024-09-13T02:37:40.790128+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:47:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.896+0000 7f6ff3e00640 1 -- 172.21.15.18:0/2196525011 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f6fd80a2c10 msgr2=0x7f6fd80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.896+0000 7f6ff3e00640 1 --2- 172.21.15.18:0/2196525011 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f6fd80a2c10 0x7f6fd80a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0096c0 tx=0x7f6fdc009260 comp rx=0 tx=0).stop 2024-09-12T02:47:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.896+0000 7f6ff3e00640 1 -- 172.21.15.18:0/2196525011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff40745c0 msgr2=0x7f6ff419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.896+0000 7f6ff3e00640 1 --2- 172.21.15.18:0/2196525011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff40745c0 0x7f6ff419a490 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400eb90 tx=0x7f6fe400c6a0 comp rx=0 tx=0).stop 2024-09-12T02:47:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.896+0000 7f6ff3e00640 1 -- 172.21.15.18:0/2196525011 shutdown_connections 2024-09-12T02:47:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.896+0000 7f6ff3e00640 1 --2- 172.21.15.18:0/2196525011 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f6fd80a2c10 0x7f6fd80a50d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.896+0000 7f6ff3e00640 1 --2- 172.21.15.18:0/2196525011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff410e260 0x7f6ff419ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:02.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.896+0000 7f6ff3e00640 1 --2- 172.21.15.18:0/2196525011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ff4074ee0 0x7f6ff419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:02.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.896+0000 7f6ff3e00640 1 --2- 172.21.15.18:0/2196525011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff40745c0 0x7f6ff419a490 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:02.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.896+0000 7f6ff3e00640 1 -- 172.21.15.18:0/2196525011 >> 172.21.15.18:0/2196525011 conn(0x7f6ff40fd740 msgr2=0x7f6ff40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:02.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.896+0000 7f6ff3e00640 1 -- 172.21.15.18:0/2196525011 shutdown_connections 2024-09-12T02:47:02.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:02.896+0000 7f6ff3e00640 1 -- 172.21.15.18:0/2196525011 wait complete. 2024-09-12T02:47:02.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:02 smithi176 ceph-mon[35713]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-09-12T02:47:03.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:02 smithi062 ceph-mon[35527]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-09-12T02:47:03.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:03 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2196525011' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:47:03.851 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-12T02:47:03.852 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:47:03.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:03 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2196525011' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:47:04.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:03 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2196525011' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:47:04.232 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:04.625 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:04 smithi018 ceph-mon[30616]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-12T02:47:04.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.845+0000 7fba41200640 1 -- 172.21.15.18:0/3092727892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba3c1019d0 msgr2=0x7fba3c101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:04.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.845+0000 7fba41200640 1 --2- 172.21.15.18:0/3092727892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba3c1019d0 0x7fba3c101e30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fba24009930 tx=0x7fba2402a420 comp rx=0 tx=0).stop 2024-09-12T02:47:04.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.845+0000 7fba41200640 1 -- 172.21.15.18:0/3092727892 shutdown_connections 2024-09-12T02:47:04.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.845+0000 7fba41200640 1 --2- 172.21.15.18:0/3092727892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba3c102370 0x7fba3c10e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:04.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.845+0000 7fba41200640 1 --2- 172.21.15.18:0/3092727892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba3c1019d0 0x7fba3c101e30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:04.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.845+0000 7fba41200640 1 --2- 172.21.15.18:0/3092727892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba3c1079d0 0x7fba3c107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:04.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.845+0000 7fba41200640 1 -- 172.21.15.18:0/3092727892 >> 172.21.15.18:0/3092727892 conn(0x7fba3c0fd710 msgr2=0x7fba3c0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:04.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.846+0000 7fba41200640 1 -- 172.21.15.18:0/3092727892 shutdown_connections 2024-09-12T02:47:04.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.846+0000 7fba41200640 1 -- 172.21.15.18:0/3092727892 wait complete. 2024-09-12T02:47:04.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.847+0000 7fba41200640 1 Processor -- start 2024-09-12T02:47:04.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.847+0000 7fba41200640 1 -- start start 2024-09-12T02:47:04.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.847+0000 7fba41200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba3c102370 0x7fba3c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:04.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.847+0000 7fba41200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba3c1079d0 0x7fba3c19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:04.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.847+0000 7fba41200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba3c19efb0 0x7fba3c19f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:04.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.847+0000 7fba41200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c111dd0 con 0x7fba3c19efb0 2024-09-12T02:47:04.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.847+0000 7fba41200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c111c50 con 0x7fba3c102370 2024-09-12T02:47:04.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.847+0000 7fba41200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c111f50 con 0x7fba3c1079d0 2024-09-12T02:47:04.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.848+0000 7fba3b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba3c102370 0x7fba3c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:04.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.848+0000 7fba3be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba3c19efb0 0x7fba3c19f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:04.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.848+0000 7fba3b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba3c102370 0x7fba3c19a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:49138/0 (socket says 172.21.15.18:49138) 2024-09-12T02:47:04.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.848+0000 7fba3b400640 1 -- 172.21.15.18:0/2114342353 learned_addr learned my addr 172.21.15.18:0/2114342353 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:04.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.848+0000 7fba33e00640 1 --2- 172.21.15.18:0/2114342353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba3c1079d0 0x7fba3c19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:04.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.848+0000 7fba3b400640 1 -- 172.21.15.18:0/2114342353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba3c1079d0 msgr2=0x7fba3c19ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:04.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.848+0000 7fba3b400640 1 --2- 172.21.15.18:0/2114342353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba3c1079d0 0x7fba3c19ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:04.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.848+0000 7fba3b400640 1 -- 172.21.15.18:0/2114342353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba3c19efb0 msgr2=0x7fba3c19f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:04.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.848+0000 7fba3b400640 1 --2- 172.21.15.18:0/2114342353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba3c19efb0 0x7fba3c19f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:04.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.848+0000 7fba3b400640 1 -- 172.21.15.18:0/2114342353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c19fa70 con 0x7fba3c102370 2024-09-12T02:47:04.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.848+0000 7fba3b400640 1 --2- 172.21.15.18:0/2114342353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba3c102370 0x7fba3c19a6e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00e9f0 tx=0x7fba2c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:04.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.849+0000 7fba38c00640 1 -- 172.21.15.18:0/2114342353 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c00cd80 con 0x7fba3c102370 2024-09-12T02:47:04.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.849+0000 7fba38c00640 1 -- 172.21.15.18:0/2114342353 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba2c005500 con 0x7fba3c102370 2024-09-12T02:47:04.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.849+0000 7fba41200640 1 -- 172.21.15.18:0/2114342353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3c19fd60 con 0x7fba3c102370 2024-09-12T02:47:04.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.849+0000 7fba38c00640 1 -- 172.21.15.18:0/2114342353 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c010690 con 0x7fba3c102370 2024-09-12T02:47:04.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.849+0000 7fba41200640 1 -- 172.21.15.18:0/2114342353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba3c1a74f0 con 0x7fba3c102370 2024-09-12T02:47:04.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.850+0000 7fba41200640 1 -- 172.21.15.18:0/2114342353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba3c101e30 con 0x7fba3c102370 2024-09-12T02:47:04.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.852+0000 7fba38c00640 1 -- 172.21.15.18:0/2114342353 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fba2c0046c0 con 0x7fba3c102370 2024-09-12T02:47:04.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.853+0000 7fba38c00640 1 --2- 172.21.15.18:0/2114342353 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fba200a2c10 0x7fba200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:04.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.853+0000 7fba38c00640 1 -- 172.21.15.18:0/2114342353 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7fba2c0cf950 con 0x7fba3c102370 2024-09-12T02:47:04.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.853+0000 7fba33e00640 1 --2- 172.21.15.18:0/2114342353 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fba200a2c10 0x7fba200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:04.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.854+0000 7fba33e00640 1 --2- 172.21.15.18:0/2114342353 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fba200a2c10 0x7fba200a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba24009230 tx=0x7fba240058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:04.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:04.855+0000 7fba38c00640 1 -- 172.21.15.18:0/2114342353 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba2c09c390 con 0x7fba3c102370 2024-09-12T02:47:04.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:04 smithi176 ceph-mon[35713]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-12T02:47:05.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:04 smithi062 ceph-mon[35527]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-12T02:47:05.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:05.046+0000 7fba41200640 1 -- 172.21.15.18:0/2114342353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba3c19ba40 con 0x7fba3c102370 2024-09-12T02:47:05.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:05.047+0000 7fba38c00640 1 -- 172.21.15.18:0/2114342353 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+24655 (secure 0 0 0) 0x7fba3c19ba40 con 0x7fba3c102370 2024-09-12T02:47:05.049 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:47:05.049 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":96,"fsid":"c7666100-70af-11ef-bcea-c7b262605968","created":"2024-09-12T02:37:14.139566+0000","modified":"2024-09-12T02:46:12.546275+0000","last_up_change":"2024-09-12T02:44:37.774835+0000","last_in_change":"2024-09-12T02:44:16.028970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:40:35.157621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:45:31.022530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:45:34.131637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:45:43.992286+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a61ecdc1-ceb9-43cb-a67d-b197888cca42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6803","nonce":2278662522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6805","nonce":2278662522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6809","nonce":2278662522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6807","nonce":2278662522}]},"public_addr":"172.21.15.18:6803/2278662522","cluster_addr":"172.21.15.18:6805/2278662522","heartbeat_back_addr":"172.21.15.18:6809/2278662522","heartbeat_front_addr":"172.21.15.18:6807/2278662522","state":["exists","up"]},{"osd":1,"uuid":"1b84f4be-23ce-466c-b974-b9851521785d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6801","nonce":3139630617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6803","nonce":3139630617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6807","nonce":3139630617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6805","nonce":3139630617}]},"public_addr":"172.21.15.62:6801/3139630617","cluster_addr":"172.21.15.62:6803/3139630617","heartbeat_back_addr":"172.21.15.62:6807/3139630617","heartbeat_front_addr":"172.21.15.62:6805/3139630617","state":["exists","up"]},{"osd":2,"uuid":"f7bdf028-db32-4d92-a039-bada37c3a146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6801","nonce":2704054654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6803","nonce":2704054654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6807","nonce":2704054654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6805","nonce":2704054654}]},"public_addr":"172.21.15.176:6801/2704054654","cluster_addr":"172.21.15.176:6803/2704054654","heartbeat_back_addr":"172.21.15.176:6807/2704054654","heartbeat_front_addr":"172.21.15.176:6805/2704054654","state":["exists","up"]},{"osd":3,"uuid":"39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6811","nonce":3378134261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6813","nonce":3378134261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6817","nonce":3378134261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6815","nonce":3378134261}]},"public_addr":"172.21.15.18:6811/3378134261","cluster_addr":"172.21.15.18:6813/3378134261","heartbeat_back_addr":"172.21.15.18:6817/3378134261","heartbeat_front_addr":"172.21.15.18:6815/3378134261","state":["exists","up"]},{"osd":4,"uuid":"66a2c8a0-1a99-4c6d-b56a-f1f6c3199655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6809","nonce":1416302860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6811","nonce":1416302860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6815","nonce":1416302860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6813","nonce":1416302860}]},"public_addr":"172.21.15.62:6809/1416302860","cluster_addr":"172.21.15.62:6811/1416302860","heartbeat_back_addr":"172.21.15.62:6815/1416302860","heartbeat_front_addr":"172.21.15.62:6813/1416302860","state":["exists","up"]},{"osd":5,"uuid":"c4070ecf-703a-4f5f-9a2b-63473ff7f98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6809","nonce":2234269387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6811","nonce":2234269387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6815","nonce":2234269387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6813","nonce":2234269387}]},"public_addr":"172.21.15.176:6809/2234269387","cluster_addr":"172.21.15.176:6811/2234269387","heartbeat_back_addr":"172.21.15.176:6815/2234269387","heartbeat_front_addr":"172.21.15.176:6813/2234269387","state":["exists","up"]},{"osd":6,"uuid":"12a08874-041e-4734-bc33-68ebfce97b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6819","nonce":3613955982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6821","nonce":3613955982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6825","nonce":3613955982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6823","nonce":3613955982}]},"public_addr":"172.21.15.18:6819/3613955982","cluster_addr":"172.21.15.18:6821/3613955982","heartbeat_back_addr":"172.21.15.18:6825/3613955982","heartbeat_front_addr":"172.21.15.18:6823/3613955982","state":["exists","up"]},{"osd":7,"uuid":"86a5b47c-143f-4848-892f-c7b6a17a2799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6817","nonce":750933013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6819","nonce":750933013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6823","nonce":750933013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6821","nonce":750933013}]},"public_addr":"172.21.15.62:6817/750933013","cluster_addr":"172.21.15.62:6819/750933013","heartbeat_back_addr":"172.21.15.62:6823/750933013","heartbeat_front_addr":"172.21.15.62:6821/750933013","state":["exists","up"]},{"osd":8,"uuid":"0426a455-ed11-4d6a-8e1d-c8aa2ee65cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6817","nonce":8496953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6819","nonce":8496953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6823","nonce":8496953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6821","nonce":8496953}]},"public_addr":"172.21.15.176:6817/8496953","cluster_addr":"172.21.15.176:6819/8496953","heartbeat_back_addr":"172.21.15.176:6823/8496953","heartbeat_front_addr":"172.21.15.176:6821/8496953","state":["exists","up"]},{"osd":9,"uuid":"241aa2cf-0765-465d-b400-4911e653412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6827","nonce":422514390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6829","nonce":422514390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6833","nonce":422514390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6831","nonce":422514390}]},"public_addr":"172.21.15.18:6827/422514390","cluster_addr":"172.21.15.18:6829/422514390","heartbeat_back_addr":"172.21.15.18:6833/422514390","heartbeat_front_addr":"172.21.15.18:6831/422514390","state":["exists","up"]},{"osd":10,"uuid":"b1d4ab1f-0ec4-4641-bab0-f39d15857615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6825","nonce":269877918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6827","nonce":269877918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6831","nonce":269877918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6829","nonce":269877918}]},"public_addr":"172.21.15.62:6825/269877918","cluster_addr":"172.21.15.62:6827/269877918","heartbeat_back_addr":"172.21.15.62:6831/269877918","heartbeat_front_addr":"172.21.15.62:6829/269877918","state":["exists","up"]},{"osd":11,"uuid":"d122f1bf-bd4f-45d5-b07c-7301b005977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6825","nonce":770358485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6827","nonce":770358485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6831","nonce":770358485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6829","nonce":770358485}]},"public_addr":"172.21.15.176:6825/770358485","cluster_addr":"172.21.15.176:6827/770358485","heartbeat_back_addr":"172.21.15.176:6831/770358485","heartbeat_front_addr":"172.21.15.176:6829/770358485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:39:42.435560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:09.100602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:32.884117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:01.733821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:29.812775+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:53.846503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:24.363464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:51.023614+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:15.782652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:45.378178+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:12.469173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:36.303058+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":1,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2679362143":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/4236556151":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6801/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6800/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/1197309398":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/3024661873":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/2429098892":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6801/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6800/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/1531572357":"2024-09-13T02:37:40.790128+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:47:05.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:05.050+0000 7fba41200640 1 -- 172.21.15.18:0/2114342353 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fba200a2c10 msgr2=0x7fba200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:05.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:05.050+0000 7fba41200640 1 --2- 172.21.15.18:0/2114342353 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fba200a2c10 0x7fba200a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba24009230 tx=0x7fba240058d0 comp rx=0 tx=0).stop 2024-09-12T02:47:05.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:05.050+0000 7fba41200640 1 -- 172.21.15.18:0/2114342353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba3c102370 msgr2=0x7fba3c19a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:05.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:05.050+0000 7fba41200640 1 --2- 172.21.15.18:0/2114342353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba3c102370 0x7fba3c19a6e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00e9f0 tx=0x7fba2c00edf0 comp rx=0 tx=0).stop 2024-09-12T02:47:05.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:05.050+0000 7fba41200640 1 -- 172.21.15.18:0/2114342353 shutdown_connections 2024-09-12T02:47:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:05.050+0000 7fba41200640 1 --2- 172.21.15.18:0/2114342353 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fba200a2c10 0x7fba200a50d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:05.050+0000 7fba41200640 1 --2- 172.21.15.18:0/2114342353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba3c19efb0 0x7fba3c19f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:05.050+0000 7fba41200640 1 --2- 172.21.15.18:0/2114342353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba3c1079d0 0x7fba3c19ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:05.050+0000 7fba41200640 1 --2- 172.21.15.18:0/2114342353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba3c102370 0x7fba3c19a6e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:05.050+0000 7fba41200640 1 -- 172.21.15.18:0/2114342353 >> 172.21.15.18:0/2114342353 conn(0x7fba3c0fd710 msgr2=0x7fba3c10d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:05.050+0000 7fba41200640 1 -- 172.21.15.18:0/2114342353 shutdown_connections 2024-09-12T02:47:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:05.050+0000 7fba41200640 1 -- 172.21.15.18:0/2114342353 wait complete. 2024-09-12T02:47:05.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:05 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2114342353' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:47:05.969 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-12T02:47:05.970 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-12T02:47:05.970 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-12T02:47:05.971 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-12T02:47:05.971 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-12T02:47:05.971 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-12T02:47:05.972 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-12T02:47:05.972 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-12T02:47:05.974 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-12T02:47:05.974 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-12T02:47:05.975 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-12T02:47:05.975 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-12T02:47:05.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:05 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2114342353' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:47:06.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:05 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2114342353' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:47:06.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:06 smithi018 ceph-mon[30616]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-12T02:47:06.948 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:06.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:06 smithi176 ceph-mon[35713]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-12T02:47:07.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:06 smithi062 ceph-mon[35527]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-12T02:47:07.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.665+0000 7f453da00640 1 -- 172.21.15.18:0/3278044650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45381049c0 msgr2=0x7f4538108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:07.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.665+0000 7f453da00640 1 --2- 172.21.15.18:0/3278044650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45381049c0 0x7f4538108a10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4520009900 tx=0x7f452002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.665+0000 7f453da00640 1 -- 172.21.15.18:0/3278044650 shutdown_connections 2024-09-12T02:47:07.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.665+0000 7f453da00640 1 --2- 172.21.15.18:0/3278044650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4538109140 0x7f4538110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.665+0000 7f453da00640 1 --2- 172.21.15.18:0/3278044650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45381049c0 0x7f4538108a10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.665+0000 7f453da00640 1 --2- 172.21.15.18:0/3278044650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4538104010 0x7f45381043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.665+0000 7f453da00640 1 -- 172.21.15.18:0/3278044650 >> 172.21.15.18:0/3278044650 conn(0x7f45380ffa50 msgr2=0x7f4538101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:07.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.665+0000 7f453da00640 1 -- 172.21.15.18:0/3278044650 shutdown_connections 2024-09-12T02:47:07.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.666+0000 7f453da00640 1 -- 172.21.15.18:0/3278044650 wait complete. 2024-09-12T02:47:07.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.667+0000 7f453da00640 1 Processor -- start 2024-09-12T02:47:07.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.667+0000 7f453da00640 1 -- start start 2024-09-12T02:47:07.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.667+0000 7f453da00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4538104010 0x7f453819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:07.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.667+0000 7f453da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45381049c0 0x7f453819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:07.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.667+0000 7f453da00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4538109140 0x7f453819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:07.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.667+0000 7f453da00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f45381141b0 con 0x7f45381049c0 2024-09-12T02:47:07.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.667+0000 7f453da00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4538114030 con 0x7f4538109140 2024-09-12T02:47:07.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.667+0000 7f453da00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4538114330 con 0x7f4538104010 2024-09-12T02:47:07.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.668+0000 7f452fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45381049c0 0x7f453819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:07.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.668+0000 7f4536a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4538104010 0x7f453819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:07.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.668+0000 7f452fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45381049c0 0x7f453819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41276/0 (socket says 172.21.15.18:41276) 2024-09-12T02:47:07.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.668+0000 7f452fe00640 1 -- 172.21.15.18:0/3578006174 learned_addr learned my addr 172.21.15.18:0/3578006174 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:07.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.668+0000 7f4537400640 1 --2- 172.21.15.18:0/3578006174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4538109140 0x7f453819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:07.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.668+0000 7f4536a00640 1 -- 172.21.15.18:0/3578006174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4538109140 msgr2=0x7f453819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:07.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.668+0000 7f4536a00640 1 --2- 172.21.15.18:0/3578006174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4538109140 0x7f453819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.668+0000 7f4536a00640 1 -- 172.21.15.18:0/3578006174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45381049c0 msgr2=0x7f453819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:07.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.668+0000 7f4536a00640 1 --2- 172.21.15.18:0/3578006174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45381049c0 0x7f453819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.668+0000 7f4536a00640 1 -- 172.21.15.18:0/3578006174 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453819f5d0 con 0x7f4538104010 2024-09-12T02:47:07.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.668+0000 7f4537400640 1 --2- 172.21.15.18:0/3578006174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4538109140 0x7f453819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:07.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.669+0000 7f4536a00640 1 --2- 172.21.15.18:0/3578006174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4538104010 0x7f453819a620 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f452800e9f0 tx=0x7f452800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:07.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.669+0000 7f452f400640 1 -- 172.21.15.18:0/3578006174 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452800ccc0 con 0x7f4538104010 2024-09-12T02:47:07.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.669+0000 7f453da00640 1 -- 172.21.15.18:0/3578006174 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f453819f8c0 con 0x7f4538104010 2024-09-12T02:47:07.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.669+0000 7f452f400640 1 -- 172.21.15.18:0/3578006174 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4528010910 con 0x7f4538104010 2024-09-12T02:47:07.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.669+0000 7f452f400640 1 -- 172.21.15.18:0/3578006174 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528018960 con 0x7f4538104010 2024-09-12T02:47:07.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.669+0000 7f453da00640 1 -- 172.21.15.18:0/3578006174 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45381a71a0 con 0x7f4538104010 2024-09-12T02:47:07.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.670+0000 7f453da00640 1 -- 172.21.15.18:0/3578006174 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4538062980 con 0x7f4538104010 2024-09-12T02:47:07.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.672+0000 7f452f400640 1 -- 172.21.15.18:0/3578006174 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4528010ac0 con 0x7f4538104010 2024-09-12T02:47:07.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.673+0000 7f452f400640 1 --2- 172.21.15.18:0/3578006174 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f451c0a2c10 0x7f451c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:07.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.673+0000 7f452f400640 1 -- 172.21.15.18:0/3578006174 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7f45280d01f0 con 0x7f4538104010 2024-09-12T02:47:07.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.673+0000 7f452fe00640 1 --2- 172.21.15.18:0/3578006174 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f451c0a2c10 0x7f451c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:07.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.674+0000 7f452f400640 1 --2- 172.21.15.18:0/3578006174 >> [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261] conn(0x7f451c0adde0 0x7f451c0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:07.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.674+0000 7f452f400640 1 -- 172.21.15.18:0/3578006174 --> [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4528028ea0 con 0x7f451c0adde0 2024-09-12T02:47:07.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.674+0000 7f452f400640 1 -- 172.21.15.18:0/3578006174 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f45280d05a0 con 0x7f4538104010 2024-09-12T02:47:07.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.674+0000 7f4537400640 1 --2- 172.21.15.18:0/3578006174 >> [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261] conn(0x7f451c0adde0 0x7f451c0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:07.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.674+0000 7f452fe00640 1 --2- 172.21.15.18:0/3578006174 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f451c0a2c10 0x7f451c0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f45200096c0 tx=0x7f45200046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:07.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.675+0000 7f4537400640 1 --2- 172.21.15.18:0/3578006174 >> [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261] conn(0x7f451c0adde0 0x7f451c0b0280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:07.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.675+0000 7f452f400640 1 -- 172.21.15.18:0/3578006174 <== osd.3 v2:172.21.15.18:6810/3378134261 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4528028ea0 con 0x7f451c0adde0 2024-09-12T02:47:07.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.690+0000 7f453da00640 1 -- 172.21.15.18:0/3578006174 --> [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4538062d80 con 0x7f451c0adde0 2024-09-12T02:47:07.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.690+0000 7f452f400640 1 -- 172.21.15.18:0/3578006174 <== osd.3 v2:172.21.15.18:6810/3378134261 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4538062d80 con 0x7f451c0adde0 2024-09-12T02:47:07.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.691+0000 7f453da00640 1 -- 172.21.15.18:0/3578006174 >> [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261] conn(0x7f451c0adde0 msgr2=0x7f451c0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:07.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.691+0000 7f453da00640 1 --2- 172.21.15.18:0/3578006174 >> [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261] conn(0x7f451c0adde0 0x7f451c0b0280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.691+0000 7f453da00640 1 -- 172.21.15.18:0/3578006174 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f451c0a2c10 msgr2=0x7f451c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:07.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.691+0000 7f453da00640 1 --2- 172.21.15.18:0/3578006174 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f451c0a2c10 0x7f451c0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f45200096c0 tx=0x7f45200046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.691+0000 7f453da00640 1 -- 172.21.15.18:0/3578006174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4538104010 msgr2=0x7f453819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:07.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.691+0000 7f453da00640 1 --2- 172.21.15.18:0/3578006174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4538104010 0x7f453819a620 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f452800e9f0 tx=0x7f452800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:47:07.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.691+0000 7f4537400640 1 -- 172.21.15.18:0/3578006174 reap_dead start 2024-09-12T02:47:07.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.691+0000 7f453da00640 1 -- 172.21.15.18:0/3578006174 shutdown_connections 2024-09-12T02:47:07.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.691+0000 7f453da00640 1 -- 172.21.15.18:0/3578006174 >> 172.21.15.18:0/3578006174 conn(0x7f45380ffa50 msgr2=0x7f4538100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:07.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.691+0000 7f453da00640 1 -- 172.21.15.18:0/3578006174 shutdown_connections 2024-09-12T02:47:07.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:07.691+0000 7f453da00640 1 -- 172.21.15.18:0/3578006174 wait complete. 2024-09-12T02:47:07.980 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:07.982 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:07.988 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:07.996 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:07.996 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:07.997 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:07.997 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:08.007 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:08.011 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:08.660 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:08.662 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:08.694 INFO:teuthology.orchestra.run.smithi018.stdout:107374182476 2024-09-12T02:47:08.695 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-12T02:47:08.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:08 smithi018 ceph-mon[30616]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-12T02:47:08.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:08 smithi176 ceph-mon[35713]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-12T02:47:09.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:08 smithi062 ceph-mon[35527]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-12T02:47:10.844 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:10 smithi018 ceph-mon[30616]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-12T02:47:10.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:10 smithi176 ceph-mon[35713]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-12T02:47:11.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:10 smithi062 ceph-mon[35527]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-12T02:47:11.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.439+0000 7fa997200640 1 -- 172.21.15.18:0/2801485445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9981019c0 msgr2=0x7fa998101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:11.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.439+0000 7fa997200640 1 --2- 172.21.15.18:0/2801485445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9981019c0 0x7fa998101e20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa980009930 tx=0x7fa98002a420 comp rx=0 tx=0).stop 2024-09-12T02:47:11.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.440+0000 7fa997200640 1 -- 172.21.15.18:0/2801485445 shutdown_connections 2024-09-12T02:47:11.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.440+0000 7fa997200640 1 --2- 172.21.15.18:0/2801485445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa998102360 0x7fa99810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:11.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.440+0000 7fa997200640 1 --2- 172.21.15.18:0/2801485445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9981019c0 0x7fa998101e20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:11.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.440+0000 7fa997200640 1 --2- 172.21.15.18:0/2801485445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9981079c0 0x7fa998107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:11.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.440+0000 7fa997200640 1 -- 172.21.15.18:0/2801485445 >> 172.21.15.18:0/2801485445 conn(0x7fa9980fd740 msgr2=0x7fa9980ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:11.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.440+0000 7fa997200640 1 -- 172.21.15.18:0/2801485445 shutdown_connections 2024-09-12T02:47:11.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.440+0000 7fa997200640 1 -- 172.21.15.18:0/2801485445 wait complete. 2024-09-12T02:47:11.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.441+0000 7fa997200640 1 Processor -- start 2024-09-12T02:47:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.441+0000 7fa997200640 1 -- start start 2024-09-12T02:47:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.442+0000 7fa997200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9981019c0 0x7fa99819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.442+0000 7fa997200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa998102360 0x7fa99819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.442+0000 7fa997200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9981079c0 0x7fa99819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:11.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.442+0000 7fa997200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa998111e10 con 0x7fa9981019c0 2024-09-12T02:47:11.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.442+0000 7fa997200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa998111c90 con 0x7fa9981079c0 2024-09-12T02:47:11.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.442+0000 7fa997200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa998111f90 con 0x7fa998102360 2024-09-12T02:47:11.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.442+0000 7fa98fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa998102360 0x7fa99819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.442+0000 7fa995e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9981019c0 0x7fa99819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.442+0000 7fa98fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa998102360 0x7fa99819aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:49088/0 (socket says 172.21.15.18:49088) 2024-09-12T02:47:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.442+0000 7fa98fe00640 1 -- 172.21.15.18:0/438593227 learned_addr learned my addr 172.21.15.18:0/438593227 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.443+0000 7fa996800640 1 --2- 172.21.15.18:0/438593227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9981079c0 0x7fa99819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.443+0000 7fa98fe00640 1 -- 172.21.15.18:0/438593227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9981079c0 msgr2=0x7fa99819eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.443+0000 7fa98fe00640 1 --2- 172.21.15.18:0/438593227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9981079c0 0x7fa99819eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.443+0000 7fa98fe00640 1 -- 172.21.15.18:0/438593227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9981019c0 msgr2=0x7fa99819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.443+0000 7fa98fe00640 1 --2- 172.21.15.18:0/438593227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9981019c0 0x7fa99819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.443+0000 7fa98fe00640 1 -- 172.21.15.18:0/438593227 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99819f480 con 0x7fa998102360 2024-09-12T02:47:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.443+0000 7fa996800640 1 --2- 172.21.15.18:0/438593227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9981079c0 0x7fa99819eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.443+0000 7fa98fe00640 1 --2- 172.21.15.18:0/438593227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa998102360 0x7fa99819aa10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa98002a940 tx=0x7fa980003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.443+0000 7fa98ea00640 1 -- 172.21.15.18:0/438593227 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98003f070 con 0x7fa998102360 2024-09-12T02:47:11.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.443+0000 7fa997200640 1 -- 172.21.15.18:0/438593227 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa99819f710 con 0x7fa998102360 2024-09-12T02:47:11.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.443+0000 7fa98ea00640 1 -- 172.21.15.18:0/438593227 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa980031c90 con 0x7fa998102360 2024-09-12T02:47:11.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.443+0000 7fa98ea00640 1 -- 172.21.15.18:0/438593227 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa980035030 con 0x7fa998102360 2024-09-12T02:47:11.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.444+0000 7fa997200640 1 -- 172.21.15.18:0/438593227 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9981a7050 con 0x7fa998102360 2024-09-12T02:47:11.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.444+0000 7fa997200640 1 -- 172.21.15.18:0/438593227 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa9980ff120 con 0x7fa998102360 2024-09-12T02:47:11.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.447+0000 7fa98ea00640 1 -- 172.21.15.18:0/438593227 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa980042070 con 0x7fa998102360 2024-09-12T02:47:11.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.448+0000 7fa98ea00640 1 --2- 172.21.15.18:0/438593227 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa97c0a2c90 0x7fa97c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:11.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.448+0000 7fa98ea00640 1 -- 172.21.15.18:0/438593227 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7fa9800f0310 con 0x7fa998102360 2024-09-12T02:47:11.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.448+0000 7fa995e00640 1 --2- 172.21.15.18:0/438593227 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa97c0a2c90 0x7fa97c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:11.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.449+0000 7fa98ea00640 1 --2- 172.21.15.18:0/438593227 >> [v2:172.21.15.62:6816/750933013,v1:172.21.15.62:6817/750933013] conn(0x7fa97c0ade60 0x7fa97c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:11.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.449+0000 7fa98ea00640 1 -- 172.21.15.18:0/438593227 --> [v2:172.21.15.62:6816/750933013,v1:172.21.15.62:6817/750933013] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa980038e90 con 0x7fa97c0ade60 2024-09-12T02:47:11.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.449+0000 7fa98ea00640 1 -- 172.21.15.18:0/438593227 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7fa9800f06c0 con 0x7fa998102360 2024-09-12T02:47:11.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.449+0000 7fa995e00640 1 --2- 172.21.15.18:0/438593227 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa97c0a2c90 0x7fa97c0a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa988009b50 tx=0x7fa988005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:11.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.449+0000 7fa996800640 1 --2- 172.21.15.18:0/438593227 >> [v2:172.21.15.62:6816/750933013,v1:172.21.15.62:6817/750933013] conn(0x7fa97c0ade60 0x7fa97c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:11.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.450+0000 7fa996800640 1 --2- 172.21.15.18:0/438593227 >> [v2:172.21.15.62:6816/750933013,v1:172.21.15.62:6817/750933013] conn(0x7fa97c0ade60 0x7fa97c0b0300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:11.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.450+0000 7fa98ea00640 1 -- 172.21.15.18:0/438593227 <== osd.7 v2:172.21.15.62:6816/750933013 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa980038e90 con 0x7fa97c0ade60 2024-09-12T02:47:11.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.465+0000 7fa997200640 1 -- 172.21.15.18:0/438593227 --> [v2:172.21.15.62:6816/750933013,v1:172.21.15.62:6817/750933013] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa998103100 con 0x7fa97c0ade60 2024-09-12T02:47:11.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.465+0000 7fa98ea00640 1 -- 172.21.15.18:0/438593227 <== osd.7 v2:172.21.15.62:6816/750933013 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa998103100 con 0x7fa97c0ade60 2024-09-12T02:47:11.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.466+0000 7fa997200640 1 -- 172.21.15.18:0/438593227 >> [v2:172.21.15.62:6816/750933013,v1:172.21.15.62:6817/750933013] conn(0x7fa97c0ade60 msgr2=0x7fa97c0b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:11.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.466+0000 7fa997200640 1 --2- 172.21.15.18:0/438593227 >> [v2:172.21.15.62:6816/750933013,v1:172.21.15.62:6817/750933013] conn(0x7fa97c0ade60 0x7fa97c0b0300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:11.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.466+0000 7fa997200640 1 -- 172.21.15.18:0/438593227 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa97c0a2c90 msgr2=0x7fa97c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:11.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.466+0000 7fa997200640 1 --2- 172.21.15.18:0/438593227 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa97c0a2c90 0x7fa97c0a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa988009b50 tx=0x7fa988005f90 comp rx=0 tx=0).stop 2024-09-12T02:47:11.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.466+0000 7fa997200640 1 -- 172.21.15.18:0/438593227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa998102360 msgr2=0x7fa99819aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:11.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.466+0000 7fa997200640 1 --2- 172.21.15.18:0/438593227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa998102360 0x7fa99819aa10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa98002a940 tx=0x7fa980003b20 comp rx=0 tx=0).stop 2024-09-12T02:47:11.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.466+0000 7fa996800640 1 -- 172.21.15.18:0/438593227 reap_dead start 2024-09-12T02:47:11.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.466+0000 7fa997200640 1 -- 172.21.15.18:0/438593227 shutdown_connections 2024-09-12T02:47:11.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.466+0000 7fa997200640 1 -- 172.21.15.18:0/438593227 >> 172.21.15.18:0/438593227 conn(0x7fa9980fd740 msgr2=0x7fa99810cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:11.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.466+0000 7fa997200640 1 -- 172.21.15.18:0/438593227 shutdown_connections 2024-09-12T02:47:11.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.467+0000 7fa997200640 1 -- 172.21.15.18:0/438593227 wait complete. 2024-09-12T02:47:11.718 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1, 8, 11]}]: dispatch 2024-09-12T02:47:11.718 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 8]}]: dispatch 2024-09-12T02:47:11.718 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 10]}]: dispatch 2024-09-12T02:47:11.718 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-09-12T02:47:11.718 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:11 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-12T02:47:11.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1, 8, 11]}]: dispatch 2024-09-12T02:47:11.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 8]}]: dispatch 2024-09-12T02:47:11.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 10]}]: dispatch 2024-09-12T02:47:11.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-09-12T02:47:11.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:11 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-12T02:47:12.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1, 8, 11]}]: dispatch 2024-09-12T02:47:12.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 8]}]: dispatch 2024-09-12T02:47:12.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 10]}]: dispatch 2024-09-12T02:47:12.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-09-12T02:47:12.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:11 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-12T02:47:12.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.317+0000 7f1159000640 1 -- 172.21.15.18:0/1905127380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11541079c0 msgr2=0x7f1154107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.317+0000 7f1159000640 1 --2- 172.21.15.18:0/1905127380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11541079c0 0x7f1154107da0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1144009930 tx=0x7f114402a420 comp rx=0 tx=0).stop 2024-09-12T02:47:12.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.317+0000 7f1159000640 1 -- 172.21.15.18:0/1905127380 shutdown_connections 2024-09-12T02:47:12.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.317+0000 7f1159000640 1 --2- 172.21.15.18:0/1905127380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1154102360 0x7f115410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.317+0000 7f1159000640 1 --2- 172.21.15.18:0/1905127380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11541019c0 0x7f1154101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.317+0000 7f1159000640 1 --2- 172.21.15.18:0/1905127380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11541079c0 0x7f1154107da0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.317+0000 7f1159000640 1 -- 172.21.15.18:0/1905127380 >> 172.21.15.18:0/1905127380 conn(0x7f11540fd740 msgr2=0x7f11540ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:12.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.317+0000 7f1159000640 1 -- 172.21.15.18:0/1905127380 shutdown_connections 2024-09-12T02:47:12.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.317+0000 7f1159000640 1 -- 172.21.15.18:0/1905127380 wait complete. 2024-09-12T02:47:12.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.318+0000 7f1159000640 1 Processor -- start 2024-09-12T02:47:12.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.319+0000 7f1159000640 1 -- start start 2024-09-12T02:47:12.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.319+0000 7f1159000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11541019c0 0x7f115419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:12.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.319+0000 7f1159000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1154102360 0x7f115419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:12.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.319+0000 7f1159000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11541079c0 0x7f115419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:12.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.319+0000 7f1159000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1154111dc0 con 0x7f11541019c0 2024-09-12T02:47:12.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.319+0000 7f1159000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1154111c40 con 0x7f11541079c0 2024-09-12T02:47:12.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.319+0000 7f1159000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1154111f40 con 0x7f1154102360 2024-09-12T02:47:12.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.319+0000 7f1153400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11541019c0 0x7f115419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:12.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.319+0000 7f1152a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1154102360 0x7f115419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:12.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.319+0000 7f1153e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11541079c0 0x7f115419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:12.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.319+0000 7f1152a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1154102360 0x7f115419aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:49052/0 (socket says 172.21.15.18:49052) 2024-09-12T02:47:12.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.319+0000 7f1152a00640 1 -- 172.21.15.18:0/2352245047 learned_addr learned my addr 172.21.15.18:0/2352245047 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:12.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.320+0000 7f1152a00640 1 -- 172.21.15.18:0/2352245047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11541079c0 msgr2=0x7f115419ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.320+0000 7f1152a00640 1 --2- 172.21.15.18:0/2352245047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11541079c0 0x7f115419ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.320+0000 7f1152a00640 1 -- 172.21.15.18:0/2352245047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11541019c0 msgr2=0x7f115419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.320+0000 7f1152a00640 1 --2- 172.21.15.18:0/2352245047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11541019c0 0x7f115419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.320+0000 7f1152a00640 1 -- 172.21.15.18:0/2352245047 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115419f470 con 0x7f1154102360 2024-09-12T02:47:12.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.320+0000 7f1152a00640 1 --2- 172.21.15.18:0/2352245047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1154102360 0x7f115419aa00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f114000e9f0 tx=0x7f114000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:12.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.320+0000 7f114be00640 1 -- 172.21.15.18:0/2352245047 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114000cd80 con 0x7f1154102360 2024-09-12T02:47:12.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.320+0000 7f1159000640 1 -- 172.21.15.18:0/2352245047 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f115419f760 con 0x7f1154102360 2024-09-12T02:47:12.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.320+0000 7f114be00640 1 -- 172.21.15.18:0/2352245047 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1140010910 con 0x7f1154102360 2024-09-12T02:47:12.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.320+0000 7f114be00640 1 -- 172.21.15.18:0/2352245047 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11400188f0 con 0x7f1154102360 2024-09-12T02:47:12.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.321+0000 7f1159000640 1 -- 172.21.15.18:0/2352245047 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11541a7040 con 0x7f1154102360 2024-09-12T02:47:12.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.321+0000 7f1159000640 1 -- 172.21.15.18:0/2352245047 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f11540fe8b0 con 0x7f1154102360 2024-09-12T02:47:12.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.324+0000 7f114be00640 1 -- 172.21.15.18:0/2352245047 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1140010ac0 con 0x7f1154102360 2024-09-12T02:47:12.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.325+0000 7f114be00640 1 --2- 172.21.15.18:0/2352245047 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f11380a2c10 0x7f11380a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:12.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.326+0000 7f114be00640 1 -- 172.21.15.18:0/2352245047 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7f11400cffa0 con 0x7f1154102360 2024-09-12T02:47:12.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.326+0000 7f1153400640 1 --2- 172.21.15.18:0/2352245047 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f11380a2c10 0x7f11380a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:12.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.326+0000 7f114be00640 1 --2- 172.21.15.18:0/2352245047 >> [v2:172.21.15.176:6816/8496953,v1:172.21.15.176:6817/8496953] conn(0x7f11380adde0 0x7f11380b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:12.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.326+0000 7f114be00640 1 -- 172.21.15.18:0/2352245047 --> [v2:172.21.15.176:6816/8496953,v1:172.21.15.176:6817/8496953] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11380b0950 con 0x7f11380adde0 2024-09-12T02:47:12.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.326+0000 7f114be00640 1 -- 172.21.15.18:0/2352245047 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f11400d0350 con 0x7f1154102360 2024-09-12T02:47:12.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.326+0000 7f1153e00640 1 --2- 172.21.15.18:0/2352245047 >> [v2:172.21.15.176:6816/8496953,v1:172.21.15.176:6817/8496953] conn(0x7f11380adde0 0x7f11380b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:12.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.327+0000 7f1153400640 1 --2- 172.21.15.18:0/2352245047 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f11380a2c10 0x7f11380a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1144009900 tx=0x7f11440058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:12.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.327+0000 7f1153e00640 1 --2- 172.21.15.18:0/2352245047 >> [v2:172.21.15.176:6816/8496953,v1:172.21.15.176:6817/8496953] conn(0x7f11380adde0 0x7f11380b0280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:12.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.328+0000 7f114be00640 1 -- 172.21.15.18:0/2352245047 <== osd.8 v2:172.21.15.176:6816/8496953 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f11380b0950 con 0x7f11380adde0 2024-09-12T02:47:12.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.346+0000 7f1159000640 1 -- 172.21.15.18:0/2352245047 --> [v2:172.21.15.176:6816/8496953,v1:172.21.15.176:6817/8496953] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1154103100 con 0x7f11380adde0 2024-09-12T02:47:12.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.347+0000 7f114be00640 1 -- 172.21.15.18:0/2352245047 <== osd.8 v2:172.21.15.176:6816/8496953 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1154103100 con 0x7f11380adde0 2024-09-12T02:47:12.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.347+0000 7f1159000640 1 -- 172.21.15.18:0/2352245047 >> [v2:172.21.15.176:6816/8496953,v1:172.21.15.176:6817/8496953] conn(0x7f11380adde0 msgr2=0x7f11380b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.347+0000 7f1159000640 1 --2- 172.21.15.18:0/2352245047 >> [v2:172.21.15.176:6816/8496953,v1:172.21.15.176:6817/8496953] conn(0x7f11380adde0 0x7f11380b0280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.347+0000 7f1159000640 1 -- 172.21.15.18:0/2352245047 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f11380a2c10 msgr2=0x7f11380a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.347+0000 7f1159000640 1 --2- 172.21.15.18:0/2352245047 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f11380a2c10 0x7f11380a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1144009900 tx=0x7f11440058d0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.347+0000 7f1159000640 1 -- 172.21.15.18:0/2352245047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1154102360 msgr2=0x7f115419aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.348+0000 7f1159000640 1 --2- 172.21.15.18:0/2352245047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1154102360 0x7f115419aa00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f114000e9f0 tx=0x7f114000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.348+0000 7f1153e00640 1 -- 172.21.15.18:0/2352245047 reap_dead start 2024-09-12T02:47:12.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.348+0000 7f1159000640 1 -- 172.21.15.18:0/2352245047 shutdown_connections 2024-09-12T02:47:12.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.348+0000 7f1159000640 1 -- 172.21.15.18:0/2352245047 >> 172.21.15.18:0/2352245047 conn(0x7f11540fd740 msgr2=0x7f11540fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:12.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.348+0000 7f1159000640 1 -- 172.21.15.18:0/2352245047 shutdown_connections 2024-09-12T02:47:12.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:10.348+0000 7f1159000640 1 -- 172.21.15.18:0/2352245047 wait complete. 2024-09-12T02:47:12.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.793+0000 7f7962600640 1 -- 172.21.15.18:0/363582979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f795c1049c0 msgr2=0x7f795c108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.793+0000 7f7962600640 1 --2- 172.21.15.18:0/363582979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f795c1049c0 0x7f795c108a10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7944009900 tx=0x7f794402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.793+0000 7f7962600640 1 -- 172.21.15.18:0/363582979 shutdown_connections 2024-09-12T02:47:12.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.793+0000 7f7962600640 1 --2- 172.21.15.18:0/363582979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f795c109140 0x7f795c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.793+0000 7f7962600640 1 --2- 172.21.15.18:0/363582979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f795c1049c0 0x7f795c108a10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.793+0000 7f7962600640 1 --2- 172.21.15.18:0/363582979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f795c104010 0x7f795c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.793+0000 7f7962600640 1 -- 172.21.15.18:0/363582979 >> 172.21.15.18:0/363582979 conn(0x7f795c0ffa50 msgr2=0x7f795c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:12.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.793+0000 7f7962600640 1 -- 172.21.15.18:0/363582979 shutdown_connections 2024-09-12T02:47:12.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.793+0000 7f7962600640 1 -- 172.21.15.18:0/363582979 wait complete. 2024-09-12T02:47:12.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.794+0000 7f7962600640 1 Processor -- start 2024-09-12T02:47:12.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.795+0000 7f7962600640 1 -- start start 2024-09-12T02:47:12.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.795+0000 7f7962600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f795c104010 0x7f795c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:12.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.795+0000 7f7962600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f795c1049c0 0x7f795c19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:12.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.795+0000 7f7962600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f795c109140 0x7f795c19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:12.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.795+0000 7f7962600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f795c114160 con 0x7f795c109140 2024-09-12T02:47:12.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.795+0000 7f7962600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f795c113fe0 con 0x7f795c1049c0 2024-09-12T02:47:12.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.795+0000 7f7962600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f795c1142e0 con 0x7f795c104010 2024-09-12T02:47:12.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.795+0000 7f795be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f795c109140 0x7f795c19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:12.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.795+0000 7f795be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f795c109140 0x7f795c19ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41370/0 (socket says 172.21.15.18:41370) 2024-09-12T02:47:12.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.795+0000 7f795be00640 1 -- 172.21.15.18:0/3777744785 learned_addr learned my addr 172.21.15.18:0/3777744785 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:12.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.795+0000 7f7953e00640 1 --2- 172.21.15.18:0/3777744785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f795c1049c0 0x7f795c19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:12.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.795+0000 7f795b400640 1 --2- 172.21.15.18:0/3777744785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f795c104010 0x7f795c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:12.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.796+0000 7f795be00640 1 -- 172.21.15.18:0/3777744785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f795c104010 msgr2=0x7f795c19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.796+0000 7f795be00640 1 --2- 172.21.15.18:0/3777744785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f795c104010 0x7f795c19a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.796+0000 7f795be00640 1 -- 172.21.15.18:0/3777744785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f795c1049c0 msgr2=0x7f795c19abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.796+0000 7f795be00640 1 --2- 172.21.15.18:0/3777744785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f795c1049c0 0x7f795c19abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.796+0000 7f795be00640 1 -- 172.21.15.18:0/3777744785 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795c19f630 con 0x7f795c109140 2024-09-12T02:47:12.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.796+0000 7f795be00640 1 --2- 172.21.15.18:0/3777744785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f795c109140 0x7f795c19ef50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f795400efd0 tx=0x7f795400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:12.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.796+0000 7f7958c00640 1 -- 172.21.15.18:0/3777744785 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7954003b70 con 0x7f795c109140 2024-09-12T02:47:12.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.796+0000 7f7962600640 1 -- 172.21.15.18:0/3777744785 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795c19f920 con 0x7f795c109140 2024-09-12T02:47:12.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.796+0000 7f7958c00640 1 -- 172.21.15.18:0/3777744785 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7954003d10 con 0x7f795c109140 2024-09-12T02:47:12.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.797+0000 7f7958c00640 1 -- 172.21.15.18:0/3777744785 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7954010990 con 0x7f795c109140 2024-09-12T02:47:12.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.797+0000 7f7962600640 1 -- 172.21.15.18:0/3777744785 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f795c1a7200 con 0x7f795c109140 2024-09-12T02:47:12.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.797+0000 7f7962600640 1 -- 172.21.15.18:0/3777744785 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f795c062980 con 0x7f795c109140 2024-09-12T02:47:12.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.800+0000 7f7958c00640 1 -- 172.21.15.18:0/3777744785 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7954010b30 con 0x7f795c109140 2024-09-12T02:47:12.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.801+0000 7f7958c00640 1 --2- 172.21.15.18:0/3777744785 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f79400a2c10 0x7f79400a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:12.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.801+0000 7f7958c00640 1 -- 172.21.15.18:0/3777744785 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f79540cfec0 con 0x7f795c109140 2024-09-12T02:47:12.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.801+0000 7f795b400640 1 --2- 172.21.15.18:0/3777744785 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f79400a2c10 0x7f79400a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:12.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.801+0000 7f7958c00640 1 --2- 172.21.15.18:0/3777744785 >> [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522] conn(0x7f79400adfe0 0x7f79400b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:12.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.801+0000 7f7958c00640 1 -- 172.21.15.18:0/3777744785 --> [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f795401fe70 con 0x7f79400adfe0 2024-09-12T02:47:12.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.801+0000 7f7958c00640 1 -- 172.21.15.18:0/3777744785 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f79540d0270 con 0x7f795c109140 2024-09-12T02:47:12.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.802+0000 7f7953e00640 1 --2- 172.21.15.18:0/3777744785 >> [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522] conn(0x7f79400adfe0 0x7f79400b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:12.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.802+0000 7f795b400640 1 --2- 172.21.15.18:0/3777744785 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f79400a2c10 0x7f79400a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f794c009bd0 tx=0x7f794c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:12.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.802+0000 7f7953e00640 1 --2- 172.21.15.18:0/3777744785 >> [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522] conn(0x7f79400adfe0 0x7f79400b0480 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:12.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.803+0000 7f7958c00640 1 -- 172.21.15.18:0/3777744785 <== osd.0 v2:172.21.15.18:6802/2278662522 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f795401fe70 con 0x7f79400adfe0 2024-09-12T02:47:12.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.821+0000 7f7962600640 1 -- 172.21.15.18:0/3777744785 --> [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f795c062e00 con 0x7f79400adfe0 2024-09-12T02:47:12.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.822+0000 7f7958c00640 1 -- 172.21.15.18:0/3777744785 <== osd.0 v2:172.21.15.18:6802/2278662522 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f795c062e00 con 0x7f79400adfe0 2024-09-12T02:47:12.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.822+0000 7f7962600640 1 -- 172.21.15.18:0/3777744785 >> [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522] conn(0x7f79400adfe0 msgr2=0x7f79400b0480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.822+0000 7f7962600640 1 --2- 172.21.15.18:0/3777744785 >> [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522] conn(0x7f79400adfe0 0x7f79400b0480 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.822+0000 7f7962600640 1 -- 172.21.15.18:0/3777744785 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f79400a2c10 msgr2=0x7f79400a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.822+0000 7f7962600640 1 --2- 172.21.15.18:0/3777744785 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f79400a2c10 0x7f79400a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f794c009bd0 tx=0x7f794c005f90 comp rx=0 tx=0).stop 2024-09-12T02:47:12.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.822+0000 7f7962600640 1 -- 172.21.15.18:0/3777744785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f795c109140 msgr2=0x7f795c19ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:12.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.822+0000 7f7962600640 1 --2- 172.21.15.18:0/3777744785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f795c109140 0x7f795c19ef50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f795400efd0 tx=0x7f795400c6a0 comp rx=0 tx=0).stop 2024-09-12T02:47:12.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.822+0000 7f795be00640 1 -- 172.21.15.18:0/3777744785 reap_dead start 2024-09-12T02:47:12.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.822+0000 7f7962600640 1 -- 172.21.15.18:0/3777744785 shutdown_connections 2024-09-12T02:47:12.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.822+0000 7f7962600640 1 -- 172.21.15.18:0/3777744785 >> 172.21.15.18:0/3777744785 conn(0x7f795c0ffa50 msgr2=0x7f795c100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:12.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.823+0000 7f7962600640 1 -- 172.21.15.18:0/3777744785 shutdown_connections 2024-09-12T02:47:12.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:12.823+0000 7f7962600640 1 -- 172.21.15.18:0/3777744785 wait complete. 2024-09-12T02:47:12.927 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:12 smithi018 ceph-mon[30616]: pgmap v356: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-12T02:47:12.927 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1, 8, 11]}]': finished 2024-09-12T02:47:12.927 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 8]}]': finished 2024-09-12T02:47:12.927 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 10]}]': finished 2024-09-12T02:47:12.927 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-12T02:47:12.927 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:12 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-12T02:47:12.927 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:12 smithi018 ceph-mon[30616]: osdmap e97: 12 total, 12 up, 12 in 2024-09-12T02:47:12.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:12 smithi176 ceph-mon[35713]: pgmap v356: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-12T02:47:12.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1, 8, 11]}]': finished 2024-09-12T02:47:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 8]}]': finished 2024-09-12T02:47:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 10]}]': finished 2024-09-12T02:47:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-12T02:47:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:12 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-12T02:47:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:12 smithi176 ceph-mon[35713]: osdmap e97: 12 total, 12 up, 12 in 2024-09-12T02:47:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:12 smithi062 ceph-mon[35527]: pgmap v356: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-12T02:47:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1, 8, 11]}]': finished 2024-09-12T02:47:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 8]}]': finished 2024-09-12T02:47:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 10]}]': finished 2024-09-12T02:47:13.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-12T02:47:13.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:12 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-12T02:47:13.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:12 smithi062 ceph-mon[35527]: osdmap e97: 12 total, 12 up, 12 in 2024-09-12T02:47:13.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.022+0000 7ffbe4c00640 1 -- 172.21.15.18:0/1121954737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe0104010 msgr2=0x7ffbe01043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.022+0000 7ffbe4c00640 1 --2- 172.21.15.18:0/1121954737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe0104010 0x7ffbe01043f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009900 tx=0x7ffbd002a410 comp rx=0 tx=0).stop 2024-09-12T02:47:13.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.022+0000 7ffbe4c00640 1 -- 172.21.15.18:0/1121954737 shutdown_connections 2024-09-12T02:47:13.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.022+0000 7ffbe4c00640 1 --2- 172.21.15.18:0/1121954737 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffbe0109140 0x7ffbe0110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.022+0000 7ffbe4c00640 1 --2- 172.21.15.18:0/1121954737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbe01049c0 0x7ffbe0108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.022+0000 7ffbe4c00640 1 --2- 172.21.15.18:0/1121954737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe0104010 0x7ffbe01043f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.022+0000 7ffbe4c00640 1 -- 172.21.15.18:0/1121954737 >> 172.21.15.18:0/1121954737 conn(0x7ffbe00ffa50 msgr2=0x7ffbe0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:13.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.022+0000 7ffbe4c00640 1 -- 172.21.15.18:0/1121954737 shutdown_connections 2024-09-12T02:47:13.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.022+0000 7ffbe4c00640 1 -- 172.21.15.18:0/1121954737 wait complete. 2024-09-12T02:47:13.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.023+0000 7ffbe4c00640 1 Processor -- start 2024-09-12T02:47:13.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.023+0000 7ffbe4c00640 1 -- start start 2024-09-12T02:47:13.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.023+0000 7ffbe4c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbe0104010 0x7ffbe019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.024+0000 7ffbe4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe01049c0 0x7ffbe019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.024+0000 7ffbe4c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffbe0109140 0x7ffbe019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.024+0000 7ffbe4c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe0114170 con 0x7ffbe01049c0 2024-09-12T02:47:13.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.024+0000 7ffbe4c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe0113ff0 con 0x7ffbe0104010 2024-09-12T02:47:13.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.024+0000 7ffbe4c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe01142f0 con 0x7ffbe0109140 2024-09-12T02:47:13.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.024+0000 7ffbd7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe01049c0 0x7ffbe019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.024+0000 7ffbd7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe01049c0 0x7ffbe019ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41310/0 (socket says 172.21.15.18:41310) 2024-09-12T02:47:13.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.024+0000 7ffbd7e00640 1 -- 172.21.15.18:0/2159288019 learned_addr learned my addr 172.21.15.18:0/2159288019 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:13.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.024+0000 7ffbdde00640 1 --2- 172.21.15.18:0/2159288019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbe0104010 0x7ffbe019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.024+0000 7ffbde800640 1 --2- 172.21.15.18:0/2159288019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffbe0109140 0x7ffbe019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.024+0000 7ffbd7e00640 1 -- 172.21.15.18:0/2159288019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffbe0109140 msgr2=0x7ffbe019ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.024+0000 7ffbd7e00640 1 --2- 172.21.15.18:0/2159288019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffbe0109140 0x7ffbe019ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.024+0000 7ffbd7e00640 1 -- 172.21.15.18:0/2159288019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbe0104010 msgr2=0x7ffbe019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.024+0000 7ffbd7e00640 1 --2- 172.21.15.18:0/2159288019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbe0104010 0x7ffbe019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.024+0000 7ffbd7e00640 1 -- 172.21.15.18:0/2159288019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe019f5e0 con 0x7ffbe01049c0 2024-09-12T02:47:13.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.024+0000 7ffbdde00640 1 --2- 172.21.15.18:0/2159288019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbe0104010 0x7ffbe019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:13.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.025+0000 7ffbd7e00640 1 --2- 172.21.15.18:0/2159288019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe01049c0 0x7ffbe019ab70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800e9f0 tx=0x7ffbc800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:13.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.025+0000 7ffbd6a00640 1 -- 172.21.15.18:0/2159288019 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800cd80 con 0x7ffbe01049c0 2024-09-12T02:47:13.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.025+0000 7ffbd6a00640 1 -- 172.21.15.18:0/2159288019 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbc8010910 con 0x7ffbe01049c0 2024-09-12T02:47:13.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.025+0000 7ffbd6a00640 1 -- 172.21.15.18:0/2159288019 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8018990 con 0x7ffbe01049c0 2024-09-12T02:47:13.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.025+0000 7ffbe4c00640 1 -- 172.21.15.18:0/2159288019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe019f8d0 con 0x7ffbe01049c0 2024-09-12T02:47:13.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.025+0000 7ffbe4c00640 1 -- 172.21.15.18:0/2159288019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe01a71b0 con 0x7ffbe01049c0 2024-09-12T02:47:13.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.026+0000 7ffbe4c00640 1 -- 172.21.15.18:0/2159288019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffbe0062940 con 0x7ffbe01049c0 2024-09-12T02:47:13.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.028+0000 7ffbd6a00640 1 -- 172.21.15.18:0/2159288019 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ffbc8010ac0 con 0x7ffbe01049c0 2024-09-12T02:47:13.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.030+0000 7ffbd6a00640 1 --2- 172.21.15.18:0/2159288019 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ffbc40a2c90 0x7ffbc40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.030+0000 7ffbd6a00640 1 -- 172.21.15.18:0/2159288019 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9092+0+0 (secure 0 0 0) 0x7ffbc80cfec0 con 0x7ffbe01049c0 2024-09-12T02:47:13.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.030+0000 7ffbdde00640 1 --2- 172.21.15.18:0/2159288019 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ffbc40a2c90 0x7ffbc40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.030+0000 7ffbd6a00640 1 --2- 172.21.15.18:0/2159288019 >> [v2:172.21.15.62:6800/3139630617,v1:172.21.15.62:6801/3139630617] conn(0x7ffbc40ade60 0x7ffbc40b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.030+0000 7ffbd6a00640 1 -- 172.21.15.18:0/2159288019 --> [v2:172.21.15.62:6800/3139630617,v1:172.21.15.62:6801/3139630617] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffbc8019ec0 con 0x7ffbc40ade60 2024-09-12T02:47:13.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.030+0000 7ffbd6a00640 1 -- 172.21.15.18:0/2159288019 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7ffbc80d0270 con 0x7ffbe01049c0 2024-09-12T02:47:13.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.031+0000 7ffbde800640 1 --2- 172.21.15.18:0/2159288019 >> [v2:172.21.15.62:6800/3139630617,v1:172.21.15.62:6801/3139630617] conn(0x7ffbc40ade60 0x7ffbc40b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.031+0000 7ffbdde00640 1 --2- 172.21.15.18:0/2159288019 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ffbc40a2c90 0x7ffbc40a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009230 tx=0x7ffbd00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:13.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.031+0000 7ffbde800640 1 --2- 172.21.15.18:0/2159288019 >> [v2:172.21.15.62:6800/3139630617,v1:172.21.15.62:6801/3139630617] conn(0x7ffbc40ade60 0x7ffbc40b0300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:13.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.032+0000 7ffbd6a00640 1 -- 172.21.15.18:0/2159288019 <== osd.1 v2:172.21.15.62:6800/3139630617 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffbc8019ec0 con 0x7ffbc40ade60 2024-09-12T02:47:13.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.047+0000 7ffbe4c00640 1 -- 172.21.15.18:0/2159288019 --> [v2:172.21.15.62:6800/3139630617,v1:172.21.15.62:6801/3139630617] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffbe0062e10 con 0x7ffbc40ade60 2024-09-12T02:47:13.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.048+0000 7ffbd6a00640 1 -- 172.21.15.18:0/2159288019 <== osd.1 v2:172.21.15.62:6800/3139630617 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ffbe0062e10 con 0x7ffbc40ade60 2024-09-12T02:47:13.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.048+0000 7ffbe4c00640 1 -- 172.21.15.18:0/2159288019 >> [v2:172.21.15.62:6800/3139630617,v1:172.21.15.62:6801/3139630617] conn(0x7ffbc40ade60 msgr2=0x7ffbc40b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.048+0000 7ffbe4c00640 1 --2- 172.21.15.18:0/2159288019 >> [v2:172.21.15.62:6800/3139630617,v1:172.21.15.62:6801/3139630617] conn(0x7ffbc40ade60 0x7ffbc40b0300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.048+0000 7ffbe4c00640 1 -- 172.21.15.18:0/2159288019 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ffbc40a2c90 msgr2=0x7ffbc40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.048+0000 7ffbe4c00640 1 --2- 172.21.15.18:0/2159288019 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ffbc40a2c90 0x7ffbc40a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009230 tx=0x7ffbd00058d0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.048+0000 7ffbe4c00640 1 -- 172.21.15.18:0/2159288019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe01049c0 msgr2=0x7ffbe019ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.048+0000 7ffbe4c00640 1 --2- 172.21.15.18:0/2159288019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe01049c0 0x7ffbe019ab70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800e9f0 tx=0x7ffbc800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.048+0000 7ffbde800640 1 -- 172.21.15.18:0/2159288019 reap_dead start 2024-09-12T02:47:13.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.048+0000 7ffbe4c00640 1 -- 172.21.15.18:0/2159288019 shutdown_connections 2024-09-12T02:47:13.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.048+0000 7ffbe4c00640 1 -- 172.21.15.18:0/2159288019 >> 172.21.15.18:0/2159288019 conn(0x7ffbe00ffa50 msgr2=0x7ffbe0100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:13.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.049+0000 7ffbe4c00640 1 -- 172.21.15.18:0/2159288019 shutdown_connections 2024-09-12T02:47:13.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.049+0000 7ffbe4c00640 1 -- 172.21.15.18:0/2159288019 wait complete. 2024-09-12T02:47:13.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.678+0000 7fdc71e00640 1 -- 172.21.15.18:0/3215090023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc6c102780 msgr2=0x7fdc6c1067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.678+0000 7fdc71e00640 1 --2- 172.21.15.18:0/3215090023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc6c102780 0x7fdc6c1067d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdc54009900 tx=0x7fdc5402a400 comp rx=0 tx=0).stop 2024-09-12T02:47:13.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.679+0000 7fdc71e00640 1 -- 172.21.15.18:0/3215090023 shutdown_connections 2024-09-12T02:47:13.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.679+0000 7fdc71e00640 1 --2- 172.21.15.18:0/3215090023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc6c106f00 0x7fdc6c10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.679+0000 7fdc71e00640 1 --2- 172.21.15.18:0/3215090023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc6c102780 0x7fdc6c1067d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.679+0000 7fdc71e00640 1 --2- 172.21.15.18:0/3215090023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc6c101dd0 0x7fdc6c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.679+0000 7fdc71e00640 1 -- 172.21.15.18:0/3215090023 >> 172.21.15.18:0/3215090023 conn(0x7fdc6c0fd8b0 msgr2=0x7fdc6c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:13.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.679+0000 7fdc71e00640 1 -- 172.21.15.18:0/3215090023 shutdown_connections 2024-09-12T02:47:13.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.679+0000 7fdc71e00640 1 -- 172.21.15.18:0/3215090023 wait complete. 2024-09-12T02:47:13.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.680+0000 7fdc71e00640 1 Processor -- start 2024-09-12T02:47:13.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.680+0000 7fdc71e00640 1 -- start start 2024-09-12T02:47:13.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.680+0000 7fdc71e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc6c101dd0 0x7fdc6c19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.680+0000 7fdc71e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc6c102780 0x7fdc6c19acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.680+0000 7fdc71e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc6c106f00 0x7fdc6c19df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.680+0000 7fdc71e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6c111f70 con 0x7fdc6c101dd0 2024-09-12T02:47:13.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.680+0000 7fdc71e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6c111df0 con 0x7fdc6c106f00 2024-09-12T02:47:13.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.680+0000 7fdc71e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6c1120f0 con 0x7fdc6c102780 2024-09-12T02:47:13.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.680+0000 7fdc6aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc6c101dd0 0x7fdc6c19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.680+0000 7fdc6b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc6c106f00 0x7fdc6c19df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.681+0000 7fdc6b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc6c106f00 0x7fdc6c19df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:49212/0 (socket says 172.21.15.18:49212) 2024-09-12T02:47:13.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.681+0000 7fdc6b400640 1 -- 172.21.15.18:0/341232080 learned_addr learned my addr 172.21.15.18:0/341232080 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:13.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.681+0000 7fdc63e00640 1 --2- 172.21.15.18:0/341232080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc6c102780 0x7fdc6c19acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.681+0000 7fdc6b400640 1 -- 172.21.15.18:0/341232080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc6c102780 msgr2=0x7fdc6c19acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.681+0000 7fdc6b400640 1 --2- 172.21.15.18:0/341232080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc6c102780 0x7fdc6c19acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.681+0000 7fdc6b400640 1 -- 172.21.15.18:0/341232080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc6c101dd0 msgr2=0x7fdc6c19a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.681+0000 7fdc6b400640 1 --2- 172.21.15.18:0/341232080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc6c101dd0 0x7fdc6c19a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.681+0000 7fdc6b400640 1 -- 172.21.15.18:0/341232080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc6c19e6c0 con 0x7fdc6c106f00 2024-09-12T02:47:13.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.681+0000 7fdc6b400640 1 --2- 172.21.15.18:0/341232080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc6c106f00 0x7fdc6c19df90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400eaa0 tx=0x7fdc6400ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:13.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.681+0000 7fdc70a00640 1 -- 172.21.15.18:0/341232080 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400cdb0 con 0x7fdc6c106f00 2024-09-12T02:47:13.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.682+0000 7fdc70a00640 1 -- 172.21.15.18:0/341232080 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc64005020 con 0x7fdc6c106f00 2024-09-12T02:47:13.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.682+0000 7fdc70a00640 1 -- 172.21.15.18:0/341232080 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc640116b0 con 0x7fdc6c106f00 2024-09-12T02:47:13.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.682+0000 7fdc71e00640 1 -- 172.21.15.18:0/341232080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc6c19e9b0 con 0x7fdc6c106f00 2024-09-12T02:47:13.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.682+0000 7fdc71e00640 1 -- 172.21.15.18:0/341232080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc6c1a7320 con 0x7fdc6c106f00 2024-09-12T02:47:13.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.682+0000 7fdc71e00640 1 -- 172.21.15.18:0/341232080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc6c0fee80 con 0x7fdc6c106f00 2024-09-12T02:47:13.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.685+0000 7fdc70a00640 1 -- 172.21.15.18:0/341232080 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdc64005560 con 0x7fdc6c106f00 2024-09-12T02:47:13.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.686+0000 7fdc70a00640 1 --2- 172.21.15.18:0/341232080 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fdc500a2c10 0x7fdc500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.686+0000 7fdc70a00640 1 -- 172.21.15.18:0/341232080 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9216+0+0 (secure 0 0 0) 0x7fdc640cfb40 con 0x7fdc6c106f00 2024-09-12T02:47:13.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.686+0000 7fdc6aa00640 1 --2- 172.21.15.18:0/341232080 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fdc500a2c10 0x7fdc500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.687+0000 7fdc70a00640 1 --2- 172.21.15.18:0/341232080 >> [v2:172.21.15.62:6824/269877918,v1:172.21.15.62:6825/269877918] conn(0x7fdc500adfe0 0x7fdc500b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:13.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.687+0000 7fdc70a00640 1 -- 172.21.15.18:0/341232080 --> [v2:172.21.15.62:6824/269877918,v1:172.21.15.62:6825/269877918] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc64014ec0 con 0x7fdc500adfe0 2024-09-12T02:47:13.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.687+0000 7fdc70a00640 1 -- 172.21.15.18:0/341232080 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=97) ==== 24+0+0 (secure 0 0 0) 0x7fdc640cfef0 con 0x7fdc6c106f00 2024-09-12T02:47:13.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.687+0000 7fdc63e00640 1 --2- 172.21.15.18:0/341232080 >> [v2:172.21.15.62:6824/269877918,v1:172.21.15.62:6825/269877918] conn(0x7fdc500adfe0 0x7fdc500b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:13.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.687+0000 7fdc6aa00640 1 --2- 172.21.15.18:0/341232080 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fdc500a2c10 0x7fdc500a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c009bd0 tx=0x7fdc5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:13.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.688+0000 7fdc63e00640 1 --2- 172.21.15.18:0/341232080 >> [v2:172.21.15.62:6824/269877918,v1:172.21.15.62:6825/269877918] conn(0x7fdc500adfe0 0x7fdc500b0480 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:13.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.688+0000 7fdc70a00640 1 -- 172.21.15.18:0/341232080 <== osd.10 v2:172.21.15.62:6824/269877918 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc64014ec0 con 0x7fdc500adfe0 2024-09-12T02:47:13.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.703+0000 7fdc71e00640 1 -- 172.21.15.18:0/341232080 --> [v2:172.21.15.62:6824/269877918,v1:172.21.15.62:6825/269877918] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdc6c1032b0 con 0x7fdc500adfe0 2024-09-12T02:47:13.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.704+0000 7fdc70a00640 1 -- 172.21.15.18:0/341232080 <== osd.10 v2:172.21.15.62:6824/269877918 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdc6c1032b0 con 0x7fdc500adfe0 2024-09-12T02:47:13.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.704+0000 7fdc71e00640 1 -- 172.21.15.18:0/341232080 >> [v2:172.21.15.62:6824/269877918,v1:172.21.15.62:6825/269877918] conn(0x7fdc500adfe0 msgr2=0x7fdc500b0480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.704+0000 7fdc71e00640 1 --2- 172.21.15.18:0/341232080 >> [v2:172.21.15.62:6824/269877918,v1:172.21.15.62:6825/269877918] conn(0x7fdc500adfe0 0x7fdc500b0480 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:13.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.704+0000 7fdc71e00640 1 -- 172.21.15.18:0/341232080 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fdc500a2c10 msgr2=0x7fdc500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.704+0000 7fdc71e00640 1 --2- 172.21.15.18:0/341232080 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fdc500a2c10 0x7fdc500a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c009bd0 tx=0x7fdc5c005f90 comp rx=0 tx=0).stop 2024-09-12T02:47:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.704+0000 7fdc71e00640 1 -- 172.21.15.18:0/341232080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc6c106f00 msgr2=0x7fdc6c19df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.704+0000 7fdc71e00640 1 --2- 172.21.15.18:0/341232080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc6c106f00 0x7fdc6c19df90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400eaa0 tx=0x7fdc6400ef60 comp rx=0 tx=0).stop 2024-09-12T02:47:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.704+0000 7fdc6b400640 1 -- 172.21.15.18:0/341232080 reap_dead start 2024-09-12T02:47:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.704+0000 7fdc71e00640 1 -- 172.21.15.18:0/341232080 shutdown_connections 2024-09-12T02:47:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.704+0000 7fdc71e00640 1 -- 172.21.15.18:0/341232080 >> 172.21.15.18:0/341232080 conn(0x7fdc6c0fd8b0 msgr2=0x7fdc6c0ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.704+0000 7fdc71e00640 1 -- 172.21.15.18:0/341232080 shutdown_connections 2024-09-12T02:47:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:11.704+0000 7fdc71e00640 1 -- 172.21.15.18:0/341232080 wait complete. 2024-09-12T02:47:13.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:13 smithi018 ceph-mon[30616]: osdmap e98: 12 total, 12 up, 12 in 2024-09-12T02:47:13.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:13 smithi176 ceph-mon[35713]: osdmap e98: 12 total, 12 up, 12 in 2024-09-12T02:47:14.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:13 smithi062 ceph-mon[35527]: osdmap e98: 12 total, 12 up, 12 in 2024-09-12T02:47:14.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.214+0000 7fb273200640 1 -- 172.21.15.18:0/2442055873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb26c109090 msgr2=0x7fb26c110c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.214+0000 7fb273200640 1 --2- 172.21.15.18:0/2442055873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb26c109090 0x7fb26c110c10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb268009ca0 tx=0x7fb26802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.214+0000 7fb273200640 1 -- 172.21.15.18:0/2442055873 shutdown_connections 2024-09-12T02:47:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.214+0000 7fb273200640 1 --2- 172.21.15.18:0/2442055873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb26c109090 0x7fb26c110c10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.214+0000 7fb273200640 1 --2- 172.21.15.18:0/2442055873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb26c104800 0x7fb26c108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.214+0000 7fb273200640 1 --2- 172.21.15.18:0/2442055873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb26c103e50 0x7fb26c104230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.214+0000 7fb273200640 1 -- 172.21.15.18:0/2442055873 >> 172.21.15.18:0/2442055873 conn(0x7fb26c0ff8b0 msgr2=0x7fb26c101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.214+0000 7fb273200640 1 -- 172.21.15.18:0/2442055873 shutdown_connections 2024-09-12T02:47:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.214+0000 7fb273200640 1 -- 172.21.15.18:0/2442055873 wait complete. 2024-09-12T02:47:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.215+0000 7fb273200640 1 Processor -- start 2024-09-12T02:47:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.215+0000 7fb273200640 1 -- start start 2024-09-12T02:47:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.215+0000 7fb273200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb26c103e50 0x7fb26c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.215+0000 7fb273200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb26c104800 0x7fb26c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.215+0000 7fb273200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb26c109090 0x7fb26c19ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.215+0000 7fb273200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c114110 con 0x7fb26c103e50 2024-09-12T02:47:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.215+0000 7fb273200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c113f90 con 0x7fb26c104800 2024-09-12T02:47:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.215+0000 7fb273200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c114290 con 0x7fb26c109090 2024-09-12T02:47:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.215+0000 7fb271e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb26c103e50 0x7fb26c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.216+0000 7fb271400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb26c104800 0x7fb26c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.216+0000 7fb271400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb26c104800 0x7fb26c19aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:49254/0 (socket says 172.21.15.18:49254) 2024-09-12T02:47:14.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.216+0000 7fb271400640 1 -- 172.21.15.18:0/2534857333 learned_addr learned my addr 172.21.15.18:0/2534857333 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:14.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.216+0000 7fb272800640 1 --2- 172.21.15.18:0/2534857333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb26c109090 0x7fb26c19ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.216+0000 7fb271400640 1 -- 172.21.15.18:0/2534857333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb26c109090 msgr2=0x7fb26c19ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.216+0000 7fb271400640 1 --2- 172.21.15.18:0/2534857333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb26c109090 0x7fb26c19ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.216+0000 7fb271400640 1 -- 172.21.15.18:0/2534857333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb26c103e50 msgr2=0x7fb26c19a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.216+0000 7fb271400640 1 --2- 172.21.15.18:0/2534857333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb26c103e50 0x7fb26c19a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.216+0000 7fb271400640 1 -- 172.21.15.18:0/2534857333 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26c19f520 con 0x7fb26c104800 2024-09-12T02:47:14.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.216+0000 7fb271400640 1 --2- 172.21.15.18:0/2534857333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb26c104800 0x7fb26c19aab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00e9f0 tx=0x7fb25c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:14.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.217+0000 7fb266a00640 1 -- 172.21.15.18:0/2534857333 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c00cd80 con 0x7fb26c104800 2024-09-12T02:47:14.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.217+0000 7fb273200640 1 -- 172.21.15.18:0/2534857333 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb26c19f810 con 0x7fb26c104800 2024-09-12T02:47:14.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.217+0000 7fb266a00640 1 -- 172.21.15.18:0/2534857333 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb25c005500 con 0x7fb26c104800 2024-09-12T02:47:14.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.217+0000 7fb266a00640 1 -- 172.21.15.18:0/2534857333 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c010690 con 0x7fb26c104800 2024-09-12T02:47:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.217+0000 7fb273200640 1 -- 172.21.15.18:0/2534857333 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb26c1a70f0 con 0x7fb26c104800 2024-09-12T02:47:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.218+0000 7fb273200640 1 -- 172.21.15.18:0/2534857333 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb26c062980 con 0x7fb26c104800 2024-09-12T02:47:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.220+0000 7fb266a00640 1 -- 172.21.15.18:0/2534857333 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb25c0046c0 con 0x7fb26c104800 2024-09-12T02:47:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.221+0000 7fb266a00640 1 --2- 172.21.15.18:0/2534857333 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb2540a2c10 0x7fb2540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.222+0000 7fb266a00640 1 -- 172.21.15.18:0/2534857333 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7fb25c0cfdc0 con 0x7fb26c104800 2024-09-12T02:47:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.222+0000 7fb271e00640 1 --2- 172.21.15.18:0/2534857333 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb2540a2c10 0x7fb2540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.222+0000 7fb266a00640 1 --2- 172.21.15.18:0/2534857333 >> [v2:172.21.15.62:6808/1416302860,v1:172.21.15.62:6809/1416302860] conn(0x7fb2540adfe0 0x7fb2540b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.222+0000 7fb266a00640 1 -- 172.21.15.18:0/2534857333 --> [v2:172.21.15.62:6808/1416302860,v1:172.21.15.62:6809/1416302860] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb25c004470 con 0x7fb2540adfe0 2024-09-12T02:47:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.222+0000 7fb266a00640 1 -- 172.21.15.18:0/2534857333 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fb25c0d0170 con 0x7fb26c104800 2024-09-12T02:47:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.222+0000 7fb272800640 1 --2- 172.21.15.18:0/2534857333 >> [v2:172.21.15.62:6808/1416302860,v1:172.21.15.62:6809/1416302860] conn(0x7fb2540adfe0 0x7fb2540b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.222+0000 7fb271e00640 1 --2- 172.21.15.18:0/2534857333 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb2540a2c10 0x7fb2540a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb260009bd0 tx=0x7fb260005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.223+0000 7fb272800640 1 --2- 172.21.15.18:0/2534857333 >> [v2:172.21.15.62:6808/1416302860,v1:172.21.15.62:6809/1416302860] conn(0x7fb2540adfe0 0x7fb2540b0480 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.224+0000 7fb266a00640 1 -- 172.21.15.18:0/2534857333 <== osd.4 v2:172.21.15.62:6808/1416302860 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb25c004470 con 0x7fb2540adfe0 2024-09-12T02:47:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.238+0000 7fb273200640 1 -- 172.21.15.18:0/2534857333 --> [v2:172.21.15.62:6808/1416302860,v1:172.21.15.62:6809/1416302860] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb26c062e00 con 0x7fb2540adfe0 2024-09-12T02:47:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.239+0000 7fb266a00640 1 -- 172.21.15.18:0/2534857333 <== osd.4 v2:172.21.15.62:6808/1416302860 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb26c062e00 con 0x7fb2540adfe0 2024-09-12T02:47:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.239+0000 7fb273200640 1 -- 172.21.15.18:0/2534857333 >> [v2:172.21.15.62:6808/1416302860,v1:172.21.15.62:6809/1416302860] conn(0x7fb2540adfe0 msgr2=0x7fb2540b0480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.239+0000 7fb273200640 1 --2- 172.21.15.18:0/2534857333 >> [v2:172.21.15.62:6808/1416302860,v1:172.21.15.62:6809/1416302860] conn(0x7fb2540adfe0 0x7fb2540b0480 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.239+0000 7fb273200640 1 -- 172.21.15.18:0/2534857333 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb2540a2c10 msgr2=0x7fb2540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.239+0000 7fb273200640 1 --2- 172.21.15.18:0/2534857333 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb2540a2c10 0x7fb2540a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb260009bd0 tx=0x7fb260005f90 comp rx=0 tx=0).stop 2024-09-12T02:47:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.239+0000 7fb273200640 1 -- 172.21.15.18:0/2534857333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb26c104800 msgr2=0x7fb26c19aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.239+0000 7fb273200640 1 --2- 172.21.15.18:0/2534857333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb26c104800 0x7fb26c19aab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00e9f0 tx=0x7fb25c00edf0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.239+0000 7fb272800640 1 -- 172.21.15.18:0/2534857333 reap_dead start 2024-09-12T02:47:14.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.240+0000 7fb273200640 1 -- 172.21.15.18:0/2534857333 shutdown_connections 2024-09-12T02:47:14.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.240+0000 7fb273200640 1 -- 172.21.15.18:0/2534857333 >> 172.21.15.18:0/2534857333 conn(0x7fb26c0ff8b0 msgr2=0x7fb26c100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:14.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.240+0000 7fb273200640 1 -- 172.21.15.18:0/2534857333 shutdown_connections 2024-09-12T02:47:14.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.240+0000 7fb273200640 1 -- 172.21.15.18:0/2534857333 wait complete. 2024-09-12T02:47:14.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.657+0000 7fc31fc00640 1 -- 172.21.15.18:0/3318975366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc318103ff0 msgr2=0x7fc3181043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.657+0000 7fc31fc00640 1 --2- 172.21.15.18:0/3318975366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc318103ff0 0x7fc3181043d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009900 tx=0x7fc30c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.658+0000 7fc31fc00640 1 -- 172.21.15.18:0/3318975366 shutdown_connections 2024-09-12T02:47:14.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.658+0000 7fc31fc00640 1 --2- 172.21.15.18:0/3318975366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc318109120 0x7fc318110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.658+0000 7fc31fc00640 1 --2- 172.21.15.18:0/3318975366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3181049a0 0x7fc3181089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.658+0000 7fc31fc00640 1 --2- 172.21.15.18:0/3318975366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc318103ff0 0x7fc3181043d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.658+0000 7fc31fc00640 1 -- 172.21.15.18:0/3318975366 >> 172.21.15.18:0/3318975366 conn(0x7fc3180ffa90 msgr2=0x7fc318101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:14.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.658+0000 7fc31fc00640 1 -- 172.21.15.18:0/3318975366 shutdown_connections 2024-09-12T02:47:14.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.658+0000 7fc31fc00640 1 -- 172.21.15.18:0/3318975366 wait complete. 2024-09-12T02:47:14.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.659+0000 7fc31fc00640 1 Processor -- start 2024-09-12T02:47:14.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.659+0000 7fc31fc00640 1 -- start start 2024-09-12T02:47:14.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.660+0000 7fc31fc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc318103ff0 0x7fc31819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.660+0000 7fc31fc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3181049a0 0x7fc31819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.660+0000 7fc31fc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc318109120 0x7fc31819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.660+0000 7fc31fc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc318114170 con 0x7fc318103ff0 2024-09-12T02:47:14.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.660+0000 7fc31fc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc318113ff0 con 0x7fc318109120 2024-09-12T02:47:14.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.660+0000 7fc31fc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc3181142f0 con 0x7fc3181049a0 2024-09-12T02:47:14.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.660+0000 7fc31d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc318103ff0 0x7fc31819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.660+0000 7fc31d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc318103ff0 0x7fc31819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41442/0 (socket says 172.21.15.18:41442) 2024-09-12T02:47:14.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.660+0000 7fc31d200640 1 -- 172.21.15.18:0/114874428 learned_addr learned my addr 172.21.15.18:0/114874428 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:14.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.660+0000 7fc31dc00640 1 --2- 172.21.15.18:0/114874428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc318109120 0x7fc31819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.660+0000 7fc317e00640 1 --2- 172.21.15.18:0/114874428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3181049a0 0x7fc31819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.661+0000 7fc31dc00640 1 -- 172.21.15.18:0/114874428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3181049a0 msgr2=0x7fc31819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.661+0000 7fc31dc00640 1 --2- 172.21.15.18:0/114874428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3181049a0 0x7fc31819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.661+0000 7fc31dc00640 1 -- 172.21.15.18:0/114874428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc318103ff0 msgr2=0x7fc31819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.661+0000 7fc31dc00640 1 --2- 172.21.15.18:0/114874428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc318103ff0 0x7fc31819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.661+0000 7fc31dc00640 1 -- 172.21.15.18:0/114874428 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31819f5b0 con 0x7fc318109120 2024-09-12T02:47:14.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.661+0000 7fc31d200640 1 --2- 172.21.15.18:0/114874428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc318103ff0 0x7fc31819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:14.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.661+0000 7fc31dc00640 1 --2- 172.21.15.18:0/114874428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc318109120 0x7fc31819eed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc310009fd0 tx=0x7fc31000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.661+0000 7fc315600640 1 -- 172.21.15.18:0/114874428 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31000ce20 con 0x7fc318109120 2024-09-12T02:47:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.661+0000 7fc315600640 1 -- 172.21.15.18:0/114874428 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc310005020 con 0x7fc318109120 2024-09-12T02:47:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.661+0000 7fc31fc00640 1 -- 172.21.15.18:0/114874428 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc31819f8a0 con 0x7fc318109120 2024-09-12T02:47:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.662+0000 7fc315600640 1 -- 172.21.15.18:0/114874428 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc310010720 con 0x7fc318109120 2024-09-12T02:47:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.662+0000 7fc31fc00640 1 -- 172.21.15.18:0/114874428 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3181a7180 con 0x7fc318109120 2024-09-12T02:47:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.663+0000 7fc31fc00640 1 -- 172.21.15.18:0/114874428 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc318062980 con 0x7fc318109120 2024-09-12T02:47:14.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.666+0000 7fc315600640 1 -- 172.21.15.18:0/114874428 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc310005540 con 0x7fc318109120 2024-09-12T02:47:14.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.667+0000 7fc315600640 1 --2- 172.21.15.18:0/114874428 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc3000a2c90 0x7fc3000a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.668+0000 7fc315600640 1 -- 172.21.15.18:0/114874428 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7fc3100cfcf0 con 0x7fc318109120 2024-09-12T02:47:14.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.668+0000 7fc31d200640 1 --2- 172.21.15.18:0/114874428 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc3000a2c90 0x7fc3000a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.668+0000 7fc315600640 1 --2- 172.21.15.18:0/114874428 >> [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982] conn(0x7fc3000ae060 0x7fc3000b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:14.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.668+0000 7fc315600640 1 -- 172.21.15.18:0/114874428 --> [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3000b0bd0 con 0x7fc3000ae060 2024-09-12T02:47:14.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.668+0000 7fc315600640 1 -- 172.21.15.18:0/114874428 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fc3100d00a0 con 0x7fc318109120 2024-09-12T02:47:14.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.668+0000 7fc317e00640 1 --2- 172.21.15.18:0/114874428 >> [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982] conn(0x7fc3000ae060 0x7fc3000b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:14.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.669+0000 7fc31d200640 1 --2- 172.21.15.18:0/114874428 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc3000a2c90 0x7fc3000a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0096c0 tx=0x7fc30c0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:14.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.669+0000 7fc317e00640 1 --2- 172.21.15.18:0/114874428 >> [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982] conn(0x7fc3000ae060 0x7fc3000b0500 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:14.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.671+0000 7fc315600640 1 -- 172.21.15.18:0/114874428 <== osd.6 v2:172.21.15.18:6818/3613955982 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc3000b0bd0 con 0x7fc3000ae060 2024-09-12T02:47:14.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.685+0000 7fc31fc00640 1 -- 172.21.15.18:0/114874428 --> [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc318062e00 con 0x7fc3000ae060 2024-09-12T02:47:14.686 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:14 smithi018 ceph-mon[30616]: pgmap v359: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T02:47:14.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.686+0000 7fc315600640 1 -- 172.21.15.18:0/114874428 <== osd.6 v2:172.21.15.18:6818/3613955982 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc318062e00 con 0x7fc3000ae060 2024-09-12T02:47:14.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.686+0000 7fc31fc00640 1 -- 172.21.15.18:0/114874428 >> [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982] conn(0x7fc3000ae060 msgr2=0x7fc3000b0500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.686+0000 7fc31fc00640 1 --2- 172.21.15.18:0/114874428 >> [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982] conn(0x7fc3000ae060 0x7fc3000b0500 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.686+0000 7fc31fc00640 1 -- 172.21.15.18:0/114874428 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc3000a2c90 msgr2=0x7fc3000a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.686+0000 7fc31fc00640 1 --2- 172.21.15.18:0/114874428 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc3000a2c90 0x7fc3000a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0096c0 tx=0x7fc30c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:14.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.686+0000 7fc31fc00640 1 -- 172.21.15.18:0/114874428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc318109120 msgr2=0x7fc31819eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:14.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.686+0000 7fc31fc00640 1 --2- 172.21.15.18:0/114874428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc318109120 0x7fc31819eed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc310009fd0 tx=0x7fc31000ef10 comp rx=0 tx=0).stop 2024-09-12T02:47:14.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.687+0000 7fc31dc00640 1 -- 172.21.15.18:0/114874428 reap_dead start 2024-09-12T02:47:14.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.687+0000 7fc31fc00640 1 -- 172.21.15.18:0/114874428 shutdown_connections 2024-09-12T02:47:14.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.687+0000 7fc31fc00640 1 -- 172.21.15.18:0/114874428 >> 172.21.15.18:0/114874428 conn(0x7fc3180ffa90 msgr2=0x7fc318100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:14.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.687+0000 7fc31fc00640 1 -- 172.21.15.18:0/114874428 shutdown_connections 2024-09-12T02:47:14.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.687+0000 7fc31fc00640 1 -- 172.21.15.18:0/114874428 wait complete. 2024-09-12T02:47:14.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:14 smithi176 ceph-mon[35713]: pgmap v359: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T02:47:15.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.898+0000 7fa58c400640 1 -- 172.21.15.18:0/510533130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa584103ff0 msgr2=0x7fa5841043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.898+0000 7fa58c400640 1 --2- 172.21.15.18:0/510533130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa584103ff0 0x7fa5841043d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa578009900 tx=0x7fa57802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.898+0000 7fa58c400640 1 -- 172.21.15.18:0/510533130 shutdown_connections 2024-09-12T02:47:15.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.898+0000 7fa58c400640 1 --2- 172.21.15.18:0/510533130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa584109120 0x7fa584110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.898+0000 7fa58c400640 1 --2- 172.21.15.18:0/510533130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5841049a0 0x7fa5841089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.898+0000 7fa58c400640 1 --2- 172.21.15.18:0/510533130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa584103ff0 0x7fa5841043d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.898+0000 7fa58c400640 1 -- 172.21.15.18:0/510533130 >> 172.21.15.18:0/510533130 conn(0x7fa5840ffa90 msgr2=0x7fa584101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:15.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.898+0000 7fa58c400640 1 -- 172.21.15.18:0/510533130 shutdown_connections 2024-09-12T02:47:15.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.898+0000 7fa58c400640 1 -- 172.21.15.18:0/510533130 wait complete. 2024-09-12T02:47:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.899+0000 7fa58c400640 1 Processor -- start 2024-09-12T02:47:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.899+0000 7fa58c400640 1 -- start start 2024-09-12T02:47:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.899+0000 7fa58c400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa584103ff0 0x7fa58419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.899+0000 7fa58c400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5841049a0 0x7fa58419ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.899+0000 7fa58c400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa584109120 0x7fa58419eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.899+0000 7fa58c400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa584114140 con 0x7fa5841049a0 2024-09-12T02:47:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.899+0000 7fa58c400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa584113fc0 con 0x7fa584103ff0 2024-09-12T02:47:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.899+0000 7fa58c400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa5841142c0 con 0x7fa584109120 2024-09-12T02:47:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.900+0000 7fa589000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5841049a0 0x7fa58419ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.900+0000 7fa589a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa584103ff0 0x7fa58419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.900+0000 7fa589000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5841049a0 0x7fa58419ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41408/0 (socket says 172.21.15.18:41408) 2024-09-12T02:47:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.900+0000 7fa589000640 1 -- 172.21.15.18:0/873729870 learned_addr learned my addr 172.21.15.18:0/873729870 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:15.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.900+0000 7fa589a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa584103ff0 0x7fa58419a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:49266/0 (socket says 172.21.15.18:49266) 2024-09-12T02:47:15.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.900+0000 7fa58a400640 1 --2- 172.21.15.18:0/873729870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa584109120 0x7fa58419eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.900+0000 7fa589000640 1 -- 172.21.15.18:0/873729870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa584109120 msgr2=0x7fa58419eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.900+0000 7fa589000640 1 --2- 172.21.15.18:0/873729870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa584109120 0x7fa58419eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.900+0000 7fa589000640 1 -- 172.21.15.18:0/873729870 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa584103ff0 msgr2=0x7fa58419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.900+0000 7fa589000640 1 --2- 172.21.15.18:0/873729870 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa584103ff0 0x7fa58419a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.900+0000 7fa589000640 1 -- 172.21.15.18:0/873729870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58419f6d0 con 0x7fa5841049a0 2024-09-12T02:47:15.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.900+0000 7fa589000640 1 --2- 172.21.15.18:0/873729870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5841049a0 0x7fa58419ac60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa57000d770 tx=0x7fa57000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:15.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.901+0000 7fa582000640 1 -- 172.21.15.18:0/873729870 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570017070 con 0x7fa5841049a0 2024-09-12T02:47:15.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.901+0000 7fa582000640 1 -- 172.21.15.18:0/873729870 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa570005500 con 0x7fa5841049a0 2024-09-12T02:47:15.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.901+0000 7fa582000640 1 -- 172.21.15.18:0/873729870 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570004e00 con 0x7fa5841049a0 2024-09-12T02:47:15.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.901+0000 7fa58c400640 1 -- 172.21.15.18:0/873729870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa58419f9c0 con 0x7fa5841049a0 2024-09-12T02:47:15.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.901+0000 7fa58c400640 1 -- 172.21.15.18:0/873729870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5841a72a0 con 0x7fa5841049a0 2024-09-12T02:47:15.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.902+0000 7fa58c400640 1 -- 172.21.15.18:0/873729870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa584062900 con 0x7fa5841049a0 2024-09-12T02:47:15.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.904+0000 7fa582000640 1 -- 172.21.15.18:0/873729870 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa570004fa0 con 0x7fa5841049a0 2024-09-12T02:47:15.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.905+0000 7fa582000640 1 --2- 172.21.15.18:0/873729870 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa56c0a2c90 0x7fa56c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.905+0000 7fa582000640 1 -- 172.21.15.18:0/873729870 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7fa5700cf310 con 0x7fa5841049a0 2024-09-12T02:47:15.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.905+0000 7fa589a00640 1 --2- 172.21.15.18:0/873729870 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa56c0a2c90 0x7fa56c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.906+0000 7fa582000640 1 --2- 172.21.15.18:0/873729870 >> [v2:172.21.15.18:6826/422514390,v1:172.21.15.18:6827/422514390] conn(0x7fa56c0ae060 0x7fa56c0b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.906+0000 7fa582000640 1 -- 172.21.15.18:0/873729870 --> [v2:172.21.15.18:6826/422514390,v1:172.21.15.18:6827/422514390] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa570001d30 con 0x7fa56c0ae060 2024-09-12T02:47:15.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.906+0000 7fa582000640 1 -- 172.21.15.18:0/873729870 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fa5700cf6c0 con 0x7fa5841049a0 2024-09-12T02:47:15.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.906+0000 7fa58a400640 1 --2- 172.21.15.18:0/873729870 >> [v2:172.21.15.18:6826/422514390,v1:172.21.15.18:6827/422514390] conn(0x7fa56c0ae060 0x7fa56c0b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.906+0000 7fa589a00640 1 --2- 172.21.15.18:0/873729870 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa56c0a2c90 0x7fa56c0a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa578009230 tx=0x7fa5780058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:15.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.906+0000 7fa58a400640 1 --2- 172.21.15.18:0/873729870 >> [v2:172.21.15.18:6826/422514390,v1:172.21.15.18:6827/422514390] conn(0x7fa56c0ae060 0x7fa56c0b0500 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:15.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.907+0000 7fa582000640 1 -- 172.21.15.18:0/873729870 <== osd.9 v2:172.21.15.18:6826/422514390 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa570001d30 con 0x7fa56c0ae060 2024-09-12T02:47:15.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.922+0000 7fa58c400640 1 -- 172.21.15.18:0/873729870 --> [v2:172.21.15.18:6826/422514390,v1:172.21.15.18:6827/422514390] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa584062d00 con 0x7fa56c0ae060 2024-09-12T02:47:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.922+0000 7fa582000640 1 -- 172.21.15.18:0/873729870 <== osd.9 v2:172.21.15.18:6826/422514390 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa584062d00 con 0x7fa56c0ae060 2024-09-12T02:47:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.923+0000 7fa58c400640 1 -- 172.21.15.18:0/873729870 >> [v2:172.21.15.18:6826/422514390,v1:172.21.15.18:6827/422514390] conn(0x7fa56c0ae060 msgr2=0x7fa56c0b0500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.923+0000 7fa58c400640 1 --2- 172.21.15.18:0/873729870 >> [v2:172.21.15.18:6826/422514390,v1:172.21.15.18:6827/422514390] conn(0x7fa56c0ae060 0x7fa56c0b0500 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.923+0000 7fa58c400640 1 -- 172.21.15.18:0/873729870 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa56c0a2c90 msgr2=0x7fa56c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.923+0000 7fa58c400640 1 --2- 172.21.15.18:0/873729870 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa56c0a2c90 0x7fa56c0a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa578009230 tx=0x7fa5780058d0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.923+0000 7fa58c400640 1 -- 172.21.15.18:0/873729870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5841049a0 msgr2=0x7fa58419ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.923+0000 7fa58c400640 1 --2- 172.21.15.18:0/873729870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5841049a0 0x7fa58419ac60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa57000d770 tx=0x7fa57000dc30 comp rx=0 tx=0).stop 2024-09-12T02:47:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.923+0000 7fa58a400640 1 -- 172.21.15.18:0/873729870 reap_dead start 2024-09-12T02:47:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.923+0000 7fa58c400640 1 -- 172.21.15.18:0/873729870 shutdown_connections 2024-09-12T02:47:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.923+0000 7fa58c400640 1 -- 172.21.15.18:0/873729870 >> 172.21.15.18:0/873729870 conn(0x7fa5840ffa90 msgr2=0x7fa584100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.923+0000 7fa58c400640 1 -- 172.21.15.18:0/873729870 shutdown_connections 2024-09-12T02:47:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:13.923+0000 7fa58c400640 1 -- 172.21.15.18:0/873729870 wait complete. 2024-09-12T02:47:15.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:14 smithi062 ceph-mon[35527]: pgmap v359: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T02:47:15.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.044+0000 7f4b57800640 1 -- 172.21.15.18:0/2254628170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b50103ff0 msgr2=0x7f4b501043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.044+0000 7f4b57800640 1 --2- 172.21.15.18:0/2254628170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b50103ff0 0x7f4b501043d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009900 tx=0x7f4b4402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.044+0000 7f4b57800640 1 -- 172.21.15.18:0/2254628170 shutdown_connections 2024-09-12T02:47:15.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.045+0000 7f4b57800640 1 --2- 172.21.15.18:0/2254628170 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b50109120 0x7f4b50110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.045+0000 7f4b57800640 1 --2- 172.21.15.18:0/2254628170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b501049a0 0x7f4b501089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.045+0000 7f4b57800640 1 --2- 172.21.15.18:0/2254628170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b50103ff0 0x7f4b501043d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.045+0000 7f4b57800640 1 -- 172.21.15.18:0/2254628170 >> 172.21.15.18:0/2254628170 conn(0x7f4b500ffa90 msgr2=0x7f4b50101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:15.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.045+0000 7f4b57800640 1 -- 172.21.15.18:0/2254628170 shutdown_connections 2024-09-12T02:47:15.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.045+0000 7f4b57800640 1 -- 172.21.15.18:0/2254628170 wait complete. 2024-09-12T02:47:15.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.046+0000 7f4b57800640 1 Processor -- start 2024-09-12T02:47:15.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.046+0000 7f4b57800640 1 -- start start 2024-09-12T02:47:15.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.046+0000 7f4b57800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b50103ff0 0x7f4b5019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.046+0000 7f4b57800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b501049a0 0x7f4b5019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.046+0000 7f4b57800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b50109120 0x7f4b5019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.046+0000 7f4b57800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4b50114170 con 0x7f4b50109120 2024-09-12T02:47:15.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.046+0000 7f4b57800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4b50113ff0 con 0x7f4b501049a0 2024-09-12T02:47:15.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.046+0000 7f4b57800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4b501142f0 con 0x7f4b50103ff0 2024-09-12T02:47:15.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.046+0000 7f4b55800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b50109120 0x7f4b5019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.046+0000 7f4b55800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b50109120 0x7f4b5019ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41426/0 (socket says 172.21.15.18:41426) 2024-09-12T02:47:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.046+0000 7f4b55800640 1 -- 172.21.15.18:0/1097771321 learned_addr learned my addr 172.21.15.18:0/1097771321 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.046+0000 7f4b4fe00640 1 --2- 172.21.15.18:0/1097771321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b501049a0 0x7f4b5019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.047+0000 7f4b54e00640 1 --2- 172.21.15.18:0/1097771321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b50103ff0 0x7f4b5019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.047+0000 7f4b55800640 1 -- 172.21.15.18:0/1097771321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b50103ff0 msgr2=0x7f4b5019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.047+0000 7f4b55800640 1 --2- 172.21.15.18:0/1097771321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b50103ff0 0x7f4b5019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.047+0000 7f4b55800640 1 -- 172.21.15.18:0/1097771321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b501049a0 msgr2=0x7f4b5019ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.047+0000 7f4b55800640 1 --2- 172.21.15.18:0/1097771321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b501049a0 0x7f4b5019ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.047+0000 7f4b55800640 1 -- 172.21.15.18:0/1097771321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5019f5e0 con 0x7f4b50109120 2024-09-12T02:47:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.047+0000 7f4b4fe00640 1 --2- 172.21.15.18:0/1097771321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b501049a0 0x7f4b5019ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.047+0000 7f4b55800640 1 --2- 172.21.15.18:0/1097771321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b50109120 0x7f4b5019ef00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009fd0 tx=0x7f4b4800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.047+0000 7f4b4d600640 1 -- 172.21.15.18:0/1097771321 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b48017070 con 0x7f4b50109120 2024-09-12T02:47:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.047+0000 7f4b4d600640 1 -- 172.21.15.18:0/1097771321 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b48003e50 con 0x7f4b50109120 2024-09-12T02:47:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.047+0000 7f4b57800640 1 -- 172.21.15.18:0/1097771321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b5019f8d0 con 0x7f4b50109120 2024-09-12T02:47:15.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.048+0000 7f4b4d600640 1 -- 172.21.15.18:0/1097771321 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b480106c0 con 0x7f4b50109120 2024-09-12T02:47:15.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.048+0000 7f4b57800640 1 -- 172.21.15.18:0/1097771321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b501a71b0 con 0x7f4b50109120 2024-09-12T02:47:15.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.048+0000 7f4b57800640 1 -- 172.21.15.18:0/1097771321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4b50062980 con 0x7f4b50109120 2024-09-12T02:47:15.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.051+0000 7f4b4d600640 1 -- 172.21.15.18:0/1097771321 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4b48003970 con 0x7f4b50109120 2024-09-12T02:47:15.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.052+0000 7f4b4d600640 1 --2- 172.21.15.18:0/1097771321 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4b380a2c10 0x7f4b380a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.052+0000 7f4b4d600640 1 -- 172.21.15.18:0/1097771321 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f4b480cf650 con 0x7f4b50109120 2024-09-12T02:47:15.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.052+0000 7f4b54e00640 1 --2- 172.21.15.18:0/1097771321 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4b380a2c10 0x7f4b380a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.052+0000 7f4b4d600640 1 --2- 172.21.15.18:0/1097771321 >> [v2:172.21.15.176:6824/770358485,v1:172.21.15.176:6825/770358485] conn(0x7f4b380adfe0 0x7f4b380b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:15.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.052+0000 7f4b4d600640 1 -- 172.21.15.18:0/1097771321 --> [v2:172.21.15.176:6824/770358485,v1:172.21.15.176:6825/770358485] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b4801de50 con 0x7f4b380adfe0 2024-09-12T02:47:15.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.052+0000 7f4b4d600640 1 -- 172.21.15.18:0/1097771321 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f4b480cfa00 con 0x7f4b50109120 2024-09-12T02:47:15.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.053+0000 7f4b54e00640 1 --2- 172.21.15.18:0/1097771321 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4b380a2c10 0x7f4b380a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4b44000c00 tx=0x7f4b44005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:15.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.053+0000 7f4b4fe00640 1 --2- 172.21.15.18:0/1097771321 >> [v2:172.21.15.176:6824/770358485,v1:172.21.15.176:6825/770358485] conn(0x7f4b380adfe0 0x7f4b380b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:15.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.053+0000 7f4b4fe00640 1 --2- 172.21.15.18:0/1097771321 >> [v2:172.21.15.176:6824/770358485,v1:172.21.15.176:6825/770358485] conn(0x7f4b380adfe0 0x7f4b380b0480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:15.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.054+0000 7f4b4d600640 1 -- 172.21.15.18:0/1097771321 <== osd.11 v2:172.21.15.176:6824/770358485 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4b4801de50 con 0x7f4b380adfe0 2024-09-12T02:47:15.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.069+0000 7f4b57800640 1 -- 172.21.15.18:0/1097771321 --> [v2:172.21.15.176:6824/770358485,v1:172.21.15.176:6825/770358485] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4b50062e00 con 0x7f4b380adfe0 2024-09-12T02:47:15.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.069+0000 7f4b4d600640 1 -- 172.21.15.18:0/1097771321 <== osd.11 v2:172.21.15.176:6824/770358485 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4b50062e00 con 0x7f4b380adfe0 2024-09-12T02:47:15.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.070+0000 7f4b57800640 1 -- 172.21.15.18:0/1097771321 >> [v2:172.21.15.176:6824/770358485,v1:172.21.15.176:6825/770358485] conn(0x7f4b380adfe0 msgr2=0x7f4b380b0480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.070+0000 7f4b57800640 1 --2- 172.21.15.18:0/1097771321 >> [v2:172.21.15.176:6824/770358485,v1:172.21.15.176:6825/770358485] conn(0x7f4b380adfe0 0x7f4b380b0480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:15.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.070+0000 7f4b57800640 1 -- 172.21.15.18:0/1097771321 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4b380a2c10 msgr2=0x7f4b380a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.070+0000 7f4b57800640 1 --2- 172.21.15.18:0/1097771321 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4b380a2c10 0x7f4b380a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4b44000c00 tx=0x7f4b44005b50 comp rx=0 tx=0).stop 2024-09-12T02:47:15.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.070+0000 7f4b57800640 1 -- 172.21.15.18:0/1097771321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b50109120 msgr2=0x7f4b5019ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:15.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.070+0000 7f4b57800640 1 --2- 172.21.15.18:0/1097771321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b50109120 0x7f4b5019ef00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009fd0 tx=0x7f4b4800b260 comp rx=0 tx=0).stop 2024-09-12T02:47:15.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.070+0000 7f4b55800640 1 -- 172.21.15.18:0/1097771321 reap_dead start 2024-09-12T02:47:15.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.070+0000 7f4b57800640 1 -- 172.21.15.18:0/1097771321 shutdown_connections 2024-09-12T02:47:15.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.070+0000 7f4b57800640 1 -- 172.21.15.18:0/1097771321 >> 172.21.15.18:0/1097771321 conn(0x7f4b500ffa90 msgr2=0x7f4b50100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:15.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.070+0000 7f4b57800640 1 -- 172.21.15.18:0/1097771321 shutdown_connections 2024-09-12T02:47:15.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:14.070+0000 7f4b57800640 1 -- 172.21.15.18:0/1097771321 wait complete. 2024-09-12T02:47:16.539 INFO:teuthology.orchestra.run.smithi018.stdout:283467841580 2024-09-12T02:47:16.540 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-12T02:47:16.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:16 smithi018 ceph-mon[30616]: pgmap v360: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s; 13 B/s, 0 objects/s recovering 2024-09-12T02:47:16.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:16 smithi176 ceph-mon[35713]: pgmap v360: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s; 13 B/s, 0 objects/s recovering 2024-09-12T02:47:17.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:16 smithi062 ceph-mon[35527]: pgmap v360: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s; 13 B/s, 0 objects/s recovering 2024-09-12T02:47:17.564 INFO:teuthology.orchestra.run.smithi018.stdout:253403070513 2024-09-12T02:47:17.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-12T02:47:17.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:17 smithi018 ceph-mon[30616]: pgmap v361: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s; 13 B/s, 0 objects/s recovering 2024-09-12T02:47:17.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:17 smithi176 ceph-mon[35713]: pgmap v361: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s; 13 B/s, 0 objects/s recovering 2024-09-12T02:47:18.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:17 smithi062 ceph-mon[35527]: pgmap v361: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s; 13 B/s, 0 objects/s recovering 2024-09-12T02:47:18.729 INFO:teuthology.orchestra.run.smithi018.stdout:197568495676 2024-09-12T02:47:18.729 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-12T02:47:18.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.686+0000 7f6c37e00640 1 -- 172.21.15.18:0/3812170762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c38074510 msgr2=0x7f6c380748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:18.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.686+0000 7f6c37e00640 1 --2- 172.21.15.18:0/3812170762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c38074510 0x7f6c380748f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009860 tx=0x7f6c2802a3d0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.686+0000 7f6c37e00640 1 -- 172.21.15.18:0/3812170762 shutdown_connections 2024-09-12T02:47:18.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.686+0000 7f6c37e00640 1 --2- 172.21.15.18:0/3812170762 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c3810e280 0x7f6c38110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.686+0000 7f6c37e00640 1 --2- 172.21.15.18:0/3812170762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c38074e30 0x7f6c3810dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.686+0000 7f6c37e00640 1 --2- 172.21.15.18:0/3812170762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c38074510 0x7f6c380748f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.686+0000 7f6c37e00640 1 -- 172.21.15.18:0/3812170762 >> 172.21.15.18:0/3812170762 conn(0x7f6c380fd740 msgr2=0x7f6c380ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:18.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.686+0000 7f6c37e00640 1 -- 172.21.15.18:0/3812170762 shutdown_connections 2024-09-12T02:47:18.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.686+0000 7f6c37e00640 1 -- 172.21.15.18:0/3812170762 wait complete. 2024-09-12T02:47:18.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.688+0000 7f6c37e00640 1 Processor -- start 2024-09-12T02:47:18.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.688+0000 7f6c37e00640 1 -- start start 2024-09-12T02:47:18.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.688+0000 7f6c37e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c38074510 0x7f6c3819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:18.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.688+0000 7f6c37e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c38074e30 0x7f6c3819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:18.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.688+0000 7f6c37e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c3810e280 0x7f6c3819ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:18.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.688+0000 7f6c37e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38114000 con 0x7f6c38074510 2024-09-12T02:47:18.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.688+0000 7f6c37e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38113e80 con 0x7f6c3810e280 2024-09-12T02:47:18.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.688+0000 7f6c37e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38114180 con 0x7f6c38074e30 2024-09-12T02:47:18.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.689+0000 7f6c36a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c38074510 0x7f6c3819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:18.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.689+0000 7f6c36a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c38074510 0x7f6c3819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59780/0 (socket says 172.21.15.18:59780) 2024-09-12T02:47:18.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.689+0000 7f6c37400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c3810e280 0x7f6c3819ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:18.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.689+0000 7f6c36a00640 1 -- 172.21.15.18:0/3471792507 learned_addr learned my addr 172.21.15.18:0/3471792507 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:18.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.689+0000 7f6c2fe00640 1 --2- 172.21.15.18:0/3471792507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c38074e30 0x7f6c3819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:18.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.689+0000 7f6c37400640 1 -- 172.21.15.18:0/3471792507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c38074e30 msgr2=0x7f6c3819a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:18.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.689+0000 7f6c37400640 1 --2- 172.21.15.18:0/3471792507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c38074e30 0x7f6c3819a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.689+0000 7f6c37400640 1 -- 172.21.15.18:0/3471792507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c38074510 msgr2=0x7f6c3819a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:18.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.689+0000 7f6c37400640 1 --2- 172.21.15.18:0/3471792507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c38074510 0x7f6c3819a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.689+0000 7f6c37400640 1 -- 172.21.15.18:0/3471792507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3819f460 con 0x7f6c3810e280 2024-09-12T02:47:18.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.690+0000 7f6c37400640 1 --2- 172.21.15.18:0/3471792507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c3810e280 0x7f6c3819ed80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6c30005fd0 tx=0x7f6c3000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:18.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.692+0000 7f6c2f400640 1 -- 172.21.15.18:0/3471792507 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3000cdf0 con 0x7f6c3810e280 2024-09-12T02:47:18.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.692+0000 7f6c2f400640 1 -- 172.21.15.18:0/3471792507 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c30005020 con 0x7f6c3810e280 2024-09-12T02:47:18.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.692+0000 7f6c37e00640 1 -- 172.21.15.18:0/3471792507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c3819f750 con 0x7f6c3810e280 2024-09-12T02:47:18.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.693+0000 7f6c2f400640 1 -- 172.21.15.18:0/3471792507 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c300106d0 con 0x7f6c3810e280 2024-09-12T02:47:18.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.693+0000 7f6c37e00640 1 -- 172.21.15.18:0/3471792507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c381a7030 con 0x7f6c3810e280 2024-09-12T02:47:18.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.694+0000 7f6c37e00640 1 -- 172.21.15.18:0/3471792507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6c38062980 con 0x7f6c3810e280 2024-09-12T02:47:18.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.696+0000 7f6c2f400640 1 -- 172.21.15.18:0/3471792507 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6c30004b20 con 0x7f6c3810e280 2024-09-12T02:47:18.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.697+0000 7f6c2f400640 1 --2- 172.21.15.18:0/3471792507 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f6c1c0a2c90 0x7f6c1c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:18.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.698+0000 7f6c36a00640 1 --2- 172.21.15.18:0/3471792507 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f6c1c0a2c90 0x7f6c1c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:18.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.698+0000 7f6c2f400640 1 -- 172.21.15.18:0/3471792507 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f6c300cfb30 con 0x7f6c3810e280 2024-09-12T02:47:18.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.698+0000 7f6c2f400640 1 --2- 172.21.15.18:0/3471792507 >> [v2:172.21.15.176:6800/2704054654,v1:172.21.15.176:6801/2704054654] conn(0x7f6c1c0ae060 0x7f6c1c0b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:18.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.698+0000 7f6c2f400640 1 -- 172.21.15.18:0/3471792507 --> [v2:172.21.15.176:6800/2704054654,v1:172.21.15.176:6801/2704054654] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c1c0b0bd0 con 0x7f6c1c0ae060 2024-09-12T02:47:18.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.698+0000 7f6c2f400640 1 -- 172.21.15.18:0/3471792507 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f6c300d42a0 con 0x7f6c3810e280 2024-09-12T02:47:18.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.698+0000 7f6c2fe00640 1 --2- 172.21.15.18:0/3471792507 >> [v2:172.21.15.176:6800/2704054654,v1:172.21.15.176:6801/2704054654] conn(0x7f6c1c0ae060 0x7f6c1c0b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:18.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.699+0000 7f6c36a00640 1 --2- 172.21.15.18:0/3471792507 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f6c1c0a2c90 0x7f6c1c0a5150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6c280095f0 tx=0x7f6c28005cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:18.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.699+0000 7f6c2fe00640 1 --2- 172.21.15.18:0/3471792507 >> [v2:172.21.15.176:6800/2704054654,v1:172.21.15.176:6801/2704054654] conn(0x7f6c1c0ae060 0x7f6c1c0b0500 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:18.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.700+0000 7f6c2f400640 1 -- 172.21.15.18:0/3471792507 <== osd.2 v2:172.21.15.176:6800/2704054654 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6c1c0b0bd0 con 0x7f6c1c0ae060 2024-09-12T02:47:18.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.718+0000 7f6c37e00640 1 -- 172.21.15.18:0/3471792507 --> [v2:172.21.15.176:6800/2704054654,v1:172.21.15.176:6801/2704054654] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6c38062d80 con 0x7f6c1c0ae060 2024-09-12T02:47:18.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.719+0000 7f6c2f400640 1 -- 172.21.15.18:0/3471792507 <== osd.2 v2:172.21.15.176:6800/2704054654 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6c38062d80 con 0x7f6c1c0ae060 2024-09-12T02:47:18.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.719+0000 7f6c37e00640 1 -- 172.21.15.18:0/3471792507 >> [v2:172.21.15.176:6800/2704054654,v1:172.21.15.176:6801/2704054654] conn(0x7f6c1c0ae060 msgr2=0x7f6c1c0b0500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:18.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.719+0000 7f6c37e00640 1 --2- 172.21.15.18:0/3471792507 >> [v2:172.21.15.176:6800/2704054654,v1:172.21.15.176:6801/2704054654] conn(0x7f6c1c0ae060 0x7f6c1c0b0500 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.719+0000 7f6c37e00640 1 -- 172.21.15.18:0/3471792507 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f6c1c0a2c90 msgr2=0x7f6c1c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:18.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.719+0000 7f6c37e00640 1 --2- 172.21.15.18:0/3471792507 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f6c1c0a2c90 0x7f6c1c0a5150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6c280095f0 tx=0x7f6c28005cb0 comp rx=0 tx=0).stop 2024-09-12T02:47:18.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.719+0000 7f6c37e00640 1 -- 172.21.15.18:0/3471792507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c3810e280 msgr2=0x7f6c3819ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:18.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.719+0000 7f6c37e00640 1 --2- 172.21.15.18:0/3471792507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c3810e280 0x7f6c3819ed80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6c30005fd0 tx=0x7f6c3000ef10 comp rx=0 tx=0).stop 2024-09-12T02:47:18.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.719+0000 7f6c37400640 1 -- 172.21.15.18:0/3471792507 reap_dead start 2024-09-12T02:47:18.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.719+0000 7f6c37e00640 1 -- 172.21.15.18:0/3471792507 shutdown_connections 2024-09-12T02:47:18.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.719+0000 7f6c37e00640 1 -- 172.21.15.18:0/3471792507 >> 172.21.15.18:0/3471792507 conn(0x7f6c380fd740 msgr2=0x7f6c380feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:18.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.720+0000 7f6c37e00640 1 -- 172.21.15.18:0/3471792507 shutdown_connections 2024-09-12T02:47:18.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.720+0000 7f6c37e00640 1 -- 172.21.15.18:0/3471792507 wait complete. 2024-09-12T02:47:19.355 INFO:teuthology.orchestra.run.smithi018.stdout:219043332150 2024-09-12T02:47:19.356 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-12T02:47:19.699 INFO:teuthology.orchestra.run.smithi018.stdout:141733920840 2024-09-12T02:47:19.699 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-12T02:47:19.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.163+0000 7f29c6a00640 1 -- 172.21.15.18:0/203220072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29c0074ee0 msgr2=0x7f29c010dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.163+0000 7f29c6a00640 1 --2- 172.21.15.18:0/203220072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29c0074ee0 0x7f29c010dd20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009860 tx=0x7f29ac02a3d0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.163+0000 7f29c6a00640 1 -- 172.21.15.18:0/203220072 shutdown_connections 2024-09-12T02:47:19.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.163+0000 7f29c6a00640 1 --2- 172.21.15.18:0/203220072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29c010e260 0x7f29c0110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.163+0000 7f29c6a00640 1 --2- 172.21.15.18:0/203220072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29c0074ee0 0x7f29c010dd20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.163+0000 7f29c6a00640 1 --2- 172.21.15.18:0/203220072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c00745c0 0x7f29c00749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.163+0000 7f29c6a00640 1 -- 172.21.15.18:0/203220072 >> 172.21.15.18:0/203220072 conn(0x7f29c00fd740 msgr2=0x7f29c00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:19.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.163+0000 7f29c6a00640 1 -- 172.21.15.18:0/203220072 shutdown_connections 2024-09-12T02:47:19.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.163+0000 7f29c6a00640 1 -- 172.21.15.18:0/203220072 wait complete. 2024-09-12T02:47:19.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.164+0000 7f29c6a00640 1 Processor -- start 2024-09-12T02:47:19.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.165+0000 7f29c6a00640 1 -- start start 2024-09-12T02:47:19.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.165+0000 7f29c6a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29c00745c0 0x7f29c019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:19.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.165+0000 7f29c6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c0074ee0 0x7f29c019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:19.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.165+0000 7f29c6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29c010e260 0x7f29c019ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:19.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.165+0000 7f29c6a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f29c0114000 con 0x7f29c010e260 2024-09-12T02:47:19.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.165+0000 7f29c6a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f29c0113e80 con 0x7f29c00745c0 2024-09-12T02:47:19.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.165+0000 7f29c6a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f29c0114180 con 0x7f29c0074ee0 2024-09-12T02:47:19.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.165+0000 7f29c5600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29c00745c0 0x7f29c019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:19.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.165+0000 7f29c5600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29c00745c0 0x7f29c019a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:44658/0 (socket says 172.21.15.18:44658) 2024-09-12T02:47:19.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.165+0000 7f29c5600640 1 -- 172.21.15.18:0/385709437 learned_addr learned my addr 172.21.15.18:0/385709437 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:19.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.166+0000 7f29c4c00640 1 --2- 172.21.15.18:0/385709437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c0074ee0 0x7f29c019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:19.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.166+0000 7f29c6000640 1 --2- 172.21.15.18:0/385709437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29c010e260 0x7f29c019ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:19.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.166+0000 7f29c5600640 1 -- 172.21.15.18:0/385709437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c0074ee0 msgr2=0x7f29c019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.166+0000 7f29c5600640 1 --2- 172.21.15.18:0/385709437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c0074ee0 0x7f29c019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.166+0000 7f29c5600640 1 -- 172.21.15.18:0/385709437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29c010e260 msgr2=0x7f29c019ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.166+0000 7f29c5600640 1 --2- 172.21.15.18:0/385709437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29c010e260 0x7f29c019ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.166+0000 7f29c5600640 1 -- 172.21.15.18:0/385709437 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c019f470 con 0x7f29c00745c0 2024-09-12T02:47:19.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.166+0000 7f29c5600640 1 --2- 172.21.15.18:0/385709437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29c00745c0 0x7f29c019a4c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f29b400e9c0 tx=0x7f29b400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:19.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.166+0000 7f29be000640 1 -- 172.21.15.18:0/385709437 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b400cde0 con 0x7f29c00745c0 2024-09-12T02:47:19.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.167+0000 7f29c6a00640 1 -- 172.21.15.18:0/385709437 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c019f760 con 0x7f29c00745c0 2024-09-12T02:47:19.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.167+0000 7f29be000640 1 -- 172.21.15.18:0/385709437 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29b40035f0 con 0x7f29c00745c0 2024-09-12T02:47:19.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.167+0000 7f29be000640 1 -- 172.21.15.18:0/385709437 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b4010650 con 0x7f29c00745c0 2024-09-12T02:47:19.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.167+0000 7f29c6a00640 1 -- 172.21.15.18:0/385709437 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c01a7040 con 0x7f29c00745c0 2024-09-12T02:47:19.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.167+0000 7f29c6a00640 1 -- 172.21.15.18:0/385709437 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29c0062980 con 0x7f29c00745c0 2024-09-12T02:47:19.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.170+0000 7f29be000640 1 -- 172.21.15.18:0/385709437 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f29b40037a0 con 0x7f29c00745c0 2024-09-12T02:47:19.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.171+0000 7f29be000640 1 --2- 172.21.15.18:0/385709437 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f29a80a2c90 0x7f29a80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:19.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.171+0000 7f29be000640 1 -- 172.21.15.18:0/385709437 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f29b40cfb30 con 0x7f29c00745c0 2024-09-12T02:47:19.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.171+0000 7f29c4c00640 1 --2- 172.21.15.18:0/385709437 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f29a80a2c90 0x7f29a80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:19.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.172+0000 7f29be000640 1 --2- 172.21.15.18:0/385709437 >> [v2:172.21.15.176:6808/2234269387,v1:172.21.15.176:6809/2234269387] conn(0x7f29a80ae060 0x7f29a80b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.172+0000 7f29be000640 1 -- 172.21.15.18:0/385709437 --> [v2:172.21.15.176:6808/2234269387,v1:172.21.15.176:6809/2234269387] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29b4024ea0 con 0x7f29a80ae060 2024-09-12T02:47:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.172+0000 7f29be000640 1 -- 172.21.15.18:0/385709437 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f29b40cfee0 con 0x7f29c00745c0 2024-09-12T02:47:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.172+0000 7f29c6000640 1 --2- 172.21.15.18:0/385709437 >> [v2:172.21.15.176:6808/2234269387,v1:172.21.15.176:6809/2234269387] conn(0x7f29a80ae060 0x7f29a80b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.172+0000 7f29c4c00640 1 --2- 172.21.15.18:0/385709437 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f29a80a2c90 0x7f29a80a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f29c010f5f0 tx=0x7f29ac005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.173+0000 7f29c6000640 1 --2- 172.21.15.18:0/385709437 >> [v2:172.21.15.176:6808/2234269387,v1:172.21.15.176:6809/2234269387] conn(0x7f29a80ae060 0x7f29a80b0500 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.173+0000 7f29be000640 1 -- 172.21.15.18:0/385709437 <== osd.5 v2:172.21.15.176:6808/2234269387 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29b4024ea0 con 0x7f29a80ae060 2024-09-12T02:47:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.188+0000 7f29c6a00640 1 -- 172.21.15.18:0/385709437 --> [v2:172.21.15.176:6808/2234269387,v1:172.21.15.176:6809/2234269387] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f29c0062d80 con 0x7f29a80ae060 2024-09-12T02:47:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.189+0000 7f29be000640 1 -- 172.21.15.18:0/385709437 <== osd.5 v2:172.21.15.176:6808/2234269387 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f29c0062d80 con 0x7f29a80ae060 2024-09-12T02:47:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.189+0000 7f29c6a00640 1 -- 172.21.15.18:0/385709437 >> [v2:172.21.15.176:6808/2234269387,v1:172.21.15.176:6809/2234269387] conn(0x7f29a80ae060 msgr2=0x7f29a80b0500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.189+0000 7f29c6a00640 1 --2- 172.21.15.18:0/385709437 >> [v2:172.21.15.176:6808/2234269387,v1:172.21.15.176:6809/2234269387] conn(0x7f29a80ae060 0x7f29a80b0500 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.189+0000 7f29c6a00640 1 -- 172.21.15.18:0/385709437 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f29a80a2c90 msgr2=0x7f29a80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.189+0000 7f29c6a00640 1 --2- 172.21.15.18:0/385709437 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f29a80a2c90 0x7f29a80a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f29c010f5f0 tx=0x7f29ac005c90 comp rx=0 tx=0).stop 2024-09-12T02:47:19.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.189+0000 7f29c6a00640 1 -- 172.21.15.18:0/385709437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29c00745c0 msgr2=0x7f29c019a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:19.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.189+0000 7f29c6a00640 1 --2- 172.21.15.18:0/385709437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29c00745c0 0x7f29c019a4c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f29b400e9c0 tx=0x7f29b400ee80 comp rx=0 tx=0).stop 2024-09-12T02:47:19.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.189+0000 7f29c6000640 1 -- 172.21.15.18:0/385709437 reap_dead start 2024-09-12T02:47:19.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.189+0000 7f29c6a00640 1 -- 172.21.15.18:0/385709437 shutdown_connections 2024-09-12T02:47:19.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.189+0000 7f29c6a00640 1 -- 172.21.15.18:0/385709437 >> 172.21.15.18:0/385709437 conn(0x7f29c00fd740 msgr2=0x7f29c00fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:19.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.189+0000 7f29c6a00640 1 -- 172.21.15.18:0/385709437 shutdown_connections 2024-09-12T02:47:19.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:18.189+0000 7f29c6a00640 1 -- 172.21.15.18:0/385709437 wait complete. 2024-09-12T02:47:19.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:19 smithi176 ceph-mon[35713]: pgmap v362: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 8 op/s; 13 B/s, 0 objects/s recovering 2024-09-12T02:47:20.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:19 smithi062 ceph-mon[35527]: pgmap v362: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 8 op/s; 13 B/s, 0 objects/s recovering 2024-09-12T02:47:20.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:19 smithi018 ceph-mon[30616]: pgmap v362: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 8 op/s; 13 B/s, 0 objects/s recovering 2024-09-12T02:47:20.716 INFO:teuthology.orchestra.run.smithi018.stdout:163208757315 2024-09-12T02:47:20.717 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-12T02:47:21.069 INFO:teuthology.orchestra.run.smithi018.stdout:34359738461 2024-09-12T02:47:21.070 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-12T02:47:21.496 INFO:teuthology.orchestra.run.smithi018.stdout:304942678054 2024-09-12T02:47:21.497 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-12T02:47:21.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:21 smithi018 ceph-mon[30616]: pgmap v363: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 12 B/s, 0 objects/s recovering 2024-09-12T02:47:21.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:21 smithi176 ceph-mon[35713]: pgmap v363: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 12 B/s, 0 objects/s recovering 2024-09-12T02:47:22.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:21 smithi062 ceph-mon[35527]: pgmap v363: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 12 B/s, 0 objects/s recovering 2024-09-12T02:47:22.040 INFO:teuthology.orchestra.run.smithi018.stdout:339302416418 2024-09-12T02:47:22.041 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-12T02:47:22.578 INFO:teuthology.orchestra.run.smithi018.stdout:77309411412 2024-09-12T02:47:22.579 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-12T02:47:22.959 INFO:teuthology.orchestra.run.smithi018.stdout:55834574934 2024-09-12T02:47:22.960 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-12T02:47:22.985 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:23.123 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:23.531 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:23.541 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:23.541 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:23.541 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:23.542 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:23.548 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:23.550 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:23.781 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:23 smithi018 ceph-mon[30616]: pgmap v364: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s; 11 B/s, 0 objects/s recovering 2024-09-12T02:47:23.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.903+0000 7f94f7000640 1 -- 172.21.15.18:0/3884797890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f01049a0 msgr2=0x7f94f01089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:23.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.903+0000 7f94f7000640 1 --2- 172.21.15.18:0/3884797890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f01049a0 0x7f94f01089f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009900 tx=0x7f94d802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.904+0000 7f94f7000640 1 -- 172.21.15.18:0/3884797890 shutdown_connections 2024-09-12T02:47:23.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.904+0000 7f94f7000640 1 --2- 172.21.15.18:0/3884797890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94f0109120 0x7f94f0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.904+0000 7f94f7000640 1 --2- 172.21.15.18:0/3884797890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f01049a0 0x7f94f01089f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.904+0000 7f94f7000640 1 --2- 172.21.15.18:0/3884797890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94f0103ff0 0x7f94f01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.904+0000 7f94f7000640 1 -- 172.21.15.18:0/3884797890 >> 172.21.15.18:0/3884797890 conn(0x7f94f00ffa90 msgr2=0x7f94f0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:23.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.904+0000 7f94f7000640 1 -- 172.21.15.18:0/3884797890 shutdown_connections 2024-09-12T02:47:23.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.904+0000 7f94f7000640 1 -- 172.21.15.18:0/3884797890 wait complete. 2024-09-12T02:47:23.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.905+0000 7f94f7000640 1 Processor -- start 2024-09-12T02:47:23.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.905+0000 7f94f7000640 1 -- start start 2024-09-12T02:47:23.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.905+0000 7f94f7000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f0103ff0 0x7f94f019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:23.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.905+0000 7f94f7000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94f01049a0 0x7f94f019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:23.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.905+0000 7f94f7000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94f0109120 0x7f94f019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:23.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.905+0000 7f94f7000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f94f0114170 con 0x7f94f0103ff0 2024-09-12T02:47:23.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.905+0000 7f94f7000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f94f0113ff0 con 0x7f94f01049a0 2024-09-12T02:47:23.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.905+0000 7f94f7000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f94f01142f0 con 0x7f94f0109120 2024-09-12T02:47:23.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.905+0000 7f94efe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f0103ff0 0x7f94f019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:23.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.905+0000 7f94efe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f0103ff0 0x7f94f019a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59802/0 (socket says 172.21.15.18:59802) 2024-09-12T02:47:23.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.905+0000 7f94efe00640 1 -- 172.21.15.18:0/2296130936 learned_addr learned my addr 172.21.15.18:0/2296130936 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:23.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.905+0000 7f94e7e00640 1 --2- 172.21.15.18:0/2296130936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94f01049a0 0x7f94f019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:23.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.906+0000 7f94f5000640 1 --2- 172.21.15.18:0/2296130936 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94f0109120 0x7f94f019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:23.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.906+0000 7f94efe00640 1 -- 172.21.15.18:0/2296130936 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94f0109120 msgr2=0x7f94f019ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:23.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.906+0000 7f94efe00640 1 --2- 172.21.15.18:0/2296130936 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94f0109120 0x7f94f019ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.906+0000 7f94efe00640 1 -- 172.21.15.18:0/2296130936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94f01049a0 msgr2=0x7f94f019ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:23.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.906+0000 7f94efe00640 1 --2- 172.21.15.18:0/2296130936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94f01049a0 0x7f94f019ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:23.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.906+0000 7f94efe00640 1 -- 172.21.15.18:0/2296130936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f019f5e0 con 0x7f94f0103ff0 2024-09-12T02:47:23.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.906+0000 7f94efe00640 1 --2- 172.21.15.18:0/2296130936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f0103ff0 0x7f94f019a630 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94e000e9f0 tx=0x7f94e000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:23.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.906+0000 7f94ed600640 1 -- 172.21.15.18:0/2296130936 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e000cd80 con 0x7f94f0103ff0 2024-09-12T02:47:23.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.906+0000 7f94f7000640 1 -- 172.21.15.18:0/2296130936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f019f8d0 con 0x7f94f0103ff0 2024-09-12T02:47:23.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.906+0000 7f94ed600640 1 -- 172.21.15.18:0/2296130936 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94e0010910 con 0x7f94f0103ff0 2024-09-12T02:47:23.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.906+0000 7f94ed600640 1 -- 172.21.15.18:0/2296130936 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0018990 con 0x7f94f0103ff0 2024-09-12T02:47:23.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.907+0000 7f94f7000640 1 -- 172.21.15.18:0/2296130936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f01a71b0 con 0x7f94f0103ff0 2024-09-12T02:47:23.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.908+0000 7f94f7000640 1 -- 172.21.15.18:0/2296130936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f01043d0 con 0x7f94f0103ff0 2024-09-12T02:47:23.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.910+0000 7f94ed600640 1 -- 172.21.15.18:0/2296130936 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f94e0010ac0 con 0x7f94f0103ff0 2024-09-12T02:47:23.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.912+0000 7f94ed600640 1 --2- 172.21.15.18:0/2296130936 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f94d40a2c10 0x7f94d40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:23.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.912+0000 7f94ed600640 1 -- 172.21.15.18:0/2296130936 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f94e00cf9a0 con 0x7f94f0103ff0 2024-09-12T02:47:23.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.912+0000 7f94e7e00640 1 --2- 172.21.15.18:0/2296130936 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f94d40a2c10 0x7f94d40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:23.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.913+0000 7f94e7e00640 1 --2- 172.21.15.18:0/2296130936 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f94d40a2c10 0x7f94d40a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f94d8000c00 tx=0x7f94d8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:23.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:23.918+0000 7f94ed600640 1 -- 172.21.15.18:0/2296130936 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f94e009c390 con 0x7f94f0103ff0 2024-09-12T02:47:23.931 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:23.931 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:23.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:23 smithi176 ceph-mon[35713]: pgmap v364: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s; 11 B/s, 0 objects/s recovering 2024-09-12T02:47:24.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:23 smithi062 ceph-mon[35527]: pgmap v364: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s; 11 B/s, 0 objects/s recovering 2024-09-12T02:47:24.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.134+0000 7f94f7000640 1 -- 172.21.15.18:0/2296130936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f94f010bdd0 con 0x7f94f0103ff0 2024-09-12T02:47:24.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.134+0000 7f94ed600640 1 -- 172.21.15.18:0/2296130936 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f94e009bc90 con 0x7f94f0103ff0 2024-09-12T02:47:24.136 INFO:teuthology.orchestra.run.smithi018.stdout:107374182479 2024-09-12T02:47:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.136+0000 7f94f7000640 1 -- 172.21.15.18:0/2296130936 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f94d40a2c10 msgr2=0x7f94d40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.136+0000 7f94f7000640 1 --2- 172.21.15.18:0/2296130936 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f94d40a2c10 0x7f94d40a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f94d8000c00 tx=0x7f94d8005b50 comp rx=0 tx=0).stop 2024-09-12T02:47:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.136+0000 7f94f7000640 1 -- 172.21.15.18:0/2296130936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f0103ff0 msgr2=0x7f94f019a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.136+0000 7f94f7000640 1 --2- 172.21.15.18:0/2296130936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f0103ff0 0x7f94f019a630 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94e000e9f0 tx=0x7f94e000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.137+0000 7f94f7000640 1 -- 172.21.15.18:0/2296130936 shutdown_connections 2024-09-12T02:47:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.137+0000 7f94f7000640 1 --2- 172.21.15.18:0/2296130936 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f94d40a2c10 0x7f94d40a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.137+0000 7f94f7000640 1 --2- 172.21.15.18:0/2296130936 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94f0109120 0x7f94f019ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.137+0000 7f94f7000640 1 --2- 172.21.15.18:0/2296130936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94f01049a0 0x7f94f019ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.137+0000 7f94f7000640 1 --2- 172.21.15.18:0/2296130936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f0103ff0 0x7f94f019a630 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.137+0000 7f94f7000640 1 -- 172.21.15.18:0/2296130936 >> 172.21.15.18:0/2296130936 conn(0x7f94f00ffa90 msgr2=0x7f94f0100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.137+0000 7f94f7000640 1 -- 172.21.15.18:0/2296130936 shutdown_connections 2024-09-12T02:47:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.137+0000 7f94f7000640 1 -- 172.21.15.18:0/2296130936 wait complete. 2024-09-12T02:47:24.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:24 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2296130936' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:47:24.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:24 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2296130936' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:47:25.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:24 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2296130936' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:47:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.814+0000 7f9d40e00640 1 -- 172.21.15.18:0/94857609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d3c1049a0 msgr2=0x7f9d3c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.814+0000 7f9d40e00640 1 --2- 172.21.15.18:0/94857609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d3c1049a0 0x7f9d3c1089f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009860 tx=0x7f9d2802a340 comp rx=0 tx=0).stop 2024-09-12T02:47:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.814+0000 7f9d40e00640 1 -- 172.21.15.18:0/94857609 shutdown_connections 2024-09-12T02:47:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.814+0000 7f9d40e00640 1 --2- 172.21.15.18:0/94857609 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d3c109120 0x7f9d3c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.814+0000 7f9d40e00640 1 --2- 172.21.15.18:0/94857609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d3c1049a0 0x7f9d3c1089f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.814+0000 7f9d40e00640 1 --2- 172.21.15.18:0/94857609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3c103ff0 0x7f9d3c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.814+0000 7f9d40e00640 1 -- 172.21.15.18:0/94857609 >> 172.21.15.18:0/94857609 conn(0x7f9d3c0ffa90 msgr2=0x7f9d3c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.814+0000 7f9d40e00640 1 -- 172.21.15.18:0/94857609 shutdown_connections 2024-09-12T02:47:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.814+0000 7f9d40e00640 1 -- 172.21.15.18:0/94857609 wait complete. 2024-09-12T02:47:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.815+0000 7f9d40e00640 1 Processor -- start 2024-09-12T02:47:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.815+0000 7f9d40e00640 1 -- start start 2024-09-12T02:47:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.815+0000 7f9d40e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d3c103ff0 0x7f9d3c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.815+0000 7f9d40e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3c1049a0 0x7f9d3c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.816+0000 7f9d40e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d3c109120 0x7f9d3c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.816+0000 7f9d40e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c114140 con 0x7f9d3c1049a0 2024-09-12T02:47:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.816+0000 7f9d40e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c113fc0 con 0x7f9d3c103ff0 2024-09-12T02:47:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.816+0000 7f9d40e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c1142c0 con 0x7f9d3c109120 2024-09-12T02:47:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.816+0000 7f9d39400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3c1049a0 0x7f9d3c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.816+0000 7f9d39e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d3c103ff0 0x7f9d3c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.816+0000 7f9d39400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3c1049a0 0x7f9d3c19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36642/0 (socket says 172.21.15.18:36642) 2024-09-12T02:47:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.816+0000 7f9d39400640 1 -- 172.21.15.18:0/3650474908 learned_addr learned my addr 172.21.15.18:0/3650474908 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.816+0000 7f9d3a800640 1 --2- 172.21.15.18:0/3650474908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d3c109120 0x7f9d3c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.816+0000 7f9d39400640 1 -- 172.21.15.18:0/3650474908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d3c109120 msgr2=0x7f9d3c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.816+0000 7f9d39400640 1 --2- 172.21.15.18:0/3650474908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d3c109120 0x7f9d3c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.816+0000 7f9d39400640 1 -- 172.21.15.18:0/3650474908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d3c103ff0 msgr2=0x7f9d3c19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.816+0000 7f9d39400640 1 --2- 172.21.15.18:0/3650474908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d3c103ff0 0x7f9d3c19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.816+0000 7f9d39400640 1 -- 172.21.15.18:0/3650474908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d3c19f5d0 con 0x7f9d3c1049a0 2024-09-12T02:47:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.816+0000 7f9d39e00640 1 --2- 172.21.15.18:0/3650474908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d3c103ff0 0x7f9d3c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.817+0000 7f9d39400640 1 --2- 172.21.15.18:0/3650474908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3c1049a0 0x7f9d3c19ab60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9d28035040 tx=0x7f9d28033b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.817+0000 7f9d32a00640 1 -- 172.21.15.18:0/3650474908 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d28037040 con 0x7f9d3c1049a0 2024-09-12T02:47:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.817+0000 7f9d32a00640 1 -- 172.21.15.18:0/3650474908 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d28040070 con 0x7f9d3c1049a0 2024-09-12T02:47:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.817+0000 7f9d32a00640 1 -- 172.21.15.18:0/3650474908 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d280039b0 con 0x7f9d3c1049a0 2024-09-12T02:47:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.817+0000 7f9d40e00640 1 -- 172.21.15.18:0/3650474908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d3c19f860 con 0x7f9d3c1049a0 2024-09-12T02:47:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.817+0000 7f9d40e00640 1 -- 172.21.15.18:0/3650474908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d3c1a71a0 con 0x7f9d3c1049a0 2024-09-12T02:47:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.818+0000 7f9d40e00640 1 -- 172.21.15.18:0/3650474908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d3c1054d0 con 0x7f9d3c1049a0 2024-09-12T02:47:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.821+0000 7f9d32a00640 1 -- 172.21.15.18:0/3650474908 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9d280305e0 con 0x7f9d3c1049a0 2024-09-12T02:47:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.824+0000 7f9d32a00640 1 --2- 172.21.15.18:0/3650474908 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9d200a2c10 0x7f9d200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.824+0000 7f9d32a00640 1 -- 172.21.15.18:0/3650474908 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f9d280efab0 con 0x7f9d3c1049a0 2024-09-12T02:47:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.824+0000 7f9d39e00640 1 --2- 172.21.15.18:0/3650474908 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9d200a2c10 0x7f9d200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.825+0000 7f9d39e00640 1 --2- 172.21.15.18:0/3650474908 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9d200a2c10 0x7f9d200a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c005fd0 tx=0x7f9d2c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.826+0000 7f9d32a00640 1 -- 172.21.15.18:0/3650474908 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9d280bc5b0 con 0x7f9d3c1049a0 2024-09-12T02:47:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:25.019+0000 7f9d40e00640 1 -- 172.21.15.18:0/3650474908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9d3c10c360 con 0x7f9d3c1049a0 2024-09-12T02:47:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:25.019+0000 7f9d32a00640 1 -- 172.21.15.18:0/3650474908 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9d280bbeb0 con 0x7f9d3c1049a0 2024-09-12T02:47:25.356 INFO:teuthology.orchestra.run.smithi018.stdout:197568495678 2024-09-12T02:47:25.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:25.021+0000 7f9d40e00640 1 -- 172.21.15.18:0/3650474908 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9d200a2c10 msgr2=0x7f9d200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:25.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:25.021+0000 7f9d40e00640 1 --2- 172.21.15.18:0/3650474908 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9d200a2c10 0x7f9d200a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c005fd0 tx=0x7f9d2c009260 comp rx=0 tx=0).stop 2024-09-12T02:47:25.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:25.021+0000 7f9d40e00640 1 -- 172.21.15.18:0/3650474908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3c1049a0 msgr2=0x7f9d3c19ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:25.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:25.021+0000 7f9d40e00640 1 --2- 172.21.15.18:0/3650474908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3c1049a0 0x7f9d3c19ab60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9d28035040 tx=0x7f9d28033b60 comp rx=0 tx=0).stop 2024-09-12T02:47:25.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:25.022+0000 7f9d40e00640 1 -- 172.21.15.18:0/3650474908 shutdown_connections 2024-09-12T02:47:25.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:25.022+0000 7f9d40e00640 1 --2- 172.21.15.18:0/3650474908 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9d200a2c10 0x7f9d200a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:25.022+0000 7f9d40e00640 1 --2- 172.21.15.18:0/3650474908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d3c109120 0x7f9d3c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:25.022+0000 7f9d40e00640 1 --2- 172.21.15.18:0/3650474908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3c1049a0 0x7f9d3c19ab60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:25.022+0000 7f9d40e00640 1 --2- 172.21.15.18:0/3650474908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d3c103ff0 0x7f9d3c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:25.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:25.022+0000 7f9d40e00640 1 -- 172.21.15.18:0/3650474908 >> 172.21.15.18:0/3650474908 conn(0x7f9d3c0ffa90 msgr2=0x7f9d3c100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:25.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:25.022+0000 7f9d40e00640 1 -- 172.21.15.18:0/3650474908 shutdown_connections 2024-09-12T02:47:25.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:25.022+0000 7f9d40e00640 1 -- 172.21.15.18:0/3650474908 wait complete. 2024-09-12T02:47:25.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:25 smithi018 ceph-mon[30616]: pgmap v365: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2024-09-12T02:47:25.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:25 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2637138555' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:47:25.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:25 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3650474908' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:47:25.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:25 smithi176 ceph-mon[35713]: pgmap v365: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2024-09-12T02:47:25.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:25 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2637138555' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:47:25.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:25 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3650474908' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:47:26.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:25 smithi062 ceph-mon[35527]: pgmap v365: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2024-09-12T02:47:26.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:25 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2637138555' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:47:26.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:25 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3650474908' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:47:26.566 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182476 got 107374182479 for osd.3 2024-09-12T02:47:26.566 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:26.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.709+0000 7fdbd3e00640 1 -- 172.21.15.18:0/4125061549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbcc109100 msgr2=0x7fdbcc110c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:26.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.709+0000 7fdbd3e00640 1 --2- 172.21.15.18:0/4125061549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbcc109100 0x7fdbcc110c80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4009ca0 tx=0x7fdbc402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.709+0000 7fdbd3e00640 1 -- 172.21.15.18:0/4125061549 shutdown_connections 2024-09-12T02:47:26.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.709+0000 7fdbd3e00640 1 --2- 172.21.15.18:0/4125061549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbcc109100 0x7fdbcc110c80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.709+0000 7fdbd3e00640 1 --2- 172.21.15.18:0/4125061549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdbcc104980 0x7fdbcc1089d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.709+0000 7fdbd3e00640 1 --2- 172.21.15.18:0/4125061549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbcc103fd0 0x7fdbcc1043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.709+0000 7fdbd3e00640 1 -- 172.21.15.18:0/4125061549 >> 172.21.15.18:0/4125061549 conn(0x7fdbcc0ffa30 msgr2=0x7fdbcc101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:26.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.710+0000 7fdbd3e00640 1 -- 172.21.15.18:0/4125061549 shutdown_connections 2024-09-12T02:47:26.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.710+0000 7fdbd3e00640 1 -- 172.21.15.18:0/4125061549 wait complete. 2024-09-12T02:47:26.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.711+0000 7fdbd3e00640 1 Processor -- start 2024-09-12T02:47:26.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.711+0000 7fdbd3e00640 1 -- start start 2024-09-12T02:47:26.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.711+0000 7fdbd3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdbcc103fd0 0x7fdbcc19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:26.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.711+0000 7fdbd3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbcc104980 0x7fdbcc19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:26.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.711+0000 7fdbd3e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbcc109100 0x7fdbcc19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:26.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.711+0000 7fdbd3e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc114130 con 0x7fdbcc103fd0 2024-09-12T02:47:26.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.711+0000 7fdbd3e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc113fb0 con 0x7fdbcc104980 2024-09-12T02:47:26.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.711+0000 7fdbd3e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc1142b0 con 0x7fdbcc109100 2024-09-12T02:47:26.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.711+0000 7fdbd1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdbcc103fd0 0x7fdbcc19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:26.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.711+0000 7fdbd1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdbcc103fd0 0x7fdbcc19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59818/0 (socket says 172.21.15.18:59818) 2024-09-12T02:47:26.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.711+0000 7fdbd1400640 1 -- 172.21.15.18:0/2637138555 learned_addr learned my addr 172.21.15.18:0/2637138555 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:26.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.711+0000 7fdbd0a00640 1 --2- 172.21.15.18:0/2637138555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbcc104980 0x7fdbcc19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:26.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.712+0000 7fdbd1e00640 1 --2- 172.21.15.18:0/2637138555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbcc109100 0x7fdbcc19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:26.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.712+0000 7fdbd1400640 1 -- 172.21.15.18:0/2637138555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbcc109100 msgr2=0x7fdbcc19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:26.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.712+0000 7fdbd1400640 1 --2- 172.21.15.18:0/2637138555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbcc109100 0x7fdbcc19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.712+0000 7fdbd1400640 1 -- 172.21.15.18:0/2637138555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbcc104980 msgr2=0x7fdbcc19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:26.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.712+0000 7fdbd1400640 1 --2- 172.21.15.18:0/2637138555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbcc104980 0x7fdbcc19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.712+0000 7fdbd1400640 1 -- 172.21.15.18:0/2637138555 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbcc19f5e0 con 0x7fdbcc103fd0 2024-09-12T02:47:26.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.712+0000 7fdbd1400640 1 --2- 172.21.15.18:0/2637138555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdbcc103fd0 0x7fdbcc19a630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000e9f0 tx=0x7fdbc000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:26.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.712+0000 7fdbca000640 1 -- 172.21.15.18:0/2637138555 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc000cd80 con 0x7fdbcc103fd0 2024-09-12T02:47:26.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.712+0000 7fdbd3e00640 1 -- 172.21.15.18:0/2637138555 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbcc19f8d0 con 0x7fdbcc103fd0 2024-09-12T02:47:26.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.712+0000 7fdbca000640 1 -- 172.21.15.18:0/2637138555 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbc0005500 con 0x7fdbcc103fd0 2024-09-12T02:47:26.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.712+0000 7fdbca000640 1 -- 172.21.15.18:0/2637138555 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0010690 con 0x7fdbcc103fd0 2024-09-12T02:47:26.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.713+0000 7fdbd3e00640 1 -- 172.21.15.18:0/2637138555 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbcc1a71b0 con 0x7fdbcc103fd0 2024-09-12T02:47:26.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.714+0000 7fdbd3e00640 1 -- 172.21.15.18:0/2637138555 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbcc1043b0 con 0x7fdbcc103fd0 2024-09-12T02:47:26.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.716+0000 7fdbca000640 1 -- 172.21.15.18:0/2637138555 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdbc00046c0 con 0x7fdbcc103fd0 2024-09-12T02:47:26.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.718+0000 7fdbca000640 1 --2- 172.21.15.18:0/2637138555 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fdbb40a2c10 0x7fdbb40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:26.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.718+0000 7fdbca000640 1 -- 172.21.15.18:0/2637138555 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7fdbc00cfca0 con 0x7fdbcc103fd0 2024-09-12T02:47:26.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.719+0000 7fdbd0a00640 1 --2- 172.21.15.18:0/2637138555 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fdbb40a2c10 0x7fdbb40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:26.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.719+0000 7fdbd0a00640 1 --2- 172.21.15.18:0/2637138555 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fdbb40a2c10 0x7fdbb40a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0ffec0 tx=0x7fdbb8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:26.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.721+0000 7fdbca000640 1 -- 172.21.15.18:0/2637138555 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdbc00541b0 con 0x7fdbcc103fd0 2024-09-12T02:47:26.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.916+0000 7fdbd3e00640 1 -- 172.21.15.18:0/2637138555 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fdbcc19b990 con 0x7fdbcc103fd0 2024-09-12T02:47:26.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.917+0000 7fdbca000640 1 -- 172.21.15.18:0/2637138555 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdbc009c690 con 0x7fdbcc103fd0 2024-09-12T02:47:26.683 INFO:teuthology.orchestra.run.smithi018.stdout:141733920842 2024-09-12T02:47:26.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.919+0000 7fdbd3e00640 1 -- 172.21.15.18:0/2637138555 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fdbb40a2c10 msgr2=0x7fdbb40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:26.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.919+0000 7fdbd3e00640 1 --2- 172.21.15.18:0/2637138555 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fdbb40a2c10 0x7fdbb40a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0ffec0 tx=0x7fdbb8005f90 comp rx=0 tx=0).stop 2024-09-12T02:47:26.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.919+0000 7fdbd3e00640 1 -- 172.21.15.18:0/2637138555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdbcc103fd0 msgr2=0x7fdbcc19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:26.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.919+0000 7fdbd3e00640 1 --2- 172.21.15.18:0/2637138555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdbcc103fd0 0x7fdbcc19a630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000e9f0 tx=0x7fdbc000edf0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.919+0000 7fdbd3e00640 1 -- 172.21.15.18:0/2637138555 shutdown_connections 2024-09-12T02:47:26.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.919+0000 7fdbd3e00640 1 --2- 172.21.15.18:0/2637138555 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fdbb40a2c10 0x7fdbb40a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.919+0000 7fdbd3e00640 1 --2- 172.21.15.18:0/2637138555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbcc109100 0x7fdbcc19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.919+0000 7fdbd3e00640 1 --2- 172.21.15.18:0/2637138555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbcc104980 0x7fdbcc19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.919+0000 7fdbd3e00640 1 --2- 172.21.15.18:0/2637138555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdbcc103fd0 0x7fdbcc19a630 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:26.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.919+0000 7fdbd3e00640 1 -- 172.21.15.18:0/2637138555 >> 172.21.15.18:0/2637138555 conn(0x7fdbcc0ffa30 msgr2=0x7fdbcc100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:26.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.919+0000 7fdbd3e00640 1 -- 172.21.15.18:0/2637138555 shutdown_connections 2024-09-12T02:47:26.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:24.919+0000 7fdbd3e00640 1 -- 172.21.15.18:0/2637138555 wait complete. 2024-09-12T02:47:26.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:26 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3201161799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:47:26.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:26 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3201161799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:47:27.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:26 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3201161799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:47:27.806 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:27 smithi018 ceph-mon[30616]: pgmap v366: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-12T02:47:27.850 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920840 got 141733920842 for osd.4 2024-09-12T02:47:27.851 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:27.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:27 smithi176 ceph-mon[35713]: pgmap v366: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-12T02:47:28.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:27 smithi062 ceph-mon[35527]: pgmap v366: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-12T02:47:28.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.343+0000 7fb09a800640 1 -- 172.21.15.18:0/469617627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb094108f60 msgr2=0x7fb094110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.343+0000 7fb09a800640 1 --2- 172.21.15.18:0/469617627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb094108f60 0x7fb094110ae0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009be0 tx=0x7fb08c02a6c0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.343+0000 7fb09a800640 1 -- 172.21.15.18:0/469617627 shutdown_connections 2024-09-12T02:47:28.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.343+0000 7fb09a800640 1 --2- 172.21.15.18:0/469617627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb094108f60 0x7fb094110ae0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.343+0000 7fb09a800640 1 --2- 172.21.15.18:0/469617627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0941047e0 0x7fb094108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.343+0000 7fb09a800640 1 --2- 172.21.15.18:0/469617627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb094103e30 0x7fb094104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.343+0000 7fb09a800640 1 -- 172.21.15.18:0/469617627 >> 172.21.15.18:0/469617627 conn(0x7fb0940ff910 msgr2=0x7fb094101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:28.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.343+0000 7fb09a800640 1 -- 172.21.15.18:0/469617627 shutdown_connections 2024-09-12T02:47:28.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.343+0000 7fb09a800640 1 -- 172.21.15.18:0/469617627 wait complete. 2024-09-12T02:47:28.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.345+0000 7fb09a800640 1 Processor -- start 2024-09-12T02:47:28.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.345+0000 7fb09a800640 1 -- start start 2024-09-12T02:47:28.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.345+0000 7fb09a800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb094103e30 0x7fb09419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.345+0000 7fb09a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0941047e0 0x7fb09419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.345+0000 7fb09a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb094108f60 0x7fb09419ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.345+0000 7fb09a800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb094113fc0 con 0x7fb094108f60 2024-09-12T02:47:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.345+0000 7fb09a800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb094113e40 con 0x7fb0941047e0 2024-09-12T02:47:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.345+0000 7fb09a800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb094114140 con 0x7fb094103e30 2024-09-12T02:47:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.345+0000 7fb098a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0941047e0 0x7fb09419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.345+0000 7fb099e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb094108f60 0x7fb09419ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.345+0000 7fb098a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0941047e0 0x7fb09419a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:42640/0 (socket says 172.21.15.18:42640) 2024-09-12T02:47:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.345+0000 7fb098a00640 1 -- 172.21.15.18:0/3965524604 learned_addr learned my addr 172.21.15.18:0/3965524604 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.346+0000 7fb099400640 1 --2- 172.21.15.18:0/3965524604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb094103e30 0x7fb09419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.346+0000 7fb098a00640 1 -- 172.21.15.18:0/3965524604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb094103e30 msgr2=0x7fb09419a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.346+0000 7fb098a00640 1 --2- 172.21.15.18:0/3965524604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb094103e30 0x7fb09419a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.346+0000 7fb098a00640 1 -- 172.21.15.18:0/3965524604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb094108f60 msgr2=0x7fb09419ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.346+0000 7fb098a00640 1 --2- 172.21.15.18:0/3965524604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb094108f60 0x7fb09419ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.346+0000 7fb098a00640 1 -- 172.21.15.18:0/3965524604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb09419f3b0 con 0x7fb0941047e0 2024-09-12T02:47:28.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.346+0000 7fb099e00640 1 --2- 172.21.15.18:0/3965524604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb094108f60 0x7fb09419ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:28.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.346+0000 7fb098a00640 1 --2- 172.21.15.18:0/3965524604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0941047e0 0x7fb09419a940 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb08000e9f0 tx=0x7fb08000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:28.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.346+0000 7fb092000640 1 -- 172.21.15.18:0/3965524604 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08000cd80 con 0x7fb0941047e0 2024-09-12T02:47:28.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.347+0000 7fb092000640 1 -- 172.21.15.18:0/3965524604 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb080005500 con 0x7fb0941047e0 2024-09-12T02:47:28.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.347+0000 7fb092000640 1 -- 172.21.15.18:0/3965524604 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080010690 con 0x7fb0941047e0 2024-09-12T02:47:28.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.347+0000 7fb09a800640 1 -- 172.21.15.18:0/3965524604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb09419f6a0 con 0x7fb0941047e0 2024-09-12T02:47:28.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.347+0000 7fb09a800640 1 -- 172.21.15.18:0/3965524604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0941a6f80 con 0x7fb0941047e0 2024-09-12T02:47:28.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.348+0000 7fb09a800640 1 -- 172.21.15.18:0/3965524604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb094105310 con 0x7fb0941047e0 2024-09-12T02:47:28.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.350+0000 7fb092000640 1 -- 172.21.15.18:0/3965524604 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb0800046c0 con 0x7fb0941047e0 2024-09-12T02:47:28.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.351+0000 7fb092000640 1 --2- 172.21.15.18:0/3965524604 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb07c0a2c10 0x7fb07c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.351+0000 7fb092000640 1 -- 172.21.15.18:0/3965524604 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7fb0800cf980 con 0x7fb0941047e0 2024-09-12T02:47:28.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.351+0000 7fb099400640 1 --2- 172.21.15.18:0/3965524604 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb07c0a2c10 0x7fb07c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.352+0000 7fb099400640 1 --2- 172.21.15.18:0/3965524604 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb07c0a2c10 0x7fb07c0a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb088009530 tx=0x7fb088009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:28.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.355+0000 7fb092000640 1 -- 172.21.15.18:0/3965524604 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb08009c370 con 0x7fb0941047e0 2024-09-12T02:47:28.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.555+0000 7fb09a800640 1 -- 172.21.15.18:0/3965524604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fb09410bbb0 con 0x7fb0941047e0 2024-09-12T02:47:28.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.556+0000 7fb092000640 1 -- 172.21.15.18:0/3965524604 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fb08009bc70 con 0x7fb0941047e0 2024-09-12T02:47:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:339302416420 2024-09-12T02:47:28.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.558+0000 7fb09a800640 1 -- 172.21.15.18:0/3965524604 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb07c0a2c10 msgr2=0x7fb07c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.558+0000 7fb09a800640 1 --2- 172.21.15.18:0/3965524604 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb07c0a2c10 0x7fb07c0a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb088009530 tx=0x7fb088009260 comp rx=0 tx=0).stop 2024-09-12T02:47:28.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.558+0000 7fb09a800640 1 -- 172.21.15.18:0/3965524604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0941047e0 msgr2=0x7fb09419a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.558+0000 7fb09a800640 1 --2- 172.21.15.18:0/3965524604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0941047e0 0x7fb09419a940 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb08000e9f0 tx=0x7fb08000edf0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.558+0000 7fb09a800640 1 -- 172.21.15.18:0/3965524604 shutdown_connections 2024-09-12T02:47:28.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.558+0000 7fb09a800640 1 --2- 172.21.15.18:0/3965524604 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb07c0a2c10 0x7fb07c0a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.558+0000 7fb09a800640 1 --2- 172.21.15.18:0/3965524604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb094108f60 0x7fb09419ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.558+0000 7fb09a800640 1 --2- 172.21.15.18:0/3965524604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0941047e0 0x7fb09419a940 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.558+0000 7fb09a800640 1 --2- 172.21.15.18:0/3965524604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb094103e30 0x7fb09419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.558+0000 7fb09a800640 1 -- 172.21.15.18:0/3965524604 >> 172.21.15.18:0/3965524604 conn(0x7fb0940ff910 msgr2=0x7fb094100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:28.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.559+0000 7fb09a800640 1 -- 172.21.15.18:0/3965524604 shutdown_connections 2024-09-12T02:47:28.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:28.559+0000 7fb09a800640 1 -- 172.21.15.18:0/3965524604 wait complete. 2024-09-12T02:47:28.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.545+0000 7fe666000640 1 -- 172.21.15.18:0/2073305460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe660104010 msgr2=0x7fe6601043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.545+0000 7fe666000640 1 --2- 172.21.15.18:0/2073305460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe660104010 0x7fe6601043f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe650009900 tx=0x7fe65002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.545+0000 7fe666000640 1 -- 172.21.15.18:0/2073305460 shutdown_connections 2024-09-12T02:47:28.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.545+0000 7fe666000640 1 --2- 172.21.15.18:0/2073305460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe660109140 0x7fe660110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.545+0000 7fe666000640 1 --2- 172.21.15.18:0/2073305460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6601049c0 0x7fe660108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.545+0000 7fe666000640 1 --2- 172.21.15.18:0/2073305460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe660104010 0x7fe6601043f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.545+0000 7fe666000640 1 -- 172.21.15.18:0/2073305460 >> 172.21.15.18:0/2073305460 conn(0x7fe6600ffa50 msgr2=0x7fe660101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:28.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.545+0000 7fe666000640 1 -- 172.21.15.18:0/2073305460 shutdown_connections 2024-09-12T02:47:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.545+0000 7fe666000640 1 -- 172.21.15.18:0/2073305460 wait complete. 2024-09-12T02:47:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.546+0000 7fe666000640 1 Processor -- start 2024-09-12T02:47:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.546+0000 7fe666000640 1 -- start start 2024-09-12T02:47:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.546+0000 7fe666000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe660104010 0x7fe66019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.546+0000 7fe666000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6601049c0 0x7fe66019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.546+0000 7fe666000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe660109140 0x7fe66019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.546+0000 7fe666000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe6601141c0 con 0x7fe6601049c0 2024-09-12T02:47:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.546+0000 7fe666000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe660114040 con 0x7fe660109140 2024-09-12T02:47:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.546+0000 7fe666000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe660114340 con 0x7fe660104010 2024-09-12T02:47:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.547+0000 7fe656a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6601049c0 0x7fe66019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.547+0000 7fe65f400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe660104010 0x7fe66019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.547+0000 7fe65f400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe660104010 0x7fe66019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:39646/0 (socket says 172.21.15.18:39646) 2024-09-12T02:47:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.547+0000 7fe65f400640 1 -- 172.21.15.18:0/1766915873 learned_addr learned my addr 172.21.15.18:0/1766915873 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.547+0000 7fe65fe00640 1 --2- 172.21.15.18:0/1766915873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe660109140 0x7fe66019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.547+0000 7fe65f400640 1 -- 172.21.15.18:0/1766915873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe660109140 msgr2=0x7fe66019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.547+0000 7fe65f400640 1 --2- 172.21.15.18:0/1766915873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe660109140 0x7fe66019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.547+0000 7fe65f400640 1 -- 172.21.15.18:0/1766915873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6601049c0 msgr2=0x7fe66019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.547+0000 7fe65f400640 1 --2- 172.21.15.18:0/1766915873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6601049c0 0x7fe66019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.547+0000 7fe65f400640 1 -- 172.21.15.18:0/1766915873 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66019f5d0 con 0x7fe660104010 2024-09-12T02:47:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.548+0000 7fe65f400640 1 --2- 172.21.15.18:0/1766915873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe660104010 0x7fe66019a620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe650004770 tx=0x7fe650003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.548+0000 7fe65cc00640 1 -- 172.21.15.18:0/1766915873 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65003f070 con 0x7fe660104010 2024-09-12T02:47:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.548+0000 7fe666000640 1 -- 172.21.15.18:0/1766915873 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe66019f860 con 0x7fe660104010 2024-09-12T02:47:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.548+0000 7fe65cc00640 1 -- 172.21.15.18:0/1766915873 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe650031ca0 con 0x7fe660104010 2024-09-12T02:47:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.548+0000 7fe65cc00640 1 -- 172.21.15.18:0/1766915873 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650035030 con 0x7fe660104010 2024-09-12T02:47:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.548+0000 7fe666000640 1 -- 172.21.15.18:0/1766915873 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6601a71a0 con 0x7fe660104010 2024-09-12T02:47:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.549+0000 7fe666000640 1 -- 172.21.15.18:0/1766915873 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6601043f0 con 0x7fe660104010 2024-09-12T02:47:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.551+0000 7fe65cc00640 1 -- 172.21.15.18:0/1766915873 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe650042070 con 0x7fe660104010 2024-09-12T02:47:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.552+0000 7fe65cc00640 1 --2- 172.21.15.18:0/1766915873 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe6440a2c10 0x7fe6440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.552+0000 7fe65cc00640 1 -- 172.21.15.18:0/1766915873 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7fe6500f0160 con 0x7fe660104010 2024-09-12T02:47:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.553+0000 7fe656a00640 1 --2- 172.21.15.18:0/1766915873 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe6440a2c10 0x7fe6440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.553+0000 7fe656a00640 1 --2- 172.21.15.18:0/1766915873 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe6440a2c10 0x7fe6440a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe6600ffe70 tx=0x7fe648005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:28.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.555+0000 7fe65cc00640 1 -- 172.21.15.18:0/1766915873 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe6500bc5c0 con 0x7fe660104010 2024-09-12T02:47:28.585 INFO:teuthology.orchestra.run.smithi018.stdout:219043332153 2024-09-12T02:47:28.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.749+0000 7fe666000640 1 -- 172.21.15.18:0/1766915873 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe66010c320 con 0x7fe660104010 2024-09-12T02:47:28.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.750+0000 7fe65cc00640 1 -- 172.21.15.18:0/1766915873 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe6500c08c0 con 0x7fe660104010 2024-09-12T02:47:28.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.752+0000 7fe666000640 1 -- 172.21.15.18:0/1766915873 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe6440a2c10 msgr2=0x7fe6440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.752+0000 7fe666000640 1 --2- 172.21.15.18:0/1766915873 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe6440a2c10 0x7fe6440a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe6600ffe70 tx=0x7fe648005f90 comp rx=0 tx=0).stop 2024-09-12T02:47:28.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.752+0000 7fe666000640 1 -- 172.21.15.18:0/1766915873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe660104010 msgr2=0x7fe66019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:28.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.752+0000 7fe666000640 1 --2- 172.21.15.18:0/1766915873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe660104010 0x7fe66019a620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe650004770 tx=0x7fe650003c10 comp rx=0 tx=0).stop 2024-09-12T02:47:28.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.753+0000 7fe666000640 1 -- 172.21.15.18:0/1766915873 shutdown_connections 2024-09-12T02:47:28.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.753+0000 7fe666000640 1 --2- 172.21.15.18:0/1766915873 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe6440a2c10 0x7fe6440a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.753+0000 7fe666000640 1 --2- 172.21.15.18:0/1766915873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe660109140 0x7fe66019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.753+0000 7fe666000640 1 --2- 172.21.15.18:0/1766915873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6601049c0 0x7fe66019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.753+0000 7fe666000640 1 --2- 172.21.15.18:0/1766915873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe660104010 0x7fe66019a620 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:28.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.753+0000 7fe666000640 1 -- 172.21.15.18:0/1766915873 >> 172.21.15.18:0/1766915873 conn(0x7fe6600ffa50 msgr2=0x7fe660100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:28.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.753+0000 7fe666000640 1 -- 172.21.15.18:0/1766915873 shutdown_connections 2024-09-12T02:47:28.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:27.753+0000 7fe666000640 1 -- 172.21.15.18:0/1766915873 wait complete. 2024-09-12T02:47:28.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:28 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1766915873' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:47:28.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:28 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3965524604' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:47:28.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:28 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1766915873' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:47:28.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:28 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3965524604' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:47:29.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:28 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1766915873' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:47:29.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:28 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3965524604' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:47:29.245 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495676 got 197568495678 for osd.6 2024-09-12T02:47:29.245 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:29.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:29 smithi018 ceph-mon[30616]: pgmap v367: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-12T02:47:29.922 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332150 got 219043332153 for osd.7 2024-09-12T02:47:29.922 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:29.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:29 smithi176 ceph-mon[35713]: pgmap v367: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-12T02:47:30.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:29 smithi062 ceph-mon[35527]: pgmap v367: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-12T02:47:30.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.292+0000 7f18c2a00640 1 -- 172.21.15.18:0/912623764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18bc103e30 msgr2=0x7f18bc104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.292+0000 7f18c2a00640 1 --2- 172.21.15.18:0/912623764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18bc103e30 0x7f18bc104210 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009900 tx=0x7f18b002a410 comp rx=0 tx=0).stop 2024-09-12T02:47:30.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.292+0000 7f18c2a00640 1 -- 172.21.15.18:0/912623764 shutdown_connections 2024-09-12T02:47:30.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.292+0000 7f18c2a00640 1 --2- 172.21.15.18:0/912623764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18bc108f60 0x7f18bc110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.292+0000 7f18c2a00640 1 --2- 172.21.15.18:0/912623764 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18bc1047e0 0x7f18bc108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.292+0000 7f18c2a00640 1 --2- 172.21.15.18:0/912623764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18bc103e30 0x7f18bc104210 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.292+0000 7f18c2a00640 1 -- 172.21.15.18:0/912623764 >> 172.21.15.18:0/912623764 conn(0x7f18bc0ff8d0 msgr2=0x7f18bc101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:30.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.292+0000 7f18c2a00640 1 -- 172.21.15.18:0/912623764 shutdown_connections 2024-09-12T02:47:30.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.292+0000 7f18c2a00640 1 -- 172.21.15.18:0/912623764 wait complete. 2024-09-12T02:47:30.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.293+0000 7f18c2a00640 1 Processor -- start 2024-09-12T02:47:30.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.294+0000 7f18c2a00640 1 -- start start 2024-09-12T02:47:30.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.294+0000 7f18c2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18bc103e30 0x7f18bc19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.294+0000 7f18c2a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18bc1047e0 0x7f18bc19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.294+0000 7f18c2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18bc108f60 0x7f18bc19ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.294+0000 7f18c2a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f18bc114010 con 0x7f18bc108f60 2024-09-12T02:47:30.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.294+0000 7f18c2a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f18bc113e90 con 0x7f18bc1047e0 2024-09-12T02:47:30.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.294+0000 7f18c2a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f18bc114190 con 0x7f18bc103e30 2024-09-12T02:47:30.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.294+0000 7f18c2000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18bc108f60 0x7f18bc19ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.294+0000 7f18c2000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18bc108f60 0x7f18bc19ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36726/0 (socket says 172.21.15.18:36726) 2024-09-12T02:47:30.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.294+0000 7f18c2000640 1 -- 172.21.15.18:0/992217674 learned_addr learned my addr 172.21.15.18:0/992217674 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:30.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.294+0000 7f18c0c00640 1 --2- 172.21.15.18:0/992217674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18bc1047e0 0x7f18bc19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.294+0000 7f18c1600640 1 --2- 172.21.15.18:0/992217674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18bc103e30 0x7f18bc19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.295+0000 7f18c2000640 1 -- 172.21.15.18:0/992217674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18bc103e30 msgr2=0x7f18bc19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.295+0000 7f18c2000640 1 --2- 172.21.15.18:0/992217674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18bc103e30 0x7f18bc19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.295+0000 7f18c2000640 1 -- 172.21.15.18:0/992217674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18bc1047e0 msgr2=0x7f18bc19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.295+0000 7f18c2000640 1 --2- 172.21.15.18:0/992217674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18bc1047e0 0x7f18bc19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.295+0000 7f18c2000640 1 -- 172.21.15.18:0/992217674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18bc19f460 con 0x7f18bc108f60 2024-09-12T02:47:30.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.295+0000 7f18c0c00640 1 --2- 172.21.15.18:0/992217674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18bc1047e0 0x7f18bc19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:30.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.295+0000 7f18c2000640 1 --2- 172.21.15.18:0/992217674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18bc108f60 0x7f18bc19ed80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f18b400eb10 tx=0x7f18b400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:30.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.295+0000 7f18ba000640 1 -- 172.21.15.18:0/992217674 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4004b20 con 0x7f18bc108f60 2024-09-12T02:47:30.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.295+0000 7f18ba000640 1 -- 172.21.15.18:0/992217674 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18b4004cc0 con 0x7f18bc108f60 2024-09-12T02:47:30.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.295+0000 7f18ba000640 1 -- 172.21.15.18:0/992217674 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4010760 con 0x7f18bc108f60 2024-09-12T02:47:30.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.295+0000 7f18c2a00640 1 -- 172.21.15.18:0/992217674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18bc19f750 con 0x7f18bc108f60 2024-09-12T02:47:30.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.296+0000 7f18c2a00640 1 -- 172.21.15.18:0/992217674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18bc1a7030 con 0x7f18bc108f60 2024-09-12T02:47:30.827 INFO:teuthology.orchestra.run.smithi018.stdout:34359738464 2024-09-12T02:47:30.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.297+0000 7f18c2a00640 1 -- 172.21.15.18:0/992217674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18bc104210 con 0x7f18bc108f60 2024-09-12T02:47:30.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.298+0000 7f18ba000640 1 -- 172.21.15.18:0/992217674 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f18b4005020 con 0x7f18bc108f60 2024-09-12T02:47:30.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.300+0000 7f18ba000640 1 --2- 172.21.15.18:0/992217674 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f18a40a2c90 0x7f18a40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:30.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.300+0000 7f18ba000640 1 -- 172.21.15.18:0/992217674 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f18b40cfa70 con 0x7f18bc108f60 2024-09-12T02:47:30.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.300+0000 7f18c1600640 1 --2- 172.21.15.18:0/992217674 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f18a40a2c90 0x7f18a40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:30.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.301+0000 7f18c1600640 1 --2- 172.21.15.18:0/992217674 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f18a40a2c90 0x7f18a40a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f18b0000c00 tx=0x7f18b0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:30.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.304+0000 7f18ba000640 1 -- 172.21.15.18:0/992217674 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18b409c460 con 0x7f18bc108f60 2024-09-12T02:47:30.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.494+0000 7f18c2a00640 1 -- 172.21.15.18:0/992217674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f18bc10bbb0 con 0x7f18bc108f60 2024-09-12T02:47:30.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.495+0000 7f18ba000640 1 -- 172.21.15.18:0/992217674 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f18b409bd60 con 0x7f18bc108f60 2024-09-12T02:47:30.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.497+0000 7f18c2a00640 1 -- 172.21.15.18:0/992217674 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f18a40a2c90 msgr2=0x7f18a40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.497+0000 7f18c2a00640 1 --2- 172.21.15.18:0/992217674 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f18a40a2c90 0x7f18a40a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f18b0000c00 tx=0x7f18b0005b50 comp rx=0 tx=0).stop 2024-09-12T02:47:30.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.497+0000 7f18c2a00640 1 -- 172.21.15.18:0/992217674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18bc108f60 msgr2=0x7f18bc19ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:30.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.497+0000 7f18c2a00640 1 --2- 172.21.15.18:0/992217674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18bc108f60 0x7f18bc19ed80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f18b400eb10 tx=0x7f18b400c2d0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.497+0000 7f18c2a00640 1 -- 172.21.15.18:0/992217674 shutdown_connections 2024-09-12T02:47:30.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.497+0000 7f18c2a00640 1 --2- 172.21.15.18:0/992217674 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f18a40a2c90 0x7f18a40a5150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.497+0000 7f18c2a00640 1 --2- 172.21.15.18:0/992217674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18bc108f60 0x7f18bc19ed80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.497+0000 7f18c2a00640 1 --2- 172.21.15.18:0/992217674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18bc1047e0 0x7f18bc19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.497+0000 7f18c2a00640 1 --2- 172.21.15.18:0/992217674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18bc103e30 0x7f18bc19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:30.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.497+0000 7f18c2a00640 1 -- 172.21.15.18:0/992217674 >> 172.21.15.18:0/992217674 conn(0x7f18bc0ff8d0 msgr2=0x7f18bc100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:30.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.497+0000 7f18c2a00640 1 -- 172.21.15.18:0/992217674 shutdown_connections 2024-09-12T02:47:30.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.497+0000 7f18c2a00640 1 -- 172.21.15.18:0/992217674 wait complete. 2024-09-12T02:47:30.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:30 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/992217674' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:47:31.029 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:30 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/992217674' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:47:31.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:30 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/992217674' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:47:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.830+0000 7f5b78e00640 1 -- 172.21.15.18:0/1847129749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b74104010 msgr2=0x7f5b741043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.830+0000 7f5b78e00640 1 --2- 172.21.15.18:0/1847129749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b74104010 0x7f5b741043f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5b64009900 tx=0x7f5b6402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.831+0000 7f5b78e00640 1 -- 172.21.15.18:0/1847129749 shutdown_connections 2024-09-12T02:47:31.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.831+0000 7f5b78e00640 1 --2- 172.21.15.18:0/1847129749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b74109140 0x7f5b74110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.831+0000 7f5b78e00640 1 --2- 172.21.15.18:0/1847129749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b741049c0 0x7f5b74108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.831+0000 7f5b78e00640 1 --2- 172.21.15.18:0/1847129749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b74104010 0x7f5b741043f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.831+0000 7f5b78e00640 1 -- 172.21.15.18:0/1847129749 >> 172.21.15.18:0/1847129749 conn(0x7f5b740ffa50 msgr2=0x7f5b74101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:31.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.831+0000 7f5b78e00640 1 -- 172.21.15.18:0/1847129749 shutdown_connections 2024-09-12T02:47:31.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.831+0000 7f5b78e00640 1 -- 172.21.15.18:0/1847129749 wait complete. 2024-09-12T02:47:31.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.832+0000 7f5b78e00640 1 Processor -- start 2024-09-12T02:47:31.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.832+0000 7f5b78e00640 1 -- start start 2024-09-12T02:47:31.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.832+0000 7f5b78e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b74104010 0x7f5b7419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.832+0000 7f5b78e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b741049c0 0x7f5b7419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.832+0000 7f5b78e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b74109140 0x7f5b7419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.832+0000 7f5b78e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5b74114190 con 0x7f5b741049c0 2024-09-12T02:47:31.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.832+0000 7f5b78e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5b74114010 con 0x7f5b74104010 2024-09-12T02:47:31.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.832+0000 7f5b78e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5b74114310 con 0x7f5b74109140 2024-09-12T02:47:31.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.832+0000 7f5b71400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b741049c0 0x7f5b7419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.832+0000 7f5b71400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b741049c0 0x7f5b7419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36754/0 (socket says 172.21.15.18:36754) 2024-09-12T02:47:31.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.832+0000 7f5b71400640 1 -- 172.21.15.18:0/2805272204 learned_addr learned my addr 172.21.15.18:0/2805272204 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:31.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.832+0000 7f5b72800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b74109140 0x7f5b7419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.832+0000 7f5b71e00640 1 --2- 172.21.15.18:0/2805272204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b74104010 0x7f5b7419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.833+0000 7f5b71400640 1 -- 172.21.15.18:0/2805272204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b74109140 msgr2=0x7f5b7419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.833+0000 7f5b71400640 1 --2- 172.21.15.18:0/2805272204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b74109140 0x7f5b7419ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.833+0000 7f5b71400640 1 -- 172.21.15.18:0/2805272204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b74104010 msgr2=0x7f5b7419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.833+0000 7f5b71400640 1 --2- 172.21.15.18:0/2805272204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b74104010 0x7f5b7419a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.833+0000 7f5b71400640 1 -- 172.21.15.18:0/2805272204 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7419f620 con 0x7f5b741049c0 2024-09-12T02:47:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.833+0000 7f5b71400640 1 --2- 172.21.15.18:0/2805272204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b741049c0 0x7f5b7419abb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5b6000e9f0 tx=0x7f5b6000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.833+0000 7f5b6aa00640 1 -- 172.21.15.18:0/2805272204 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6000cd80 con 0x7f5b741049c0 2024-09-12T02:47:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.833+0000 7f5b78e00640 1 -- 172.21.15.18:0/2805272204 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b7419f910 con 0x7f5b741049c0 2024-09-12T02:47:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.833+0000 7f5b6aa00640 1 -- 172.21.15.18:0/2805272204 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b60010910 con 0x7f5b741049c0 2024-09-12T02:47:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.833+0000 7f5b6aa00640 1 -- 172.21.15.18:0/2805272204 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b600188f0 con 0x7f5b741049c0 2024-09-12T02:47:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.834+0000 7f5b78e00640 1 -- 172.21.15.18:0/2805272204 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b741a71f0 con 0x7f5b741049c0 2024-09-12T02:47:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.835+0000 7f5b78e00640 1 -- 172.21.15.18:0/2805272204 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b741043f0 con 0x7f5b741049c0 2024-09-12T02:47:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.837+0000 7f5b6aa00640 1 -- 172.21.15.18:0/2805272204 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5b60010ac0 con 0x7f5b741049c0 2024-09-12T02:47:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.838+0000 7f5b6aa00640 1 --2- 172.21.15.18:0/2805272204 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5b580a2c10 0x7f5b580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.839+0000 7f5b6aa00640 1 -- 172.21.15.18:0/2805272204 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f5b600cf9e0 con 0x7f5b741049c0 2024-09-12T02:47:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.839+0000 7f5b71e00640 1 --2- 172.21.15.18:0/2805272204 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5b580a2c10 0x7f5b580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.839+0000 7f5b71e00640 1 --2- 172.21.15.18:0/2805272204 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5b580a2c10 0x7f5b580a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5b64000c00 tx=0x7f5b64005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:31.171 INFO:teuthology.orchestra.run.smithi018.stdout:304942678058 2024-09-12T02:47:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:30.842+0000 7f5b6aa00640 1 -- 172.21.15.18:0/2805272204 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5b6009bd80 con 0x7f5b741049c0 2024-09-12T02:47:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.028+0000 7f5b78e00640 1 -- 172.21.15.18:0/2805272204 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f5b7410bd90 con 0x7f5b741049c0 2024-09-12T02:47:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.029+0000 7f5b6aa00640 1 -- 172.21.15.18:0/2805272204 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f5b600a0080 con 0x7f5b741049c0 2024-09-12T02:47:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.031+0000 7f5b78e00640 1 -- 172.21.15.18:0/2805272204 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5b580a2c10 msgr2=0x7f5b580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.031+0000 7f5b78e00640 1 --2- 172.21.15.18:0/2805272204 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5b580a2c10 0x7f5b580a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5b64000c00 tx=0x7f5b64005b50 comp rx=0 tx=0).stop 2024-09-12T02:47:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.031+0000 7f5b78e00640 1 -- 172.21.15.18:0/2805272204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b741049c0 msgr2=0x7f5b7419abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.031+0000 7f5b78e00640 1 --2- 172.21.15.18:0/2805272204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b741049c0 0x7f5b7419abb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5b6000e9f0 tx=0x7f5b6000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.031+0000 7f5b78e00640 1 -- 172.21.15.18:0/2805272204 shutdown_connections 2024-09-12T02:47:31.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.031+0000 7f5b78e00640 1 --2- 172.21.15.18:0/2805272204 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5b580a2c10 0x7f5b580a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.031+0000 7f5b78e00640 1 --2- 172.21.15.18:0/2805272204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b74109140 0x7f5b7419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.031+0000 7f5b78e00640 1 --2- 172.21.15.18:0/2805272204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b741049c0 0x7f5b7419abb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.031+0000 7f5b78e00640 1 --2- 172.21.15.18:0/2805272204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b74104010 0x7f5b7419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.031+0000 7f5b78e00640 1 -- 172.21.15.18:0/2805272204 >> 172.21.15.18:0/2805272204 conn(0x7f5b740ffa50 msgr2=0x7f5b74100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:31.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.031+0000 7f5b78e00640 1 -- 172.21.15.18:0/2805272204 shutdown_connections 2024-09-12T02:47:31.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.031+0000 7f5b78e00640 1 -- 172.21.15.18:0/2805272204 wait complete. 2024-09-12T02:47:31.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.653+0000 7f17c0e00640 1 -- 172.21.15.18:0/2999277674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc1049a0 msgr2=0x7f17bc1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.653+0000 7f17c0e00640 1 --2- 172.21.15.18:0/2999277674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc1049a0 0x7f17bc1089f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009900 tx=0x7f17a402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.653+0000 7f17c0e00640 1 -- 172.21.15.18:0/2999277674 shutdown_connections 2024-09-12T02:47:31.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.653+0000 7f17c0e00640 1 --2- 172.21.15.18:0/2999277674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17bc109120 0x7f17bc110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.653+0000 7f17c0e00640 1 --2- 172.21.15.18:0/2999277674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc1049a0 0x7f17bc1089f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.653+0000 7f17c0e00640 1 --2- 172.21.15.18:0/2999277674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17bc103ff0 0x7f17bc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.653+0000 7f17c0e00640 1 -- 172.21.15.18:0/2999277674 >> 172.21.15.18:0/2999277674 conn(0x7f17bc0ffa90 msgr2=0x7f17bc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:31.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.653+0000 7f17c0e00640 1 -- 172.21.15.18:0/2999277674 shutdown_connections 2024-09-12T02:47:31.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.653+0000 7f17c0e00640 1 -- 172.21.15.18:0/2999277674 wait complete. 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.654+0000 7f17c0e00640 1 Processor -- start 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.654+0000 7f17c0e00640 1 -- start start 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.654+0000 7f17c0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc103ff0 0x7f17bc19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.654+0000 7f17c0e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17bc1049a0 0x7f17bc19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.654+0000 7f17c0e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17bc109120 0x7f17bc19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.654+0000 7f17c0e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc114120 con 0x7f17bc103ff0 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.654+0000 7f17c0e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc113fa0 con 0x7f17bc109120 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.654+0000 7f17c0e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1142a0 con 0x7f17bc1049a0 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.655+0000 7f17b9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc103ff0 0x7f17bc19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.655+0000 7f17b9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc103ff0 0x7f17bc19a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36762/0 (socket says 172.21.15.18:36762) 2024-09-12T02:47:31.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.655+0000 7f17b9e00640 1 -- 172.21.15.18:0/885564830 learned_addr learned my addr 172.21.15.18:0/885564830 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:31.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.655+0000 7f17b3e00640 1 --2- 172.21.15.18:0/885564830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17bc1049a0 0x7f17bc19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.655+0000 7f17ba800640 1 --2- 172.21.15.18:0/885564830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17bc109120 0x7f17bc19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.655+0000 7f17b9e00640 1 -- 172.21.15.18:0/885564830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17bc1049a0 msgr2=0x7f17bc19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.655+0000 7f17b9e00640 1 --2- 172.21.15.18:0/885564830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17bc1049a0 0x7f17bc19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.655+0000 7f17b9e00640 1 -- 172.21.15.18:0/885564830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17bc109120 msgr2=0x7f17bc19ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.655+0000 7f17b9e00640 1 --2- 172.21.15.18:0/885564830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17bc109120 0x7f17bc19ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.655+0000 7f17b9e00640 1 -- 172.21.15.18:0/885564830 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17bc19f650 con 0x7f17bc103ff0 2024-09-12T02:47:31.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.656+0000 7f17b9e00640 1 --2- 172.21.15.18:0/885564830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc103ff0 0x7f17bc19a6a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00ea60 tx=0x7f17ac00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:31.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.656+0000 7f17b2a00640 1 -- 172.21.15.18:0/885564830 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac00cde0 con 0x7f17bc103ff0 2024-09-12T02:47:31.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.656+0000 7f17b2a00640 1 -- 172.21.15.18:0/885564830 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17ac0035f0 con 0x7f17bc103ff0 2024-09-12T02:47:31.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.656+0000 7f17b2a00640 1 -- 172.21.15.18:0/885564830 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac010670 con 0x7f17bc103ff0 2024-09-12T02:47:31.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.656+0000 7f17c0e00640 1 -- 172.21.15.18:0/885564830 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17bc19f940 con 0x7f17bc103ff0 2024-09-12T02:47:31.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.656+0000 7f17c0e00640 1 -- 172.21.15.18:0/885564830 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17bc1a7220 con 0x7f17bc103ff0 2024-09-12T02:47:31.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.657+0000 7f17c0e00640 1 -- 172.21.15.18:0/885564830 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17bc1043d0 con 0x7f17bc103ff0 2024-09-12T02:47:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.659+0000 7f17b2a00640 1 -- 172.21.15.18:0/885564830 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f17ac0037a0 con 0x7f17bc103ff0 2024-09-12T02:47:31.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.660+0000 7f17b2a00640 1 --2- 172.21.15.18:0/885564830 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f17a00a2c90 0x7f17a00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.661+0000 7f17b2a00640 1 -- 172.21.15.18:0/885564830 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f17ac0cf850 con 0x7f17bc103ff0 2024-09-12T02:47:31.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.661+0000 7f17b3e00640 1 --2- 172.21.15.18:0/885564830 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f17a00a2c90 0x7f17a00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.661+0000 7f17b3e00640 1 --2- 172.21.15.18:0/885564830 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f17a00a2c90 0x7f17a00a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009230 tx=0x7f17a40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:31.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.665+0000 7f17b2a00640 1 -- 172.21.15.18:0/885564830 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f17ac09c240 con 0x7f17bc103ff0 2024-09-12T02:47:31.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.155+0000 7ff51b200640 1 -- 172.21.15.18:0/695949067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff51c103e30 msgr2=0x7ff51c104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.155+0000 7ff51b200640 1 --2- 172.21.15.18:0/695949067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff51c103e30 0x7ff51c104210 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009900 tx=0x7ff50c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.155+0000 7ff51b200640 1 -- 172.21.15.18:0/695949067 shutdown_connections 2024-09-12T02:47:31.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.155+0000 7ff51b200640 1 --2- 172.21.15.18:0/695949067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51c108f60 0x7ff51c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.155+0000 7ff51b200640 1 --2- 172.21.15.18:0/695949067 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff51c1047e0 0x7ff51c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.155+0000 7ff51b200640 1 --2- 172.21.15.18:0/695949067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff51c103e30 0x7ff51c104210 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.155+0000 7ff51b200640 1 -- 172.21.15.18:0/695949067 >> 172.21.15.18:0/695949067 conn(0x7ff51c0ff8d0 msgr2=0x7ff51c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:31.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.155+0000 7ff51b200640 1 -- 172.21.15.18:0/695949067 shutdown_connections 2024-09-12T02:47:31.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.155+0000 7ff51b200640 1 -- 172.21.15.18:0/695949067 wait complete. 2024-09-12T02:47:31.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.156+0000 7ff51b200640 1 Processor -- start 2024-09-12T02:47:31.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.156+0000 7ff51b200640 1 -- start start 2024-09-12T02:47:31.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.157+0000 7ff51b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51c103e30 0x7ff51c19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.157+0000 7ff51b200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff51c1047e0 0x7ff51c19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.157+0000 7ff51b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff51c108f60 0x7ff51c19ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.157+0000 7ff51b200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c113fc0 con 0x7ff51c108f60 2024-09-12T02:47:31.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.157+0000 7ff51b200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c113e40 con 0x7ff51c1047e0 2024-09-12T02:47:31.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.157+0000 7ff51b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c114140 con 0x7ff51c103e30 2024-09-12T02:47:31.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.157+0000 7ff519e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51c103e30 0x7ff51c19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.157+0000 7ff519e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51c103e30 0x7ff51c19a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:39630/0 (socket says 172.21.15.18:39630) 2024-09-12T02:47:31.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.157+0000 7ff519e00640 1 -- 172.21.15.18:0/3201161799 learned_addr learned my addr 172.21.15.18:0/3201161799 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:31.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.157+0000 7ff519400640 1 --2- 172.21.15.18:0/3201161799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff51c1047e0 0x7ff51c19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.158+0000 7ff519400640 1 -- 172.21.15.18:0/3201161799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51c103e30 msgr2=0x7ff51c19a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:31 smithi018 ceph-mon[30616]: pgmap v368: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:31.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:31 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2805272204' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:47:31.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.158+0000 7ff519400640 1 --2- 172.21.15.18:0/3201161799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51c103e30 0x7ff51c19a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.158+0000 7ff519400640 1 -- 172.21.15.18:0/3201161799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff51c108f60 msgr2=0x7ff51c19ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.158+0000 7ff51a800640 1 --2- 172.21.15.18:0/3201161799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff51c108f60 0x7ff51c19ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.158+0000 7ff519400640 1 --2- 172.21.15.18:0/3201161799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff51c108f60 0x7ff51c19ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.158+0000 7ff519400640 1 -- 172.21.15.18:0/3201161799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51c19f3f0 con 0x7ff51c1047e0 2024-09-12T02:47:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.158+0000 7ff519e00640 1 --2- 172.21.15.18:0/3201161799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51c103e30 0x7ff51c19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.158+0000 7ff51a800640 1 --2- 172.21.15.18:0/3201161799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff51c108f60 0x7ff51c19ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:47:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.159+0000 7ff519400640 1 --2- 172.21.15.18:0/3201161799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff51c1047e0 0x7ff51c19a980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff50800e9f0 tx=0x7ff50800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.159+0000 7ff512a00640 1 -- 172.21.15.18:0/3201161799 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50800ccc0 con 0x7ff51c1047e0 2024-09-12T02:47:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.159+0000 7ff51b200640 1 -- 172.21.15.18:0/3201161799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff51c19f6e0 con 0x7ff51c1047e0 2024-09-12T02:47:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.159+0000 7ff512a00640 1 -- 172.21.15.18:0/3201161799 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff508010910 con 0x7ff51c1047e0 2024-09-12T02:47:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.159+0000 7ff512a00640 1 -- 172.21.15.18:0/3201161799 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff508018960 con 0x7ff51c1047e0 2024-09-12T02:47:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.159+0000 7ff51b200640 1 -- 172.21.15.18:0/3201161799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff51c1a6fc0 con 0x7ff51c1047e0 2024-09-12T02:47:31.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.160+0000 7ff51b200640 1 -- 172.21.15.18:0/3201161799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff51c104210 con 0x7ff51c1047e0 2024-09-12T02:47:31.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.162+0000 7ff512a00640 1 -- 172.21.15.18:0/3201161799 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff508010ac0 con 0x7ff51c1047e0 2024-09-12T02:47:31.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.164+0000 7ff512a00640 1 --2- 172.21.15.18:0/3201161799 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff5000a2c10 0x7ff5000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:31.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.164+0000 7ff512a00640 1 -- 172.21.15.18:0/3201161799 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7ff5080cfa20 con 0x7ff51c1047e0 2024-09-12T02:47:31.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.164+0000 7ff519e00640 1 --2- 172.21.15.18:0/3201161799 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff5000a2c10 0x7ff5000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:31.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.165+0000 7ff519e00640 1 --2- 172.21.15.18:0/3201161799 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff5000a2c10 0x7ff5000a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0096c0 tx=0x7ff50c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:31.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.168+0000 7ff512a00640 1 -- 172.21.15.18:0/3201161799 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff50809c410 con 0x7ff51c1047e0 2024-09-12T02:47:31.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.354+0000 7ff51b200640 1 -- 172.21.15.18:0/3201161799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff51c10c170 con 0x7ff51c1047e0 2024-09-12T02:47:31.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.355+0000 7ff512a00640 1 -- 172.21.15.18:0/3201161799 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff50809bd10 con 0x7ff51c1047e0 2024-09-12T02:47:31.792 INFO:teuthology.orchestra.run.smithi018.stdout:163208757316 2024-09-12T02:47:31.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.357+0000 7ff51b200640 1 -- 172.21.15.18:0/3201161799 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff5000a2c10 msgr2=0x7ff5000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.357+0000 7ff51b200640 1 --2- 172.21.15.18:0/3201161799 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff5000a2c10 0x7ff5000a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0096c0 tx=0x7ff50c005a20 comp rx=0 tx=0).stop 2024-09-12T02:47:31.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.357+0000 7ff51b200640 1 -- 172.21.15.18:0/3201161799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff51c1047e0 msgr2=0x7ff51c19a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.357+0000 7ff51b200640 1 --2- 172.21.15.18:0/3201161799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff51c1047e0 0x7ff51c19a980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff50800e9f0 tx=0x7ff50800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.358+0000 7ff51b200640 1 -- 172.21.15.18:0/3201161799 shutdown_connections 2024-09-12T02:47:31.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.358+0000 7ff51b200640 1 --2- 172.21.15.18:0/3201161799 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7ff5000a2c10 0x7ff5000a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.358+0000 7ff51b200640 1 --2- 172.21.15.18:0/3201161799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff51c108f60 0x7ff51c19ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.358+0000 7ff51b200640 1 --2- 172.21.15.18:0/3201161799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff51c1047e0 0x7ff51c19a980 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.358+0000 7ff51b200640 1 --2- 172.21.15.18:0/3201161799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51c103e30 0x7ff51c19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.358+0000 7ff51b200640 1 -- 172.21.15.18:0/3201161799 >> 172.21.15.18:0/3201161799 conn(0x7ff51c0ff8d0 msgr2=0x7ff51c100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:31.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.358+0000 7ff51b200640 1 -- 172.21.15.18:0/3201161799 shutdown_connections 2024-09-12T02:47:31.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:26.358+0000 7ff51b200640 1 -- 172.21.15.18:0/3201161799 wait complete. 2024-09-12T02:47:31.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.863+0000 7f17c0e00640 1 -- 172.21.15.18:0/885564830 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f17bc19ba00 con 0x7f17bc103ff0 2024-09-12T02:47:31.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.863+0000 7f17b2a00640 1 -- 172.21.15.18:0/885564830 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f17ac09bb40 con 0x7f17bc103ff0 2024-09-12T02:47:31.865 INFO:teuthology.orchestra.run.smithi018.stdout:253403070517 2024-09-12T02:47:31.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.866+0000 7f17c0e00640 1 -- 172.21.15.18:0/885564830 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f17a00a2c90 msgr2=0x7f17a00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.866+0000 7f17c0e00640 1 --2- 172.21.15.18:0/885564830 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f17a00a2c90 0x7f17a00a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009230 tx=0x7f17a40058d0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.866+0000 7f17c0e00640 1 -- 172.21.15.18:0/885564830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc103ff0 msgr2=0x7f17bc19a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:31.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.866+0000 7f17c0e00640 1 --2- 172.21.15.18:0/885564830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc103ff0 0x7f17bc19a6a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00ea60 tx=0x7f17ac00ef20 comp rx=0 tx=0).stop 2024-09-12T02:47:31.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.866+0000 7f17c0e00640 1 -- 172.21.15.18:0/885564830 shutdown_connections 2024-09-12T02:47:31.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.866+0000 7f17c0e00640 1 --2- 172.21.15.18:0/885564830 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f17a00a2c90 0x7f17a00a5150 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.866+0000 7f17c0e00640 1 --2- 172.21.15.18:0/885564830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17bc109120 0x7f17bc19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.866+0000 7f17c0e00640 1 --2- 172.21.15.18:0/885564830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17bc1049a0 0x7f17bc19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.866+0000 7f17c0e00640 1 --2- 172.21.15.18:0/885564830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17bc103ff0 0x7f17bc19a6a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:31.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.866+0000 7f17c0e00640 1 -- 172.21.15.18:0/885564830 >> 172.21.15.18:0/885564830 conn(0x7f17bc0ffa90 msgr2=0x7f17bc100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:31.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.866+0000 7f17c0e00640 1 -- 172.21.15.18:0/885564830 shutdown_connections 2024-09-12T02:47:31.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:31.866+0000 7f17c0e00640 1 -- 172.21.15.18:0/885564830 wait complete. 2024-09-12T02:47:31.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:31 smithi176 ceph-mon[35713]: pgmap v368: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:31.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:31 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2805272204' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:47:32.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:31 smithi062 ceph-mon[35527]: pgmap v368: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:32.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:31 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2805272204' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:47:32.991 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:32 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/885564830' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:47:33.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:32 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/885564830' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:47:33.056 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070513 got 253403070517 for osd.8 2024-09-12T02:47:33.057 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:33.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:32 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/885564830' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:47:33.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.776+0000 7f520f200640 1 -- 172.21.15.18:0/3920532905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52100745c0 msgr2=0x7f52100749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.776+0000 7f520f200640 1 --2- 172.21.15.18:0/3920532905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52100745c0 0x7f52100749a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5200009ca0 tx=0x7f520002a950 comp rx=0 tx=0).stop 2024-09-12T02:47:33.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.776+0000 7f520f200640 1 -- 172.21.15.18:0/3920532905 shutdown_connections 2024-09-12T02:47:33.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.776+0000 7f520f200640 1 --2- 172.21.15.18:0/3920532905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f521010e260 0x7f5210110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.776+0000 7f520f200640 1 --2- 172.21.15.18:0/3920532905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5210074ee0 0x7f521010dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.776+0000 7f520f200640 1 --2- 172.21.15.18:0/3920532905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52100745c0 0x7f52100749a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.776+0000 7f520f200640 1 -- 172.21.15.18:0/3920532905 >> 172.21.15.18:0/3920532905 conn(0x7f52100fd740 msgr2=0x7f52100ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.776+0000 7f520f200640 1 -- 172.21.15.18:0/3920532905 shutdown_connections 2024-09-12T02:47:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.776+0000 7f520f200640 1 -- 172.21.15.18:0/3920532905 wait complete. 2024-09-12T02:47:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.777+0000 7f520f200640 1 Processor -- start 2024-09-12T02:47:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.777+0000 7f520f200640 1 -- start start 2024-09-12T02:47:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.778+0000 7f520f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52100745c0 0x7f521019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.778+0000 7f520f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5210074ee0 0x7f521019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.778+0000 7f520f200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f521010e260 0x7f521019ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.778+0000 7f520f200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5210114000 con 0x7f52100745c0 2024-09-12T02:47:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.778+0000 7f520f200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5210113e80 con 0x7f521010e260 2024-09-12T02:47:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.778+0000 7f520f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5210114180 con 0x7f5210074ee0 2024-09-12T02:47:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.778+0000 7f520de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52100745c0 0x7f521019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.778+0000 7f520e800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f521010e260 0x7f521019ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.778+0000 7f520de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52100745c0 0x7f521019a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36782/0 (socket says 172.21.15.18:36782) 2024-09-12T02:47:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.778+0000 7f520de00640 1 -- 172.21.15.18:0/2749380546 learned_addr learned my addr 172.21.15.18:0/2749380546 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.778+0000 7f5205400640 1 --2- 172.21.15.18:0/2749380546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5210074ee0 0x7f521019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.779+0000 7f520e800640 1 -- 172.21.15.18:0/2749380546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5210074ee0 msgr2=0x7f521019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.779+0000 7f520e800640 1 --2- 172.21.15.18:0/2749380546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5210074ee0 0x7f521019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.779+0000 7f520e800640 1 -- 172.21.15.18:0/2749380546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52100745c0 msgr2=0x7f521019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.779+0000 7f520e800640 1 --2- 172.21.15.18:0/2749380546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52100745c0 0x7f521019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.779+0000 7f520e800640 1 -- 172.21.15.18:0/2749380546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521019f470 con 0x7f521010e260 2024-09-12T02:47:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.779+0000 7f520de00640 1 --2- 172.21.15.18:0/2749380546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52100745c0 0x7f521019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:33.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.779+0000 7f520e800640 1 --2- 172.21.15.18:0/2749380546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f521010e260 0x7f521019ed90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f520800e940 tx=0x7f520800ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:33.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.779+0000 7f5207400640 1 -- 172.21.15.18:0/2749380546 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520800ccc0 con 0x7f521010e260 2024-09-12T02:47:33.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.779+0000 7f5207400640 1 -- 172.21.15.18:0/2749380546 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5208005020 con 0x7f521010e260 2024-09-12T02:47:33.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.779+0000 7f520f200640 1 -- 172.21.15.18:0/2749380546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521019f760 con 0x7f521010e260 2024-09-12T02:47:33.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.779+0000 7f5207400640 1 -- 172.21.15.18:0/2749380546 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5208004a00 con 0x7f521010e260 2024-09-12T02:47:33.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.779+0000 7f520f200640 1 -- 172.21.15.18:0/2749380546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52101a7040 con 0x7f521010e260 2024-09-12T02:47:33.302 INFO:teuthology.orchestra.run.smithi018.stdout:283467841583 2024-09-12T02:47:33.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.780+0000 7f520f200640 1 -- 172.21.15.18:0/2749380546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52100749a0 con 0x7f521010e260 2024-09-12T02:47:33.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.782+0000 7f5207400640 1 -- 172.21.15.18:0/2749380546 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f52080051d0 con 0x7f521010e260 2024-09-12T02:47:33.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.783+0000 7f5207400640 1 --2- 172.21.15.18:0/2749380546 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f51f40a2c10 0x7f51f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:33.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.783+0000 7f5207400640 1 -- 172.21.15.18:0/2749380546 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f52080cf4d0 con 0x7f521010e260 2024-09-12T02:47:33.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.784+0000 7f520de00640 1 --2- 172.21.15.18:0/2749380546 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f51f40a2c10 0x7f51f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:33.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.784+0000 7f520de00640 1 --2- 172.21.15.18:0/2749380546 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f51f40a2c10 0x7f51f40a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5200009a60 tx=0x7f5200005dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:33.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.788+0000 7f5207400640 1 -- 172.21.15.18:0/2749380546 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f520809bec0 con 0x7f521010e260 2024-09-12T02:47:33.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.974+0000 7f520f200640 1 -- 172.21.15.18:0/2749380546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f5210109440 con 0x7f521010e260 2024-09-12T02:47:33.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.974+0000 7f5207400640 1 -- 172.21.15.18:0/2749380546 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f520809b7c0 con 0x7f521010e260 2024-09-12T02:47:33.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.976+0000 7f520f200640 1 -- 172.21.15.18:0/2749380546 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f51f40a2c10 msgr2=0x7f51f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.976+0000 7f520f200640 1 --2- 172.21.15.18:0/2749380546 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f51f40a2c10 0x7f51f40a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5200009a60 tx=0x7f5200005dc0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.976+0000 7f520f200640 1 -- 172.21.15.18:0/2749380546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f521010e260 msgr2=0x7f521019ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:33.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.976+0000 7f520f200640 1 --2- 172.21.15.18:0/2749380546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f521010e260 0x7f521019ed90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f520800e940 tx=0x7f520800ee00 comp rx=0 tx=0).stop 2024-09-12T02:47:33.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.976+0000 7f520f200640 1 -- 172.21.15.18:0/2749380546 shutdown_connections 2024-09-12T02:47:33.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.976+0000 7f520f200640 1 --2- 172.21.15.18:0/2749380546 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f51f40a2c10 0x7f51f40a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.976+0000 7f520f200640 1 --2- 172.21.15.18:0/2749380546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f521010e260 0x7f521019ed90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.976+0000 7f520f200640 1 --2- 172.21.15.18:0/2749380546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5210074ee0 0x7f521019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.976+0000 7f520f200640 1 --2- 172.21.15.18:0/2749380546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52100745c0 0x7f521019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:33.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.976+0000 7f520f200640 1 -- 172.21.15.18:0/2749380546 >> 172.21.15.18:0/2749380546 conn(0x7f52100fd740 msgr2=0x7f52100fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:33.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.977+0000 7f520f200640 1 -- 172.21.15.18:0/2749380546 shutdown_connections 2024-09-12T02:47:33.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:32.977+0000 7f520f200640 1 -- 172.21.15.18:0/2749380546 wait complete. 2024-09-12T02:47:34.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:33 smithi018 ceph-mon[30616]: pgmap v369: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:47:34.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:33 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2749380546' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:47:34.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:33 smithi062 ceph-mon[35527]: pgmap v369: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:47:34.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:33 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2749380546' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:47:34.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:33 smithi176 ceph-mon[35713]: pgmap v369: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:47:34.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:33 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2749380546' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:47:34.638 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757315 got 163208757316 for osd.5 2024-09-12T02:47:34.638 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:35.000 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678054 got 304942678058 for osd.10 2024-09-12T02:47:35.000 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:35.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.179+0000 7f9393200640 1 -- 172.21.15.18:0/3257290488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938c1010d0 msgr2=0x7f938c10dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.179+0000 7f9393200640 1 --2- 172.21.15.18:0/3257290488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938c1010d0 0x7f938c10dd90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f937c009860 tx=0x7f937c02a340 comp rx=0 tx=0).stop 2024-09-12T02:47:35.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.179+0000 7f9393200640 1 -- 172.21.15.18:0/3257290488 shutdown_connections 2024-09-12T02:47:35.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.179+0000 7f9393200640 1 --2- 172.21.15.18:0/3257290488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f938c10e2d0 0x7f938c1106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.179+0000 7f9393200640 1 --2- 172.21.15.18:0/3257290488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938c1010d0 0x7f938c10dd90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.179+0000 7f9393200640 1 --2- 172.21.15.18:0/3257290488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f938c100720 0x7f938c100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.179+0000 7f9393200640 1 -- 172.21.15.18:0/3257290488 >> 172.21.15.18:0/3257290488 conn(0x7f938c0fc610 msgr2=0x7f938c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:35.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.179+0000 7f9393200640 1 -- 172.21.15.18:0/3257290488 shutdown_connections 2024-09-12T02:47:35.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.179+0000 7f9393200640 1 -- 172.21.15.18:0/3257290488 wait complete. 2024-09-12T02:47:35.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.180+0000 7f9393200640 1 Processor -- start 2024-09-12T02:47:35.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.180+0000 7f9393200640 1 -- start start 2024-09-12T02:47:35.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.180+0000 7f9393200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f938c100720 0x7f938c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.180+0000 7f9393200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f938c1010d0 0x7f938c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.181+0000 7f9393200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938c10e2d0 0x7f938c19edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.181+0000 7f9393200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f938c113ff0 con 0x7f938c100720 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.181+0000 7f9393200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f938c113e70 con 0x7f938c1010d0 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.181+0000 7f9393200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f938c114170 con 0x7f938c10e2d0 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.181+0000 7f9391400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f938c1010d0 0x7f938c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.181+0000 7f9391400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f938c1010d0 0x7f938c19aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:37582/0 (socket says 172.21.15.18:37582) 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.181+0000 7f9391400640 1 -- 172.21.15.18:0/4037821004 learned_addr learned my addr 172.21.15.18:0/4037821004 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.181+0000 7f9391e00640 1 --2- 172.21.15.18:0/4037821004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f938c100720 0x7f938c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.181+0000 7f9392800640 1 --2- 172.21.15.18:0/4037821004 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938c10e2d0 0x7f938c19edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.181+0000 7f9391400640 1 -- 172.21.15.18:0/4037821004 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938c10e2d0 msgr2=0x7f938c19edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.181+0000 7f9391400640 1 --2- 172.21.15.18:0/4037821004 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938c10e2d0 0x7f938c19edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.181+0000 7f9391400640 1 -- 172.21.15.18:0/4037821004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f938c100720 msgr2=0x7f938c19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.181+0000 7f9391400640 1 --2- 172.21.15.18:0/4037821004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f938c100720 0x7f938c19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.181+0000 7f9391400640 1 -- 172.21.15.18:0/4037821004 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938c19f4b0 con 0x7f938c1010d0 2024-09-12T02:47:35.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.182+0000 7f9391400640 1 --2- 172.21.15.18:0/4037821004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f938c1010d0 0x7f938c19aa40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f937c035040 tx=0x7f937c033b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:35.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.182+0000 7f9386a00640 1 -- 172.21.15.18:0/4037821004 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937c037040 con 0x7f938c1010d0 2024-09-12T02:47:35.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.182+0000 7f9393200640 1 -- 172.21.15.18:0/4037821004 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f938c19f740 con 0x7f938c1010d0 2024-09-12T02:47:35.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.182+0000 7f9386a00640 1 -- 172.21.15.18:0/4037821004 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f937c040070 con 0x7f938c1010d0 2024-09-12T02:47:35.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.182+0000 7f9386a00640 1 -- 172.21.15.18:0/4037821004 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937c0039b0 con 0x7f938c1010d0 2024-09-12T02:47:35.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.182+0000 7f9393200640 1 -- 172.21.15.18:0/4037821004 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f938c1a7080 con 0x7f938c1010d0 2024-09-12T02:47:35.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.183+0000 7f9393200640 1 -- 172.21.15.18:0/4037821004 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f938c06a850 con 0x7f938c1010d0 2024-09-12T02:47:35.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.185+0000 7f9386a00640 1 -- 172.21.15.18:0/4037821004 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f937c0305e0 con 0x7f938c1010d0 2024-09-12T02:47:35.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.186+0000 7f9386a00640 1 --2- 172.21.15.18:0/4037821004 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f93740a2c10 0x7f93740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:35.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.186+0000 7f9386a00640 1 -- 172.21.15.18:0/4037821004 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f937c0ef450 con 0x7f938c1010d0 2024-09-12T02:47:35.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.187+0000 7f9391e00640 1 --2- 172.21.15.18:0/4037821004 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f93740a2c10 0x7f93740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:35.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.187+0000 7f9391e00640 1 --2- 172.21.15.18:0/4037821004 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f93740a2c10 0x7f93740a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9380009530 tx=0x7f9380009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:35.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.190+0000 7f9386a00640 1 -- 172.21.15.18:0/4037821004 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f937c0bbf90 con 0x7f938c1010d0 2024-09-12T02:47:35.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.380+0000 7f9393200640 1 -- 172.21.15.18:0/4037821004 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f938c109460 con 0x7f938c1010d0 2024-09-12T02:47:35.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.380+0000 7f9386a00640 1 -- 172.21.15.18:0/4037821004 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f937c0a4e20 con 0x7f938c1010d0 2024-09-12T02:47:35.381 INFO:teuthology.orchestra.run.smithi018.stdout:77309411415 2024-09-12T02:47:35.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.383+0000 7f9393200640 1 -- 172.21.15.18:0/4037821004 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f93740a2c10 msgr2=0x7f93740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.383+0000 7f9393200640 1 --2- 172.21.15.18:0/4037821004 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f93740a2c10 0x7f93740a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9380009530 tx=0x7f9380009260 comp rx=0 tx=0).stop 2024-09-12T02:47:35.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.383+0000 7f9393200640 1 -- 172.21.15.18:0/4037821004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f938c1010d0 msgr2=0x7f938c19aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:35.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.383+0000 7f9393200640 1 --2- 172.21.15.18:0/4037821004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f938c1010d0 0x7f938c19aa40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f937c035040 tx=0x7f937c033b60 comp rx=0 tx=0).stop 2024-09-12T02:47:35.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.383+0000 7f9393200640 1 -- 172.21.15.18:0/4037821004 shutdown_connections 2024-09-12T02:47:35.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.383+0000 7f9393200640 1 --2- 172.21.15.18:0/4037821004 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f93740a2c10 0x7f93740a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.383+0000 7f9393200640 1 --2- 172.21.15.18:0/4037821004 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938c10e2d0 0x7f938c19edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.383+0000 7f9393200640 1 --2- 172.21.15.18:0/4037821004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f938c1010d0 0x7f938c19aa40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.383+0000 7f9393200640 1 --2- 172.21.15.18:0/4037821004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f938c100720 0x7f938c19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:35.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.383+0000 7f9393200640 1 -- 172.21.15.18:0/4037821004 >> 172.21.15.18:0/4037821004 conn(0x7f938c0fc610 msgr2=0x7f938c0fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:35.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.383+0000 7f9393200640 1 -- 172.21.15.18:0/4037821004 shutdown_connections 2024-09-12T02:47:35.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:35.383+0000 7f9393200640 1 -- 172.21.15.18:0/4037821004 wait complete. 2024-09-12T02:47:35.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:35 smithi176 ceph-mon[35713]: pgmap v370: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:35.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:35 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:47:35.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:35 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/4037821004' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:47:36.023 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:35 smithi018 ceph-mon[30616]: pgmap v370: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:36.023 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:35 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:47:36.023 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:35 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/4037821004' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:47:36.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:35 smithi062 ceph-mon[35527]: pgmap v370: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:36.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:35 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:47:36.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:35 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/4037821004' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:47:36.061 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841580 got 283467841583 for osd.9 2024-09-12T02:47:36.061 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:36.177 INFO:tasks.cephadm.ceph_manager.ceph:need seq 339302416418 got 339302416420 for osd.11 2024-09-12T02:47:36.177 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:36.700 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738461 got 34359738464 for osd.0 2024-09-12T02:47:36.701 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:37.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.258+0000 7f6ca0e00640 1 -- 172.21.15.18:0/2627308638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c9c102790 msgr2=0x7f6c9c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:37.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.258+0000 7f6ca0e00640 1 --2- 172.21.15.18:0/2627308638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c9c102790 0x7f6c9c1067e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009900 tx=0x7f6c8402a400 comp rx=0 tx=0).stop 2024-09-12T02:47:37.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.259+0000 7f6ca0e00640 1 -- 172.21.15.18:0/2627308638 shutdown_connections 2024-09-12T02:47:37.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.259+0000 7f6ca0e00640 1 --2- 172.21.15.18:0/2627308638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c9c106f10 0x7f6c9c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.259+0000 7f6ca0e00640 1 --2- 172.21.15.18:0/2627308638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c9c102790 0x7f6c9c1067e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.259+0000 7f6ca0e00640 1 --2- 172.21.15.18:0/2627308638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c9c101de0 0x7f6c9c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.259+0000 7f6ca0e00640 1 -- 172.21.15.18:0/2627308638 >> 172.21.15.18:0/2627308638 conn(0x7f6c9c0fd8c0 msgr2=0x7f6c9c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:37.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.259+0000 7f6ca0e00640 1 -- 172.21.15.18:0/2627308638 shutdown_connections 2024-09-12T02:47:37.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.259+0000 7f6ca0e00640 1 -- 172.21.15.18:0/2627308638 wait complete. 2024-09-12T02:47:37.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.260+0000 7f6ca0e00640 1 Processor -- start 2024-09-12T02:47:37.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.261+0000 7f6ca0e00640 1 -- start start 2024-09-12T02:47:37.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.261+0000 7f6ca0e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c9c101de0 0x7f6c9c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:37.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.261+0000 7f6ca0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c9c102790 0x7f6c9c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:37.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.261+0000 7f6ca0e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c9c106f10 0x7f6c9c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:37.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.261+0000 7f6ca0e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9c111f70 con 0x7f6c9c102790 2024-09-12T02:47:37.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.261+0000 7f6ca0e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9c111df0 con 0x7f6c9c106f10 2024-09-12T02:47:37.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.261+0000 7f6ca0e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9c1120f0 con 0x7f6c9c101de0 2024-09-12T02:47:37.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.261+0000 7f6c91400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c9c102790 0x7f6c9c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:37.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.261+0000 7f6c91400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c9c102790 0x7f6c9c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58438/0 (socket says 172.21.15.18:58438) 2024-09-12T02:47:37.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.261+0000 7f6c91400640 1 -- 172.21.15.18:0/1835067848 learned_addr learned my addr 172.21.15.18:0/1835067848 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:37.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.261+0000 7f6c99e00640 1 --2- 172.21.15.18:0/1835067848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c9c101de0 0x7f6c9c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:37.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.261+0000 7f6c9a800640 1 --2- 172.21.15.18:0/1835067848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c9c106f10 0x7f6c9c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:37.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.262+0000 7f6c91400640 1 -- 172.21.15.18:0/1835067848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c9c101de0 msgr2=0x7f6c9c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:37.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.262+0000 7f6c91400640 1 --2- 172.21.15.18:0/1835067848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c9c101de0 0x7f6c9c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.262+0000 7f6c91400640 1 -- 172.21.15.18:0/1835067848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c9c106f10 msgr2=0x7f6c9c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:37.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.262+0000 7f6c91400640 1 --2- 172.21.15.18:0/1835067848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c9c106f10 0x7f6c9c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.262+0000 7f6c91400640 1 -- 172.21.15.18:0/1835067848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c9c1a6910 con 0x7f6c9c102790 2024-09-12T02:47:37.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.262+0000 7f6c99e00640 1 --2- 172.21.15.18:0/1835067848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c9c101de0 0x7f6c9c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:37.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.262+0000 7f6c91400640 1 --2- 172.21.15.18:0/1835067848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c9c102790 0x7f6c9c074a30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6c84006010 tx=0x7f6c84004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:37.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.262+0000 7f6c93400640 1 -- 172.21.15.18:0/1835067848 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8403f030 con 0x7f6c9c102790 2024-09-12T02:47:37.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.262+0000 7f6c93400640 1 -- 172.21.15.18:0/1835067848 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c84004440 con 0x7f6c9c102790 2024-09-12T02:47:37.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.263+0000 7f6ca0e00640 1 -- 172.21.15.18:0/1835067848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c9c1a6ba0 con 0x7f6c9c102790 2024-09-12T02:47:37.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.263+0000 7f6c93400640 1 -- 172.21.15.18:0/1835067848 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84035070 con 0x7f6c9c102790 2024-09-12T02:47:37.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.263+0000 7f6ca0e00640 1 -- 172.21.15.18:0/1835067848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c9c1a70d0 con 0x7f6c9c102790 2024-09-12T02:47:37.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.264+0000 7f6ca0e00640 1 -- 172.21.15.18:0/1835067848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c9c1021c0 con 0x7f6c9c102790 2024-09-12T02:47:37.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.266+0000 7f6c93400640 1 -- 172.21.15.18:0/1835067848 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6c84042030 con 0x7f6c9c102790 2024-09-12T02:47:37.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.268+0000 7f6c93400640 1 --2- 172.21.15.18:0/1835067848 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f6c800a2c90 0x7f6c800a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:37.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.268+0000 7f6c93400640 1 -- 172.21.15.18:0/1835067848 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f6c840ef8a0 con 0x7f6c9c102790 2024-09-12T02:47:37.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.268+0000 7f6c99e00640 1 --2- 172.21.15.18:0/1835067848 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f6c800a2c90 0x7f6c800a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:37.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.269+0000 7f6c99e00640 1 --2- 172.21.15.18:0/1835067848 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f6c800a2c90 0x7f6c800a5150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009fc0 tx=0x7f6c8c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:37.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.272+0000 7f6c93400640 1 -- 172.21.15.18:0/1835067848 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6c840bbc40 con 0x7f6c9c102790 2024-09-12T02:47:37.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.459+0000 7f6ca0e00640 1 -- 172.21.15.18:0/1835067848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6c9c02d7c0 con 0x7f6c9c102790 2024-09-12T02:47:37.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.460+0000 7f6c93400640 1 -- 172.21.15.18:0/1835067848 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6c840bff40 con 0x7f6c9c102790 2024-09-12T02:47:37.461 INFO:teuthology.orchestra.run.smithi018.stdout:55834574939 2024-09-12T02:47:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.462+0000 7f6ca0e00640 1 -- 172.21.15.18:0/1835067848 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f6c800a2c90 msgr2=0x7f6c800a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.462+0000 7f6ca0e00640 1 --2- 172.21.15.18:0/1835067848 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f6c800a2c90 0x7f6c800a5150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009fc0 tx=0x7f6c8c005f90 comp rx=0 tx=0).stop 2024-09-12T02:47:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.462+0000 7f6ca0e00640 1 -- 172.21.15.18:0/1835067848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c9c102790 msgr2=0x7f6c9c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.462+0000 7f6ca0e00640 1 --2- 172.21.15.18:0/1835067848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c9c102790 0x7f6c9c074a30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6c84006010 tx=0x7f6c84004040 comp rx=0 tx=0).stop 2024-09-12T02:47:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.462+0000 7f6ca0e00640 1 -- 172.21.15.18:0/1835067848 shutdown_connections 2024-09-12T02:47:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.462+0000 7f6ca0e00640 1 --2- 172.21.15.18:0/1835067848 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f6c800a2c90 0x7f6c800a5150 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.462+0000 7f6ca0e00640 1 --2- 172.21.15.18:0/1835067848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c9c106f10 0x7f6c9c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.462+0000 7f6ca0e00640 1 --2- 172.21.15.18:0/1835067848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c9c102790 0x7f6c9c074a30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.462+0000 7f6ca0e00640 1 --2- 172.21.15.18:0/1835067848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c9c101de0 0x7f6c9c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.462+0000 7f6ca0e00640 1 -- 172.21.15.18:0/1835067848 >> 172.21.15.18:0/1835067848 conn(0x7f6c9c0fd8c0 msgr2=0x7f6c9c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.462+0000 7f6ca0e00640 1 -- 172.21.15.18:0/1835067848 shutdown_connections 2024-09-12T02:47:37.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:37.462+0000 7f6ca0e00640 1 -- 172.21.15.18:0/1835067848 wait complete. 2024-09-12T02:47:37.509 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:37.509 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:37.510 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:37.510 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:37 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:37.510 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:37 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1835067848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:47:37.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:37.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:37.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:37.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:37 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:37.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:37 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1835067848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:47:37.908 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411412 got 77309411415 for osd.2 2024-09-12T02:47:37.908 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:37.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:37.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:37.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:37.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:37 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:37.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:37 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1835067848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:47:38.701 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574934 got 55834574939 for osd.1 2024-09-12T02:47:38.701 DEBUG:teuthology.parallel:result is None 2024-09-12T02:47:38.702 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T02:47:38.702 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:47:38.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:38 smithi062 ceph-mon[35527]: pgmap v371: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:47:38.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:38 smithi018 ceph-mon[30616]: pgmap v371: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:47:38.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:38 smithi176 ceph-mon[35713]: pgmap v371: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:47:39.622 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.267+0000 7f5dd1600640 1 -- 172.21.15.18:0/3409082568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc1049a0 msgr2=0x7f5dcc1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.267+0000 7f5dd1600640 1 --2- 172.21.15.18:0/3409082568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc1049a0 0x7f5dcc1089f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009900 tx=0x7f5db402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.267+0000 7f5dd1600640 1 -- 172.21.15.18:0/3409082568 shutdown_connections 2024-09-12T02:47:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.267+0000 7f5dd1600640 1 --2- 172.21.15.18:0/3409082568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dcc109120 0x7f5dcc110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.267+0000 7f5dd1600640 1 --2- 172.21.15.18:0/3409082568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc1049a0 0x7f5dcc1089f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.267+0000 7f5dd1600640 1 --2- 172.21.15.18:0/3409082568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dcc103ff0 0x7f5dcc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.267+0000 7f5dd1600640 1 -- 172.21.15.18:0/3409082568 >> 172.21.15.18:0/3409082568 conn(0x7f5dcc0ffa90 msgr2=0x7f5dcc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.267+0000 7f5dd1600640 1 -- 172.21.15.18:0/3409082568 shutdown_connections 2024-09-12T02:47:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.267+0000 7f5dd1600640 1 -- 172.21.15.18:0/3409082568 wait complete. 2024-09-12T02:47:40.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.268+0000 7f5dd1600640 1 Processor -- start 2024-09-12T02:47:40.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.268+0000 7f5dd1600640 1 -- start start 2024-09-12T02:47:40.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.269+0000 7f5dd1600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dcc103ff0 0x7f5dcc19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:40.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.269+0000 7f5dd1600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc1049a0 0x7f5dcc19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:40.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.269+0000 7f5dd1600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dcc109120 0x7f5dcc19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:40.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.269+0000 7f5dd1600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc114140 con 0x7f5dcc1049a0 2024-09-12T02:47:40.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.269+0000 7f5dd1600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc113fc0 con 0x7f5dcc109120 2024-09-12T02:47:40.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.269+0000 7f5dd1600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc1142c0 con 0x7f5dcc103ff0 2024-09-12T02:47:40.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.269+0000 7f5dc3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc1049a0 0x7f5dcc19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.269+0000 7f5dc3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc1049a0 0x7f5dcc19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58462/0 (socket says 172.21.15.18:58462) 2024-09-12T02:47:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.269+0000 7f5dc3e00640 1 -- 172.21.15.18:0/2396264065 learned_addr learned my addr 172.21.15.18:0/2396264065 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.269+0000 7f5dcaa00640 1 --2- 172.21.15.18:0/2396264065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dcc103ff0 0x7f5dcc19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.269+0000 7f5dcb400640 1 --2- 172.21.15.18:0/2396264065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dcc109120 0x7f5dcc19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.269+0000 7f5dc3e00640 1 -- 172.21.15.18:0/2396264065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dcc103ff0 msgr2=0x7f5dcc19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.270+0000 7f5dc3e00640 1 --2- 172.21.15.18:0/2396264065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dcc103ff0 0x7f5dcc19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.270+0000 7f5dc3e00640 1 -- 172.21.15.18:0/2396264065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dcc109120 msgr2=0x7f5dcc19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.270+0000 7f5dc3e00640 1 --2- 172.21.15.18:0/2396264065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dcc109120 0x7f5dcc19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.270+0000 7f5dc3e00640 1 -- 172.21.15.18:0/2396264065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc19f5d0 con 0x7f5dcc1049a0 2024-09-12T02:47:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.270+0000 7f5dc3e00640 1 --2- 172.21.15.18:0/2396264065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc1049a0 0x7f5dcc19ab60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5db4006010 tx=0x7f5db4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:40.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.270+0000 7f5dc3400640 1 -- 172.21.15.18:0/2396264065 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db403f030 con 0x7f5dcc1049a0 2024-09-12T02:47:40.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.270+0000 7f5dc3400640 1 -- 172.21.15.18:0/2396264065 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5db4004440 con 0x7f5dcc1049a0 2024-09-12T02:47:40.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.270+0000 7f5dd1600640 1 -- 172.21.15.18:0/2396264065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dcc19f860 con 0x7f5dcc1049a0 2024-09-12T02:47:40.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.271+0000 7f5dd1600640 1 -- 172.21.15.18:0/2396264065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dcc1a71a0 con 0x7f5dcc1049a0 2024-09-12T02:47:40.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.271+0000 7f5dc3400640 1 -- 172.21.15.18:0/2396264065 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db4035070 con 0x7f5dcc1049a0 2024-09-12T02:47:40.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.272+0000 7f5dd1600640 1 -- 172.21.15.18:0/2396264065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dcc1043d0 con 0x7f5dcc1049a0 2024-09-12T02:47:40.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.275+0000 7f5dc3400640 1 -- 172.21.15.18:0/2396264065 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5db4042030 con 0x7f5dcc1049a0 2024-09-12T02:47:40.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.276+0000 7f5dc3400640 1 --2- 172.21.15.18:0/2396264065 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5db00a2c90 0x7f5db00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:40.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.276+0000 7f5dc3400640 1 -- 172.21.15.18:0/2396264065 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f5db40ef7e0 con 0x7f5dcc1049a0 2024-09-12T02:47:40.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.277+0000 7f5dcaa00640 1 --2- 172.21.15.18:0/2396264065 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5db00a2c90 0x7f5db00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:40.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.277+0000 7f5dcaa00640 1 --2- 172.21.15.18:0/2396264065 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5db00a2c90 0x7f5db00a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc009bd0 tx=0x7f5dbc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:40.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.280+0000 7f5dc3400640 1 -- 172.21.15.18:0/2396264065 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5db40bc1d0 con 0x7f5dcc1049a0 2024-09-12T02:47:40.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.493+0000 7f5dd1600640 1 -- 172.21.15.18:0/2396264065 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5dcc10c3c0 con 0x7f5db00a2c90 2024-09-12T02:47:40.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.502+0000 7f5dc3400640 1 -- 172.21.15.18:0/2396264065 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340406 (secure 0 0 0) 0x7f5dcc10c3c0 con 0x7f5db00a2c90 2024-09-12T02:47:40.507 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:47:40.508 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-12T02:47:40.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.507+0000 7f5dd1600640 1 -- 172.21.15.18:0/2396264065 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5db00a2c90 msgr2=0x7f5db00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:40.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.507+0000 7f5dd1600640 1 --2- 172.21.15.18:0/2396264065 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5db00a2c90 0x7f5db00a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc009bd0 tx=0x7f5dbc005f90 comp rx=0 tx=0).stop 2024-09-12T02:47:40.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.507+0000 7f5dd1600640 1 -- 172.21.15.18:0/2396264065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc1049a0 msgr2=0x7f5dcc19ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:40.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.507+0000 7f5dd1600640 1 --2- 172.21.15.18:0/2396264065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc1049a0 0x7f5dcc19ab60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5db4006010 tx=0x7f5db4004040 comp rx=0 tx=0).stop 2024-09-12T02:47:40.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.507+0000 7f5dd1600640 1 -- 172.21.15.18:0/2396264065 shutdown_connections 2024-09-12T02:47:40.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.507+0000 7f5dd1600640 1 --2- 172.21.15.18:0/2396264065 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5db00a2c90 0x7f5db00a5150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.507+0000 7f5dd1600640 1 --2- 172.21.15.18:0/2396264065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dcc109120 0x7f5dcc19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.507+0000 7f5dd1600640 1 --2- 172.21.15.18:0/2396264065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc1049a0 0x7f5dcc19ab60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.507+0000 7f5dd1600640 1 --2- 172.21.15.18:0/2396264065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5dcc103ff0 0x7f5dcc19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:40.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.507+0000 7f5dd1600640 1 -- 172.21.15.18:0/2396264065 >> 172.21.15.18:0/2396264065 conn(0x7f5dcc0ffa90 msgr2=0x7f5dcc100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:40.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.507+0000 7f5dd1600640 1 -- 172.21.15.18:0/2396264065 shutdown_connections 2024-09-12T02:47:40.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:40.507+0000 7f5dd1600640 1 -- 172.21.15.18:0/2396264065 wait complete. 2024-09-12T02:47:40.522 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:40 smithi018 ceph-mon[30616]: pgmap v372: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:47:40.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:40 smithi062 ceph-mon[35527]: pgmap v372: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:47:40.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:40 smithi176 ceph-mon[35713]: pgmap v372: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:47:41.323 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":372,"stamp":"2024-09-12T02:47:38.644281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662432,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":791,"num_read_kb":523,"num_write":434,"num_write_kb":3086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":355,"ondisk_log_size":355,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360648,"kb_used_data":15488,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124581176,"statfs":{"total":1151940427776,"available":1151571124224,"internally_reserved":0,"allocated":15859712,"data_stored":8738570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003484"},"pg_stats":[{"pgid":"2.1f","version":"96'13","reported_seq":123,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:37.768493+0000","last_change":"2024-09-12T02:45:32.388516+0000","last_active":"2024-09-12T02:47:37.768493+0000","last_peered":"2024-09-12T02:47:37.768493+0000","last_clean":"2024-09-12T02:47:37.768493+0000","last_became_active":"2024-09-12T02:45:32.388066+0000","last_became_peered":"2024-09-12T02:45:32.388066+0000","last_unstale":"2024-09-12T02:47:37.768493+0000","last_undegraded":"2024-09-12T02:47:37.768493+0000","last_fullsized":"2024-09-12T02:47:37.768493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:51.222779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689555+0000","last_change":"2024-09-12T02:45:35.434469+0000","last_active":"2024-09-12T02:47:12.689555+0000","last_peered":"2024-09-12T02:47:12.689555+0000","last_clean":"2024-09-12T02:47:12.689555+0000","last_became_active":"2024-09-12T02:45:35.431803+0000","last_became_peered":"2024-09-12T02:45:35.431803+0000","last_unstale":"2024-09-12T02:47:12.689555+0000","last_undegraded":"2024-09-12T02:47:12.689555+0000","last_fullsized":"2024-09-12T02:47:12.689555+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:00.826976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.690917+0000","last_change":"2024-09-12T02:47:12.690917+0000","last_active":"2024-09-12T02:47:12.690917+0000","last_peered":"2024-09-12T02:47:12.690917+0000","last_clean":"2024-09-12T02:47:12.690917+0000","last_became_active":"2024-09-12T02:47:12.690487+0000","last_became_peered":"2024-09-12T02:47:12.690487+0000","last_unstale":"2024-09-12T02:47:12.690917+0000","last_undegraded":"2024-09-12T02:47:12.690917+0000","last_fullsized":"2024-09-12T02:47:12.690917+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:16.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"96'2","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689861+0000","last_change":"2024-09-12T02:45:32.479037+0000","last_active":"2024-09-12T02:47:12.689861+0000","last_peered":"2024-09-12T02:47:12.689861+0000","last_clean":"2024-09-12T02:47:12.689861+0000","last_became_active":"2024-09-12T02:45:32.477071+0000","last_became_peered":"2024-09-12T02:45:32.477071+0000","last_unstale":"2024-09-12T02:47:12.689861+0000","last_undegraded":"2024-09-12T02:47:12.689861+0000","last_fullsized":"2024-09-12T02:47:12.689861+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:29.512142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612561+0000","last_change":"2024-09-12T02:45:35.418226+0000","last_active":"2024-09-12T02:47:12.612561+0000","last_peered":"2024-09-12T02:47:12.612561+0000","last_clean":"2024-09-12T02:47:12.612561+0000","last_became_active":"2024-09-12T02:45:35.417910+0000","last_became_peered":"2024-09-12T02:45:35.417910+0000","last_unstale":"2024-09-12T02:47:12.612561+0000","last_undegraded":"2024-09-12T02:47:12.612561+0000","last_fullsized":"2024-09-12T02:47:12.612561+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:06.788584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707011+0000","last_change":"2024-09-12T02:45:45.487575+0000","last_active":"2024-09-12T02:47:12.707011+0000","last_peered":"2024-09-12T02:47:12.707011+0000","last_clean":"2024-09-12T02:47:12.707011+0000","last_became_active":"2024-09-12T02:45:45.487246+0000","last_became_peered":"2024-09-12T02:45:45.487246+0000","last_unstale":"2024-09-12T02:47:12.707011+0000","last_undegraded":"2024-09-12T02:47:12.707011+0000","last_fullsized":"2024-09-12T02:47:12.707011+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:06.068200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"96'12","reported_seq":57,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.617653+0000","last_change":"2024-09-12T02:45:32.393707+0000","last_active":"2024-09-12T02:47:12.617653+0000","last_peered":"2024-09-12T02:47:12.617653+0000","last_clean":"2024-09-12T02:47:12.617653+0000","last_became_active":"2024-09-12T02:45:32.393305+0000","last_became_peered":"2024-09-12T02:45:32.393305+0000","last_unstale":"2024-09-12T02:47:12.617653+0000","last_undegraded":"2024-09-12T02:47:12.617653+0000","last_fullsized":"2024-09-12T02:47:12.617653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:02.755660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.614324+0000","last_change":"2024-09-12T02:45:35.432556+0000","last_active":"2024-09-12T02:47:12.614324+0000","last_peered":"2024-09-12T02:47:12.614324+0000","last_clean":"2024-09-12T02:47:12.614324+0000","last_became_active":"2024-09-12T02:45:35.431164+0000","last_became_peered":"2024-09-12T02:45:35.431164+0000","last_unstale":"2024-09-12T02:47:12.614324+0000","last_undegraded":"2024-09-12T02:47:12.614324+0000","last_fullsized":"2024-09-12T02:47:12.614324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:11.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707932+0000","last_change":"2024-09-12T02:45:45.493518+0000","last_active":"2024-09-12T02:47:12.707932+0000","last_peered":"2024-09-12T02:47:12.707932+0000","last_clean":"2024-09-12T02:47:12.707932+0000","last_became_active":"2024-09-12T02:45:45.492902+0000","last_became_peered":"2024-09-12T02:45:45.492902+0000","last_unstale":"2024-09-12T02:47:12.707932+0000","last_undegraded":"2024-09-12T02:47:12.707932+0000","last_fullsized":"2024-09-12T02:47:12.707932+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:11.278901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"96'5","reported_seq":50,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.617691+0000","last_change":"2024-09-12T02:45:32.388552+0000","last_active":"2024-09-12T02:47:12.617691+0000","last_peered":"2024-09-12T02:47:12.617691+0000","last_clean":"2024-09-12T02:47:12.617691+0000","last_became_active":"2024-09-12T02:45:32.388168+0000","last_became_peered":"2024-09-12T02:45:32.388168+0000","last_unstale":"2024-09-12T02:47:12.617691+0000","last_undegraded":"2024-09-12T02:47:12.617691+0000","last_fullsized":"2024-09-12T02:47:12.617691+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:29.803240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707093+0000","last_change":"2024-09-12T02:46:12.951385+0000","last_active":"2024-09-12T02:47:12.707093+0000","last_peered":"2024-09-12T02:47:12.707093+0000","last_clean":"2024-09-12T02:47:12.707093+0000","last_became_active":"2024-09-12T02:46:12.950977+0000","last_became_peered":"2024-09-12T02:46:12.950977+0000","last_unstale":"2024-09-12T02:47:12.707093+0000","last_undegraded":"2024-09-12T02:47:12.707093+0000","last_fullsized":"2024-09-12T02:47:12.707093+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:59.262026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707192+0000","last_change":"2024-09-12T02:45:45.487534+0000","last_active":"2024-09-12T02:47:12.707192+0000","last_peered":"2024-09-12T02:47:12.707192+0000","last_clean":"2024-09-12T02:47:12.707192+0000","last_became_active":"2024-09-12T02:45:45.487101+0000","last_became_peered":"2024-09-12T02:45:45.487101+0000","last_unstale":"2024-09-12T02:47:12.707192+0000","last_undegraded":"2024-09-12T02:47:12.707192+0000","last_fullsized":"2024-09-12T02:47:12.707192+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:50.808850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610515+0000","last_change":"2024-09-12T02:45:35.432796+0000","last_active":"2024-09-12T02:47:12.610515+0000","last_peered":"2024-09-12T02:47:12.610515+0000","last_clean":"2024-09-12T02:47:12.610515+0000","last_became_active":"2024-09-12T02:45:35.432456+0000","last_became_peered":"2024-09-12T02:45:35.432456+0000","last_unstale":"2024-09-12T02:47:12.610515+0000","last_undegraded":"2024-09-12T02:47:12.610515+0000","last_fullsized":"2024-09-12T02:47:12.610515+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:02.597515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"96'4","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.617738+0000","last_change":"2024-09-12T02:45:32.394657+0000","last_active":"2024-09-12T02:47:12.617738+0000","last_peered":"2024-09-12T02:47:12.617738+0000","last_clean":"2024-09-12T02:47:12.617738+0000","last_became_active":"2024-09-12T02:45:32.394277+0000","last_became_peered":"2024-09-12T02:45:32.394277+0000","last_unstale":"2024-09-12T02:47:12.617738+0000","last_undegraded":"2024-09-12T02:47:12.617738+0000","last_fullsized":"2024-09-12T02:47:12.617738+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:26.614900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707556+0000","last_change":"2024-09-12T02:45:45.831567+0000","last_active":"2024-09-12T02:47:12.707556+0000","last_peered":"2024-09-12T02:47:12.707556+0000","last_clean":"2024-09-12T02:47:12.707556+0000","last_became_active":"2024-09-12T02:45:45.831124+0000","last_became_peered":"2024-09-12T02:45:45.831124+0000","last_unstale":"2024-09-12T02:47:12.707556+0000","last_undegraded":"2024-09-12T02:47:12.707556+0000","last_fullsized":"2024-09-12T02:47:12.707556+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:43.289387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689934+0000","last_change":"2024-09-12T02:45:35.435658+0000","last_active":"2024-09-12T02:47:12.689934+0000","last_peered":"2024-09-12T02:47:12.689934+0000","last_clean":"2024-09-12T02:47:12.689934+0000","last_became_active":"2024-09-12T02:45:35.434759+0000","last_became_peered":"2024-09-12T02:45:35.434759+0000","last_unstale":"2024-09-12T02:47:12.689934+0000","last_undegraded":"2024-09-12T02:47:12.689934+0000","last_fullsized":"2024-09-12T02:47:12.689934+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:49.384125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"96'3","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609819+0000","last_change":"2024-09-12T02:45:32.394125+0000","last_active":"2024-09-12T02:47:12.609819+0000","last_peered":"2024-09-12T02:47:12.609819+0000","last_clean":"2024-09-12T02:47:12.609819+0000","last_became_active":"2024-09-12T02:45:32.393797+0000","last_became_peered":"2024-09-12T02:45:32.393797+0000","last_unstale":"2024-09-12T02:47:12.609819+0000","last_undegraded":"2024-09-12T02:47:12.609819+0000","last_fullsized":"2024-09-12T02:47:12.609819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:41.553865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"96'1","reported_seq":27,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707205+0000","last_change":"2024-09-12T02:45:45.495186+0000","last_active":"2024-09-12T02:47:12.707205+0000","last_peered":"2024-09-12T02:47:12.707205+0000","last_clean":"2024-09-12T02:47:12.707205+0000","last_became_active":"2024-09-12T02:45:45.494764+0000","last_became_peered":"2024-09-12T02:45:45.494764+0000","last_unstale":"2024-09-12T02:47:12.707205+0000","last_undegraded":"2024-09-12T02:47:12.707205+0000","last_fullsized":"2024-09-12T02:47:12.707205+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:59.623399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.611985+0000","last_change":"2024-09-12T02:45:35.431606+0000","last_active":"2024-09-12T02:47:12.611985+0000","last_peered":"2024-09-12T02:47:12.611985+0000","last_clean":"2024-09-12T02:47:12.611985+0000","last_became_active":"2024-09-12T02:45:35.431259+0000","last_became_peered":"2024-09-12T02:45:35.431259+0000","last_unstale":"2024-09-12T02:47:12.611985+0000","last_undegraded":"2024-09-12T02:47:12.611985+0000","last_fullsized":"2024-09-12T02:47:12.611985+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:17.014610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"96'7","reported_seq":51,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689768+0000","last_change":"2024-09-12T02:45:32.386098+0000","last_active":"2024-09-12T02:47:12.689768+0000","last_peered":"2024-09-12T02:47:12.689768+0000","last_clean":"2024-09-12T02:47:12.689768+0000","last_became_active":"2024-09-12T02:45:32.385762+0000","last_became_peered":"2024-09-12T02:45:32.385762+0000","last_unstale":"2024-09-12T02:47:12.689768+0000","last_undegraded":"2024-09-12T02:47:12.689768+0000","last_fullsized":"2024-09-12T02:47:12.689768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:17.109916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707783+0000","last_change":"2024-09-12T02:45:45.492746+0000","last_active":"2024-09-12T02:47:12.707783+0000","last_peered":"2024-09-12T02:47:12.707783+0000","last_clean":"2024-09-12T02:47:12.707783+0000","last_became_active":"2024-09-12T02:45:45.492280+0000","last_became_peered":"2024-09-12T02:45:45.492280+0000","last_unstale":"2024-09-12T02:47:12.707783+0000","last_undegraded":"2024-09-12T02:47:12.707783+0000","last_fullsized":"2024-09-12T02:47:12.707783+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:56.585316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.616958+0000","last_change":"2024-09-12T02:45:35.430254+0000","last_active":"2024-09-12T02:47:12.616958+0000","last_peered":"2024-09-12T02:47:12.616958+0000","last_clean":"2024-09-12T02:47:12.616958+0000","last_became_active":"2024-09-12T02:45:35.429822+0000","last_became_peered":"2024-09-12T02:45:35.429822+0000","last_unstale":"2024-09-12T02:47:12.616958+0000","last_undegraded":"2024-09-12T02:47:12.616958+0000","last_fullsized":"2024-09-12T02:47:12.616958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:45.750936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"96'2","reported_seq":45,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.614745+0000","last_change":"2024-09-12T02:45:32.476950+0000","last_active":"2024-09-12T02:47:12.614745+0000","last_peered":"2024-09-12T02:47:12.614745+0000","last_clean":"2024-09-12T02:47:12.614745+0000","last_became_active":"2024-09-12T02:45:32.476619+0000","last_became_peered":"2024-09-12T02:45:32.476619+0000","last_unstale":"2024-09-12T02:47:12.614745+0000","last_undegraded":"2024-09-12T02:47:12.614745+0000","last_fullsized":"2024-09-12T02:47:12.614745+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:18.963069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707688+0000","last_change":"2024-09-12T02:45:45.833226+0000","last_active":"2024-09-12T02:47:12.707688+0000","last_peered":"2024-09-12T02:47:12.707688+0000","last_clean":"2024-09-12T02:47:12.707688+0000","last_became_active":"2024-09-12T02:45:45.832716+0000","last_became_peered":"2024-09-12T02:45:45.832716+0000","last_unstale":"2024-09-12T02:47:12.707688+0000","last_undegraded":"2024-09-12T02:47:12.707688+0000","last_fullsized":"2024-09-12T02:47:12.707688+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:12.072765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612133+0000","last_change":"2024-09-12T02:45:35.436301+0000","last_active":"2024-09-12T02:47:12.612133+0000","last_peered":"2024-09-12T02:47:12.612133+0000","last_clean":"2024-09-12T02:47:12.612133+0000","last_became_active":"2024-09-12T02:45:35.435999+0000","last_became_peered":"2024-09-12T02:45:35.435999+0000","last_unstale":"2024-09-12T02:47:12.612133+0000","last_undegraded":"2024-09-12T02:47:12.612133+0000","last_fullsized":"2024-09-12T02:47:12.612133+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:02.823154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"96'7","reported_seq":51,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.708755+0000","last_change":"2024-09-12T02:45:32.382231+0000","last_active":"2024-09-12T02:47:12.708755+0000","last_peered":"2024-09-12T02:47:12.708755+0000","last_clean":"2024-09-12T02:47:12.708755+0000","last_became_active":"2024-09-12T02:45:32.381821+0000","last_became_peered":"2024-09-12T02:45:32.381821+0000","last_unstale":"2024-09-12T02:47:12.708755+0000","last_undegraded":"2024-09-12T02:47:12.708755+0000","last_fullsized":"2024-09-12T02:47:12.708755+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:34:02.631429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609691+0000","last_change":"2024-09-12T02:45:45.481460+0000","last_active":"2024-09-12T02:47:12.609691+0000","last_peered":"2024-09-12T02:47:12.609691+0000","last_clean":"2024-09-12T02:47:12.609691+0000","last_became_active":"2024-09-12T02:45:45.480697+0000","last_became_peered":"2024-09-12T02:45:45.480697+0000","last_unstale":"2024-09-12T02:47:12.609691+0000","last_undegraded":"2024-09-12T02:47:12.609691+0000","last_fullsized":"2024-09-12T02:47:12.609691+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:34.985196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689745+0000","last_change":"2024-09-12T02:45:35.434844+0000","last_active":"2024-09-12T02:47:12.689745+0000","last_peered":"2024-09-12T02:47:12.689745+0000","last_clean":"2024-09-12T02:47:12.689745+0000","last_became_active":"2024-09-12T02:45:35.433513+0000","last_became_peered":"2024-09-12T02:45:35.433513+0000","last_unstale":"2024-09-12T02:47:12.689745+0000","last_undegraded":"2024-09-12T02:47:12.689745+0000","last_fullsized":"2024-09-12T02:47:12.689745+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:01.473202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"96'15","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707790+0000","last_change":"2024-09-12T02:45:32.389455+0000","last_active":"2024-09-12T02:47:12.707790+0000","last_peered":"2024-09-12T02:47:12.707790+0000","last_clean":"2024-09-12T02:47:12.707790+0000","last_became_active":"2024-09-12T02:45:32.388633+0000","last_became_peered":"2024-09-12T02:45:32.388633+0000","last_unstale":"2024-09-12T02:47:12.707790+0000","last_undegraded":"2024-09-12T02:47:12.707790+0000","last_fullsized":"2024-09-12T02:47:12.707790+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:34.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689082+0000","last_change":"2024-09-12T02:45:45.831697+0000","last_active":"2024-09-12T02:47:12.689082+0000","last_peered":"2024-09-12T02:47:12.689082+0000","last_clean":"2024-09-12T02:47:12.689082+0000","last_became_active":"2024-09-12T02:45:45.831167+0000","last_became_peered":"2024-09-12T02:45:45.831167+0000","last_unstale":"2024-09-12T02:47:12.689082+0000","last_undegraded":"2024-09-12T02:47:12.689082+0000","last_fullsized":"2024-09-12T02:47:12.689082+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:48.553773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609362+0000","last_change":"2024-09-12T02:45:35.423196+0000","last_active":"2024-09-12T02:47:12.609362+0000","last_peered":"2024-09-12T02:47:12.609362+0000","last_clean":"2024-09-12T02:47:12.609362+0000","last_became_active":"2024-09-12T02:45:35.422778+0000","last_became_peered":"2024-09-12T02:45:35.422778+0000","last_unstale":"2024-09-12T02:47:12.609362+0000","last_undegraded":"2024-09-12T02:47:12.609362+0000","last_fullsized":"2024-09-12T02:47:12.609362+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:37.092151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"96'4","reported_seq":20,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.611852+0000","last_change":"2024-09-12T02:46:12.558805+0000","last_active":"2024-09-12T02:47:12.611852+0000","last_peered":"2024-09-12T02:47:12.611852+0000","last_clean":"2024-09-12T02:47:12.611852+0000","last_became_active":"2024-09-12T02:46:12.558479+0000","last_became_peered":"2024-09-12T02:46:12.558479+0000","last_unstale":"2024-09-12T02:47:12.611852+0000","last_undegraded":"2024-09-12T02:47:12.611852+0000","last_fullsized":"2024-09-12T02:47:12.611852+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:28.757698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":33,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.619317+0000","last_change":"2024-09-12T02:47:12.619317+0000","last_active":"2024-09-12T02:47:12.619317+0000","last_peered":"2024-09-12T02:47:12.619317+0000","last_clean":"2024-09-12T02:47:12.619317+0000","last_became_active":"2024-09-12T02:47:12.618808+0000","last_became_peered":"2024-09-12T02:47:12.618808+0000","last_unstale":"2024-09-12T02:47:12.619317+0000","last_undegraded":"2024-09-12T02:47:12.619317+0000","last_fullsized":"2024-09-12T02:47:12.619317+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:20.339072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.708287+0000","last_change":"2024-09-12T02:45:35.432783+0000","last_active":"2024-09-12T02:47:12.708287+0000","last_peered":"2024-09-12T02:47:12.708287+0000","last_clean":"2024-09-12T02:47:12.708287+0000","last_became_active":"2024-09-12T02:45:35.432461+0000","last_became_peered":"2024-09-12T02:45:35.432461+0000","last_unstale":"2024-09-12T02:47:12.708287+0000","last_undegraded":"2024-09-12T02:47:12.708287+0000","last_fullsized":"2024-09-12T02:47:12.708287+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:20.066115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"96'1","reported_seq":46,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707432+0000","last_change":"2024-09-12T02:45:32.478636+0000","last_active":"2024-09-12T02:47:12.707432+0000","last_peered":"2024-09-12T02:47:12.707432+0000","last_clean":"2024-09-12T02:47:12.707432+0000","last_became_active":"2024-09-12T02:45:32.477347+0000","last_became_peered":"2024-09-12T02:45:32.477347+0000","last_unstale":"2024-09-12T02:47:12.707432+0000","last_undegraded":"2024-09-12T02:47:12.707432+0000","last_fullsized":"2024-09-12T02:47:12.707432+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:02.872897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.616944+0000","last_change":"2024-09-12T02:45:45.831550+0000","last_active":"2024-09-12T02:47:12.616944+0000","last_peered":"2024-09-12T02:47:12.616944+0000","last_clean":"2024-09-12T02:47:12.616944+0000","last_became_active":"2024-09-12T02:45:45.831004+0000","last_became_peered":"2024-09-12T02:45:45.831004+0000","last_unstale":"2024-09-12T02:47:12.616944+0000","last_undegraded":"2024-09-12T02:47:12.616944+0000","last_fullsized":"2024-09-12T02:47:12.616944+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:24.183273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.708099+0000","last_change":"2024-09-12T02:45:35.417296+0000","last_active":"2024-09-12T02:47:12.708099+0000","last_peered":"2024-09-12T02:47:12.708099+0000","last_clean":"2024-09-12T02:47:12.708099+0000","last_became_active":"2024-09-12T02:45:35.416963+0000","last_became_peered":"2024-09-12T02:45:35.416963+0000","last_unstale":"2024-09-12T02:47:12.708099+0000","last_undegraded":"2024-09-12T02:47:12.708099+0000","last_fullsized":"2024-09-12T02:47:12.708099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:22.945974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"96'6","reported_seq":115,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:36.767635+0000","last_change":"2024-09-12T02:45:32.387264+0000","last_active":"2024-09-12T02:47:36.767635+0000","last_peered":"2024-09-12T02:47:36.767635+0000","last_clean":"2024-09-12T02:47:36.767635+0000","last_became_active":"2024-09-12T02:45:32.386900+0000","last_became_peered":"2024-09-12T02:45:32.386900+0000","last_unstale":"2024-09-12T02:47:36.767635+0000","last_undegraded":"2024-09-12T02:47:36.767635+0000","last_fullsized":"2024-09-12T02:47:36.767635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:26.638049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609267+0000","last_change":"2024-09-12T02:45:45.481793+0000","last_active":"2024-09-12T02:47:12.609267+0000","last_peered":"2024-09-12T02:47:12.609267+0000","last_clean":"2024-09-12T02:47:12.609267+0000","last_became_active":"2024-09-12T02:45:45.481265+0000","last_became_peered":"2024-09-12T02:45:45.481265+0000","last_unstale":"2024-09-12T02:47:12.609267+0000","last_undegraded":"2024-09-12T02:47:12.609267+0000","last_fullsized":"2024-09-12T02:47:12.609267+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:24.568713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707233+0000","last_change":"2024-09-12T02:45:35.432102+0000","last_active":"2024-09-12T02:47:12.707233+0000","last_peered":"2024-09-12T02:47:12.707233+0000","last_clean":"2024-09-12T02:47:12.707233+0000","last_became_active":"2024-09-12T02:45:35.431521+0000","last_became_peered":"2024-09-12T02:45:35.431521+0000","last_unstale":"2024-09-12T02:47:12.707233+0000","last_undegraded":"2024-09-12T02:47:12.707233+0000","last_fullsized":"2024-09-12T02:47:12.707233+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:40.669668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"96'5","reported_seq":111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:33.762767+0000","last_change":"2024-09-12T02:45:32.479322+0000","last_active":"2024-09-12T02:47:33.762767+0000","last_peered":"2024-09-12T02:47:33.762767+0000","last_clean":"2024-09-12T02:47:33.762767+0000","last_became_active":"2024-09-12T02:45:32.478565+0000","last_became_peered":"2024-09-12T02:45:32.478565+0000","last_unstale":"2024-09-12T02:47:33.762767+0000","last_undegraded":"2024-09-12T02:47:33.762767+0000","last_fullsized":"2024-09-12T02:47:33.762767+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:03.400545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609195+0000","last_change":"2024-09-12T02:45:45.831894+0000","last_active":"2024-09-12T02:47:12.609195+0000","last_peered":"2024-09-12T02:47:12.609195+0000","last_clean":"2024-09-12T02:47:12.609195+0000","last_became_active":"2024-09-12T02:45:45.831365+0000","last_became_peered":"2024-09-12T02:45:45.831365+0000","last_unstale":"2024-09-12T02:47:12.609195+0000","last_undegraded":"2024-09-12T02:47:12.609195+0000","last_fullsized":"2024-09-12T02:47:12.609195+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:57.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.608945+0000","last_change":"2024-09-12T02:45:35.419676+0000","last_active":"2024-09-12T02:47:12.608945+0000","last_peered":"2024-09-12T02:47:12.608945+0000","last_clean":"2024-09-12T02:47:12.608945+0000","last_became_active":"2024-09-12T02:45:35.419371+0000","last_became_peered":"2024-09-12T02:45:35.419371+0000","last_unstale":"2024-09-12T02:47:12.608945+0000","last_undegraded":"2024-09-12T02:47:12.608945+0000","last_fullsized":"2024-09-12T02:47:12.608945+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:19.303214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"96'4","reported_seq":48,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610873+0000","last_change":"2024-09-12T02:45:32.389855+0000","last_active":"2024-09-12T02:47:12.610873+0000","last_peered":"2024-09-12T02:47:12.610873+0000","last_clean":"2024-09-12T02:47:12.610873+0000","last_became_active":"2024-09-12T02:45:32.389457+0000","last_became_peered":"2024-09-12T02:45:32.389457+0000","last_unstale":"2024-09-12T02:47:12.610873+0000","last_undegraded":"2024-09-12T02:47:12.610873+0000","last_fullsized":"2024-09-12T02:47:12.610873+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:41.540961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707495+0000","last_change":"2024-09-12T02:45:45.832346+0000","last_active":"2024-09-12T02:47:12.707495+0000","last_peered":"2024-09-12T02:47:12.707495+0000","last_clean":"2024-09-12T02:47:12.707495+0000","last_became_active":"2024-09-12T02:45:45.831810+0000","last_became_peered":"2024-09-12T02:45:45.831810+0000","last_unstale":"2024-09-12T02:47:12.707495+0000","last_undegraded":"2024-09-12T02:47:12.707495+0000","last_fullsized":"2024-09-12T02:47:12.707495+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:08.388606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689701+0000","last_change":"2024-09-12T02:45:35.437560+0000","last_active":"2024-09-12T02:47:12.689701+0000","last_peered":"2024-09-12T02:47:12.689701+0000","last_clean":"2024-09-12T02:47:12.689701+0000","last_became_active":"2024-09-12T02:45:35.435837+0000","last_became_peered":"2024-09-12T02:45:35.435837+0000","last_unstale":"2024-09-12T02:47:12.689701+0000","last_undegraded":"2024-09-12T02:47:12.689701+0000","last_fullsized":"2024-09-12T02:47:12.689701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:21.171560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"96'6","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.708291+0000","last_change":"2024-09-12T02:45:32.385075+0000","last_active":"2024-09-12T02:47:12.708291+0000","last_peered":"2024-09-12T02:47:12.708291+0000","last_clean":"2024-09-12T02:47:12.708291+0000","last_became_active":"2024-09-12T02:45:32.384569+0000","last_became_peered":"2024-09-12T02:45:32.384569+0000","last_unstale":"2024-09-12T02:47:12.708291+0000","last_undegraded":"2024-09-12T02:47:12.708291+0000","last_fullsized":"2024-09-12T02:47:12.708291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:32.962756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":370,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610936+0000","last_change":"2024-09-12T02:44:18.042779+0000","last_active":"2024-09-12T02:47:12.610936+0000","last_peered":"2024-09-12T02:47:12.610936+0000","last_clean":"2024-09-12T02:47:12.610936+0000","last_became_active":"2024-09-12T02:44:18.042265+0000","last_became_peered":"2024-09-12T02:44:18.042265+0000","last_unstale":"2024-09-12T02:47:12.610936+0000","last_undegraded":"2024-09-12T02:47:12.610936+0000","last_fullsized":"2024-09-12T02:47:12.610936+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:40:35.543336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:40:35.543336+0000","last_clean_scrub_stamp":"2024-09-12T02:40:35.543336+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:22.348756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"96'1","reported_seq":27,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610627+0000","last_change":"2024-09-12T02:45:45.492737+0000","last_active":"2024-09-12T02:47:12.610627+0000","last_peered":"2024-09-12T02:47:12.610627+0000","last_clean":"2024-09-12T02:47:12.610627+0000","last_became_active":"2024-09-12T02:45:45.492280+0000","last_became_peered":"2024-09-12T02:45:45.492280+0000","last_unstale":"2024-09-12T02:47:12.610627+0000","last_undegraded":"2024-09-12T02:47:12.610627+0000","last_fullsized":"2024-09-12T02:47:12.610627+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:45.530066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610971+0000","last_change":"2024-09-12T02:45:35.431876+0000","last_active":"2024-09-12T02:47:12.610971+0000","last_peered":"2024-09-12T02:47:12.610971+0000","last_clean":"2024-09-12T02:47:12.610971+0000","last_became_active":"2024-09-12T02:45:35.431505+0000","last_became_peered":"2024-09-12T02:45:35.431505+0000","last_unstale":"2024-09-12T02:47:12.610971+0000","last_undegraded":"2024-09-12T02:47:12.610971+0000","last_fullsized":"2024-09-12T02:47:12.610971+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:30.370034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"96'6","reported_seq":114,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:33.764126+0000","last_change":"2024-09-12T02:45:32.477394+0000","last_active":"2024-09-12T02:47:33.764126+0000","last_peered":"2024-09-12T02:47:33.764126+0000","last_clean":"2024-09-12T02:47:33.764126+0000","last_became_active":"2024-09-12T02:45:32.477064+0000","last_became_peered":"2024-09-12T02:45:32.477064+0000","last_unstale":"2024-09-12T02:47:33.764126+0000","last_undegraded":"2024-09-12T02:47:33.764126+0000","last_fullsized":"2024-09-12T02:47:33.764126+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:03.828652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.614246+0000","last_change":"2024-09-12T02:45:45.481201+0000","last_active":"2024-09-12T02:47:12.614246+0000","last_peered":"2024-09-12T02:47:12.614246+0000","last_clean":"2024-09-12T02:47:12.614246+0000","last_became_active":"2024-09-12T02:45:45.480721+0000","last_became_peered":"2024-09-12T02:45:45.480721+0000","last_unstale":"2024-09-12T02:47:12.614246+0000","last_undegraded":"2024-09-12T02:47:12.614246+0000","last_fullsized":"2024-09-12T02:47:12.614246+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:12.780521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610487+0000","last_change":"2024-09-12T02:45:35.440920+0000","last_active":"2024-09-12T02:47:12.610487+0000","last_peered":"2024-09-12T02:47:12.610487+0000","last_clean":"2024-09-12T02:47:12.610487+0000","last_became_active":"2024-09-12T02:45:35.440566+0000","last_became_peered":"2024-09-12T02:45:35.440566+0000","last_unstale":"2024-09-12T02:47:12.610487+0000","last_undegraded":"2024-09-12T02:47:12.610487+0000","last_fullsized":"2024-09-12T02:47:12.610487+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:19.171841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"96'3","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707845+0000","last_change":"2024-09-12T02:45:32.388589+0000","last_active":"2024-09-12T02:47:12.707845+0000","last_peered":"2024-09-12T02:47:12.707845+0000","last_clean":"2024-09-12T02:47:12.707845+0000","last_became_active":"2024-09-12T02:45:32.388243+0000","last_became_peered":"2024-09-12T02:45:32.388243+0000","last_unstale":"2024-09-12T02:47:12.707845+0000","last_undegraded":"2024-09-12T02:47:12.707845+0000","last_fullsized":"2024-09-12T02:47:12.707845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:23.747525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.709684+0000","last_change":"2024-09-12T02:47:12.709684+0000","last_active":"2024-09-12T02:47:12.709684+0000","last_peered":"2024-09-12T02:47:12.709684+0000","last_clean":"2024-09-12T02:47:12.709684+0000","last_became_active":"2024-09-12T02:47:12.709272+0000","last_became_peered":"2024-09-12T02:47:12.709272+0000","last_unstale":"2024-09-12T02:47:12.709684+0000","last_undegraded":"2024-09-12T02:47:12.709684+0000","last_fullsized":"2024-09-12T02:47:12.709684+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:45.198897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,10,1,4],"acting":[0,10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610525+0000","last_change":"2024-09-12T02:45:35.427871+0000","last_active":"2024-09-12T02:47:12.610525+0000","last_peered":"2024-09-12T02:47:12.610525+0000","last_clean":"2024-09-12T02:47:12.610525+0000","last_became_active":"2024-09-12T02:45:35.427499+0000","last_became_peered":"2024-09-12T02:45:35.427499+0000","last_unstale":"2024-09-12T02:47:12.610525+0000","last_undegraded":"2024-09-12T02:47:12.610525+0000","last_fullsized":"2024-09-12T02:47:12.610525+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:15.515311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"96'5","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609661+0000","last_change":"2024-09-12T02:45:32.389199+0000","last_active":"2024-09-12T02:47:12.609661+0000","last_peered":"2024-09-12T02:47:12.609661+0000","last_clean":"2024-09-12T02:47:12.609661+0000","last_became_active":"2024-09-12T02:45:32.388885+0000","last_became_peered":"2024-09-12T02:45:32.388885+0000","last_unstale":"2024-09-12T02:47:12.609661+0000","last_undegraded":"2024-09-12T02:47:12.609661+0000","last_fullsized":"2024-09-12T02:47:12.609661+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.002707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707028+0000","last_change":"2024-09-12T02:45:45.485171+0000","last_active":"2024-09-12T02:47:12.707028+0000","last_peered":"2024-09-12T02:47:12.707028+0000","last_clean":"2024-09-12T02:47:12.707028+0000","last_became_active":"2024-09-12T02:45:45.484540+0000","last_became_peered":"2024-09-12T02:45:45.484540+0000","last_unstale":"2024-09-12T02:47:12.707028+0000","last_undegraded":"2024-09-12T02:47:12.707028+0000","last_fullsized":"2024-09-12T02:47:12.707028+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:52.063588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612231+0000","last_change":"2024-09-12T02:46:12.951994+0000","last_active":"2024-09-12T02:47:12.612231+0000","last_peered":"2024-09-12T02:47:12.612231+0000","last_clean":"2024-09-12T02:47:12.612231+0000","last_became_active":"2024-09-12T02:46:12.951653+0000","last_became_peered":"2024-09-12T02:46:12.951653+0000","last_unstale":"2024-09-12T02:47:12.612231+0000","last_undegraded":"2024-09-12T02:47:12.612231+0000","last_fullsized":"2024-09-12T02:47:12.612231+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:35.221403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"96'2","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.617586+0000","last_change":"2024-09-12T02:45:32.390592+0000","last_active":"2024-09-12T02:47:12.617586+0000","last_peered":"2024-09-12T02:47:12.617586+0000","last_clean":"2024-09-12T02:47:12.617586+0000","last_became_active":"2024-09-12T02:45:32.390211+0000","last_became_peered":"2024-09-12T02:45:32.390211+0000","last_unstale":"2024-09-12T02:47:12.617586+0000","last_undegraded":"2024-09-12T02:47:12.617586+0000","last_fullsized":"2024-09-12T02:47:12.617586+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:04.437645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707269+0000","last_change":"2024-09-12T02:45:45.491332+0000","last_active":"2024-09-12T02:47:12.707269+0000","last_peered":"2024-09-12T02:47:12.707269+0000","last_clean":"2024-09-12T02:47:12.707269+0000","last_became_active":"2024-09-12T02:45:45.490943+0000","last_became_peered":"2024-09-12T02:45:45.490943+0000","last_unstale":"2024-09-12T02:47:12.707269+0000","last_undegraded":"2024-09-12T02:47:12.707269+0000","last_fullsized":"2024-09-12T02:47:12.707269+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:50.154253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707384+0000","last_change":"2024-09-12T02:45:35.426119+0000","last_active":"2024-09-12T02:47:12.707384+0000","last_peered":"2024-09-12T02:47:12.707384+0000","last_clean":"2024-09-12T02:47:12.707384+0000","last_became_active":"2024-09-12T02:45:35.425740+0000","last_became_peered":"2024-09-12T02:45:35.425740+0000","last_unstale":"2024-09-12T02:47:12.707384+0000","last_undegraded":"2024-09-12T02:47:12.707384+0000","last_fullsized":"2024-09-12T02:47:12.707384+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:36.451449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"96'17","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.628813+0000","last_change":"2024-09-12T02:47:12.628461+0000","last_active":"2024-09-12T02:47:12.628813+0000","last_peered":"2024-09-12T02:47:12.628813+0000","last_clean":"2024-09-12T02:47:12.628813+0000","last_became_active":"2024-09-12T02:47:12.615376+0000","last_became_peered":"2024-09-12T02:47:12.615376+0000","last_unstale":"2024-09-12T02:47:12.628813+0000","last_undegraded":"2024-09-12T02:47:12.628813+0000","last_fullsized":"2024-09-12T02:47:12.628813+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:23.818238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,1],"acting":[11,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609627+0000","last_change":"2024-09-12T02:45:45.493917+0000","last_active":"2024-09-12T02:47:12.609627+0000","last_peered":"2024-09-12T02:47:12.609627+0000","last_clean":"2024-09-12T02:47:12.609627+0000","last_became_active":"2024-09-12T02:45:45.493488+0000","last_became_peered":"2024-09-12T02:45:45.493488+0000","last_unstale":"2024-09-12T02:47:12.609627+0000","last_undegraded":"2024-09-12T02:47:12.609627+0000","last_fullsized":"2024-09-12T02:47:12.609627+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:27.092953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610235+0000","last_change":"2024-09-12T02:45:35.423430+0000","last_active":"2024-09-12T02:47:12.610235+0000","last_peered":"2024-09-12T02:47:12.610235+0000","last_clean":"2024-09-12T02:47:12.610235+0000","last_became_active":"2024-09-12T02:45:35.423097+0000","last_became_peered":"2024-09-12T02:45:35.423097+0000","last_unstale":"2024-09-12T02:47:12.610235+0000","last_undegraded":"2024-09-12T02:47:12.610235+0000","last_fullsized":"2024-09-12T02:47:12.610235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:53.823140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"96'5","reported_seq":113,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:35.766393+0000","last_change":"2024-09-12T02:45:32.384965+0000","last_active":"2024-09-12T02:47:35.766393+0000","last_peered":"2024-09-12T02:47:35.766393+0000","last_clean":"2024-09-12T02:47:35.766393+0000","last_became_active":"2024-09-12T02:45:32.384369+0000","last_became_peered":"2024-09-12T02:45:32.384369+0000","last_unstale":"2024-09-12T02:47:35.766393+0000","last_undegraded":"2024-09-12T02:47:35.766393+0000","last_fullsized":"2024-09-12T02:47:35.766393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:43.022766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707889+0000","last_change":"2024-09-12T02:45:45.491338+0000","last_active":"2024-09-12T02:47:12.707889+0000","last_peered":"2024-09-12T02:47:12.707889+0000","last_clean":"2024-09-12T02:47:12.707889+0000","last_became_active":"2024-09-12T02:45:45.490578+0000","last_became_peered":"2024-09-12T02:45:45.490578+0000","last_unstale":"2024-09-12T02:47:12.707889+0000","last_undegraded":"2024-09-12T02:47:12.707889+0000","last_fullsized":"2024-09-12T02:47:12.707889+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:28.609202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610670+0000","last_change":"2024-09-12T02:45:35.429907+0000","last_active":"2024-09-12T02:47:12.610670+0000","last_peered":"2024-09-12T02:47:12.610670+0000","last_clean":"2024-09-12T02:47:12.610670+0000","last_became_active":"2024-09-12T02:45:35.429546+0000","last_became_peered":"2024-09-12T02:45:35.429546+0000","last_unstale":"2024-09-12T02:47:12.610670+0000","last_undegraded":"2024-09-12T02:47:12.610670+0000","last_fullsized":"2024-09-12T02:47:12.610670+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:50.471835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"96'5","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707582+0000","last_change":"2024-09-12T02:45:32.390663+0000","last_active":"2024-09-12T02:47:12.707582+0000","last_peered":"2024-09-12T02:47:12.707582+0000","last_clean":"2024-09-12T02:47:12.707582+0000","last_became_active":"2024-09-12T02:45:32.390316+0000","last_became_peered":"2024-09-12T02:45:32.390316+0000","last_unstale":"2024-09-12T02:47:12.707582+0000","last_undegraded":"2024-09-12T02:47:12.707582+0000","last_fullsized":"2024-09-12T02:47:12.707582+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:11.605522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.611821+0000","last_change":"2024-09-12T02:45:45.494111+0000","last_active":"2024-09-12T02:47:12.611821+0000","last_peered":"2024-09-12T02:47:12.611821+0000","last_clean":"2024-09-12T02:47:12.611821+0000","last_became_active":"2024-09-12T02:45:45.493709+0000","last_became_peered":"2024-09-12T02:45:45.493709+0000","last_unstale":"2024-09-12T02:47:12.611821+0000","last_undegraded":"2024-09-12T02:47:12.611821+0000","last_fullsized":"2024-09-12T02:47:12.611821+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:24.998025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609191+0000","last_change":"2024-09-12T02:45:35.442187+0000","last_active":"2024-09-12T02:47:12.609191+0000","last_peered":"2024-09-12T02:47:12.609191+0000","last_clean":"2024-09-12T02:47:12.609191+0000","last_became_active":"2024-09-12T02:45:35.441751+0000","last_became_peered":"2024-09-12T02:45:35.441751+0000","last_unstale":"2024-09-12T02:47:12.609191+0000","last_undegraded":"2024-09-12T02:47:12.609191+0000","last_fullsized":"2024-09-12T02:47:12.609191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:53.014758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"96'9","reported_seq":55,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609887+0000","last_change":"2024-09-12T02:45:32.394390+0000","last_active":"2024-09-12T02:47:12.609887+0000","last_peered":"2024-09-12T02:47:12.609887+0000","last_clean":"2024-09-12T02:47:12.609887+0000","last_became_active":"2024-09-12T02:45:32.392304+0000","last_became_peered":"2024-09-12T02:45:32.392304+0000","last_unstale":"2024-09-12T02:47:12.609887+0000","last_undegraded":"2024-09-12T02:47:12.609887+0000","last_fullsized":"2024-09-12T02:47:12.609887+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:16.412697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707737+0000","last_change":"2024-09-12T02:45:45.491459+0000","last_active":"2024-09-12T02:47:12.707737+0000","last_peered":"2024-09-12T02:47:12.707737+0000","last_clean":"2024-09-12T02:47:12.707737+0000","last_became_active":"2024-09-12T02:45:45.490857+0000","last_became_peered":"2024-09-12T02:45:45.490857+0000","last_unstale":"2024-09-12T02:47:12.707737+0000","last_undegraded":"2024-09-12T02:47:12.707737+0000","last_fullsized":"2024-09-12T02:47:12.707737+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:39.712007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.617507+0000","last_change":"2024-09-12T02:45:35.431311+0000","last_active":"2024-09-12T02:47:12.617507+0000","last_peered":"2024-09-12T02:47:12.617507+0000","last_clean":"2024-09-12T02:47:12.617507+0000","last_became_active":"2024-09-12T02:45:35.430446+0000","last_became_peered":"2024-09-12T02:45:35.430446+0000","last_unstale":"2024-09-12T02:47:12.617507+0000","last_undegraded":"2024-09-12T02:47:12.617507+0000","last_fullsized":"2024-09-12T02:47:12.617507+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:28.526132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"96'37","reported_seq":210,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:33.763489+0000","last_change":"2024-09-12T02:45:32.395938+0000","last_active":"2024-09-12T02:47:33.763489+0000","last_peered":"2024-09-12T02:47:33.763489+0000","last_clean":"2024-09-12T02:47:33.763489+0000","last_became_active":"2024-09-12T02:45:32.395509+0000","last_became_peered":"2024-09-12T02:45:32.395509+0000","last_unstale":"2024-09-12T02:47:33.763489+0000","last_undegraded":"2024-09-12T02:47:33.763489+0000","last_fullsized":"2024-09-12T02:47:33.763489+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:17.401062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64622,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":130,"num_read_kb":128,"num_write":39,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.706977+0000","last_change":"2024-09-12T02:45:45.493335+0000","last_active":"2024-09-12T02:47:12.706977+0000","last_peered":"2024-09-12T02:47:12.706977+0000","last_clean":"2024-09-12T02:47:12.706977+0000","last_became_active":"2024-09-12T02:45:45.490473+0000","last_became_peered":"2024-09-12T02:45:45.490473+0000","last_unstale":"2024-09-12T02:47:12.706977+0000","last_undegraded":"2024-09-12T02:47:12.706977+0000","last_fullsized":"2024-09-12T02:47:12.706977+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:10.375643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707101+0000","last_change":"2024-09-12T02:46:12.951215+0000","last_active":"2024-09-12T02:47:12.707101+0000","last_peered":"2024-09-12T02:47:12.707101+0000","last_clean":"2024-09-12T02:47:12.707101+0000","last_became_active":"2024-09-12T02:46:12.950829+0000","last_became_peered":"2024-09-12T02:46:12.950829+0000","last_unstale":"2024-09-12T02:47:12.707101+0000","last_undegraded":"2024-09-12T02:47:12.707101+0000","last_fullsized":"2024-09-12T02:47:12.707101+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:42.251826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,4],"acting":[9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.15","version":"96'5","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707811+0000","last_change":"2024-09-12T02:45:32.477587+0000","last_active":"2024-09-12T02:47:12.707811+0000","last_peered":"2024-09-12T02:47:12.707811+0000","last_clean":"2024-09-12T02:47:12.707811+0000","last_became_active":"2024-09-12T02:45:32.477084+0000","last_became_peered":"2024-09-12T02:45:32.477084+0000","last_unstale":"2024-09-12T02:47:12.707811+0000","last_undegraded":"2024-09-12T02:47:12.707811+0000","last_fullsized":"2024-09-12T02:47:12.707811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:24.363281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707826+0000","last_change":"2024-09-12T02:45:45.493505+0000","last_active":"2024-09-12T02:47:12.707826+0000","last_peered":"2024-09-12T02:47:12.707826+0000","last_clean":"2024-09-12T02:47:12.707826+0000","last_became_active":"2024-09-12T02:45:45.492903+0000","last_became_peered":"2024-09-12T02:45:45.492903+0000","last_unstale":"2024-09-12T02:47:12.707826+0000","last_undegraded":"2024-09-12T02:47:12.707826+0000","last_fullsized":"2024-09-12T02:47:12.707826+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:23.365274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612580+0000","last_change":"2024-09-12T02:45:35.422762+0000","last_active":"2024-09-12T02:47:12.612580+0000","last_peered":"2024-09-12T02:47:12.612580+0000","last_clean":"2024-09-12T02:47:12.612580+0000","last_became_active":"2024-09-12T02:45:35.422457+0000","last_became_peered":"2024-09-12T02:45:35.422457+0000","last_unstale":"2024-09-12T02:47:12.612580+0000","last_undegraded":"2024-09-12T02:47:12.612580+0000","last_fullsized":"2024-09-12T02:47:12.612580+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:41.437234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"96'4","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610643+0000","last_change":"2024-09-12T02:45:32.391699+0000","last_active":"2024-09-12T02:47:12.610643+0000","last_peered":"2024-09-12T02:47:12.610643+0000","last_clean":"2024-09-12T02:47:12.610643+0000","last_became_active":"2024-09-12T02:45:32.391114+0000","last_became_peered":"2024-09-12T02:45:32.391114+0000","last_unstale":"2024-09-12T02:47:12.610643+0000","last_undegraded":"2024-09-12T02:47:12.610643+0000","last_fullsized":"2024-09-12T02:47:12.610643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:25.751549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.706919+0000","last_change":"2024-09-12T02:45:45.486896+0000","last_active":"2024-09-12T02:47:12.706919+0000","last_peered":"2024-09-12T02:47:12.706919+0000","last_clean":"2024-09-12T02:47:12.706919+0000","last_became_active":"2024-09-12T02:45:45.486465+0000","last_became_peered":"2024-09-12T02:45:45.486465+0000","last_unstale":"2024-09-12T02:47:12.706919+0000","last_undegraded":"2024-09-12T02:47:12.706919+0000","last_fullsized":"2024-09-12T02:47:12.706919+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:21.774968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.614946+0000","last_change":"2024-09-12T02:45:35.424470+0000","last_active":"2024-09-12T02:47:12.614946+0000","last_peered":"2024-09-12T02:47:12.614946+0000","last_clean":"2024-09-12T02:47:12.614946+0000","last_became_active":"2024-09-12T02:45:35.424129+0000","last_became_peered":"2024-09-12T02:45:35.424129+0000","last_unstale":"2024-09-12T02:47:12.614946+0000","last_undegraded":"2024-09-12T02:47:12.614946+0000","last_fullsized":"2024-09-12T02:47:12.614946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:25.541549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"96'4","reported_seq":167,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:33.763388+0000","last_change":"2024-09-12T02:45:32.388773+0000","last_active":"2024-09-12T02:47:33.763388+0000","last_peered":"2024-09-12T02:47:33.763388+0000","last_clean":"2024-09-12T02:47:33.763388+0000","last_became_active":"2024-09-12T02:45:32.388403+0000","last_became_peered":"2024-09-12T02:45:32.388403+0000","last_unstale":"2024-09-12T02:47:33.763388+0000","last_undegraded":"2024-09-12T02:47:33.763388+0000","last_fullsized":"2024-09-12T02:47:33.763388+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:20.756820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689388+0000","last_change":"2024-09-12T02:45:45.490632+0000","last_active":"2024-09-12T02:47:12.689388+0000","last_peered":"2024-09-12T02:47:12.689388+0000","last_clean":"2024-09-12T02:47:12.689388+0000","last_became_active":"2024-09-12T02:45:45.490098+0000","last_became_peered":"2024-09-12T02:45:45.490098+0000","last_unstale":"2024-09-12T02:47:12.689388+0000","last_undegraded":"2024-09-12T02:47:12.689388+0000","last_fullsized":"2024-09-12T02:47:12.689388+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:07.780423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.611846+0000","last_change":"2024-09-12T02:45:45.481451+0000","last_active":"2024-09-12T02:47:12.611846+0000","last_peered":"2024-09-12T02:47:12.611846+0000","last_clean":"2024-09-12T02:47:12.611846+0000","last_became_active":"2024-09-12T02:45:45.480969+0000","last_became_peered":"2024-09-12T02:45:45.480969+0000","last_unstale":"2024-09-12T02:47:12.611846+0000","last_undegraded":"2024-09-12T02:47:12.611846+0000","last_fullsized":"2024-09-12T02:47:12.611846+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:25.320414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707174+0000","last_change":"2024-09-12T02:45:35.435918+0000","last_active":"2024-09-12T02:47:12.707174+0000","last_peered":"2024-09-12T02:47:12.707174+0000","last_clean":"2024-09-12T02:47:12.707174+0000","last_became_active":"2024-09-12T02:45:35.433911+0000","last_became_peered":"2024-09-12T02:45:35.433911+0000","last_unstale":"2024-09-12T02:47:12.707174+0000","last_undegraded":"2024-09-12T02:47:12.707174+0000","last_fullsized":"2024-09-12T02:47:12.707174+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:27.147122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"96'3","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707410+0000","last_change":"2024-09-12T02:45:32.391021+0000","last_active":"2024-09-12T02:47:12.707410+0000","last_peered":"2024-09-12T02:47:12.707410+0000","last_clean":"2024-09-12T02:47:12.707410+0000","last_became_active":"2024-09-12T02:45:32.390532+0000","last_became_peered":"2024-09-12T02:45:32.390532+0000","last_unstale":"2024-09-12T02:47:12.707410+0000","last_undegraded":"2024-09-12T02:47:12.707410+0000","last_fullsized":"2024-09-12T02:47:12.707410+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:22.708802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":33,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.709351+0000","last_change":"2024-09-12T02:47:12.709351+0000","last_active":"2024-09-12T02:47:12.709351+0000","last_peered":"2024-09-12T02:47:12.709351+0000","last_clean":"2024-09-12T02:47:12.709351+0000","last_became_active":"2024-09-12T02:47:12.708958+0000","last_became_peered":"2024-09-12T02:47:12.708958+0000","last_unstale":"2024-09-12T02:47:12.709351+0000","last_undegraded":"2024-09-12T02:47:12.709351+0000","last_fullsized":"2024-09-12T02:47:12.709351+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:35.062469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689220+0000","last_change":"2024-09-12T02:45:35.438200+0000","last_active":"2024-09-12T02:47:12.689220+0000","last_peered":"2024-09-12T02:47:12.689220+0000","last_clean":"2024-09-12T02:47:12.689220+0000","last_became_active":"2024-09-12T02:45:35.437585+0000","last_became_peered":"2024-09-12T02:45:35.437585+0000","last_unstale":"2024-09-12T02:47:12.689220+0000","last_undegraded":"2024-09-12T02:47:12.689220+0000","last_fullsized":"2024-09-12T02:47:12.689220+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:57.675512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"96'3","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.608945+0000","last_change":"2024-09-12T02:45:32.385619+0000","last_active":"2024-09-12T02:47:12.608945+0000","last_peered":"2024-09-12T02:47:12.608945+0000","last_clean":"2024-09-12T02:47:12.608945+0000","last_became_active":"2024-09-12T02:45:32.384997+0000","last_became_peered":"2024-09-12T02:45:32.384997+0000","last_unstale":"2024-09-12T02:47:12.608945+0000","last_undegraded":"2024-09-12T02:47:12.608945+0000","last_fullsized":"2024-09-12T02:47:12.608945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:11.716779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"96'7","reported_seq":50,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.708151+0000","last_change":"2024-09-12T02:45:32.388089+0000","last_active":"2024-09-12T02:47:12.708151+0000","last_peered":"2024-09-12T02:47:12.708151+0000","last_clean":"2024-09-12T02:47:12.708151+0000","last_became_active":"2024-09-12T02:45:32.387560+0000","last_became_peered":"2024-09-12T02:45:32.387560+0000","last_unstale":"2024-09-12T02:47:12.708151+0000","last_undegraded":"2024-09-12T02:47:12.708151+0000","last_fullsized":"2024-09-12T02:47:12.708151+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:14.290116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707433+0000","last_change":"2024-09-12T02:46:12.558894+0000","last_active":"2024-09-12T02:47:12.707433+0000","last_peered":"2024-09-12T02:47:12.707433+0000","last_clean":"2024-09-12T02:47:12.707433+0000","last_became_active":"2024-09-12T02:46:12.558518+0000","last_became_peered":"2024-09-12T02:46:12.558518+0000","last_unstale":"2024-09-12T02:47:12.707433+0000","last_undegraded":"2024-09-12T02:47:12.707433+0000","last_fullsized":"2024-09-12T02:47:12.707433+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:00.171554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609884+0000","last_change":"2024-09-12T02:45:45.494098+0000","last_active":"2024-09-12T02:47:12.609884+0000","last_peered":"2024-09-12T02:47:12.609884+0000","last_clean":"2024-09-12T02:47:12.609884+0000","last_became_active":"2024-09-12T02:45:45.493698+0000","last_became_peered":"2024-09-12T02:45:45.493698+0000","last_unstale":"2024-09-12T02:47:12.609884+0000","last_undegraded":"2024-09-12T02:47:12.609884+0000","last_fullsized":"2024-09-12T02:47:12.609884+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:39.832159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"96'5","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:34.765604+0000","last_change":"2024-09-12T02:46:12.952787+0000","last_active":"2024-09-12T02:47:34.765604+0000","last_peered":"2024-09-12T02:47:34.765604+0000","last_clean":"2024-09-12T02:47:34.765604+0000","last_became_active":"2024-09-12T02:46:12.952373+0000","last_became_peered":"2024-09-12T02:46:12.952373+0000","last_unstale":"2024-09-12T02:47:34.765604+0000","last_undegraded":"2024-09-12T02:47:34.765604+0000","last_fullsized":"2024-09-12T02:47:34.765604+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:49.435438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.617107+0000","last_change":"2024-09-12T02:45:35.427334+0000","last_active":"2024-09-12T02:47:12.617107+0000","last_peered":"2024-09-12T02:47:12.617107+0000","last_clean":"2024-09-12T02:47:12.617107+0000","last_became_active":"2024-09-12T02:45:35.427010+0000","last_became_peered":"2024-09-12T02:45:35.427010+0000","last_unstale":"2024-09-12T02:47:12.617107+0000","last_undegraded":"2024-09-12T02:47:12.617107+0000","last_fullsized":"2024-09-12T02:47:12.617107+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:39.587384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609948+0000","last_change":"2024-09-12T02:45:45.482354+0000","last_active":"2024-09-12T02:47:12.609948+0000","last_peered":"2024-09-12T02:47:12.609948+0000","last_clean":"2024-09-12T02:47:12.609948+0000","last_became_active":"2024-09-12T02:45:45.481411+0000","last_became_peered":"2024-09-12T02:45:45.481411+0000","last_unstale":"2024-09-12T02:47:12.609948+0000","last_undegraded":"2024-09-12T02:47:12.609948+0000","last_fullsized":"2024-09-12T02:47:12.609948+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:43.049433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.611834+0000","last_change":"2024-09-12T02:45:35.430793+0000","last_active":"2024-09-12T02:47:12.611834+0000","last_peered":"2024-09-12T02:47:12.611834+0000","last_clean":"2024-09-12T02:47:12.611834+0000","last_became_active":"2024-09-12T02:45:35.430468+0000","last_became_peered":"2024-09-12T02:45:35.430468+0000","last_unstale":"2024-09-12T02:47:12.611834+0000","last_undegraded":"2024-09-12T02:47:12.611834+0000","last_fullsized":"2024-09-12T02:47:12.611834+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:19.446186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":44,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610090+0000","last_change":"2024-09-12T02:46:12.557140+0000","last_active":"2024-09-12T02:47:12.610090+0000","last_peered":"2024-09-12T02:47:12.610090+0000","last_clean":"2024-09-12T02:47:12.610090+0000","last_became_active":"2024-09-12T02:46:12.556649+0000","last_became_peered":"2024-09-12T02:46:12.556649+0000","last_unstale":"2024-09-12T02:47:12.610090+0000","last_undegraded":"2024-09-12T02:47:12.610090+0000","last_fullsized":"2024-09-12T02:47:12.610090+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:04.154036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609819+0000","last_change":"2024-09-12T02:45:35.438653+0000","last_active":"2024-09-12T02:47:12.609819+0000","last_peered":"2024-09-12T02:47:12.609819+0000","last_clean":"2024-09-12T02:47:12.609819+0000","last_became_active":"2024-09-12T02:45:35.438352+0000","last_became_peered":"2024-09-12T02:45:35.438352+0000","last_unstale":"2024-09-12T02:47:12.609819+0000","last_undegraded":"2024-09-12T02:47:12.609819+0000","last_fullsized":"2024-09-12T02:47:12.609819+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:34.665709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.611998+0000","last_change":"2024-09-12T02:45:35.424654+0000","last_active":"2024-09-12T02:47:12.611998+0000","last_peered":"2024-09-12T02:47:12.611998+0000","last_clean":"2024-09-12T02:47:12.611998+0000","last_became_active":"2024-09-12T02:45:35.423269+0000","last_became_peered":"2024-09-12T02:45:35.423269+0000","last_unstale":"2024-09-12T02:47:12.611998+0000","last_undegraded":"2024-09-12T02:47:12.611998+0000","last_fullsized":"2024-09-12T02:47:12.611998+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:16.595261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609358+0000","last_change":"2024-09-12T02:45:35.428658+0000","last_active":"2024-09-12T02:47:12.609358+0000","last_peered":"2024-09-12T02:47:12.609358+0000","last_clean":"2024-09-12T02:47:12.609358+0000","last_became_active":"2024-09-12T02:45:35.428333+0000","last_became_peered":"2024-09-12T02:45:35.428333+0000","last_unstale":"2024-09-12T02:47:12.609358+0000","last_undegraded":"2024-09-12T02:47:12.609358+0000","last_fullsized":"2024-09-12T02:47:12.609358+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:41:38.418409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612429+0000","last_change":"2024-09-12T02:45:35.427806+0000","last_active":"2024-09-12T02:47:12.612429+0000","last_peered":"2024-09-12T02:47:12.612429+0000","last_clean":"2024-09-12T02:47:12.612429+0000","last_became_active":"2024-09-12T02:45:35.427418+0000","last_became_peered":"2024-09-12T02:45:35.427418+0000","last_unstale":"2024-09-12T02:47:12.612429+0000","last_undegraded":"2024-09-12T02:47:12.612429+0000","last_fullsized":"2024-09-12T02:47:12.612429+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:27.184153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610374+0000","last_change":"2024-09-12T02:45:35.430350+0000","last_active":"2024-09-12T02:47:12.610374+0000","last_peered":"2024-09-12T02:47:12.610374+0000","last_clean":"2024-09-12T02:47:12.610374+0000","last_became_active":"2024-09-12T02:45:35.429807+0000","last_became_peered":"2024-09-12T02:45:35.429807+0000","last_unstale":"2024-09-12T02:47:12.610374+0000","last_undegraded":"2024-09-12T02:47:12.610374+0000","last_fullsized":"2024-09-12T02:47:12.610374+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:41.043882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689639+0000","last_change":"2024-09-12T02:45:35.438354+0000","last_active":"2024-09-12T02:47:12.689639+0000","last_peered":"2024-09-12T02:47:12.689639+0000","last_clean":"2024-09-12T02:47:12.689639+0000","last_became_active":"2024-09-12T02:45:35.437987+0000","last_became_peered":"2024-09-12T02:45:35.437987+0000","last_unstale":"2024-09-12T02:47:12.689639+0000","last_undegraded":"2024-09-12T02:47:12.689639+0000","last_fullsized":"2024-09-12T02:47:12.689639+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:51.202605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707153+0000","last_change":"2024-09-12T02:45:35.438633+0000","last_active":"2024-09-12T02:47:12.707153+0000","last_peered":"2024-09-12T02:47:12.707153+0000","last_clean":"2024-09-12T02:47:12.707153+0000","last_became_active":"2024-09-12T02:45:35.438288+0000","last_became_peered":"2024-09-12T02:45:35.438288+0000","last_unstale":"2024-09-12T02:47:12.707153+0000","last_undegraded":"2024-09-12T02:47:12.707153+0000","last_fullsized":"2024-09-12T02:47:12.707153+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:22.037816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689625+0000","last_change":"2024-09-12T02:45:35.437493+0000","last_active":"2024-09-12T02:47:12.689625+0000","last_peered":"2024-09-12T02:47:12.689625+0000","last_clean":"2024-09-12T02:47:12.689625+0000","last_became_active":"2024-09-12T02:45:35.434830+0000","last_became_peered":"2024-09-12T02:45:35.434830+0000","last_unstale":"2024-09-12T02:47:12.689625+0000","last_undegraded":"2024-09-12T02:47:12.689625+0000","last_fullsized":"2024-09-12T02:47:12.689625+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:16.970119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.614780+0000","last_change":"2024-09-12T02:46:12.558495+0000","last_active":"2024-09-12T02:47:12.614780+0000","last_peered":"2024-09-12T02:47:12.614780+0000","last_clean":"2024-09-12T02:47:12.614780+0000","last_became_active":"2024-09-12T02:46:12.558172+0000","last_became_peered":"2024-09-12T02:46:12.558172+0000","last_unstale":"2024-09-12T02:47:12.614780+0000","last_undegraded":"2024-09-12T02:47:12.614780+0000","last_fullsized":"2024-09-12T02:47:12.614780+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:02.114483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,8],"acting":[1,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609406+0000","last_change":"2024-09-12T02:45:35.428552+0000","last_active":"2024-09-12T02:47:12.609406+0000","last_peered":"2024-09-12T02:47:12.609406+0000","last_clean":"2024-09-12T02:47:12.609406+0000","last_became_active":"2024-09-12T02:45:35.428029+0000","last_became_peered":"2024-09-12T02:45:35.428029+0000","last_unstale":"2024-09-12T02:47:12.609406+0000","last_undegraded":"2024-09-12T02:47:12.609406+0000","last_fullsized":"2024-09-12T02:47:12.609406+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:57.669432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.611960+0000","last_change":"2024-09-12T02:45:35.427928+0000","last_active":"2024-09-12T02:47:12.611960+0000","last_peered":"2024-09-12T02:47:12.611960+0000","last_clean":"2024-09-12T02:47:12.611960+0000","last_became_active":"2024-09-12T02:45:35.427452+0000","last_became_peered":"2024-09-12T02:45:35.427452+0000","last_unstale":"2024-09-12T02:47:12.611960+0000","last_undegraded":"2024-09-12T02:47:12.611960+0000","last_fullsized":"2024-09-12T02:47:12.611960+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:01.646899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610191+0000","last_change":"2024-09-12T02:45:35.432714+0000","last_active":"2024-09-12T02:47:12.610191+0000","last_peered":"2024-09-12T02:47:12.610191+0000","last_clean":"2024-09-12T02:47:12.610191+0000","last_became_active":"2024-09-12T02:45:35.431698+0000","last_became_peered":"2024-09-12T02:45:35.431698+0000","last_unstale":"2024-09-12T02:47:12.610191+0000","last_undegraded":"2024-09-12T02:47:12.610191+0000","last_fullsized":"2024-09-12T02:47:12.610191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:34.925405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707745+0000","last_change":"2024-09-12T02:45:35.432157+0000","last_active":"2024-09-12T02:47:12.707745+0000","last_peered":"2024-09-12T02:47:12.707745+0000","last_clean":"2024-09-12T02:47:12.707745+0000","last_became_active":"2024-09-12T02:45:35.431847+0000","last_became_peered":"2024-09-12T02:45:35.431847+0000","last_unstale":"2024-09-12T02:47:12.707745+0000","last_undegraded":"2024-09-12T02:47:12.707745+0000","last_fullsized":"2024-09-12T02:47:12.707745+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:43.928689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612908+0000","last_change":"2024-09-12T02:45:35.429942+0000","last_active":"2024-09-12T02:47:12.612908+0000","last_peered":"2024-09-12T02:47:12.612908+0000","last_clean":"2024-09-12T02:47:12.612908+0000","last_became_active":"2024-09-12T02:45:35.429154+0000","last_became_peered":"2024-09-12T02:45:35.429154+0000","last_unstale":"2024-09-12T02:47:12.612908+0000","last_undegraded":"2024-09-12T02:47:12.612908+0000","last_fullsized":"2024-09-12T02:47:12.612908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:03.888466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.614573+0000","last_change":"2024-09-12T02:45:35.429241+0000","last_active":"2024-09-12T02:47:12.614573+0000","last_peered":"2024-09-12T02:47:12.614573+0000","last_clean":"2024-09-12T02:47:12.614573+0000","last_became_active":"2024-09-12T02:45:35.428927+0000","last_became_peered":"2024-09-12T02:45:35.428927+0000","last_unstale":"2024-09-12T02:47:12.614573+0000","last_undegraded":"2024-09-12T02:47:12.614573+0000","last_fullsized":"2024-09-12T02:47:12.614573+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:04.306748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.611844+0000","last_change":"2024-09-12T02:45:35.424196+0000","last_active":"2024-09-12T02:47:12.611844+0000","last_peered":"2024-09-12T02:47:12.611844+0000","last_clean":"2024-09-12T02:47:12.611844+0000","last_became_active":"2024-09-12T02:45:35.423882+0000","last_became_peered":"2024-09-12T02:45:35.423882+0000","last_unstale":"2024-09-12T02:47:12.611844+0000","last_undegraded":"2024-09-12T02:47:12.611844+0000","last_fullsized":"2024-09-12T02:47:12.611844+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:35.118183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.611713+0000","last_change":"2024-09-12T02:45:35.426770+0000","last_active":"2024-09-12T02:47:12.611713+0000","last_peered":"2024-09-12T02:47:12.611713+0000","last_clean":"2024-09-12T02:47:12.611713+0000","last_became_active":"2024-09-12T02:45:35.425905+0000","last_became_peered":"2024-09-12T02:45:35.425905+0000","last_unstale":"2024-09-12T02:47:12.611713+0000","last_undegraded":"2024-09-12T02:47:12.611713+0000","last_fullsized":"2024-09-12T02:47:12.611713+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:35.447860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609310+0000","last_change":"2024-09-12T02:45:35.423413+0000","last_active":"2024-09-12T02:47:12.609310+0000","last_peered":"2024-09-12T02:47:12.609310+0000","last_clean":"2024-09-12T02:47:12.609310+0000","last_became_active":"2024-09-12T02:45:35.423113+0000","last_became_peered":"2024-09-12T02:45:35.423113+0000","last_unstale":"2024-09-12T02:47:12.609310+0000","last_undegraded":"2024-09-12T02:47:12.609310+0000","last_fullsized":"2024-09-12T02:47:12.609310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:24.194882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707599+0000","last_change":"2024-09-12T02:45:35.427814+0000","last_active":"2024-09-12T02:47:12.707599+0000","last_peered":"2024-09-12T02:47:12.707599+0000","last_clean":"2024-09-12T02:47:12.707599+0000","last_became_active":"2024-09-12T02:45:35.427495+0000","last_became_peered":"2024-09-12T02:45:35.427495+0000","last_unstale":"2024-09-12T02:47:12.707599+0000","last_undegraded":"2024-09-12T02:47:12.707599+0000","last_fullsized":"2024-09-12T02:47:12.707599+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:36:59.459681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610867+0000","last_change":"2024-09-12T02:45:35.432816+0000","last_active":"2024-09-12T02:47:12.610867+0000","last_peered":"2024-09-12T02:47:12.610867+0000","last_clean":"2024-09-12T02:47:12.610867+0000","last_became_active":"2024-09-12T02:45:35.432415+0000","last_became_peered":"2024-09-12T02:45:35.432415+0000","last_unstale":"2024-09-12T02:47:12.610867+0000","last_undegraded":"2024-09-12T02:47:12.610867+0000","last_fullsized":"2024-09-12T02:47:12.610867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:06.434342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.708294+0000","last_change":"2024-09-12T02:45:35.417788+0000","last_active":"2024-09-12T02:47:12.708294+0000","last_peered":"2024-09-12T02:47:12.708294+0000","last_clean":"2024-09-12T02:47:12.708294+0000","last_became_active":"2024-09-12T02:45:35.417382+0000","last_became_peered":"2024-09-12T02:45:35.417382+0000","last_unstale":"2024-09-12T02:47:12.708294+0000","last_undegraded":"2024-09-12T02:47:12.708294+0000","last_fullsized":"2024-09-12T02:47:12.708294+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:38.752047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.615161+0000","last_change":"2024-09-12T02:45:35.422546+0000","last_active":"2024-09-12T02:47:12.615161+0000","last_peered":"2024-09-12T02:47:12.615161+0000","last_clean":"2024-09-12T02:47:12.615161+0000","last_became_active":"2024-09-12T02:45:35.422184+0000","last_became_peered":"2024-09-12T02:45:35.422184+0000","last_unstale":"2024-09-12T02:47:12.615161+0000","last_undegraded":"2024-09-12T02:47:12.615161+0000","last_fullsized":"2024-09-12T02:47:12.615161+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.022551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689193+0000","last_change":"2024-09-12T02:45:35.435371+0000","last_active":"2024-09-12T02:47:12.689193+0000","last_peered":"2024-09-12T02:47:12.689193+0000","last_clean":"2024-09-12T02:47:12.689193+0000","last_became_active":"2024-09-12T02:45:35.435054+0000","last_became_peered":"2024-09-12T02:45:35.435054+0000","last_unstale":"2024-09-12T02:47:12.689193+0000","last_undegraded":"2024-09-12T02:47:12.689193+0000","last_fullsized":"2024-09-12T02:47:12.689193+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:18.099755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610399+0000","last_change":"2024-09-12T02:45:35.421617+0000","last_active":"2024-09-12T02:47:12.610399+0000","last_peered":"2024-09-12T02:47:12.610399+0000","last_clean":"2024-09-12T02:47:12.610399+0000","last_became_active":"2024-09-12T02:45:35.421247+0000","last_became_peered":"2024-09-12T02:45:35.421247+0000","last_unstale":"2024-09-12T02:47:12.610399+0000","last_undegraded":"2024-09-12T02:47:12.610399+0000","last_fullsized":"2024-09-12T02:47:12.610399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:04.457638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.708026+0000","last_change":"2024-09-12T02:46:13.370227+0000","last_active":"2024-09-12T02:47:12.708026+0000","last_peered":"2024-09-12T02:47:12.708026+0000","last_clean":"2024-09-12T02:47:12.708026+0000","last_became_active":"2024-09-12T02:46:13.369826+0000","last_became_peered":"2024-09-12T02:46:13.369826+0000","last_unstale":"2024-09-12T02:47:12.708026+0000","last_undegraded":"2024-09-12T02:47:12.708026+0000","last_fullsized":"2024-09-12T02:47:12.708026+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:13.621494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.617285+0000","last_change":"2024-09-12T02:45:35.441542+0000","last_active":"2024-09-12T02:47:12.617285+0000","last_peered":"2024-09-12T02:47:12.617285+0000","last_clean":"2024-09-12T02:47:12.617285+0000","last_became_active":"2024-09-12T02:45:35.441215+0000","last_became_peered":"2024-09-12T02:45:35.441215+0000","last_unstale":"2024-09-12T02:47:12.617285+0000","last_undegraded":"2024-09-12T02:47:12.617285+0000","last_fullsized":"2024-09-12T02:47:12.617285+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:42.978480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707740+0000","last_change":"2024-09-12T02:45:35.425410+0000","last_active":"2024-09-12T02:47:12.707740+0000","last_peered":"2024-09-12T02:47:12.707740+0000","last_clean":"2024-09-12T02:47:12.707740+0000","last_became_active":"2024-09-12T02:45:35.424960+0000","last_became_peered":"2024-09-12T02:45:35.424960+0000","last_unstale":"2024-09-12T02:47:12.707740+0000","last_undegraded":"2024-09-12T02:47:12.707740+0000","last_fullsized":"2024-09-12T02:47:12.707740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:45.162712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612323+0000","last_change":"2024-09-12T02:45:35.415105+0000","last_active":"2024-09-12T02:47:12.612323+0000","last_peered":"2024-09-12T02:47:12.612323+0000","last_clean":"2024-09-12T02:47:12.612323+0000","last_became_active":"2024-09-12T02:45:35.414338+0000","last_became_peered":"2024-09-12T02:45:35.414338+0000","last_unstale":"2024-09-12T02:47:12.612323+0000","last_undegraded":"2024-09-12T02:47:12.612323+0000","last_fullsized":"2024-09-12T02:47:12.612323+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:45.011716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612057+0000","last_change":"2024-09-12T02:45:35.420637+0000","last_active":"2024-09-12T02:47:12.612057+0000","last_peered":"2024-09-12T02:47:12.612057+0000","last_clean":"2024-09-12T02:47:12.612057+0000","last_became_active":"2024-09-12T02:45:35.420354+0000","last_became_peered":"2024-09-12T02:45:35.420354+0000","last_unstale":"2024-09-12T02:47:12.612057+0000","last_undegraded":"2024-09-12T02:47:12.612057+0000","last_fullsized":"2024-09-12T02:47:12.612057+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:15.807265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612777+0000","last_change":"2024-09-12T02:45:35.429505+0000","last_active":"2024-09-12T02:47:12.612777+0000","last_peered":"2024-09-12T02:47:12.612777+0000","last_clean":"2024-09-12T02:47:12.612777+0000","last_became_active":"2024-09-12T02:45:35.428728+0000","last_became_peered":"2024-09-12T02:45:35.428728+0000","last_unstale":"2024-09-12T02:47:12.612777+0000","last_undegraded":"2024-09-12T02:47:12.612777+0000","last_fullsized":"2024-09-12T02:47:12.612777+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:15.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71830,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":655,"num_read_kb":404,"num_write":251,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":215490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416422,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1155072,"data_stored":565839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678059,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28820,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716332,"statfs":{"total":95995035648,"available":95965523968,"internally_reserved":0,"allocated":1835008,"data_stored":1216660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841585,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28168,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716984,"statfs":{"total":95995035648,"available":95966191616,"internally_reserved":0,"allocated":1167360,"data_stored":569248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070519,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32308,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712844,"statfs":{"total":95995035648,"available":95961952256,"internally_reserved":0,"allocated":1142784,"data_stored":565306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332156,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37068,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708084,"statfs":{"total":95995035648,"available":95957078016,"internally_reserved":0,"allocated":1757184,"data_stored":1162029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495681,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28140,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717012,"statfs":{"total":95995035648,"available":95966220288,"internally_reserved":0,"allocated":1138688,"data_stored":561049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757319,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28752,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716400,"statfs":{"total":95995035648,"available":95965593600,"internally_reserved":0,"allocated":1765376,"data_stored":1157218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920845,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36480,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708672,"statfs":{"total":95995035648,"available":95957680128,"internally_reserved":0,"allocated":1155072,"data_stored":565352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182482,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1150976,"data_stored":560364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28216,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716936,"statfs":{"total":95995035648,"available":95966142464,"internally_reserved":0,"allocated":1212416,"data_stored":626187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28216,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716936,"statfs":{"total":95995035648,"available":95966142464,"internally_reserved":0,"allocated":1216512,"data_stored":626813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28168,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716984,"statfs":{"total":95995035648,"available":95966191616,"internally_reserved":0,"allocated":1163264,"data_stored":562505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":66879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":66253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:47:41.329 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:47:41.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:41 smithi018 ceph-mon[30616]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:47:41.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:41 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:41.758 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:41.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:41 smithi062 ceph-mon[35527]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:47:41.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:41 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:41.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:41 smithi176 ceph-mon[35713]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:47:41.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:41 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:42.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.313+0000 7f9754600640 1 -- 172.21.15.18:0/451410622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f974c1049c0 msgr2=0x7f974c108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:42.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.313+0000 7f9754600640 1 --2- 172.21.15.18:0/451410622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f974c1049c0 0x7f974c108a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9738009900 tx=0x7f973802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.313+0000 7f9754600640 1 -- 172.21.15.18:0/451410622 shutdown_connections 2024-09-12T02:47:42.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.313+0000 7f9754600640 1 --2- 172.21.15.18:0/451410622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f974c109140 0x7f974c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.313+0000 7f9754600640 1 --2- 172.21.15.18:0/451410622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f974c1049c0 0x7f974c108a10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.313+0000 7f9754600640 1 --2- 172.21.15.18:0/451410622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f974c104010 0x7f974c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.313+0000 7f9754600640 1 -- 172.21.15.18:0/451410622 >> 172.21.15.18:0/451410622 conn(0x7f974c0ffa50 msgr2=0x7f974c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:42.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.314+0000 7f9754600640 1 -- 172.21.15.18:0/451410622 shutdown_connections 2024-09-12T02:47:42.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.314+0000 7f9754600640 1 -- 172.21.15.18:0/451410622 wait complete. 2024-09-12T02:47:42.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.315+0000 7f9754600640 1 Processor -- start 2024-09-12T02:47:42.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.315+0000 7f9754600640 1 -- start start 2024-09-12T02:47:42.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.316+0000 7f9754600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f974c104010 0x7f974c19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:42.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.316+0000 7f9754600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f974c1049c0 0x7f974c19ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:42.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.316+0000 7f9754600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f974c109140 0x7f974c19eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:42.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.316+0000 7f9754600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f974c114160 con 0x7f974c109140 2024-09-12T02:47:42.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.316+0000 7f9754600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f974c113fe0 con 0x7f974c104010 2024-09-12T02:47:42.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.316+0000 7f9754600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f974c1142e0 con 0x7f974c1049c0 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.316+0000 7f9751c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f974c104010 0x7f974c19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.316+0000 7f9751200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f974c1049c0 0x7f974c19ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.316+0000 7f9751c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f974c104010 0x7f974c19a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:37606/0 (socket says 172.21.15.18:37606) 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.316+0000 7f9751c00640 1 -- 172.21.15.18:0/4224872812 learned_addr learned my addr 172.21.15.18:0/4224872812 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:42.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.316+0000 7f9752600640 1 --2- 172.21.15.18:0/4224872812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f974c109140 0x7f974c19eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.316+0000 7f9751c00640 1 -- 172.21.15.18:0/4224872812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f974c1049c0 msgr2=0x7f974c19ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.316+0000 7f9751c00640 1 --2- 172.21.15.18:0/4224872812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f974c1049c0 0x7f974c19ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.316+0000 7f9751c00640 1 -- 172.21.15.18:0/4224872812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f974c109140 msgr2=0x7f974c19eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.316+0000 7f9751c00640 1 --2- 172.21.15.18:0/4224872812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f974c109140 0x7f974c19eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.316+0000 7f9751c00640 1 -- 172.21.15.18:0/4224872812 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974c19f6d0 con 0x7f974c104010 2024-09-12T02:47:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.317+0000 7f9751c00640 1 --2- 172.21.15.18:0/4224872812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f974c104010 0x7f974c19a720 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f974000e9f0 tx=0x7f974000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.317+0000 7f974a000640 1 -- 172.21.15.18:0/4224872812 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974000ccc0 con 0x7f974c104010 2024-09-12T02:47:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.317+0000 7f9754600640 1 -- 172.21.15.18:0/4224872812 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974c19f9c0 con 0x7f974c104010 2024-09-12T02:47:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.317+0000 7f974a000640 1 -- 172.21.15.18:0/4224872812 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f974000ce60 con 0x7f974c104010 2024-09-12T02:47:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.317+0000 7f974a000640 1 -- 172.21.15.18:0/4224872812 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740010690 con 0x7f974c104010 2024-09-12T02:47:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.317+0000 7f9754600640 1 -- 172.21.15.18:0/4224872812 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f974c1a72a0 con 0x7f974c104010 2024-09-12T02:47:42.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.318+0000 7f9754600640 1 -- 172.21.15.18:0/4224872812 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f974c1043f0 con 0x7f974c104010 2024-09-12T02:47:42.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.320+0000 7f974a000640 1 -- 172.21.15.18:0/4224872812 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f97400046c0 con 0x7f974c104010 2024-09-12T02:47:42.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.323+0000 7f974a000640 1 --2- 172.21.15.18:0/4224872812 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f97340a2c90 0x7f97340a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:42.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.323+0000 7f974a000640 1 -- 172.21.15.18:0/4224872812 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f97400cf910 con 0x7f974c104010 2024-09-12T02:47:42.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.323+0000 7f9751200640 1 --2- 172.21.15.18:0/4224872812 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f97340a2c90 0x7f97340a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:42.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.324+0000 7f9751200640 1 --2- 172.21.15.18:0/4224872812 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f97340a2c90 0x7f97340a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9738009230 tx=0x7f97380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:42.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.324+0000 7f974a000640 1 -- 172.21.15.18:0/4224872812 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f974009c300 con 0x7f974c104010 2024-09-12T02:47:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.513+0000 7f9754600640 1 -- 172.21.15.18:0/4224872812 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f974c10c3f0 con 0x7f97340a2c90 2024-09-12T02:47:42.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.523+0000 7f974a000640 1 -- 172.21.15.18:0/4224872812 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340406 (secure 0 0 0) 0x7f9738031630 con 0x7f97340a2c90 2024-09-12T02:47:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:47:42.530 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-12T02:47:42.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.528+0000 7f9754600640 1 -- 172.21.15.18:0/4224872812 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f97340a2c90 msgr2=0x7f97340a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.528+0000 7f9754600640 1 --2- 172.21.15.18:0/4224872812 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f97340a2c90 0x7f97340a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9738009230 tx=0x7f97380058d0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.528+0000 7f9754600640 1 -- 172.21.15.18:0/4224872812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f974c104010 msgr2=0x7f974c19a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.528+0000 7f9754600640 1 --2- 172.21.15.18:0/4224872812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f974c104010 0x7f974c19a720 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f974000e9f0 tx=0x7f974000edf0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.528+0000 7f9754600640 1 -- 172.21.15.18:0/4224872812 shutdown_connections 2024-09-12T02:47:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.528+0000 7f9754600640 1 --2- 172.21.15.18:0/4224872812 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f97340a2c90 0x7f97340a5150 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.528+0000 7f9754600640 1 --2- 172.21.15.18:0/4224872812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f974c109140 0x7f974c19eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.528+0000 7f9754600640 1 --2- 172.21.15.18:0/4224872812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f974c1049c0 0x7f974c19ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.528+0000 7f9754600640 1 --2- 172.21.15.18:0/4224872812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f974c104010 0x7f974c19a720 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.528+0000 7f9754600640 1 -- 172.21.15.18:0/4224872812 >> 172.21.15.18:0/4224872812 conn(0x7f974c0ffa50 msgr2=0x7f974c100df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.528+0000 7f9754600640 1 -- 172.21.15.18:0/4224872812 shutdown_connections 2024-09-12T02:47:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:42.528+0000 7f9754600640 1 -- 172.21.15.18:0/4224872812 wait complete. 2024-09-12T02:47:42.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:42 smithi062 ceph-mon[35527]: pgmap v373: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:42.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:42 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:42.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:42 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:47:42.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:42 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:47:42.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:42 smithi062 ceph-mon[35527]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:42.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:42 smithi018 ceph-mon[30616]: pgmap v373: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:42.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:42 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:42.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:42 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:47:42.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:42 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:47:42.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:42 smithi018 ceph-mon[30616]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:42.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:42 smithi176 ceph-mon[35713]: pgmap v373: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:42.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:42 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:42.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:42 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:47:42.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:42 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:47:42.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:42 smithi176 ceph-mon[35713]: from='mgr.14150 172.21.15.18:0/3985451663' entity='mgr.x' 2024-09-12T02:47:43.375 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":373,"stamp":"2024-09-12T02:47:40.644930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662432,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":821,"num_read_kb":543,"num_write":434,"num_write_kb":3086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":355,"ondisk_log_size":355,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360648,"kb_used_data":15488,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124581176,"statfs":{"total":1151940427776,"available":1151571124224,"internally_reserved":0,"allocated":15859712,"data_stored":8738570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003533"},"pg_stats":[{"pgid":"2.1f","version":"96'13","reported_seq":123,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:37.768493+0000","last_change":"2024-09-12T02:45:32.388516+0000","last_active":"2024-09-12T02:47:37.768493+0000","last_peered":"2024-09-12T02:47:37.768493+0000","last_clean":"2024-09-12T02:47:37.768493+0000","last_became_active":"2024-09-12T02:45:32.388066+0000","last_became_peered":"2024-09-12T02:45:32.388066+0000","last_unstale":"2024-09-12T02:47:37.768493+0000","last_undegraded":"2024-09-12T02:47:37.768493+0000","last_fullsized":"2024-09-12T02:47:37.768493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:51.222779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689555+0000","last_change":"2024-09-12T02:45:35.434469+0000","last_active":"2024-09-12T02:47:12.689555+0000","last_peered":"2024-09-12T02:47:12.689555+0000","last_clean":"2024-09-12T02:47:12.689555+0000","last_became_active":"2024-09-12T02:45:35.431803+0000","last_became_peered":"2024-09-12T02:45:35.431803+0000","last_unstale":"2024-09-12T02:47:12.689555+0000","last_undegraded":"2024-09-12T02:47:12.689555+0000","last_fullsized":"2024-09-12T02:47:12.689555+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:00.826976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.690917+0000","last_change":"2024-09-12T02:47:12.690917+0000","last_active":"2024-09-12T02:47:12.690917+0000","last_peered":"2024-09-12T02:47:12.690917+0000","last_clean":"2024-09-12T02:47:12.690917+0000","last_became_active":"2024-09-12T02:47:12.690487+0000","last_became_peered":"2024-09-12T02:47:12.690487+0000","last_unstale":"2024-09-12T02:47:12.690917+0000","last_undegraded":"2024-09-12T02:47:12.690917+0000","last_fullsized":"2024-09-12T02:47:12.690917+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:16.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"96'2","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689861+0000","last_change":"2024-09-12T02:45:32.479037+0000","last_active":"2024-09-12T02:47:12.689861+0000","last_peered":"2024-09-12T02:47:12.689861+0000","last_clean":"2024-09-12T02:47:12.689861+0000","last_became_active":"2024-09-12T02:45:32.477071+0000","last_became_peered":"2024-09-12T02:45:32.477071+0000","last_unstale":"2024-09-12T02:47:12.689861+0000","last_undegraded":"2024-09-12T02:47:12.689861+0000","last_fullsized":"2024-09-12T02:47:12.689861+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:29.512142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612606+0000","last_change":"2024-09-12T02:45:35.418226+0000","last_active":"2024-09-12T02:47:12.612606+0000","last_peered":"2024-09-12T02:47:12.612606+0000","last_clean":"2024-09-12T02:47:12.612606+0000","last_became_active":"2024-09-12T02:45:35.417910+0000","last_became_peered":"2024-09-12T02:45:35.417910+0000","last_unstale":"2024-09-12T02:47:12.612606+0000","last_undegraded":"2024-09-12T02:47:12.612606+0000","last_fullsized":"2024-09-12T02:47:12.612606+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:06.788584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707011+0000","last_change":"2024-09-12T02:45:45.487575+0000","last_active":"2024-09-12T02:47:12.707011+0000","last_peered":"2024-09-12T02:47:12.707011+0000","last_clean":"2024-09-12T02:47:12.707011+0000","last_became_active":"2024-09-12T02:45:45.487246+0000","last_became_peered":"2024-09-12T02:45:45.487246+0000","last_unstale":"2024-09-12T02:47:12.707011+0000","last_undegraded":"2024-09-12T02:47:12.707011+0000","last_fullsized":"2024-09-12T02:47:12.707011+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:06.068200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"96'12","reported_seq":57,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.617653+0000","last_change":"2024-09-12T02:45:32.393707+0000","last_active":"2024-09-12T02:47:12.617653+0000","last_peered":"2024-09-12T02:47:12.617653+0000","last_clean":"2024-09-12T02:47:12.617653+0000","last_became_active":"2024-09-12T02:45:32.393305+0000","last_became_peered":"2024-09-12T02:45:32.393305+0000","last_unstale":"2024-09-12T02:47:12.617653+0000","last_undegraded":"2024-09-12T02:47:12.617653+0000","last_fullsized":"2024-09-12T02:47:12.617653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:02.755660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.614324+0000","last_change":"2024-09-12T02:45:35.432556+0000","last_active":"2024-09-12T02:47:12.614324+0000","last_peered":"2024-09-12T02:47:12.614324+0000","last_clean":"2024-09-12T02:47:12.614324+0000","last_became_active":"2024-09-12T02:45:35.431164+0000","last_became_peered":"2024-09-12T02:45:35.431164+0000","last_unstale":"2024-09-12T02:47:12.614324+0000","last_undegraded":"2024-09-12T02:47:12.614324+0000","last_fullsized":"2024-09-12T02:47:12.614324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:11.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707932+0000","last_change":"2024-09-12T02:45:45.493518+0000","last_active":"2024-09-12T02:47:12.707932+0000","last_peered":"2024-09-12T02:47:12.707932+0000","last_clean":"2024-09-12T02:47:12.707932+0000","last_became_active":"2024-09-12T02:45:45.492902+0000","last_became_peered":"2024-09-12T02:45:45.492902+0000","last_unstale":"2024-09-12T02:47:12.707932+0000","last_undegraded":"2024-09-12T02:47:12.707932+0000","last_fullsized":"2024-09-12T02:47:12.707932+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:11.278901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"96'5","reported_seq":50,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.617691+0000","last_change":"2024-09-12T02:45:32.388552+0000","last_active":"2024-09-12T02:47:12.617691+0000","last_peered":"2024-09-12T02:47:12.617691+0000","last_clean":"2024-09-12T02:47:12.617691+0000","last_became_active":"2024-09-12T02:45:32.388168+0000","last_became_peered":"2024-09-12T02:45:32.388168+0000","last_unstale":"2024-09-12T02:47:12.617691+0000","last_undegraded":"2024-09-12T02:47:12.617691+0000","last_fullsized":"2024-09-12T02:47:12.617691+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:29.803240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707093+0000","last_change":"2024-09-12T02:46:12.951385+0000","last_active":"2024-09-12T02:47:12.707093+0000","last_peered":"2024-09-12T02:47:12.707093+0000","last_clean":"2024-09-12T02:47:12.707093+0000","last_became_active":"2024-09-12T02:46:12.950977+0000","last_became_peered":"2024-09-12T02:46:12.950977+0000","last_unstale":"2024-09-12T02:47:12.707093+0000","last_undegraded":"2024-09-12T02:47:12.707093+0000","last_fullsized":"2024-09-12T02:47:12.707093+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:59.262026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707192+0000","last_change":"2024-09-12T02:45:45.487534+0000","last_active":"2024-09-12T02:47:12.707192+0000","last_peered":"2024-09-12T02:47:12.707192+0000","last_clean":"2024-09-12T02:47:12.707192+0000","last_became_active":"2024-09-12T02:45:45.487101+0000","last_became_peered":"2024-09-12T02:45:45.487101+0000","last_unstale":"2024-09-12T02:47:12.707192+0000","last_undegraded":"2024-09-12T02:47:12.707192+0000","last_fullsized":"2024-09-12T02:47:12.707192+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:50.808850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610515+0000","last_change":"2024-09-12T02:45:35.432796+0000","last_active":"2024-09-12T02:47:12.610515+0000","last_peered":"2024-09-12T02:47:12.610515+0000","last_clean":"2024-09-12T02:47:12.610515+0000","last_became_active":"2024-09-12T02:45:35.432456+0000","last_became_peered":"2024-09-12T02:45:35.432456+0000","last_unstale":"2024-09-12T02:47:12.610515+0000","last_undegraded":"2024-09-12T02:47:12.610515+0000","last_fullsized":"2024-09-12T02:47:12.610515+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:02.597515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"96'4","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.617738+0000","last_change":"2024-09-12T02:45:32.394657+0000","last_active":"2024-09-12T02:47:12.617738+0000","last_peered":"2024-09-12T02:47:12.617738+0000","last_clean":"2024-09-12T02:47:12.617738+0000","last_became_active":"2024-09-12T02:45:32.394277+0000","last_became_peered":"2024-09-12T02:45:32.394277+0000","last_unstale":"2024-09-12T02:47:12.617738+0000","last_undegraded":"2024-09-12T02:47:12.617738+0000","last_fullsized":"2024-09-12T02:47:12.617738+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:26.614900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707556+0000","last_change":"2024-09-12T02:45:45.831567+0000","last_active":"2024-09-12T02:47:12.707556+0000","last_peered":"2024-09-12T02:47:12.707556+0000","last_clean":"2024-09-12T02:47:12.707556+0000","last_became_active":"2024-09-12T02:45:45.831124+0000","last_became_peered":"2024-09-12T02:45:45.831124+0000","last_unstale":"2024-09-12T02:47:12.707556+0000","last_undegraded":"2024-09-12T02:47:12.707556+0000","last_fullsized":"2024-09-12T02:47:12.707556+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:43.289387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689934+0000","last_change":"2024-09-12T02:45:35.435658+0000","last_active":"2024-09-12T02:47:12.689934+0000","last_peered":"2024-09-12T02:47:12.689934+0000","last_clean":"2024-09-12T02:47:12.689934+0000","last_became_active":"2024-09-12T02:45:35.434759+0000","last_became_peered":"2024-09-12T02:45:35.434759+0000","last_unstale":"2024-09-12T02:47:12.689934+0000","last_undegraded":"2024-09-12T02:47:12.689934+0000","last_fullsized":"2024-09-12T02:47:12.689934+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:49.384125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"96'3","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609819+0000","last_change":"2024-09-12T02:45:32.394125+0000","last_active":"2024-09-12T02:47:12.609819+0000","last_peered":"2024-09-12T02:47:12.609819+0000","last_clean":"2024-09-12T02:47:12.609819+0000","last_became_active":"2024-09-12T02:45:32.393797+0000","last_became_peered":"2024-09-12T02:45:32.393797+0000","last_unstale":"2024-09-12T02:47:12.609819+0000","last_undegraded":"2024-09-12T02:47:12.609819+0000","last_fullsized":"2024-09-12T02:47:12.609819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:41.553865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"96'1","reported_seq":27,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707205+0000","last_change":"2024-09-12T02:45:45.495186+0000","last_active":"2024-09-12T02:47:12.707205+0000","last_peered":"2024-09-12T02:47:12.707205+0000","last_clean":"2024-09-12T02:47:12.707205+0000","last_became_active":"2024-09-12T02:45:45.494764+0000","last_became_peered":"2024-09-12T02:45:45.494764+0000","last_unstale":"2024-09-12T02:47:12.707205+0000","last_undegraded":"2024-09-12T02:47:12.707205+0000","last_fullsized":"2024-09-12T02:47:12.707205+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:59.623399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.611985+0000","last_change":"2024-09-12T02:45:35.431606+0000","last_active":"2024-09-12T02:47:12.611985+0000","last_peered":"2024-09-12T02:47:12.611985+0000","last_clean":"2024-09-12T02:47:12.611985+0000","last_became_active":"2024-09-12T02:45:35.431259+0000","last_became_peered":"2024-09-12T02:45:35.431259+0000","last_unstale":"2024-09-12T02:47:12.611985+0000","last_undegraded":"2024-09-12T02:47:12.611985+0000","last_fullsized":"2024-09-12T02:47:12.611985+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:17.014610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"96'7","reported_seq":51,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689768+0000","last_change":"2024-09-12T02:45:32.386098+0000","last_active":"2024-09-12T02:47:12.689768+0000","last_peered":"2024-09-12T02:47:12.689768+0000","last_clean":"2024-09-12T02:47:12.689768+0000","last_became_active":"2024-09-12T02:45:32.385762+0000","last_became_peered":"2024-09-12T02:45:32.385762+0000","last_unstale":"2024-09-12T02:47:12.689768+0000","last_undegraded":"2024-09-12T02:47:12.689768+0000","last_fullsized":"2024-09-12T02:47:12.689768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:17.109916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707783+0000","last_change":"2024-09-12T02:45:45.492746+0000","last_active":"2024-09-12T02:47:12.707783+0000","last_peered":"2024-09-12T02:47:12.707783+0000","last_clean":"2024-09-12T02:47:12.707783+0000","last_became_active":"2024-09-12T02:45:45.492280+0000","last_became_peered":"2024-09-12T02:45:45.492280+0000","last_unstale":"2024-09-12T02:47:12.707783+0000","last_undegraded":"2024-09-12T02:47:12.707783+0000","last_fullsized":"2024-09-12T02:47:12.707783+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:56.585316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.616958+0000","last_change":"2024-09-12T02:45:35.430254+0000","last_active":"2024-09-12T02:47:12.616958+0000","last_peered":"2024-09-12T02:47:12.616958+0000","last_clean":"2024-09-12T02:47:12.616958+0000","last_became_active":"2024-09-12T02:45:35.429822+0000","last_became_peered":"2024-09-12T02:45:35.429822+0000","last_unstale":"2024-09-12T02:47:12.616958+0000","last_undegraded":"2024-09-12T02:47:12.616958+0000","last_fullsized":"2024-09-12T02:47:12.616958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:45.750936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"96'2","reported_seq":45,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.614745+0000","last_change":"2024-09-12T02:45:32.476950+0000","last_active":"2024-09-12T02:47:12.614745+0000","last_peered":"2024-09-12T02:47:12.614745+0000","last_clean":"2024-09-12T02:47:12.614745+0000","last_became_active":"2024-09-12T02:45:32.476619+0000","last_became_peered":"2024-09-12T02:45:32.476619+0000","last_unstale":"2024-09-12T02:47:12.614745+0000","last_undegraded":"2024-09-12T02:47:12.614745+0000","last_fullsized":"2024-09-12T02:47:12.614745+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:18.963069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707688+0000","last_change":"2024-09-12T02:45:45.833226+0000","last_active":"2024-09-12T02:47:12.707688+0000","last_peered":"2024-09-12T02:47:12.707688+0000","last_clean":"2024-09-12T02:47:12.707688+0000","last_became_active":"2024-09-12T02:45:45.832716+0000","last_became_peered":"2024-09-12T02:45:45.832716+0000","last_unstale":"2024-09-12T02:47:12.707688+0000","last_undegraded":"2024-09-12T02:47:12.707688+0000","last_fullsized":"2024-09-12T02:47:12.707688+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:12.072765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612133+0000","last_change":"2024-09-12T02:45:35.436301+0000","last_active":"2024-09-12T02:47:12.612133+0000","last_peered":"2024-09-12T02:47:12.612133+0000","last_clean":"2024-09-12T02:47:12.612133+0000","last_became_active":"2024-09-12T02:45:35.435999+0000","last_became_peered":"2024-09-12T02:45:35.435999+0000","last_unstale":"2024-09-12T02:47:12.612133+0000","last_undegraded":"2024-09-12T02:47:12.612133+0000","last_fullsized":"2024-09-12T02:47:12.612133+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:02.823154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"96'7","reported_seq":51,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.708755+0000","last_change":"2024-09-12T02:45:32.382231+0000","last_active":"2024-09-12T02:47:12.708755+0000","last_peered":"2024-09-12T02:47:12.708755+0000","last_clean":"2024-09-12T02:47:12.708755+0000","last_became_active":"2024-09-12T02:45:32.381821+0000","last_became_peered":"2024-09-12T02:45:32.381821+0000","last_unstale":"2024-09-12T02:47:12.708755+0000","last_undegraded":"2024-09-12T02:47:12.708755+0000","last_fullsized":"2024-09-12T02:47:12.708755+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:34:02.631429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609691+0000","last_change":"2024-09-12T02:45:45.481460+0000","last_active":"2024-09-12T02:47:12.609691+0000","last_peered":"2024-09-12T02:47:12.609691+0000","last_clean":"2024-09-12T02:47:12.609691+0000","last_became_active":"2024-09-12T02:45:45.480697+0000","last_became_peered":"2024-09-12T02:45:45.480697+0000","last_unstale":"2024-09-12T02:47:12.609691+0000","last_undegraded":"2024-09-12T02:47:12.609691+0000","last_fullsized":"2024-09-12T02:47:12.609691+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:34.985196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689745+0000","last_change":"2024-09-12T02:45:35.434844+0000","last_active":"2024-09-12T02:47:12.689745+0000","last_peered":"2024-09-12T02:47:12.689745+0000","last_clean":"2024-09-12T02:47:12.689745+0000","last_became_active":"2024-09-12T02:45:35.433513+0000","last_became_peered":"2024-09-12T02:45:35.433513+0000","last_unstale":"2024-09-12T02:47:12.689745+0000","last_undegraded":"2024-09-12T02:47:12.689745+0000","last_fullsized":"2024-09-12T02:47:12.689745+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:01.473202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"96'15","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707790+0000","last_change":"2024-09-12T02:45:32.389455+0000","last_active":"2024-09-12T02:47:12.707790+0000","last_peered":"2024-09-12T02:47:12.707790+0000","last_clean":"2024-09-12T02:47:12.707790+0000","last_became_active":"2024-09-12T02:45:32.388633+0000","last_became_peered":"2024-09-12T02:45:32.388633+0000","last_unstale":"2024-09-12T02:47:12.707790+0000","last_undegraded":"2024-09-12T02:47:12.707790+0000","last_fullsized":"2024-09-12T02:47:12.707790+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:34.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689082+0000","last_change":"2024-09-12T02:45:45.831697+0000","last_active":"2024-09-12T02:47:12.689082+0000","last_peered":"2024-09-12T02:47:12.689082+0000","last_clean":"2024-09-12T02:47:12.689082+0000","last_became_active":"2024-09-12T02:45:45.831167+0000","last_became_peered":"2024-09-12T02:45:45.831167+0000","last_unstale":"2024-09-12T02:47:12.689082+0000","last_undegraded":"2024-09-12T02:47:12.689082+0000","last_fullsized":"2024-09-12T02:47:12.689082+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:48.553773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609403+0000","last_change":"2024-09-12T02:45:35.423196+0000","last_active":"2024-09-12T02:47:12.609403+0000","last_peered":"2024-09-12T02:47:12.609403+0000","last_clean":"2024-09-12T02:47:12.609403+0000","last_became_active":"2024-09-12T02:45:35.422778+0000","last_became_peered":"2024-09-12T02:45:35.422778+0000","last_unstale":"2024-09-12T02:47:12.609403+0000","last_undegraded":"2024-09-12T02:47:12.609403+0000","last_fullsized":"2024-09-12T02:47:12.609403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:37.092151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"96'4","reported_seq":20,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.611852+0000","last_change":"2024-09-12T02:46:12.558805+0000","last_active":"2024-09-12T02:47:12.611852+0000","last_peered":"2024-09-12T02:47:12.611852+0000","last_clean":"2024-09-12T02:47:12.611852+0000","last_became_active":"2024-09-12T02:46:12.558479+0000","last_became_peered":"2024-09-12T02:46:12.558479+0000","last_unstale":"2024-09-12T02:47:12.611852+0000","last_undegraded":"2024-09-12T02:47:12.611852+0000","last_fullsized":"2024-09-12T02:47:12.611852+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:28.757698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":33,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.619317+0000","last_change":"2024-09-12T02:47:12.619317+0000","last_active":"2024-09-12T02:47:12.619317+0000","last_peered":"2024-09-12T02:47:12.619317+0000","last_clean":"2024-09-12T02:47:12.619317+0000","last_became_active":"2024-09-12T02:47:12.618808+0000","last_became_peered":"2024-09-12T02:47:12.618808+0000","last_unstale":"2024-09-12T02:47:12.619317+0000","last_undegraded":"2024-09-12T02:47:12.619317+0000","last_fullsized":"2024-09-12T02:47:12.619317+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:20.339072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.708345+0000","last_change":"2024-09-12T02:45:35.432783+0000","last_active":"2024-09-12T02:47:12.708345+0000","last_peered":"2024-09-12T02:47:12.708345+0000","last_clean":"2024-09-12T02:47:12.708345+0000","last_became_active":"2024-09-12T02:45:35.432461+0000","last_became_peered":"2024-09-12T02:45:35.432461+0000","last_unstale":"2024-09-12T02:47:12.708345+0000","last_undegraded":"2024-09-12T02:47:12.708345+0000","last_fullsized":"2024-09-12T02:47:12.708345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:20.066115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"96'1","reported_seq":46,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707432+0000","last_change":"2024-09-12T02:45:32.478636+0000","last_active":"2024-09-12T02:47:12.707432+0000","last_peered":"2024-09-12T02:47:12.707432+0000","last_clean":"2024-09-12T02:47:12.707432+0000","last_became_active":"2024-09-12T02:45:32.477347+0000","last_became_peered":"2024-09-12T02:45:32.477347+0000","last_unstale":"2024-09-12T02:47:12.707432+0000","last_undegraded":"2024-09-12T02:47:12.707432+0000","last_fullsized":"2024-09-12T02:47:12.707432+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:02.872897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.616944+0000","last_change":"2024-09-12T02:45:45.831550+0000","last_active":"2024-09-12T02:47:12.616944+0000","last_peered":"2024-09-12T02:47:12.616944+0000","last_clean":"2024-09-12T02:47:12.616944+0000","last_became_active":"2024-09-12T02:45:45.831004+0000","last_became_peered":"2024-09-12T02:45:45.831004+0000","last_unstale":"2024-09-12T02:47:12.616944+0000","last_undegraded":"2024-09-12T02:47:12.616944+0000","last_fullsized":"2024-09-12T02:47:12.616944+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:24.183273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.708158+0000","last_change":"2024-09-12T02:45:35.417296+0000","last_active":"2024-09-12T02:47:12.708158+0000","last_peered":"2024-09-12T02:47:12.708158+0000","last_clean":"2024-09-12T02:47:12.708158+0000","last_became_active":"2024-09-12T02:45:35.416963+0000","last_became_peered":"2024-09-12T02:45:35.416963+0000","last_unstale":"2024-09-12T02:47:12.708158+0000","last_undegraded":"2024-09-12T02:47:12.708158+0000","last_fullsized":"2024-09-12T02:47:12.708158+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:22.945974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"96'6","reported_seq":115,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:36.767635+0000","last_change":"2024-09-12T02:45:32.387264+0000","last_active":"2024-09-12T02:47:36.767635+0000","last_peered":"2024-09-12T02:47:36.767635+0000","last_clean":"2024-09-12T02:47:36.767635+0000","last_became_active":"2024-09-12T02:45:32.386900+0000","last_became_peered":"2024-09-12T02:45:32.386900+0000","last_unstale":"2024-09-12T02:47:36.767635+0000","last_undegraded":"2024-09-12T02:47:36.767635+0000","last_fullsized":"2024-09-12T02:47:36.767635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:26.638049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609267+0000","last_change":"2024-09-12T02:45:45.481793+0000","last_active":"2024-09-12T02:47:12.609267+0000","last_peered":"2024-09-12T02:47:12.609267+0000","last_clean":"2024-09-12T02:47:12.609267+0000","last_became_active":"2024-09-12T02:45:45.481265+0000","last_became_peered":"2024-09-12T02:45:45.481265+0000","last_unstale":"2024-09-12T02:47:12.609267+0000","last_undegraded":"2024-09-12T02:47:12.609267+0000","last_fullsized":"2024-09-12T02:47:12.609267+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:24.568713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707233+0000","last_change":"2024-09-12T02:45:35.432102+0000","last_active":"2024-09-12T02:47:12.707233+0000","last_peered":"2024-09-12T02:47:12.707233+0000","last_clean":"2024-09-12T02:47:12.707233+0000","last_became_active":"2024-09-12T02:45:35.431521+0000","last_became_peered":"2024-09-12T02:45:35.431521+0000","last_unstale":"2024-09-12T02:47:12.707233+0000","last_undegraded":"2024-09-12T02:47:12.707233+0000","last_fullsized":"2024-09-12T02:47:12.707233+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:40.669668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"96'5","reported_seq":117,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:39.771269+0000","last_change":"2024-09-12T02:45:32.479322+0000","last_active":"2024-09-12T02:47:39.771269+0000","last_peered":"2024-09-12T02:47:39.771269+0000","last_clean":"2024-09-12T02:47:39.771269+0000","last_became_active":"2024-09-12T02:45:32.478565+0000","last_became_peered":"2024-09-12T02:45:32.478565+0000","last_unstale":"2024-09-12T02:47:39.771269+0000","last_undegraded":"2024-09-12T02:47:39.771269+0000","last_fullsized":"2024-09-12T02:47:39.771269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:03.400545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":67,"num_read_kb":67,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609195+0000","last_change":"2024-09-12T02:45:45.831894+0000","last_active":"2024-09-12T02:47:12.609195+0000","last_peered":"2024-09-12T02:47:12.609195+0000","last_clean":"2024-09-12T02:47:12.609195+0000","last_became_active":"2024-09-12T02:45:45.831365+0000","last_became_peered":"2024-09-12T02:45:45.831365+0000","last_unstale":"2024-09-12T02:47:12.609195+0000","last_undegraded":"2024-09-12T02:47:12.609195+0000","last_fullsized":"2024-09-12T02:47:12.609195+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:57.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609007+0000","last_change":"2024-09-12T02:45:35.419676+0000","last_active":"2024-09-12T02:47:12.609007+0000","last_peered":"2024-09-12T02:47:12.609007+0000","last_clean":"2024-09-12T02:47:12.609007+0000","last_became_active":"2024-09-12T02:45:35.419371+0000","last_became_peered":"2024-09-12T02:45:35.419371+0000","last_unstale":"2024-09-12T02:47:12.609007+0000","last_undegraded":"2024-09-12T02:47:12.609007+0000","last_fullsized":"2024-09-12T02:47:12.609007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:19.303214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"96'4","reported_seq":48,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610873+0000","last_change":"2024-09-12T02:45:32.389855+0000","last_active":"2024-09-12T02:47:12.610873+0000","last_peered":"2024-09-12T02:47:12.610873+0000","last_clean":"2024-09-12T02:47:12.610873+0000","last_became_active":"2024-09-12T02:45:32.389457+0000","last_became_peered":"2024-09-12T02:45:32.389457+0000","last_unstale":"2024-09-12T02:47:12.610873+0000","last_undegraded":"2024-09-12T02:47:12.610873+0000","last_fullsized":"2024-09-12T02:47:12.610873+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:41.540961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707495+0000","last_change":"2024-09-12T02:45:45.832346+0000","last_active":"2024-09-12T02:47:12.707495+0000","last_peered":"2024-09-12T02:47:12.707495+0000","last_clean":"2024-09-12T02:47:12.707495+0000","last_became_active":"2024-09-12T02:45:45.831810+0000","last_became_peered":"2024-09-12T02:45:45.831810+0000","last_unstale":"2024-09-12T02:47:12.707495+0000","last_undegraded":"2024-09-12T02:47:12.707495+0000","last_fullsized":"2024-09-12T02:47:12.707495+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:08.388606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689751+0000","last_change":"2024-09-12T02:45:35.437560+0000","last_active":"2024-09-12T02:47:12.689751+0000","last_peered":"2024-09-12T02:47:12.689751+0000","last_clean":"2024-09-12T02:47:12.689751+0000","last_became_active":"2024-09-12T02:45:35.435837+0000","last_became_peered":"2024-09-12T02:45:35.435837+0000","last_unstale":"2024-09-12T02:47:12.689751+0000","last_undegraded":"2024-09-12T02:47:12.689751+0000","last_fullsized":"2024-09-12T02:47:12.689751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:21.171560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"96'6","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.708291+0000","last_change":"2024-09-12T02:45:32.385075+0000","last_active":"2024-09-12T02:47:12.708291+0000","last_peered":"2024-09-12T02:47:12.708291+0000","last_clean":"2024-09-12T02:47:12.708291+0000","last_became_active":"2024-09-12T02:45:32.384569+0000","last_became_peered":"2024-09-12T02:45:32.384569+0000","last_unstale":"2024-09-12T02:47:12.708291+0000","last_undegraded":"2024-09-12T02:47:12.708291+0000","last_fullsized":"2024-09-12T02:47:12.708291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:32.962756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":370,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610936+0000","last_change":"2024-09-12T02:44:18.042779+0000","last_active":"2024-09-12T02:47:12.610936+0000","last_peered":"2024-09-12T02:47:12.610936+0000","last_clean":"2024-09-12T02:47:12.610936+0000","last_became_active":"2024-09-12T02:44:18.042265+0000","last_became_peered":"2024-09-12T02:44:18.042265+0000","last_unstale":"2024-09-12T02:47:12.610936+0000","last_undegraded":"2024-09-12T02:47:12.610936+0000","last_fullsized":"2024-09-12T02:47:12.610936+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:40:35.543336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:40:35.543336+0000","last_clean_scrub_stamp":"2024-09-12T02:40:35.543336+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:22.348756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"96'1","reported_seq":27,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610627+0000","last_change":"2024-09-12T02:45:45.492737+0000","last_active":"2024-09-12T02:47:12.610627+0000","last_peered":"2024-09-12T02:47:12.610627+0000","last_clean":"2024-09-12T02:47:12.610627+0000","last_became_active":"2024-09-12T02:45:45.492280+0000","last_became_peered":"2024-09-12T02:45:45.492280+0000","last_unstale":"2024-09-12T02:47:12.610627+0000","last_undegraded":"2024-09-12T02:47:12.610627+0000","last_fullsized":"2024-09-12T02:47:12.610627+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:45.530066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610971+0000","last_change":"2024-09-12T02:45:35.431876+0000","last_active":"2024-09-12T02:47:12.610971+0000","last_peered":"2024-09-12T02:47:12.610971+0000","last_clean":"2024-09-12T02:47:12.610971+0000","last_became_active":"2024-09-12T02:45:35.431505+0000","last_became_peered":"2024-09-12T02:45:35.431505+0000","last_unstale":"2024-09-12T02:47:12.610971+0000","last_undegraded":"2024-09-12T02:47:12.610971+0000","last_fullsized":"2024-09-12T02:47:12.610971+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:30.370034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"96'6","reported_seq":119,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:38.771052+0000","last_change":"2024-09-12T02:45:32.477394+0000","last_active":"2024-09-12T02:47:38.771052+0000","last_peered":"2024-09-12T02:47:38.771052+0000","last_clean":"2024-09-12T02:47:38.771052+0000","last_became_active":"2024-09-12T02:45:32.477064+0000","last_became_peered":"2024-09-12T02:45:32.477064+0000","last_unstale":"2024-09-12T02:47:38.771052+0000","last_undegraded":"2024-09-12T02:47:38.771052+0000","last_fullsized":"2024-09-12T02:47:38.771052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:03.828652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":69,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.614246+0000","last_change":"2024-09-12T02:45:45.481201+0000","last_active":"2024-09-12T02:47:12.614246+0000","last_peered":"2024-09-12T02:47:12.614246+0000","last_clean":"2024-09-12T02:47:12.614246+0000","last_became_active":"2024-09-12T02:45:45.480721+0000","last_became_peered":"2024-09-12T02:45:45.480721+0000","last_unstale":"2024-09-12T02:47:12.614246+0000","last_undegraded":"2024-09-12T02:47:12.614246+0000","last_fullsized":"2024-09-12T02:47:12.614246+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:12.780521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610487+0000","last_change":"2024-09-12T02:45:35.440920+0000","last_active":"2024-09-12T02:47:12.610487+0000","last_peered":"2024-09-12T02:47:12.610487+0000","last_clean":"2024-09-12T02:47:12.610487+0000","last_became_active":"2024-09-12T02:45:35.440566+0000","last_became_peered":"2024-09-12T02:45:35.440566+0000","last_unstale":"2024-09-12T02:47:12.610487+0000","last_undegraded":"2024-09-12T02:47:12.610487+0000","last_fullsized":"2024-09-12T02:47:12.610487+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:19.171841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"96'3","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707845+0000","last_change":"2024-09-12T02:45:32.388589+0000","last_active":"2024-09-12T02:47:12.707845+0000","last_peered":"2024-09-12T02:47:12.707845+0000","last_clean":"2024-09-12T02:47:12.707845+0000","last_became_active":"2024-09-12T02:45:32.388243+0000","last_became_peered":"2024-09-12T02:45:32.388243+0000","last_unstale":"2024-09-12T02:47:12.707845+0000","last_undegraded":"2024-09-12T02:47:12.707845+0000","last_fullsized":"2024-09-12T02:47:12.707845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:23.747525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.709684+0000","last_change":"2024-09-12T02:47:12.709684+0000","last_active":"2024-09-12T02:47:12.709684+0000","last_peered":"2024-09-12T02:47:12.709684+0000","last_clean":"2024-09-12T02:47:12.709684+0000","last_became_active":"2024-09-12T02:47:12.709272+0000","last_became_peered":"2024-09-12T02:47:12.709272+0000","last_unstale":"2024-09-12T02:47:12.709684+0000","last_undegraded":"2024-09-12T02:47:12.709684+0000","last_fullsized":"2024-09-12T02:47:12.709684+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:45.198897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,10,1,4],"acting":[0,10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610525+0000","last_change":"2024-09-12T02:45:35.427871+0000","last_active":"2024-09-12T02:47:12.610525+0000","last_peered":"2024-09-12T02:47:12.610525+0000","last_clean":"2024-09-12T02:47:12.610525+0000","last_became_active":"2024-09-12T02:45:35.427499+0000","last_became_peered":"2024-09-12T02:45:35.427499+0000","last_unstale":"2024-09-12T02:47:12.610525+0000","last_undegraded":"2024-09-12T02:47:12.610525+0000","last_fullsized":"2024-09-12T02:47:12.610525+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:15.515311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"96'5","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609661+0000","last_change":"2024-09-12T02:45:32.389199+0000","last_active":"2024-09-12T02:47:12.609661+0000","last_peered":"2024-09-12T02:47:12.609661+0000","last_clean":"2024-09-12T02:47:12.609661+0000","last_became_active":"2024-09-12T02:45:32.388885+0000","last_became_peered":"2024-09-12T02:45:32.388885+0000","last_unstale":"2024-09-12T02:47:12.609661+0000","last_undegraded":"2024-09-12T02:47:12.609661+0000","last_fullsized":"2024-09-12T02:47:12.609661+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.002707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707028+0000","last_change":"2024-09-12T02:45:45.485171+0000","last_active":"2024-09-12T02:47:12.707028+0000","last_peered":"2024-09-12T02:47:12.707028+0000","last_clean":"2024-09-12T02:47:12.707028+0000","last_became_active":"2024-09-12T02:45:45.484540+0000","last_became_peered":"2024-09-12T02:45:45.484540+0000","last_unstale":"2024-09-12T02:47:12.707028+0000","last_undegraded":"2024-09-12T02:47:12.707028+0000","last_fullsized":"2024-09-12T02:47:12.707028+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:52.063588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612231+0000","last_change":"2024-09-12T02:46:12.951994+0000","last_active":"2024-09-12T02:47:12.612231+0000","last_peered":"2024-09-12T02:47:12.612231+0000","last_clean":"2024-09-12T02:47:12.612231+0000","last_became_active":"2024-09-12T02:46:12.951653+0000","last_became_peered":"2024-09-12T02:46:12.951653+0000","last_unstale":"2024-09-12T02:47:12.612231+0000","last_undegraded":"2024-09-12T02:47:12.612231+0000","last_fullsized":"2024-09-12T02:47:12.612231+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:35.221403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"96'2","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.617586+0000","last_change":"2024-09-12T02:45:32.390592+0000","last_active":"2024-09-12T02:47:12.617586+0000","last_peered":"2024-09-12T02:47:12.617586+0000","last_clean":"2024-09-12T02:47:12.617586+0000","last_became_active":"2024-09-12T02:45:32.390211+0000","last_became_peered":"2024-09-12T02:45:32.390211+0000","last_unstale":"2024-09-12T02:47:12.617586+0000","last_undegraded":"2024-09-12T02:47:12.617586+0000","last_fullsized":"2024-09-12T02:47:12.617586+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:04.437645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707269+0000","last_change":"2024-09-12T02:45:45.491332+0000","last_active":"2024-09-12T02:47:12.707269+0000","last_peered":"2024-09-12T02:47:12.707269+0000","last_clean":"2024-09-12T02:47:12.707269+0000","last_became_active":"2024-09-12T02:45:45.490943+0000","last_became_peered":"2024-09-12T02:45:45.490943+0000","last_unstale":"2024-09-12T02:47:12.707269+0000","last_undegraded":"2024-09-12T02:47:12.707269+0000","last_fullsized":"2024-09-12T02:47:12.707269+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:50.154253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707384+0000","last_change":"2024-09-12T02:45:35.426119+0000","last_active":"2024-09-12T02:47:12.707384+0000","last_peered":"2024-09-12T02:47:12.707384+0000","last_clean":"2024-09-12T02:47:12.707384+0000","last_became_active":"2024-09-12T02:45:35.425740+0000","last_became_peered":"2024-09-12T02:45:35.425740+0000","last_unstale":"2024-09-12T02:47:12.707384+0000","last_undegraded":"2024-09-12T02:47:12.707384+0000","last_fullsized":"2024-09-12T02:47:12.707384+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:36.451449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"96'17","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.628813+0000","last_change":"2024-09-12T02:47:12.628461+0000","last_active":"2024-09-12T02:47:12.628813+0000","last_peered":"2024-09-12T02:47:12.628813+0000","last_clean":"2024-09-12T02:47:12.628813+0000","last_became_active":"2024-09-12T02:47:12.615376+0000","last_became_peered":"2024-09-12T02:47:12.615376+0000","last_unstale":"2024-09-12T02:47:12.628813+0000","last_undegraded":"2024-09-12T02:47:12.628813+0000","last_fullsized":"2024-09-12T02:47:12.628813+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:23.818238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,1],"acting":[11,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609627+0000","last_change":"2024-09-12T02:45:45.493917+0000","last_active":"2024-09-12T02:47:12.609627+0000","last_peered":"2024-09-12T02:47:12.609627+0000","last_clean":"2024-09-12T02:47:12.609627+0000","last_became_active":"2024-09-12T02:45:45.493488+0000","last_became_peered":"2024-09-12T02:45:45.493488+0000","last_unstale":"2024-09-12T02:47:12.609627+0000","last_undegraded":"2024-09-12T02:47:12.609627+0000","last_fullsized":"2024-09-12T02:47:12.609627+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:27.092953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610235+0000","last_change":"2024-09-12T02:45:35.423430+0000","last_active":"2024-09-12T02:47:12.610235+0000","last_peered":"2024-09-12T02:47:12.610235+0000","last_clean":"2024-09-12T02:47:12.610235+0000","last_became_active":"2024-09-12T02:45:35.423097+0000","last_became_peered":"2024-09-12T02:45:35.423097+0000","last_unstale":"2024-09-12T02:47:12.610235+0000","last_undegraded":"2024-09-12T02:47:12.610235+0000","last_fullsized":"2024-09-12T02:47:12.610235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:53.823140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"96'5","reported_seq":113,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:35.766393+0000","last_change":"2024-09-12T02:45:32.384965+0000","last_active":"2024-09-12T02:47:35.766393+0000","last_peered":"2024-09-12T02:47:35.766393+0000","last_clean":"2024-09-12T02:47:35.766393+0000","last_became_active":"2024-09-12T02:45:32.384369+0000","last_became_peered":"2024-09-12T02:45:32.384369+0000","last_unstale":"2024-09-12T02:47:35.766393+0000","last_undegraded":"2024-09-12T02:47:35.766393+0000","last_fullsized":"2024-09-12T02:47:35.766393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:43.022766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707889+0000","last_change":"2024-09-12T02:45:45.491338+0000","last_active":"2024-09-12T02:47:12.707889+0000","last_peered":"2024-09-12T02:47:12.707889+0000","last_clean":"2024-09-12T02:47:12.707889+0000","last_became_active":"2024-09-12T02:45:45.490578+0000","last_became_peered":"2024-09-12T02:45:45.490578+0000","last_unstale":"2024-09-12T02:47:12.707889+0000","last_undegraded":"2024-09-12T02:47:12.707889+0000","last_fullsized":"2024-09-12T02:47:12.707889+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:28.609202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610670+0000","last_change":"2024-09-12T02:45:35.429907+0000","last_active":"2024-09-12T02:47:12.610670+0000","last_peered":"2024-09-12T02:47:12.610670+0000","last_clean":"2024-09-12T02:47:12.610670+0000","last_became_active":"2024-09-12T02:45:35.429546+0000","last_became_peered":"2024-09-12T02:45:35.429546+0000","last_unstale":"2024-09-12T02:47:12.610670+0000","last_undegraded":"2024-09-12T02:47:12.610670+0000","last_fullsized":"2024-09-12T02:47:12.610670+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:50.471835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"96'5","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707582+0000","last_change":"2024-09-12T02:45:32.390663+0000","last_active":"2024-09-12T02:47:12.707582+0000","last_peered":"2024-09-12T02:47:12.707582+0000","last_clean":"2024-09-12T02:47:12.707582+0000","last_became_active":"2024-09-12T02:45:32.390316+0000","last_became_peered":"2024-09-12T02:45:32.390316+0000","last_unstale":"2024-09-12T02:47:12.707582+0000","last_undegraded":"2024-09-12T02:47:12.707582+0000","last_fullsized":"2024-09-12T02:47:12.707582+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:11.605522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.611821+0000","last_change":"2024-09-12T02:45:45.494111+0000","last_active":"2024-09-12T02:47:12.611821+0000","last_peered":"2024-09-12T02:47:12.611821+0000","last_clean":"2024-09-12T02:47:12.611821+0000","last_became_active":"2024-09-12T02:45:45.493709+0000","last_became_peered":"2024-09-12T02:45:45.493709+0000","last_unstale":"2024-09-12T02:47:12.611821+0000","last_undegraded":"2024-09-12T02:47:12.611821+0000","last_fullsized":"2024-09-12T02:47:12.611821+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:24.998025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609191+0000","last_change":"2024-09-12T02:45:35.442187+0000","last_active":"2024-09-12T02:47:12.609191+0000","last_peered":"2024-09-12T02:47:12.609191+0000","last_clean":"2024-09-12T02:47:12.609191+0000","last_became_active":"2024-09-12T02:45:35.441751+0000","last_became_peered":"2024-09-12T02:45:35.441751+0000","last_unstale":"2024-09-12T02:47:12.609191+0000","last_undegraded":"2024-09-12T02:47:12.609191+0000","last_fullsized":"2024-09-12T02:47:12.609191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:53.014758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"96'9","reported_seq":55,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609887+0000","last_change":"2024-09-12T02:45:32.394390+0000","last_active":"2024-09-12T02:47:12.609887+0000","last_peered":"2024-09-12T02:47:12.609887+0000","last_clean":"2024-09-12T02:47:12.609887+0000","last_became_active":"2024-09-12T02:45:32.392304+0000","last_became_peered":"2024-09-12T02:45:32.392304+0000","last_unstale":"2024-09-12T02:47:12.609887+0000","last_undegraded":"2024-09-12T02:47:12.609887+0000","last_fullsized":"2024-09-12T02:47:12.609887+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:16.412697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707737+0000","last_change":"2024-09-12T02:45:45.491459+0000","last_active":"2024-09-12T02:47:12.707737+0000","last_peered":"2024-09-12T02:47:12.707737+0000","last_clean":"2024-09-12T02:47:12.707737+0000","last_became_active":"2024-09-12T02:45:45.490857+0000","last_became_peered":"2024-09-12T02:45:45.490857+0000","last_unstale":"2024-09-12T02:47:12.707737+0000","last_undegraded":"2024-09-12T02:47:12.707737+0000","last_fullsized":"2024-09-12T02:47:12.707737+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:39.712007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.617507+0000","last_change":"2024-09-12T02:45:35.431311+0000","last_active":"2024-09-12T02:47:12.617507+0000","last_peered":"2024-09-12T02:47:12.617507+0000","last_clean":"2024-09-12T02:47:12.617507+0000","last_became_active":"2024-09-12T02:45:35.430446+0000","last_became_peered":"2024-09-12T02:45:35.430446+0000","last_unstale":"2024-09-12T02:47:12.617507+0000","last_undegraded":"2024-09-12T02:47:12.617507+0000","last_fullsized":"2024-09-12T02:47:12.617507+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:28.526132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"96'37","reported_seq":220,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:38.770385+0000","last_change":"2024-09-12T02:45:32.395938+0000","last_active":"2024-09-12T02:47:38.770385+0000","last_peered":"2024-09-12T02:47:38.770385+0000","last_clean":"2024-09-12T02:47:38.770385+0000","last_became_active":"2024-09-12T02:45:32.395509+0000","last_became_peered":"2024-09-12T02:45:32.395509+0000","last_unstale":"2024-09-12T02:47:38.770385+0000","last_undegraded":"2024-09-12T02:47:38.770385+0000","last_fullsized":"2024-09-12T02:47:38.770385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:17.401062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64622,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":140,"num_read_kb":133,"num_write":39,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.706977+0000","last_change":"2024-09-12T02:45:45.493335+0000","last_active":"2024-09-12T02:47:12.706977+0000","last_peered":"2024-09-12T02:47:12.706977+0000","last_clean":"2024-09-12T02:47:12.706977+0000","last_became_active":"2024-09-12T02:45:45.490473+0000","last_became_peered":"2024-09-12T02:45:45.490473+0000","last_unstale":"2024-09-12T02:47:12.706977+0000","last_undegraded":"2024-09-12T02:47:12.706977+0000","last_fullsized":"2024-09-12T02:47:12.706977+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:10.375643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707101+0000","last_change":"2024-09-12T02:46:12.951215+0000","last_active":"2024-09-12T02:47:12.707101+0000","last_peered":"2024-09-12T02:47:12.707101+0000","last_clean":"2024-09-12T02:47:12.707101+0000","last_became_active":"2024-09-12T02:46:12.950829+0000","last_became_peered":"2024-09-12T02:46:12.950829+0000","last_unstale":"2024-09-12T02:47:12.707101+0000","last_undegraded":"2024-09-12T02:47:12.707101+0000","last_fullsized":"2024-09-12T02:47:12.707101+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:42.251826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,4],"acting":[9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.15","version":"96'5","reported_seq":49,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707811+0000","last_change":"2024-09-12T02:45:32.477587+0000","last_active":"2024-09-12T02:47:12.707811+0000","last_peered":"2024-09-12T02:47:12.707811+0000","last_clean":"2024-09-12T02:47:12.707811+0000","last_became_active":"2024-09-12T02:45:32.477084+0000","last_became_peered":"2024-09-12T02:45:32.477084+0000","last_unstale":"2024-09-12T02:47:12.707811+0000","last_undegraded":"2024-09-12T02:47:12.707811+0000","last_fullsized":"2024-09-12T02:47:12.707811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:24.363281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707826+0000","last_change":"2024-09-12T02:45:45.493505+0000","last_active":"2024-09-12T02:47:12.707826+0000","last_peered":"2024-09-12T02:47:12.707826+0000","last_clean":"2024-09-12T02:47:12.707826+0000","last_became_active":"2024-09-12T02:45:45.492903+0000","last_became_peered":"2024-09-12T02:45:45.492903+0000","last_unstale":"2024-09-12T02:47:12.707826+0000","last_undegraded":"2024-09-12T02:47:12.707826+0000","last_fullsized":"2024-09-12T02:47:12.707826+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:23.365274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612580+0000","last_change":"2024-09-12T02:45:35.422762+0000","last_active":"2024-09-12T02:47:12.612580+0000","last_peered":"2024-09-12T02:47:12.612580+0000","last_clean":"2024-09-12T02:47:12.612580+0000","last_became_active":"2024-09-12T02:45:35.422457+0000","last_became_peered":"2024-09-12T02:45:35.422457+0000","last_unstale":"2024-09-12T02:47:12.612580+0000","last_undegraded":"2024-09-12T02:47:12.612580+0000","last_fullsized":"2024-09-12T02:47:12.612580+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:41.437234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"96'4","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610643+0000","last_change":"2024-09-12T02:45:32.391699+0000","last_active":"2024-09-12T02:47:12.610643+0000","last_peered":"2024-09-12T02:47:12.610643+0000","last_clean":"2024-09-12T02:47:12.610643+0000","last_became_active":"2024-09-12T02:45:32.391114+0000","last_became_peered":"2024-09-12T02:45:32.391114+0000","last_unstale":"2024-09-12T02:47:12.610643+0000","last_undegraded":"2024-09-12T02:47:12.610643+0000","last_fullsized":"2024-09-12T02:47:12.610643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:25.751549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.706919+0000","last_change":"2024-09-12T02:45:45.486896+0000","last_active":"2024-09-12T02:47:12.706919+0000","last_peered":"2024-09-12T02:47:12.706919+0000","last_clean":"2024-09-12T02:47:12.706919+0000","last_became_active":"2024-09-12T02:45:45.486465+0000","last_became_peered":"2024-09-12T02:45:45.486465+0000","last_unstale":"2024-09-12T02:47:12.706919+0000","last_undegraded":"2024-09-12T02:47:12.706919+0000","last_fullsized":"2024-09-12T02:47:12.706919+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:21.774968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.614946+0000","last_change":"2024-09-12T02:45:35.424470+0000","last_active":"2024-09-12T02:47:12.614946+0000","last_peered":"2024-09-12T02:47:12.614946+0000","last_clean":"2024-09-12T02:47:12.614946+0000","last_became_active":"2024-09-12T02:45:35.424129+0000","last_became_peered":"2024-09-12T02:45:35.424129+0000","last_unstale":"2024-09-12T02:47:12.614946+0000","last_undegraded":"2024-09-12T02:47:12.614946+0000","last_fullsized":"2024-09-12T02:47:12.614946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:25.541549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"96'4","reported_seq":177,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:38.769977+0000","last_change":"2024-09-12T02:45:32.388773+0000","last_active":"2024-09-12T02:47:38.769977+0000","last_peered":"2024-09-12T02:47:38.769977+0000","last_clean":"2024-09-12T02:47:38.769977+0000","last_became_active":"2024-09-12T02:45:32.388403+0000","last_became_peered":"2024-09-12T02:45:32.388403+0000","last_unstale":"2024-09-12T02:47:38.769977+0000","last_undegraded":"2024-09-12T02:47:38.769977+0000","last_fullsized":"2024-09-12T02:47:38.769977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:20.756820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":130,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689388+0000","last_change":"2024-09-12T02:45:45.490632+0000","last_active":"2024-09-12T02:47:12.689388+0000","last_peered":"2024-09-12T02:47:12.689388+0000","last_clean":"2024-09-12T02:47:12.689388+0000","last_became_active":"2024-09-12T02:45:45.490098+0000","last_became_peered":"2024-09-12T02:45:45.490098+0000","last_unstale":"2024-09-12T02:47:12.689388+0000","last_undegraded":"2024-09-12T02:47:12.689388+0000","last_fullsized":"2024-09-12T02:47:12.689388+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:07.780423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.611846+0000","last_change":"2024-09-12T02:45:45.481451+0000","last_active":"2024-09-12T02:47:12.611846+0000","last_peered":"2024-09-12T02:47:12.611846+0000","last_clean":"2024-09-12T02:47:12.611846+0000","last_became_active":"2024-09-12T02:45:45.480969+0000","last_became_peered":"2024-09-12T02:45:45.480969+0000","last_unstale":"2024-09-12T02:47:12.611846+0000","last_undegraded":"2024-09-12T02:47:12.611846+0000","last_fullsized":"2024-09-12T02:47:12.611846+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:25.320414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707174+0000","last_change":"2024-09-12T02:45:35.435918+0000","last_active":"2024-09-12T02:47:12.707174+0000","last_peered":"2024-09-12T02:47:12.707174+0000","last_clean":"2024-09-12T02:47:12.707174+0000","last_became_active":"2024-09-12T02:45:35.433911+0000","last_became_peered":"2024-09-12T02:45:35.433911+0000","last_unstale":"2024-09-12T02:47:12.707174+0000","last_undegraded":"2024-09-12T02:47:12.707174+0000","last_fullsized":"2024-09-12T02:47:12.707174+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:27.147122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"96'3","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707410+0000","last_change":"2024-09-12T02:45:32.391021+0000","last_active":"2024-09-12T02:47:12.707410+0000","last_peered":"2024-09-12T02:47:12.707410+0000","last_clean":"2024-09-12T02:47:12.707410+0000","last_became_active":"2024-09-12T02:45:32.390532+0000","last_became_peered":"2024-09-12T02:45:32.390532+0000","last_unstale":"2024-09-12T02:47:12.707410+0000","last_undegraded":"2024-09-12T02:47:12.707410+0000","last_fullsized":"2024-09-12T02:47:12.707410+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:22.708802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":33,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.709351+0000","last_change":"2024-09-12T02:47:12.709351+0000","last_active":"2024-09-12T02:47:12.709351+0000","last_peered":"2024-09-12T02:47:12.709351+0000","last_clean":"2024-09-12T02:47:12.709351+0000","last_became_active":"2024-09-12T02:47:12.708958+0000","last_became_peered":"2024-09-12T02:47:12.708958+0000","last_unstale":"2024-09-12T02:47:12.709351+0000","last_undegraded":"2024-09-12T02:47:12.709351+0000","last_fullsized":"2024-09-12T02:47:12.709351+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:35.062469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689220+0000","last_change":"2024-09-12T02:45:35.438200+0000","last_active":"2024-09-12T02:47:12.689220+0000","last_peered":"2024-09-12T02:47:12.689220+0000","last_clean":"2024-09-12T02:47:12.689220+0000","last_became_active":"2024-09-12T02:45:35.437585+0000","last_became_peered":"2024-09-12T02:45:35.437585+0000","last_unstale":"2024-09-12T02:47:12.689220+0000","last_undegraded":"2024-09-12T02:47:12.689220+0000","last_fullsized":"2024-09-12T02:47:12.689220+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:57.675512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"96'3","reported_seq":47,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.608945+0000","last_change":"2024-09-12T02:45:32.385619+0000","last_active":"2024-09-12T02:47:12.608945+0000","last_peered":"2024-09-12T02:47:12.608945+0000","last_clean":"2024-09-12T02:47:12.608945+0000","last_became_active":"2024-09-12T02:45:32.384997+0000","last_became_peered":"2024-09-12T02:45:32.384997+0000","last_unstale":"2024-09-12T02:47:12.608945+0000","last_undegraded":"2024-09-12T02:47:12.608945+0000","last_fullsized":"2024-09-12T02:47:12.608945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:11.716779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"96'7","reported_seq":50,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.708151+0000","last_change":"2024-09-12T02:45:32.388089+0000","last_active":"2024-09-12T02:47:12.708151+0000","last_peered":"2024-09-12T02:47:12.708151+0000","last_clean":"2024-09-12T02:47:12.708151+0000","last_became_active":"2024-09-12T02:45:32.387560+0000","last_became_peered":"2024-09-12T02:45:32.387560+0000","last_unstale":"2024-09-12T02:47:12.708151+0000","last_undegraded":"2024-09-12T02:47:12.708151+0000","last_fullsized":"2024-09-12T02:47:12.708151+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:14.290116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707433+0000","last_change":"2024-09-12T02:46:12.558894+0000","last_active":"2024-09-12T02:47:12.707433+0000","last_peered":"2024-09-12T02:47:12.707433+0000","last_clean":"2024-09-12T02:47:12.707433+0000","last_became_active":"2024-09-12T02:46:12.558518+0000","last_became_peered":"2024-09-12T02:46:12.558518+0000","last_unstale":"2024-09-12T02:47:12.707433+0000","last_undegraded":"2024-09-12T02:47:12.707433+0000","last_fullsized":"2024-09-12T02:47:12.707433+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:00.171554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609884+0000","last_change":"2024-09-12T02:45:45.494098+0000","last_active":"2024-09-12T02:47:12.609884+0000","last_peered":"2024-09-12T02:47:12.609884+0000","last_clean":"2024-09-12T02:47:12.609884+0000","last_became_active":"2024-09-12T02:45:45.493698+0000","last_became_peered":"2024-09-12T02:45:45.493698+0000","last_unstale":"2024-09-12T02:47:12.609884+0000","last_undegraded":"2024-09-12T02:47:12.609884+0000","last_fullsized":"2024-09-12T02:47:12.609884+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:39.832159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"96'5","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:34.765604+0000","last_change":"2024-09-12T02:46:12.952787+0000","last_active":"2024-09-12T02:47:34.765604+0000","last_peered":"2024-09-12T02:47:34.765604+0000","last_clean":"2024-09-12T02:47:34.765604+0000","last_became_active":"2024-09-12T02:46:12.952373+0000","last_became_peered":"2024-09-12T02:46:12.952373+0000","last_unstale":"2024-09-12T02:47:34.765604+0000","last_undegraded":"2024-09-12T02:47:34.765604+0000","last_fullsized":"2024-09-12T02:47:34.765604+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:31.367264+0000","last_clean_scrub_stamp":"2024-09-12T02:45:31.367264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:49.435438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.617107+0000","last_change":"2024-09-12T02:45:35.427334+0000","last_active":"2024-09-12T02:47:12.617107+0000","last_peered":"2024-09-12T02:47:12.617107+0000","last_clean":"2024-09-12T02:47:12.617107+0000","last_became_active":"2024-09-12T02:45:35.427010+0000","last_became_peered":"2024-09-12T02:45:35.427010+0000","last_unstale":"2024-09-12T02:47:12.617107+0000","last_undegraded":"2024-09-12T02:47:12.617107+0000","last_fullsized":"2024-09-12T02:47:12.617107+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:39.587384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609948+0000","last_change":"2024-09-12T02:45:45.482354+0000","last_active":"2024-09-12T02:47:12.609948+0000","last_peered":"2024-09-12T02:47:12.609948+0000","last_clean":"2024-09-12T02:47:12.609948+0000","last_became_active":"2024-09-12T02:45:45.481411+0000","last_became_peered":"2024-09-12T02:45:45.481411+0000","last_unstale":"2024-09-12T02:47:12.609948+0000","last_undegraded":"2024-09-12T02:47:12.609948+0000","last_fullsized":"2024-09-12T02:47:12.609948+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:44.455549+0000","last_clean_scrub_stamp":"2024-09-12T02:45:44.455549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:43.049433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.611834+0000","last_change":"2024-09-12T02:45:35.430793+0000","last_active":"2024-09-12T02:47:12.611834+0000","last_peered":"2024-09-12T02:47:12.611834+0000","last_clean":"2024-09-12T02:47:12.611834+0000","last_became_active":"2024-09-12T02:45:35.430468+0000","last_became_peered":"2024-09-12T02:45:35.430468+0000","last_unstale":"2024-09-12T02:47:12.611834+0000","last_undegraded":"2024-09-12T02:47:12.611834+0000","last_fullsized":"2024-09-12T02:47:12.611834+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:19.446186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":45,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610139+0000","last_change":"2024-09-12T02:46:12.557140+0000","last_active":"2024-09-12T02:47:12.610139+0000","last_peered":"2024-09-12T02:47:12.610139+0000","last_clean":"2024-09-12T02:47:12.610139+0000","last_became_active":"2024-09-12T02:46:12.556649+0000","last_became_peered":"2024-09-12T02:46:12.556649+0000","last_unstale":"2024-09-12T02:47:12.610139+0000","last_undegraded":"2024-09-12T02:47:12.610139+0000","last_fullsized":"2024-09-12T02:47:12.610139+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:04.154036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609880+0000","last_change":"2024-09-12T02:45:35.438653+0000","last_active":"2024-09-12T02:47:12.609880+0000","last_peered":"2024-09-12T02:47:12.609880+0000","last_clean":"2024-09-12T02:47:12.609880+0000","last_became_active":"2024-09-12T02:45:35.438352+0000","last_became_peered":"2024-09-12T02:45:35.438352+0000","last_unstale":"2024-09-12T02:47:12.609880+0000","last_undegraded":"2024-09-12T02:47:12.609880+0000","last_fullsized":"2024-09-12T02:47:12.609880+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:34.665709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612045+0000","last_change":"2024-09-12T02:45:35.424654+0000","last_active":"2024-09-12T02:47:12.612045+0000","last_peered":"2024-09-12T02:47:12.612045+0000","last_clean":"2024-09-12T02:47:12.612045+0000","last_became_active":"2024-09-12T02:45:35.423269+0000","last_became_peered":"2024-09-12T02:45:35.423269+0000","last_unstale":"2024-09-12T02:47:12.612045+0000","last_undegraded":"2024-09-12T02:47:12.612045+0000","last_fullsized":"2024-09-12T02:47:12.612045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:16.595261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609358+0000","last_change":"2024-09-12T02:45:35.428658+0000","last_active":"2024-09-12T02:47:12.609358+0000","last_peered":"2024-09-12T02:47:12.609358+0000","last_clean":"2024-09-12T02:47:12.609358+0000","last_became_active":"2024-09-12T02:45:35.428333+0000","last_became_peered":"2024-09-12T02:45:35.428333+0000","last_unstale":"2024-09-12T02:47:12.609358+0000","last_undegraded":"2024-09-12T02:47:12.609358+0000","last_fullsized":"2024-09-12T02:47:12.609358+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:41:38.418409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612429+0000","last_change":"2024-09-12T02:45:35.427806+0000","last_active":"2024-09-12T02:47:12.612429+0000","last_peered":"2024-09-12T02:47:12.612429+0000","last_clean":"2024-09-12T02:47:12.612429+0000","last_became_active":"2024-09-12T02:45:35.427418+0000","last_became_peered":"2024-09-12T02:45:35.427418+0000","last_unstale":"2024-09-12T02:47:12.612429+0000","last_undegraded":"2024-09-12T02:47:12.612429+0000","last_fullsized":"2024-09-12T02:47:12.612429+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:27.184153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610374+0000","last_change":"2024-09-12T02:45:35.430350+0000","last_active":"2024-09-12T02:47:12.610374+0000","last_peered":"2024-09-12T02:47:12.610374+0000","last_clean":"2024-09-12T02:47:12.610374+0000","last_became_active":"2024-09-12T02:45:35.429807+0000","last_became_peered":"2024-09-12T02:45:35.429807+0000","last_unstale":"2024-09-12T02:47:12.610374+0000","last_undegraded":"2024-09-12T02:47:12.610374+0000","last_fullsized":"2024-09-12T02:47:12.610374+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:41.043882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689639+0000","last_change":"2024-09-12T02:45:35.438354+0000","last_active":"2024-09-12T02:47:12.689639+0000","last_peered":"2024-09-12T02:47:12.689639+0000","last_clean":"2024-09-12T02:47:12.689639+0000","last_became_active":"2024-09-12T02:45:35.437987+0000","last_became_peered":"2024-09-12T02:45:35.437987+0000","last_unstale":"2024-09-12T02:47:12.689639+0000","last_undegraded":"2024-09-12T02:47:12.689639+0000","last_fullsized":"2024-09-12T02:47:12.689639+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:51.202605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707153+0000","last_change":"2024-09-12T02:45:35.438633+0000","last_active":"2024-09-12T02:47:12.707153+0000","last_peered":"2024-09-12T02:47:12.707153+0000","last_clean":"2024-09-12T02:47:12.707153+0000","last_became_active":"2024-09-12T02:45:35.438288+0000","last_became_peered":"2024-09-12T02:45:35.438288+0000","last_unstale":"2024-09-12T02:47:12.707153+0000","last_undegraded":"2024-09-12T02:47:12.707153+0000","last_fullsized":"2024-09-12T02:47:12.707153+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:22.037816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689625+0000","last_change":"2024-09-12T02:45:35.437493+0000","last_active":"2024-09-12T02:47:12.689625+0000","last_peered":"2024-09-12T02:47:12.689625+0000","last_clean":"2024-09-12T02:47:12.689625+0000","last_became_active":"2024-09-12T02:45:35.434830+0000","last_became_peered":"2024-09-12T02:45:35.434830+0000","last_unstale":"2024-09-12T02:47:12.689625+0000","last_undegraded":"2024-09-12T02:47:12.689625+0000","last_fullsized":"2024-09-12T02:47:12.689625+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:16.970119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.614780+0000","last_change":"2024-09-12T02:46:12.558495+0000","last_active":"2024-09-12T02:47:12.614780+0000","last_peered":"2024-09-12T02:47:12.614780+0000","last_clean":"2024-09-12T02:47:12.614780+0000","last_became_active":"2024-09-12T02:46:12.558172+0000","last_became_peered":"2024-09-12T02:46:12.558172+0000","last_unstale":"2024-09-12T02:47:12.614780+0000","last_undegraded":"2024-09-12T02:47:12.614780+0000","last_fullsized":"2024-09-12T02:47:12.614780+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:02.114483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,8],"acting":[1,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609406+0000","last_change":"2024-09-12T02:45:35.428552+0000","last_active":"2024-09-12T02:47:12.609406+0000","last_peered":"2024-09-12T02:47:12.609406+0000","last_clean":"2024-09-12T02:47:12.609406+0000","last_became_active":"2024-09-12T02:45:35.428029+0000","last_became_peered":"2024-09-12T02:45:35.428029+0000","last_unstale":"2024-09-12T02:47:12.609406+0000","last_undegraded":"2024-09-12T02:47:12.609406+0000","last_fullsized":"2024-09-12T02:47:12.609406+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:57.669432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.611960+0000","last_change":"2024-09-12T02:45:35.427928+0000","last_active":"2024-09-12T02:47:12.611960+0000","last_peered":"2024-09-12T02:47:12.611960+0000","last_clean":"2024-09-12T02:47:12.611960+0000","last_became_active":"2024-09-12T02:45:35.427452+0000","last_became_peered":"2024-09-12T02:45:35.427452+0000","last_unstale":"2024-09-12T02:47:12.611960+0000","last_undegraded":"2024-09-12T02:47:12.611960+0000","last_fullsized":"2024-09-12T02:47:12.611960+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:01.646899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610191+0000","last_change":"2024-09-12T02:45:35.432714+0000","last_active":"2024-09-12T02:47:12.610191+0000","last_peered":"2024-09-12T02:47:12.610191+0000","last_clean":"2024-09-12T02:47:12.610191+0000","last_became_active":"2024-09-12T02:45:35.431698+0000","last_became_peered":"2024-09-12T02:45:35.431698+0000","last_unstale":"2024-09-12T02:47:12.610191+0000","last_undegraded":"2024-09-12T02:47:12.610191+0000","last_fullsized":"2024-09-12T02:47:12.610191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:34.925405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707745+0000","last_change":"2024-09-12T02:45:35.432157+0000","last_active":"2024-09-12T02:47:12.707745+0000","last_peered":"2024-09-12T02:47:12.707745+0000","last_clean":"2024-09-12T02:47:12.707745+0000","last_became_active":"2024-09-12T02:45:35.431847+0000","last_became_peered":"2024-09-12T02:45:35.431847+0000","last_unstale":"2024-09-12T02:47:12.707745+0000","last_undegraded":"2024-09-12T02:47:12.707745+0000","last_fullsized":"2024-09-12T02:47:12.707745+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:43.928689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612908+0000","last_change":"2024-09-12T02:45:35.429942+0000","last_active":"2024-09-12T02:47:12.612908+0000","last_peered":"2024-09-12T02:47:12.612908+0000","last_clean":"2024-09-12T02:47:12.612908+0000","last_became_active":"2024-09-12T02:45:35.429154+0000","last_became_peered":"2024-09-12T02:45:35.429154+0000","last_unstale":"2024-09-12T02:47:12.612908+0000","last_undegraded":"2024-09-12T02:47:12.612908+0000","last_fullsized":"2024-09-12T02:47:12.612908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:03.888466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.614573+0000","last_change":"2024-09-12T02:45:35.429241+0000","last_active":"2024-09-12T02:47:12.614573+0000","last_peered":"2024-09-12T02:47:12.614573+0000","last_clean":"2024-09-12T02:47:12.614573+0000","last_became_active":"2024-09-12T02:45:35.428927+0000","last_became_peered":"2024-09-12T02:45:35.428927+0000","last_unstale":"2024-09-12T02:47:12.614573+0000","last_undegraded":"2024-09-12T02:47:12.614573+0000","last_fullsized":"2024-09-12T02:47:12.614573+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:04.306748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.611844+0000","last_change":"2024-09-12T02:45:35.424196+0000","last_active":"2024-09-12T02:47:12.611844+0000","last_peered":"2024-09-12T02:47:12.611844+0000","last_clean":"2024-09-12T02:47:12.611844+0000","last_became_active":"2024-09-12T02:45:35.423882+0000","last_became_peered":"2024-09-12T02:45:35.423882+0000","last_unstale":"2024-09-12T02:47:12.611844+0000","last_undegraded":"2024-09-12T02:47:12.611844+0000","last_fullsized":"2024-09-12T02:47:12.611844+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:35.118183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.611713+0000","last_change":"2024-09-12T02:45:35.426770+0000","last_active":"2024-09-12T02:47:12.611713+0000","last_peered":"2024-09-12T02:47:12.611713+0000","last_clean":"2024-09-12T02:47:12.611713+0000","last_became_active":"2024-09-12T02:45:35.425905+0000","last_became_peered":"2024-09-12T02:45:35.425905+0000","last_unstale":"2024-09-12T02:47:12.611713+0000","last_undegraded":"2024-09-12T02:47:12.611713+0000","last_fullsized":"2024-09-12T02:47:12.611713+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:35.447860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.609310+0000","last_change":"2024-09-12T02:45:35.423413+0000","last_active":"2024-09-12T02:47:12.609310+0000","last_peered":"2024-09-12T02:47:12.609310+0000","last_clean":"2024-09-12T02:47:12.609310+0000","last_became_active":"2024-09-12T02:45:35.423113+0000","last_became_peered":"2024-09-12T02:45:35.423113+0000","last_unstale":"2024-09-12T02:47:12.609310+0000","last_undegraded":"2024-09-12T02:47:12.609310+0000","last_fullsized":"2024-09-12T02:47:12.609310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:24.194882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707599+0000","last_change":"2024-09-12T02:45:35.427814+0000","last_active":"2024-09-12T02:47:12.707599+0000","last_peered":"2024-09-12T02:47:12.707599+0000","last_clean":"2024-09-12T02:47:12.707599+0000","last_became_active":"2024-09-12T02:45:35.427495+0000","last_became_peered":"2024-09-12T02:45:35.427495+0000","last_unstale":"2024-09-12T02:47:12.707599+0000","last_undegraded":"2024-09-12T02:47:12.707599+0000","last_fullsized":"2024-09-12T02:47:12.707599+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:36:59.459681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610867+0000","last_change":"2024-09-12T02:45:35.432816+0000","last_active":"2024-09-12T02:47:12.610867+0000","last_peered":"2024-09-12T02:47:12.610867+0000","last_clean":"2024-09-12T02:47:12.610867+0000","last_became_active":"2024-09-12T02:45:35.432415+0000","last_became_peered":"2024-09-12T02:45:35.432415+0000","last_unstale":"2024-09-12T02:47:12.610867+0000","last_undegraded":"2024-09-12T02:47:12.610867+0000","last_fullsized":"2024-09-12T02:47:12.610867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:06.434342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.708294+0000","last_change":"2024-09-12T02:45:35.417788+0000","last_active":"2024-09-12T02:47:12.708294+0000","last_peered":"2024-09-12T02:47:12.708294+0000","last_clean":"2024-09-12T02:47:12.708294+0000","last_became_active":"2024-09-12T02:45:35.417382+0000","last_became_peered":"2024-09-12T02:45:35.417382+0000","last_unstale":"2024-09-12T02:47:12.708294+0000","last_undegraded":"2024-09-12T02:47:12.708294+0000","last_fullsized":"2024-09-12T02:47:12.708294+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:38.752047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.615161+0000","last_change":"2024-09-12T02:45:35.422546+0000","last_active":"2024-09-12T02:47:12.615161+0000","last_peered":"2024-09-12T02:47:12.615161+0000","last_clean":"2024-09-12T02:47:12.615161+0000","last_became_active":"2024-09-12T02:45:35.422184+0000","last_became_peered":"2024-09-12T02:45:35.422184+0000","last_unstale":"2024-09-12T02:47:12.615161+0000","last_undegraded":"2024-09-12T02:47:12.615161+0000","last_fullsized":"2024-09-12T02:47:12.615161+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.022551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.689193+0000","last_change":"2024-09-12T02:45:35.435371+0000","last_active":"2024-09-12T02:47:12.689193+0000","last_peered":"2024-09-12T02:47:12.689193+0000","last_clean":"2024-09-12T02:47:12.689193+0000","last_became_active":"2024-09-12T02:45:35.435054+0000","last_became_peered":"2024-09-12T02:45:35.435054+0000","last_unstale":"2024-09-12T02:47:12.689193+0000","last_undegraded":"2024-09-12T02:47:12.689193+0000","last_fullsized":"2024-09-12T02:47:12.689193+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:18.099755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.610399+0000","last_change":"2024-09-12T02:45:35.421617+0000","last_active":"2024-09-12T02:47:12.610399+0000","last_peered":"2024-09-12T02:47:12.610399+0000","last_clean":"2024-09-12T02:47:12.610399+0000","last_became_active":"2024-09-12T02:45:35.421247+0000","last_became_peered":"2024-09-12T02:45:35.421247+0000","last_unstale":"2024-09-12T02:47:12.610399+0000","last_undegraded":"2024-09-12T02:47:12.610399+0000","last_fullsized":"2024-09-12T02:47:12.610399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:04.457638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.708026+0000","last_change":"2024-09-12T02:46:13.370227+0000","last_active":"2024-09-12T02:47:12.708026+0000","last_peered":"2024-09-12T02:47:12.708026+0000","last_clean":"2024-09-12T02:47:12.708026+0000","last_became_active":"2024-09-12T02:46:13.369826+0000","last_became_peered":"2024-09-12T02:46:13.369826+0000","last_unstale":"2024-09-12T02:47:12.708026+0000","last_undegraded":"2024-09-12T02:47:12.708026+0000","last_fullsized":"2024-09-12T02:47:12.708026+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:13.621494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.617285+0000","last_change":"2024-09-12T02:45:35.441542+0000","last_active":"2024-09-12T02:47:12.617285+0000","last_peered":"2024-09-12T02:47:12.617285+0000","last_clean":"2024-09-12T02:47:12.617285+0000","last_became_active":"2024-09-12T02:45:35.441215+0000","last_became_peered":"2024-09-12T02:45:35.441215+0000","last_unstale":"2024-09-12T02:47:12.617285+0000","last_undegraded":"2024-09-12T02:47:12.617285+0000","last_fullsized":"2024-09-12T02:47:12.617285+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:42.978480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.707740+0000","last_change":"2024-09-12T02:45:35.425410+0000","last_active":"2024-09-12T02:47:12.707740+0000","last_peered":"2024-09-12T02:47:12.707740+0000","last_clean":"2024-09-12T02:47:12.707740+0000","last_became_active":"2024-09-12T02:45:35.424960+0000","last_became_peered":"2024-09-12T02:45:35.424960+0000","last_unstale":"2024-09-12T02:47:12.707740+0000","last_undegraded":"2024-09-12T02:47:12.707740+0000","last_fullsized":"2024-09-12T02:47:12.707740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:45.162712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612370+0000","last_change":"2024-09-12T02:45:35.415105+0000","last_active":"2024-09-12T02:47:12.612370+0000","last_peered":"2024-09-12T02:47:12.612370+0000","last_clean":"2024-09-12T02:47:12.612370+0000","last_became_active":"2024-09-12T02:45:35.414338+0000","last_became_peered":"2024-09-12T02:45:35.414338+0000","last_unstale":"2024-09-12T02:47:12.612370+0000","last_undegraded":"2024-09-12T02:47:12.612370+0000","last_fullsized":"2024-09-12T02:47:12.612370+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:45.011716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612108+0000","last_change":"2024-09-12T02:45:35.420637+0000","last_active":"2024-09-12T02:47:12.612108+0000","last_peered":"2024-09-12T02:47:12.612108+0000","last_clean":"2024-09-12T02:47:12.612108+0000","last_became_active":"2024-09-12T02:45:35.420354+0000","last_became_peered":"2024-09-12T02:45:35.420354+0000","last_unstale":"2024-09-12T02:47:12.612108+0000","last_undegraded":"2024-09-12T02:47:12.612108+0000","last_fullsized":"2024-09-12T02:47:12.612108+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:15.807265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T02:47:12.612777+0000","last_change":"2024-09-12T02:45:35.429505+0000","last_active":"2024-09-12T02:47:12.612777+0000","last_peered":"2024-09-12T02:47:12.612777+0000","last_clean":"2024-09-12T02:47:12.612777+0000","last_became_active":"2024-09-12T02:45:35.428728+0000","last_became_peered":"2024-09-12T02:45:35.428728+0000","last_unstale":"2024-09-12T02:47:12.612777+0000","last_undegraded":"2024-09-12T02:47:12.612777+0000","last_fullsized":"2024-09-12T02:47:12.612777+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:45:34.389417+0000","last_clean_scrub_stamp":"2024-09-12T02:45:34.389417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:15.987209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71830,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":685,"num_read_kb":424,"num_write":251,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":215490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416423,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1155072,"data_stored":565839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678060,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28820,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716332,"statfs":{"total":95995035648,"available":95965523968,"internally_reserved":0,"allocated":1835008,"data_stored":1216660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841585,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28168,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716984,"statfs":{"total":95995035648,"available":95966191616,"internally_reserved":0,"allocated":1167360,"data_stored":569248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070519,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32308,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712844,"statfs":{"total":95995035648,"available":95961952256,"internally_reserved":0,"allocated":1142784,"data_stored":565306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332156,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37068,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708084,"statfs":{"total":95995035648,"available":95957078016,"internally_reserved":0,"allocated":1757184,"data_stored":1162029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495682,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28140,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717012,"statfs":{"total":95995035648,"available":95966220288,"internally_reserved":0,"allocated":1138688,"data_stored":561049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757319,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28752,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716400,"statfs":{"total":95995035648,"available":95965593600,"internally_reserved":0,"allocated":1765376,"data_stored":1157218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920845,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36480,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708672,"statfs":{"total":95995035648,"available":95957680128,"internally_reserved":0,"allocated":1155072,"data_stored":565352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1150976,"data_stored":560364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411417,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28216,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716936,"statfs":{"total":95995035648,"available":95966142464,"internally_reserved":0,"allocated":1212416,"data_stored":626187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28216,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716936,"statfs":{"total":95995035648,"available":95966142464,"internally_reserved":0,"allocated":1216512,"data_stored":626813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28168,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716984,"statfs":{"total":95995035648,"available":95966191616,"internally_reserved":0,"allocated":1163264,"data_stored":562505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":66879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":66253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:47:43.381 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T02:47:43.381 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T02:47:43.381 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-12T02:47:43.381 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-12T02:47:43.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:43 smithi018 ceph-mon[30616]: from='client.24926 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:47:43.768 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:43.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:43 smithi062 ceph-mon[35527]: from='client.24926 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:47:43.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:43 smithi176 ceph-mon[35713]: from='client.24926 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:47:44.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.445+0000 7f224fe00640 1 -- 172.21.15.18:0/1022213859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2250100720 msgr2=0x7f2250100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.445+0000 7f224fe00640 1 --2- 172.21.15.18:0/1022213859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2250100720 0x7f2250100b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2240009900 tx=0x7f224002a410 comp rx=0 tx=0).stop 2024-09-12T02:47:44.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.446+0000 7f224fe00640 1 -- 172.21.15.18:0/1022213859 shutdown_connections 2024-09-12T02:47:44.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.446+0000 7f224fe00640 1 --2- 172.21.15.18:0/1022213859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f225010e2d0 0x7f22501106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.446+0000 7f224fe00640 1 --2- 172.21.15.18:0/1022213859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22501010d0 0x7f225010dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.446+0000 7f224fe00640 1 --2- 172.21.15.18:0/1022213859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2250100720 0x7f2250100b00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.446+0000 7f224fe00640 1 -- 172.21.15.18:0/1022213859 >> 172.21.15.18:0/1022213859 conn(0x7f22500fc610 msgr2=0x7f22500fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:44.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.446+0000 7f224fe00640 1 -- 172.21.15.18:0/1022213859 shutdown_connections 2024-09-12T02:47:44.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.446+0000 7f224fe00640 1 -- 172.21.15.18:0/1022213859 wait complete. 2024-09-12T02:47:44.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.447+0000 7f224fe00640 1 Processor -- start 2024-09-12T02:47:44.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.447+0000 7f224fe00640 1 -- start start 2024-09-12T02:47:44.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.447+0000 7f224fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2250100720 0x7f225019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.447+0000 7f224fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22501010d0 0x7f225019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.447+0000 7f224fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f225010e2d0 0x7f225019ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.447+0000 7f224fe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2250113ff0 con 0x7f2250100720 2024-09-12T02:47:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.447+0000 7f224fe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2250113e70 con 0x7f225010e2d0 2024-09-12T02:47:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.447+0000 7f224fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2250114170 con 0x7f22501010d0 2024-09-12T02:47:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.447+0000 7f224ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2250100720 0x7f225019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.448+0000 7f224e000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22501010d0 0x7f225019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.448+0000 7f224e000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22501010d0 0x7f225019aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:39142/0 (socket says 172.21.15.18:39142) 2024-09-12T02:47:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.448+0000 7f224e000640 1 -- 172.21.15.18:0/1558794062 learned_addr learned my addr 172.21.15.18:0/1558794062 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.448+0000 7f224f400640 1 --2- 172.21.15.18:0/1558794062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f225010e2d0 0x7f225019ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.448+0000 7f224e000640 1 -- 172.21.15.18:0/1558794062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f225010e2d0 msgr2=0x7f225019ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.448+0000 7f224e000640 1 --2- 172.21.15.18:0/1558794062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f225010e2d0 0x7f225019ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.448+0000 7f224e000640 1 -- 172.21.15.18:0/1558794062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2250100720 msgr2=0x7f225019a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.448+0000 7f224e000640 1 --2- 172.21.15.18:0/1558794062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2250100720 0x7f225019a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.448+0000 7f224e000640 1 -- 172.21.15.18:0/1558794062 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225019f520 con 0x7f22501010d0 2024-09-12T02:47:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.448+0000 7f224e000640 1 --2- 172.21.15.18:0/1558794062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22501010d0 0x7f225019aab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f223c00ea60 tx=0x7f223c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:44.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.449+0000 7f2247400640 1 -- 172.21.15.18:0/1558794062 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c00cde0 con 0x7f22501010d0 2024-09-12T02:47:44.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.449+0000 7f224fe00640 1 -- 172.21.15.18:0/1558794062 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225019f810 con 0x7f22501010d0 2024-09-12T02:47:44.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.449+0000 7f224fe00640 1 -- 172.21.15.18:0/1558794062 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22501a70f0 con 0x7f22501010d0 2024-09-12T02:47:44.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.449+0000 7f2247400640 1 -- 172.21.15.18:0/1558794062 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f223c0035f0 con 0x7f22501010d0 2024-09-12T02:47:44.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.449+0000 7f2247400640 1 -- 172.21.15.18:0/1558794062 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c018690 con 0x7f22501010d0 2024-09-12T02:47:44.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.450+0000 7f224fe00640 1 -- 172.21.15.18:0/1558794062 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2230005290 con 0x7f22501010d0 2024-09-12T02:47:44.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.452+0000 7f2247400640 1 -- 172.21.15.18:0/1558794062 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f223c004020 con 0x7f22501010d0 2024-09-12T02:47:44.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.453+0000 7f2247400640 1 --2- 172.21.15.18:0/1558794062 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f22340a2c90 0x7f22340a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:44.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.454+0000 7f2247400640 1 -- 172.21.15.18:0/1558794062 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f223c0cf810 con 0x7f22501010d0 2024-09-12T02:47:44.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.454+0000 7f224ea00640 1 --2- 172.21.15.18:0/1558794062 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f22340a2c90 0x7f22340a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:44.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.455+0000 7f224ea00640 1 --2- 172.21.15.18:0/1558794062 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f22340a2c90 0x7f22340a5150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2240009230 tx=0x7f22400058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:44.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.456+0000 7f2247400640 1 -- 172.21.15.18:0/1558794062 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f223c09c290 con 0x7f22501010d0 2024-09-12T02:47:44.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.681+0000 7f224fe00640 1 -- 172.21.15.18:0/1558794062 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2230005580 con 0x7f22501010d0 2024-09-12T02:47:44.682 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:44 smithi018 ceph-mon[30616]: pgmap v374: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:47:44.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.682+0000 7f2247400640 1 -- 172.21.15.18:0/1558794062 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f223c09bb90 con 0x7f22501010d0 2024-09-12T02:47:44.682 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:47:44.682 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T02:47:44.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.684+0000 7f224fe00640 1 -- 172.21.15.18:0/1558794062 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f22340a2c90 msgr2=0x7f22340a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.684+0000 7f224fe00640 1 --2- 172.21.15.18:0/1558794062 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f22340a2c90 0x7f22340a5150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2240009230 tx=0x7f22400058d0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.684+0000 7f224fe00640 1 -- 172.21.15.18:0/1558794062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22501010d0 msgr2=0x7f225019aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:44.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.684+0000 7f224fe00640 1 --2- 172.21.15.18:0/1558794062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22501010d0 0x7f225019aab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f223c00ea60 tx=0x7f223c00ef20 comp rx=0 tx=0).stop 2024-09-12T02:47:44.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.684+0000 7f224fe00640 1 -- 172.21.15.18:0/1558794062 shutdown_connections 2024-09-12T02:47:44.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.685+0000 7f224fe00640 1 --2- 172.21.15.18:0/1558794062 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f22340a2c90 0x7f22340a5150 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.685+0000 7f224fe00640 1 --2- 172.21.15.18:0/1558794062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f225010e2d0 0x7f225019ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.685+0000 7f224fe00640 1 --2- 172.21.15.18:0/1558794062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22501010d0 0x7f225019aab0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.685+0000 7f224fe00640 1 --2- 172.21.15.18:0/1558794062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2250100720 0x7f225019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:44.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.685+0000 7f224fe00640 1 -- 172.21.15.18:0/1558794062 >> 172.21.15.18:0/1558794062 conn(0x7f22500fc610 msgr2=0x7f22500fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:44.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.685+0000 7f224fe00640 1 -- 172.21.15.18:0/1558794062 shutdown_connections 2024-09-12T02:47:44.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:44.685+0000 7f224fe00640 1 -- 172.21.15.18:0/1558794062 wait complete. 2024-09-12T02:47:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:44 smithi062 ceph-mon[35527]: pgmap v374: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:47:44.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:44 smithi176 ceph-mon[35713]: pgmap v374: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:47:45.525 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-12T02:47:45.525 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:47:45.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:45 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1558794062' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:47:45.912 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:45.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:45 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1558794062' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:47:46.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:45 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1558794062' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:47:46.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.522+0000 7faeff200640 1 -- 172.21.15.18:0/493763259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faef8077040 msgr2=0x7faef8112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:46.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.522+0000 7faeff200640 1 --2- 172.21.15.18:0/493763259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faef8077040 0x7faef8112510 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faee4009900 tx=0x7faee402a410 comp rx=0 tx=0).stop 2024-09-12T02:47:46.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.523+0000 7faeff200640 1 -- 172.21.15.18:0/493763259 shutdown_connections 2024-09-12T02:47:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.523+0000 7faeff200640 1 --2- 172.21.15.18:0/493763259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faef8112a50 0x7faef8114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.523+0000 7faeff200640 1 --2- 172.21.15.18:0/493763259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faef8077040 0x7faef8112510 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.523+0000 7faeff200640 1 --2- 172.21.15.18:0/493763259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef8076720 0x7faef8076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.523+0000 7faeff200640 1 -- 172.21.15.18:0/493763259 >> 172.21.15.18:0/493763259 conn(0x7faef80ffa50 msgr2=0x7faef8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.523+0000 7faeff200640 1 -- 172.21.15.18:0/493763259 shutdown_connections 2024-09-12T02:47:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.523+0000 7faeff200640 1 -- 172.21.15.18:0/493763259 wait complete. 2024-09-12T02:47:46.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.524+0000 7faeff200640 1 Processor -- start 2024-09-12T02:47:46.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.524+0000 7faeff200640 1 -- start start 2024-09-12T02:47:46.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.524+0000 7faeff200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faef8076720 0x7faef81a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.524+0000 7faeff200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faef8077040 0x7faef81a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.524+0000 7faeff200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef8112a50 0x7faef819e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.524+0000 7faeff200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faef81185e0 con 0x7faef8077040 2024-09-12T02:47:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.524+0000 7faeff200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7faef8118460 con 0x7faef8076720 2024-09-12T02:47:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.524+0000 7faeff200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faef8118760 con 0x7faef8112a50 2024-09-12T02:47:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.525+0000 7faef7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faef8077040 0x7faef81a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.525+0000 7faef7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faef8076720 0x7faef81a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.525+0000 7faef7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faef8077040 0x7faef81a4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48138/0 (socket says 172.21.15.18:48138) 2024-09-12T02:47:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.525+0000 7faef7400640 1 -- 172.21.15.18:0/3970077545 learned_addr learned my addr 172.21.15.18:0/3970077545 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.525+0000 7faefd200640 1 --2- 172.21.15.18:0/3970077545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef8112a50 0x7faef819e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.525+0000 7faef7e00640 1 -- 172.21.15.18:0/3970077545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef8112a50 msgr2=0x7faef819e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.525+0000 7faef7e00640 1 --2- 172.21.15.18:0/3970077545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef8112a50 0x7faef819e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.525+0000 7faef7e00640 1 -- 172.21.15.18:0/3970077545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faef8077040 msgr2=0x7faef81a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:46.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.525+0000 7faef7e00640 1 --2- 172.21.15.18:0/3970077545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faef8077040 0x7faef81a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.525+0000 7faef7e00640 1 -- 172.21.15.18:0/3970077545 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef819f010 con 0x7faef8076720 2024-09-12T02:47:46.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.525+0000 7faefd200640 1 --2- 172.21.15.18:0/3970077545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef8112a50 0x7faef819e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:46.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.525+0000 7faef7e00640 1 --2- 172.21.15.18:0/3970077545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faef8076720 0x7faef81a4720 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faee800e9f0 tx=0x7faee800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:46.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.526+0000 7faef4c00640 1 -- 172.21.15.18:0/3970077545 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee800ccc0 con 0x7faef8076720 2024-09-12T02:47:46.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.526+0000 7faeff200640 1 -- 172.21.15.18:0/3970077545 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef819f300 con 0x7faef8076720 2024-09-12T02:47:46.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.526+0000 7faef4c00640 1 -- 172.21.15.18:0/3970077545 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faee8005020 con 0x7faef8076720 2024-09-12T02:47:46.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.526+0000 7faef4c00640 1 -- 172.21.15.18:0/3970077545 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee80049e0 con 0x7faef8076720 2024-09-12T02:47:46.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.526+0000 7faeff200640 1 -- 172.21.15.18:0/3970077545 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faef81ab5f0 con 0x7faef8076720 2024-09-12T02:47:46.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.527+0000 7faeff200640 1 -- 172.21.15.18:0/3970077545 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faef8076b00 con 0x7faef8076720 2024-09-12T02:47:46.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.529+0000 7faef4c00640 1 -- 172.21.15.18:0/3970077545 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7faee8005560 con 0x7faef8076720 2024-09-12T02:47:46.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.530+0000 7faef4c00640 1 --2- 172.21.15.18:0/3970077545 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faedc0a2c10 0x7faedc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:46.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.530+0000 7faef4c00640 1 -- 172.21.15.18:0/3970077545 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7faee80cf6a0 con 0x7faef8076720 2024-09-12T02:47:46.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.531+0000 7faef7400640 1 --2- 172.21.15.18:0/3970077545 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faedc0a2c10 0x7faedc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:46.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.531+0000 7faef7400640 1 --2- 172.21.15.18:0/3970077545 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faedc0a2c10 0x7faedc0a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faef8079220 tx=0x7faee4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:46.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.532+0000 7faef4c00640 1 -- 172.21.15.18:0/3970077545 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faee80051d0 con 0x7faef8076720 2024-09-12T02:47:46.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.756+0000 7faeff200640 1 -- 172.21.15.18:0/3970077545 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faef810dc10 con 0x7faef8076720 2024-09-12T02:47:46.757 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:46 smithi018 ceph-mon[30616]: pgmap v375: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:46.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.757+0000 7faef4c00640 1 -- 172.21.15.18:0/3970077545 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11966 (secure 0 0 0) 0x7faee809c120 con 0x7faef8076720 2024-09-12T02:47:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:47:46.758 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"btime":"2024-09-12T02:46:36:660732+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/747069368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":747069368},{"type":"v1","addr":"172.21.15.18:6837","nonce":747069368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/4056752027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4056752027},{"type":"v1","addr":"172.21.15.18:6839","nonce":4056752027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:45:36.564696+0000","modified":"2024-09-12T02:46:35.796320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24527,"mds_1":24526,"mds_2":24508,"mds_3":24493,"mds_4":24488},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/43234729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":43234729},{"type":"v1","addr":"172.21.15.18:6835","nonce":43234729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6835/564392030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":564392030},{"type":"v1","addr":"172.21.15.62:6835","nonce":564392030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6835/3199321182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3199321182},{"type":"v1","addr":"172.21.15.176:6835","nonce":3199321182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.62:6837/3520593627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3520593627},{"type":"v1","addr":"172.21.15.62:6837","nonce":3520593627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":23,"addr":"172.21.15.176:6837/4286557016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4286557016},{"type":"v1","addr":"172.21.15.176:6837","nonce":4286557016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.176:6839/3957634398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":3957634398},{"type":"v1","addr":"172.21.15.176:6839","nonce":3957634398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"a","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.18:6841/823308007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":823308007},{"type":"v1","addr":"172.21.15.18:6841","nonce":823308007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/3744347102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3744347102},{"type":"v1","addr":"172.21.15.62:6839","nonce":3744347102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24488,24527,24493,24508,24526]},"id":1}]} 2024-09-12T02:47:46.758 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 29 2024-09-12T02:47:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.760+0000 7faeff200640 1 -- 172.21.15.18:0/3970077545 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faedc0a2c10 msgr2=0x7faedc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.760+0000 7faeff200640 1 --2- 172.21.15.18:0/3970077545 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faedc0a2c10 0x7faedc0a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faef8079220 tx=0x7faee4005a20 comp rx=0 tx=0).stop 2024-09-12T02:47:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.760+0000 7faeff200640 1 -- 172.21.15.18:0/3970077545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faef8076720 msgr2=0x7faef81a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.760+0000 7faeff200640 1 --2- 172.21.15.18:0/3970077545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faef8076720 0x7faef81a4720 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faee800e9f0 tx=0x7faee800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.761+0000 7faeff200640 1 -- 172.21.15.18:0/3970077545 shutdown_connections 2024-09-12T02:47:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.761+0000 7faeff200640 1 --2- 172.21.15.18:0/3970077545 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faedc0a2c10 0x7faedc0a50d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.761+0000 7faeff200640 1 --2- 172.21.15.18:0/3970077545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef8112a50 0x7faef819e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.761+0000 7faeff200640 1 --2- 172.21.15.18:0/3970077545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faef8077040 0x7faef81a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.761+0000 7faeff200640 1 --2- 172.21.15.18:0/3970077545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faef8076720 0x7faef81a4720 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:46.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.761+0000 7faeff200640 1 -- 172.21.15.18:0/3970077545 >> 172.21.15.18:0/3970077545 conn(0x7faef80ffa50 msgr2=0x7faef8101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:46.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.761+0000 7faeff200640 1 -- 172.21.15.18:0/3970077545 shutdown_connections 2024-09-12T02:47:46.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:46.761+0000 7faeff200640 1 -- 172.21.15.18:0/3970077545 wait complete. 2024-09-12T02:47:46.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:46 smithi176 ceph-mon[35713]: pgmap v375: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:47.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:46 smithi062 ceph-mon[35527]: pgmap v375: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:47.648 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:47:47.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:47 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3970077545' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:47:47.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:47 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3970077545' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:47:48.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:47 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3970077545' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:47:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:48.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.697+0000 7f1c1e000640 1 -- 172.21.15.18:0/381755525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c18106f10 msgr2=0x7f1c1810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:48.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.697+0000 7f1c1e000640 1 --2- 172.21.15.18:0/381755525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c18106f10 0x7f1c1810ea90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009ca0 tx=0x7f1c1002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.697+0000 7f1c1e000640 1 -- 172.21.15.18:0/381755525 shutdown_connections 2024-09-12T02:47:48.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.697+0000 7f1c1e000640 1 --2- 172.21.15.18:0/381755525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c18106f10 0x7f1c1810ea90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.697+0000 7f1c1e000640 1 --2- 172.21.15.18:0/381755525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c18102790 0x7f1c181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.697+0000 7f1c1e000640 1 --2- 172.21.15.18:0/381755525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c18101de0 0x7f1c181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.697+0000 7f1c1e000640 1 -- 172.21.15.18:0/381755525 >> 172.21.15.18:0/381755525 conn(0x7f1c180fd8c0 msgr2=0x7f1c180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:48.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.698+0000 7f1c1e000640 1 -- 172.21.15.18:0/381755525 shutdown_connections 2024-09-12T02:47:48.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.698+0000 7f1c1e000640 1 -- 172.21.15.18:0/381755525 wait complete. 2024-09-12T02:47:48.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.699+0000 7f1c1e000640 1 Processor -- start 2024-09-12T02:47:48.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.699+0000 7f1c1e000640 1 -- start start 2024-09-12T02:47:48.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.699+0000 7f1c1e000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c18101de0 0x7f1c180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:48.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.699+0000 7f1c1e000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c18102790 0x7f1c18074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:48.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.700+0000 7f1c1e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c18106f10 0x7f1c18074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:48.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.700+0000 7f1c1e000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1c18111fc0 con 0x7f1c18106f10 2024-09-12T02:47:48.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.700+0000 7f1c1e000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1c18111e40 con 0x7f1c18101de0 2024-09-12T02:47:48.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.700+0000 7f1c1e000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1c18112140 con 0x7f1c18102790 2024-09-12T02:47:48.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.700+0000 7f1c0fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c18102790 0x7f1c18074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:48.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.700+0000 7f1c17400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c18101de0 0x7f1c180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:48.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.700+0000 7f1c17400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c18101de0 0x7f1c180744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:42388/0 (socket says 172.21.15.18:42388) 2024-09-12T02:47:48.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.700+0000 7f1c17400640 1 -- 172.21.15.18:0/2053313093 learned_addr learned my addr 172.21.15.18:0/2053313093 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:48.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.700+0000 7f1c0fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c18102790 0x7f1c18074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:45358/0 (socket says 172.21.15.18:45358) 2024-09-12T02:47:48.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.700+0000 7f1c17e00640 1 --2- 172.21.15.18:0/2053313093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c18106f10 0x7f1c18074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:48.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.700+0000 7f1c0fe00640 1 -- 172.21.15.18:0/2053313093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c18101de0 msgr2=0x7f1c180744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:48.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.700+0000 7f1c0fe00640 1 --2- 172.21.15.18:0/2053313093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c18101de0 0x7f1c180744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.700+0000 7f1c0fe00640 1 -- 172.21.15.18:0/2053313093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c18106f10 msgr2=0x7f1c18074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:48.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.700+0000 7f1c0fe00640 1 --2- 172.21.15.18:0/2053313093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c18106f10 0x7f1c18074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.700+0000 7f1c0fe00640 1 -- 172.21.15.18:0/2053313093 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c181a6880 con 0x7f1c18102790 2024-09-12T02:47:48.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.700+0000 7f1c17400640 1 --2- 172.21.15.18:0/2053313093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c18101de0 0x7f1c180744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:48.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.701+0000 7f1c0fe00640 1 --2- 172.21.15.18:0/2053313093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c18102790 0x7f1c18074a30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000e9f0 tx=0x7f1c0000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:48.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.701+0000 7f1c14c00640 1 -- 172.21.15.18:0/2053313093 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0000ccc0 con 0x7f1c18102790 2024-09-12T02:47:48.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.701+0000 7f1c1e000640 1 -- 172.21.15.18:0/2053313093 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c181a6b70 con 0x7f1c18102790 2024-09-12T02:47:48.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.701+0000 7f1c14c00640 1 -- 172.21.15.18:0/2053313093 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c00010910 con 0x7f1c18102790 2024-09-12T02:47:48.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.701+0000 7f1c14c00640 1 -- 172.21.15.18:0/2053313093 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c00018960 con 0x7f1c18102790 2024-09-12T02:47:48.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.701+0000 7f1c1e000640 1 -- 172.21.15.18:0/2053313093 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c181a7100 con 0x7f1c18102790 2024-09-12T02:47:48.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.702+0000 7f1c1e000640 1 -- 172.21.15.18:0/2053313093 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c181021c0 con 0x7f1c18102790 2024-09-12T02:47:48.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.705+0000 7f1c14c00640 1 -- 172.21.15.18:0/2053313093 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1c00010ac0 con 0x7f1c18102790 2024-09-12T02:47:48.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.706+0000 7f1c14c00640 1 --2- 172.21.15.18:0/2053313093 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f1bfc0a2c90 0x7f1bfc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:48.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.706+0000 7f1c14c00640 1 -- 172.21.15.18:0/2053313093 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f1c000cfbb0 con 0x7f1c18102790 2024-09-12T02:47:48.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.706+0000 7f1c17400640 1 --2- 172.21.15.18:0/2053313093 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f1bfc0a2c90 0x7f1bfc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:48.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.707+0000 7f1c17400640 1 --2- 172.21.15.18:0/2053313093 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f1bfc0a2c90 0x7f1bfc0a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1c08011550 tx=0x7f1c08005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:48.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.708+0000 7f1c14c00640 1 -- 172.21.15.18:0/2053313093 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1c0009bf50 con 0x7f1c18102790 2024-09-12T02:47:48.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:48 smithi018 ceph-mon[30616]: pgmap v376: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:47:48.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.934+0000 7f1c1e000640 1 -- 172.21.15.18:0/2053313093 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c18075a20 con 0x7f1c18102790 2024-09-12T02:47:48.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.935+0000 7f1c14c00640 1 -- 172.21.15.18:0/2053313093 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11966 (secure 0 0 0) 0x7f1c18075a20 con 0x7f1c18102790 2024-09-12T02:47:48.936 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:47:48.936 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"btime":"2024-09-12T02:46:36:660732+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/747069368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":747069368},{"type":"v1","addr":"172.21.15.18:6837","nonce":747069368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/4056752027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4056752027},{"type":"v1","addr":"172.21.15.18:6839","nonce":4056752027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:45:36.564696+0000","modified":"2024-09-12T02:46:35.796320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24527,"mds_1":24526,"mds_2":24508,"mds_3":24493,"mds_4":24488},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/43234729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":43234729},{"type":"v1","addr":"172.21.15.18:6835","nonce":43234729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6835/564392030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":564392030},{"type":"v1","addr":"172.21.15.62:6835","nonce":564392030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6835/3199321182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3199321182},{"type":"v1","addr":"172.21.15.176:6835","nonce":3199321182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.62:6837/3520593627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3520593627},{"type":"v1","addr":"172.21.15.62:6837","nonce":3520593627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":23,"addr":"172.21.15.176:6837/4286557016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4286557016},{"type":"v1","addr":"172.21.15.176:6837","nonce":4286557016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.176:6839/3957634398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":3957634398},{"type":"v1","addr":"172.21.15.176:6839","nonce":3957634398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"a","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.18:6841/823308007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":823308007},{"type":"v1","addr":"172.21.15.18:6841","nonce":823308007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/3744347102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3744347102},{"type":"v1","addr":"172.21.15.62:6839","nonce":3744347102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24488,24527,24493,24508,24526]},"id":1}]} 2024-09-12T02:47:48.936 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 29 2024-09-12T02:47:48.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.937+0000 7f1c1e000640 1 -- 172.21.15.18:0/2053313093 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f1bfc0a2c90 msgr2=0x7f1bfc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:48.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.937+0000 7f1c1e000640 1 --2- 172.21.15.18:0/2053313093 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f1bfc0a2c90 0x7f1bfc0a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1c08011550 tx=0x7f1c08005f90 comp rx=0 tx=0).stop 2024-09-12T02:47:48.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.937+0000 7f1c1e000640 1 -- 172.21.15.18:0/2053313093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c18102790 msgr2=0x7f1c18074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:48.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.937+0000 7f1c1e000640 1 --2- 172.21.15.18:0/2053313093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c18102790 0x7f1c18074a30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000e9f0 tx=0x7f1c0000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.938+0000 7f1c1e000640 1 -- 172.21.15.18:0/2053313093 shutdown_connections 2024-09-12T02:47:48.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.938+0000 7f1c1e000640 1 --2- 172.21.15.18:0/2053313093 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f1bfc0a2c90 0x7f1bfc0a5150 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.938+0000 7f1c1e000640 1 --2- 172.21.15.18:0/2053313093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c18106f10 0x7f1c18074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.938+0000 7f1c1e000640 1 --2- 172.21.15.18:0/2053313093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c18102790 0x7f1c18074a30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.938+0000 7f1c1e000640 1 --2- 172.21.15.18:0/2053313093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c18101de0 0x7f1c180744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:48.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.938+0000 7f1c1e000640 1 -- 172.21.15.18:0/2053313093 >> 172.21.15.18:0/2053313093 conn(0x7f1c180fd8c0 msgr2=0x7f1c180febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:48.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.938+0000 7f1c1e000640 1 -- 172.21.15.18:0/2053313093 shutdown_connections 2024-09-12T02:47:48.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:48.938+0000 7f1c1e000640 1 -- 172.21.15.18:0/2053313093 wait complete. 2024-09-12T02:47:48.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:48 smithi176 ceph-mon[35713]: pgmap v376: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:47:49.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:48 smithi062 ceph-mon[35527]: pgmap v376: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:47:49.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:49 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2053313093' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:47:49.719 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:47:49.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:49 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2053313093' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:47:50.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:49 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2053313093' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:47:50.097 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:50.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.699+0000 7f2db2000640 1 -- 172.21.15.18:0/980838747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dac104010 msgr2=0x7f2dac1043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.699+0000 7f2db2000640 1 --2- 172.21.15.18:0/980838747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dac104010 0x7f2dac1043f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009900 tx=0x7f2d9c02a410 comp rx=0 tx=0).stop 2024-09-12T02:47:50.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.699+0000 7f2db2000640 1 -- 172.21.15.18:0/980838747 shutdown_connections 2024-09-12T02:47:50.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.699+0000 7f2db2000640 1 --2- 172.21.15.18:0/980838747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dac109140 0x7f2dac110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.699+0000 7f2db2000640 1 --2- 172.21.15.18:0/980838747 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dac1049c0 0x7f2dac108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.699+0000 7f2db2000640 1 --2- 172.21.15.18:0/980838747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dac104010 0x7f2dac1043f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.699+0000 7f2db2000640 1 -- 172.21.15.18:0/980838747 >> 172.21.15.18:0/980838747 conn(0x7f2dac0ffa50 msgr2=0x7f2dac101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:50.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.699+0000 7f2db2000640 1 -- 172.21.15.18:0/980838747 shutdown_connections 2024-09-12T02:47:50.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.699+0000 7f2db2000640 1 -- 172.21.15.18:0/980838747 wait complete. 2024-09-12T02:47:50.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.700+0000 7f2db2000640 1 Processor -- start 2024-09-12T02:47:50.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.701+0000 7f2db2000640 1 -- start start 2024-09-12T02:47:50.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.701+0000 7f2db2000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dac104010 0x7f2dac19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.701+0000 7f2db2000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dac1049c0 0x7f2dac19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.701+0000 7f2db2000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dac109140 0x7f2dac19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.701+0000 7f2db2000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2dac114190 con 0x7f2dac109140 2024-09-12T02:47:50.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.701+0000 7f2db2000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2dac114010 con 0x7f2dac1049c0 2024-09-12T02:47:50.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.701+0000 7f2db2000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2dac114310 con 0x7f2dac104010 2024-09-12T02:47:50.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.701+0000 7f2da2a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dac1049c0 0x7f2dac19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.701+0000 7f2dab400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dac104010 0x7f2dac19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.701+0000 7f2dabe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dac109140 0x7f2dac19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.701+0000 7f2da2a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dac1049c0 0x7f2dac19ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:42408/0 (socket says 172.21.15.18:42408) 2024-09-12T02:47:50.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.701+0000 7f2da2a00640 1 -- 172.21.15.18:0/4111734872 learned_addr learned my addr 172.21.15.18:0/4111734872 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:50.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.701+0000 7f2dab400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dac104010 0x7f2dac19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:45390/0 (socket says 172.21.15.18:45390) 2024-09-12T02:47:50.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.702+0000 7f2da2a00640 1 -- 172.21.15.18:0/4111734872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dac104010 msgr2=0x7f2dac19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.702+0000 7f2da2a00640 1 --2- 172.21.15.18:0/4111734872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dac104010 0x7f2dac19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.702+0000 7f2da2a00640 1 -- 172.21.15.18:0/4111734872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dac109140 msgr2=0x7f2dac19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.702+0000 7f2da2a00640 1 --2- 172.21.15.18:0/4111734872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dac109140 0x7f2dac19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.702+0000 7f2da2a00640 1 -- 172.21.15.18:0/4111734872 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dac19f5b0 con 0x7f2dac1049c0 2024-09-12T02:47:50.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.702+0000 7f2dabe00640 1 --2- 172.21.15.18:0/4111734872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dac109140 0x7f2dac19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:50.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.702+0000 7f2da2a00640 1 --2- 172.21.15.18:0/4111734872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dac1049c0 0x7f2dac19ab40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400d950 tx=0x7f2d9400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:50.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.702+0000 7f2da8c00640 1 -- 172.21.15.18:0/4111734872 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d94017030 con 0x7f2dac1049c0 2024-09-12T02:47:50.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.702+0000 7f2db2000640 1 -- 172.21.15.18:0/4111734872 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dac19f8a0 con 0x7f2dac1049c0 2024-09-12T02:47:50.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.702+0000 7f2da8c00640 1 -- 172.21.15.18:0/4111734872 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d94004020 con 0x7f2dac1049c0 2024-09-12T02:47:50.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.702+0000 7f2da8c00640 1 -- 172.21.15.18:0/4111734872 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d940047a0 con 0x7f2dac1049c0 2024-09-12T02:47:50.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.703+0000 7f2db2000640 1 -- 172.21.15.18:0/4111734872 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dac1a7180 con 0x7f2dac1049c0 2024-09-12T02:47:50.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.704+0000 7f2db2000640 1 -- 172.21.15.18:0/4111734872 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dac1043f0 con 0x7f2dac1049c0 2024-09-12T02:47:50.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.705+0000 7f2da8c00640 1 -- 172.21.15.18:0/4111734872 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2d940041d0 con 0x7f2dac1049c0 2024-09-12T02:47:50.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.707+0000 7f2da8c00640 1 --2- 172.21.15.18:0/4111734872 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2d900a2c10 0x7f2d900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:50.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.707+0000 7f2da8c00640 1 -- 172.21.15.18:0/4111734872 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f2d940cf190 con 0x7f2dac1049c0 2024-09-12T02:47:50.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.707+0000 7f2dab400640 1 --2- 172.21.15.18:0/4111734872 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2d900a2c10 0x7f2d900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:50.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.708+0000 7f2dab400640 1 --2- 172.21.15.18:0/4111734872 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2d900a2c10 0x7f2d900a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c000c00 tx=0x7f2d9c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:50.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.709+0000 7f2da8c00640 1 -- 172.21.15.18:0/4111734872 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d9409bb80 con 0x7f2dac1049c0 2024-09-12T02:47:50.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:50 smithi018 ceph-mon[30616]: pgmap v377: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:47:50.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.895+0000 7f2db2000640 1 -- 172.21.15.18:0/4111734872 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2dac19b960 con 0x7f2dac1049c0 2024-09-12T02:47:50.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.897+0000 7f2da8c00640 1 -- 172.21.15.18:0/4111734872 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+24861 (secure 0 0 0) 0x7f2dac19b960 con 0x7f2dac1049c0 2024-09-12T02:47:50.898 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:47:50.898 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":98,"fsid":"c7666100-70af-11ef-bcea-c7b262605968","created":"2024-09-12T02:37:14.139566+0000","modified":"2024-09-12T02:47:12.605245+0000","last_up_change":"2024-09-12T02:44:37.774835+0000","last_in_change":"2024-09-12T02:44:16.028970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:40:35.157621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:45:31.022530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:45:34.131637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:45:43.992286+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a61ecdc1-ceb9-43cb-a67d-b197888cca42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6803","nonce":2278662522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6805","nonce":2278662522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6809","nonce":2278662522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6807","nonce":2278662522}]},"public_addr":"172.21.15.18:6803/2278662522","cluster_addr":"172.21.15.18:6805/2278662522","heartbeat_back_addr":"172.21.15.18:6809/2278662522","heartbeat_front_addr":"172.21.15.18:6807/2278662522","state":["exists","up"]},{"osd":1,"uuid":"1b84f4be-23ce-466c-b974-b9851521785d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6801","nonce":3139630617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6803","nonce":3139630617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6807","nonce":3139630617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6805","nonce":3139630617}]},"public_addr":"172.21.15.62:6801/3139630617","cluster_addr":"172.21.15.62:6803/3139630617","heartbeat_back_addr":"172.21.15.62:6807/3139630617","heartbeat_front_addr":"172.21.15.62:6805/3139630617","state":["exists","up"]},{"osd":2,"uuid":"f7bdf028-db32-4d92-a039-bada37c3a146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6801","nonce":2704054654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6803","nonce":2704054654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6807","nonce":2704054654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6805","nonce":2704054654}]},"public_addr":"172.21.15.176:6801/2704054654","cluster_addr":"172.21.15.176:6803/2704054654","heartbeat_back_addr":"172.21.15.176:6807/2704054654","heartbeat_front_addr":"172.21.15.176:6805/2704054654","state":["exists","up"]},{"osd":3,"uuid":"39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6811","nonce":3378134261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6813","nonce":3378134261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6817","nonce":3378134261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6815","nonce":3378134261}]},"public_addr":"172.21.15.18:6811/3378134261","cluster_addr":"172.21.15.18:6813/3378134261","heartbeat_back_addr":"172.21.15.18:6817/3378134261","heartbeat_front_addr":"172.21.15.18:6815/3378134261","state":["exists","up"]},{"osd":4,"uuid":"66a2c8a0-1a99-4c6d-b56a-f1f6c3199655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6809","nonce":1416302860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6811","nonce":1416302860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6815","nonce":1416302860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6813","nonce":1416302860}]},"public_addr":"172.21.15.62:6809/1416302860","cluster_addr":"172.21.15.62:6811/1416302860","heartbeat_back_addr":"172.21.15.62:6815/1416302860","heartbeat_front_addr":"172.21.15.62:6813/1416302860","state":["exists","up"]},{"osd":5,"uuid":"c4070ecf-703a-4f5f-9a2b-63473ff7f98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6809","nonce":2234269387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6811","nonce":2234269387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6815","nonce":2234269387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6813","nonce":2234269387}]},"public_addr":"172.21.15.176:6809/2234269387","cluster_addr":"172.21.15.176:6811/2234269387","heartbeat_back_addr":"172.21.15.176:6815/2234269387","heartbeat_front_addr":"172.21.15.176:6813/2234269387","state":["exists","up"]},{"osd":6,"uuid":"12a08874-041e-4734-bc33-68ebfce97b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6819","nonce":3613955982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6821","nonce":3613955982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6825","nonce":3613955982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6823","nonce":3613955982}]},"public_addr":"172.21.15.18:6819/3613955982","cluster_addr":"172.21.15.18:6821/3613955982","heartbeat_back_addr":"172.21.15.18:6825/3613955982","heartbeat_front_addr":"172.21.15.18:6823/3613955982","state":["exists","up"]},{"osd":7,"uuid":"86a5b47c-143f-4848-892f-c7b6a17a2799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6817","nonce":750933013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6819","nonce":750933013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6823","nonce":750933013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6821","nonce":750933013}]},"public_addr":"172.21.15.62:6817/750933013","cluster_addr":"172.21.15.62:6819/750933013","heartbeat_back_addr":"172.21.15.62:6823/750933013","heartbeat_front_addr":"172.21.15.62:6821/750933013","state":["exists","up"]},{"osd":8,"uuid":"0426a455-ed11-4d6a-8e1d-c8aa2ee65cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6817","nonce":8496953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6819","nonce":8496953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6823","nonce":8496953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6821","nonce":8496953}]},"public_addr":"172.21.15.176:6817/8496953","cluster_addr":"172.21.15.176:6819/8496953","heartbeat_back_addr":"172.21.15.176:6823/8496953","heartbeat_front_addr":"172.21.15.176:6821/8496953","state":["exists","up"]},{"osd":9,"uuid":"241aa2cf-0765-465d-b400-4911e653412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6827","nonce":422514390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6829","nonce":422514390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6833","nonce":422514390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6831","nonce":422514390}]},"public_addr":"172.21.15.18:6827/422514390","cluster_addr":"172.21.15.18:6829/422514390","heartbeat_back_addr":"172.21.15.18:6833/422514390","heartbeat_front_addr":"172.21.15.18:6831/422514390","state":["exists","up"]},{"osd":10,"uuid":"b1d4ab1f-0ec4-4641-bab0-f39d15857615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6825","nonce":269877918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6827","nonce":269877918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6831","nonce":269877918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6829","nonce":269877918}]},"public_addr":"172.21.15.62:6825/269877918","cluster_addr":"172.21.15.62:6827/269877918","heartbeat_back_addr":"172.21.15.62:6831/269877918","heartbeat_front_addr":"172.21.15.62:6829/269877918","state":["exists","up"]},{"osd":11,"uuid":"d122f1bf-bd4f-45d5-b07c-7301b005977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6825","nonce":770358485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6827","nonce":770358485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6831","nonce":770358485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6829","nonce":770358485}]},"public_addr":"172.21.15.176:6825/770358485","cluster_addr":"172.21.15.176:6827/770358485","heartbeat_back_addr":"172.21.15.176:6831/770358485","heartbeat_front_addr":"172.21.15.176:6829/770358485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:39:42.435560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:09.100602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:32.884117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:01.733821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:29.812775+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:53.846503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:24.363464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:51.023614+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:15.782652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:45.378178+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:12.469173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:36.303058+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":1,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.3","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2679362143":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/4236556151":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6801/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6800/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/1197309398":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/3024661873":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/2429098892":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6801/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6800/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/1531572357":"2024-09-13T02:37:40.790128+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:47:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.899+0000 7f2db2000640 1 -- 172.21.15.18:0/4111734872 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2d900a2c10 msgr2=0x7f2d900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.899+0000 7f2db2000640 1 --2- 172.21.15.18:0/4111734872 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2d900a2c10 0x7f2d900a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c000c00 tx=0x7f2d9c005b50 comp rx=0 tx=0).stop 2024-09-12T02:47:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.899+0000 7f2db2000640 1 -- 172.21.15.18:0/4111734872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dac1049c0 msgr2=0x7f2dac19ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.899+0000 7f2db2000640 1 --2- 172.21.15.18:0/4111734872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dac1049c0 0x7f2dac19ab40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400d950 tx=0x7f2d9400de10 comp rx=0 tx=0).stop 2024-09-12T02:47:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.899+0000 7f2db2000640 1 -- 172.21.15.18:0/4111734872 shutdown_connections 2024-09-12T02:47:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.899+0000 7f2db2000640 1 --2- 172.21.15.18:0/4111734872 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2d900a2c10 0x7f2d900a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.899+0000 7f2db2000640 1 --2- 172.21.15.18:0/4111734872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dac109140 0x7f2dac19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.899+0000 7f2db2000640 1 --2- 172.21.15.18:0/4111734872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dac1049c0 0x7f2dac19ab40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.899+0000 7f2db2000640 1 --2- 172.21.15.18:0/4111734872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dac104010 0x7f2dac19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.899+0000 7f2db2000640 1 -- 172.21.15.18:0/4111734872 >> 172.21.15.18:0/4111734872 conn(0x7f2dac0ffa50 msgr2=0x7f2dac100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.900+0000 7f2db2000640 1 -- 172.21.15.18:0/4111734872 shutdown_connections 2024-09-12T02:47:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:50.900+0000 7f2db2000640 1 -- 172.21.15.18:0/4111734872 wait complete. 2024-09-12T02:47:50.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:50 smithi176 ceph-mon[35713]: pgmap v377: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:47:51.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:50 smithi062 ceph-mon[35527]: pgmap v377: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:47:51.712 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:47:51.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:51 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/4111734872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:47:51.880 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:51 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/4111734872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:47:52.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:51 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/4111734872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:47:52.088 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:52.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.651+0000 7f21acc00640 1 -- 172.21.15.18:0/3001574730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a81049a0 msgr2=0x7f21a81089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:52.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.651+0000 7f21acc00640 1 --2- 172.21.15.18:0/3001574730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a81049a0 0x7f21a81089f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2194009900 tx=0x7f219402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.652+0000 7f21acc00640 1 -- 172.21.15.18:0/3001574730 shutdown_connections 2024-09-12T02:47:52.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.652+0000 7f21acc00640 1 --2- 172.21.15.18:0/3001574730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21a8109120 0x7f21a8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.652+0000 7f21acc00640 1 --2- 172.21.15.18:0/3001574730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a81049a0 0x7f21a81089f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.652+0000 7f21acc00640 1 --2- 172.21.15.18:0/3001574730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21a8103ff0 0x7f21a81043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.652+0000 7f21acc00640 1 -- 172.21.15.18:0/3001574730 >> 172.21.15.18:0/3001574730 conn(0x7f21a80ffa90 msgr2=0x7f21a8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:52.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.652+0000 7f21acc00640 1 -- 172.21.15.18:0/3001574730 shutdown_connections 2024-09-12T02:47:52.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.652+0000 7f21acc00640 1 -- 172.21.15.18:0/3001574730 wait complete. 2024-09-12T02:47:52.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.653+0000 7f21acc00640 1 Processor -- start 2024-09-12T02:47:52.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.653+0000 7f21acc00640 1 -- start start 2024-09-12T02:47:52.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.653+0000 7f21acc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21a8103ff0 0x7f21a819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:52.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.653+0000 7f21acc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a81049a0 0x7f21a819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:52.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.653+0000 7f21acc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21a8109120 0x7f21a819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:52.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.653+0000 7f21acc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f21a8114140 con 0x7f21a81049a0 2024-09-12T02:47:52.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.653+0000 7f21acc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f21a8113fc0 con 0x7f21a8103ff0 2024-09-12T02:47:52.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.653+0000 7f21acc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f21a81142c0 con 0x7f21a8109120 2024-09-12T02:47:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.654+0000 7f21a5e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21a8103ff0 0x7f21a819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.654+0000 7f21a5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a81049a0 0x7f21a819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.654+0000 7f21a5e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21a8103ff0 0x7f21a819a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:42418/0 (socket says 172.21.15.18:42418) 2024-09-12T02:47:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.654+0000 7f21a5e00640 1 -- 172.21.15.18:0/3623457544 learned_addr learned my addr 172.21.15.18:0/3623457544 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.654+0000 7f21a6800640 1 --2- 172.21.15.18:0/3623457544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21a8109120 0x7f21a819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.654+0000 7f21a5e00640 1 -- 172.21.15.18:0/3623457544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21a8109120 msgr2=0x7f21a819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.654+0000 7f21a5e00640 1 --2- 172.21.15.18:0/3623457544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21a8109120 0x7f21a819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.654+0000 7f21a5e00640 1 -- 172.21.15.18:0/3623457544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a81049a0 msgr2=0x7f21a819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.654+0000 7f21a5e00640 1 --2- 172.21.15.18:0/3623457544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a81049a0 0x7f21a819abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.654+0000 7f21a5e00640 1 -- 172.21.15.18:0/3623457544 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a819f650 con 0x7f21a8103ff0 2024-09-12T02:47:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.654+0000 7f21a5e00640 1 --2- 172.21.15.18:0/3623457544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21a8103ff0 0x7f21a819a6a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f219800ea60 tx=0x7f219800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.655+0000 7f219ea00640 1 -- 172.21.15.18:0/3623457544 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219800cde0 con 0x7f21a8103ff0 2024-09-12T02:47:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.655+0000 7f219ea00640 1 -- 172.21.15.18:0/3623457544 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21980035f0 con 0x7f21a8103ff0 2024-09-12T02:47:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.655+0000 7f21acc00640 1 -- 172.21.15.18:0/3623457544 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a819f940 con 0x7f21a8103ff0 2024-09-12T02:47:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.655+0000 7f219ea00640 1 -- 172.21.15.18:0/3623457544 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2198010670 con 0x7f21a8103ff0 2024-09-12T02:47:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.655+0000 7f21acc00640 1 -- 172.21.15.18:0/3623457544 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a81a7220 con 0x7f21a8103ff0 2024-09-12T02:47:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.656+0000 7f21acc00640 1 -- 172.21.15.18:0/3623457544 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21a81043d0 con 0x7f21a8103ff0 2024-09-12T02:47:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.658+0000 7f219ea00640 1 -- 172.21.15.18:0/3623457544 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f21980037a0 con 0x7f21a8103ff0 2024-09-12T02:47:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.659+0000 7f219ea00640 1 --2- 172.21.15.18:0/3623457544 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f218c0a2c90 0x7f218c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.659+0000 7f219ea00640 1 -- 172.21.15.18:0/3623457544 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f21980cf870 con 0x7f21a8103ff0 2024-09-12T02:47:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.659+0000 7f21a5400640 1 --2- 172.21.15.18:0/3623457544 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f218c0a2c90 0x7f218c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.660+0000 7f21a5400640 1 --2- 172.21.15.18:0/3623457544 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f218c0a2c90 0x7f218c0a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2194009230 tx=0x7f21940058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.663+0000 7f219ea00640 1 -- 172.21.15.18:0/3623457544 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f219809c260 con 0x7f21a8103ff0 2024-09-12T02:47:52.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:52 smithi018 ceph-mon[30616]: pgmap v378: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:52.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.889+0000 7f21acc00640 1 -- 172.21.15.18:0/3623457544 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21a810c360 con 0x7f21a8103ff0 2024-09-12T02:47:52.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.890+0000 7f219ea00640 1 -- 172.21.15.18:0/3623457544 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11966 (secure 0 0 0) 0x7f219809bb60 con 0x7f21a8103ff0 2024-09-12T02:47:52.890 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:47:52.890 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"btime":"2024-09-12T02:46:36:660732+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/747069368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":747069368},{"type":"v1","addr":"172.21.15.18:6837","nonce":747069368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/4056752027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4056752027},{"type":"v1","addr":"172.21.15.18:6839","nonce":4056752027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:45:36.564696+0000","modified":"2024-09-12T02:46:35.796320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24527,"mds_1":24526,"mds_2":24508,"mds_3":24493,"mds_4":24488},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/43234729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":43234729},{"type":"v1","addr":"172.21.15.18:6835","nonce":43234729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6835/564392030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":564392030},{"type":"v1","addr":"172.21.15.62:6835","nonce":564392030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6835/3199321182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3199321182},{"type":"v1","addr":"172.21.15.176:6835","nonce":3199321182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.62:6837/3520593627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3520593627},{"type":"v1","addr":"172.21.15.62:6837","nonce":3520593627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":23,"addr":"172.21.15.176:6837/4286557016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4286557016},{"type":"v1","addr":"172.21.15.176:6837","nonce":4286557016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.176:6839/3957634398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":3957634398},{"type":"v1","addr":"172.21.15.176:6839","nonce":3957634398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"a","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.18:6841/823308007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":823308007},{"type":"v1","addr":"172.21.15.18:6841","nonce":823308007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/3744347102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3744347102},{"type":"v1","addr":"172.21.15.62:6839","nonce":3744347102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24488,24527,24493,24508,24526]},"id":1}]} 2024-09-12T02:47:52.891 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 29 2024-09-12T02:47:52.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.892+0000 7f21acc00640 1 -- 172.21.15.18:0/3623457544 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f218c0a2c90 msgr2=0x7f218c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:52.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.892+0000 7f21acc00640 1 --2- 172.21.15.18:0/3623457544 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f218c0a2c90 0x7f218c0a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2194009230 tx=0x7f21940058d0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.892+0000 7f21acc00640 1 -- 172.21.15.18:0/3623457544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21a8103ff0 msgr2=0x7f21a819a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:52.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.892+0000 7f21acc00640 1 --2- 172.21.15.18:0/3623457544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21a8103ff0 0x7f21a819a6a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f219800ea60 tx=0x7f219800ef20 comp rx=0 tx=0).stop 2024-09-12T02:47:52.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.893+0000 7f21acc00640 1 -- 172.21.15.18:0/3623457544 shutdown_connections 2024-09-12T02:47:52.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.893+0000 7f21acc00640 1 --2- 172.21.15.18:0/3623457544 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f218c0a2c90 0x7f218c0a5150 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.893+0000 7f21acc00640 1 --2- 172.21.15.18:0/3623457544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21a8109120 0x7f21a819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.893+0000 7f21acc00640 1 --2- 172.21.15.18:0/3623457544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a81049a0 0x7f21a819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.893+0000 7f21acc00640 1 --2- 172.21.15.18:0/3623457544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21a8103ff0 0x7f21a819a6a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:52.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.893+0000 7f21acc00640 1 -- 172.21.15.18:0/3623457544 >> 172.21.15.18:0/3623457544 conn(0x7f21a80ffa90 msgr2=0x7f21a8100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:52.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.893+0000 7f21acc00640 1 -- 172.21.15.18:0/3623457544 shutdown_connections 2024-09-12T02:47:52.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:52.893+0000 7f21acc00640 1 -- 172.21.15.18:0/3623457544 wait complete. 2024-09-12T02:47:52.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:52 smithi176 ceph-mon[35713]: pgmap v378: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:53.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:52 smithi062 ceph-mon[35527]: pgmap v378: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:53.721 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T02:45:36.564696+0000', 'modified': '2024-09-12T02:46:35.796320+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24527, 'mds_1': 24526, 'mds_2': 24508, 'mds_3': 24493, 'mds_4': 24488}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24434': {'gid': 24434, 'name': 'k', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.62:6833/1160389785', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 1160389785}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 1160389785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24439': {'gid': 24439, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.176:6833/1988054318', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6832', 'nonce': 1988054318}, {'type': 'v1', 'addr': '172.21.15.176:6833', 'nonce': 1988054318}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'j', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.18:6835/43234729', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6834', 'nonce': 43234729}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 43234729}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.62:6835/564392030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 564392030}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 564392030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.176:6835/3199321182', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6834', 'nonce': 3199321182}, {'type': 'v1', 'addr': '172.21.15.176:6835', 'nonce': 3199321182}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'h', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 23, 'addr': '172.21.15.62:6837/3520593627', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6836', 'nonce': 3520593627}, {'type': 'v1', 'addr': '172.21.15.62:6837', 'nonce': 3520593627}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 23, 'addr': '172.21.15.176:6837/4286557016', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6836', 'nonce': 4286557016}, {'type': 'v1', 'addr': '172.21.15.176:6837', 'nonce': 4286557016}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24508': {'gid': 24508, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.176:6839/3957634398', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6838', 'nonce': 3957634398}, {'type': 'v1', 'addr': '172.21.15.176:6839', 'nonce': 3957634398}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24526': {'gid': 24526, 'name': 'a', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.18:6841/823308007', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6840', 'nonce': 823308007}, {'type': 'v1', 'addr': '172.21.15.18:6841', 'nonce': 823308007}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24527': {'gid': 24527, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.62:6839/3744347102', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6838', 'nonce': 3744347102}, {'type': 'v1', 'addr': '172.21.15.62:6839', 'nonce': 3744347102}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24527, 'qdb_cluster': [24488, 24527, 24493, 24508, 24526]} 2024-09-12T02:47:53.722 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T02:47:53.722 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T02:47:53.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:53 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3623457544' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:47:53.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:53 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3623457544' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:47:54.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:53 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3623457544' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:47:54.102 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:54.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.753+0000 7f5f1a800640 1 -- 172.21.15.18:0/3054935114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f14102360 msgr2=0x7f5f1410e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:54.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.753+0000 7f5f1a800640 1 --2- 172.21.15.18:0/3054935114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f14102360 0x7f5f1410e890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009cd0 tx=0x7f5f0c02a8e0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.753+0000 7f5f1a800640 1 -- 172.21.15.18:0/3054935114 shutdown_connections 2024-09-12T02:47:54.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.753+0000 7f5f1a800640 1 --2- 172.21.15.18:0/3054935114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f14102360 0x7f5f1410e890 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.753+0000 7f5f1a800640 1 --2- 172.21.15.18:0/3054935114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f141019c0 0x7f5f14101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.753+0000 7f5f1a800640 1 --2- 172.21.15.18:0/3054935114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f141079c0 0x7f5f14107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.753+0000 7f5f1a800640 1 -- 172.21.15.18:0/3054935114 >> 172.21.15.18:0/3054935114 conn(0x7f5f140fd740 msgr2=0x7f5f140ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:54.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.753+0000 7f5f1a800640 1 -- 172.21.15.18:0/3054935114 shutdown_connections 2024-09-12T02:47:54.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.753+0000 7f5f1a800640 1 -- 172.21.15.18:0/3054935114 wait complete. 2024-09-12T02:47:54.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.754+0000 7f5f1a800640 1 Processor -- start 2024-09-12T02:47:54.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.754+0000 7f5f1a800640 1 -- start start 2024-09-12T02:47:54.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.755+0000 7f5f1a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f141019c0 0x7f5f14198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.755+0000 7f5f1a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f14102360 0x7f5f141987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.755+0000 7f5f1a800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f141079c0 0x7f5f1419cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.755+0000 7f5f1a800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5f14111dc0 con 0x7f5f141019c0 2024-09-12T02:47:54.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.755+0000 7f5f1a800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5f14111c40 con 0x7f5f14102360 2024-09-12T02:47:54.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.755+0000 7f5f1a800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5f14111f40 con 0x7f5f141079c0 2024-09-12T02:47:54.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.755+0000 7f5f19400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f141019c0 0x7f5f14198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.755+0000 7f5f19e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f141079c0 0x7f5f1419cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.755+0000 7f5f19e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f141079c0 0x7f5f1419cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:45428/0 (socket says 172.21.15.18:45428) 2024-09-12T02:47:54.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.755+0000 7f5f19400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f141019c0 0x7f5f14198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48206/0 (socket says 172.21.15.18:48206) 2024-09-12T02:47:54.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.755+0000 7f5f19e00640 1 -- 172.21.15.18:0/3584096762 learned_addr learned my addr 172.21.15.18:0/3584096762 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:54.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.755+0000 7f5f18a00640 1 --2- 172.21.15.18:0/3584096762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f14102360 0x7f5f141987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.756+0000 7f5f19e00640 1 -- 172.21.15.18:0/3584096762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f14102360 msgr2=0x7f5f141987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:54.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.756+0000 7f5f19e00640 1 --2- 172.21.15.18:0/3584096762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f14102360 0x7f5f141987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.756+0000 7f5f19e00640 1 -- 172.21.15.18:0/3584096762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f141019c0 msgr2=0x7f5f14198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:54.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.756+0000 7f5f19e00640 1 --2- 172.21.15.18:0/3584096762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f141019c0 0x7f5f14198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.756+0000 7f5f19e00640 1 -- 172.21.15.18:0/3584096762 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1419d230 con 0x7f5f141079c0 2024-09-12T02:47:54.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.756+0000 7f5f19400640 1 --2- 172.21.15.18:0/3584096762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f141019c0 0x7f5f14198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:54.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.756+0000 7f5f19e00640 1 --2- 172.21.15.18:0/3584096762 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f141079c0 0x7f5f1419cb50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c005cc0 tx=0x7f5f0c032f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:54.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.756+0000 7f5f12000640 1 -- 172.21.15.18:0/3584096762 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c004040 con 0x7f5f141079c0 2024-09-12T02:47:54.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.756+0000 7f5f12000640 1 -- 172.21.15.18:0/3584096762 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f0c0046c0 con 0x7f5f141079c0 2024-09-12T02:47:54.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.756+0000 7f5f1a800640 1 -- 172.21.15.18:0/3584096762 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f1419d4c0 con 0x7f5f141079c0 2024-09-12T02:47:54.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.757+0000 7f5f12000640 1 -- 172.21.15.18:0/3584096762 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c030e00 con 0x7f5f141079c0 2024-09-12T02:47:54.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.757+0000 7f5f1a800640 1 -- 172.21.15.18:0/3584096762 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f141a4e00 con 0x7f5f141079c0 2024-09-12T02:47:54.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.760+0000 7f5f12000640 1 -- 172.21.15.18:0/3584096762 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5f0c0305a0 con 0x7f5f141079c0 2024-09-12T02:47:54.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.760+0000 7f5f1e7c9740 1 Processor -- start 2024-09-12T02:47:54.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.760+0000 7f5f1e7c9740 1 -- start start 2024-09-12T02:47:54.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.760+0000 7f5f1e7c9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceadf7a60 0x561ceadf6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.760+0000 7f5f1e7c9740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceadf6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.760+0000 7f5f1e7c9740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceae09d60 0x561ceae0c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.760+0000 7f5f1e7c9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561cead5c0b0 con 0x561ceadf7a60 2024-09-12T02:47:54.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.760+0000 7f5f1e7c9740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561cead03ab0 con 0x561ceadf68c0 2024-09-12T02:47:54.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.760+0000 7f5f1e7c9740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561cead58070 con 0x561ceae09d60 2024-09-12T02:47:54.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.761+0000 7f5f18a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceadf7a60 0x561ceadf6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.761+0000 7f5f18a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceadf7a60 0x561ceadf6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48214/0 (socket says 172.21.15.18:48214) 2024-09-12T02:47:54.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.761+0000 7f5f18a00640 1 -- 172.21.15.18:0/1797150633 learned_addr learned my addr 172.21.15.18:0/1797150633 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:54.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.761+0000 7f5f19400640 1 --2- 172.21.15.18:0/1797150633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceadf6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.761+0000 7f5f12000640 1 --2- 172.21.15.18:0/3584096762 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5efc0a2c10 0x7f5efc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.761+0000 7f5f18a00640 1 --2- 172.21.15.18:0/1797150633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceae09d60 0x561ceae0c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.761+0000 7f5f18a00640 1 -- 172.21.15.18:0/1797150633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceae09d60 msgr2=0x561ceae0c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:54.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.761+0000 7f5f18a00640 1 --2- 172.21.15.18:0/1797150633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceae09d60 0x561ceae0c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.761+0000 7f5f18a00640 1 -- 172.21.15.18:0/1797150633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 msgr2=0x561ceadf6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:54.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.761+0000 7f5f18a00640 1 --2- 172.21.15.18:0/1797150633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceadf6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.761+0000 7f5f18a00640 1 -- 172.21.15.18:0/1797150633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cead104a0 con 0x561ceadf7a60 2024-09-12T02:47:54.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.761+0000 7f5f19400640 1 --2- 172.21.15.18:0/1797150633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceadf6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:54.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.761+0000 7f5f12000640 1 -- 172.21.15.18:0/3584096762 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f5f0c02e030 con 0x7f5f141079c0 2024-09-12T02:47:54.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.762+0000 7f5f19e00640 1 --2- 172.21.15.18:0/3584096762 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5efc0a2c10 0x7f5efc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.762+0000 7f5f18a00640 1 --2- 172.21.15.18:0/1797150633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceadf7a60 0x561ceadf6380 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000b6c0 tx=0x7f5f0000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad369b2e833465ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:54.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.762+0000 7f5f06600640 1 -- 172.21.15.18:0/1797150633 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00005020 con 0x561ceadf7a60 2024-09-12T02:47:54.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.762+0000 7f5f06600640 1 -- 172.21.15.18:0/1797150633 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f000056a0 con 0x561ceadf7a60 2024-09-12T02:47:54.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.762+0000 7f5f06600640 1 -- 172.21.15.18:0/1797150633 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0000f680 con 0x561ceadf7a60 2024-09-12T02:47:54.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.763+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/1797150633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceadf7a60 msgr2=0x561ceadf6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:54.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.763+0000 7f5f19e00640 1 --2- 172.21.15.18:0/3584096762 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5efc0a2c10 0x7f5efc0a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c005e30 tx=0x7f5f0c0308d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:54.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.763+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/1797150633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceadf7a60 0x561ceadf6380 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000b6c0 tx=0x7f5f0000b650 comp rx=0 tx=0).stop 2024-09-12T02:47:54.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.763+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/1797150633 shutdown_connections 2024-09-12T02:47:54.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.763+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/1797150633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceae09d60 0x561ceae0c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.763+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/1797150633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceadf6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.763+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/1797150633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceadf7a60 0x561ceadf6380 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.763+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/1797150633 >> 172.21.15.18:0/1797150633 conn(0x561ceadf2a70 msgr2=0x561ceadf2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:54.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.763+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/1797150633 shutdown_connections 2024-09-12T02:47:54.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.763+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/1797150633 wait complete. 2024-09-12T02:47:54.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.764+0000 7f5f1e7c9740 1 -- start start 2024-09-12T02:47:54.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.764+0000 7f5f1e7c9740 1 Processor -- start 2024-09-12T02:47:54.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.764+0000 7f5f1e7c9740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceadfa110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.764+0000 7f5f1e7c9740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceadf7a60 0x561ceadfa650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.764+0000 7f5f1e7c9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceae09d60 0x561ceadfab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.764+0000 7f5f1e7c9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561ceae0cb30 con 0x561ceae09d60 2024-09-12T02:47:54.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.764+0000 7f5f1e7c9740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561ceace4920 con 0x561ceadf68c0 2024-09-12T02:47:54.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.764+0000 7f5f1e7c9740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561ceae0ccb0 con 0x561ceadf7a60 2024-09-12T02:47:54.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.764+0000 7f5f1e7c9740 10 client.0 _ll_register_callbacks cb 0x561cead088a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:54.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.765+0000 7f5f18a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceae09d60 0x561ceadfab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.765+0000 7f5f18a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceae09d60 0x561ceadfab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48226/0 (socket says 172.21.15.18:48226) 2024-09-12T02:47:54.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.765+0000 7f5f18a00640 1 -- 172.21.15.18:0/3847723034 learned_addr learned my addr 172.21.15.18:0/3847723034 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:54.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.765+0000 7f5f19400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceadf7a60 0x561ceadfa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.765+0000 7f5f18a00640 1 --2- 172.21.15.18:0/3847723034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceadfa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.765+0000 7f5f19400640 1 -- 172.21.15.18:0/3847723034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 msgr2=0x561ceadfa110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:54.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.765+0000 7f5f19400640 1 --2- 172.21.15.18:0/3847723034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceadfa110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.765+0000 7f5f19400640 1 -- 172.21.15.18:0/3847723034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceae09d60 msgr2=0x561ceadfab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:54.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.765+0000 7f5f19400640 1 --2- 172.21.15.18:0/3847723034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceae09d60 0x561ceadfab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.765+0000 7f5f19400640 1 -- 172.21.15.18:0/3847723034 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ceaacd2b0 con 0x561ceadf7a60 2024-09-12T02:47:54.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.765+0000 7f5f18a00640 1 --2- 172.21.15.18:0/3847723034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceae09d60 0x561ceadfab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:54.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.766+0000 7f5f19400640 1 --2- 172.21.15.18:0/3847723034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceadf7a60 0x561ceadfa650 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5f08012d20 tx=0x7f5f0800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=724c680aa3553005 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:54.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.766+0000 7f5efaa00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:47:54.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.766+0000 7f5efaa00640 1 -- 172.21.15.18:0/3847723034 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800fe60 con 0x561ceadf7a60 2024-09-12T02:47:54.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.766+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/3847723034 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f000056a0 con 0x561ceadf7a60 2024-09-12T02:47:54.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.766+0000 7f5efaa00640 1 -- 172.21.15.18:0/3847723034 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f5f080120d0 con 0x561ceadf7a60 2024-09-12T02:47:54.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.766+0000 7f5efaa00640 1 -- 172.21.15.18:0/3847723034 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5f08025050 con 0x561ceadf7a60 2024-09-12T02:47:54.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.766+0000 7f5f1e7c9740 10 client.24967 fetch_fsmap learned FSMap version 29 2024-09-12T02:47:54.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.766+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/3847723034 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561ceae18930 con 0x561ceadf7a60 2024-09-12T02:47:54.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.767+0000 7f5efaa00640 1 -- 172.21.15.18:0/3847723034 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f000056a0 con 0x561ceadf7a60 2024-09-12T02:47:54.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.767+0000 7f5efaa00640 1 -- 172.21.15.18:0/3847723034 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5f08003c60 con 0x561ceadf7a60 2024-09-12T02:47:54.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.767+0000 7f5f1e7c9740 10 client.24967 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:47:54.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.767+0000 7f5f1e7c9740 10 client.24967 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:47:54.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.767+0000 7f5f1e7c9740 20 client.24967 populate_metadata read hostname 'smithi018' 2024-09-12T02:47:54.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.767+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/3847723034 >> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] conn(0x561ceae1af10 0x561ceae1c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.767+0000 7f5f1e7c9740 4 client.24967 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:47:54.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.767+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/3847723034 --> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cead69620 con 0x561ceae1af10 2024-09-12T02:47:54.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.767+0000 7f5f18a00640 1 --2- 172.21.15.18:0/3847723034 >> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] conn(0x561ceae1af10 0x561ceae1c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.768+0000 7f5f18a00640 1 --2- 172.21.15.18:0/3847723034 >> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] conn(0x561ceae1af10 0x561ceae1c380 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ab0e17e5a850157d server_cookie=5e093219e34d3092 in_seq=0 out_seq=0 2024-09-12T02:47:54.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.768+0000 7f5efaa00640 10 client.24967 ms_handle_connect on v2:172.21.15.62:6836/3520593627 2024-09-12T02:47:54.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.769+0000 7f5efaa00640 1 -- 172.21.15.18:0/3847723034 <== mds.4 v2:172.21.15.62:6836/3520593627 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561cead69620 con 0x561ceae1af10 2024-09-12T02:47:54.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.769+0000 7f5efaa00640 10 client.24967 handle_command_reply: tid=0 2024-09-12T02:47:54.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.769+0000 7f5f1e7c9740 1 client.24967 shutdown 2024-09-12T02:47:54.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.769+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/3847723034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceadf7a60 msgr2=0x561ceadfa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:54.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.769+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/3847723034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceadf7a60 0x561ceadfa650 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5f08012d20 tx=0x7f5f0800f790 comp rx=0 tx=0).stop 2024-09-12T02:47:54.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.769+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/3847723034 shutdown_connections 2024-09-12T02:47:54.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.769+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/3847723034 >> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] conn(0x561ceae1af10 0x561ceae1c380 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.769+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/3847723034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceae09d60 0x561ceadfab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.769+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/3847723034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceadf7a60 0x561ceadfa650 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.769+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/3847723034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceadfa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.769+0000 7f5efaa00640 0 client.24967 ms_handle_reset on v2:172.21.15.62:6836/3520593627 2024-09-12T02:47:54.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.769+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/3847723034 >> 172.21.15.18:0/3847723034 conn(0x561ceadf2a70 msgr2=0x561ceadf8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:54.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.769+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/3847723034 shutdown_connections 2024-09-12T02:47:54.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.769+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/3847723034 wait complete. 2024-09-12T02:47:54.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.769+0000 7f5f1e7c9740 20 client.24967 trim_cache size 0 max 16384 2024-09-12T02:47:54.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.788+0000 7f5f1e7c9740 1 Processor -- start 2024-09-12T02:47:54.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.788+0000 7f5f1e7c9740 1 -- start start 2024-09-12T02:47:54.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.788+0000 7f5f1e7c9740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceae1c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.788+0000 7f5f1e7c9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceadf7a60 0x561ceadf6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.789+0000 7f5f1e7c9740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceae09d60 0x561ceadfa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.789+0000 7f5f1e7c9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561ceae1a6c0 con 0x561ceadf7a60 2024-09-12T02:47:54.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.789+0000 7f5f1e7c9740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561ceae1ad90 con 0x561ceadf68c0 2024-09-12T02:47:54.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.789+0000 7f5f1e7c9740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561ceae1b460 con 0x561ceae09d60 2024-09-12T02:47:54.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.789+0000 7f5f19400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceadf7a60 0x561ceadf6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.789+0000 7f5f19400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceadf7a60 0x561ceadf6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48230/0 (socket says 172.21.15.18:48230) 2024-09-12T02:47:54.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.789+0000 7f5f19400640 1 -- 172.21.15.18:0/3818179137 learned_addr learned my addr 172.21.15.18:0/3818179137 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:54.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.789+0000 7f5f18a00640 1 --2- 172.21.15.18:0/3818179137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceae1c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.789+0000 7f5f18a00640 1 --2- 172.21.15.18:0/3818179137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceae09d60 0x561ceadfa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.789+0000 7f5f19400640 1 -- 172.21.15.18:0/3818179137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceae09d60 msgr2=0x561ceadfa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:54.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.789+0000 7f5f19400640 1 --2- 172.21.15.18:0/3818179137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceae09d60 0x561ceadfa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.789+0000 7f5f19400640 1 -- 172.21.15.18:0/3818179137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 msgr2=0x561ceae1c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:54.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.789+0000 7f5f19400640 1 --2- 172.21.15.18:0/3818179137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceae1c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.789+0000 7f5f19400640 1 -- 172.21.15.18:0/3818179137 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ceadf72d0 con 0x561ceadf7a60 2024-09-12T02:47:54.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.789+0000 7f5f18a00640 1 --2- 172.21.15.18:0/3818179137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceae1c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:54.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.790+0000 7f5f19400640 1 --2- 172.21.15.18:0/3818179137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceadf7a60 0x561ceadf6260 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5f0801c600 tx=0x7f5f08009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a131dc151c5154 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:54.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.790+0000 7f5f05c00640 1 -- 172.21.15.18:0/3818179137 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f080120d0 con 0x561ceadf7a60 2024-09-12T02:47:54.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.790+0000 7f5f05c00640 1 -- 172.21.15.18:0/3818179137 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f08012270 con 0x561ceadf7a60 2024-09-12T02:47:54.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.790+0000 7f5f05c00640 1 -- 172.21.15.18:0/3818179137 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0801caa0 con 0x561ceadf7a60 2024-09-12T02:47:54.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.791+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/3818179137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceadf7a60 msgr2=0x561ceadf6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:54.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.791+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/3818179137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceadf7a60 0x561ceadf6260 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5f0801c600 tx=0x7f5f08009be0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.791+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/3818179137 shutdown_connections 2024-09-12T02:47:54.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.791+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/3818179137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceae09d60 0x561ceadfa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.791+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/3818179137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceadf7a60 0x561ceadf6260 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.791+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/3818179137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceae1c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.791+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/3818179137 >> 172.21.15.18:0/3818179137 conn(0x561ceadf2a70 msgr2=0x561ceaded7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:54.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.791+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/3818179137 shutdown_connections 2024-09-12T02:47:54.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.791+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/3818179137 wait complete. 2024-09-12T02:47:54.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.791+0000 7f5f1e7c9740 1 -- start start 2024-09-12T02:47:54.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.791+0000 7f5f1e7c9740 1 Processor -- start 2024-09-12T02:47:54.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.792+0000 7f5f1e7c9740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceae24cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.792+0000 7f5f1e7c9740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceae09d60 0x561ceae07a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.792+0000 7f5f1e7c9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceae07fa0 0x561ceae08420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.792+0000 7f5f1e7c9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561ceae1c200 con 0x561ceae07fa0 2024-09-12T02:47:54.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.792+0000 7f5f1e7c9740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561ceae1bb30 con 0x561ceadf68c0 2024-09-12T02:47:54.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.792+0000 7f5f1e7c9740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561ceae1c8d0 con 0x561ceae09d60 2024-09-12T02:47:54.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.792+0000 7f5f1e7c9740 10 client.0 _ll_register_callbacks cb 0x7f5f08012930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:54.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.792+0000 7f5f18a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceae24cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.792+0000 7f5f18a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceae24cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:42472/0 (socket says 172.21.15.18:42472) 2024-09-12T02:47:54.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.792+0000 7f5f18a00640 1 -- 172.21.15.18:0/2123469689 learned_addr learned my addr 172.21.15.18:0/2123469689 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:54.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.792+0000 7f5f19400640 1 --2- 172.21.15.18:0/2123469689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceae09d60 0x561ceae07a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.792+0000 7f5f18a00640 1 --2- 172.21.15.18:0/2123469689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceae07fa0 0x561ceae08420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.793+0000 7f5f19400640 1 -- 172.21.15.18:0/2123469689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 msgr2=0x561ceae24cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:54.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.793+0000 7f5f19400640 1 --2- 172.21.15.18:0/2123469689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceae24cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.793+0000 7f5f19400640 1 -- 172.21.15.18:0/2123469689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceae07fa0 msgr2=0x561ceae08420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:54.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.793+0000 7f5f19400640 1 --2- 172.21.15.18:0/2123469689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceae07fa0 0x561ceae08420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.793+0000 7f5f19400640 1 -- 172.21.15.18:0/2123469689 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ceae22930 con 0x561ceae09d60 2024-09-12T02:47:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.793+0000 7f5f19400640 1 --2- 172.21.15.18:0/2123469689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceae09d60 0x561ceae07a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x561ceadfb4b0 tx=0x7f5f08005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=576bedd9ffeaaf49 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.793+0000 7f5efaa00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:47:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.793+0000 7f5efaa00640 1 -- 172.21.15.18:0/2123469689 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0801cbf0 con 0x561ceae09d60 2024-09-12T02:47:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.793+0000 7f5efaa00640 1 -- 172.21.15.18:0/2123469689 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f5f0801cd90 con 0x561ceae09d60 2024-09-12T02:47:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.793+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/2123469689 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f08012270 con 0x561ceae09d60 2024-09-12T02:47:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.794+0000 7f5efaa00640 1 -- 172.21.15.18:0/2123469689 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5f08005070 con 0x561ceae09d60 2024-09-12T02:47:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.794+0000 7f5f1e7c9740 10 client.24973 fetch_fsmap learned FSMap version 29 2024-09-12T02:47:54.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.794+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/2123469689 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561ceae85980 con 0x561ceae09d60 2024-09-12T02:47:54.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.794+0000 7f5efaa00640 1 -- 172.21.15.18:0/2123469689 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f08012270 con 0x561ceae09d60 2024-09-12T02:47:54.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.794+0000 7f5efaa00640 1 -- 172.21.15.18:0/2123469689 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5f08003b20 con 0x561ceae09d60 2024-09-12T02:47:54.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.794+0000 7f5f1e7c9740 10 client.24973 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:47:54.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.794+0000 7f5f1e7c9740 10 client.24973 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:47:54.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.794+0000 7f5f1e7c9740 20 client.24973 populate_metadata read hostname 'smithi018' 2024-09-12T02:47:54.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.794+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/2123469689 >> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] conn(0x561ceae8a150 0x561ceae88e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:54.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.794+0000 7f5f1e7c9740 4 client.24973 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:47:54.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.794+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/2123469689 --> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] -- command(tid 0: {"prefix": "status"}) -- 0x561cead63b30 con 0x561ceae8a150 2024-09-12T02:47:54.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.795+0000 7f5f18a00640 1 --2- 172.21.15.18:0/2123469689 >> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] conn(0x561ceae8a150 0x561ceae88e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:54.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.795+0000 7f5f18a00640 1 --2- 172.21.15.18:0/2123469689 >> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] conn(0x561ceae8a150 0x561ceae88e60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9522eb33fa75fd8d server_cookie=3c881f712770ecb3 in_seq=0 out_seq=0 2024-09-12T02:47:54.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.795+0000 7f5efaa00640 10 client.24973 ms_handle_connect on v2:172.21.15.62:6836/3520593627 2024-09-12T02:47:54.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.795+0000 7f5efaa00640 1 -- 172.21.15.18:0/2123469689 <== mds.4 v2:172.21.15.62:6836/3520593627 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x561cead63b30 con 0x561ceae8a150 2024-09-12T02:47:54.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.795+0000 7f5efaa00640 10 client.24973 handle_command_reply: tid=0 2024-09-12T02:47:54.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.795+0000 7f5f1e7c9740 1 client.24973 shutdown 2024-09-12T02:47:54.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.796+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/2123469689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceae09d60 msgr2=0x561ceae07a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:54.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.796+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/2123469689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceae09d60 0x561ceae07a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x561ceadfb4b0 tx=0x7f5f08005f90 comp rx=0 tx=0).stop 2024-09-12T02:47:54.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.796+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/2123469689 shutdown_connections 2024-09-12T02:47:54.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.796+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/2123469689 >> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] conn(0x561ceae8a150 0x561ceae88e60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.796+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/2123469689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561ceae07fa0 0x561ceae08420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.796+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/2123469689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561ceae09d60 0x561ceae07a60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.796+0000 7f5f1e7c9740 1 --2- 172.21.15.18:0/2123469689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ceadf68c0 0x561ceae24cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.796+0000 7f5efaa00640 0 client.24973 ms_handle_reset on v2:172.21.15.62:6836/3520593627 2024-09-12T02:47:54.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.796+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/2123469689 >> 172.21.15.18:0/2123469689 conn(0x561ceadf2a70 msgr2=0x561ceadfb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:54.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.796+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/2123469689 shutdown_connections 2024-09-12T02:47:54.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.796+0000 7f5f1e7c9740 1 -- 172.21.15.18:0/2123469689 wait complete. 2024-09-12T02:47:54.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.796+0000 7f5f1e7c9740 20 client.24973 trim_cache size 0 max 16384 2024-09-12T02:47:54.803 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T02:47:54.803 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "c7666100-70af-11ef-bcea-c7b262605968", 2024-09-12T02:47:54.803 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 4, 2024-09-12T02:47:54.803 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24488, 2024-09-12T02:47:54.803 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-12T02:47:54.803 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-12T02:47:54.803 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-12T02:47:54.803 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 81.139158800000004, 2024-09-12T02:47:54.803 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 29, 2024-09-12T02:47:54.804 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 98, 2024-09-12T02:47:54.804 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 96, 2024-09-12T02:47:54.804 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 165.68953798999999 2024-09-12T02:47:54.804 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T02:47:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.797+0000 7f5f1a800640 1 -- 172.21.15.18:0/3584096762 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5efc0a2c10 msgr2=0x7f5efc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.797+0000 7f5f1a800640 1 --2- 172.21.15.18:0/3584096762 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5efc0a2c10 0x7f5efc0a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c005e30 tx=0x7f5f0c0308d0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.797+0000 7f5f1a800640 1 -- 172.21.15.18:0/3584096762 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f141079c0 msgr2=0x7f5f1419cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.797+0000 7f5f1a800640 1 --2- 172.21.15.18:0/3584096762 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f141079c0 0x7f5f1419cb50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c005cc0 tx=0x7f5f0c032f40 comp rx=0 tx=0).stop 2024-09-12T02:47:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.797+0000 7f5f1a800640 1 -- 172.21.15.18:0/3584096762 shutdown_connections 2024-09-12T02:47:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.797+0000 7f5f1a800640 1 --2- 172.21.15.18:0/3584096762 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f5efc0a2c10 0x7f5efc0a50d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.797+0000 7f5f1a800640 1 --2- 172.21.15.18:0/3584096762 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f141079c0 0x7f5f1419cb50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.797+0000 7f5f1a800640 1 --2- 172.21.15.18:0/3584096762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f14102360 0x7f5f141987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.797+0000 7f5f1a800640 1 --2- 172.21.15.18:0/3584096762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f141019c0 0x7f5f14198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:54.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.797+0000 7f5f1a800640 1 -- 172.21.15.18:0/3584096762 >> 172.21.15.18:0/3584096762 conn(0x7f5f140fd740 msgr2=0x7f5f140fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:54.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.797+0000 7f5f1a800640 1 -- 172.21.15.18:0/3584096762 shutdown_connections 2024-09-12T02:47:54.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:54.797+0000 7f5f1a800640 1 -- 172.21.15.18:0/3584096762 wait complete. 2024-09-12T02:47:54.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:54 smithi018 ceph-mon[30616]: pgmap v379: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:47:54.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:54 smithi176 ceph-mon[35713]: pgmap v379: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:47:55.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:54 smithi062 ceph-mon[35527]: pgmap v379: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:47:55.788 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T02:47:56.173 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:56.673 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:56 smithi018 ceph-mon[30616]: pgmap v380: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:56.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.790+0000 7f1522800640 1 -- 172.21.15.18:0/2005892265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f151c1049c0 msgr2=0x7f151c108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:56.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.790+0000 7f1522800640 1 --2- 172.21.15.18:0/2005892265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f151c1049c0 0x7f151c108a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1504009900 tx=0x7f150402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.790+0000 7f1522800640 1 -- 172.21.15.18:0/2005892265 shutdown_connections 2024-09-12T02:47:56.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.790+0000 7f1522800640 1 --2- 172.21.15.18:0/2005892265 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f151c109140 0x7f151c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.790+0000 7f1522800640 1 --2- 172.21.15.18:0/2005892265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f151c1049c0 0x7f151c108a10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.790+0000 7f1522800640 1 --2- 172.21.15.18:0/2005892265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151c104010 0x7f151c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.790+0000 7f1522800640 1 -- 172.21.15.18:0/2005892265 >> 172.21.15.18:0/2005892265 conn(0x7f151c0ffa50 msgr2=0x7f151c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.790+0000 7f1522800640 1 -- 172.21.15.18:0/2005892265 shutdown_connections 2024-09-12T02:47:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.790+0000 7f1522800640 1 -- 172.21.15.18:0/2005892265 wait complete. 2024-09-12T02:47:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.791+0000 7f1522800640 1 Processor -- start 2024-09-12T02:47:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.791+0000 7f1522800640 1 -- start start 2024-09-12T02:47:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.792+0000 7f1522800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f151c104010 0x7f151c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.792+0000 7f1522800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151c1049c0 0x7f151c19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.792+0000 7f1522800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f151c109140 0x7f151c19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.792+0000 7f1522800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f151c114140 con 0x7f151c1049c0 2024-09-12T02:47:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.792+0000 7f1522800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f151c113fc0 con 0x7f151c109140 2024-09-12T02:47:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.792+0000 7f1522800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f151c1142c0 con 0x7f151c104010 2024-09-12T02:47:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.792+0000 7f1513e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151c1049c0 0x7f151c19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.792+0000 7f1513e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151c1049c0 0x7f151c19ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58126/0 (socket says 172.21.15.18:58126) 2024-09-12T02:47:56.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.792+0000 7f1513e00640 1 -- 172.21.15.18:0/1873016843 learned_addr learned my addr 172.21.15.18:0/1873016843 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:56.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.792+0000 7f151be00640 1 --2- 172.21.15.18:0/1873016843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f151c109140 0x7f151c19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.792+0000 7f151b400640 1 --2- 172.21.15.18:0/1873016843 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f151c104010 0x7f151c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.792+0000 7f151be00640 1 -- 172.21.15.18:0/1873016843 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f151c104010 msgr2=0x7f151c19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:56.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.792+0000 7f151be00640 1 --2- 172.21.15.18:0/1873016843 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f151c104010 0x7f151c19a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.792+0000 7f151be00640 1 -- 172.21.15.18:0/1873016843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151c1049c0 msgr2=0x7f151c19ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:56.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.792+0000 7f151be00640 1 --2- 172.21.15.18:0/1873016843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151c1049c0 0x7f151c19ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.792+0000 7f151be00640 1 -- 172.21.15.18:0/1873016843 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151c19f690 con 0x7f151c109140 2024-09-12T02:47:56.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.793+0000 7f151be00640 1 --2- 172.21.15.18:0/1873016843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f151c109140 0x7f151c19efb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1514009fd0 tx=0x7f151400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:56.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.793+0000 7f1518c00640 1 -- 172.21.15.18:0/1873016843 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151400ce20 con 0x7f151c109140 2024-09-12T02:47:56.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.793+0000 7f1518c00640 1 -- 172.21.15.18:0/1873016843 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1514005020 con 0x7f151c109140 2024-09-12T02:47:56.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.793+0000 7f1522800640 1 -- 172.21.15.18:0/1873016843 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f151c19f980 con 0x7f151c109140 2024-09-12T02:47:56.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.793+0000 7f1518c00640 1 -- 172.21.15.18:0/1873016843 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514010720 con 0x7f151c109140 2024-09-12T02:47:56.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.793+0000 7f1522800640 1 -- 172.21.15.18:0/1873016843 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f151c1a7260 con 0x7f151c109140 2024-09-12T02:47:56.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.796+0000 7f1518c00640 1 -- 172.21.15.18:0/1873016843 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1514005540 con 0x7f151c109140 2024-09-12T02:47:56.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.796+0000 7f1525227740 1 Processor -- start 2024-09-12T02:47:56.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.797+0000 7f1525227740 1 -- start start 2024-09-12T02:47:56.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.797+0000 7f1525227740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaff330 0x5582bcaff710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.797+0000 7f1525227740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcaffc50 0x5582bcb09fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.797+0000 7f1525227740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcb0a510 0x5582bcb0c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.797+0000 7f1525227740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5582bca650b0 con 0x5582bcaff330 2024-09-12T02:47:56.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.797+0000 7f1525227740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5582bca0cab0 con 0x5582bcb0a510 2024-09-12T02:47:56.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.797+0000 7f1525227740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5582bca61070 con 0x5582bcaffc50 2024-09-12T02:47:56.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.797+0000 7f151b400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcaffc50 0x5582bcb09fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.797+0000 7f1513e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaff330 0x5582bcaff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.797+0000 7f151b400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcaffc50 0x5582bcb09fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:55852/0 (socket says 172.21.15.18:55852) 2024-09-12T02:47:56.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.797+0000 7f151b400640 1 -- 172.21.15.18:0/1574018289 learned_addr learned my addr 172.21.15.18:0/1574018289 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:56.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.798+0000 7f151b400640 1 -- 172.21.15.18:0/1574018289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcb0a510 msgr2=0x5582bcb0c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:56.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.798+0000 7f151b400640 1 --2- 172.21.15.18:0/1574018289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcb0a510 0x5582bcb0c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.798+0000 7f151b400640 1 -- 172.21.15.18:0/1574018289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaff330 msgr2=0x5582bcaff710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:56.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.798+0000 7f151b400640 1 --2- 172.21.15.18:0/1574018289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaff330 0x5582bcaff710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.798+0000 7f151b400640 1 -- 172.21.15.18:0/1574018289 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582bca194a0 con 0x5582bcaffc50 2024-09-12T02:47:56.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.798+0000 7f1518c00640 1 --2- 172.21.15.18:0/1873016843 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f15000a2c10 0x7f15000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.798+0000 7f151b400640 1 --2- 172.21.15.18:0/1574018289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcaffc50 0x5582bcb09fd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f150c009cf0 tx=0x7f150c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6d5ce3f425ae597 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:56.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.798+0000 7f1518c00640 1 -- 172.21.15.18:0/1873016843 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f15140cfc60 con 0x7f151c109140 2024-09-12T02:47:56.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.798+0000 7f1513e00640 1 --2- 172.21.15.18:0/1873016843 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f15000a2c10 0x7f15000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.798+0000 7f1510c00640 1 -- 172.21.15.18:0/1574018289 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c01e070 con 0x5582bcaffc50 2024-09-12T02:47:56.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.798+0000 7f1510c00640 1 -- 172.21.15.18:0/1574018289 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f150c019b10 con 0x5582bcaffc50 2024-09-12T02:47:56.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.799+0000 7f1510c00640 1 -- 172.21.15.18:0/1574018289 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c00ea60 con 0x5582bcaffc50 2024-09-12T02:47:56.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.799+0000 7f1525227740 1 -- 172.21.15.18:0/1574018289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcaffc50 msgr2=0x5582bcb09fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:56.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.799+0000 7f1525227740 1 --2- 172.21.15.18:0/1574018289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcaffc50 0x5582bcb09fd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f150c009cf0 tx=0x7f150c011810 comp rx=0 tx=0).stop 2024-09-12T02:47:56.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.799+0000 7f1513e00640 1 --2- 172.21.15.18:0/1873016843 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f15000a2c10 0x7f15000a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1504031550 tx=0x7f1504005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:56.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.799+0000 7f1525227740 1 -- 172.21.15.18:0/1574018289 shutdown_connections 2024-09-12T02:47:56.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.799+0000 7f1525227740 1 --2- 172.21.15.18:0/1574018289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcb0a510 0x5582bcb0c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.799+0000 7f1525227740 1 --2- 172.21.15.18:0/1574018289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcaffc50 0x5582bcb09fd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.799+0000 7f1525227740 1 --2- 172.21.15.18:0/1574018289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaff330 0x5582bcaff710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.799+0000 7f1525227740 1 -- 172.21.15.18:0/1574018289 >> 172.21.15.18:0/1574018289 conn(0x5582bcafb8c0 msgr2=0x5582bcafbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:56.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.800+0000 7f1525227740 1 -- 172.21.15.18:0/1574018289 shutdown_connections 2024-09-12T02:47:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.800+0000 7f1525227740 1 -- 172.21.15.18:0/1574018289 wait complete. 2024-09-12T02:47:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.800+0000 7f1525227740 1 -- start start 2024-09-12T02:47:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.800+0000 7f1525227740 1 Processor -- start 2024-09-12T02:47:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f1525227740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaff330 0x5582bcb07550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f1525227740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcaffc50 0x5582bcb07a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f1525227740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcb0a510 0x5582bcb07fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f1525227740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5582bcb0d060 con 0x5582bcaff330 2024-09-12T02:47:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f1525227740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5582bc9ed920 con 0x5582bcb0a510 2024-09-12T02:47:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f1525227740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5582bcb0d1e0 con 0x5582bcaffc50 2024-09-12T02:47:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f1525227740 10 client.0 _ll_register_callbacks cb 0x5582bca118a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f151b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaff330 0x5582bcb07550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f151be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcb0a510 0x5582bcb07fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f1513e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcaffc50 0x5582bcb07a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f151b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaff330 0x5582bcb07550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58140/0 (socket says 172.21.15.18:58140) 2024-09-12T02:47:56.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f151b400640 1 -- 172.21.15.18:0/4009540937 learned_addr learned my addr 172.21.15.18:0/4009540937 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:56.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f151b400640 1 -- 172.21.15.18:0/4009540937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcaffc50 msgr2=0x5582bcb07a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:56.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f151b400640 1 --2- 172.21.15.18:0/4009540937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcaffc50 0x5582bcb07a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f151b400640 1 -- 172.21.15.18:0/4009540937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcb0a510 msgr2=0x5582bcb07fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:56.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f151b400640 1 --2- 172.21.15.18:0/4009540937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcb0a510 0x5582bcb07fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f151b400640 1 -- 172.21.15.18:0/4009540937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582bc7d62b0 con 0x5582bcaff330 2024-09-12T02:47:56.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.801+0000 7f151be00640 1 --2- 172.21.15.18:0/4009540937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcb0a510 0x5582bcb07fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:56.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.802+0000 7f151b400640 1 --2- 172.21.15.18:0/4009540937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaff330 0x5582bcb07550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f150c00e680 tx=0x7f150c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e355d73ca470f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:56.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.802+0000 7f1509600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:47:56.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.802+0000 7f1509600640 1 -- 172.21.15.18:0/4009540937 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c01e050 con 0x5582bcaff330 2024-09-12T02:47:56.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.802+0000 7f1525227740 1 -- 172.21.15.18:0/4009540937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f150c019b10 con 0x5582bcaff330 2024-09-12T02:47:56.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.802+0000 7f1509600640 1 -- 172.21.15.18:0/4009540937 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f150c005240 con 0x5582bcaff330 2024-09-12T02:47:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.802+0000 7f1509600640 1 -- 172.21.15.18:0/4009540937 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f150c033050 con 0x5582bcaff330 2024-09-12T02:47:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.802+0000 7f1525227740 10 client.14970 fetch_fsmap learned FSMap version 29 2024-09-12T02:47:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.803+0000 7f1525227740 1 -- 172.21.15.18:0/4009540937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5582bcb18e10 con 0x5582bcaff330 2024-09-12T02:47:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.803+0000 7f1509600640 1 -- 172.21.15.18:0/4009540937 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f150c019b10 con 0x5582bcaff330 2024-09-12T02:47:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.803+0000 7f1509600640 1 -- 172.21.15.18:0/4009540937 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f150c00e6e0 con 0x5582bcaff330 2024-09-12T02:47:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.803+0000 7f1525227740 10 client.14970 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:47:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.803+0000 7f1525227740 10 client.14970 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:47:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.803+0000 7f1525227740 20 client.14970 populate_metadata read hostname 'smithi018' 2024-09-12T02:47:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.803+0000 7f1525227740 1 --2- 172.21.15.18:0/4009540937 >> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] conn(0x5582bcb1b1f0 0x5582bcb1c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.803+0000 7f1525227740 4 client.14970 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:47:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.803+0000 7f1525227740 1 -- 172.21.15.18:0/4009540937 --> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582bca72620 con 0x5582bcb1b1f0 2024-09-12T02:47:56.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.804+0000 7f1513e00640 1 --2- 172.21.15.18:0/4009540937 >> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] conn(0x5582bcb1b1f0 0x5582bcb1c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.804+0000 7f1513e00640 1 --2- 172.21.15.18:0/4009540937 >> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] conn(0x5582bcb1b1f0 0x5582bcb1c660 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b5d2a6565a052033 server_cookie=dff6e53c14aeea5 in_seq=0 out_seq=0 2024-09-12T02:47:56.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.804+0000 7f1509600640 10 client.14970 ms_handle_connect on v2:172.21.15.176:6836/4286557016 2024-09-12T02:47:56.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.805+0000 7f1509600640 1 -- 172.21.15.18:0/4009540937 <== mds.3 v2:172.21.15.176:6836/4286557016 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5582bca72620 con 0x5582bcb1b1f0 2024-09-12T02:47:56.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.805+0000 7f1509600640 10 client.14970 handle_command_reply: tid=0 2024-09-12T02:47:56.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.805+0000 7f1525227740 1 client.14970 shutdown 2024-09-12T02:47:56.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.805+0000 7f1525227740 1 -- 172.21.15.18:0/4009540937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaff330 msgr2=0x5582bcb07550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:56.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.805+0000 7f1525227740 1 --2- 172.21.15.18:0/4009540937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaff330 0x5582bcb07550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f150c00e680 tx=0x7f150c019660 comp rx=0 tx=0).stop 2024-09-12T02:47:56.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.805+0000 7f1525227740 1 -- 172.21.15.18:0/4009540937 shutdown_connections 2024-09-12T02:47:56.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.805+0000 7f1525227740 1 --2- 172.21.15.18:0/4009540937 >> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] conn(0x5582bcb1b1f0 0x5582bcb1c660 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.806+0000 7f1525227740 1 --2- 172.21.15.18:0/4009540937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcb0a510 0x5582bcb07fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.806+0000 7f1525227740 1 --2- 172.21.15.18:0/4009540937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcaffc50 0x5582bcb07a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.806+0000 7f1525227740 1 --2- 172.21.15.18:0/4009540937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaff330 0x5582bcb07550 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.806+0000 7f1525227740 1 -- 172.21.15.18:0/4009540937 >> 172.21.15.18:0/4009540937 conn(0x5582bcafb8c0 msgr2=0x5582bcb015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:56.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.806+0000 7f1509600640 0 client.14970 ms_handle_reset on v2:172.21.15.176:6836/4286557016 2024-09-12T02:47:56.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.806+0000 7f1525227740 1 -- 172.21.15.18:0/4009540937 shutdown_connections 2024-09-12T02:47:56.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.806+0000 7f1525227740 1 -- 172.21.15.18:0/4009540937 wait complete. 2024-09-12T02:47:56.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.806+0000 7f1525227740 20 client.14970 trim_cache size 0 max 16384 2024-09-12T02:47:56.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.825+0000 7f1525227740 1 Processor -- start 2024-09-12T02:47:56.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.826+0000 7f1525227740 1 -- start start 2024-09-12T02:47:56.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.826+0000 7f1525227740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcaff330 0x5582bcb1b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.826+0000 7f1525227740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaffc50 0x5582bcb01d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.826+0000 7f1525227740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcb0a510 0x5582bcb07aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.826+0000 7f1525227740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5582bcb1a9a0 con 0x5582bcaffc50 2024-09-12T02:47:56.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.826+0000 7f1525227740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5582bcb1b070 con 0x5582bcb0a510 2024-09-12T02:47:56.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.826+0000 7f1525227740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5582bcb1b740 con 0x5582bcaff330 2024-09-12T02:47:56.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.826+0000 7f1513e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaffc50 0x5582bcb01d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.826+0000 7f1513e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaffc50 0x5582bcb01d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58148/0 (socket says 172.21.15.18:58148) 2024-09-12T02:47:56.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.826+0000 7f1513e00640 1 -- 172.21.15.18:0/3245315620 learned_addr learned my addr 172.21.15.18:0/3245315620 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:56.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.826+0000 7f151be00640 1 --2- 172.21.15.18:0/3245315620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcb0a510 0x5582bcb07aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.827+0000 7f151b400640 1 --2- 172.21.15.18:0/3245315620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcaff330 0x5582bcb1b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.827+0000 7f151be00640 1 -- 172.21.15.18:0/3245315620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcaff330 msgr2=0x5582bcb1b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:56.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.827+0000 7f151be00640 1 --2- 172.21.15.18:0/3245315620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcaff330 0x5582bcb1b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.827+0000 7f151be00640 1 -- 172.21.15.18:0/3245315620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaffc50 msgr2=0x5582bcb01d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:56.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.827+0000 7f151be00640 1 --2- 172.21.15.18:0/3245315620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaffc50 0x5582bcb01d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.827+0000 7f151be00640 1 -- 172.21.15.18:0/3245315620 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582bcafca50 con 0x5582bcb0a510 2024-09-12T02:47:56.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.827+0000 7f151be00640 1 --2- 172.21.15.18:0/3245315620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcb0a510 0x5582bcb07aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f15140cd200 tx=0x7f15140054b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a33818f8e319729 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:56.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.827+0000 7f150be00640 1 -- 172.21.15.18:0/3245315620 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15140a4bc0 con 0x5582bcb0a510 2024-09-12T02:47:56.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.827+0000 7f150be00640 1 -- 172.21.15.18:0/3245315620 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15140cd450 con 0x5582bcb0a510 2024-09-12T02:47:56.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.827+0000 7f150be00640 1 -- 172.21.15.18:0/3245315620 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15140badf0 con 0x5582bcb0a510 2024-09-12T02:47:56.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.828+0000 7f1525227740 1 -- 172.21.15.18:0/3245315620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcb0a510 msgr2=0x5582bcb07aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:56.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.828+0000 7f1525227740 1 --2- 172.21.15.18:0/3245315620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcb0a510 0x5582bcb07aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f15140cd200 tx=0x7f15140054b0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.828+0000 7f1525227740 1 -- 172.21.15.18:0/3245315620 shutdown_connections 2024-09-12T02:47:56.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.828+0000 7f1525227740 1 --2- 172.21.15.18:0/3245315620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcb0a510 0x5582bcb07aa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.828+0000 7f1525227740 1 --2- 172.21.15.18:0/3245315620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaffc50 0x5582bcb01d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.828+0000 7f1525227740 1 --2- 172.21.15.18:0/3245315620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcaff330 0x5582bcb1b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.828+0000 7f1525227740 1 -- 172.21.15.18:0/3245315620 >> 172.21.15.18:0/3245315620 conn(0x5582bcafb8c0 msgr2=0x5582bcb05e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:56.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.828+0000 7f1525227740 1 -- 172.21.15.18:0/3245315620 shutdown_connections 2024-09-12T02:47:56.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.828+0000 7f1525227740 1 -- 172.21.15.18:0/3245315620 wait complete. 2024-09-12T02:47:56.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.829+0000 7f1525227740 1 -- start start 2024-09-12T02:47:56.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.829+0000 7f1525227740 1 Processor -- start 2024-09-12T02:47:56.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.829+0000 7f1525227740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcaff330 0x5582bcb24b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.829+0000 7f1525227740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaffc50 0x5582bcb25080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.829+0000 7f1525227740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcb0a510 0x5582bcb1de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.829+0000 7f1525227740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5582bcb1c4e0 con 0x5582bcaffc50 2024-09-12T02:47:56.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.829+0000 7f1525227740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5582bcb1be10 con 0x5582bcaff330 2024-09-12T02:47:56.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.829+0000 7f1525227740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5582bcb1cbb0 con 0x5582bcb0a510 2024-09-12T02:47:56.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.830+0000 7f1525227740 10 client.0 _ll_register_callbacks cb 0x7f150c009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:56.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.830+0000 7f151b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcaff330 0x5582bcb24b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.830+0000 7f151b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcaff330 0x5582bcb24b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:33122/0 (socket says 172.21.15.18:33122) 2024-09-12T02:47:56.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.830+0000 7f151b400640 1 -- 172.21.15.18:0/2927053457 learned_addr learned my addr 172.21.15.18:0/2927053457 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:56.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.830+0000 7f1513e00640 1 --2- 172.21.15.18:0/2927053457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaffc50 0x5582bcb25080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.830+0000 7f151be00640 1 --2- 172.21.15.18:0/2927053457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcb0a510 0x5582bcb1de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.830+0000 7f151b400640 1 -- 172.21.15.18:0/2927053457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcb0a510 msgr2=0x5582bcb1de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:56.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.830+0000 7f151b400640 1 --2- 172.21.15.18:0/2927053457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcb0a510 0x5582bcb1de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.830+0000 7f151b400640 1 -- 172.21.15.18:0/2927053457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaffc50 msgr2=0x5582bcb25080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:56.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.830+0000 7f151b400640 1 --2- 172.21.15.18:0/2927053457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaffc50 0x5582bcb25080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.830+0000 7f151b400640 1 -- 172.21.15.18:0/2927053457 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582bcb1e6a0 con 0x5582bcaff330 2024-09-12T02:47:56.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.831+0000 7f151b400640 1 --2- 172.21.15.18:0/2927053457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcaff330 0x5582bcb24b40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f150c011850 tx=0x7f150c019750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=796c27d6f1a84df1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:56.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.831+0000 7f1509600640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:47:56.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.831+0000 7f1509600640 1 -- 172.21.15.18:0/2927053457 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c01e040 con 0x5582bcaff330 2024-09-12T02:47:56.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.831+0000 7f1525227740 1 -- 172.21.15.18:0/2927053457 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15140cd450 con 0x5582bcaff330 2024-09-12T02:47:56.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.831+0000 7f1509600640 1 -- 172.21.15.18:0/2927053457 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f150c0199e0 con 0x5582bcaff330 2024-09-12T02:47:56.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.831+0000 7f1509600640 1 -- 172.21.15.18:0/2927053457 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f150c03f050 con 0x5582bcaff330 2024-09-12T02:47:56.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.831+0000 7f1525227740 10 client.24989 fetch_fsmap learned FSMap version 29 2024-09-12T02:47:56.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.831+0000 7f1525227740 1 -- 172.21.15.18:0/2927053457 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5582bcb23140 con 0x5582bcaff330 2024-09-12T02:47:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.832+0000 7f1509600640 1 -- 172.21.15.18:0/2927053457 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15140cd450 con 0x5582bcaff330 2024-09-12T02:47:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.832+0000 7f1509600640 1 -- 172.21.15.18:0/2927053457 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f150c036030 con 0x5582bcaff330 2024-09-12T02:47:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.832+0000 7f1525227740 10 client.24989 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:47:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.832+0000 7f1525227740 10 client.24989 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:47:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.832+0000 7f1525227740 20 client.24989 populate_metadata read hostname 'smithi018' 2024-09-12T02:47:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.832+0000 7f1525227740 1 --2- 172.21.15.18:0/2927053457 >> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] conn(0x5582bcb89f60 0x5582bcb88c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.832+0000 7f1525227740 4 client.24989 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:47:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.832+0000 7f1525227740 1 -- 172.21.15.18:0/2927053457 --> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] -- command(tid 0: {"prefix": "status"}) -- 0x5582bca6cb30 con 0x5582bcb89f60 2024-09-12T02:47:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.832+0000 7f1513e00640 1 --2- 172.21.15.18:0/2927053457 >> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] conn(0x5582bcb89f60 0x5582bcb88c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:56.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.833+0000 7f1513e00640 1 --2- 172.21.15.18:0/2927053457 >> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] conn(0x5582bcb89f60 0x5582bcb88c70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2bda3e605b0219ad server_cookie=24449e0898b4b075 in_seq=0 out_seq=0 2024-09-12T02:47:56.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.833+0000 7f1509600640 10 client.24989 ms_handle_connect on v2:172.21.15.176:6836/4286557016 2024-09-12T02:47:56.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.833+0000 7f1509600640 1 -- 172.21.15.18:0/2927053457 <== mds.3 v2:172.21.15.176:6836/4286557016 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5582bca6cb30 con 0x5582bcb89f60 2024-09-12T02:47:56.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.833+0000 7f1509600640 10 client.24989 handle_command_reply: tid=0 2024-09-12T02:47:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.833+0000 7f1525227740 1 client.24989 shutdown 2024-09-12T02:47:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.833+0000 7f1525227740 1 -- 172.21.15.18:0/2927053457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcaff330 msgr2=0x5582bcb24b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.833+0000 7f1525227740 1 --2- 172.21.15.18:0/2927053457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcaff330 0x5582bcb24b40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f150c011850 tx=0x7f150c019750 comp rx=0 tx=0).stop 2024-09-12T02:47:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.833+0000 7f1525227740 1 -- 172.21.15.18:0/2927053457 shutdown_connections 2024-09-12T02:47:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.833+0000 7f1525227740 1 --2- 172.21.15.18:0/2927053457 >> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] conn(0x5582bcb89f60 0x5582bcb88c70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.833+0000 7f1525227740 1 --2- 172.21.15.18:0/2927053457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5582bcb0a510 0x5582bcb1de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.833+0000 7f1525227740 1 --2- 172.21.15.18:0/2927053457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5582bcaffc50 0x5582bcb25080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.833+0000 7f1525227740 1 --2- 172.21.15.18:0/2927053457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5582bcaff330 0x5582bcb24b40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.833+0000 7f1525227740 1 -- 172.21.15.18:0/2927053457 >> 172.21.15.18:0/2927053457 conn(0x5582bcafb8c0 msgr2=0x5582bcb15430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.833+0000 7f1509600640 0 client.24989 ms_handle_reset on v2:172.21.15.176:6836/4286557016 2024-09-12T02:47:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.834+0000 7f1525227740 1 -- 172.21.15.18:0/2927053457 shutdown_connections 2024-09-12T02:47:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.834+0000 7f1525227740 1 -- 172.21.15.18:0/2927053457 wait complete. 2024-09-12T02:47:56.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.834+0000 7f1525227740 20 client.24989 trim_cache size 0 max 16384 2024-09-12T02:47:56.841 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T02:47:56.841 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "c7666100-70af-11ef-bcea-c7b262605968", 2024-09-12T02:47:56.841 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 3, 2024-09-12T02:47:56.841 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24493, 2024-09-12T02:47:56.841 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-12T02:47:56.841 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-12T02:47:56.841 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-12T02:47:56.841 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 84.195990144999996, 2024-09-12T02:47:56.841 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 29, 2024-09-12T02:47:56.842 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 98, 2024-09-12T02:47:56.842 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 96, 2024-09-12T02:47:56.842 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 170.486182687 2024-09-12T02:47:56.842 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T02:47:56.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.835+0000 7f1522800640 1 -- 172.21.15.18:0/1873016843 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f15000a2c10 msgr2=0x7f15000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:56.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.835+0000 7f1522800640 1 --2- 172.21.15.18:0/1873016843 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f15000a2c10 0x7f15000a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1504031550 tx=0x7f1504005bd0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.835+0000 7f1522800640 1 -- 172.21.15.18:0/1873016843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f151c109140 msgr2=0x7f151c19efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:56.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.835+0000 7f1522800640 1 --2- 172.21.15.18:0/1873016843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f151c109140 0x7f151c19efb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1514009fd0 tx=0x7f151400ef10 comp rx=0 tx=0).stop 2024-09-12T02:47:56.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.835+0000 7f1522800640 1 -- 172.21.15.18:0/1873016843 shutdown_connections 2024-09-12T02:47:56.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.835+0000 7f1522800640 1 --2- 172.21.15.18:0/1873016843 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f15000a2c10 0x7f15000a50d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.835+0000 7f1522800640 1 --2- 172.21.15.18:0/1873016843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f151c109140 0x7f151c19efb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.835+0000 7f1522800640 1 --2- 172.21.15.18:0/1873016843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151c1049c0 0x7f151c19ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.835+0000 7f1522800640 1 --2- 172.21.15.18:0/1873016843 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f151c104010 0x7f151c19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:56.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.835+0000 7f1522800640 1 -- 172.21.15.18:0/1873016843 >> 172.21.15.18:0/1873016843 conn(0x7f151c0ffa50 msgr2=0x7f151c100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:56.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.835+0000 7f1522800640 1 -- 172.21.15.18:0/1873016843 shutdown_connections 2024-09-12T02:47:56.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:56.835+0000 7f1522800640 1 -- 172.21.15.18:0/1873016843 wait complete. 2024-09-12T02:47:56.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:56 smithi176 ceph-mon[35713]: pgmap v380: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:57.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:56 smithi062 ceph-mon[35527]: pgmap v380: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:47:57.677 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T02:47:58.056 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:47:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.705+0000 7f23f8200640 1 -- 172.21.15.18:0/1774064250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23f01049a0 msgr2=0x7f23f01089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.705+0000 7f23f8200640 1 --2- 172.21.15.18:0/1774064250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23f01049a0 0x7f23f01089f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009900 tx=0x7f23dc02a410 comp rx=0 tx=0).stop 2024-09-12T02:47:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.706+0000 7f23f8200640 1 -- 172.21.15.18:0/1774064250 shutdown_connections 2024-09-12T02:47:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.706+0000 7f23f8200640 1 --2- 172.21.15.18:0/1774064250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23f0109120 0x7f23f0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.706+0000 7f23f8200640 1 --2- 172.21.15.18:0/1774064250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23f01049a0 0x7f23f01089f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.706+0000 7f23f8200640 1 --2- 172.21.15.18:0/1774064250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23f0103ff0 0x7f23f01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.706+0000 7f23f8200640 1 -- 172.21.15.18:0/1774064250 >> 172.21.15.18:0/1774064250 conn(0x7f23f00ffa90 msgr2=0x7f23f0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.706+0000 7f23f8200640 1 -- 172.21.15.18:0/1774064250 shutdown_connections 2024-09-12T02:47:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.706+0000 7f23f8200640 1 -- 172.21.15.18:0/1774064250 wait complete. 2024-09-12T02:47:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.707+0000 7f23f8200640 1 Processor -- start 2024-09-12T02:47:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.707+0000 7f23f8200640 1 -- start start 2024-09-12T02:47:58.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.707+0000 7f23f8200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23f0103ff0 0x7f23f019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.707+0000 7f23f8200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23f01049a0 0x7f23f019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.707+0000 7f23f8200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23f0109120 0x7f23f019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.707+0000 7f23f8200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f23f0114140 con 0x7f23f0109120 2024-09-12T02:47:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.707+0000 7f23f8200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f23f0113fc0 con 0x7f23f01049a0 2024-09-12T02:47:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.707+0000 7f23f8200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f23f01142c0 con 0x7f23f0103ff0 2024-09-12T02:47:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.708+0000 7f23f4e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23f01049a0 0x7f23f019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.708+0000 7f23f6200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23f0109120 0x7f23f019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.708+0000 7f23f4e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23f01049a0 0x7f23f019ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:33138/0 (socket says 172.21.15.18:33138) 2024-09-12T02:47:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.708+0000 7f23f4e00640 1 -- 172.21.15.18:0/1990078951 learned_addr learned my addr 172.21.15.18:0/1990078951 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.708+0000 7f23f5800640 1 --2- 172.21.15.18:0/1990078951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23f0103ff0 0x7f23f019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.708+0000 7f23f4e00640 1 -- 172.21.15.18:0/1990078951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23f0103ff0 msgr2=0x7f23f019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.708+0000 7f23f4e00640 1 --2- 172.21.15.18:0/1990078951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23f0103ff0 0x7f23f019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.708+0000 7f23f4e00640 1 -- 172.21.15.18:0/1990078951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23f0109120 msgr2=0x7f23f019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.708+0000 7f23f4e00640 1 --2- 172.21.15.18:0/1990078951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23f0109120 0x7f23f019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.708+0000 7f23f4e00640 1 -- 172.21.15.18:0/1990078951 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f019f5d0 con 0x7f23f01049a0 2024-09-12T02:47:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.708+0000 7f23f4e00640 1 --2- 172.21.15.18:0/1990078951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23f01049a0 0x7f23f019ab60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f23dc006010 tx=0x7f23dc004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.709+0000 7f23ee000640 1 -- 172.21.15.18:0/1990078951 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc03f030 con 0x7f23f01049a0 2024-09-12T02:47:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.709+0000 7f23ee000640 1 -- 172.21.15.18:0/1990078951 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23dc004440 con 0x7f23f01049a0 2024-09-12T02:47:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.709+0000 7f23ee000640 1 -- 172.21.15.18:0/1990078951 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc035070 con 0x7f23f01049a0 2024-09-12T02:47:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.709+0000 7f23f8200640 1 -- 172.21.15.18:0/1990078951 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23f019f860 con 0x7f23f01049a0 2024-09-12T02:47:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.709+0000 7f23f8200640 1 -- 172.21.15.18:0/1990078951 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23f01a71a0 con 0x7f23f01049a0 2024-09-12T02:47:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.712+0000 7f23ee000640 1 -- 172.21.15.18:0/1990078951 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f23dc042030 con 0x7f23f01049a0 2024-09-12T02:47:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.712+0000 7f23fae06740 1 Processor -- start 2024-09-12T02:47:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.712+0000 7f23fae06740 1 -- start start 2024-09-12T02:47:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.712+0000 7f23fae06740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9a330 0x5636e2e9a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.712+0000 7f23fae06740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2e9ac50 0x5636e2ea4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.712+0000 7f23fae06740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2ea5510 0x5636e2ea7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.712+0000 7f23fae06740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5636e2e000b0 con 0x5636e2ea5510 2024-09-12T02:47:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.712+0000 7f23fae06740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5636e2da7ab0 con 0x5636e2e9a330 2024-09-12T02:47:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.712+0000 7f23fae06740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5636e2dfc070 con 0x5636e2e9ac50 2024-09-12T02:47:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.713+0000 7f23f6200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9a330 0x5636e2e9a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.713+0000 7f23f6200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9a330 0x5636e2e9a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:33140/0 (socket says 172.21.15.18:33140) 2024-09-12T02:47:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.713+0000 7f23f6200640 1 -- 172.21.15.18:0/288353033 learned_addr learned my addr 172.21.15.18:0/288353033 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.713+0000 7f23f4e00640 1 --2- 172.21.15.18:0/288353033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2ea5510 0x5636e2ea7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.713+0000 7f23f5800640 1 --2- 172.21.15.18:0/288353033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2e9ac50 0x5636e2ea4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.713+0000 7f23f6200640 1 -- 172.21.15.18:0/288353033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2e9ac50 msgr2=0x5636e2ea4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:58.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.713+0000 7f23f6200640 1 --2- 172.21.15.18:0/288353033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2e9ac50 0x5636e2ea4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.713+0000 7f23f6200640 1 -- 172.21.15.18:0/288353033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2ea5510 msgr2=0x5636e2ea7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:58.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.713+0000 7f23f6200640 1 --2- 172.21.15.18:0/288353033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2ea5510 0x5636e2ea7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.713+0000 7f23f6200640 1 -- 172.21.15.18:0/288353033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636e2db44a0 con 0x5636e2e9a330 2024-09-12T02:47:58.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.713+0000 7f23f5800640 1 --2- 172.21.15.18:0/288353033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2e9ac50 0x5636e2ea4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:58.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.713+0000 7f23f4e00640 1 --2- 172.21.15.18:0/288353033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2ea5510 0x5636e2ea7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:47:58.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.713+0000 7f23f6200640 1 --2- 172.21.15.18:0/288353033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9a330 0x5636e2e9a710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009f50 tx=0x7f23e80118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=402de70c8a81778b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:58.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.713+0000 7f23ee000640 1 --2- 172.21.15.18:0/1990078951 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f23d80a2c90 0x7f23d80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.714+0000 7f23e2a00640 1 -- 172.21.15.18:0/288353033 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8004d20 con 0x5636e2e9a330 2024-09-12T02:47:58.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.714+0000 7f23ee000640 1 -- 172.21.15.18:0/1990078951 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f23dc0ef8b0 con 0x7f23f01049a0 2024-09-12T02:47:58.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.714+0000 7f23e2a00640 1 -- 172.21.15.18:0/288353033 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23e8004050 con 0x5636e2e9a330 2024-09-12T02:47:58.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.714+0000 7f23e2a00640 1 -- 172.21.15.18:0/288353033 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8005280 con 0x5636e2e9a330 2024-09-12T02:47:58.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.714+0000 7f23f5800640 1 --2- 172.21.15.18:0/1990078951 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f23d80a2c90 0x7f23d80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.714+0000 7f23fae06740 1 -- 172.21.15.18:0/288353033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9a330 msgr2=0x5636e2e9a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.714+0000 7f23fae06740 1 --2- 172.21.15.18:0/288353033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9a330 0x5636e2e9a710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009f50 tx=0x7f23e80118d0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.714+0000 7f23f5800640 1 --2- 172.21.15.18:0/1990078951 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f23d80a2c90 0x7f23d80a5150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5636e2e97720 tx=0x7f23e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:58.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.715+0000 7f23fae06740 1 -- 172.21.15.18:0/288353033 shutdown_connections 2024-09-12T02:47:58.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.715+0000 7f23fae06740 1 --2- 172.21.15.18:0/288353033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2ea5510 0x5636e2ea7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.715+0000 7f23fae06740 1 --2- 172.21.15.18:0/288353033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2e9ac50 0x5636e2ea4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.715+0000 7f23fae06740 1 --2- 172.21.15.18:0/288353033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9a330 0x5636e2e9a710 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.715+0000 7f23fae06740 1 -- 172.21.15.18:0/288353033 >> 172.21.15.18:0/288353033 conn(0x5636e2e968c0 msgr2=0x5636e2e96ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:58.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.715+0000 7f23fae06740 1 -- 172.21.15.18:0/288353033 shutdown_connections 2024-09-12T02:47:58.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.715+0000 7f23fae06740 1 -- 172.21.15.18:0/288353033 wait complete. 2024-09-12T02:47:58.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.715+0000 7f23fae06740 1 -- start start 2024-09-12T02:47:58.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.715+0000 7f23fae06740 1 Processor -- start 2024-09-12T02:47:58.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.716+0000 7f23fae06740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9a330 0x5636e2ea2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.716+0000 7f23fae06740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2e9ac50 0x5636e2ea2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.716+0000 7f23fae06740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2ea5510 0x5636e2ea30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.716+0000 7f23fae06740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5636e2ea8060 con 0x5636e2e9a330 2024-09-12T02:47:58.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.716+0000 7f23fae06740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5636e2d88920 con 0x5636e2ea5510 2024-09-12T02:47:58.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.716+0000 7f23fae06740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5636e2ea81e0 con 0x5636e2e9ac50 2024-09-12T02:47:58.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.716+0000 7f23fae06740 10 client.0 _ll_register_callbacks cb 0x5636e2dac8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:58.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.716+0000 7f23f5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9a330 0x5636e2ea2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.716+0000 7f23f5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9a330 0x5636e2ea2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58194/0 (socket says 172.21.15.18:58194) 2024-09-12T02:47:58.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.716+0000 7f23f5800640 1 -- 172.21.15.18:0/1252006303 learned_addr learned my addr 172.21.15.18:0/1252006303 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:58.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.716+0000 7f23f4e00640 1 --2- 172.21.15.18:0/1252006303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2e9ac50 0x5636e2ea2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.716+0000 7f23f6200640 1 --2- 172.21.15.18:0/1252006303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2ea5510 0x5636e2ea30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.717+0000 7f23f4e00640 1 -- 172.21.15.18:0/1252006303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2ea5510 msgr2=0x5636e2ea30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:58.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.717+0000 7f23f4e00640 1 --2- 172.21.15.18:0/1252006303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2ea5510 0x5636e2ea30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.717+0000 7f23f4e00640 1 -- 172.21.15.18:0/1252006303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9a330 msgr2=0x5636e2ea2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:58.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.717+0000 7f23f4e00640 1 --2- 172.21.15.18:0/1252006303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9a330 0x5636e2ea2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.717+0000 7f23f4e00640 1 -- 172.21.15.18:0/1252006303 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636e2b712b0 con 0x5636e2e9ac50 2024-09-12T02:47:58.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.717+0000 7f23f5800640 1 --2- 172.21.15.18:0/1252006303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9a330 0x5636e2ea2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:47:58.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.717+0000 7f23f4e00640 1 --2- 172.21.15.18:0/1252006303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2e9ac50 0x5636e2ea2b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0ece50 tx=0x7f23dc0b7fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75b55828d28a37d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:58.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.717+0000 7f23d7400640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:47:58.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.717+0000 7f23d7400640 1 -- 172.21.15.18:0/1252006303 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc049070 con 0x5636e2e9ac50 2024-09-12T02:47:58.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.717+0000 7f23fae06740 1 -- 172.21.15.18:0/1252006303 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23e8004050 con 0x5636e2e9ac50 2024-09-12T02:47:58.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.717+0000 7f23d7400640 1 -- 172.21.15.18:0/1252006303 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f23dc0b82c0 con 0x5636e2e9ac50 2024-09-12T02:47:58.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.717+0000 7f23d7400640 1 -- 172.21.15.18:0/1252006303 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f23dc0bbc50 con 0x5636e2e9ac50 2024-09-12T02:47:58.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.717+0000 7f23fae06740 10 client.25003 fetch_fsmap learned FSMap version 29 2024-09-12T02:47:58.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.717+0000 7f23fae06740 1 -- 172.21.15.18:0/1252006303 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5636e2ea8060 con 0x5636e2e9ac50 2024-09-12T02:47:58.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.718+0000 7f23d7400640 1 -- 172.21.15.18:0/1252006303 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23e8004050 con 0x5636e2e9ac50 2024-09-12T02:47:58.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.718+0000 7f23d7400640 1 -- 172.21.15.18:0/1252006303 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f23dc0bbeb0 con 0x5636e2e9ac50 2024-09-12T02:47:58.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.718+0000 7f23fae06740 10 client.25003 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:47:58.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.718+0000 7f23fae06740 10 client.25003 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:47:58.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.718+0000 7f23fae06740 20 client.25003 populate_metadata read hostname 'smithi018' 2024-09-12T02:47:58.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.718+0000 7f23fae06740 1 --2- 172.21.15.18:0/1252006303 >> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] conn(0x5636e2eb6470 0x5636e2eb78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.718+0000 7f23fae06740 4 client.25003 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:47:58.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.718+0000 7f23fae06740 1 -- 172.21.15.18:0/1252006303 --> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636e2e0d620 con 0x5636e2eb6470 2024-09-12T02:47:58.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.719+0000 7f23f5800640 1 --2- 172.21.15.18:0/1252006303 >> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] conn(0x5636e2eb6470 0x5636e2eb78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.719+0000 7f23f5800640 1 --2- 172.21.15.18:0/1252006303 >> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] conn(0x5636e2eb6470 0x5636e2eb78e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bef5336bac33f249 server_cookie=bb988460c5d6b4a8 in_seq=0 out_seq=0 2024-09-12T02:47:58.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.719+0000 7f23d7400640 10 client.25003 ms_handle_connect on v2:172.21.15.176:6838/3957634398 2024-09-12T02:47:58.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.720+0000 7f23d7400640 1 -- 172.21.15.18:0/1252006303 <== mds.2 v2:172.21.15.176:6838/3957634398 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636e2e0d620 con 0x5636e2eb6470 2024-09-12T02:47:58.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.720+0000 7f23d7400640 10 client.25003 handle_command_reply: tid=0 2024-09-12T02:47:58.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.720+0000 7f23fae06740 1 client.25003 shutdown 2024-09-12T02:47:58.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.720+0000 7f23fae06740 1 -- 172.21.15.18:0/1252006303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2e9ac50 msgr2=0x5636e2ea2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.720+0000 7f23fae06740 1 --2- 172.21.15.18:0/1252006303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2e9ac50 0x5636e2ea2b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0ece50 tx=0x7f23dc0b7fb0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.720+0000 7f23fae06740 1 -- 172.21.15.18:0/1252006303 shutdown_connections 2024-09-12T02:47:58.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.720+0000 7f23fae06740 1 --2- 172.21.15.18:0/1252006303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2ea5510 0x5636e2ea30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.720+0000 7f23fae06740 1 --2- 172.21.15.18:0/1252006303 >> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] conn(0x5636e2eb6470 0x5636e2eb78e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.720+0000 7f23fae06740 1 --2- 172.21.15.18:0/1252006303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2e9ac50 0x5636e2ea2b60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.720+0000 7f23fae06740 1 --2- 172.21.15.18:0/1252006303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9a330 0x5636e2ea2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.720+0000 7f23d7400640 0 client.25003 ms_handle_reset on v2:172.21.15.176:6838/3957634398 2024-09-12T02:47:58.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.720+0000 7f23fae06740 1 -- 172.21.15.18:0/1252006303 >> 172.21.15.18:0/1252006303 conn(0x5636e2e968c0 msgr2=0x5636e2e9c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:58.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.721+0000 7f23fae06740 1 -- 172.21.15.18:0/1252006303 shutdown_connections 2024-09-12T02:47:58.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.721+0000 7f23fae06740 1 -- 172.21.15.18:0/1252006303 wait complete. 2024-09-12T02:47:58.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.721+0000 7f23fae06740 20 client.25003 trim_cache size 0 max 16384 2024-09-12T02:47:58.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.740+0000 7f23fae06740 1 Processor -- start 2024-09-12T02:47:58.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.740+0000 7f23fae06740 1 -- start start 2024-09-12T02:47:58.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.740+0000 7f23fae06740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9a330 0x5636e2eb6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.740+0000 7f23fae06740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9ac50 0x5636e2e9c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.740+0000 7f23fae06740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2ea5510 0x5636e2e9f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.740+0000 7f23fae06740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5636e2eb5c20 con 0x5636e2e9a330 2024-09-12T02:47:58.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.740+0000 7f23fae06740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5636e2eb62f0 con 0x5636e2e9ac50 2024-09-12T02:47:58.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.740+0000 7f23fae06740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5636e2eb69c0 con 0x5636e2ea5510 2024-09-12T02:47:58.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.740+0000 7f23f5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9a330 0x5636e2eb6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.740+0000 7f23f5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9a330 0x5636e2eb6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58200/0 (socket says 172.21.15.18:58200) 2024-09-12T02:47:58.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.740+0000 7f23f5800640 1 -- 172.21.15.18:0/1362465772 learned_addr learned my addr 172.21.15.18:0/1362465772 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:58.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.740+0000 7f23f4e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9ac50 0x5636e2e9c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.741+0000 7f23f6200640 1 --2- 172.21.15.18:0/1362465772 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2ea5510 0x5636e2e9f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.741+0000 7f23f4e00640 1 -- 172.21.15.18:0/1362465772 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2ea5510 msgr2=0x5636e2e9f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:58.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.741+0000 7f23f4e00640 1 --2- 172.21.15.18:0/1362465772 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2ea5510 0x5636e2e9f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.741+0000 7f23f4e00640 1 -- 172.21.15.18:0/1362465772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9a330 msgr2=0x5636e2eb6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:58.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.741+0000 7f23f4e00640 1 --2- 172.21.15.18:0/1362465772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9a330 0x5636e2eb6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.741+0000 7f23f4e00640 1 -- 172.21.15.18:0/1362465772 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636e2ea0bd0 con 0x5636e2e9ac50 2024-09-12T02:47:58.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.741+0000 7f23f4e00640 1 --2- 172.21.15.18:0/1362465772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9ac50 0x5636e2e9c490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0bbbe0 tx=0x7f23dc0b8020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f8ce5f41867acba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:58.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.741+0000 7f23e2000640 1 -- 172.21.15.18:0/1362465772 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0d8070 con 0x5636e2e9ac50 2024-09-12T02:47:58.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.741+0000 7f23e2000640 1 -- 172.21.15.18:0/1362465772 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23dc0bff50 con 0x5636e2e9ac50 2024-09-12T02:47:58.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.742+0000 7f23e2000640 1 -- 172.21.15.18:0/1362465772 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc049050 con 0x5636e2e9ac50 2024-09-12T02:47:58.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.742+0000 7f23fae06740 1 -- 172.21.15.18:0/1362465772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9ac50 msgr2=0x5636e2e9c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.742+0000 7f23fae06740 1 --2- 172.21.15.18:0/1362465772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9ac50 0x5636e2e9c490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0bbbe0 tx=0x7f23dc0b8020 comp rx=0 tx=0).stop 2024-09-12T02:47:58.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.742+0000 7f23fae06740 1 -- 172.21.15.18:0/1362465772 shutdown_connections 2024-09-12T02:47:58.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.742+0000 7f23fae06740 1 --2- 172.21.15.18:0/1362465772 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2ea5510 0x5636e2e9f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.742+0000 7f23fae06740 1 --2- 172.21.15.18:0/1362465772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9ac50 0x5636e2e9c490 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.742+0000 7f23fae06740 1 --2- 172.21.15.18:0/1362465772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9a330 0x5636e2eb6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.742+0000 7f23fae06740 1 -- 172.21.15.18:0/1362465772 >> 172.21.15.18:0/1362465772 conn(0x5636e2e968c0 msgr2=0x5636e2e9bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.742+0000 7f23fae06740 1 -- 172.21.15.18:0/1362465772 shutdown_connections 2024-09-12T02:47:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.742+0000 7f23fae06740 1 -- 172.21.15.18:0/1362465772 wait complete. 2024-09-12T02:47:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.743+0000 7f23fae06740 1 -- start start 2024-09-12T02:47:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.743+0000 7f23fae06740 1 Processor -- start 2024-09-12T02:47:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.743+0000 7f23fae06740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9a330 0x5636e2ebfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.743+0000 7f23fae06740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9ac50 0x5636e2ec00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.743+0000 7f23fae06740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2ea5510 0x5636e2ebab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.743+0000 7f23fae06740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5636e2eb7760 con 0x5636e2e9ac50 2024-09-12T02:47:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.743+0000 7f23fae06740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5636e2eb7090 con 0x5636e2e9a330 2024-09-12T02:47:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.743+0000 7f23fae06740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5636e2eb7e30 con 0x5636e2ea5510 2024-09-12T02:47:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.743+0000 7f23fae06740 10 client.0 _ll_register_callbacks cb 0x7f23dc0095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:47:58.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.744+0000 7f23f5800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9a330 0x5636e2ebfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.744+0000 7f23f5800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9a330 0x5636e2ebfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:33154/0 (socket says 172.21.15.18:33154) 2024-09-12T02:47:58.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.744+0000 7f23f4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9ac50 0x5636e2ec00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.744+0000 7f23f5800640 1 -- 172.21.15.18:0/210738484 learned_addr learned my addr 172.21.15.18:0/210738484 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:47:58.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.744+0000 7f23f5800640 1 -- 172.21.15.18:0/210738484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2ea5510 msgr2=0x5636e2ebab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:58.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.744+0000 7f23f6200640 1 --2- 172.21.15.18:0/210738484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2ea5510 0x5636e2ebab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.744+0000 7f23f5800640 1 --2- 172.21.15.18:0/210738484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2ea5510 0x5636e2ebab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.744+0000 7f23f5800640 1 -- 172.21.15.18:0/210738484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9ac50 msgr2=0x5636e2ec00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:47:58.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.744+0000 7f23f5800640 1 --2- 172.21.15.18:0/210738484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9ac50 0x5636e2ec00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.744+0000 7f23f5800640 1 -- 172.21.15.18:0/210738484 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636e2ec0830 con 0x5636e2e9a330 2024-09-12T02:47:58.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.745+0000 7f23f5800640 1 --2- 172.21.15.18:0/210738484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9a330 0x5636e2ebfbb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x5636e2ea3790 tx=0x7f23e40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a13e9a9ba54ec23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:47:58.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.745+0000 7f23d7400640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:47:58.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.745+0000 7f23d7400640 1 -- 172.21.15.18:0/210738484 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e403b060 con 0x5636e2e9a330 2024-09-12T02:47:58.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.745+0000 7f23fae06740 1 -- 172.21.15.18:0/210738484 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23dc0bff50 con 0x5636e2e9a330 2024-09-12T02:47:58.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.745+0000 7f23d7400640 1 -- 172.21.15.18:0/210738484 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f23e401ecb0 con 0x5636e2e9a330 2024-09-12T02:47:58.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.745+0000 7f23d7400640 1 -- 172.21.15.18:0/210738484 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f23e4042050 con 0x5636e2e9a330 2024-09-12T02:47:58.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.745+0000 7f23fae06740 10 client.25007 fetch_fsmap learned FSMap version 29 2024-09-12T02:47:58.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.745+0000 7f23fae06740 1 -- 172.21.15.18:0/210738484 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5636e2f21210 con 0x5636e2e9a330 2024-09-12T02:47:58.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.745+0000 7f23d7400640 1 -- 172.21.15.18:0/210738484 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23dc0bff50 con 0x5636e2e9a330 2024-09-12T02:47:58.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.746+0000 7f23d7400640 1 -- 172.21.15.18:0/210738484 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f23e402c510 con 0x5636e2e9a330 2024-09-12T02:47:58.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.746+0000 7f23fae06740 10 client.25007 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:47:58.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.746+0000 7f23fae06740 10 client.25007 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:47:58.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.746+0000 7f23fae06740 20 client.25007 populate_metadata read hostname 'smithi018' 2024-09-12T02:47:58.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.746+0000 7f23fae06740 1 --2- 172.21.15.18:0/210738484 >> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] conn(0x5636e2f25e20 0x5636e2f24b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:47:58.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.746+0000 7f23fae06740 4 client.25007 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:47:58.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.746+0000 7f23fae06740 1 -- 172.21.15.18:0/210738484 --> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] -- command(tid 0: {"prefix": "status"}) -- 0x5636e2e07b30 con 0x5636e2f25e20 2024-09-12T02:47:58.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.746+0000 7f23f4e00640 1 --2- 172.21.15.18:0/210738484 >> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] conn(0x5636e2f25e20 0x5636e2f24b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:47:58.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.747+0000 7f23f4e00640 1 --2- 172.21.15.18:0/210738484 >> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] conn(0x5636e2f25e20 0x5636e2f24b30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=30f0d2dd61850207 server_cookie=195e51f519346b7e in_seq=0 out_seq=0 2024-09-12T02:47:58.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.747+0000 7f23d7400640 10 client.25007 ms_handle_connect on v2:172.21.15.176:6838/3957634398 2024-09-12T02:47:58.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.747+0000 7f23d7400640 1 -- 172.21.15.18:0/210738484 <== mds.2 v2:172.21.15.176:6838/3957634398 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5636e2e07b30 con 0x5636e2f25e20 2024-09-12T02:47:58.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.747+0000 7f23d7400640 10 client.25007 handle_command_reply: tid=0 2024-09-12T02:47:58.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.747+0000 7f23fae06740 1 client.25007 shutdown 2024-09-12T02:47:58.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.747+0000 7f23fae06740 1 -- 172.21.15.18:0/210738484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9a330 msgr2=0x5636e2ebfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.747+0000 7f23fae06740 1 --2- 172.21.15.18:0/210738484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9a330 0x5636e2ebfbb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x5636e2ea3790 tx=0x7f23e40046c0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.747+0000 7f23fae06740 1 -- 172.21.15.18:0/210738484 shutdown_connections 2024-09-12T02:47:58.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.747+0000 7f23fae06740 1 --2- 172.21.15.18:0/210738484 >> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] conn(0x5636e2f25e20 0x5636e2f24b30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.747+0000 7f23d7400640 0 client.25007 ms_handle_reset on v2:172.21.15.176:6838/3957634398 2024-09-12T02:47:58.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.747+0000 7f23fae06740 1 --2- 172.21.15.18:0/210738484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5636e2ea5510 0x5636e2ebab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.747+0000 7f23fae06740 1 --2- 172.21.15.18:0/210738484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636e2e9ac50 0x5636e2ec00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.747+0000 7f23fae06740 1 --2- 172.21.15.18:0/210738484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5636e2e9a330 0x5636e2ebfbb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.747+0000 7f23fae06740 1 -- 172.21.15.18:0/210738484 >> 172.21.15.18:0/210738484 conn(0x5636e2e968c0 msgr2=0x5636e2ea46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:58.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.748+0000 7f23fae06740 1 -- 172.21.15.18:0/210738484 shutdown_connections 2024-09-12T02:47:58.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.748+0000 7f23fae06740 1 -- 172.21.15.18:0/210738484 wait complete. 2024-09-12T02:47:58.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.748+0000 7f23fae06740 20 client.25007 trim_cache size 0 max 16384 2024-09-12T02:47:58.751 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T02:47:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "c7666100-70af-11ef-bcea-c7b262605968", 2024-09-12T02:47:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 2, 2024-09-12T02:47:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24508, 2024-09-12T02:47:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-12T02:47:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-12T02:47:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-12T02:47:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 87.114975623000007, 2024-09-12T02:47:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 29, 2024-09-12T02:47:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 98, 2024-09-12T02:47:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 96, 2024-09-12T02:47:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 166.97931356999999 2024-09-12T02:47:58.752 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T02:47:58.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.748+0000 7f23f8200640 1 -- 172.21.15.18:0/1990078951 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f23d80a2c90 msgr2=0x7f23d80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.748+0000 7f23f8200640 1 --2- 172.21.15.18:0/1990078951 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f23d80a2c90 0x7f23d80a5150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5636e2e97720 tx=0x7f23e4005f90 comp rx=0 tx=0).stop 2024-09-12T02:47:58.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.748+0000 7f23f8200640 1 -- 172.21.15.18:0/1990078951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23f01049a0 msgr2=0x7f23f019ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:47:58.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.748+0000 7f23f8200640 1 --2- 172.21.15.18:0/1990078951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23f01049a0 0x7f23f019ab60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f23dc006010 tx=0x7f23dc004040 comp rx=0 tx=0).stop 2024-09-12T02:47:58.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.749+0000 7f23f8200640 1 -- 172.21.15.18:0/1990078951 shutdown_connections 2024-09-12T02:47:58.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.749+0000 7f23f8200640 1 --2- 172.21.15.18:0/1990078951 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f23d80a2c90 0x7f23d80a5150 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.749+0000 7f23f8200640 1 --2- 172.21.15.18:0/1990078951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23f0109120 0x7f23f019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.749+0000 7f23f8200640 1 --2- 172.21.15.18:0/1990078951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23f01049a0 0x7f23f019ab60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.749+0000 7f23f8200640 1 --2- 172.21.15.18:0/1990078951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23f0103ff0 0x7f23f019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:47:58.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.749+0000 7f23f8200640 1 -- 172.21.15.18:0/1990078951 >> 172.21.15.18:0/1990078951 conn(0x7f23f00ffa90 msgr2=0x7f23f0100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:47:58.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.749+0000 7f23f8200640 1 -- 172.21.15.18:0/1990078951 shutdown_connections 2024-09-12T02:47:58.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:47:58.749+0000 7f23f8200640 1 -- 172.21.15.18:0/1990078951 wait complete. 2024-09-12T02:47:58.835 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:47:58 smithi062 ceph-mon[35527]: pgmap v381: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:47:58.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:47:58 smithi018 ceph-mon[30616]: pgmap v381: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:47:58.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:47:58 smithi176 ceph-mon[35713]: pgmap v381: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:47:59.710 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell mds.a status 2024-09-12T02:48:00.089 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:00.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.723+0000 7fe45fa00640 1 -- 172.21.15.18:0/1586299238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe458112a50 msgr2=0x7fe458114e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:00.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.723+0000 7fe45fa00640 1 --2- 172.21.15.18:0/1586299238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe458112a50 0x7fe458114e40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe450009ca0 tx=0x7fe45002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.724+0000 7fe45fa00640 1 -- 172.21.15.18:0/1586299238 shutdown_connections 2024-09-12T02:48:00.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.724+0000 7fe45fa00640 1 --2- 172.21.15.18:0/1586299238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe458112a50 0x7fe458114e40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.724+0000 7fe45fa00640 1 --2- 172.21.15.18:0/1586299238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe458077040 0x7fe458112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.724+0000 7fe45fa00640 1 --2- 172.21.15.18:0/1586299238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe458076720 0x7fe458076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.724+0000 7fe45fa00640 1 -- 172.21.15.18:0/1586299238 >> 172.21.15.18:0/1586299238 conn(0x7fe4580ffa50 msgr2=0x7fe458101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.724+0000 7fe45fa00640 1 -- 172.21.15.18:0/1586299238 shutdown_connections 2024-09-12T02:48:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.724+0000 7fe45fa00640 1 -- 172.21.15.18:0/1586299238 wait complete. 2024-09-12T02:48:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.725+0000 7fe45fa00640 1 Processor -- start 2024-09-12T02:48:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.725+0000 7fe45fa00640 1 -- start start 2024-09-12T02:48:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.725+0000 7fe45fa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe458076720 0x7fe4581a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.725+0000 7fe45fa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe458077040 0x7fe4581a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.725+0000 7fe45fa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe458112a50 0x7fe45819e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.725+0000 7fe45fa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe4581185e0 con 0x7fe458112a50 2024-09-12T02:48:00.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.725+0000 7fe45fa00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe458118460 con 0x7fe458077040 2024-09-12T02:48:00.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.725+0000 7fe45fa00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe458118760 con 0x7fe458076720 2024-09-12T02:48:00.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.725+0000 7fe44fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe458077040 0x7fe4581a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.725+0000 7fe45d000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe458076720 0x7fe4581a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.725+0000 7fe44fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe458077040 0x7fe4581a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:33174/0 (socket says 172.21.15.18:33174) 2024-09-12T02:48:00.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.725+0000 7fe44fe00640 1 -- 172.21.15.18:0/104580502 learned_addr learned my addr 172.21.15.18:0/104580502 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:00.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.725+0000 7fe45da00640 1 --2- 172.21.15.18:0/104580502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe458112a50 0x7fe45819e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.726+0000 7fe44fe00640 1 -- 172.21.15.18:0/104580502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe458076720 msgr2=0x7fe4581a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:00.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.726+0000 7fe44fe00640 1 --2- 172.21.15.18:0/104580502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe458076720 0x7fe4581a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.726+0000 7fe44fe00640 1 -- 172.21.15.18:0/104580502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe458112a50 msgr2=0x7fe45819e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:00.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.726+0000 7fe44fe00640 1 --2- 172.21.15.18:0/104580502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe458112a50 0x7fe45819e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.726+0000 7fe44fe00640 1 -- 172.21.15.18:0/104580502 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45819efa0 con 0x7fe458077040 2024-09-12T02:48:00.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.726+0000 7fe45d000640 1 --2- 172.21.15.18:0/104580502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe458076720 0x7fe4581a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:00.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.726+0000 7fe44fe00640 1 --2- 172.21.15.18:0/104580502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe458077040 0x7fe4581a4bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe44000e9f0 tx=0x7fe44000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:00.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.726+0000 7fe456000640 1 -- 172.21.15.18:0/104580502 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44000cd80 con 0x7fe458077040 2024-09-12T02:48:00.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.726+0000 7fe456000640 1 -- 172.21.15.18:0/104580502 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe440010910 con 0x7fe458077040 2024-09-12T02:48:00.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.727+0000 7fe456000640 1 -- 172.21.15.18:0/104580502 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440018990 con 0x7fe458077040 2024-09-12T02:48:00.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.727+0000 7fe45fa00640 1 -- 172.21.15.18:0/104580502 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe45819f290 con 0x7fe458077040 2024-09-12T02:48:00.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.727+0000 7fe45fa00640 1 -- 172.21.15.18:0/104580502 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4581ab580 con 0x7fe458077040 2024-09-12T02:48:00.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.729+0000 7fe462672740 1 Processor -- start 2024-09-12T02:48:00.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.730+0000 7fe462672740 1 -- start start 2024-09-12T02:48:00.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.730+0000 7fe456000640 1 -- 172.21.15.18:0/104580502 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe440010ac0 con 0x7fe458077040 2024-09-12T02:48:00.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.730+0000 7fe462672740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b6c330 0x562d77b6c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.730+0000 7fe462672740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b6cc50 0x562d77b76fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.730+0000 7fe462672740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b77510 0x562d77b79900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.730+0000 7fe462672740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d77ad20b0 con 0x562d77b6c330 2024-09-12T02:48:00.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.730+0000 7fe462672740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562d77a79ab0 con 0x562d77b6cc50 2024-09-12T02:48:00.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.730+0000 7fe462672740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562d77ace070 con 0x562d77b77510 2024-09-12T02:48:00.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.730+0000 7fe45da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b6c330 0x562d77b6c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.730+0000 7fe45d000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b6cc50 0x562d77b76fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.730+0000 7fe45d000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b6cc50 0x562d77b76fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:33188/0 (socket says 172.21.15.18:33188) 2024-09-12T02:48:00.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.730+0000 7fe45d000640 1 -- 172.21.15.18:0/652929769 learned_addr learned my addr 172.21.15.18:0/652929769 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:00.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.730+0000 7fe44fe00640 1 --2- 172.21.15.18:0/652929769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b77510 0x562d77b79900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.731+0000 7fe45d000640 1 -- 172.21.15.18:0/652929769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b77510 msgr2=0x562d77b79900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:00.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.731+0000 7fe45d000640 1 --2- 172.21.15.18:0/652929769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b77510 0x562d77b79900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.731+0000 7fe45d000640 1 -- 172.21.15.18:0/652929769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b6c330 msgr2=0x562d77b6c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:00.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.731+0000 7fe45d000640 1 --2- 172.21.15.18:0/652929769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b6c330 0x562d77b6c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.731+0000 7fe45d000640 1 -- 172.21.15.18:0/652929769 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d77a864a0 con 0x562d77b6cc50 2024-09-12T02:48:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.731+0000 7fe45d000640 1 --2- 172.21.15.18:0/652929769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b6cc50 0x562d77b76fd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe448010480 tx=0x7fe448010940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a73728b88fcae78b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.731+0000 7fe44e000640 1 -- 172.21.15.18:0/652929769 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe448005220 con 0x562d77b6cc50 2024-09-12T02:48:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.731+0000 7fe44e000640 1 -- 172.21.15.18:0/652929769 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe448004c80 con 0x562d77b6cc50 2024-09-12T02:48:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.731+0000 7fe44e000640 1 -- 172.21.15.18:0/652929769 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe448011b30 con 0x562d77b6cc50 2024-09-12T02:48:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.731+0000 7fe456000640 1 --2- 172.21.15.18:0/104580502 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe43c0a2c10 0x7fe43c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.732+0000 7fe456000640 1 -- 172.21.15.18:0/104580502 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7fe4400cf830 con 0x7fe458077040 2024-09-12T02:48:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.732+0000 7fe45da00640 1 --2- 172.21.15.18:0/104580502 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe43c0a2c10 0x7fe43c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.732+0000 7fe462672740 1 -- 172.21.15.18:0/652929769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b6cc50 msgr2=0x562d77b76fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.732+0000 7fe462672740 1 --2- 172.21.15.18:0/652929769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b6cc50 0x562d77b76fd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe448010480 tx=0x7fe448010940 comp rx=0 tx=0).stop 2024-09-12T02:48:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.732+0000 7fe462672740 1 -- 172.21.15.18:0/652929769 shutdown_connections 2024-09-12T02:48:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.732+0000 7fe462672740 1 --2- 172.21.15.18:0/652929769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b77510 0x562d77b79900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.732+0000 7fe462672740 1 --2- 172.21.15.18:0/652929769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b6cc50 0x562d77b76fd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.732+0000 7fe462672740 1 --2- 172.21.15.18:0/652929769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b6c330 0x562d77b6c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.732+0000 7fe462672740 1 -- 172.21.15.18:0/652929769 >> 172.21.15.18:0/652929769 conn(0x562d77b688c0 msgr2=0x562d77b68ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.732+0000 7fe462672740 1 -- 172.21.15.18:0/652929769 shutdown_connections 2024-09-12T02:48:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.732+0000 7fe45da00640 1 --2- 172.21.15.18:0/104580502 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe43c0a2c10 0x7fe43c0a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe450005e30 tx=0x7fe450005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.733+0000 7fe462672740 1 -- 172.21.15.18:0/652929769 wait complete. 2024-09-12T02:48:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.733+0000 7fe462672740 1 -- start start 2024-09-12T02:48:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.733+0000 7fe462672740 1 Processor -- start 2024-09-12T02:48:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.734+0000 7fe462672740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b6c330 0x562d77b745d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.734+0000 7fe462672740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b6cc50 0x562d77b74b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.734+0000 7fe462672740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b77510 0x562d77b75050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.734+0000 7fe462672740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d77b7a060 con 0x562d77b6c330 2024-09-12T02:48:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.734+0000 7fe462672740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562d77a5a920 con 0x562d77b77510 2024-09-12T02:48:00.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.734+0000 7fe462672740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562d77b7a1e0 con 0x562d77b6cc50 2024-09-12T02:48:00.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.734+0000 7fe462672740 10 client.0 _ll_register_callbacks cb 0x562d77a7e8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:00.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.734+0000 7fe45da00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b77510 0x562d77b75050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.734+0000 7fe45d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b6c330 0x562d77b745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.734+0000 7fe45da00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b77510 0x562d77b75050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:33194/0 (socket says 172.21.15.18:33194) 2024-09-12T02:48:00.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.734+0000 7fe45da00640 1 -- 172.21.15.18:0/2500347596 learned_addr learned my addr 172.21.15.18:0/2500347596 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:00.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.734+0000 7fe44fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b6cc50 0x562d77b74b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.734+0000 7fe45d000640 1 -- 172.21.15.18:0/2500347596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b6cc50 msgr2=0x562d77b74b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:00.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.734+0000 7fe45d000640 1 --2- 172.21.15.18:0/2500347596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b6cc50 0x562d77b74b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.734+0000 7fe45d000640 1 -- 172.21.15.18:0/2500347596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b77510 msgr2=0x562d77b75050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:00.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.734+0000 7fe45d000640 1 --2- 172.21.15.18:0/2500347596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b77510 0x562d77b75050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.735+0000 7fe45d000640 1 -- 172.21.15.18:0/2500347596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d778432b0 con 0x562d77b6c330 2024-09-12T02:48:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.735+0000 7fe45da00640 1 --2- 172.21.15.18:0/2500347596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b77510 0x562d77b75050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.735+0000 7fe44fe00640 1 --2- 172.21.15.18:0/2500347596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b6cc50 0x562d77b74b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.735+0000 7fe45d000640 1 --2- 172.21.15.18:0/2500347596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b6c330 0x562d77b745d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe448010450 tx=0x7fe4480048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d05d90101d172b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.735+0000 7fe446a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:48:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.735+0000 7fe446a00640 1 -- 172.21.15.18:0/2500347596 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44802a020 con 0x562d77b6c330 2024-09-12T02:48:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.735+0000 7fe462672740 1 -- 172.21.15.18:0/2500347596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe448004c80 con 0x562d77b6c330 2024-09-12T02:48:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.735+0000 7fe446a00640 1 -- 172.21.15.18:0/2500347596 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7fe448005410 con 0x562d77b6c330 2024-09-12T02:48:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.735+0000 7fe446a00640 1 -- 172.21.15.18:0/2500347596 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe448032050 con 0x562d77b6c330 2024-09-12T02:48:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.736+0000 7fe462672740 10 client.15006 fetch_fsmap learned FSMap version 29 2024-09-12T02:48:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.736+0000 7fe462672740 1 -- 172.21.15.18:0/2500347596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562d77b85e80 con 0x562d77b6c330 2024-09-12T02:48:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.736+0000 7fe446a00640 1 -- 172.21.15.18:0/2500347596 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe448004c80 con 0x562d77b6c330 2024-09-12T02:48:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.736+0000 7fe446a00640 1 -- 172.21.15.18:0/2500347596 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe448011a50 con 0x562d77b6c330 2024-09-12T02:48:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.736+0000 7fe462672740 10 client.15006 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:48:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.736+0000 7fe462672740 10 client.15006 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:48:00.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.736+0000 7fe462672740 20 client.15006 populate_metadata read hostname 'smithi018' 2024-09-12T02:48:00.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.736+0000 7fe462672740 1 --2- 172.21.15.18:0/2500347596 >> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] conn(0x562d77b88110 0x562d77b89580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.736+0000 7fe462672740 4 client.15006 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:00.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.736+0000 7fe462672740 1 -- 172.21.15.18:0/2500347596 --> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d77adf620 con 0x562d77b88110 2024-09-12T02:48:00.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.736+0000 7fe44fe00640 1 --2- 172.21.15.18:0/2500347596 >> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] conn(0x562d77b88110 0x562d77b89580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.737+0000 7fe44fe00640 1 --2- 172.21.15.18:0/2500347596 >> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] conn(0x562d77b88110 0x562d77b89580 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=484f30cd6cded66 server_cookie=51cf3644aeac17d0 in_seq=0 out_seq=0 2024-09-12T02:48:00.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.737+0000 7fe446a00640 10 client.15006 ms_handle_connect on v2:172.21.15.18:6840/823308007 2024-09-12T02:48:00.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.738+0000 7fe446a00640 1 -- 172.21.15.18:0/2500347596 <== mds.1 v2:172.21.15.18:6840/823308007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d77adf620 con 0x562d77b88110 2024-09-12T02:48:00.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.738+0000 7fe446a00640 10 client.15006 handle_command_reply: tid=0 2024-09-12T02:48:00.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.738+0000 7fe462672740 1 client.15006 shutdown 2024-09-12T02:48:00.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.738+0000 7fe462672740 1 -- 172.21.15.18:0/2500347596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b6c330 msgr2=0x562d77b745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:00.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.738+0000 7fe462672740 1 --2- 172.21.15.18:0/2500347596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b6c330 0x562d77b745d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe448010450 tx=0x7fe4480048f0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.738+0000 7fe462672740 1 -- 172.21.15.18:0/2500347596 shutdown_connections 2024-09-12T02:48:00.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.738+0000 7fe462672740 1 --2- 172.21.15.18:0/2500347596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b77510 0x562d77b75050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.738+0000 7fe462672740 1 --2- 172.21.15.18:0/2500347596 >> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] conn(0x562d77b88110 0x562d77b89580 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.738+0000 7fe462672740 1 --2- 172.21.15.18:0/2500347596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b6cc50 0x562d77b74b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.738+0000 7fe462672740 1 --2- 172.21.15.18:0/2500347596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b6c330 0x562d77b745d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.738+0000 7fe446a00640 0 client.15006 ms_handle_reset on v2:172.21.15.18:6840/823308007 2024-09-12T02:48:00.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.738+0000 7fe462672740 1 -- 172.21.15.18:0/2500347596 >> 172.21.15.18:0/2500347596 conn(0x562d77b688c0 msgr2=0x562d77b6e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:00.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.738+0000 7fe462672740 1 -- 172.21.15.18:0/2500347596 shutdown_connections 2024-09-12T02:48:00.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.738+0000 7fe462672740 1 -- 172.21.15.18:0/2500347596 wait complete. 2024-09-12T02:48:00.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.739+0000 7fe462672740 20 client.15006 trim_cache size 0 max 16384 2024-09-12T02:48:00.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.757+0000 7fe462672740 1 Processor -- start 2024-09-12T02:48:00.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.757+0000 7fe462672740 1 -- start start 2024-09-12T02:48:00.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.758+0000 7fe462672740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b6c330 0x562d77b6ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.758+0000 7fe462672740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b6cc50 0x562d77b6e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.758+0000 7fe462672740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b77510 0x562d77b74b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.758+0000 7fe462672740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d77b878c0 con 0x562d77b6cc50 2024-09-12T02:48:00.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.758+0000 7fe462672740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562d77b87f90 con 0x562d77b77510 2024-09-12T02:48:00.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.758+0000 7fe462672740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562d77b88660 con 0x562d77b6c330 2024-09-12T02:48:00.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.758+0000 7fe45da00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b77510 0x562d77b74b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.758+0000 7fe44fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b6cc50 0x562d77b6e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.758+0000 7fe45da00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b77510 0x562d77b74b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:33200/0 (socket says 172.21.15.18:33200) 2024-09-12T02:48:00.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.758+0000 7fe45da00640 1 -- 172.21.15.18:0/3309437543 learned_addr learned my addr 172.21.15.18:0/3309437543 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:00.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.758+0000 7fe45d000640 1 --2- 172.21.15.18:0/3309437543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b6c330 0x562d77b6ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.758+0000 7fe45da00640 1 -- 172.21.15.18:0/3309437543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b6c330 msgr2=0x562d77b6ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:00.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.758+0000 7fe45da00640 1 --2- 172.21.15.18:0/3309437543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b6c330 0x562d77b6ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.758+0000 7fe45da00640 1 -- 172.21.15.18:0/3309437543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b6cc50 msgr2=0x562d77b6e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:00.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.758+0000 7fe45da00640 1 --2- 172.21.15.18:0/3309437543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b6cc50 0x562d77b6e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.758+0000 7fe45da00640 1 -- 172.21.15.18:0/3309437543 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d77b72b20 con 0x562d77b77510 2024-09-12T02:48:00.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.759+0000 7fe44fe00640 1 --2- 172.21.15.18:0/3309437543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b6cc50 0x562d77b6e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:00.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.759+0000 7fe45da00640 1 --2- 172.21.15.18:0/3309437543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b77510 0x562d77b74b20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe45002aeb0 tx=0x7fe450041000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a04b948d0300192 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:00.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.759+0000 7fe44d600640 1 -- 172.21.15.18:0/3309437543 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe450031450 con 0x562d77b77510 2024-09-12T02:48:00.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.759+0000 7fe44d600640 1 -- 172.21.15.18:0/3309437543 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe450036050 con 0x562d77b77510 2024-09-12T02:48:00.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.759+0000 7fe44d600640 1 -- 172.21.15.18:0/3309437543 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45002f610 con 0x562d77b77510 2024-09-12T02:48:00.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.760+0000 7fe462672740 1 -- 172.21.15.18:0/3309437543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b77510 msgr2=0x562d77b74b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:00.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.760+0000 7fe462672740 1 --2- 172.21.15.18:0/3309437543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b77510 0x562d77b74b20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe45002aeb0 tx=0x7fe450041000 comp rx=0 tx=0).stop 2024-09-12T02:48:00.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.760+0000 7fe462672740 1 -- 172.21.15.18:0/3309437543 shutdown_connections 2024-09-12T02:48:00.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.760+0000 7fe462672740 1 --2- 172.21.15.18:0/3309437543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b77510 0x562d77b74b20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.760+0000 7fe462672740 1 --2- 172.21.15.18:0/3309437543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b6cc50 0x562d77b6e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.760+0000 7fe462672740 1 --2- 172.21.15.18:0/3309437543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b6c330 0x562d77b6ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.760+0000 7fe462672740 1 -- 172.21.15.18:0/3309437543 >> 172.21.15.18:0/3309437543 conn(0x562d77b688c0 msgr2=0x562d77b6ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:00.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.760+0000 7fe462672740 1 -- 172.21.15.18:0/3309437543 shutdown_connections 2024-09-12T02:48:00.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.760+0000 7fe462672740 1 -- 172.21.15.18:0/3309437543 wait complete. 2024-09-12T02:48:00.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.761+0000 7fe462672740 1 -- start start 2024-09-12T02:48:00.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.761+0000 7fe462672740 1 Processor -- start 2024-09-12T02:48:00.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.761+0000 7fe462672740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b6c330 0x562d77b91c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.761+0000 7fe462672740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b6cc50 0x562d77b710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.761+0000 7fe462672740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b77510 0x562d77b71630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.762+0000 7fe462672740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d77b89400 con 0x562d77b77510 2024-09-12T02:48:00.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.762+0000 7fe462672740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562d77b88d30 con 0x562d77b6c330 2024-09-12T02:48:00.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.762+0000 7fe462672740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562d77b89ad0 con 0x562d77b6cc50 2024-09-12T02:48:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.762+0000 7fe462672740 10 client.0 _ll_register_callbacks cb 0x7fe448005c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.762+0000 7fe45d000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b6c330 0x562d77b91c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.762+0000 7fe45d000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b6c330 0x562d77b91c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:33208/0 (socket says 172.21.15.18:33208) 2024-09-12T02:48:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.762+0000 7fe45da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b77510 0x562d77b71630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.762+0000 7fe45d000640 1 -- 172.21.15.18:0/4022599758 learned_addr learned my addr 172.21.15.18:0/4022599758 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.762+0000 7fe44fe00640 1 --2- 172.21.15.18:0/4022599758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b6cc50 0x562d77b710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.762+0000 7fe45d000640 1 -- 172.21.15.18:0/4022599758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b6cc50 msgr2=0x562d77b710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.762+0000 7fe45d000640 1 --2- 172.21.15.18:0/4022599758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b6cc50 0x562d77b710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.762+0000 7fe45d000640 1 -- 172.21.15.18:0/4022599758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b77510 msgr2=0x562d77b71630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.762+0000 7fe45d000640 1 --2- 172.21.15.18:0/4022599758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b77510 0x562d77b71630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.762+0000 7fe45d000640 1 -- 172.21.15.18:0/4022599758 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d77b71b70 con 0x562d77b6c330 2024-09-12T02:48:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.763+0000 7fe45d000640 1 --2- 172.21.15.18:0/4022599758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b6c330 0x562d77b91c50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe448010480 tx=0x7fe448011580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f94a10a6f5fb10d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.763+0000 7fe446a00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:48:00.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.763+0000 7fe446a00640 1 -- 172.21.15.18:0/4022599758 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44802a030 con 0x562d77b6c330 2024-09-12T02:48:00.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.763+0000 7fe446a00640 1 -- 172.21.15.18:0/4022599758 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7fe448005210 con 0x562d77b6c330 2024-09-12T02:48:00.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.763+0000 7fe462672740 1 -- 172.21.15.18:0/4022599758 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe450036050 con 0x562d77b6c330 2024-09-12T02:48:00.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.763+0000 7fe446a00640 1 -- 172.21.15.18:0/4022599758 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe448048050 con 0x562d77b6c330 2024-09-12T02:48:00.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.763+0000 7fe462672740 10 client.25025 fetch_fsmap learned FSMap version 29 2024-09-12T02:48:00.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.763+0000 7fe462672740 1 -- 172.21.15.18:0/4022599758 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562d77b903f0 con 0x562d77b6c330 2024-09-12T02:48:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.763+0000 7fe446a00640 1 -- 172.21.15.18:0/4022599758 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe450036050 con 0x562d77b6c330 2024-09-12T02:48:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.764+0000 7fe446a00640 1 -- 172.21.15.18:0/4022599758 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe44801b430 con 0x562d77b6c330 2024-09-12T02:48:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.764+0000 7fe462672740 10 client.25025 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:48:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.764+0000 7fe462672740 10 client.25025 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:48:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.764+0000 7fe462672740 20 client.25025 populate_metadata read hostname 'smithi018' 2024-09-12T02:48:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.764+0000 7fe462672740 1 --2- 172.21.15.18:0/4022599758 >> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] conn(0x562d77bf6ff0 0x562d77bf5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.764+0000 7fe462672740 4 client.25025 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:48:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.764+0000 7fe462672740 1 -- 172.21.15.18:0/4022599758 --> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] -- command(tid 0: {"prefix": "status"}) -- 0x562d77ad9b30 con 0x562d77bf6ff0 2024-09-12T02:48:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.764+0000 7fe44fe00640 1 --2- 172.21.15.18:0/4022599758 >> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] conn(0x562d77bf6ff0 0x562d77bf5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.765+0000 7fe44fe00640 1 --2- 172.21.15.18:0/4022599758 >> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] conn(0x562d77bf6ff0 0x562d77bf5d00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=99e03789373dd3a1 server_cookie=b52ad301485ed24 in_seq=0 out_seq=0 2024-09-12T02:48:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.765+0000 7fe446a00640 10 client.25025 ms_handle_connect on v2:172.21.15.18:6840/823308007 2024-09-12T02:48:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.765+0000 7fe446a00640 1 -- 172.21.15.18:0/4022599758 <== mds.1 v2:172.21.15.18:6840/823308007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562d77ad9b30 con 0x562d77bf6ff0 2024-09-12T02:48:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.765+0000 7fe446a00640 10 client.25025 handle_command_reply: tid=0 2024-09-12T02:48:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.765+0000 7fe462672740 1 client.25025 shutdown 2024-09-12T02:48:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.765+0000 7fe462672740 1 -- 172.21.15.18:0/4022599758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b6c330 msgr2=0x562d77b91c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.765+0000 7fe462672740 1 --2- 172.21.15.18:0/4022599758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b6c330 0x562d77b91c50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe448010480 tx=0x7fe448011580 comp rx=0 tx=0).stop 2024-09-12T02:48:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.765+0000 7fe462672740 1 -- 172.21.15.18:0/4022599758 shutdown_connections 2024-09-12T02:48:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.765+0000 7fe462672740 1 --2- 172.21.15.18:0/4022599758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d77b77510 0x562d77b71630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.765+0000 7fe462672740 1 --2- 172.21.15.18:0/4022599758 >> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] conn(0x562d77bf6ff0 0x562d77bf5d00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.765+0000 7fe462672740 1 --2- 172.21.15.18:0/4022599758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d77b6cc50 0x562d77b710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.765+0000 7fe462672740 1 --2- 172.21.15.18:0/4022599758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562d77b6c330 0x562d77b91c50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.765+0000 7fe446a00640 0 client.25025 ms_handle_reset on v2:172.21.15.18:6840/823308007 2024-09-12T02:48:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.765+0000 7fe462672740 1 -- 172.21.15.18:0/4022599758 >> 172.21.15.18:0/4022599758 conn(0x562d77b688c0 msgr2=0x562d77b67a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.766+0000 7fe462672740 1 -- 172.21.15.18:0/4022599758 shutdown_connections 2024-09-12T02:48:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.766+0000 7fe462672740 1 -- 172.21.15.18:0/4022599758 wait complete. 2024-09-12T02:48:00.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.766+0000 7fe462672740 20 client.25025 trim_cache size 0 max 16384 2024-09-12T02:48:00.782 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T02:48:00.782 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "c7666100-70af-11ef-bcea-c7b262605968", 2024-09-12T02:48:00.782 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 1, 2024-09-12T02:48:00.782 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24526, 2024-09-12T02:48:00.782 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-12T02:48:00.782 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-12T02:48:00.782 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-12T02:48:00.782 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 90.140994386000003, 2024-09-12T02:48:00.783 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 29, 2024-09-12T02:48:00.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 98, 2024-09-12T02:48:00.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 96, 2024-09-12T02:48:00.783 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 161.006095437 2024-09-12T02:48:00.783 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T02:48:00.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.766+0000 7fe45fa00640 1 -- 172.21.15.18:0/104580502 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe43c0a2c10 msgr2=0x7fe43c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:00.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.766+0000 7fe45fa00640 1 --2- 172.21.15.18:0/104580502 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe43c0a2c10 0x7fe43c0a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe450005e30 tx=0x7fe450005d80 comp rx=0 tx=0).stop 2024-09-12T02:48:00.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.766+0000 7fe45fa00640 1 -- 172.21.15.18:0/104580502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe458077040 msgr2=0x7fe4581a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:00.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.766+0000 7fe45fa00640 1 --2- 172.21.15.18:0/104580502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe458077040 0x7fe4581a4bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe44000e9f0 tx=0x7fe44000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.767+0000 7fe45fa00640 1 -- 172.21.15.18:0/104580502 shutdown_connections 2024-09-12T02:48:00.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.767+0000 7fe45fa00640 1 --2- 172.21.15.18:0/104580502 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fe43c0a2c10 0x7fe43c0a50d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.767+0000 7fe45fa00640 1 --2- 172.21.15.18:0/104580502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe458112a50 0x7fe45819e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.767+0000 7fe45fa00640 1 --2- 172.21.15.18:0/104580502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe458077040 0x7fe4581a4bf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.767+0000 7fe45fa00640 1 --2- 172.21.15.18:0/104580502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe458076720 0x7fe4581a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:00.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.767+0000 7fe45fa00640 1 -- 172.21.15.18:0/104580502 >> 172.21.15.18:0/104580502 conn(0x7fe4580ffa50 msgr2=0x7fe458101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:00.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.767+0000 7fe45fa00640 1 -- 172.21.15.18:0/104580502 shutdown_connections 2024-09-12T02:48:00.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:00.767+0000 7fe45fa00640 1 -- 172.21.15.18:0/104580502 wait complete. 2024-09-12T02:48:00.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:00 smithi018 ceph-mon[30616]: pgmap v382: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:48:00.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:00 smithi176 ceph-mon[35713]: pgmap v382: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:48:01.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:00 smithi062 ceph-mon[35527]: pgmap v382: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:48:01.686 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:48:02.064 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.650+0000 7f3312a00640 1 -- 172.21.15.18:0/1035706315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f330c103ff0 msgr2=0x7f330c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.650+0000 7f3312a00640 1 --2- 172.21.15.18:0/1035706315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f330c103ff0 0x7f330c1043d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009900 tx=0x7f32fc02a410 comp rx=0 tx=0).stop 2024-09-12T02:48:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.650+0000 7f3312a00640 1 -- 172.21.15.18:0/1035706315 shutdown_connections 2024-09-12T02:48:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.650+0000 7f3312a00640 1 --2- 172.21.15.18:0/1035706315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f330c109120 0x7f330c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.650+0000 7f3312a00640 1 --2- 172.21.15.18:0/1035706315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f330c1049a0 0x7f330c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.650+0000 7f3312a00640 1 --2- 172.21.15.18:0/1035706315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f330c103ff0 0x7f330c1043d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.650+0000 7f3312a00640 1 -- 172.21.15.18:0/1035706315 >> 172.21.15.18:0/1035706315 conn(0x7f330c0ffa90 msgr2=0x7f330c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.650+0000 7f3312a00640 1 -- 172.21.15.18:0/1035706315 shutdown_connections 2024-09-12T02:48:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.650+0000 7f3312a00640 1 -- 172.21.15.18:0/1035706315 wait complete. 2024-09-12T02:48:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.651+0000 7f3312a00640 1 Processor -- start 2024-09-12T02:48:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.651+0000 7f3312a00640 1 -- start start 2024-09-12T02:48:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.652+0000 7f3312a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f330c103ff0 0x7f330c19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.652+0000 7f3312a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f330c1049a0 0x7f330c19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.652+0000 7f3312a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f330c109120 0x7f330c19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.652+0000 7f3312a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f330c114140 con 0x7f330c109120 2024-09-12T02:48:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.652+0000 7f3312a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f330c113fc0 con 0x7f330c103ff0 2024-09-12T02:48:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.652+0000 7f3312a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f330c1142c0 con 0x7f330c1049a0 2024-09-12T02:48:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.652+0000 7f3310a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f330c109120 0x7f330c19ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.652+0000 7f330be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f330c103ff0 0x7f330c19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.652+0000 7f330b400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f330c1049a0 0x7f330c19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.652+0000 7f330be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f330c103ff0 0x7f330c19a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:33232/0 (socket says 172.21.15.18:33232) 2024-09-12T02:48:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.652+0000 7f330be00640 1 -- 172.21.15.18:0/1145354032 learned_addr learned my addr 172.21.15.18:0/1145354032 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.652+0000 7f330b400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f330c1049a0 0x7f330c19ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:56026/0 (socket says 172.21.15.18:56026) 2024-09-12T02:48:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.653+0000 7f330be00640 1 -- 172.21.15.18:0/1145354032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f330c1049a0 msgr2=0x7f330c19ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.653+0000 7f330be00640 1 --2- 172.21.15.18:0/1145354032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f330c1049a0 0x7f330c19ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.653+0000 7f330be00640 1 -- 172.21.15.18:0/1145354032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f330c109120 msgr2=0x7f330c19ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.653+0000 7f330be00640 1 --2- 172.21.15.18:0/1145354032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f330c109120 0x7f330c19ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.653+0000 7f330be00640 1 -- 172.21.15.18:0/1145354032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c19f670 con 0x7f330c103ff0 2024-09-12T02:48:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.653+0000 7f330b400640 1 --2- 172.21.15.18:0/1145354032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f330c1049a0 0x7f330c19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.653+0000 7f3310a00640 1 --2- 172.21.15.18:0/1145354032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f330c109120 0x7f330c19ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.653+0000 7f330be00640 1 --2- 172.21.15.18:0/1145354032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f330c103ff0 0x7f330c19a6c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f32fc006010 tx=0x7f32fc004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.653+0000 7f3308c00640 1 -- 172.21.15.18:0/1145354032 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc03f030 con 0x7f330c103ff0 2024-09-12T02:48:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.653+0000 7f3312a00640 1 -- 172.21.15.18:0/1145354032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f330c19f900 con 0x7f330c103ff0 2024-09-12T02:48:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.654+0000 7f3308c00640 1 -- 172.21.15.18:0/1145354032 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32fc004440 con 0x7f330c103ff0 2024-09-12T02:48:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.654+0000 7f3308c00640 1 -- 172.21.15.18:0/1145354032 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc035070 con 0x7f330c103ff0 2024-09-12T02:48:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.654+0000 7f3312a00640 1 -- 172.21.15.18:0/1145354032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f330c1a7240 con 0x7f330c103ff0 2024-09-12T02:48:02.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.656+0000 7f3308c00640 1 -- 172.21.15.18:0/1145354032 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f32fc042030 con 0x7f330c103ff0 2024-09-12T02:48:02.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.657+0000 7f33154be740 1 Processor -- start 2024-09-12T02:48:02.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.657+0000 7f33154be740 1 -- start start 2024-09-12T02:48:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.657+0000 7f33154be740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8330 0x56519d8d8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.657+0000 7f33154be740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8c50 0x56519d8e2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.657+0000 7f33154be740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8e3510 0x56519d8e5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.657+0000 7f33154be740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56519d83e0b0 con 0x56519d8d8c50 2024-09-12T02:48:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.657+0000 7f33154be740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56519d7e5ab0 con 0x56519d8d8330 2024-09-12T02:48:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.657+0000 7f33154be740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56519d83a070 con 0x56519d8e3510 2024-09-12T02:48:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.657+0000 7f330be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8c50 0x56519d8e2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.657+0000 7f3310a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8330 0x56519d8d8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.658+0000 7f3310a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8330 0x56519d8d8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:33240/0 (socket says 172.21.15.18:33240) 2024-09-12T02:48:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.658+0000 7f3310a00640 1 -- 172.21.15.18:0/1549793559 learned_addr learned my addr 172.21.15.18:0/1549793559 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.658+0000 7f330b400640 1 --2- 172.21.15.18:0/1549793559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8e3510 0x56519d8e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.658+0000 7f3310a00640 1 -- 172.21.15.18:0/1549793559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8e3510 msgr2=0x56519d8e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.658+0000 7f3310a00640 1 --2- 172.21.15.18:0/1549793559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8e3510 0x56519d8e5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.658+0000 7f3310a00640 1 -- 172.21.15.18:0/1549793559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8c50 msgr2=0x56519d8e2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.658+0000 7f3310a00640 1 --2- 172.21.15.18:0/1549793559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8c50 0x56519d8e2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.658+0000 7f3310a00640 1 -- 172.21.15.18:0/1549793559 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519d7f24a0 con 0x56519d8d8330 2024-09-12T02:48:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.658+0000 7f330b400640 1 --2- 172.21.15.18:0/1549793559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8e3510 0x56519d8e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.658+0000 7f3310a00640 1 --2- 172.21.15.18:0/1549793559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8330 0x56519d8d8710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3304011790 tx=0x7f3304011c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18f373394a56165e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.658+0000 7f3308c00640 1 --2- 172.21.15.18:0/1145354032 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f32f00a2c10 0x7f32f00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.659+0000 7f3301200640 1 -- 172.21.15.18:0/1549793559 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3304004d20 con 0x56519d8d8330 2024-09-12T02:48:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.659+0000 7f3301200640 1 -- 172.21.15.18:0/1549793559 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f330400f9a0 con 0x56519d8d8330 2024-09-12T02:48:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.659+0000 7f3301200640 1 -- 172.21.15.18:0/1549793559 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3304004470 con 0x56519d8d8330 2024-09-12T02:48:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.659+0000 7f330be00640 1 --2- 172.21.15.18:0/1145354032 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f32f00a2c10 0x7f32f00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.659+0000 7f3308c00640 1 -- 172.21.15.18:0/1145354032 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f32fc0ef930 con 0x7f330c103ff0 2024-09-12T02:48:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.659+0000 7f33154be740 1 -- 172.21.15.18:0/1549793559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8330 msgr2=0x56519d8d8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.659+0000 7f33154be740 1 --2- 172.21.15.18:0/1549793559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8330 0x56519d8d8710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3304011790 tx=0x7f3304011c50 comp rx=0 tx=0).stop 2024-09-12T02:48:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.659+0000 7f330be00640 1 --2- 172.21.15.18:0/1145354032 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f32f00a2c10 0x7f32f00a50d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009230 tx=0x7f32fc0f5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.660+0000 7f33154be740 1 -- 172.21.15.18:0/1549793559 shutdown_connections 2024-09-12T02:48:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.660+0000 7f33154be740 1 --2- 172.21.15.18:0/1549793559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8e3510 0x56519d8e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.660+0000 7f33154be740 1 --2- 172.21.15.18:0/1549793559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8c50 0x56519d8e2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.660+0000 7f33154be740 1 --2- 172.21.15.18:0/1549793559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8330 0x56519d8d8710 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.660+0000 7f33154be740 1 -- 172.21.15.18:0/1549793559 >> 172.21.15.18:0/1549793559 conn(0x56519d8d48c0 msgr2=0x56519d8d4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.660+0000 7f33154be740 1 -- 172.21.15.18:0/1549793559 shutdown_connections 2024-09-12T02:48:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.660+0000 7f33154be740 1 -- 172.21.15.18:0/1549793559 wait complete. 2024-09-12T02:48:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.660+0000 7f33154be740 1 -- start start 2024-09-12T02:48:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.660+0000 7f33154be740 1 Processor -- start 2024-09-12T02:48:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.661+0000 7f33154be740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8d8330 0x56519d8e0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.661+0000 7f33154be740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8c50 0x56519d8e0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.661+0000 7f33154be740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8e3510 0x56519d8e1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.661+0000 7f33154be740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56519d8e6060 con 0x56519d8e3510 2024-09-12T02:48:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.661+0000 7f33154be740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56519d7c6920 con 0x56519d8d8c50 2024-09-12T02:48:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.661+0000 7f33154be740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56519d8e61e0 con 0x56519d8d8330 2024-09-12T02:48:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.661+0000 7f33154be740 10 client.0 _ll_register_callbacks cb 0x56519d7ea8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.661+0000 7f3310a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8d8330 0x56519d8e0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.661+0000 7f330b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8c50 0x56519d8e0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.661+0000 7f3310a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8d8330 0x56519d8e0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:56042/0 (socket says 172.21.15.18:56042) 2024-09-12T02:48:02.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.661+0000 7f3310a00640 1 -- 172.21.15.18:0/321912976 learned_addr learned my addr 172.21.15.18:0/321912976 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:02.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.661+0000 7f3310a00640 1 --2- 172.21.15.18:0/321912976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8e3510 0x56519d8e1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.662+0000 7f330b400640 1 -- 172.21.15.18:0/321912976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8d8330 msgr2=0x56519d8e0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:02.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.662+0000 7f330b400640 1 --2- 172.21.15.18:0/321912976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8d8330 0x56519d8e0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.662+0000 7f330b400640 1 -- 172.21.15.18:0/321912976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8e3510 msgr2=0x56519d8e1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:02.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.662+0000 7f330b400640 1 --2- 172.21.15.18:0/321912976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8e3510 0x56519d8e1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.662+0000 7f330b400640 1 -- 172.21.15.18:0/321912976 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56519d5af2b0 con 0x56519d8d8c50 2024-09-12T02:48:02.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.662+0000 7f330b400640 1 --2- 172.21.15.18:0/321912976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8c50 0x56519d8e0ad0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f330c100020 tx=0x7f32f8012de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fdf413874e9262d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:02.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.662+0000 7f32f5600640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:48:02.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.662+0000 7f32f5600640 1 -- 172.21.15.18:0/321912976 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f8004050 con 0x56519d8d8c50 2024-09-12T02:48:02.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.662+0000 7f33154be740 1 -- 172.21.15.18:0/321912976 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f330400f9a0 con 0x56519d8d8c50 2024-09-12T02:48:02.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.662+0000 7f32f5600640 1 -- 172.21.15.18:0/321912976 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f32f80041f0 con 0x56519d8d8c50 2024-09-12T02:48:02.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.663+0000 7f32f5600640 1 -- 172.21.15.18:0/321912976 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f32f8024050 con 0x56519d8d8c50 2024-09-12T02:48:02.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.663+0000 7f33154be740 10 client.25037 fetch_fsmap learned FSMap version 29 2024-09-12T02:48:02.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.663+0000 7f33154be740 1 -- 172.21.15.18:0/321912976 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56519d8f1e30 con 0x56519d8d8c50 2024-09-12T02:48:02.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.663+0000 7f32f5600640 1 -- 172.21.15.18:0/321912976 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f330400f9a0 con 0x56519d8d8c50 2024-09-12T02:48:02.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.663+0000 7f32f5600640 1 -- 172.21.15.18:0/321912976 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f32f8003a40 con 0x56519d8d8c50 2024-09-12T02:48:02.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.663+0000 7f33154be740 10 client.25037 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:48:02.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.663+0000 7f33154be740 10 client.25037 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:48:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.663+0000 7f33154be740 20 client.25037 populate_metadata read hostname 'smithi018' 2024-09-12T02:48:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.663+0000 7f33154be740 1 --2- 172.21.15.18:0/321912976 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56519d8f4430 0x56519d8f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.663+0000 7f33154be740 4 client.25037 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.663+0000 7f33154be740 1 -- 172.21.15.18:0/321912976 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56519d84b620 con 0x56519d8f4430 2024-09-12T02:48:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.664+0000 7f3310a00640 1 --2- 172.21.15.18:0/321912976 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56519d8f4430 0x56519d8f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.664+0000 7f3310a00640 1 --2- 172.21.15.18:0/321912976 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56519d8f4430 0x56519d8f58a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f80ad79bbf7af7a9 server_cookie=6c1ec22afe41d894 in_seq=0 out_seq=0 2024-09-12T02:48:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.664+0000 7f32f5600640 10 client.25037 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:48:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.665+0000 7f32f5600640 1 -- 172.21.15.18:0/321912976 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56519d84b620 con 0x56519d8f4430 2024-09-12T02:48:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.665+0000 7f32f5600640 10 client.25037 handle_command_reply: tid=0 2024-09-12T02:48:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.665+0000 7f33154be740 1 client.25037 shutdown 2024-09-12T02:48:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.665+0000 7f33154be740 1 -- 172.21.15.18:0/321912976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8c50 msgr2=0x56519d8e0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.665+0000 7f33154be740 1 --2- 172.21.15.18:0/321912976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8c50 0x56519d8e0ad0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f330c100020 tx=0x7f32f8012de0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.665+0000 7f33154be740 1 -- 172.21.15.18:0/321912976 shutdown_connections 2024-09-12T02:48:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.665+0000 7f33154be740 1 --2- 172.21.15.18:0/321912976 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56519d8f4430 0x56519d8f58a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.665+0000 7f33154be740 1 --2- 172.21.15.18:0/321912976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8e3510 0x56519d8e1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.665+0000 7f33154be740 1 --2- 172.21.15.18:0/321912976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8c50 0x56519d8e0ad0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.665+0000 7f32f5600640 0 client.25037 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:48:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.665+0000 7f33154be740 1 --2- 172.21.15.18:0/321912976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8d8330 0x56519d8e0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.665+0000 7f33154be740 1 -- 172.21.15.18:0/321912976 >> 172.21.15.18:0/321912976 conn(0x56519d8d48c0 msgr2=0x56519d8da5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.665+0000 7f33154be740 1 -- 172.21.15.18:0/321912976 shutdown_connections 2024-09-12T02:48:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.666+0000 7f33154be740 1 -- 172.21.15.18:0/321912976 wait complete. 2024-09-12T02:48:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.666+0000 7f33154be740 20 client.25037 trim_cache size 0 max 16384 2024-09-12T02:48:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.684+0000 7f33154be740 1 Processor -- start 2024-09-12T02:48:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.685+0000 7f33154be740 1 -- start start 2024-09-12T02:48:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.685+0000 7f33154be740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8330 0x56519d8deea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.685+0000 7f33154be740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8d8c50 0x56519d8df3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.685+0000 7f33154be740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8e3510 0x56519d8dd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.685+0000 7f33154be740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56519d8f3be0 con 0x56519d8d8330 2024-09-12T02:48:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.685+0000 7f33154be740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56519d8f42b0 con 0x56519d8e3510 2024-09-12T02:48:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.685+0000 7f33154be740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56519d8f4980 con 0x56519d8d8c50 2024-09-12T02:48:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.685+0000 7f3310a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8330 0x56519d8deea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.685+0000 7f3310a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8330 0x56519d8deea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58294/0 (socket says 172.21.15.18:58294) 2024-09-12T02:48:02.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.685+0000 7f3310a00640 1 -- 172.21.15.18:0/796217128 learned_addr learned my addr 172.21.15.18:0/796217128 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:02.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.685+0000 7f330b400640 1 --2- 172.21.15.18:0/796217128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8d8c50 0x56519d8df3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.686+0000 7f3310a00640 1 --2- 172.21.15.18:0/796217128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8e3510 0x56519d8dd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.686+0000 7f3310a00640 1 -- 172.21.15.18:0/796217128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8d8c50 msgr2=0x56519d8df3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:02.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.686+0000 7f3310a00640 1 --2- 172.21.15.18:0/796217128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8d8c50 0x56519d8df3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.686+0000 7f3310a00640 1 -- 172.21.15.18:0/796217128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8e3510 msgr2=0x56519d8dd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:02.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.686+0000 7f3310a00640 1 --2- 172.21.15.18:0/796217128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8e3510 0x56519d8dd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.686+0000 7f3310a00640 1 -- 172.21.15.18:0/796217128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519d8deb20 con 0x56519d8d8330 2024-09-12T02:48:02.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.686+0000 7f3310a00640 1 --2- 172.21.15.18:0/796217128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8330 0x56519d8deea0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f330400f890 tx=0x7f3304009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b230a4ca66660601 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:02.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.686+0000 7f32f7e00640 1 -- 172.21.15.18:0/796217128 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330401e040 con 0x56519d8d8330 2024-09-12T02:48:02.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.686+0000 7f32f7e00640 1 -- 172.21.15.18:0/796217128 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3304003c30 con 0x56519d8d8330 2024-09-12T02:48:02.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.686+0000 7f32f7e00640 1 -- 172.21.15.18:0/796217128 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3304028660 con 0x56519d8d8330 2024-09-12T02:48:02.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.687+0000 7f33154be740 1 -- 172.21.15.18:0/796217128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8330 msgr2=0x56519d8deea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.687+0000 7f33154be740 1 --2- 172.21.15.18:0/796217128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8330 0x56519d8deea0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f330400f890 tx=0x7f3304009500 comp rx=0 tx=0).stop 2024-09-12T02:48:02.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.687+0000 7f33154be740 1 -- 172.21.15.18:0/796217128 shutdown_connections 2024-09-12T02:48:02.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.687+0000 7f33154be740 1 --2- 172.21.15.18:0/796217128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8e3510 0x56519d8dd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.687+0000 7f33154be740 1 --2- 172.21.15.18:0/796217128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8d8c50 0x56519d8df3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.687+0000 7f33154be740 1 --2- 172.21.15.18:0/796217128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8330 0x56519d8deea0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.687+0000 7f33154be740 1 -- 172.21.15.18:0/796217128 >> 172.21.15.18:0/796217128 conn(0x56519d8d48c0 msgr2=0x56519d8db8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.687+0000 7f33154be740 1 -- 172.21.15.18:0/796217128 shutdown_connections 2024-09-12T02:48:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.687+0000 7f33154be740 1 -- 172.21.15.18:0/796217128 wait complete. 2024-09-12T02:48:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.688+0000 7f33154be740 1 -- start start 2024-09-12T02:48:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.688+0000 7f33154be740 1 Processor -- start 2024-09-12T02:48:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.688+0000 7f33154be740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8330 0x56519d8fdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.688+0000 7f33154be740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8c50 0x56519d8fe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.688+0000 7f33154be740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8e3510 0x56519d8f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.688+0000 7f33154be740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56519d8f5720 con 0x56519d8d8c50 2024-09-12T02:48:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.688+0000 7f33154be740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56519d8f5050 con 0x56519d8d8330 2024-09-12T02:48:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.688+0000 7f33154be740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56519d8f5df0 con 0x56519d8e3510 2024-09-12T02:48:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.688+0000 7f33154be740 10 client.0 _ll_register_callbacks cb 0x7f32f8012590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.688+0000 7f330b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8c50 0x56519d8fe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.689+0000 7f330b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8c50 0x56519d8fe0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58300/0 (socket says 172.21.15.18:58300) 2024-09-12T02:48:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.689+0000 7f330b400640 1 -- 172.21.15.18:0/2637078727 learned_addr learned my addr 172.21.15.18:0/2637078727 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.689+0000 7f3310a00640 1 --2- 172.21.15.18:0/2637078727 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8330 0x56519d8fdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.689+0000 7f3310a00640 1 --2- 172.21.15.18:0/2637078727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8e3510 0x56519d8f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.689+0000 7f330b400640 1 -- 172.21.15.18:0/2637078727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8e3510 msgr2=0x56519d8f8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.689+0000 7f330b400640 1 --2- 172.21.15.18:0/2637078727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8e3510 0x56519d8f8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.689+0000 7f330b400640 1 -- 172.21.15.18:0/2637078727 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8330 msgr2=0x56519d8fdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:02.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.689+0000 7f330b400640 1 --2- 172.21.15.18:0/2637078727 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8330 0x56519d8fdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.689+0000 7f330b400640 1 -- 172.21.15.18:0/2637078727 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56519d8fe7f0 con 0x56519d8d8c50 2024-09-12T02:48:02.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.689+0000 7f3310a00640 1 --2- 172.21.15.18:0/2637078727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8e3510 0x56519d8f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:02.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.689+0000 7f330b400640 1 --2- 172.21.15.18:0/2637078727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8c50 0x56519d8fe0b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f32f8010480 tx=0x7f32f8012520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6debc027697e8ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:02.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.689+0000 7f32f5600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:48:02.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.690+0000 7f32f5600640 1 -- 172.21.15.18:0/2637078727 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f8005c50 con 0x56519d8d8c50 2024-09-12T02:48:02.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.690+0000 7f32f5600640 1 -- 172.21.15.18:0/2637078727 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f32f80050c0 con 0x56519d8d8c50 2024-09-12T02:48:02.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.690+0000 7f33154be740 1 -- 172.21.15.18:0/2637078727 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3304003c30 con 0x56519d8d8c50 2024-09-12T02:48:02.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.690+0000 7f32f5600640 1 -- 172.21.15.18:0/2637078727 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f32f803a050 con 0x56519d8d8c50 2024-09-12T02:48:02.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.690+0000 7f33154be740 10 client.15030 fetch_fsmap learned FSMap version 29 2024-09-12T02:48:02.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.690+0000 7f33154be740 1 -- 172.21.15.18:0/2637078727 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56519d95f1a0 con 0x56519d8d8c50 2024-09-12T02:48:02.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.690+0000 7f32f5600640 1 -- 172.21.15.18:0/2637078727 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3304003c30 con 0x56519d8d8c50 2024-09-12T02:48:02.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.690+0000 7f32f5600640 1 -- 172.21.15.18:0/2637078727 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f32f8010500 con 0x56519d8d8c50 2024-09-12T02:48:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.690+0000 7f33154be740 10 client.15030 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:48:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.690+0000 7f33154be740 10 client.15030 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:48:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.691+0000 7f33154be740 20 client.15030 populate_metadata read hostname 'smithi018' 2024-09-12T02:48:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.691+0000 7f33154be740 1 --2- 172.21.15.18:0/2637078727 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56519d963d50 0x56519d962a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.691+0000 7f33154be740 4 client.15030 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:48:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.691+0000 7f33154be740 1 -- 172.21.15.18:0/2637078727 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "status"}) -- 0x56519d845b30 con 0x56519d963d50 2024-09-12T02:48:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.691+0000 7f3310a00640 1 --2- 172.21.15.18:0/2637078727 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56519d963d50 0x56519d962a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:02.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.691+0000 7f3310a00640 1 --2- 172.21.15.18:0/2637078727 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56519d963d50 0x56519d962a60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c33c938e6f11687 server_cookie=2aa2b6591658efc2 in_seq=0 out_seq=0 2024-09-12T02:48:02.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.691+0000 7f32f5600640 10 client.15030 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:48:02.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.692+0000 7f32f5600640 1 -- 172.21.15.18:0/2637078727 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56519d845b30 con 0x56519d963d50 2024-09-12T02:48:02.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.692+0000 7f32f5600640 10 client.15030 handle_command_reply: tid=0 2024-09-12T02:48:02.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.692+0000 7f33154be740 1 client.15030 shutdown 2024-09-12T02:48:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.692+0000 7f33154be740 1 -- 172.21.15.18:0/2637078727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8c50 msgr2=0x56519d8fe0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.692+0000 7f33154be740 1 --2- 172.21.15.18:0/2637078727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8c50 0x56519d8fe0b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f32f8010480 tx=0x7f32f8012520 comp rx=0 tx=0).stop 2024-09-12T02:48:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.692+0000 7f33154be740 1 -- 172.21.15.18:0/2637078727 shutdown_connections 2024-09-12T02:48:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.692+0000 7f33154be740 1 --2- 172.21.15.18:0/2637078727 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56519d963d50 0x56519d962a60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.692+0000 7f33154be740 1 --2- 172.21.15.18:0/2637078727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519d8e3510 0x56519d8f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.692+0000 7f33154be740 1 --2- 172.21.15.18:0/2637078727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56519d8d8c50 0x56519d8fe0b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.692+0000 7f33154be740 1 --2- 172.21.15.18:0/2637078727 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56519d8d8330 0x56519d8fdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.692+0000 7f33154be740 1 -- 172.21.15.18:0/2637078727 >> 172.21.15.18:0/2637078727 conn(0x56519d8d48c0 msgr2=0x56519d8dee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.692+0000 7f32f5600640 0 client.15030 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:48:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.692+0000 7f33154be740 1 -- 172.21.15.18:0/2637078727 shutdown_connections 2024-09-12T02:48:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.692+0000 7f33154be740 1 -- 172.21.15.18:0/2637078727 wait complete. 2024-09-12T02:48:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.692+0000 7f33154be740 20 client.15030 trim_cache size 0 max 16384 2024-09-12T02:48:02.698 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T02:48:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "c7666100-70af-11ef-bcea-c7b262605968", 2024-09-12T02:48:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-12T02:48:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24527, 2024-09-12T02:48:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-12T02:48:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-12T02:48:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-12T02:48:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 145.26732017200001, 2024-09-12T02:48:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 29, 2024-09-12T02:48:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 98, 2024-09-12T02:48:02.699 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 96, 2024-09-12T02:48:02.699 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 160.274430798 2024-09-12T02:48:02.699 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T02:48:02.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.693+0000 7f3312a00640 1 -- 172.21.15.18:0/1145354032 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f32f00a2c10 msgr2=0x7f32f00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.693+0000 7f3312a00640 1 --2- 172.21.15.18:0/1145354032 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f32f00a2c10 0x7f32f00a50d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009230 tx=0x7f32fc0f5530 comp rx=0 tx=0).stop 2024-09-12T02:48:02.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.693+0000 7f3312a00640 1 -- 172.21.15.18:0/1145354032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f330c103ff0 msgr2=0x7f330c19a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:02.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.693+0000 7f3312a00640 1 --2- 172.21.15.18:0/1145354032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f330c103ff0 0x7f330c19a6c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f32fc006010 tx=0x7f32fc004040 comp rx=0 tx=0).stop 2024-09-12T02:48:02.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.693+0000 7f3312a00640 1 -- 172.21.15.18:0/1145354032 shutdown_connections 2024-09-12T02:48:02.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.693+0000 7f3312a00640 1 --2- 172.21.15.18:0/1145354032 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f32f00a2c10 0x7f32f00a50d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.693+0000 7f3312a00640 1 --2- 172.21.15.18:0/1145354032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f330c109120 0x7f330c19ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.693+0000 7f3312a00640 1 --2- 172.21.15.18:0/1145354032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f330c1049a0 0x7f330c19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.693+0000 7f3312a00640 1 --2- 172.21.15.18:0/1145354032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f330c103ff0 0x7f330c19a6c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:02.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.693+0000 7f3312a00640 1 -- 172.21.15.18:0/1145354032 >> 172.21.15.18:0/1145354032 conn(0x7f330c0ffa90 msgr2=0x7f330c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:02.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.693+0000 7f3312a00640 1 -- 172.21.15.18:0/1145354032 shutdown_connections 2024-09-12T02:48:02.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:02.693+0000 7f3312a00640 1 -- 172.21.15.18:0/1145354032 wait complete. 2024-09-12T02:48:02.701 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:02 smithi018 ceph-mon[30616]: pgmap v383: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:48:02.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:02 smithi176 ceph-mon[35713]: pgmap v383: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:48:03.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:02 smithi062 ceph-mon[35527]: pgmap v383: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:48:03.490 INFO:tasks.cephadm:Setup complete, yielding 2024-09-12T02:48:03.491 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T02:48:03.502 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-12T02:48:03.503 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-12T02:48:03.882 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:04.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.469+0000 7f8cff400640 1 -- 172.21.15.18:0/2554687093 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf40319b0 con 0x7f8d00076ba0 2024-09-12T02:48:04.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.470+0000 7f8d07c00640 1 -- 172.21.15.18:0/2554687093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d00076ba0 msgr2=0x7f8d00076fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:04.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.470+0000 7f8d07c00640 1 --2- 172.21.15.18:0/2554687093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d00076ba0 0x7f8d00076fa0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009900 tx=0x7f8cf402a410 comp rx=0 tx=0).stop 2024-09-12T02:48:04.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.470+0000 7f8d07c00640 1 -- 172.21.15.18:0/2554687093 shutdown_connections 2024-09-12T02:48:04.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.470+0000 7f8d07c00640 1 --2- 172.21.15.18:0/2554687093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d00078790 0x7f8d00079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.470+0000 7f8d07c00640 1 --2- 172.21.15.18:0/2554687093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d00077df0 0x7f8d00078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.470+0000 7f8d07c00640 1 --2- 172.21.15.18:0/2554687093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d00076ba0 0x7f8d00076fa0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.470+0000 7f8d07c00640 1 -- 172.21.15.18:0/2554687093 >> 172.21.15.18:0/2554687093 conn(0x7f8d000ff5b0 msgr2=0x7f8d001019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:04.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.471+0000 7f8d07c00640 1 -- 172.21.15.18:0/2554687093 shutdown_connections 2024-09-12T02:48:04.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.471+0000 7f8d07c00640 1 -- 172.21.15.18:0/2554687093 wait complete. 2024-09-12T02:48:04.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.472+0000 7f8d07c00640 1 Processor -- start 2024-09-12T02:48:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.472+0000 7f8d07c00640 1 -- start start 2024-09-12T02:48:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.472+0000 7f8d07c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d00076ba0 0x7f8d0019e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.472+0000 7f8d07c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d00077df0 0x7f8d0019e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.472+0000 7f8d07c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d00078790 0x7f8d001a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.472+0000 7f8d07c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8d00113ec0 con 0x7f8d00076ba0 2024-09-12T02:48:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.472+0000 7f8d07c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8d00113d40 con 0x7f8d00077df0 2024-09-12T02:48:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.472+0000 7f8d07c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8d00114040 con 0x7f8d00078790 2024-09-12T02:48:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.472+0000 7f8d05200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d00076ba0 0x7f8d0019e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:04.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.472+0000 7f8cffe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d00077df0 0x7f8d0019e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:04.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.472+0000 7f8d05200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d00076ba0 0x7f8d0019e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58318/0 (socket says 172.21.15.18:58318) 2024-09-12T02:48:04.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.472+0000 7f8d05200640 1 -- 172.21.15.18:0/991985616 learned_addr learned my addr 172.21.15.18:0/991985616 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:04.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.472+0000 7f8d05c00640 1 --2- 172.21.15.18:0/991985616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d00078790 0x7f8d001a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:04.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.473+0000 7f8cffe00640 1 -- 172.21.15.18:0/991985616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d00078790 msgr2=0x7f8d001a5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.473+0000 7f8cffe00640 1 --2- 172.21.15.18:0/991985616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d00078790 0x7f8d001a5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.473+0000 7f8cffe00640 1 -- 172.21.15.18:0/991985616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d00076ba0 msgr2=0x7f8d0019e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.473+0000 7f8cffe00640 1 --2- 172.21.15.18:0/991985616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d00076ba0 0x7f8d0019e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.473+0000 7f8cffe00640 1 -- 172.21.15.18:0/991985616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d001a60e0 con 0x7f8d00077df0 2024-09-12T02:48:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.473+0000 7f8cffe00640 1 --2- 172.21.15.18:0/991985616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d00077df0 0x7f8d0019e9f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8cec005fd0 tx=0x7f8cec00dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.473+0000 7f8cfd600640 1 -- 172.21.15.18:0/991985616 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec009c30 con 0x7f8d00077df0 2024-09-12T02:48:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.474+0000 7f8cfd600640 1 -- 172.21.15.18:0/991985616 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cec009dd0 con 0x7f8d00077df0 2024-09-12T02:48:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.474+0000 7f8cfd600640 1 -- 172.21.15.18:0/991985616 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec010460 con 0x7f8d00077df0 2024-09-12T02:48:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.474+0000 7f8d07c00640 1 -- 172.21.15.18:0/991985616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d001a63d0 con 0x7f8d00077df0 2024-09-12T02:48:04.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.474+0000 7f8d07c00640 1 -- 172.21.15.18:0/991985616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d001a68c0 con 0x7f8d00077df0 2024-09-12T02:48:04.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.475+0000 7f8d07c00640 1 -- 172.21.15.18:0/991985616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d00110780 con 0x7f8d00077df0 2024-09-12T02:48:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.477+0000 7f8cfd600640 1 -- 172.21.15.18:0/991985616 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8cec003ef0 con 0x7f8d00077df0 2024-09-12T02:48:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.478+0000 7f8cfd600640 1 --2- 172.21.15.18:0/991985616 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f8ce80a2cc0 0x7f8ce80a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.478+0000 7f8cfd600640 1 -- 172.21.15.18:0/991985616 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f8cec0cf080 con 0x7f8d00077df0 2024-09-12T02:48:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.478+0000 7f8d05200640 1 --2- 172.21.15.18:0/991985616 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f8ce80a2cc0 0x7f8ce80a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:04.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.479+0000 7f8d05200640 1 --2- 172.21.15.18:0/991985616 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f8ce80a2cc0 0x7f8ce80a5180 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4031440 tx=0x7f8cf40315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:04.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.480+0000 7f8cfd600640 1 -- 172.21.15.18:0/991985616 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8cec017020 con 0x7f8d00077df0 2024-09-12T02:48:04.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.684+0000 7f8d07c00640 1 -- 172.21.15.18:0/991985616 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f8d00062630 con 0x7f8ce80a2cc0 2024-09-12T02:48:04.686 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:04 smithi018 ceph-mon[30616]: pgmap v384: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:48:04.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.686+0000 7f8cfd600640 1 -- 172.21.15.18:0/991985616 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f8d00062630 con 0x7f8ce80a2cc0 2024-09-12T02:48:04.687 INFO:teuthology.orchestra.run.smithi018.stdout:Backend: cephadm 2024-09-12T02:48:04.687 INFO:teuthology.orchestra.run.smithi018.stdout:Available: Yes 2024-09-12T02:48:04.687 INFO:teuthology.orchestra.run.smithi018.stdout:Paused: No 2024-09-12T02:48:04.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.688+0000 7f8d07c00640 1 -- 172.21.15.18:0/991985616 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f8ce80a2cc0 msgr2=0x7f8ce80a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:04.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.688+0000 7f8d07c00640 1 --2- 172.21.15.18:0/991985616 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f8ce80a2cc0 0x7f8ce80a5180 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4031440 tx=0x7f8cf40315b0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.688+0000 7f8d07c00640 1 -- 172.21.15.18:0/991985616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d00077df0 msgr2=0x7f8d0019e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.688+0000 7f8d07c00640 1 --2- 172.21.15.18:0/991985616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d00077df0 0x7f8d0019e9f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8cec005fd0 tx=0x7f8cec00dde0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.688+0000 7f8d07c00640 1 -- 172.21.15.18:0/991985616 shutdown_connections 2024-09-12T02:48:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.688+0000 7f8d07c00640 1 --2- 172.21.15.18:0/991985616 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f8ce80a2cc0 0x7f8ce80a5180 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.688+0000 7f8d07c00640 1 --2- 172.21.15.18:0/991985616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d00078790 0x7f8d001a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.688+0000 7f8d07c00640 1 --2- 172.21.15.18:0/991985616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d00077df0 0x7f8d0019e9f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.688+0000 7f8d07c00640 1 --2- 172.21.15.18:0/991985616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d00076ba0 0x7f8d0019e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.688+0000 7f8d07c00640 1 -- 172.21.15.18:0/991985616 >> 172.21.15.18:0/991985616 conn(0x7f8d000ff5b0 msgr2=0x7f8d00101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.689+0000 7f8d07c00640 1 -- 172.21.15.18:0/991985616 shutdown_connections 2024-09-12T02:48:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:04.689+0000 7f8d07c00640 1 -- 172.21.15.18:0/991985616 wait complete. 2024-09-12T02:48:04.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:04 smithi176 ceph-mon[35713]: pgmap v384: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:48:05.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:04 smithi062 ceph-mon[35527]: pgmap v384: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:48:05.583 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-12T02:48:05.961 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:06.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.601+0000 7fc1ef400640 1 -- 172.21.15.18:0/485144068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e8077df0 msgr2=0x7fc1e8078250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:06.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.601+0000 7fc1ef400640 1 --2- 172.21.15.18:0/485144068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e8077df0 0x7fc1e8078250 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4009900 tx=0x7fc1d402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:48:06.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.601+0000 7fc1ef400640 1 -- 172.21.15.18:0/485144068 shutdown_connections 2024-09-12T02:48:06.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.601+0000 7fc1ef400640 1 --2- 172.21.15.18:0/485144068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1e8078790 0x7fc1e8079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:06.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.601+0000 7fc1ef400640 1 --2- 172.21.15.18:0/485144068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e8077df0 0x7fc1e8078250 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:06.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.602+0000 7fc1ef400640 1 --2- 172.21.15.18:0/485144068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1e8076ba0 0x7fc1e8076fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:06.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.602+0000 7fc1ef400640 1 -- 172.21.15.18:0/485144068 >> 172.21.15.18:0/485144068 conn(0x7fc1e80ff5b0 msgr2=0x7fc1e81019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:06.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.602+0000 7fc1ef400640 1 -- 172.21.15.18:0/485144068 shutdown_connections 2024-09-12T02:48:06.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.602+0000 7fc1ef400640 1 -- 172.21.15.18:0/485144068 wait complete. 2024-09-12T02:48:06.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.603+0000 7fc1ef400640 1 Processor -- start 2024-09-12T02:48:06.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.603+0000 7fc1ef400640 1 -- start start 2024-09-12T02:48:06.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.603+0000 7fc1ef400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1e8076ba0 0x7fc1e819e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:06.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.603+0000 7fc1ef400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1e8077df0 0x7fc1e819ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:06.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.603+0000 7fc1ef400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e8078790 0x7fc1e81a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:06.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.603+0000 7fc1ef400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e8113ed0 con 0x7fc1e8078790 2024-09-12T02:48:06.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.603+0000 7fc1ef400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e8113d50 con 0x7fc1e8077df0 2024-09-12T02:48:06.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.603+0000 7fc1ef400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e8114050 con 0x7fc1e8076ba0 2024-09-12T02:48:06.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.603+0000 7fc1eca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1e8076ba0 0x7fc1e819e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:06.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.603+0000 7fc1e7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1e8077df0 0x7fc1e819ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:06.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.603+0000 7fc1ed400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e8078790 0x7fc1e81a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:06.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.603+0000 7fc1e7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1e8077df0 0x7fc1e819ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:41982/0 (socket says 172.21.15.18:41982) 2024-09-12T02:48:06.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.603+0000 7fc1e7e00640 1 -- 172.21.15.18:0/1026645958 learned_addr learned my addr 172.21.15.18:0/1026645958 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:06.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.604+0000 7fc1ed400640 1 -- 172.21.15.18:0/1026645958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1e8076ba0 msgr2=0x7fc1e819e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:06.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.604+0000 7fc1ed400640 1 --2- 172.21.15.18:0/1026645958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1e8076ba0 0x7fc1e819e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:06.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.604+0000 7fc1ed400640 1 -- 172.21.15.18:0/1026645958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1e8077df0 msgr2=0x7fc1e819ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:06.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.604+0000 7fc1ed400640 1 --2- 172.21.15.18:0/1026645958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1e8077df0 0x7fc1e819ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:06.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.604+0000 7fc1ed400640 1 -- 172.21.15.18:0/1026645958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e81a6110 con 0x7fc1e8078790 2024-09-12T02:48:06.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.604+0000 7fc1ed400640 1 --2- 172.21.15.18:0/1026645958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e8078790 0x7fc1e81a5aa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009fd0 tx=0x7fc1e000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:06.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.605+0000 7fc1e5600640 1 -- 172.21.15.18:0/1026645958 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e000ce20 con 0x7fc1e8078790 2024-09-12T02:48:06.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.605+0000 7fc1ef400640 1 -- 172.21.15.18:0/1026645958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e81a6400 con 0x7fc1e8078790 2024-09-12T02:48:06.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.605+0000 7fc1e5600640 1 -- 172.21.15.18:0/1026645958 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1e0005020 con 0x7fc1e8078790 2024-09-12T02:48:06.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.605+0000 7fc1e5600640 1 -- 172.21.15.18:0/1026645958 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0010720 con 0x7fc1e8078790 2024-09-12T02:48:06.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.605+0000 7fc1ef400640 1 -- 172.21.15.18:0/1026645958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e81a6940 con 0x7fc1e8078790 2024-09-12T02:48:06.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.606+0000 7fc1ef400640 1 -- 172.21.15.18:0/1026645958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e8110780 con 0x7fc1e8078790 2024-09-12T02:48:06.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.608+0000 7fc1e5600640 1 -- 172.21.15.18:0/1026645958 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc1e0005540 con 0x7fc1e8078790 2024-09-12T02:48:06.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.609+0000 7fc1e5600640 1 --2- 172.21.15.18:0/1026645958 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc1d00a2c40 0x7fc1d00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:06.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.609+0000 7fc1e5600640 1 -- 172.21.15.18:0/1026645958 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7fc1e00cfc10 con 0x7fc1e8078790 2024-09-12T02:48:06.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.609+0000 7fc1eca00640 1 --2- 172.21.15.18:0/1026645958 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc1d00a2c40 0x7fc1d00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:06.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.610+0000 7fc1eca00640 1 --2- 172.21.15.18:0/1026645958 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc1d00a2c40 0x7fc1d00a5100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc005d00 tx=0x7fc1dc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:06.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.613+0000 7fc1e5600640 1 -- 172.21.15.18:0/1026645958 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc1e009c600 con 0x7fc1e8078790 2024-09-12T02:48:06.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.806+0000 7fc1ef400640 1 -- 172.21.15.18:0/1026645958 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc1e8062630 con 0x7fc1d00a2c40 2024-09-12T02:48:06.807 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:06 smithi018 ceph-mon[30616]: pgmap v385: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:48:06.807 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:06 smithi018 ceph-mon[30616]: from='client.25049 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:06.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.819+0000 7fc1e5600640 1 -- 172.21.15.18:0/1026645958 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4092 (secure 0 0 0) 0x7fc1e8062630 con 0x7fc1d00a2c40 2024-09-12T02:48:06.819 INFO:teuthology.orchestra.run.smithi018.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T02:48:06.820 INFO:teuthology.orchestra.run.smithi018.stdout:mds.a smithi018 running (2m) 25s ago 2m 17.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 1ee1e9374c0d 2024-09-12T02:48:06.820 INFO:teuthology.orchestra.run.smithi018.stdout:mds.b smithi062 running (2m) 30s ago 2m 26.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 de9f39a716ff 2024-09-12T02:48:06.820 INFO:teuthology.orchestra.run.smithi018.stdout:mds.c smithi176 running (3m) 30s ago 3m 21.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 3e6e43c73e3a 2024-09-12T02:48:06.820 INFO:teuthology.orchestra.run.smithi018.stdout:mds.d smithi018 running (3m) 25s ago 3m 13.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 04132871406c 2024-09-12T02:48:06.820 INFO:teuthology.orchestra.run.smithi018.stdout:mds.e smithi062 running (3m) 30s ago 3m 17.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 d964d8b0ca40 2024-09-12T02:48:06.820 INFO:teuthology.orchestra.run.smithi018.stdout:mds.f smithi176 running (3m) 30s ago 3m 21.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 5ee4c6c9ec25 2024-09-12T02:48:06.820 INFO:teuthology.orchestra.run.smithi018.stdout:mds.g smithi018 running (2m) 25s ago 2m 13.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 6383b0afb323 2024-09-12T02:48:06.820 INFO:teuthology.orchestra.run.smithi018.stdout:mds.h smithi062 running (2m) 30s ago 2m 18.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 71fddda72f21 2024-09-12T02:48:06.820 INFO:teuthology.orchestra.run.smithi018.stdout:mds.i smithi176 running (2m) 30s ago 2m 18.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 5fbba7b09308 2024-09-12T02:48:06.820 INFO:teuthology.orchestra.run.smithi018.stdout:mds.j smithi018 running (3m) 25s ago 3m 16.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 27b489837ab4 2024-09-12T02:48:06.820 INFO:teuthology.orchestra.run.smithi018.stdout:mds.k smithi062 running (3m) 30s ago 3m 18.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 a638e8e00816 2024-09-12T02:48:06.821 INFO:teuthology.orchestra.run.smithi018.stdout:mds.l smithi176 running (3m) 30s ago 3m 20.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 448d622eafb0 2024-09-12T02:48:06.821 INFO:teuthology.orchestra.run.smithi018.stdout:mgr.x smithi018 *:9283,8765 running (10m) 25s ago 10m 510M - 19.1.1-298-gb53b6d3e 54467abc55f8 4e1ebb106e63 2024-09-12T02:48:06.821 INFO:teuthology.orchestra.run.smithi018.stdout:mgr.y smithi062 *:8443,8765 running (8m) 30s ago 8m 442M - 19.1.1-298-gb53b6d3e 54467abc55f8 d9c451f580ae 2024-09-12T02:48:06.821 INFO:teuthology.orchestra.run.smithi018.stdout:mgr.z smithi176 *:8443,8765 running (8m) 30s ago 8m 442M - 19.1.1-298-gb53b6d3e 54467abc55f8 b9cf66c81d05 2024-09-12T02:48:06.821 INFO:teuthology.orchestra.run.smithi018.stdout:mon.a smithi018 running (10m) 25s ago 10m 50.7M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 148cd232de42 2024-09-12T02:48:06.821 INFO:teuthology.orchestra.run.smithi018.stdout:mon.b smithi062 running (9m) 30s ago 9m 42.6M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 6ea4dc7aab4b 2024-09-12T02:48:06.821 INFO:teuthology.orchestra.run.smithi018.stdout:mon.c smithi176 running (9m) 30s ago 9m 41.5M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 ef06237f8294 2024-09-12T02:48:06.821 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 smithi018 running (8m) 25s ago 8m 45.0M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 1241ca70f2b9 2024-09-12T02:48:06.821 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 smithi062 running (8m) 30s ago 8m 49.4M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 d99fe0e56628 2024-09-12T02:48:06.821 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2 smithi176 running (7m) 30s ago 7m 47.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 e645d4778b5a 2024-09-12T02:48:06.821 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 smithi018 running (7m) 25s ago 7m 44.1M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 1dfb91fc26b1 2024-09-12T02:48:06.821 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 smithi062 running (6m) 30s ago 6m 53.1M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 cd5eded42c35 2024-09-12T02:48:06.822 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 smithi176 running (6m) 30s ago 6m 44.9M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 450ff46a2dbd 2024-09-12T02:48:06.822 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6 smithi018 running (5m) 25s ago 5m 41.7M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 ed54eb733beb 2024-09-12T02:48:06.822 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7 smithi062 running (5m) 30s ago 5m 53.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 96096859b118 2024-09-12T02:48:06.822 INFO:teuthology.orchestra.run.smithi018.stdout:osd.8 smithi176 running (4m) 30s ago 4m 53.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 4f0df3ee9568 2024-09-12T02:48:06.822 INFO:teuthology.orchestra.run.smithi018.stdout:osd.9 smithi018 running (4m) 25s ago 4m 41.5M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 123f0b51f1eb 2024-09-12T02:48:06.822 INFO:teuthology.orchestra.run.smithi018.stdout:osd.10 smithi062 running (4m) 30s ago 4m 44.4M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 2e04b9a0caa8 2024-09-12T02:48:06.822 INFO:teuthology.orchestra.run.smithi018.stdout:osd.11 smithi176 running (3m) 30s ago 3m 42.7M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 bdbf87816164 2024-09-12T02:48:06.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.821+0000 7fc1ef400640 1 -- 172.21.15.18:0/1026645958 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc1d00a2c40 msgr2=0x7fc1d00a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:06.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.821+0000 7fc1ef400640 1 --2- 172.21.15.18:0/1026645958 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc1d00a2c40 0x7fc1d00a5100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc005d00 tx=0x7fc1dc00b410 comp rx=0 tx=0).stop 2024-09-12T02:48:06.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.821+0000 7fc1ef400640 1 -- 172.21.15.18:0/1026645958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e8078790 msgr2=0x7fc1e81a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:06.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.821+0000 7fc1ef400640 1 --2- 172.21.15.18:0/1026645958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e8078790 0x7fc1e81a5aa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009fd0 tx=0x7fc1e000ef10 comp rx=0 tx=0).stop 2024-09-12T02:48:06.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.821+0000 7fc1ef400640 1 -- 172.21.15.18:0/1026645958 shutdown_connections 2024-09-12T02:48:06.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.821+0000 7fc1ef400640 1 --2- 172.21.15.18:0/1026645958 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fc1d00a2c40 0x7fc1d00a5100 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:06.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.821+0000 7fc1ef400640 1 --2- 172.21.15.18:0/1026645958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e8078790 0x7fc1e81a5aa0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:06.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.821+0000 7fc1ef400640 1 --2- 172.21.15.18:0/1026645958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1e8077df0 0x7fc1e819ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:06.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.821+0000 7fc1ef400640 1 --2- 172.21.15.18:0/1026645958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1e8076ba0 0x7fc1e819e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:06.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.821+0000 7fc1ef400640 1 -- 172.21.15.18:0/1026645958 >> 172.21.15.18:0/1026645958 conn(0x7fc1e80ff5b0 msgr2=0x7fc1e8101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:06.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.821+0000 7fc1ef400640 1 -- 172.21.15.18:0/1026645958 shutdown_connections 2024-09-12T02:48:06.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:06.821+0000 7fc1ef400640 1 -- 172.21.15.18:0/1026645958 wait complete. 2024-09-12T02:48:06.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:06 smithi176 ceph-mon[35713]: pgmap v385: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:48:06.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:06 smithi176 ceph-mon[35713]: from='client.25049 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:07.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:06 smithi062 ceph-mon[35527]: pgmap v385: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:48:07.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:06 smithi062 ceph-mon[35527]: from='client.25049 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:07.646 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-12T02:48:08.031 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:08.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.687+0000 7f4102000640 1 -- 172.21.15.18:0/2995798092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40fc102e00 msgr2=0x7f40fc103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:08.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.687+0000 7f4102000640 1 --2- 172.21.15.18:0/2995798092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40fc102e00 0x7f40fc103280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009900 tx=0x7f40e402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.687+0000 7f4102000640 1 -- 172.21.15.18:0/2995798092 shutdown_connections 2024-09-12T02:48:08.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.687+0000 7f4102000640 1 --2- 172.21.15.18:0/2995798092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40fc1037c0 0x7f40fc10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.687+0000 7f4102000640 1 --2- 172.21.15.18:0/2995798092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40fc102e00 0x7f40fc103280 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.687+0000 7f4102000640 1 --2- 172.21.15.18:0/2995798092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40fc101c00 0x7f40fc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.687+0000 7f4102000640 1 -- 172.21.15.18:0/2995798092 >> 172.21.15.18:0/2995798092 conn(0x7f40fc0fd390 msgr2=0x7f40fc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.687+0000 7f4102000640 1 -- 172.21.15.18:0/2995798092 shutdown_connections 2024-09-12T02:48:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.687+0000 7f4102000640 1 -- 172.21.15.18:0/2995798092 wait complete. 2024-09-12T02:48:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.688+0000 7f4102000640 1 Processor -- start 2024-09-12T02:48:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.688+0000 7f4102000640 1 -- start start 2024-09-12T02:48:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.688+0000 7f4102000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40fc101c00 0x7f40fc19a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.688+0000 7f4102000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40fc102e00 0x7f40fc19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.688+0000 7f4102000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40fc1037c0 0x7f40fc1a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.688+0000 7f4102000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc10d8d0 con 0x7f40fc101c00 2024-09-12T02:48:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.688+0000 7f4102000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc10d750 con 0x7f40fc102e00 2024-09-12T02:48:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.688+0000 7f4102000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc10da50 con 0x7f40fc1037c0 2024-09-12T02:48:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.688+0000 7f40fb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40fc101c00 0x7f40fc19a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.689+0000 7f40f3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40fc102e00 0x7f40fc19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.689+0000 7f40f3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40fc102e00 0x7f40fc19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:42008/0 (socket says 172.21.15.18:42008) 2024-09-12T02:48:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.689+0000 7f40f3e00640 1 -- 172.21.15.18:0/2202706524 learned_addr learned my addr 172.21.15.18:0/2202706524 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.689+0000 7f40fbe00640 1 --2- 172.21.15.18:0/2202706524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40fc1037c0 0x7f40fc1a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.689+0000 7f40f3e00640 1 -- 172.21.15.18:0/2202706524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40fc1037c0 msgr2=0x7f40fc1a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.689+0000 7f40f3e00640 1 --2- 172.21.15.18:0/2202706524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40fc1037c0 0x7f40fc1a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.689+0000 7f40f3e00640 1 -- 172.21.15.18:0/2202706524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40fc101c00 msgr2=0x7f40fc19a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.689+0000 7f40f3e00640 1 --2- 172.21.15.18:0/2202706524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40fc101c00 0x7f40fc19a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.689+0000 7f40f3e00640 1 -- 172.21.15.18:0/2202706524 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40fc1a1d30 con 0x7f40fc102e00 2024-09-12T02:48:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.689+0000 7f40fbe00640 1 --2- 172.21.15.18:0/2202706524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40fc1037c0 0x7f40fc1a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.689+0000 7f40f3e00640 1 --2- 172.21.15.18:0/2202706524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40fc102e00 0x7f40fc19a640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f40e4031440 tx=0x7f40e4032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.690+0000 7f40f8c00640 1 -- 172.21.15.18:0/2202706524 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e403f030 con 0x7f40fc102e00 2024-09-12T02:48:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.690+0000 7f40f8c00640 1 -- 172.21.15.18:0/2202706524 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40e4003ce0 con 0x7f40fc102e00 2024-09-12T02:48:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.690+0000 7f4102000640 1 -- 172.21.15.18:0/2202706524 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40fc1a1fc0 con 0x7f40fc102e00 2024-09-12T02:48:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.690+0000 7f40f8c00640 1 -- 172.21.15.18:0/2202706524 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e4035070 con 0x7f40fc102e00 2024-09-12T02:48:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.690+0000 7f4102000640 1 -- 172.21.15.18:0/2202706524 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40fc1a2410 con 0x7f40fc102e00 2024-09-12T02:48:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.691+0000 7f4102000640 1 -- 172.21.15.18:0/2202706524 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40fc1a2640 con 0x7f40fc102e00 2024-09-12T02:48:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.693+0000 7f40f8c00640 1 -- 172.21.15.18:0/2202706524 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f40e4042030 con 0x7f40fc102e00 2024-09-12T02:48:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.694+0000 7f40f8c00640 1 --2- 172.21.15.18:0/2202706524 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40e00a2c40 0x7f40e00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.694+0000 7f40f8c00640 1 -- 172.21.15.18:0/2202706524 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f40e40efc00 con 0x7f40fc102e00 2024-09-12T02:48:08.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.695+0000 7f40fb400640 1 --2- 172.21.15.18:0/2202706524 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40e00a2c40 0x7f40e00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:08.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.695+0000 7f40fb400640 1 --2- 172.21.15.18:0/2202706524 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40e00a2c40 0x7f40e00a5100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f40fc102c60 tx=0x7f40ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:08.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.696+0000 7f40f8c00640 1 -- 172.21.15.18:0/2202706524 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f40e40bc5f0 con 0x7f40fc102e00 2024-09-12T02:48:08.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:08 smithi018 ceph-mon[30616]: pgmap v386: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:48:08.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:08 smithi018 ceph-mon[30616]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:08.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.888+0000 7f4102000640 1 -- 172.21.15.18:0/2202706524 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f40fc075b40 con 0x7f40e00a2c40 2024-09-12T02:48:08.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.894+0000 7f40f8c00640 1 -- 172.21.15.18:0/2202706524 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f40fc075b40 con 0x7f40e00a2c40 2024-09-12T02:48:08.895 INFO:teuthology.orchestra.run.smithi018.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-12T02:48:08.895 INFO:teuthology.orchestra.run.smithi018.stdout:mds.all 12/12 32s ago 3m smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi176=c;smithi176=f;smithi176=i;smithi176=l;count:12 2024-09-12T02:48:08.895 INFO:teuthology.orchestra.run.smithi018.stdout:mgr 3/3 32s ago 9m smithi018=x;smithi062=y;smithi176=z;count:3 2024-09-12T02:48:08.895 INFO:teuthology.orchestra.run.smithi018.stdout:mon 3/3 32s ago 9m smithi018:172.21.15.18=a;smithi062:172.21.15.62=b;smithi176:172.21.15.176=c;count:3 2024-09-12T02:48:08.895 INFO:teuthology.orchestra.run.smithi018.stdout:osd 12 32s ago - 2024-09-12T02:48:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.896+0000 7f4102000640 1 -- 172.21.15.18:0/2202706524 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40e00a2c40 msgr2=0x7f40e00a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.896+0000 7f4102000640 1 --2- 172.21.15.18:0/2202706524 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40e00a2c40 0x7f40e00a5100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f40fc102c60 tx=0x7f40ec005f90 comp rx=0 tx=0).stop 2024-09-12T02:48:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.896+0000 7f4102000640 1 -- 172.21.15.18:0/2202706524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40fc102e00 msgr2=0x7f40fc19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.896+0000 7f4102000640 1 --2- 172.21.15.18:0/2202706524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40fc102e00 0x7f40fc19a640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f40e4031440 tx=0x7f40e4032ce0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.897+0000 7f4102000640 1 -- 172.21.15.18:0/2202706524 shutdown_connections 2024-09-12T02:48:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.897+0000 7f4102000640 1 --2- 172.21.15.18:0/2202706524 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f40e00a2c40 0x7f40e00a5100 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.897+0000 7f4102000640 1 --2- 172.21.15.18:0/2202706524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40fc1037c0 0x7f40fc1a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.897+0000 7f4102000640 1 --2- 172.21.15.18:0/2202706524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40fc102e00 0x7f40fc19a640 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.897+0000 7f4102000640 1 --2- 172.21.15.18:0/2202706524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40fc101c00 0x7f40fc19a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:08.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.897+0000 7f4102000640 1 -- 172.21.15.18:0/2202706524 >> 172.21.15.18:0/2202706524 conn(0x7f40fc0fd390 msgr2=0x7f40fc074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:08.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.897+0000 7f4102000640 1 -- 172.21.15.18:0/2202706524 shutdown_connections 2024-09-12T02:48:08.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:08.897+0000 7f4102000640 1 -- 172.21.15.18:0/2202706524 wait complete. 2024-09-12T02:48:08.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:08 smithi176 ceph-mon[35713]: pgmap v386: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:48:08.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:08 smithi176 ceph-mon[35713]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:09.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:08 smithi062 ceph-mon[35527]: pgmap v386: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:48:09.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:08 smithi062 ceph-mon[35527]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:09.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-12T02:48:10.138 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:10.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.789+0000 7f9373e00640 1 -- 172.21.15.18:0/2545784494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9374105810 msgr2=0x7f937410c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:10.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.789+0000 7f9373e00640 1 --2- 172.21.15.18:0/2545784494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9374105810 0x7f937410c0a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f936c009ca0 tx=0x7f936c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.789+0000 7f9373e00640 1 -- 172.21.15.18:0/2545784494 shutdown_connections 2024-09-12T02:48:10.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.789+0000 7f9373e00640 1 --2- 172.21.15.18:0/2545784494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9374105810 0x7f937410c0a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.789+0000 7f9373e00640 1 --2- 172.21.15.18:0/2545784494 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9374104e50 0x7f93741052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.789+0000 7f9373e00640 1 --2- 172.21.15.18:0/2545784494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9374103c50 0x7f9374104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.789+0000 7f9373e00640 1 -- 172.21.15.18:0/2545784494 >> 172.21.15.18:0/2545784494 conn(0x7f93740ff3e0 msgr2=0x7f9374101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:10.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.789+0000 7f9373e00640 1 -- 172.21.15.18:0/2545784494 shutdown_connections 2024-09-12T02:48:10.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.789+0000 7f9373e00640 1 -- 172.21.15.18:0/2545784494 wait complete. 2024-09-12T02:48:10.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.790+0000 7f9373e00640 1 Processor -- start 2024-09-12T02:48:10.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.790+0000 7f9373e00640 1 -- start start 2024-09-12T02:48:10.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.790+0000 7f9373e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9374103c50 0x7f9374199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:10.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.790+0000 7f9373e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9374104e50 0x7f937419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:10.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.790+0000 7f9373e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9374105810 0x7f93741a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:10.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.790+0000 7f9373e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f937410f920 con 0x7f9374103c50 2024-09-12T02:48:10.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.790+0000 7f9373e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f937410f7a0 con 0x7f9374104e50 2024-09-12T02:48:10.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.790+0000 7f9373e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f937410faa0 con 0x7f9374105810 2024-09-12T02:48:10.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.790+0000 7f9372a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9374103c50 0x7f9374199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:10.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.791+0000 7f9372a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9374103c50 0x7f9374199ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53642/0 (socket says 172.21.15.18:53642) 2024-09-12T02:48:10.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.791+0000 7f9372a00640 1 -- 172.21.15.18:0/2683313309 learned_addr learned my addr 172.21.15.18:0/2683313309 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:10.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.791+0000 7f9373400640 1 --2- 172.21.15.18:0/2683313309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9374105810 0x7f93741a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:10.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.791+0000 7f936be00640 1 --2- 172.21.15.18:0/2683313309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9374104e50 0x7f937419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:10.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.791+0000 7f9372a00640 1 -- 172.21.15.18:0/2683313309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9374105810 msgr2=0x7f93741a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:10.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.791+0000 7f9372a00640 1 --2- 172.21.15.18:0/2683313309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9374105810 0x7f93741a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.791+0000 7f9372a00640 1 -- 172.21.15.18:0/2683313309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9374104e50 msgr2=0x7f937419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:10.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.791+0000 7f9372a00640 1 --2- 172.21.15.18:0/2683313309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9374104e50 0x7f937419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.791+0000 7f9372a00640 1 -- 172.21.15.18:0/2683313309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93741a1b10 con 0x7f9374103c50 2024-09-12T02:48:10.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.791+0000 7f9373400640 1 --2- 172.21.15.18:0/2683313309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9374105810 0x7f93741a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:10.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.791+0000 7f9372a00640 1 --2- 172.21.15.18:0/2683313309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9374103c50 0x7f9374199ee0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f936400e9c0 tx=0x7f936400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:10.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.792+0000 7f936b400640 1 -- 172.21.15.18:0/2683313309 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936400cd80 con 0x7f9374103c50 2024-09-12T02:48:10.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.792+0000 7f9373e00640 1 -- 172.21.15.18:0/2683313309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93741a1e00 con 0x7f9374103c50 2024-09-12T02:48:10.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.792+0000 7f936b400640 1 -- 172.21.15.18:0/2683313309 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93640035f0 con 0x7f9374103c50 2024-09-12T02:48:10.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.792+0000 7f9373e00640 1 -- 172.21.15.18:0/2683313309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93741a2200 con 0x7f9374103c50 2024-09-12T02:48:10.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.792+0000 7f936b400640 1 -- 172.21.15.18:0/2683313309 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364010630 con 0x7f9374103c50 2024-09-12T02:48:10.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.793+0000 7f9373e00640 1 -- 172.21.15.18:0/2683313309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f937410af80 con 0x7f9374103c50 2024-09-12T02:48:10.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.795+0000 7f936b400640 1 -- 172.21.15.18:0/2683313309 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f93640037a0 con 0x7f9374103c50 2024-09-12T02:48:10.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.796+0000 7f936b400640 1 --2- 172.21.15.18:0/2683313309 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f93580a2c40 0x7f93580a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:10.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.796+0000 7f936b400640 1 -- 172.21.15.18:0/2683313309 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f93640cfa30 con 0x7f9374103c50 2024-09-12T02:48:10.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.797+0000 7f936be00640 1 --2- 172.21.15.18:0/2683313309 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f93580a2c40 0x7f93580a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:10.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.797+0000 7f936be00640 1 --2- 172.21.15.18:0/2683313309 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f93580a2c40 0x7f93580a5100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f937419b400 tx=0x7f935c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:10.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.800+0000 7f936b400640 1 -- 172.21.15.18:0/2683313309 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f936409c420 con 0x7f9374103c50 2024-09-12T02:48:10.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:10 smithi018 ceph-mon[30616]: pgmap v387: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:48:10.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:10 smithi018 ceph-mon[30616]: from='client.25061 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:10.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:10 smithi176 ceph-mon[35713]: pgmap v387: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:48:10.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:10 smithi176 ceph-mon[35713]: from='client.25061 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:10.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.994+0000 7f9373e00640 1 -- 172.21.15.18:0/2683313309 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f9374062630 con 0x7f93580a2c40 2024-09-12T02:48:10.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.996+0000 7f936b400640 1 -- 172.21.15.18:0/2683313309 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f9374062630 con 0x7f93580a2c40 2024-09-12T02:48:10.996 INFO:teuthology.orchestra.run.smithi018.stdout:HOST ADDR LABELS STATUS 2024-09-12T02:48:10.996 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018 172.21.15.18 2024-09-12T02:48:10.996 INFO:teuthology.orchestra.run.smithi018.stdout:smithi062 172.21.15.62 2024-09-12T02:48:10.997 INFO:teuthology.orchestra.run.smithi018.stdout:smithi176 172.21.15.176 2024-09-12T02:48:10.997 INFO:teuthology.orchestra.run.smithi018.stdout:3 hosts in cluster 2024-09-12T02:48:10.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.998+0000 7f9373e00640 1 -- 172.21.15.18:0/2683313309 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f93580a2c40 msgr2=0x7f93580a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:10.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.998+0000 7f9373e00640 1 --2- 172.21.15.18:0/2683313309 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f93580a2c40 0x7f93580a5100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f937419b400 tx=0x7f935c005f90 comp rx=0 tx=0).stop 2024-09-12T02:48:10.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.998+0000 7f9373e00640 1 -- 172.21.15.18:0/2683313309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9374103c50 msgr2=0x7f9374199ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:10.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.998+0000 7f9373e00640 1 --2- 172.21.15.18:0/2683313309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9374103c50 0x7f9374199ee0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f936400e9c0 tx=0x7f936400ee80 comp rx=0 tx=0).stop 2024-09-12T02:48:10.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.999+0000 7f9373e00640 1 -- 172.21.15.18:0/2683313309 shutdown_connections 2024-09-12T02:48:10.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.999+0000 7f9373e00640 1 --2- 172.21.15.18:0/2683313309 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f93580a2c40 0x7f93580a5100 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.999+0000 7f9373e00640 1 --2- 172.21.15.18:0/2683313309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9374105810 0x7f93741a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.999+0000 7f9373e00640 1 --2- 172.21.15.18:0/2683313309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9374104e50 0x7f937419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:10.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.999+0000 7f9373e00640 1 --2- 172.21.15.18:0/2683313309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9374103c50 0x7f9374199ee0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:11.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.999+0000 7f9373e00640 1 -- 172.21.15.18:0/2683313309 >> 172.21.15.18:0/2683313309 conn(0x7f93740ff3e0 msgr2=0x7f9374108150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:11.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.999+0000 7f9373e00640 1 -- 172.21.15.18:0/2683313309 shutdown_connections 2024-09-12T02:48:11.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:10.999+0000 7f9373e00640 1 -- 172.21.15.18:0/2683313309 wait complete. 2024-09-12T02:48:11.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:10 smithi062 ceph-mon[35527]: pgmap v387: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:48:11.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:10 smithi062 ceph-mon[35527]: from='client.25061 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:11.838 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-12T02:48:12.215 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:12.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:12 smithi018 ceph-mon[30616]: pgmap v388: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:48:12.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:12 smithi018 ceph-mon[30616]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:12.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:12 smithi018 ceph-mon[30616]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-12T02:48:12.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.826+0000 7f1962800640 1 -- 172.21.15.18:0/3750172607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f195c105920 msgr2=0x7f195c10c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:12.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.826+0000 7f1962800640 1 --2- 172.21.15.18:0/3750172607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f195c105920 0x7f195c10c240 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1954009be0 tx=0x7f195402a6d0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.826+0000 7f1962800640 1 -- 172.21.15.18:0/3750172607 shutdown_connections 2024-09-12T02:48:12.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.826+0000 7f1962800640 1 --2- 172.21.15.18:0/3750172607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f195c105920 0x7f195c10c240 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.826+0000 7f1962800640 1 --2- 172.21.15.18:0/3750172607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f195c104f60 0x7f195c1053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.826+0000 7f1962800640 1 --2- 172.21.15.18:0/3750172607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195c103e00 0x7f195c104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.826+0000 7f1962800640 1 -- 172.21.15.18:0/3750172607 >> 172.21.15.18:0/3750172607 conn(0x7f195c0ff5b0 msgr2=0x7f195c1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:12.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.826+0000 7f1962800640 1 -- 172.21.15.18:0/3750172607 shutdown_connections 2024-09-12T02:48:12.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.826+0000 7f1962800640 1 -- 172.21.15.18:0/3750172607 wait complete. 2024-09-12T02:48:12.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.827+0000 7f1962800640 1 Processor -- start 2024-09-12T02:48:12.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.827+0000 7f1962800640 1 -- start start 2024-09-12T02:48:12.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.827+0000 7f1962800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f195c103e00 0x7f195c19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:12.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.827+0000 7f1962800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f195c104f60 0x7f195c19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:12.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.827+0000 7f1962800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195c105920 0x7f195c1a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:12.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.827+0000 7f1962800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f195c10fa40 con 0x7f195c104f60 2024-09-12T02:48:12.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.827+0000 7f1962800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f195c10f8c0 con 0x7f195c105920 2024-09-12T02:48:12.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.827+0000 7f1962800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f195c10fbc0 con 0x7f195c103e00 2024-09-12T02:48:12.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.828+0000 7f195aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f195c104f60 0x7f195c19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:12.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.828+0000 7f195aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f195c104f60 0x7f195c19a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53658/0 (socket says 172.21.15.18:53658) 2024-09-12T02:48:12.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.828+0000 7f195aa00640 1 -- 172.21.15.18:0/4100700701 learned_addr learned my addr 172.21.15.18:0/4100700701 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:12.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.828+0000 7f195be00640 1 --2- 172.21.15.18:0/4100700701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195c105920 0x7f195c1a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:12.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.828+0000 7f195b400640 1 --2- 172.21.15.18:0/4100700701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f195c103e00 0x7f195c19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:12.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.828+0000 7f195aa00640 1 -- 172.21.15.18:0/4100700701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f195c103e00 msgr2=0x7f195c19a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:12.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.828+0000 7f195aa00640 1 --2- 172.21.15.18:0/4100700701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f195c103e00 0x7f195c19a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.828+0000 7f195aa00640 1 -- 172.21.15.18:0/4100700701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195c105920 msgr2=0x7f195c1a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:12.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.828+0000 7f195aa00640 1 --2- 172.21.15.18:0/4100700701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195c105920 0x7f195c1a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:12.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.828+0000 7f195aa00640 1 -- 172.21.15.18:0/4100700701 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f195c1a1cc0 con 0x7f195c104f60 2024-09-12T02:48:12.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.829+0000 7f195aa00640 1 --2- 172.21.15.18:0/4100700701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f195c104f60 0x7f195c19a5d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f194800e9c0 tx=0x7f194800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:12.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.829+0000 7f1953e00640 1 -- 172.21.15.18:0/4100700701 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194800cd80 con 0x7f195c104f60 2024-09-12T02:48:12.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.829+0000 7f1953e00640 1 -- 172.21.15.18:0/4100700701 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19480035f0 con 0x7f195c104f60 2024-09-12T02:48:12.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.829+0000 7f1962800640 1 -- 172.21.15.18:0/4100700701 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f195c1a1fb0 con 0x7f195c104f60 2024-09-12T02:48:12.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.829+0000 7f1953e00640 1 -- 172.21.15.18:0/4100700701 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1948010690 con 0x7f195c104f60 2024-09-12T02:48:12.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.829+0000 7f1962800640 1 -- 172.21.15.18:0/4100700701 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f195c1a24b0 con 0x7f195c104f60 2024-09-12T02:48:12.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.830+0000 7f1962800640 1 -- 172.21.15.18:0/4100700701 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f195c10b150 con 0x7f195c104f60 2024-09-12T02:48:12.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.833+0000 7f1953e00640 1 -- 172.21.15.18:0/4100700701 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f19480037a0 con 0x7f195c104f60 2024-09-12T02:48:12.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.834+0000 7f1953e00640 1 --2- 172.21.15.18:0/4100700701 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f19400a2c30 0x7f19400a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:12.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.834+0000 7f1953e00640 1 -- 172.21.15.18:0/4100700701 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f19480cf730 con 0x7f195c104f60 2024-09-12T02:48:12.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.834+0000 7f195b400640 1 --2- 172.21.15.18:0/4100700701 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f19400a2c30 0x7f19400a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:12.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.835+0000 7f195b400640 1 --2- 172.21.15.18:0/4100700701 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f19400a2c30 0x7f19400a50f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f194c009530 tx=0x7f194c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:12.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:12.838+0000 7f1953e00640 1 -- 172.21.15.18:0/4100700701 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f194809c280 con 0x7f195c104f60 2024-09-12T02:48:12.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:12 smithi176 ceph-mon[35713]: pgmap v388: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:48:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:12 smithi176 ceph-mon[35713]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:12.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:12 smithi176 ceph-mon[35713]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-12T02:48:13.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:13.030+0000 7f1962800640 1 -- 172.21.15.18:0/4100700701 --> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f195c062630 con 0x7f19400a2c30 2024-09-12T02:48:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:12 smithi062 ceph-mon[35527]: pgmap v388: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:48:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:12 smithi062 ceph-mon[35527]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:12 smithi062 ceph-mon[35527]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-12T02:48:13.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:13.032+0000 7f1953e00640 1 -- 172.21.15.18:0/4100700701 <== mgr.14150 v2:172.21.15.18:6800/494888664 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f195c062630 con 0x7f19400a2c30 2024-09-12T02:48:13.034 INFO:teuthology.orchestra.run.smithi018.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-12T02:48:13.034 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75120091480DGN 447G No 4m ago Has a FileSystem, LVM detected 2024-09-12T02:48:13.034 INFO:teuthology.orchestra.run.smithi018.stdout:smithi062 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT53440094400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-09-12T02:48:13.034 INFO:teuthology.orchestra.run.smithi018.stdout:smithi176 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62330099400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-12T02:48:13.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:13.034+0000 7f1962800640 1 -- 172.21.15.18:0/4100700701 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f19400a2c30 msgr2=0x7f19400a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:13.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:13.034+0000 7f1962800640 1 --2- 172.21.15.18:0/4100700701 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f19400a2c30 0x7f19400a50f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f194c009530 tx=0x7f194c009260 comp rx=0 tx=0).stop 2024-09-12T02:48:13.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:13.034+0000 7f1962800640 1 -- 172.21.15.18:0/4100700701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f195c104f60 msgr2=0x7f195c19a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:13.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:13.034+0000 7f1962800640 1 --2- 172.21.15.18:0/4100700701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f195c104f60 0x7f195c19a5d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f194800e9c0 tx=0x7f194800ee80 comp rx=0 tx=0).stop 2024-09-12T02:48:13.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:13.035+0000 7f1962800640 1 -- 172.21.15.18:0/4100700701 shutdown_connections 2024-09-12T02:48:13.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:13.035+0000 7f1962800640 1 --2- 172.21.15.18:0/4100700701 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f19400a2c30 0x7f19400a50f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:13.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:13.035+0000 7f1962800640 1 --2- 172.21.15.18:0/4100700701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195c105920 0x7f195c1a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:13.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:13.035+0000 7f1962800640 1 --2- 172.21.15.18:0/4100700701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f195c104f60 0x7f195c19a5d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:13.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:13.035+0000 7f1962800640 1 --2- 172.21.15.18:0/4100700701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f195c103e00 0x7f195c19a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:13.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:13.035+0000 7f1962800640 1 -- 172.21.15.18:0/4100700701 >> 172.21.15.18:0/4100700701 conn(0x7f195c0ff5b0 msgr2=0x7f195c108320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:13.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:13.035+0000 7f1962800640 1 -- 172.21.15.18:0/4100700701 shutdown_connections 2024-09-12T02:48:13.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:13.035+0000 7f1962800640 1 -- 172.21.15.18:0/4100700701 wait complete. 2024-09-12T02:48:14.072 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T02:48:14.332 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-12T02:48:14.333 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-12T02:48:14.721 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:14.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:14 smithi018 ceph-mon[30616]: pgmap v389: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T02:48:14.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:14 smithi018 ceph-mon[30616]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:14.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:14 smithi176 ceph-mon[35713]: pgmap v389: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T02:48:14.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:14 smithi176 ceph-mon[35713]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:15.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:14 smithi062 ceph-mon[35527]: pgmap v389: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T02:48:15.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:14 smithi062 ceph-mon[35527]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:15.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.338+0000 7f33a8000640 1 -- 172.21.15.18:0/778618495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a0077df0 msgr2=0x7f33a0078250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:15.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.338+0000 7f33a8000640 1 --2- 172.21.15.18:0/778618495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a0077df0 0x7f33a0078250 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f338c009900 tx=0x7f338c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.338+0000 7f33a8000640 1 -- 172.21.15.18:0/778618495 shutdown_connections 2024-09-12T02:48:15.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.338+0000 7f33a8000640 1 --2- 172.21.15.18:0/778618495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a0078790 0x7f33a0079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.338+0000 7f33a8000640 1 --2- 172.21.15.18:0/778618495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a0077df0 0x7f33a0078250 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.338+0000 7f33a8000640 1 --2- 172.21.15.18:0/778618495 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33a0076ba0 0x7f33a0076fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.338+0000 7f33a8000640 1 -- 172.21.15.18:0/778618495 >> 172.21.15.18:0/778618495 conn(0x7f33a00ff5b0 msgr2=0x7f33a01019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:15.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.338+0000 7f33a8000640 1 -- 172.21.15.18:0/778618495 shutdown_connections 2024-09-12T02:48:15.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.338+0000 7f33a8000640 1 -- 172.21.15.18:0/778618495 wait complete. 2024-09-12T02:48:15.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.339+0000 7f33a8000640 1 Processor -- start 2024-09-12T02:48:15.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.339+0000 7f33a8000640 1 -- start start 2024-09-12T02:48:15.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.339+0000 7f33a8000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33a0076ba0 0x7f33a019e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.339+0000 7f33a8000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a0077df0 0x7f33a019ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.339+0000 7f33a8000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a0078790 0x7f33a01a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.339+0000 7f33a8000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33a0113ea0 con 0x7f33a0078790 2024-09-12T02:48:15.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.339+0000 7f33a8000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f33a0113d20 con 0x7f33a0077df0 2024-09-12T02:48:15.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.340+0000 7f33a8000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f33a0114020 con 0x7f33a0076ba0 2024-09-12T02:48:15.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.340+0000 7f33a5600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33a0076ba0 0x7f33a019e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.340+0000 7f33a5600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33a0076ba0 0x7f33a019e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:38242/0 (socket says 172.21.15.18:38242) 2024-09-12T02:48:15.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.340+0000 7f33a5600640 1 -- 172.21.15.18:0/2058615797 learned_addr learned my addr 172.21.15.18:0/2058615797 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:15.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.340+0000 7f33a6000640 1 --2- 172.21.15.18:0/2058615797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a0078790 0x7f33a01a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.340+0000 7f33a4c00640 1 --2- 172.21.15.18:0/2058615797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a0077df0 0x7f33a019ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.340+0000 7f33a5600640 1 -- 172.21.15.18:0/2058615797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a0077df0 msgr2=0x7f33a019ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:15.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.340+0000 7f33a5600640 1 --2- 172.21.15.18:0/2058615797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a0077df0 0x7f33a019ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.340+0000 7f33a5600640 1 -- 172.21.15.18:0/2058615797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a0078790 msgr2=0x7f33a01a5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:15.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.340+0000 7f33a5600640 1 --2- 172.21.15.18:0/2058615797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a0078790 0x7f33a01a5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.340+0000 7f33a5600640 1 -- 172.21.15.18:0/2058615797 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a01a6100 con 0x7f33a0076ba0 2024-09-12T02:48:15.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.341+0000 7f33a5600640 1 --2- 172.21.15.18:0/2058615797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33a0076ba0 0x7f33a019e4d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f339400e9f0 tx=0x7f339400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:15.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.341+0000 7f339e000640 1 -- 172.21.15.18:0/2058615797 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339400cd80 con 0x7f33a0076ba0 2024-09-12T02:48:15.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.341+0000 7f33a8000640 1 -- 172.21.15.18:0/2058615797 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a01a63f0 con 0x7f33a0076ba0 2024-09-12T02:48:15.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.341+0000 7f339e000640 1 -- 172.21.15.18:0/2058615797 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3394005500 con 0x7f33a0076ba0 2024-09-12T02:48:15.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.341+0000 7f339e000640 1 -- 172.21.15.18:0/2058615797 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394010690 con 0x7f33a0076ba0 2024-09-12T02:48:15.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.341+0000 7f33a8000640 1 -- 172.21.15.18:0/2058615797 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a01a6900 con 0x7f33a0076ba0 2024-09-12T02:48:15.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.343+0000 7f33a8000640 1 -- 172.21.15.18:0/2058615797 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a0110780 con 0x7f33a0076ba0 2024-09-12T02:48:15.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.344+0000 7f339e000640 1 -- 172.21.15.18:0/2058615797 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f33940046c0 con 0x7f33a0076ba0 2024-09-12T02:48:15.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.346+0000 7f339e000640 1 --2- 172.21.15.18:0/2058615797 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f33880a2bb0 0x7f33880a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:15.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.346+0000 7f339e000640 1 -- 172.21.15.18:0/2058615797 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f33940cf830 con 0x7f33a0076ba0 2024-09-12T02:48:15.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.346+0000 7f33a4c00640 1 --2- 172.21.15.18:0/2058615797 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f33880a2bb0 0x7f33880a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:15.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.347+0000 7f33a4c00640 1 --2- 172.21.15.18:0/2058615797 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f33880a2bb0 0x7f33880a5070 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f338c0314e0 tx=0x7f338c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:15.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.350+0000 7f339e000640 1 -- 172.21.15.18:0/2058615797 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f339409c380 con 0x7f33a0076ba0 2024-09-12T02:48:15.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.598+0000 7f33a8000640 1 -- 172.21.15.18:0/2058615797 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f33a0062df0 con 0x7f33a0076ba0 2024-09-12T02:48:15.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.602+0000 7f339e000640 1 -- 172.21.15.18:0/2058615797 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) ==== 76+0+3124 (secure 0 0 0) 0x7f339409bc80 con 0x7f33a0076ba0 2024-09-12T02:48:15.604 INFO:teuthology.orchestra.run.smithi018.stdout:e29 2024-09-12T02:48:15.604 INFO:teuthology.orchestra.run.smithi018.stdout:btime 2024-09-12T02:46:36:660732+0000 2024-09-12T02:48:15.605 INFO:teuthology.orchestra.run.smithi018.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T02:48:15.605 INFO:teuthology.orchestra.run.smithi018.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:48:15.605 INFO:teuthology.orchestra.run.smithi018.stdout:legacy client fscid: 1 2024-09-12T02:48:15.605 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:48:15.605 INFO:teuthology.orchestra.run.smithi018.stdout:Filesystem 'cephfs' (1) 2024-09-12T02:48:15.605 INFO:teuthology.orchestra.run.smithi018.stdout:fs_name cephfs 2024-09-12T02:48:15.605 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 29 2024-09-12T02:48:15.605 INFO:teuthology.orchestra.run.smithi018.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-12T02:48:15.605 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-09-12T02:45:36.564696+0000 2024-09-12T02:48:15.605 INFO:teuthology.orchestra.run.smithi018.stdout:modified 2024-09-12T02:46:35.796320+0000 2024-09-12T02:48:15.605 INFO:teuthology.orchestra.run.smithi018.stdout:tableserver 0 2024-09-12T02:48:15.605 INFO:teuthology.orchestra.run.smithi018.stdout:root 0 2024-09-12T02:48:15.605 INFO:teuthology.orchestra.run.smithi018.stdout:session_timeout 300 2024-09-12T02:48:15.606 INFO:teuthology.orchestra.run.smithi018.stdout:session_autoclose 300 2024-09-12T02:48:15.606 INFO:teuthology.orchestra.run.smithi018.stdout:max_file_size 1099511627776 2024-09-12T02:48:15.606 INFO:teuthology.orchestra.run.smithi018.stdout:max_xattr_size 65536 2024-09-12T02:48:15.606 INFO:teuthology.orchestra.run.smithi018.stdout:required_client_features {} 2024-09-12T02:48:15.606 INFO:teuthology.orchestra.run.smithi018.stdout:last_failure 0 2024-09-12T02:48:15.606 INFO:teuthology.orchestra.run.smithi018.stdout:last_failure_osd_epoch 0 2024-09-12T02:48:15.606 INFO:teuthology.orchestra.run.smithi018.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:48:15.606 INFO:teuthology.orchestra.run.smithi018.stdout:max_mds 5 2024-09-12T02:48:15.606 INFO:teuthology.orchestra.run.smithi018.stdout:in 0,1,2,3,4 2024-09-12T02:48:15.606 INFO:teuthology.orchestra.run.smithi018.stdout:up {0=24527,1=24526,2=24508,3=24493,4=24488} 2024-09-12T02:48:15.606 INFO:teuthology.orchestra.run.smithi018.stdout:failed 2024-09-12T02:48:15.606 INFO:teuthology.orchestra.run.smithi018.stdout:damaged 2024-09-12T02:48:15.606 INFO:teuthology.orchestra.run.smithi018.stdout:stopped 2024-09-12T02:48:15.606 INFO:teuthology.orchestra.run.smithi018.stdout:data_pools [3,4] 2024-09-12T02:48:15.607 INFO:teuthology.orchestra.run.smithi018.stdout:metadata_pool 2 2024-09-12T02:48:15.607 INFO:teuthology.orchestra.run.smithi018.stdout:inline_data disabled 2024-09-12T02:48:15.607 INFO:teuthology.orchestra.run.smithi018.stdout:balancer 2024-09-12T02:48:15.607 INFO:teuthology.orchestra.run.smithi018.stdout:bal_rank_mask -1 2024-09-12T02:48:15.607 INFO:teuthology.orchestra.run.smithi018.stdout:standby_count_wanted 0 2024-09-12T02:48:15.607 INFO:teuthology.orchestra.run.smithi018.stdout:qdb_cluster leader: 24527 members: 24488,24527,24493,24508,24526 2024-09-12T02:48:15.607 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b{0:24527} state up:active seq 5 addr [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:48:15.607 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.f{0:24481} state up:standby-replay seq 1 addr [v2:172.21.15.176:6834/3199321182,v1:172.21.15.176:6835/3199321182] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:48:15.607 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a{1:24526} state up:active seq 19 addr [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:48:15.607 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.e{1:24464} state up:standby-replay seq 1 addr [v2:172.21.15.62:6834/564392030,v1:172.21.15.62:6835/564392030] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:48:15.607 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.i{2:24508} state up:active seq 21 addr [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:48:15.607 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.j{2:24451} state up:standby-replay seq 1 addr [v2:172.21.15.18:6834/43234729,v1:172.21.15.18:6835/43234729] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:48:15.607 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c{3:24493} state up:active seq 23 addr [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:48:15.607 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.l{3:24439} state up:standby-replay seq 1 addr [v2:172.21.15.176:6832/1988054318,v1:172.21.15.176:6833/1988054318] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:48:15.608 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.h{4:24488} state up:active seq 23 addr [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:48:15.608 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.k{4:24434} state up:standby-replay seq 1 addr [v2:172.21.15.62:6832/1160389785,v1:172.21.15.62:6833/1160389785] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:48:15.608 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:48:15.608 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:48:15.608 INFO:teuthology.orchestra.run.smithi018.stdout:Standby daemons: 2024-09-12T02:48:15.608 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:48:15.608 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d{-1:14463} state up:standby seq 1 addr [v2:172.21.15.18:6836/747069368,v1:172.21.15.18:6837/747069368] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:48:15.608 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.g{-1:14499} state up:standby seq 1 addr [v2:172.21.15.18:6838/4056752027,v1:172.21.15.18:6839/4056752027] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:48:15.609 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 29 2024-09-12T02:48:15.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.605+0000 7f33a8000640 1 -- 172.21.15.18:0/2058615797 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f33880a2bb0 msgr2=0x7f33880a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:15.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.605+0000 7f33a8000640 1 --2- 172.21.15.18:0/2058615797 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f33880a2bb0 0x7f33880a5070 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f338c0314e0 tx=0x7f338c000bc0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.605+0000 7f33a8000640 1 -- 172.21.15.18:0/2058615797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33a0076ba0 msgr2=0x7f33a019e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:15.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.605+0000 7f33a8000640 1 --2- 172.21.15.18:0/2058615797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33a0076ba0 0x7f33a019e4d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f339400e9f0 tx=0x7f339400edf0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.605+0000 7f33a8000640 1 -- 172.21.15.18:0/2058615797 shutdown_connections 2024-09-12T02:48:15.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.605+0000 7f33a8000640 1 --2- 172.21.15.18:0/2058615797 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f33880a2bb0 0x7f33880a5070 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.605+0000 7f33a8000640 1 --2- 172.21.15.18:0/2058615797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a0078790 0x7f33a01a5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.605+0000 7f33a8000640 1 --2- 172.21.15.18:0/2058615797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a0077df0 0x7f33a019ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.605+0000 7f33a8000640 1 --2- 172.21.15.18:0/2058615797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33a0076ba0 0x7f33a019e4d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:15.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.605+0000 7f33a8000640 1 -- 172.21.15.18:0/2058615797 >> 172.21.15.18:0/2058615797 conn(0x7f33a00ff5b0 msgr2=0x7f33a0101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:15.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.605+0000 7f33a8000640 1 -- 172.21.15.18:0/2058615797 shutdown_connections 2024-09-12T02:48:15.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:15.605+0000 7f33a8000640 1 -- 172.21.15.18:0/2058615797 wait complete. 2024-09-12T02:48:16.607 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7666100-70af-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-12T02:48:16.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:16 smithi018 ceph-mon[30616]: pgmap v390: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-12T02:48:16.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:16 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2058615797' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:48:16.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:16 smithi176 ceph-mon[35713]: pgmap v390: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-12T02:48:16.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:16 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2058615797' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:48:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:17.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:16 smithi062 ceph-mon[35527]: pgmap v390: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-12T02:48:17.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:16 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2058615797' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:48:17.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.667+0000 7f2aaea00640 1 -- 172.21.15.18:0/2383985444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aa8105810 msgr2=0x7f2aa810c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:17.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.667+0000 7f2aaea00640 1 --2- 172.21.15.18:0/2383985444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aa8105810 0x7f2aa810c0a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009ca0 tx=0x7f2aa002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:48:17.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.667+0000 7f2aaea00640 1 -- 172.21.15.18:0/2383985444 shutdown_connections 2024-09-12T02:48:17.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.667+0000 7f2aaea00640 1 --2- 172.21.15.18:0/2383985444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aa8105810 0x7f2aa810c0a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:17.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.667+0000 7f2aaea00640 1 --2- 172.21.15.18:0/2383985444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2aa8104e50 0x7f2aa81052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:17.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.667+0000 7f2aaea00640 1 --2- 172.21.15.18:0/2383985444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aa8103c50 0x7f2aa8104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:17.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.667+0000 7f2aaea00640 1 -- 172.21.15.18:0/2383985444 >> 172.21.15.18:0/2383985444 conn(0x7f2aa80ff3e0 msgr2=0x7f2aa8101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:17.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.667+0000 7f2aaea00640 1 -- 172.21.15.18:0/2383985444 shutdown_connections 2024-09-12T02:48:17.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.667+0000 7f2aaea00640 1 -- 172.21.15.18:0/2383985444 wait complete. 2024-09-12T02:48:17.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.668+0000 7f2aaea00640 1 Processor -- start 2024-09-12T02:48:17.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.669+0000 7f2aaea00640 1 -- start start 2024-09-12T02:48:17.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.669+0000 7f2aaea00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2aa8103c50 0x7f2aa8199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:17.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.669+0000 7f2aaea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aa8104e50 0x7f2aa819a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:17.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.669+0000 7f2aaea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aa8105810 0x7f2aa81a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:17.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.669+0000 7f2aaea00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa810f8d0 con 0x7f2aa8104e50 2024-09-12T02:48:17.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.669+0000 7f2aaea00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa810f750 con 0x7f2aa8105810 2024-09-12T02:48:17.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.669+0000 7f2aaea00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa810fa50 con 0x7f2aa8103c50 2024-09-12T02:48:17.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.669+0000 7f2aacc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aa8104e50 0x7f2aa819a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:17.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.669+0000 7f2aae000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aa8105810 0x7f2aa81a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:17.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.669+0000 7f2aad600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2aa8103c50 0x7f2aa8199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:17.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.669+0000 7f2aae000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aa8105810 0x7f2aa81a1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:51040/0 (socket says 172.21.15.18:51040) 2024-09-12T02:48:17.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.669+0000 7f2aae000640 1 -- 172.21.15.18:0/2647100211 learned_addr learned my addr 172.21.15.18:0/2647100211 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:17.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.670+0000 7f2aad600640 1 -- 172.21.15.18:0/2647100211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aa8105810 msgr2=0x7f2aa81a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:17.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.670+0000 7f2aad600640 1 --2- 172.21.15.18:0/2647100211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aa8105810 0x7f2aa81a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:17.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.670+0000 7f2aad600640 1 -- 172.21.15.18:0/2647100211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aa8104e50 msgr2=0x7f2aa819a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:17.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.670+0000 7f2aad600640 1 --2- 172.21.15.18:0/2647100211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aa8104e50 0x7f2aa819a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:17.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.670+0000 7f2aad600640 1 -- 172.21.15.18:0/2647100211 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa81a1ad0 con 0x7f2aa8103c50 2024-09-12T02:48:17.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.670+0000 7f2aad600640 1 --2- 172.21.15.18:0/2647100211 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2aa8103c50 0x7f2aa8199ea0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00e9c0 tx=0x7f2a9c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:17.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.670+0000 7f2aa6000640 1 -- 172.21.15.18:0/2647100211 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c00cd80 con 0x7f2aa8103c50 2024-09-12T02:48:17.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.671+0000 7f2aaea00640 1 -- 172.21.15.18:0/2647100211 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aa81a1dc0 con 0x7f2aa8103c50 2024-09-12T02:48:17.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.671+0000 7f2aa6000640 1 -- 172.21.15.18:0/2647100211 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a9c010910 con 0x7f2aa8103c50 2024-09-12T02:48:17.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.671+0000 7f2aa6000640 1 -- 172.21.15.18:0/2647100211 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c018980 con 0x7f2aa8103c50 2024-09-12T02:48:17.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.671+0000 7f2aaea00640 1 -- 172.21.15.18:0/2647100211 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aa81a2270 con 0x7f2aa8103c50 2024-09-12T02:48:17.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.672+0000 7f2aaea00640 1 -- 172.21.15.18:0/2647100211 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aa810af80 con 0x7f2aa8103c50 2024-09-12T02:48:17.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.674+0000 7f2aa6000640 1 -- 172.21.15.18:0/2647100211 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2a9c01f020 con 0x7f2aa8103c50 2024-09-12T02:48:17.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.675+0000 7f2aa6000640 1 --2- 172.21.15.18:0/2647100211 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2a900a2c30 0x7f2a900a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:17.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.675+0000 7f2aa6000640 1 -- 172.21.15.18:0/2647100211 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f2a9c0cf460 con 0x7f2aa8103c50 2024-09-12T02:48:17.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.675+0000 7f2aacc00640 1 --2- 172.21.15.18:0/2647100211 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2a900a2c30 0x7f2a900a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:17.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.676+0000 7f2aacc00640 1 --2- 172.21.15.18:0/2647100211 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2a900a2c30 0x7f2a900a50f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2aa819b3c0 tx=0x7f2a94005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:17.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.677+0000 7f2aa6000640 1 -- 172.21.15.18:0/2647100211 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a9c09bff0 con 0x7f2aa8103c50 2024-09-12T02:48:17.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.862+0000 7f2aaea00640 1 -- 172.21.15.18:0/2647100211 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f2aa802da20 con 0x7f2aa8103c50 2024-09-12T02:48:17.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.864+0000 7f2aa6000640 1 -- 172.21.15.18:0/2647100211 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v98) ==== 56+0+5678 (secure 0 0 0) 0x7f2a9c09b8f0 con 0x7f2aa8103c50 2024-09-12T02:48:17.865 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 98 2024-09-12T02:48:17.865 INFO:teuthology.orchestra.run.smithi018.stdout:fsid c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T02:48:17.865 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-09-12T02:37:14.139566+0000 2024-09-12T02:48:17.866 INFO:teuthology.orchestra.run.smithi018.stdout:modified 2024-09-12T02:47:12.605245+0000 2024-09-12T02:48:17.866 INFO:teuthology.orchestra.run.smithi018.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T02:48:17.866 INFO:teuthology.orchestra.run.smithi018.stdout:crush_version 27 2024-09-12T02:48:17.866 INFO:teuthology.orchestra.run.smithi018.stdout:full_ratio 0.95 2024-09-12T02:48:17.866 INFO:teuthology.orchestra.run.smithi018.stdout:backfillfull_ratio 0.9 2024-09-12T02:48:17.866 INFO:teuthology.orchestra.run.smithi018.stdout:nearfull_ratio 0.85 2024-09-12T02:48:17.866 INFO:teuthology.orchestra.run.smithi018.stdout:require_min_compat_client luminous 2024-09-12T02:48:17.866 INFO:teuthology.orchestra.run.smithi018.stdout:min_compat_client luminous 2024-09-12T02:48:17.866 INFO:teuthology.orchestra.run.smithi018.stdout:require_osd_release squid 2024-09-12T02:48:17.866 INFO:teuthology.orchestra.run.smithi018.stdout:stretch_mode_enabled false 2024-09-12T02:48:17.866 INFO:teuthology.orchestra.run.smithi018.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-12T02:48:17.866 INFO:teuthology.orchestra.run.smithi018.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 87 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-12T02:48:17.867 INFO:teuthology.orchestra.run.smithi018.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 87 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-12T02:48:17.867 INFO:teuthology.orchestra.run.smithi018.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 94 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-12T02:48:17.867 INFO:teuthology.orchestra.run.smithi018.stdout:max_osd 12 2024-09-12T02:48:17.867 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 up in weight 1 up_from 8 up_thru 97 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6802/2278662522,v1:172.21.15.18:6803/2278662522] [v2:172.21.15.18:6804/2278662522,v1:172.21.15.18:6805/2278662522] exists,up a61ecdc1-ceb9-43cb-a67d-b197888cca42 2024-09-12T02:48:17.867 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 up in weight 1 up_from 13 up_thru 95 down_at 0 last_clean_interval [0,0) [v2:172.21.15.62:6800/3139630617,v1:172.21.15.62:6801/3139630617] [v2:172.21.15.62:6802/3139630617,v1:172.21.15.62:6803/3139630617] exists,up 1b84f4be-23ce-466c-b974-b9851521785d 2024-09-12T02:48:17.867 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2 up in weight 1 up_from 18 up_thru 97 down_at 0 last_clean_interval [0,0) [v2:172.21.15.176:6800/2704054654,v1:172.21.15.176:6801/2704054654] [v2:172.21.15.176:6802/2704054654,v1:172.21.15.176:6803/2704054654] exists,up f7bdf028-db32-4d92-a039-bada37c3a146 2024-09-12T02:48:17.867 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 up in weight 1 up_from 25 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6810/3378134261,v1:172.21.15.18:6811/3378134261] [v2:172.21.15.18:6812/3378134261,v1:172.21.15.18:6813/3378134261] exists,up 39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357 2024-09-12T02:48:17.867 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 up in weight 1 up_from 33 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.62:6808/1416302860,v1:172.21.15.62:6809/1416302860] [v2:172.21.15.62:6810/1416302860,v1:172.21.15.62:6811/1416302860] exists,up 66a2c8a0-1a99-4c6d-b56a-f1f6c3199655 2024-09-12T02:48:17.867 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 up in weight 1 up_from 38 up_thru 95 down_at 0 last_clean_interval [0,0) [v2:172.21.15.176:6808/2234269387,v1:172.21.15.176:6809/2234269387] [v2:172.21.15.176:6810/2234269387,v1:172.21.15.176:6811/2234269387] exists,up c4070ecf-703a-4f5f-9a2b-63473ff7f98f 2024-09-12T02:48:17.867 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6 up in weight 1 up_from 46 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6818/3613955982,v1:172.21.15.18:6819/3613955982] [v2:172.21.15.18:6820/3613955982,v1:172.21.15.18:6821/3613955982] exists,up 12a08874-041e-4734-bc33-68ebfce97b2b 2024-09-12T02:48:17.867 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7 up in weight 1 up_from 51 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.62:6816/750933013,v1:172.21.15.62:6817/750933013] [v2:172.21.15.62:6818/750933013,v1:172.21.15.62:6819/750933013] exists,up 86a5b47c-143f-4848-892f-c7b6a17a2799 2024-09-12T02:48:17.867 INFO:teuthology.orchestra.run.smithi018.stdout:osd.8 up in weight 1 up_from 59 up_thru 95 down_at 0 last_clean_interval [0,0) [v2:172.21.15.176:6816/8496953,v1:172.21.15.176:6817/8496953] [v2:172.21.15.176:6818/8496953,v1:172.21.15.176:6819/8496953] exists,up 0426a455-ed11-4d6a-8e1d-c8aa2ee65cae 2024-09-12T02:48:17.867 INFO:teuthology.orchestra.run.smithi018.stdout:osd.9 up in weight 1 up_from 66 up_thru 95 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6826/422514390,v1:172.21.15.18:6827/422514390] [v2:172.21.15.18:6828/422514390,v1:172.21.15.18:6829/422514390] exists,up 241aa2cf-0765-465d-b400-4911e653412a 2024-09-12T02:48:17.868 INFO:teuthology.orchestra.run.smithi018.stdout:osd.10 up in weight 1 up_from 71 up_thru 95 down_at 0 last_clean_interval [0,0) [v2:172.21.15.62:6824/269877918,v1:172.21.15.62:6825/269877918] [v2:172.21.15.62:6826/269877918,v1:172.21.15.62:6827/269877918] exists,up b1d4ab1f-0ec4-4641-bab0-f39d15857615 2024-09-12T02:48:17.868 INFO:teuthology.orchestra.run.smithi018.stdout:osd.11 up in weight 1 up_from 79 up_thru 97 down_at 0 last_clean_interval [0,0) [v2:172.21.15.176:6824/770358485,v1:172.21.15.176:6825/770358485] [v2:172.21.15.176:6826/770358485,v1:172.21.15.176:6827/770358485] exists,up d122f1bf-bd4f-45d5-b07c-7301b005977c 2024-09-12T02:48:17.868 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.5 [8,11] 2024-09-12T02:48:17.868 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.10 [2,1,8,11] 2024-09-12T02:48:17.868 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.1b [2,4] 2024-09-12T02:48:17.868 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.e [5,9] 2024-09-12T02:48:17.868 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.14 [1,9] 2024-09-12T02:48:17.868 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.1b [4,7] 2024-09-12T02:48:17.868 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.1d [5,9] 2024-09-12T02:48:17.868 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.21 [4,8] 2024-09-12T02:48:17.868 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.2a [3,8] 2024-09-12T02:48:17.868 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.3a [4,6] 2024-09-12T02:48:17.868 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 4.3 [5,8] 2024-09-12T02:48:17.868 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 4.b [9,10] 2024-09-12T02:48:17.869 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 4.19 [9,8] 2024-09-12T02:48:17.869 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 4.1f [9,8] 2024-09-12T02:48:17.869 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/2679362143 expires 2024-09-13T02:38:10.525951+0000 2024-09-12T02:48:17.869 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/4236556151 expires 2024-09-13T02:38:10.525951+0000 2024-09-12T02:48:17.869 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6801/3271799053 expires 2024-09-13T02:38:10.525951+0000 2024-09-12T02:48:17.869 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6800/3271799053 expires 2024-09-13T02:38:10.525951+0000 2024-09-12T02:48:17.869 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/1197309398 expires 2024-09-13T02:37:40.790128+0000 2024-09-12T02:48:17.869 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/3024661873 expires 2024-09-13T02:38:10.525951+0000 2024-09-12T02:48:17.869 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/2429098892 expires 2024-09-13T02:37:40.790128+0000 2024-09-12T02:48:17.869 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6801/601880715 expires 2024-09-13T02:37:40.790128+0000 2024-09-12T02:48:17.869 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6800/601880715 expires 2024-09-13T02:37:40.790128+0000 2024-09-12T02:48:17.869 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/1531572357 expires 2024-09-13T02:37:40.790128+0000 2024-09-12T02:48:17.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.866+0000 7f2aaea00640 1 -- 172.21.15.18:0/2647100211 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2a900a2c30 msgr2=0x7f2a900a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:17.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.866+0000 7f2aaea00640 1 --2- 172.21.15.18:0/2647100211 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2a900a2c30 0x7f2a900a50f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2aa819b3c0 tx=0x7f2a94005f90 comp rx=0 tx=0).stop 2024-09-12T02:48:17.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.866+0000 7f2aaea00640 1 -- 172.21.15.18:0/2647100211 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2aa8103c50 msgr2=0x7f2aa8199ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:17.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.866+0000 7f2aaea00640 1 --2- 172.21.15.18:0/2647100211 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2aa8103c50 0x7f2aa8199ea0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00e9c0 tx=0x7f2a9c00ee80 comp rx=0 tx=0).stop 2024-09-12T02:48:17.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.866+0000 7f2aaea00640 1 -- 172.21.15.18:0/2647100211 shutdown_connections 2024-09-12T02:48:17.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.866+0000 7f2aaea00640 1 --2- 172.21.15.18:0/2647100211 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f2a900a2c30 0x7f2a900a50f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:17.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.866+0000 7f2aaea00640 1 --2- 172.21.15.18:0/2647100211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aa8105810 0x7f2aa81a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:17.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.866+0000 7f2aaea00640 1 --2- 172.21.15.18:0/2647100211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aa8104e50 0x7f2aa819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:17.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.866+0000 7f2aaea00640 1 --2- 172.21.15.18:0/2647100211 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2aa8103c50 0x7f2aa8199ea0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:17.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.866+0000 7f2aaea00640 1 -- 172.21.15.18:0/2647100211 >> 172.21.15.18:0/2647100211 conn(0x7f2aa80ff3e0 msgr2=0x7f2aa8108150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:17.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.867+0000 7f2aaea00640 1 -- 172.21.15.18:0/2647100211 shutdown_connections 2024-09-12T02:48:17.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:17.867+0000 7f2aaea00640 1 -- 172.21.15.18:0/2647100211 wait complete. 2024-09-12T02:48:18.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:18 smithi018 ceph-mon[30616]: pgmap v391: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:48:18.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:18 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2647100211' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:48:18.905 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-12T02:48:18.917 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:48:18.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:18 smithi176 ceph-mon[35713]: pgmap v391: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:48:18.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:18 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2647100211' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:48:19.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:18 smithi062 ceph-mon[35527]: pgmap v391: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:48:19.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:18 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2647100211' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:48:19.296 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:19.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.874+0000 7f69fa400640 1 -- 172.21.15.18:0/2526891131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69f4109120 msgr2=0x7f69f4110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:19.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.874+0000 7f69fa400640 1 --2- 172.21.15.18:0/2526891131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69f4109120 0x7f69f4110ca0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f69ec009ca0 tx=0x7f69ec02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.874+0000 7f69fa400640 1 -- 172.21.15.18:0/2526891131 shutdown_connections 2024-09-12T02:48:19.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.874+0000 7f69fa400640 1 --2- 172.21.15.18:0/2526891131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69f4109120 0x7f69f4110ca0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.874+0000 7f69fa400640 1 --2- 172.21.15.18:0/2526891131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69f41049a0 0x7f69f41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.874+0000 7f69fa400640 1 --2- 172.21.15.18:0/2526891131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69f4103ff0 0x7f69f41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.874+0000 7f69fa400640 1 -- 172.21.15.18:0/2526891131 >> 172.21.15.18:0/2526891131 conn(0x7f69f40ffa90 msgr2=0x7f69f4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:19.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.875+0000 7f69fa400640 1 -- 172.21.15.18:0/2526891131 shutdown_connections 2024-09-12T02:48:19.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.875+0000 7f69fa400640 1 -- 172.21.15.18:0/2526891131 wait complete. 2024-09-12T02:48:19.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.875+0000 7f69fa400640 1 Processor -- start 2024-09-12T02:48:19.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.876+0000 7f69fa400640 1 -- start start 2024-09-12T02:48:19.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.876+0000 7f69fa400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69f4103ff0 0x7f69f419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.876+0000 7f69fa400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69f41049a0 0x7f69f419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.876+0000 7f69fa400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69f4109120 0x7f69f419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.876+0000 7f69fa400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f69f4114150 con 0x7f69f4103ff0 2024-09-12T02:48:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.876+0000 7f69fa400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f69f4113fd0 con 0x7f69f41049a0 2024-09-12T02:48:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.876+0000 7f69fa400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f69f41142d0 con 0x7f69f4109120 2024-09-12T02:48:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.876+0000 7f69f3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69f4103ff0 0x7f69f419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.876+0000 7f69f3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69f4103ff0 0x7f69f419a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55346/0 (socket says 172.21.15.18:55346) 2024-09-12T02:48:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.876+0000 7f69f3400640 1 -- 172.21.15.18:0/2230478138 learned_addr learned my addr 172.21.15.18:0/2230478138 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.876+0000 7f69f2a00640 1 --2- 172.21.15.18:0/2230478138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69f41049a0 0x7f69f419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.876+0000 7f69f3e00640 1 --2- 172.21.15.18:0/2230478138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69f4109120 0x7f69f419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.877+0000 7f69f3400640 1 -- 172.21.15.18:0/2230478138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69f4109120 msgr2=0x7f69f419ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.877+0000 7f69f3400640 1 --2- 172.21.15.18:0/2230478138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69f4109120 0x7f69f419ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.877+0000 7f69f3400640 1 -- 172.21.15.18:0/2230478138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69f41049a0 msgr2=0x7f69f419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:19.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.877+0000 7f69f3400640 1 --2- 172.21.15.18:0/2230478138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69f41049a0 0x7f69f419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:19.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.877+0000 7f69f3400640 1 -- 172.21.15.18:0/2230478138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f419f560 con 0x7f69f4103ff0 2024-09-12T02:48:19.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.877+0000 7f69f3e00640 1 --2- 172.21.15.18:0/2230478138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69f4109120 0x7f69f419ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:19.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.877+0000 7f69f3400640 1 --2- 172.21.15.18:0/2230478138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69f4103ff0 0x7f69f419a5b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f69e400ea60 tx=0x7f69e400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:19.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.877+0000 7f69ebe00640 1 -- 172.21.15.18:0/2230478138 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e400cde0 con 0x7f69f4103ff0 2024-09-12T02:48:19.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.877+0000 7f69ebe00640 1 -- 172.21.15.18:0/2230478138 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69e40035f0 con 0x7f69f4103ff0 2024-09-12T02:48:19.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.877+0000 7f69ebe00640 1 -- 172.21.15.18:0/2230478138 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e4010670 con 0x7f69f4103ff0 2024-09-12T02:48:19.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.878+0000 7f69fa400640 1 -- 172.21.15.18:0/2230478138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f419f850 con 0x7f69f4103ff0 2024-09-12T02:48:19.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.878+0000 7f69fa400640 1 -- 172.21.15.18:0/2230478138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f41a7130 con 0x7f69f4103ff0 2024-09-12T02:48:19.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.879+0000 7f69fa400640 1 -- 172.21.15.18:0/2230478138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f41043d0 con 0x7f69f4103ff0 2024-09-12T02:48:19.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.881+0000 7f69ebe00640 1 -- 172.21.15.18:0/2230478138 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f69e40037a0 con 0x7f69f4103ff0 2024-09-12T02:48:19.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.883+0000 7f69ebe00640 1 --2- 172.21.15.18:0/2230478138 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f69d80a2b80 0x7f69d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:19.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.883+0000 7f69ebe00640 1 -- 172.21.15.18:0/2230478138 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f69e40cf7f0 con 0x7f69f4103ff0 2024-09-12T02:48:19.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.883+0000 7f69f2a00640 1 --2- 172.21.15.18:0/2230478138 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f69d80a2b80 0x7f69d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:19.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.884+0000 7f69f2a00640 1 --2- 172.21.15.18:0/2230478138 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f69d80a2b80 0x7f69d80a5040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f69f40ffeb0 tx=0x7f69e000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:19.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:19.888+0000 7f69ebe00640 1 -- 172.21.15.18:0/2230478138 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f69e409c340 con 0x7f69f4103ff0 2024-09-12T02:48:20.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:20.108+0000 7f69fa400640 1 -- 172.21.15.18:0/2230478138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69f419b910 con 0x7f69f4103ff0 2024-09-12T02:48:20.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:20.109+0000 7f69ebe00640 1 -- 172.21.15.18:0/2230478138 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11966 (secure 0 0 0) 0x7f69e409bc40 con 0x7f69f4103ff0 2024-09-12T02:48:20.110 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:48:20.111 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"btime":"2024-09-12T02:46:36:660732+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/747069368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":747069368},{"type":"v1","addr":"172.21.15.18:6837","nonce":747069368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/4056752027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4056752027},{"type":"v1","addr":"172.21.15.18:6839","nonce":4056752027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:45:36.564696+0000","modified":"2024-09-12T02:46:35.796320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24527,"mds_1":24526,"mds_2":24508,"mds_3":24493,"mds_4":24488},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/43234729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":43234729},{"type":"v1","addr":"172.21.15.18:6835","nonce":43234729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6835/564392030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":564392030},{"type":"v1","addr":"172.21.15.62:6835","nonce":564392030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6835/3199321182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3199321182},{"type":"v1","addr":"172.21.15.176:6835","nonce":3199321182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.62:6837/3520593627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3520593627},{"type":"v1","addr":"172.21.15.62:6837","nonce":3520593627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":23,"addr":"172.21.15.176:6837/4286557016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4286557016},{"type":"v1","addr":"172.21.15.176:6837","nonce":4286557016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.176:6839/3957634398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":3957634398},{"type":"v1","addr":"172.21.15.176:6839","nonce":3957634398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"a","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.18:6841/823308007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":823308007},{"type":"v1","addr":"172.21.15.18:6841","nonce":823308007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/3744347102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3744347102},{"type":"v1","addr":"172.21.15.62:6839","nonce":3744347102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24488,24527,24493,24508,24526]},"id":1}]} 2024-09-12T02:48:20.111 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 29 2024-09-12T02:48:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:20.111+0000 7f69fa400640 1 -- 172.21.15.18:0/2230478138 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f69d80a2b80 msgr2=0x7f69d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:20.111+0000 7f69fa400640 1 --2- 172.21.15.18:0/2230478138 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f69d80a2b80 0x7f69d80a5040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f69f40ffeb0 tx=0x7f69e000b390 comp rx=0 tx=0).stop 2024-09-12T02:48:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:20.111+0000 7f69fa400640 1 -- 172.21.15.18:0/2230478138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69f4103ff0 msgr2=0x7f69f419a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:20.111+0000 7f69fa400640 1 --2- 172.21.15.18:0/2230478138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69f4103ff0 0x7f69f419a5b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f69e400ea60 tx=0x7f69e400ef20 comp rx=0 tx=0).stop 2024-09-12T02:48:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:20.111+0000 7f69fa400640 1 -- 172.21.15.18:0/2230478138 shutdown_connections 2024-09-12T02:48:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:20.111+0000 7f69fa400640 1 --2- 172.21.15.18:0/2230478138 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f69d80a2b80 0x7f69d80a5040 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:20.111+0000 7f69fa400640 1 --2- 172.21.15.18:0/2230478138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69f4109120 0x7f69f419ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:20.111+0000 7f69fa400640 1 --2- 172.21.15.18:0/2230478138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69f41049a0 0x7f69f419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:20.111+0000 7f69fa400640 1 --2- 172.21.15.18:0/2230478138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69f4103ff0 0x7f69f419a5b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:20.111+0000 7f69fa400640 1 -- 172.21.15.18:0/2230478138 >> 172.21.15.18:0/2230478138 conn(0x7f69f40ffa90 msgr2=0x7f69f4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:20.111+0000 7f69fa400640 1 -- 172.21.15.18:0/2230478138 shutdown_connections 2024-09-12T02:48:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:20.112+0000 7f69fa400640 1 -- 172.21.15.18:0/2230478138 wait complete. 2024-09-12T02:48:20.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:20 smithi018 ceph-mon[30616]: pgmap v392: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:48:20.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:20 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2230478138' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:20.923 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:48:20.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:20 smithi176 ceph-mon[35713]: pgmap v392: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:48:20.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:20 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2230478138' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:21.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:20 smithi062 ceph-mon[35527]: pgmap v392: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:48:21.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:20 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2230478138' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:21.301 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:21.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.918+0000 7faae7200640 1 -- 172.21.15.18:0/3001529455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae01079c0 msgr2=0x7faae0107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:21.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.918+0000 7faae7200640 1 --2- 172.21.15.18:0/3001529455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae01079c0 0x7faae0107da0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faad4009930 tx=0x7faad402a420 comp rx=0 tx=0).stop 2024-09-12T02:48:21.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.918+0000 7faae7200640 1 -- 172.21.15.18:0/3001529455 shutdown_connections 2024-09-12T02:48:21.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.918+0000 7faae7200640 1 --2- 172.21.15.18:0/3001529455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faae0102360 0x7faae010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.918+0000 7faae7200640 1 --2- 172.21.15.18:0/3001529455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faae01019c0 0x7faae0101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.918+0000 7faae7200640 1 --2- 172.21.15.18:0/3001529455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae01079c0 0x7faae0107da0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.918+0000 7faae7200640 1 -- 172.21.15.18:0/3001529455 >> 172.21.15.18:0/3001529455 conn(0x7faae00fd740 msgr2=0x7faae00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:21.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.918+0000 7faae7200640 1 -- 172.21.15.18:0/3001529455 shutdown_connections 2024-09-12T02:48:21.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.918+0000 7faae7200640 1 -- 172.21.15.18:0/3001529455 wait complete. 2024-09-12T02:48:21.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.919+0000 7faae7200640 1 Processor -- start 2024-09-12T02:48:21.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.920+0000 7faae7200640 1 -- start start 2024-09-12T02:48:21.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.920+0000 7faae7200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faae01019c0 0x7faae019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.920+0000 7faae7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae0102360 0x7faae019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.920+0000 7faae7200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faae01079c0 0x7faae019edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.920+0000 7faae7200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faae0111dc0 con 0x7faae0102360 2024-09-12T02:48:21.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.920+0000 7faae7200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7faae0111c40 con 0x7faae01019c0 2024-09-12T02:48:21.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.920+0000 7faae7200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faae0111f40 con 0x7faae01079c0 2024-09-12T02:48:21.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.920+0000 7faae5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae0102360 0x7faae019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.920+0000 7faae5e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faae01019c0 0x7faae019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.920+0000 7faae5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae0102360 0x7faae019aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55354/0 (socket says 172.21.15.18:55354) 2024-09-12T02:48:21.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.920+0000 7faae5400640 1 -- 172.21.15.18:0/910386009 learned_addr learned my addr 172.21.15.18:0/910386009 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:21.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.921+0000 7faae6800640 1 --2- 172.21.15.18:0/910386009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faae01079c0 0x7faae019edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.921+0000 7faae5e00640 1 -- 172.21.15.18:0/910386009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faae01079c0 msgr2=0x7faae019edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:21.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.921+0000 7faae5e00640 1 --2- 172.21.15.18:0/910386009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faae01079c0 0x7faae019edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.921+0000 7faae5e00640 1 -- 172.21.15.18:0/910386009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae0102360 msgr2=0x7faae019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:21.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.921+0000 7faae5e00640 1 --2- 172.21.15.18:0/910386009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae0102360 0x7faae019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.921+0000 7faae5e00640 1 -- 172.21.15.18:0/910386009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae019f4b0 con 0x7faae01019c0 2024-09-12T02:48:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.921+0000 7faae5e00640 1 --2- 172.21.15.18:0/910386009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faae01019c0 0x7faae019a500 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faad4005940 tx=0x7faad4031b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.921+0000 7faadaa00640 1 -- 172.21.15.18:0/910386009 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad403f070 con 0x7faae01019c0 2024-09-12T02:48:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.921+0000 7faae7200640 1 -- 172.21.15.18:0/910386009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae019f740 con 0x7faae01019c0 2024-09-12T02:48:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.921+0000 7faadaa00640 1 -- 172.21.15.18:0/910386009 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faad4003ad0 con 0x7faae01019c0 2024-09-12T02:48:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.922+0000 7faadaa00640 1 -- 172.21.15.18:0/910386009 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4035070 con 0x7faae01019c0 2024-09-12T02:48:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.922+0000 7faae7200640 1 -- 172.21.15.18:0/910386009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae01a7080 con 0x7faae01019c0 2024-09-12T02:48:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.923+0000 7faae7200640 1 -- 172.21.15.18:0/910386009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faae0101e20 con 0x7faae01019c0 2024-09-12T02:48:21.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.925+0000 7faadaa00640 1 -- 172.21.15.18:0/910386009 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7faad40035f0 con 0x7faae01019c0 2024-09-12T02:48:21.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.926+0000 7faadaa00640 1 --2- 172.21.15.18:0/910386009 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faac80a2c00 0x7faac80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:21.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.926+0000 7faadaa00640 1 -- 172.21.15.18:0/910386009 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7faad40efad0 con 0x7faae01019c0 2024-09-12T02:48:21.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.926+0000 7faae5400640 1 --2- 172.21.15.18:0/910386009 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faac80a2c00 0x7faac80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:21.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.927+0000 7faae5400640 1 --2- 172.21.15.18:0/910386009 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faac80a2c00 0x7faac80a50c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faae010eac0 tx=0x7faad0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:21.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:21.928+0000 7faadaa00640 1 -- 172.21.15.18:0/910386009 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faad40bbfd0 con 0x7faae01019c0 2024-09-12T02:48:22.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:22.149+0000 7faae7200640 1 -- 172.21.15.18:0/910386009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faae019b860 con 0x7faae01019c0 2024-09-12T02:48:22.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:22.150+0000 7faadaa00640 1 -- 172.21.15.18:0/910386009 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11966 (secure 0 0 0) 0x7faad40c02d0 con 0x7faae01019c0 2024-09-12T02:48:22.152 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:48:22.152 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"btime":"2024-09-12T02:46:36:660732+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/747069368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":747069368},{"type":"v1","addr":"172.21.15.18:6837","nonce":747069368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/4056752027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4056752027},{"type":"v1","addr":"172.21.15.18:6839","nonce":4056752027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:45:36.564696+0000","modified":"2024-09-12T02:46:35.796320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24527,"mds_1":24526,"mds_2":24508,"mds_3":24493,"mds_4":24488},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/43234729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":43234729},{"type":"v1","addr":"172.21.15.18:6835","nonce":43234729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6835/564392030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":564392030},{"type":"v1","addr":"172.21.15.62:6835","nonce":564392030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6835/3199321182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3199321182},{"type":"v1","addr":"172.21.15.176:6835","nonce":3199321182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.62:6837/3520593627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3520593627},{"type":"v1","addr":"172.21.15.62:6837","nonce":3520593627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":23,"addr":"172.21.15.176:6837/4286557016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4286557016},{"type":"v1","addr":"172.21.15.176:6837","nonce":4286557016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.176:6839/3957634398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":3957634398},{"type":"v1","addr":"172.21.15.176:6839","nonce":3957634398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"a","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.18:6841/823308007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":823308007},{"type":"v1","addr":"172.21.15.18:6841","nonce":823308007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/3744347102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3744347102},{"type":"v1","addr":"172.21.15.62:6839","nonce":3744347102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24488,24527,24493,24508,24526]},"id":1}]} 2024-09-12T02:48:22.152 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 29 2024-09-12T02:48:22.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:22.153+0000 7faae7200640 1 -- 172.21.15.18:0/910386009 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faac80a2c00 msgr2=0x7faac80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:22.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:22.153+0000 7faae7200640 1 --2- 172.21.15.18:0/910386009 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faac80a2c00 0x7faac80a50c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faae010eac0 tx=0x7faad0005f90 comp rx=0 tx=0).stop 2024-09-12T02:48:22.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:22.153+0000 7faae7200640 1 -- 172.21.15.18:0/910386009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faae01019c0 msgr2=0x7faae019a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:22.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:22.153+0000 7faae7200640 1 --2- 172.21.15.18:0/910386009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faae01019c0 0x7faae019a500 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faad4005940 tx=0x7faad4031b50 comp rx=0 tx=0).stop 2024-09-12T02:48:22.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:22.153+0000 7faae7200640 1 -- 172.21.15.18:0/910386009 shutdown_connections 2024-09-12T02:48:22.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:22.153+0000 7faae7200640 1 --2- 172.21.15.18:0/910386009 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7faac80a2c00 0x7faac80a50c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:22.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:22.153+0000 7faae7200640 1 --2- 172.21.15.18:0/910386009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faae01079c0 0x7faae019edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:22.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:22.153+0000 7faae7200640 1 --2- 172.21.15.18:0/910386009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae0102360 0x7faae019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:22.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:22.153+0000 7faae7200640 1 --2- 172.21.15.18:0/910386009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faae01019c0 0x7faae019a500 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:22.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:22.153+0000 7faae7200640 1 -- 172.21.15.18:0/910386009 >> 172.21.15.18:0/910386009 conn(0x7faae00fd740 msgr2=0x7faae010cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:22.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:22.153+0000 7faae7200640 1 -- 172.21.15.18:0/910386009 shutdown_connections 2024-09-12T02:48:22.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:22.153+0000 7faae7200640 1 -- 172.21.15.18:0/910386009 wait complete. 2024-09-12T02:48:22.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:22 smithi018 ceph-mon[30616]: pgmap v393: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T02:48:22.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:22 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/910386009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:22.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:22 smithi176 ceph-mon[35713]: pgmap v393: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T02:48:22.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:22 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/910386009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:22.984 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:48:23.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:22 smithi062 ceph-mon[35527]: pgmap v393: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T02:48:23.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:22 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/910386009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:48:23.361 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:23.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.950+0000 7fb9ed800640 1 -- 172.21.15.18:0/2895836180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9e8112b90 msgr2=0x7fb9e8114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:23.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.950+0000 7fb9ed800640 1 --2- 172.21.15.18:0/2895836180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9e8112b90 0x7fb9e8114f80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009ca0 tx=0x7fb9e002a950 comp rx=0 tx=0).stop 2024-09-12T02:48:23.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.951+0000 7fb9ed800640 1 -- 172.21.15.18:0/2895836180 shutdown_connections 2024-09-12T02:48:23.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.951+0000 7fb9ed800640 1 --2- 172.21.15.18:0/2895836180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9e8112b90 0x7fb9e8114f80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.951+0000 7fb9ed800640 1 --2- 172.21.15.18:0/2895836180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9e8074eb0 0x7fb9e8112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.951+0000 7fb9ed800640 1 --2- 172.21.15.18:0/2895836180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9e8074590 0x7fb9e8074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.951+0000 7fb9ed800640 1 -- 172.21.15.18:0/2895836180 >> 172.21.15.18:0/2895836180 conn(0x7fb9e80fd8c0 msgr2=0x7fb9e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.951+0000 7fb9ed800640 1 -- 172.21.15.18:0/2895836180 shutdown_connections 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.951+0000 7fb9ed800640 1 -- 172.21.15.18:0/2895836180 wait complete. 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.952+0000 7fb9ed800640 1 Processor -- start 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.952+0000 7fb9ed800640 1 -- start start 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.952+0000 7fb9ed800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9e8074590 0x7fb9e81a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.952+0000 7fb9ed800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9e8074eb0 0x7fb9e81a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.952+0000 7fb9ed800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9e8112b90 0x7fb9e819e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.952+0000 7fb9ed800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e8118560 con 0x7fb9e8112b90 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.952+0000 7fb9ed800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e81183e0 con 0x7fb9e8074eb0 2024-09-12T02:48:23.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.952+0000 7fb9ed800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e81186e0 con 0x7fb9e8074590 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.952+0000 7fb9e6000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9e8074eb0 0x7fb9e81a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.952+0000 7fb9e7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9e8112b90 0x7fb9e819e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.952+0000 7fb9e6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9e8074590 0x7fb9e81a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.952+0000 7fb9e6000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9e8074eb0 0x7fb9e81a4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:51114/0 (socket says 172.21.15.18:51114) 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.952+0000 7fb9e6000640 1 -- 172.21.15.18:0/3466112342 learned_addr learned my addr 172.21.15.18:0/3466112342 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.953+0000 7fb9e7400640 1 -- 172.21.15.18:0/3466112342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9e8074590 msgr2=0x7fb9e81a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.953+0000 7fb9e7400640 1 --2- 172.21.15.18:0/3466112342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9e8074590 0x7fb9e81a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.953+0000 7fb9e7400640 1 -- 172.21.15.18:0/3466112342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9e8074eb0 msgr2=0x7fb9e81a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.953+0000 7fb9e7400640 1 --2- 172.21.15.18:0/3466112342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9e8074eb0 0x7fb9e81a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.953+0000 7fb9e7400640 1 -- 172.21.15.18:0/3466112342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e819eff0 con 0x7fb9e8112b90 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.953+0000 7fb9e7400640 1 --2- 172.21.15.18:0/3466112342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9e8112b90 0x7fb9e819e8c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb9e002ae70 tx=0x7fb9e002f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.953+0000 7fb9df400640 1 -- 172.21.15.18:0/3466112342 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0034040 con 0x7fb9e8112b90 2024-09-12T02:48:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.954+0000 7fb9ed800640 1 -- 172.21.15.18:0/3466112342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e819f280 con 0x7fb9e8112b90 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.954+0000 7fb9df400640 1 -- 172.21.15.18:0/3466112342 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9e0030920 con 0x7fb9e8112b90 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.954+0000 7fb9df400640 1 -- 172.21.15.18:0/3466112342 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0004720 con 0x7fb9e8112b90 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.954+0000 7fb9ed800640 1 -- 172.21.15.18:0/3466112342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e81ab5d0 con 0x7fb9e8112b90 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.955+0000 7fb9ed800640 1 -- 172.21.15.18:0/3466112342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e8074970 con 0x7fb9e8112b90 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.956+0000 7fb9df400640 1 -- 172.21.15.18:0/3466112342 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb9e0037020 con 0x7fb9e8112b90 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.958+0000 7fb9df400640 1 --2- 172.21.15.18:0/3466112342 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb9cc0a2b80 0x7fb9cc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.958+0000 7fb9df400640 1 -- 172.21.15.18:0/3466112342 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7fb9e00f02b0 con 0x7fb9e8112b90 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.958+0000 7fb9e6a00640 1 --2- 172.21.15.18:0/3466112342 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb9cc0a2b80 0x7fb9cc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.959+0000 7fb9e6a00640 1 --2- 172.21.15.18:0/3466112342 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb9cc0a2b80 0x7fb9cc0a5040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb9e819fa00 tx=0x7fb9d800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:23.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:23.962+0000 7fb9df400640 1 -- 172.21.15.18:0/3466112342 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb9e00bce00 con 0x7fb9e8112b90 2024-09-12T02:48:24.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:24.149+0000 7fb9ed800640 1 -- 172.21.15.18:0/3466112342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9e8104fd0 con 0x7fb9e8112b90 2024-09-12T02:48:24.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:24.151+0000 7fb9df400640 1 -- 172.21.15.18:0/3466112342 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+24861 (secure 0 0 0) 0x7fb9e00bc700 con 0x7fb9e8112b90 2024-09-12T02:48:24.152 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T02:48:24.153 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":98,"fsid":"c7666100-70af-11ef-bcea-c7b262605968","created":"2024-09-12T02:37:14.139566+0000","modified":"2024-09-12T02:47:12.605245+0000","last_up_change":"2024-09-12T02:44:37.774835+0000","last_in_change":"2024-09-12T02:44:16.028970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:40:35.157621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:45:31.022530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:45:34.131637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:45:43.992286+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a61ecdc1-ceb9-43cb-a67d-b197888cca42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6803","nonce":2278662522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6805","nonce":2278662522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6809","nonce":2278662522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6807","nonce":2278662522}]},"public_addr":"172.21.15.18:6803/2278662522","cluster_addr":"172.21.15.18:6805/2278662522","heartbeat_back_addr":"172.21.15.18:6809/2278662522","heartbeat_front_addr":"172.21.15.18:6807/2278662522","state":["exists","up"]},{"osd":1,"uuid":"1b84f4be-23ce-466c-b974-b9851521785d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6801","nonce":3139630617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6803","nonce":3139630617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6807","nonce":3139630617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6805","nonce":3139630617}]},"public_addr":"172.21.15.62:6801/3139630617","cluster_addr":"172.21.15.62:6803/3139630617","heartbeat_back_addr":"172.21.15.62:6807/3139630617","heartbeat_front_addr":"172.21.15.62:6805/3139630617","state":["exists","up"]},{"osd":2,"uuid":"f7bdf028-db32-4d92-a039-bada37c3a146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6801","nonce":2704054654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6803","nonce":2704054654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6807","nonce":2704054654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6805","nonce":2704054654}]},"public_addr":"172.21.15.176:6801/2704054654","cluster_addr":"172.21.15.176:6803/2704054654","heartbeat_back_addr":"172.21.15.176:6807/2704054654","heartbeat_front_addr":"172.21.15.176:6805/2704054654","state":["exists","up"]},{"osd":3,"uuid":"39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6811","nonce":3378134261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6813","nonce":3378134261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6817","nonce":3378134261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6815","nonce":3378134261}]},"public_addr":"172.21.15.18:6811/3378134261","cluster_addr":"172.21.15.18:6813/3378134261","heartbeat_back_addr":"172.21.15.18:6817/3378134261","heartbeat_front_addr":"172.21.15.18:6815/3378134261","state":["exists","up"]},{"osd":4,"uuid":"66a2c8a0-1a99-4c6d-b56a-f1f6c3199655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6809","nonce":1416302860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6811","nonce":1416302860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6815","nonce":1416302860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6813","nonce":1416302860}]},"public_addr":"172.21.15.62:6809/1416302860","cluster_addr":"172.21.15.62:6811/1416302860","heartbeat_back_addr":"172.21.15.62:6815/1416302860","heartbeat_front_addr":"172.21.15.62:6813/1416302860","state":["exists","up"]},{"osd":5,"uuid":"c4070ecf-703a-4f5f-9a2b-63473ff7f98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6809","nonce":2234269387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6811","nonce":2234269387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6815","nonce":2234269387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6813","nonce":2234269387}]},"public_addr":"172.21.15.176:6809/2234269387","cluster_addr":"172.21.15.176:6811/2234269387","heartbeat_back_addr":"172.21.15.176:6815/2234269387","heartbeat_front_addr":"172.21.15.176:6813/2234269387","state":["exists","up"]},{"osd":6,"uuid":"12a08874-041e-4734-bc33-68ebfce97b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6819","nonce":3613955982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6821","nonce":3613955982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6825","nonce":3613955982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6823","nonce":3613955982}]},"public_addr":"172.21.15.18:6819/3613955982","cluster_addr":"172.21.15.18:6821/3613955982","heartbeat_back_addr":"172.21.15.18:6825/3613955982","heartbeat_front_addr":"172.21.15.18:6823/3613955982","state":["exists","up"]},{"osd":7,"uuid":"86a5b47c-143f-4848-892f-c7b6a17a2799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6817","nonce":750933013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6819","nonce":750933013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6823","nonce":750933013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6821","nonce":750933013}]},"public_addr":"172.21.15.62:6817/750933013","cluster_addr":"172.21.15.62:6819/750933013","heartbeat_back_addr":"172.21.15.62:6823/750933013","heartbeat_front_addr":"172.21.15.62:6821/750933013","state":["exists","up"]},{"osd":8,"uuid":"0426a455-ed11-4d6a-8e1d-c8aa2ee65cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6817","nonce":8496953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6819","nonce":8496953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6823","nonce":8496953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6821","nonce":8496953}]},"public_addr":"172.21.15.176:6817/8496953","cluster_addr":"172.21.15.176:6819/8496953","heartbeat_back_addr":"172.21.15.176:6823/8496953","heartbeat_front_addr":"172.21.15.176:6821/8496953","state":["exists","up"]},{"osd":9,"uuid":"241aa2cf-0765-465d-b400-4911e653412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6827","nonce":422514390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6829","nonce":422514390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6833","nonce":422514390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6831","nonce":422514390}]},"public_addr":"172.21.15.18:6827/422514390","cluster_addr":"172.21.15.18:6829/422514390","heartbeat_back_addr":"172.21.15.18:6833/422514390","heartbeat_front_addr":"172.21.15.18:6831/422514390","state":["exists","up"]},{"osd":10,"uuid":"b1d4ab1f-0ec4-4641-bab0-f39d15857615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6825","nonce":269877918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6827","nonce":269877918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6831","nonce":269877918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6829","nonce":269877918}]},"public_addr":"172.21.15.62:6825/269877918","cluster_addr":"172.21.15.62:6827/269877918","heartbeat_back_addr":"172.21.15.62:6831/269877918","heartbeat_front_addr":"172.21.15.62:6829/269877918","state":["exists","up"]},{"osd":11,"uuid":"d122f1bf-bd4f-45d5-b07c-7301b005977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6825","nonce":770358485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6827","nonce":770358485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6831","nonce":770358485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6829","nonce":770358485}]},"public_addr":"172.21.15.176:6825/770358485","cluster_addr":"172.21.15.176:6827/770358485","heartbeat_back_addr":"172.21.15.176:6831/770358485","heartbeat_front_addr":"172.21.15.176:6829/770358485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:39:42.435560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:09.100602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:32.884117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:01.733821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:29.812775+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:53.846503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:24.363464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:51.023614+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:15.782652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:45.378178+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:12.469173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:36.303058+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":1,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.3","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/2679362143":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/4236556151":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6801/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6800/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/1197309398":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/3024661873":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/2429098892":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6801/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6800/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/1531572357":"2024-09-13T02:37:40.790128+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:48:24.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:24.153+0000 7fb9ed800640 1 -- 172.21.15.18:0/3466112342 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb9cc0a2b80 msgr2=0x7fb9cc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:24.153+0000 7fb9ed800640 1 --2- 172.21.15.18:0/3466112342 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb9cc0a2b80 0x7fb9cc0a5040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb9e819fa00 tx=0x7fb9d800b390 comp rx=0 tx=0).stop 2024-09-12T02:48:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:24.153+0000 7fb9ed800640 1 -- 172.21.15.18:0/3466112342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9e8112b90 msgr2=0x7fb9e819e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:24.153+0000 7fb9ed800640 1 --2- 172.21.15.18:0/3466112342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9e8112b90 0x7fb9e819e8c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb9e002ae70 tx=0x7fb9e002f630 comp rx=0 tx=0).stop 2024-09-12T02:48:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:24.153+0000 7fb9ed800640 1 -- 172.21.15.18:0/3466112342 shutdown_connections 2024-09-12T02:48:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:24.153+0000 7fb9ed800640 1 --2- 172.21.15.18:0/3466112342 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fb9cc0a2b80 0x7fb9cc0a5040 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:24.153+0000 7fb9ed800640 1 --2- 172.21.15.18:0/3466112342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9e8112b90 0x7fb9e819e8c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:24.153+0000 7fb9ed800640 1 --2- 172.21.15.18:0/3466112342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9e8074eb0 0x7fb9e81a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:24.153+0000 7fb9ed800640 1 --2- 172.21.15.18:0/3466112342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9e8074590 0x7fb9e81a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:24.153+0000 7fb9ed800640 1 -- 172.21.15.18:0/3466112342 >> 172.21.15.18:0/3466112342 conn(0x7fb9e80fd8c0 msgr2=0x7fb9e80ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:24.153+0000 7fb9ed800640 1 -- 172.21.15.18:0/3466112342 shutdown_connections 2024-09-12T02:48:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:24.154+0000 7fb9ed800640 1 -- 172.21.15.18:0/3466112342 wait complete. 2024-09-12T02:48:24.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:24 smithi018 ceph-mon[30616]: pgmap v394: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:48:24.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:24 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3466112342' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:48:24.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:24 smithi176 ceph-mon[35713]: pgmap v394: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:48:24.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:24 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3466112342' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:48:24.983 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T02:45:36.564696+0000', 'modified': '2024-09-12T02:46:35.796320+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24527, 'mds_1': 24526, 'mds_2': 24508, 'mds_3': 24493, 'mds_4': 24488}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24434': {'gid': 24434, 'name': 'k', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.62:6833/1160389785', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 1160389785}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 1160389785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24439': {'gid': 24439, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.176:6833/1988054318', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6832', 'nonce': 1988054318}, {'type': 'v1', 'addr': '172.21.15.176:6833', 'nonce': 1988054318}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'j', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.18:6835/43234729', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6834', 'nonce': 43234729}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 43234729}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.62:6835/564392030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 564392030}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 564392030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.176:6835/3199321182', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6834', 'nonce': 3199321182}, {'type': 'v1', 'addr': '172.21.15.176:6835', 'nonce': 3199321182}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'h', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 23, 'addr': '172.21.15.62:6837/3520593627', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6836', 'nonce': 3520593627}, {'type': 'v1', 'addr': '172.21.15.62:6837', 'nonce': 3520593627}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 23, 'addr': '172.21.15.176:6837/4286557016', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6836', 'nonce': 4286557016}, {'type': 'v1', 'addr': '172.21.15.176:6837', 'nonce': 4286557016}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24508': {'gid': 24508, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.176:6839/3957634398', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6838', 'nonce': 3957634398}, {'type': 'v1', 'addr': '172.21.15.176:6839', 'nonce': 3957634398}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24526': {'gid': 24526, 'name': 'a', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.18:6841/823308007', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6840', 'nonce': 823308007}, {'type': 'v1', 'addr': '172.21.15.18:6841', 'nonce': 823308007}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24527': {'gid': 24527, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.62:6839/3744347102', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6838', 'nonce': 3744347102}, {'type': 'v1', 'addr': '172.21.15.62:6839', 'nonce': 3744347102}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24527, 'qdb_cluster': [24488, 24527, 24493, 24508, 24526]} 2024-09-12T02:48:24.983 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T02:48:24.984 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T02:48:25.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:24 smithi062 ceph-mon[35527]: pgmap v394: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:48:25.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:24 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3466112342' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:48:25.361 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:25.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.947+0000 7f9f43e00640 1 -- 172.21.15.18:0/1344321788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f44108f60 msgr2=0x7f9f44110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:25.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.947+0000 7f9f43e00640 1 --2- 172.21.15.18:0/1344321788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f44108f60 0x7f9f44110ae0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009ca0 tx=0x7f9f3c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.947+0000 7f9f43e00640 1 -- 172.21.15.18:0/1344321788 shutdown_connections 2024-09-12T02:48:25.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.947+0000 7f9f43e00640 1 --2- 172.21.15.18:0/1344321788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f44108f60 0x7f9f44110ae0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.947+0000 7f9f43e00640 1 --2- 172.21.15.18:0/1344321788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f441047e0 0x7f9f44108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.947+0000 7f9f43e00640 1 --2- 172.21.15.18:0/1344321788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f44103e30 0x7f9f44104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.947+0000 7f9f43e00640 1 -- 172.21.15.18:0/1344321788 >> 172.21.15.18:0/1344321788 conn(0x7f9f440ff8d0 msgr2=0x7f9f44101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:25.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.947+0000 7f9f43e00640 1 -- 172.21.15.18:0/1344321788 shutdown_connections 2024-09-12T02:48:25.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.947+0000 7f9f43e00640 1 -- 172.21.15.18:0/1344321788 wait complete. 2024-09-12T02:48:25.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.949+0000 7f9f43e00640 1 Processor -- start 2024-09-12T02:48:25.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.949+0000 7f9f43e00640 1 -- start start 2024-09-12T02:48:25.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.949+0000 7f9f43e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f44103e30 0x7f9f4419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.949+0000 7f9f43e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f441047e0 0x7f9f4419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.949+0000 7f9f43e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f44108f60 0x7f9f4419ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.949+0000 7f9f43e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9f44114010 con 0x7f9f44103e30 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.949+0000 7f9f43e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9f44113e90 con 0x7f9f44108f60 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.949+0000 7f9f43e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9f44114190 con 0x7f9f441047e0 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.949+0000 7f9f42a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f44103e30 0x7f9f4419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.949+0000 7f9f43400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f44108f60 0x7f9f4419ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.949+0000 7f9f42a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f44103e30 0x7f9f4419a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43326/0 (socket says 172.21.15.18:43326) 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.949+0000 7f9f43400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f44108f60 0x7f9f4419ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:57650/0 (socket says 172.21.15.18:57650) 2024-09-12T02:48:25.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.949+0000 7f9f42a00640 1 -- 172.21.15.18:0/2099200802 learned_addr learned my addr 172.21.15.18:0/2099200802 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:25.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.950+0000 7f9f3a000640 1 --2- 172.21.15.18:0/2099200802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f441047e0 0x7f9f4419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.950+0000 7f9f43400640 1 -- 172.21.15.18:0/2099200802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f441047e0 msgr2=0x7f9f4419a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:25.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.950+0000 7f9f43400640 1 --2- 172.21.15.18:0/2099200802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f441047e0 0x7f9f4419a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.950+0000 7f9f43400640 1 -- 172.21.15.18:0/2099200802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f44103e30 msgr2=0x7f9f4419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:25.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.950+0000 7f9f43400640 1 --2- 172.21.15.18:0/2099200802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f44103e30 0x7f9f4419a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.950+0000 7f9f43400640 1 -- 172.21.15.18:0/2099200802 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4419f3e0 con 0x7f9f44108f60 2024-09-12T02:48:25.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.950+0000 7f9f43400640 1 --2- 172.21.15.18:0/2099200802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f44108f60 0x7f9f4419ed00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c005e30 tx=0x7f9f3c003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:25.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.950+0000 7f9f3be00640 1 -- 172.21.15.18:0/2099200802 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c031650 con 0x7f9f44108f60 2024-09-12T02:48:25.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.951+0000 7f9f3be00640 1 -- 172.21.15.18:0/2099200802 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f3c0317f0 con 0x7f9f44108f60 2024-09-12T02:48:25.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.951+0000 7f9f43e00640 1 -- 172.21.15.18:0/2099200802 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f4419f670 con 0x7f9f44108f60 2024-09-12T02:48:25.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.951+0000 7f9f3be00640 1 -- 172.21.15.18:0/2099200802 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c02f990 con 0x7f9f44108f60 2024-09-12T02:48:25.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.951+0000 7f9f43e00640 1 -- 172.21.15.18:0/2099200802 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f441a6fb0 con 0x7f9f44108f60 2024-09-12T02:48:25.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.954+0000 7f9f4c260740 1 Processor -- start 2024-09-12T02:48:25.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.954+0000 7f9f3be00640 1 -- 172.21.15.18:0/2099200802 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9f3c02fb30 con 0x7f9f44108f60 2024-09-12T02:48:25.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.954+0000 7f9f4c260740 1 -- start start 2024-09-12T02:48:25.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.954+0000 7f9f4c260740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dba4e0 0x561680dba8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.954+0000 7f9f4c260740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dbae00 0x561680dc5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.954+0000 7f9f4c260740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dc56c0 0x561680dc7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.954+0000 7f9f4c260740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561680d200b0 con 0x561680dbae00 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.954+0000 7f9f4c260740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561680cc7ab0 con 0x561680dc56c0 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.954+0000 7f9f4c260740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561680d1c070 con 0x561680dba4e0 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.955+0000 7f9f42a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dbae00 0x561680dc5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.955+0000 7f9f42a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dbae00 0x561680dc5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43334/0 (socket says 172.21.15.18:43334) 2024-09-12T02:48:25.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.955+0000 7f9f42a00640 1 -- 172.21.15.18:0/192892504 learned_addr learned my addr 172.21.15.18:0/192892504 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:25.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.955+0000 7f9f3a000640 1 --2- 172.21.15.18:0/192892504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dc56c0 0x561680dc7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.955+0000 7f9f3a000640 1 --2- 172.21.15.18:0/192892504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dba4e0 0x561680dba8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.955+0000 7f9f42a00640 1 -- 172.21.15.18:0/192892504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dba4e0 msgr2=0x561680dba8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:25.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.955+0000 7f9f42a00640 1 --2- 172.21.15.18:0/192892504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dba4e0 0x561680dba8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.955+0000 7f9f42a00640 1 -- 172.21.15.18:0/192892504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dc56c0 msgr2=0x561680dc7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:25.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.955+0000 7f9f42a00640 1 --2- 172.21.15.18:0/192892504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dc56c0 0x561680dc7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.955+0000 7f9f42a00640 1 -- 172.21.15.18:0/192892504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561680cd44a0 con 0x561680dbae00 2024-09-12T02:48:25.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.955+0000 7f9f3a000640 1 --2- 172.21.15.18:0/192892504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dba4e0 0x561680dba8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.956+0000 7f9f42a00640 1 --2- 172.21.15.18:0/192892504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dbae00 0x561680dc5180 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009e10 tx=0x7f9f34011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ee19c75c080161 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.956+0000 7f9f3be00640 1 --2- 172.21.15.18:0/2099200802 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9f280a2b80 0x7f9f280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.956+0000 7f9f33e00640 1 -- 172.21.15.18:0/192892504 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3401e070 con 0x561680dbae00 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.956+0000 7f9f33e00640 1 -- 172.21.15.18:0/192892504 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f34019b10 con 0x561680dbae00 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.956+0000 7f9f33e00640 1 -- 172.21.15.18:0/192892504 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3400fb80 con 0x561680dbae00 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.956+0000 7f9f3be00640 1 -- 172.21.15.18:0/2099200802 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f9f3c0f07d0 con 0x7f9f44108f60 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.956+0000 7f9f3a000640 1 --2- 172.21.15.18:0/2099200802 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9f280a2b80 0x7f9f280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.957+0000 7f9f4c260740 1 -- 172.21.15.18:0/192892504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dbae00 msgr2=0x561680dc5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.957+0000 7f9f4c260740 1 --2- 172.21.15.18:0/192892504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dbae00 0x561680dc5180 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009e10 tx=0x7f9f34011810 comp rx=0 tx=0).stop 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.957+0000 7f9f4c260740 1 -- 172.21.15.18:0/192892504 shutdown_connections 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.957+0000 7f9f4c260740 1 --2- 172.21.15.18:0/192892504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dc56c0 0x561680dc7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.957+0000 7f9f4c260740 1 --2- 172.21.15.18:0/192892504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dbae00 0x561680dc5180 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.957+0000 7f9f4c260740 1 --2- 172.21.15.18:0/192892504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dba4e0 0x561680dba8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.957+0000 7f9f4c260740 1 -- 172.21.15.18:0/192892504 >> 172.21.15.18:0/192892504 conn(0x561680db6a70 msgr2=0x561680db6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.957+0000 7f9f3a000640 1 --2- 172.21.15.18:0/2099200802 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9f280a2b80 0x7f9f280a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x561680db7df0 tx=0x7f9f2c0096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.957+0000 7f9f4c260740 1 -- 172.21.15.18:0/192892504 shutdown_connections 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.957+0000 7f9f4c260740 1 -- 172.21.15.18:0/192892504 wait complete. 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.957+0000 7f9f4c260740 1 -- start start 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.958+0000 7f9f4c260740 1 Processor -- start 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.958+0000 7f9f4c260740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dba4e0 0x561680dc2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.958+0000 7f9f4c260740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dbae00 0x561680dc2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.958+0000 7f9f4c260740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dc56c0 0x561680dc3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.958+0000 7f9f4c260740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561680dc8330 con 0x561680dc56c0 2024-09-12T02:48:25.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.958+0000 7f9f4c260740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561680ca8920 con 0x561680dba4e0 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.958+0000 7f9f4c260740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561680dc84b0 con 0x561680dbae00 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.958+0000 7f9f4c260740 10 client.0 _ll_register_callbacks cb 0x561680ccc8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.959+0000 7f9f43400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dc56c0 0x561680dc3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.959+0000 7f9f42a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dba4e0 0x561680dc2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.959+0000 7f9f42a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dba4e0 0x561680dc2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:57666/0 (socket says 172.21.15.18:57666) 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.959+0000 7f9f42a00640 1 -- 172.21.15.18:0/2791399982 learned_addr learned my addr 172.21.15.18:0/2791399982 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.959+0000 7f9f43400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dc56c0 0x561680dc3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43346/0 (socket says 172.21.15.18:43346) 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.959+0000 7f9f3a000640 1 --2- 172.21.15.18:0/2791399982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dbae00 0x561680dc2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.959+0000 7f9f43400640 1 -- 172.21.15.18:0/2791399982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dbae00 msgr2=0x561680dc2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.959+0000 7f9f43400640 1 --2- 172.21.15.18:0/2791399982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dbae00 0x561680dc2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.959+0000 7f9f43400640 1 -- 172.21.15.18:0/2791399982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dba4e0 msgr2=0x561680dc2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:25.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.959+0000 7f9f43400640 1 --2- 172.21.15.18:0/2791399982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dba4e0 0x561680dc2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.959+0000 7f9f43400640 1 -- 172.21.15.18:0/2791399982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561680a912b0 con 0x561680dc56c0 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.959+0000 7f9f42a00640 1 --2- 172.21.15.18:0/2791399982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dba4e0 0x561680dc2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.959+0000 7f9f43400640 1 --2- 172.21.15.18:0/2791399982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dc56c0 0x561680dc3000 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c006010 tx=0x7f9f3c031ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e489a6c480247edc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.959+0000 7f9f30c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.960+0000 7f9f30c00640 1 -- 172.21.15.18:0/2791399982 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c0d5e60 con 0x561680dc56c0 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.960+0000 7f9f30c00640 1 -- 172.21.15.18:0/2791399982 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f9f3c0baf60 con 0x561680dc56c0 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.960+0000 7f9f4c260740 1 -- 172.21.15.18:0/2791399982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f34019b10 con 0x561680dc56c0 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.960+0000 7f9f30c00640 1 -- 172.21.15.18:0/2791399982 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9f3c0c58d0 con 0x561680dc56c0 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.960+0000 7f9f4c260740 10 client.15102 fetch_fsmap learned FSMap version 29 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.960+0000 7f9f4c260740 1 -- 172.21.15.18:0/2791399982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561680dc8330 con 0x561680dc56c0 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.960+0000 7f9f30c00640 1 -- 172.21.15.18:0/2791399982 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f34019b10 con 0x561680dc56c0 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.960+0000 7f9f30c00640 1 -- 172.21.15.18:0/2791399982 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9f3c004b40 con 0x561680dc56c0 2024-09-12T02:48:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.960+0000 7f9f4c260740 10 client.15102 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.961+0000 7f9f4c260740 10 client.15102 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.961+0000 7f9f4c260740 20 client.15102 populate_metadata read hostname 'smithi018' 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.961+0000 7f9f4c260740 1 --2- 172.21.15.18:0/2791399982 >> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] conn(0x561680dd66b0 0x561680dd7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.961+0000 7f9f4c260740 4 client.15102 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.961+0000 7f9f4c260740 1 -- 172.21.15.18:0/2791399982 --> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561680d2d620 con 0x561680dd66b0 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.961+0000 7f9f42a00640 1 --2- 172.21.15.18:0/2791399982 >> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] conn(0x561680dd66b0 0x561680dd7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.962+0000 7f9f42a00640 1 --2- 172.21.15.18:0/2791399982 >> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] conn(0x561680dd66b0 0x561680dd7b20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e6076e004b738a16 server_cookie=6840a61e37b311da in_seq=0 out_seq=0 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.962+0000 7f9f30c00640 10 client.15102 ms_handle_connect on v2:172.21.15.62:6836/3520593627 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.962+0000 7f9f30c00640 1 -- 172.21.15.18:0/2791399982 <== mds.4 v2:172.21.15.62:6836/3520593627 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561680d2d620 con 0x561680dd66b0 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.962+0000 7f9f30c00640 10 client.15102 handle_command_reply: tid=0 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.963+0000 7f9f4c260740 1 client.15102 shutdown 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.963+0000 7f9f4c260740 1 -- 172.21.15.18:0/2791399982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dc56c0 msgr2=0x561680dc3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:25.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.963+0000 7f9f4c260740 1 --2- 172.21.15.18:0/2791399982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dc56c0 0x561680dc3000 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c006010 tx=0x7f9f3c031ae0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.963+0000 7f9f4c260740 1 -- 172.21.15.18:0/2791399982 shutdown_connections 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.963+0000 7f9f4c260740 1 --2- 172.21.15.18:0/2791399982 >> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] conn(0x561680dd66b0 0x561680dd7b20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.963+0000 7f9f4c260740 1 --2- 172.21.15.18:0/2791399982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dc56c0 0x561680dc3000 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.963+0000 7f9f30c00640 0 client.15102 ms_handle_reset on v2:172.21.15.62:6836/3520593627 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.963+0000 7f9f4c260740 1 --2- 172.21.15.18:0/2791399982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dbae00 0x561680dc2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.963+0000 7f9f4c260740 1 --2- 172.21.15.18:0/2791399982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dba4e0 0x561680dc2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.963+0000 7f9f4c260740 1 -- 172.21.15.18:0/2791399982 >> 172.21.15.18:0/2791399982 conn(0x561680db6a70 msgr2=0x561680dbc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.963+0000 7f9f4c260740 1 -- 172.21.15.18:0/2791399982 shutdown_connections 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.963+0000 7f9f4c260740 1 -- 172.21.15.18:0/2791399982 wait complete. 2024-09-12T02:48:25.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.963+0000 7f9f4c260740 20 client.15102 trim_cache size 0 max 16384 2024-09-12T02:48:25.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.982+0000 7f9f4c260740 1 Processor -- start 2024-09-12T02:48:25.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.982+0000 7f9f4c260740 1 -- start start 2024-09-12T02:48:25.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.982+0000 7f9f4c260740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dba4e0 0x561680dd5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.982+0000 7f9f4c260740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dbae00 0x561680dbcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.982+0000 7f9f4c260740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dc56c0 0x561680dc1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.982+0000 7f9f4c260740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561680dd5e60 con 0x561680dba4e0 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.982+0000 7f9f4c260740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561680dd6530 con 0x561680dc56c0 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.982+0000 7f9f4c260740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561680dd6c00 con 0x561680dbae00 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.983+0000 7f9f42a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dba4e0 0x561680dd5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.983+0000 7f9f42a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dba4e0 0x561680dd5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43348/0 (socket says 172.21.15.18:43348) 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.983+0000 7f9f42a00640 1 -- 172.21.15.18:0/3092892105 learned_addr learned my addr 172.21.15.18:0/3092892105 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.983+0000 7f9f3a000640 1 --2- 172.21.15.18:0/3092892105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dbae00 0x561680dbcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.983+0000 7f9f43400640 1 --2- 172.21.15.18:0/3092892105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dc56c0 0x561680dc1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.983+0000 7f9f3a000640 1 -- 172.21.15.18:0/3092892105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dc56c0 msgr2=0x561680dc1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:25.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.983+0000 7f9f3a000640 1 --2- 172.21.15.18:0/3092892105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dc56c0 0x561680dc1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.983+0000 7f9f3a000640 1 -- 172.21.15.18:0/3092892105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dba4e0 msgr2=0x561680dd5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.983+0000 7f9f3a000640 1 --2- 172.21.15.18:0/3092892105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dba4e0 0x561680dd5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.983+0000 7f9f3a000640 1 -- 172.21.15.18:0/3092892105 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561680dc1530 con 0x561680dbae00 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.984+0000 7f9f3a000640 1 --2- 172.21.15.18:0/3092892105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dbae00 0x561680dbcf40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x561680dc1e10 tx=0x7f9f2c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74e50d297ff3caa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.984+0000 7f9f33400640 1 -- 172.21.15.18:0/3092892105 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c003b00 con 0x561680dbae00 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.984+0000 7f9f33400640 1 -- 172.21.15.18:0/3092892105 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f2c005500 con 0x561680dbae00 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.984+0000 7f9f33400640 1 -- 172.21.15.18:0/3092892105 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c004c50 con 0x561680dbae00 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.984+0000 7f9f4c260740 1 -- 172.21.15.18:0/3092892105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dbae00 msgr2=0x561680dbcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:25.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.984+0000 7f9f4c260740 1 --2- 172.21.15.18:0/3092892105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dbae00 0x561680dbcf40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x561680dc1e10 tx=0x7f9f2c004730 comp rx=0 tx=0).stop 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.985+0000 7f9f4c260740 1 -- 172.21.15.18:0/3092892105 shutdown_connections 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.985+0000 7f9f4c260740 1 --2- 172.21.15.18:0/3092892105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dc56c0 0x561680dc1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.985+0000 7f9f4c260740 1 --2- 172.21.15.18:0/3092892105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dbae00 0x561680dbcf40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.985+0000 7f9f4c260740 1 --2- 172.21.15.18:0/3092892105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dba4e0 0x561680dd5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.985+0000 7f9f4c260740 1 -- 172.21.15.18:0/3092892105 >> 172.21.15.18:0/3092892105 conn(0x561680db6a70 msgr2=0x561680dd5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.985+0000 7f9f4c260740 1 -- 172.21.15.18:0/3092892105 shutdown_connections 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.985+0000 7f9f4c260740 1 -- 172.21.15.18:0/3092892105 wait complete. 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.985+0000 7f9f4c260740 1 -- start start 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.985+0000 7f9f4c260740 1 Processor -- start 2024-09-12T02:48:25.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.986+0000 7f9f4c260740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dba4e0 0x561680de0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.986+0000 7f9f4c260740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dbae00 0x561680dbf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.986+0000 7f9f4c260740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dc56c0 0x561680dbf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.986+0000 7f9f4c260740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561680dd79a0 con 0x561680dba4e0 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.986+0000 7f9f4c260740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561680dd72d0 con 0x561680dc56c0 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.986+0000 7f9f4c260740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561680dd8070 con 0x561680dbae00 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.986+0000 7f9f4c260740 10 client.0 _ll_register_callbacks cb 0x7f9f3c0bc5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:25.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.986+0000 7f9f43400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dc56c0 0x561680dbf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.986+0000 7f9f42a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dba4e0 0x561680de0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.986+0000 7f9f43400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dc56c0 0x561680dbf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:57692/0 (socket says 172.21.15.18:57692) 2024-09-12T02:48:25.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.986+0000 7f9f43400640 1 -- 172.21.15.18:0/1053508780 learned_addr learned my addr 172.21.15.18:0/1053508780 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:25.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.986+0000 7f9f3a000640 1 --2- 172.21.15.18:0/1053508780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dbae00 0x561680dbf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.987+0000 7f9f43400640 1 -- 172.21.15.18:0/1053508780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dbae00 msgr2=0x561680dbf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.987+0000 7f9f43400640 1 --2- 172.21.15.18:0/1053508780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dbae00 0x561680dbf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.987+0000 7f9f43400640 1 -- 172.21.15.18:0/1053508780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dba4e0 msgr2=0x561680de0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.987+0000 7f9f43400640 1 --2- 172.21.15.18:0/1053508780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dba4e0 0x561680de0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.987+0000 7f9f43400640 1 -- 172.21.15.18:0/1053508780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561680dbff00 con 0x561680dc56c0 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.987+0000 7f9f43400640 1 --2- 172.21.15.18:0/1053508780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dc56c0 0x561680dbf7f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0c53a0 tx=0x7f9f3c0bd490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ea26aa2f7849d31 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.987+0000 7f9f30c00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.987+0000 7f9f30c00640 1 -- 172.21.15.18:0/1053508780 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c0d5e60 con 0x561680dc56c0 2024-09-12T02:48:25.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.987+0000 7f9f30c00640 1 -- 172.21.15.18:0/1053508780 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f9f3c0c5440 con 0x561680dc56c0 2024-09-12T02:48:25.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.987+0000 7f9f4c260740 1 -- 172.21.15.18:0/1053508780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f2c005500 con 0x561680dc56c0 2024-09-12T02:48:25.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.987+0000 7f9f30c00640 1 -- 172.21.15.18:0/1053508780 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9f3c0bc0b0 con 0x561680dc56c0 2024-09-12T02:48:25.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.987+0000 7f9f4c260740 10 client.25121 fetch_fsmap learned FSMap version 29 2024-09-12T02:48:25.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.987+0000 7f9f4c260740 1 -- 172.21.15.18:0/1053508780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561680e40dc0 con 0x561680dc56c0 2024-09-12T02:48:25.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.988+0000 7f9f30c00640 1 -- 172.21.15.18:0/1053508780 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f2c005500 con 0x561680dc56c0 2024-09-12T02:48:25.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.988+0000 7f9f30c00640 1 -- 172.21.15.18:0/1053508780 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9f3c09bad0 con 0x561680dc56c0 2024-09-12T02:48:25.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.988+0000 7f9f4c260740 10 client.25121 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:48:25.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.988+0000 7f9f4c260740 10 client.25121 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:48:25.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.988+0000 7f9f4c260740 20 client.25121 populate_metadata read hostname 'smithi018' 2024-09-12T02:48:25.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.988+0000 7f9f4c260740 1 --2- 172.21.15.18:0/1053508780 >> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] conn(0x561680e456e0 0x561680e443f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:25.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.988+0000 7f9f4c260740 4 client.25121 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:48:25.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.988+0000 7f9f4c260740 1 -- 172.21.15.18:0/1053508780 --> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] -- command(tid 0: {"prefix": "status"}) -- 0x561680d27b30 con 0x561680e456e0 2024-09-12T02:48:25.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.988+0000 7f9f42a00640 1 --2- 172.21.15.18:0/1053508780 >> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] conn(0x561680e456e0 0x561680e443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:25.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.989+0000 7f9f42a00640 1 --2- 172.21.15.18:0/1053508780 >> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] conn(0x561680e456e0 0x561680e443f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b59f52e2077a62d1 server_cookie=8d58ee73ddbca610 in_seq=0 out_seq=0 2024-09-12T02:48:25.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.989+0000 7f9f30c00640 10 client.25121 ms_handle_connect on v2:172.21.15.62:6836/3520593627 2024-09-12T02:48:25.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.989+0000 7f9f30c00640 1 -- 172.21.15.18:0/1053508780 <== mds.4 v2:172.21.15.62:6836/3520593627 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x561680d27b30 con 0x561680e456e0 2024-09-12T02:48:25.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.989+0000 7f9f30c00640 10 client.25121 handle_command_reply: tid=0 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.989+0000 7f9f4c260740 1 client.25121 shutdown 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.989+0000 7f9f4c260740 1 -- 172.21.15.18:0/1053508780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dc56c0 msgr2=0x561680dbf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.989+0000 7f9f4c260740 1 --2- 172.21.15.18:0/1053508780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dc56c0 0x561680dbf7f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0c53a0 tx=0x7f9f3c0bd490 comp rx=0 tx=0).stop 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.989+0000 7f9f4c260740 1 -- 172.21.15.18:0/1053508780 shutdown_connections 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.989+0000 7f9f4c260740 1 --2- 172.21.15.18:0/1053508780 >> [v2:172.21.15.62:6836/3520593627,v1:172.21.15.62:6837/3520593627] conn(0x561680e456e0 0x561680e443f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.989+0000 7f9f4c260740 1 --2- 172.21.15.18:0/1053508780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561680dc56c0 0x561680dbf7f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.989+0000 7f9f4c260740 1 --2- 172.21.15.18:0/1053508780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561680dbae00 0x561680dbf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.989+0000 7f9f4c260740 1 --2- 172.21.15.18:0/1053508780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561680dba4e0 0x561680de0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.989+0000 7f9f30c00640 0 client.25121 ms_handle_reset on v2:172.21.15.62:6836/3520593627 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.989+0000 7f9f4c260740 1 -- 172.21.15.18:0/1053508780 >> 172.21.15.18:0/1053508780 conn(0x561680db6a70 msgr2=0x561680db53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.990+0000 7f9f4c260740 1 -- 172.21.15.18:0/1053508780 shutdown_connections 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.990+0000 7f9f4c260740 1 -- 172.21.15.18:0/1053508780 wait complete. 2024-09-12T02:48:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.990+0000 7f9f4c260740 20 client.25121 trim_cache size 0 max 16384 2024-09-12T02:48:25.999 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T02:48:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "c7666100-70af-11ef-bcea-c7b262605968", 2024-09-12T02:48:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 4, 2024-09-12T02:48:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24488, 2024-09-12T02:48:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-12T02:48:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-12T02:48:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-12T02:48:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 112.33377490399999, 2024-09-12T02:48:26.000 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 29, 2024-09-12T02:48:26.000 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 98, 2024-09-12T02:48:26.000 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 96, 2024-09-12T02:48:26.000 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 196.88415412000001 2024-09-12T02:48:26.000 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T02:48:26.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.990+0000 7f9f43e00640 1 -- 172.21.15.18:0/2099200802 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9f280a2b80 msgr2=0x7f9f280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.990+0000 7f9f43e00640 1 --2- 172.21.15.18:0/2099200802 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9f280a2b80 0x7f9f280a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x561680db7df0 tx=0x7f9f2c0096a0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.990+0000 7f9f43e00640 1 -- 172.21.15.18:0/2099200802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f44108f60 msgr2=0x7f9f4419ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:26.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.990+0000 7f9f43e00640 1 --2- 172.21.15.18:0/2099200802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f44108f60 0x7f9f4419ed00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c005e30 tx=0x7f9f3c003f10 comp rx=0 tx=0).stop 2024-09-12T02:48:26.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.990+0000 7f9f43e00640 1 -- 172.21.15.18:0/2099200802 shutdown_connections 2024-09-12T02:48:26.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.990+0000 7f9f43e00640 1 --2- 172.21.15.18:0/2099200802 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9f280a2b80 0x7f9f280a5040 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.990+0000 7f9f43e00640 1 --2- 172.21.15.18:0/2099200802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f44108f60 0x7f9f4419ed00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.990+0000 7f9f43e00640 1 --2- 172.21.15.18:0/2099200802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f441047e0 0x7f9f4419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.990+0000 7f9f43e00640 1 --2- 172.21.15.18:0/2099200802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f44103e30 0x7f9f4419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:26.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.990+0000 7f9f43e00640 1 -- 172.21.15.18:0/2099200802 >> 172.21.15.18:0/2099200802 conn(0x7f9f440ff8d0 msgr2=0x7f9f44100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:26.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.991+0000 7f9f43e00640 1 -- 172.21.15.18:0/2099200802 shutdown_connections 2024-09-12T02:48:26.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:25.991+0000 7f9f43e00640 1 -- 172.21.15.18:0/2099200802 wait complete. 2024-09-12T02:48:26.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:26 smithi018 ceph-mon[30616]: pgmap v395: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-12T02:48:26.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:26 smithi176 ceph-mon[35713]: pgmap v395: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-12T02:48:27.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:26 smithi062 ceph-mon[35527]: pgmap v395: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-12T02:48:27.046 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T02:48:27.425 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:28.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.041+0000 7f4b0e200640 1 -- 172.21.15.18:0/3837426270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b08109120 msgr2=0x7f4b08110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.041+0000 7f4b0e200640 1 --2- 172.21.15.18:0/3837426270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b08109120 0x7f4b08110ca0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009ca0 tx=0x7f4b0002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.041+0000 7f4b0e200640 1 -- 172.21.15.18:0/3837426270 shutdown_connections 2024-09-12T02:48:28.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.041+0000 7f4b0e200640 1 --2- 172.21.15.18:0/3837426270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b08109120 0x7f4b08110ca0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.041+0000 7f4b0e200640 1 --2- 172.21.15.18:0/3837426270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b081049a0 0x7f4b081089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.042+0000 7f4b0e200640 1 --2- 172.21.15.18:0/3837426270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b08103ff0 0x7f4b081043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.042+0000 7f4b0e200640 1 -- 172.21.15.18:0/3837426270 >> 172.21.15.18:0/3837426270 conn(0x7f4b080ffa90 msgr2=0x7f4b08101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:28.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.042+0000 7f4b0e200640 1 -- 172.21.15.18:0/3837426270 shutdown_connections 2024-09-12T02:48:28.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.042+0000 7f4b0e200640 1 -- 172.21.15.18:0/3837426270 wait complete. 2024-09-12T02:48:28.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.043+0000 7f4b0e200640 1 Processor -- start 2024-09-12T02:48:28.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.043+0000 7f4b0e200640 1 -- start start 2024-09-12T02:48:28.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.043+0000 7f4b0e200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b08103ff0 0x7f4b0819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.043+0000 7f4b0e200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b081049a0 0x7f4b0819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.043+0000 7f4b0e200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b08109120 0x7f4b0819eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.043+0000 7f4b0e200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4b081141a0 con 0x7f4b08103ff0 2024-09-12T02:48:28.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.043+0000 7f4b0e200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08114020 con 0x7f4b08109120 2024-09-12T02:48:28.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.043+0000 7f4b0e200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08114320 con 0x7f4b081049a0 2024-09-12T02:48:28.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.044+0000 7f4b07400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b08103ff0 0x7f4b0819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.044+0000 7f4affe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b081049a0 0x7f4b0819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.044+0000 7f4affe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b081049a0 0x7f4b0819ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:52234/0 (socket says 172.21.15.18:52234) 2024-09-12T02:48:28.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.044+0000 7f4affe00640 1 -- 172.21.15.18:0/2679153651 learned_addr learned my addr 172.21.15.18:0/2679153651 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:28.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.044+0000 7f4b07e00640 1 --2- 172.21.15.18:0/2679153651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b08109120 0x7f4b0819eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.044+0000 7f4affe00640 1 -- 172.21.15.18:0/2679153651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b08109120 msgr2=0x7f4b0819eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.044+0000 7f4affe00640 1 --2- 172.21.15.18:0/2679153651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b08109120 0x7f4b0819eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.044+0000 7f4affe00640 1 -- 172.21.15.18:0/2679153651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b08103ff0 msgr2=0x7f4b0819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.044+0000 7f4affe00640 1 --2- 172.21.15.18:0/2679153651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b08103ff0 0x7f4b0819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.044+0000 7f4affe00640 1 -- 172.21.15.18:0/2679153651 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0819f590 con 0x7f4b081049a0 2024-09-12T02:48:28.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.044+0000 7f4affe00640 1 --2- 172.21.15.18:0/2679153651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b081049a0 0x7f4b0819ab20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4af000e9f0 tx=0x7f4af000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:28.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.045+0000 7f4b04c00640 1 -- 172.21.15.18:0/2679153651 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af000cd80 con 0x7f4b081049a0 2024-09-12T02:48:28.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.045+0000 7f4b04c00640 1 -- 172.21.15.18:0/2679153651 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4af0010910 con 0x7f4b081049a0 2024-09-12T02:48:28.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.045+0000 7f4b04c00640 1 -- 172.21.15.18:0/2679153651 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0018990 con 0x7f4b081049a0 2024-09-12T02:48:28.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.045+0000 7f4b0e200640 1 -- 172.21.15.18:0/2679153651 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b0819f880 con 0x7f4b081049a0 2024-09-12T02:48:28.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.045+0000 7f4b0e200640 1 -- 172.21.15.18:0/2679153651 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b081a7160 con 0x7f4b081049a0 2024-09-12T02:48:28.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.048+0000 7f4b10cab740 1 Processor -- start 2024-09-12T02:48:28.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.048+0000 7f4b04c00640 1 -- 172.21.15.18:0/2679153651 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4af0010ac0 con 0x7f4b081049a0 2024-09-12T02:48:28.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.048+0000 7f4b10cab740 1 -- start start 2024-09-12T02:48:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.048+0000 7f4b10cab740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9b330 0x561f0dd9b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.048+0000 7f4b10cab740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9bc50 0x561f0dda5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.048+0000 7f4b10cab740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dda8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.048+0000 7f4b10cab740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561f0dd010b0 con 0x561f0dd9b330 2024-09-12T02:48:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.048+0000 7f4b10cab740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561f0dca8ab0 con 0x561f0dda6510 2024-09-12T02:48:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.048+0000 7f4b10cab740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561f0dcfd070 con 0x561f0dd9bc50 2024-09-12T02:48:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.049+0000 7f4b07e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9b330 0x561f0dd9b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.049+0000 7f4b07e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9b330 0x561f0dd9b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43382/0 (socket says 172.21.15.18:43382) 2024-09-12T02:48:28.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.049+0000 7f4b07e00640 1 -- 172.21.15.18:0/635482147 learned_addr learned my addr 172.21.15.18:0/635482147 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:28.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.049+0000 7f4b07400640 1 --2- 172.21.15.18:0/635482147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9bc50 0x561f0dda5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.049+0000 7f4affe00640 1 --2- 172.21.15.18:0/635482147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dda8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.049+0000 7f4b07e00640 1 -- 172.21.15.18:0/635482147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9bc50 msgr2=0x561f0dda5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:28.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.049+0000 7f4b07e00640 1 --2- 172.21.15.18:0/635482147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9bc50 0x561f0dda5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.049+0000 7f4b07e00640 1 -- 172.21.15.18:0/635482147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 msgr2=0x561f0dda8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:28.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.049+0000 7f4b07e00640 1 --2- 172.21.15.18:0/635482147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dda8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.049+0000 7f4b07e00640 1 -- 172.21.15.18:0/635482147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f0dcb54a0 con 0x561f0dd9b330 2024-09-12T02:48:28.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.050+0000 7f4b07e00640 1 --2- 172.21.15.18:0/635482147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9b330 0x561f0dd9b710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009ca0 tx=0x7f4b000093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258532f6019546e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:28.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.050+0000 7f4b04c00640 1 --2- 172.21.15.18:0/2679153651 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4aec0a2c00 0x7f4aec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.050+0000 7f4af7e00640 1 -- 172.21.15.18:0/635482147 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00031db0 con 0x561f0dd9b330 2024-09-12T02:48:28.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.050+0000 7f4af7e00640 1 -- 172.21.15.18:0/635482147 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b00036030 con 0x561f0dd9b330 2024-09-12T02:48:28.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.050+0000 7f4af7e00640 1 -- 172.21.15.18:0/635482147 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00004330 con 0x561f0dd9b330 2024-09-12T02:48:28.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.050+0000 7f4b04c00640 1 -- 172.21.15.18:0/2679153651 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f4af00cf620 con 0x7f4b081049a0 2024-09-12T02:48:28.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.050+0000 7f4b07400640 1 --2- 172.21.15.18:0/2679153651 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4aec0a2c00 0x7f4aec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.051+0000 7f4b10cab740 1 -- 172.21.15.18:0/635482147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9b330 msgr2=0x561f0dd9b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.051+0000 7f4b10cab740 1 --2- 172.21.15.18:0/635482147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9b330 0x561f0dd9b710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009ca0 tx=0x7f4b000093e0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.051+0000 7f4b10cab740 1 -- 172.21.15.18:0/635482147 shutdown_connections 2024-09-12T02:48:28.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.051+0000 7f4b10cab740 1 --2- 172.21.15.18:0/635482147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dda8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.051+0000 7f4b10cab740 1 --2- 172.21.15.18:0/635482147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9bc50 0x561f0dda5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.051+0000 7f4b10cab740 1 --2- 172.21.15.18:0/635482147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9b330 0x561f0dd9b710 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.051+0000 7f4b10cab740 1 -- 172.21.15.18:0/635482147 >> 172.21.15.18:0/635482147 conn(0x561f0dd978c0 msgr2=0x561f0dd97ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:28.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.051+0000 7f4b07400640 1 --2- 172.21.15.18:0/2679153651 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4aec0a2c00 0x7f4aec0a50c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x561f0dd98720 tx=0x7f4af8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:28.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.051+0000 7f4b10cab740 1 -- 172.21.15.18:0/635482147 shutdown_connections 2024-09-12T02:48:28.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.051+0000 7f4b10cab740 1 -- 172.21.15.18:0/635482147 wait complete. 2024-09-12T02:48:28.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.052+0000 7f4b10cab740 1 -- start start 2024-09-12T02:48:28.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.052+0000 7f4b10cab740 1 Processor -- start 2024-09-12T02:48:28.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.052+0000 7f4b10cab740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9b330 0x561f0dda3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.052+0000 7f4b10cab740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9bc50 0x561f0dda39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.052+0000 7f4b10cab740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dda3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.052+0000 7f4b10cab740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561f0dda9000 con 0x561f0dd9b330 2024-09-12T02:48:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.052+0000 7f4b10cab740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561f0dc89920 con 0x561f0dda6510 2024-09-12T02:48:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.052+0000 7f4b10cab740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561f0dda9180 con 0x561f0dd9bc50 2024-09-12T02:48:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.052+0000 7f4b10cab740 10 client.0 _ll_register_callbacks cb 0x561f0dcad8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.053+0000 7f4b07400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9b330 0x561f0dda3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.053+0000 7f4b07e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dda3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.053+0000 7f4b07e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dda3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:57724/0 (socket says 172.21.15.18:57724) 2024-09-12T02:48:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.053+0000 7f4b07e00640 1 -- 172.21.15.18:0/4059679250 learned_addr learned my addr 172.21.15.18:0/4059679250 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.053+0000 7f4affe00640 1 --2- 172.21.15.18:0/4059679250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9bc50 0x561f0dda39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.053+0000 7f4b07400640 1 -- 172.21.15.18:0/4059679250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9bc50 msgr2=0x561f0dda39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.053+0000 7f4b07400640 1 --2- 172.21.15.18:0/4059679250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9bc50 0x561f0dda39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.053+0000 7f4b07400640 1 -- 172.21.15.18:0/4059679250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 msgr2=0x561f0dda3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.053+0000 7f4b07400640 1 --2- 172.21.15.18:0/4059679250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dda3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.053+0000 7f4b07400640 1 -- 172.21.15.18:0/4059679250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f0da722b0 con 0x561f0dd9b330 2024-09-12T02:48:28.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.053+0000 7f4b07e00640 1 --2- 172.21.15.18:0/4059679250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dda3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:28.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.054+0000 7f4b07400640 1 --2- 172.21.15.18:0/4059679250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9b330 0x561f0dda3470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4af8012cb0 tx=0x7f4af8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce5ac1f2179a7f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:28.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.054+0000 7f4af4c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:48:28.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.054+0000 7f4af4c00640 1 -- 172.21.15.18:0/4059679250 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8005020 con 0x561f0dd9b330 2024-09-12T02:48:28.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.054+0000 7f4af4c00640 1 -- 172.21.15.18:0/4059679250 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f4af80051c0 con 0x561f0dd9b330 2024-09-12T02:48:28.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.054+0000 7f4b10cab740 1 -- 172.21.15.18:0/4059679250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b00036030 con 0x561f0dd9b330 2024-09-12T02:48:28.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.054+0000 7f4af4c00640 1 -- 172.21.15.18:0/4059679250 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4af80053c0 con 0x561f0dd9b330 2024-09-12T02:48:28.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.054+0000 7f4b10cab740 10 client.15120 fetch_fsmap learned FSMap version 29 2024-09-12T02:48:28.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.054+0000 7f4b10cab740 1 -- 172.21.15.18:0/4059679250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561f0ddb4c80 con 0x561f0dd9b330 2024-09-12T02:48:28.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.055+0000 7f4af4c00640 1 -- 172.21.15.18:0/4059679250 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b00036030 con 0x561f0dd9b330 2024-09-12T02:48:28.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.055+0000 7f4af4c00640 1 -- 172.21.15.18:0/4059679250 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4af8027070 con 0x561f0dd9b330 2024-09-12T02:48:28.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.055+0000 7f4b10cab740 10 client.15120 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:48:28.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.055+0000 7f4b10cab740 10 client.15120 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:48:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.055+0000 7f4b10cab740 20 client.15120 populate_metadata read hostname 'smithi018' 2024-09-12T02:48:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.055+0000 7f4b10cab740 1 --2- 172.21.15.18:0/4059679250 >> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] conn(0x561f0ddb72f0 0x561f0ddb8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.055+0000 7f4b10cab740 4 client.15120 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.055+0000 7f4b10cab740 1 -- 172.21.15.18:0/4059679250 --> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f0dd0e620 con 0x561f0ddb72f0 2024-09-12T02:48:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.055+0000 7f4affe00640 1 --2- 172.21.15.18:0/4059679250 >> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] conn(0x561f0ddb72f0 0x561f0ddb8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.056+0000 7f4affe00640 1 --2- 172.21.15.18:0/4059679250 >> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] conn(0x561f0ddb72f0 0x561f0ddb8760 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=196ee1a597854614 server_cookie=9dd409a4203c647d in_seq=0 out_seq=0 2024-09-12T02:48:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.056+0000 7f4af4c00640 10 client.15120 ms_handle_connect on v2:172.21.15.176:6836/4286557016 2024-09-12T02:48:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.057+0000 7f4af4c00640 1 -- 172.21.15.18:0/4059679250 <== mds.3 v2:172.21.15.176:6836/4286557016 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561f0dd0e620 con 0x561f0ddb72f0 2024-09-12T02:48:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.057+0000 7f4af4c00640 10 client.15120 handle_command_reply: tid=0 2024-09-12T02:48:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.057+0000 7f4b10cab740 1 client.15120 shutdown 2024-09-12T02:48:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.057+0000 7f4b10cab740 1 -- 172.21.15.18:0/4059679250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9b330 msgr2=0x561f0dda3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.057+0000 7f4b10cab740 1 --2- 172.21.15.18:0/4059679250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9b330 0x561f0dda3470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4af8012cb0 tx=0x7f4af8004730 comp rx=0 tx=0).stop 2024-09-12T02:48:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.057+0000 7f4b10cab740 1 -- 172.21.15.18:0/4059679250 shutdown_connections 2024-09-12T02:48:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.057+0000 7f4b10cab740 1 --2- 172.21.15.18:0/4059679250 >> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] conn(0x561f0ddb72f0 0x561f0ddb8760 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.057+0000 7f4b10cab740 1 --2- 172.21.15.18:0/4059679250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dda3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.057+0000 7f4b10cab740 1 --2- 172.21.15.18:0/4059679250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9bc50 0x561f0dda39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.057+0000 7f4b10cab740 1 --2- 172.21.15.18:0/4059679250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9b330 0x561f0dda3470 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.057+0000 7f4b10cab740 1 -- 172.21.15.18:0/4059679250 >> 172.21.15.18:0/4059679250 conn(0x561f0dd978c0 msgr2=0x561f0dd9d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.057+0000 7f4af4c00640 0 client.15120 ms_handle_reset on v2:172.21.15.176:6836/4286557016 2024-09-12T02:48:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.057+0000 7f4b10cab740 1 -- 172.21.15.18:0/4059679250 shutdown_connections 2024-09-12T02:48:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.057+0000 7f4b10cab740 1 -- 172.21.15.18:0/4059679250 wait complete. 2024-09-12T02:48:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.057+0000 7f4b10cab740 20 client.15120 trim_cache size 0 max 16384 2024-09-12T02:48:28.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.076+0000 7f4b10cab740 1 Processor -- start 2024-09-12T02:48:28.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.076+0000 7f4b10cab740 1 -- start start 2024-09-12T02:48:28.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.076+0000 7f4b10cab740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9b330 0x561f0ddb8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.076+0000 7f4b10cab740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9bc50 0x561f0dda39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.076+0000 7f4b10cab740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dda3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.076+0000 7f4b10cab740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561f0ddb6aa0 con 0x561f0dd9bc50 2024-09-12T02:48:28.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.076+0000 7f4b10cab740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561f0ddb7170 con 0x561f0dda6510 2024-09-12T02:48:28.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.076+0000 7f4b10cab740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561f0ddb7840 con 0x561f0dd9b330 2024-09-12T02:48:28.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.077+0000 7f4affe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9bc50 0x561f0dda39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.077+0000 7f4affe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9bc50 0x561f0dda39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43402/0 (socket says 172.21.15.18:43402) 2024-09-12T02:48:28.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.077+0000 7f4affe00640 1 -- 172.21.15.18:0/3468305691 learned_addr learned my addr 172.21.15.18:0/3468305691 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:28.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.077+0000 7f4b07400640 1 --2- 172.21.15.18:0/3468305691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9b330 0x561f0ddb8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.077+0000 7f4b07e00640 1 --2- 172.21.15.18:0/3468305691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dda3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.077+0000 7f4affe00640 1 -- 172.21.15.18:0/3468305691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9b330 msgr2=0x561f0ddb8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:28.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.077+0000 7f4affe00640 1 --2- 172.21.15.18:0/3468305691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9b330 0x561f0ddb8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.077+0000 7f4affe00640 1 -- 172.21.15.18:0/3468305691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 msgr2=0x561f0dda3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:28.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.077+0000 7f4affe00640 1 --2- 172.21.15.18:0/3468305691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dda3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.077+0000 7f4affe00640 1 -- 172.21.15.18:0/3468305691 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f0dda19c0 con 0x561f0dd9bc50 2024-09-12T02:48:28.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.077+0000 7f4affe00640 1 --2- 172.21.15.18:0/3468305691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9bc50 0x561f0dda39c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4af009b820 tx=0x7f4af0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d43b6ff5c7bd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:28.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.077+0000 7f4af7400640 1 -- 172.21.15.18:0/3468305691 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af00a46e0 con 0x561f0dd9bc50 2024-09-12T02:48:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.078+0000 7f4af7400640 1 -- 172.21.15.18:0/3468305691 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4af00d2e10 con 0x561f0dd9bc50 2024-09-12T02:48:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.078+0000 7f4af7400640 1 -- 172.21.15.18:0/3468305691 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af00cf2b0 con 0x561f0dd9bc50 2024-09-12T02:48:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.078+0000 7f4b10cab740 1 -- 172.21.15.18:0/3468305691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9bc50 msgr2=0x561f0dda39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.078+0000 7f4b10cab740 1 --2- 172.21.15.18:0/3468305691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9bc50 0x561f0dda39c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4af009b820 tx=0x7f4af0000bc0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.078+0000 7f4b10cab740 1 -- 172.21.15.18:0/3468305691 shutdown_connections 2024-09-12T02:48:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.078+0000 7f4b10cab740 1 --2- 172.21.15.18:0/3468305691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dda3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.078+0000 7f4b10cab740 1 --2- 172.21.15.18:0/3468305691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9bc50 0x561f0dda39c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.078+0000 7f4b10cab740 1 --2- 172.21.15.18:0/3468305691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9b330 0x561f0ddb8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.078+0000 7f4b10cab740 1 -- 172.21.15.18:0/3468305691 >> 172.21.15.18:0/3468305691 conn(0x561f0dd978c0 msgr2=0x561f0dda1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.078+0000 7f4b10cab740 1 -- 172.21.15.18:0/3468305691 shutdown_connections 2024-09-12T02:48:28.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.078+0000 7f4b10cab740 1 -- 172.21.15.18:0/3468305691 wait complete. 2024-09-12T02:48:28.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.079+0000 7f4b10cab740 1 -- start start 2024-09-12T02:48:28.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.079+0000 7f4b10cab740 1 Processor -- start 2024-09-12T02:48:28.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.079+0000 7f4b10cab740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9b330 0x561f0ddc0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.079+0000 7f4b10cab740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9bc50 0x561f0ddc1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.079+0000 7f4b10cab740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dd9ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.079+0000 7f4b10cab740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561f0ddb85e0 con 0x561f0dd9bc50 2024-09-12T02:48:28.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.079+0000 7f4b10cab740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561f0ddb7f10 con 0x561f0dda6510 2024-09-12T02:48:28.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.079+0000 7f4b10cab740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561f0ddb8cb0 con 0x561f0dd9b330 2024-09-12T02:48:28.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.079+0000 7f4b10cab740 10 client.0 _ll_register_callbacks cb 0x7f4af80044a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:28.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.080+0000 7f4b07400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9b330 0x561f0ddc0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.080+0000 7f4b07400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9b330 0x561f0ddc0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:52262/0 (socket says 172.21.15.18:52262) 2024-09-12T02:48:28.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.080+0000 7f4affe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9bc50 0x561f0ddc1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.080+0000 7f4b07400640 1 -- 172.21.15.18:0/3791605644 learned_addr learned my addr 172.21.15.18:0/3791605644 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:28.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.080+0000 7f4b07e00640 1 --2- 172.21.15.18:0/3791605644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dd9ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.080+0000 7f4b07400640 1 -- 172.21.15.18:0/3791605644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 msgr2=0x561f0dd9ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:28.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.080+0000 7f4b07400640 1 --2- 172.21.15.18:0/3791605644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dd9ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.080+0000 7f4b07400640 1 -- 172.21.15.18:0/3791605644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9bc50 msgr2=0x561f0ddc1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:28.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.080+0000 7f4b07400640 1 --2- 172.21.15.18:0/3791605644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9bc50 0x561f0ddc1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.080+0000 7f4b07400640 1 -- 172.21.15.18:0/3791605644 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f0dda0780 con 0x561f0dd9b330 2024-09-12T02:48:28.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.080+0000 7f4affe00640 1 --2- 172.21.15.18:0/3791605644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9bc50 0x561f0ddc1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:28.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.080+0000 7f4b07400640 1 --2- 172.21.15.18:0/3791605644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9b330 0x561f0ddc0cf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4af801e9b0 tx=0x7f4af80045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3645c6dd6521910 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:28.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.080+0000 7f4af4c00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:48:28.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.081+0000 7f4af4c00640 1 -- 172.21.15.18:0/3791605644 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8036430 con 0x561f0dd9b330 2024-09-12T02:48:28.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.081+0000 7f4af4c00640 1 -- 172.21.15.18:0/3791605644 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f4af80365d0 con 0x561f0dd9b330 2024-09-12T02:48:28.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.081+0000 7f4b10cab740 1 -- 172.21.15.18:0/3791605644 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4af00d2e10 con 0x561f0dd9b330 2024-09-12T02:48:28.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.081+0000 7f4af4c00640 1 -- 172.21.15.18:0/3791605644 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4af8041050 con 0x561f0dd9b330 2024-09-12T02:48:28.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.081+0000 7f4b10cab740 10 client.25138 fetch_fsmap learned FSMap version 29 2024-09-12T02:48:28.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.081+0000 7f4b10cab740 1 -- 172.21.15.18:0/3791605644 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561f0ddbf440 con 0x561f0dd9b330 2024-09-12T02:48:28.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.081+0000 7f4af4c00640 1 -- 172.21.15.18:0/3791605644 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4af00d2e10 con 0x561f0dd9b330 2024-09-12T02:48:28.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.081+0000 7f4af4c00640 1 -- 172.21.15.18:0/3791605644 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4af8027070 con 0x561f0dd9b330 2024-09-12T02:48:28.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.082+0000 7f4b10cab740 10 client.25138 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:48:28.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.082+0000 7f4b10cab740 10 client.25138 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:48:28.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.082+0000 7f4b10cab740 20 client.25138 populate_metadata read hostname 'smithi018' 2024-09-12T02:48:28.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.082+0000 7f4b10cab740 1 --2- 172.21.15.18:0/3791605644 >> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] conn(0x561f0de26200 0x561f0de24f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:28.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.082+0000 7f4b10cab740 4 client.25138 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:48:28.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.082+0000 7f4b10cab740 1 -- 172.21.15.18:0/3791605644 --> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] -- command(tid 0: {"prefix": "status"}) -- 0x561f0dd08b30 con 0x561f0de26200 2024-09-12T02:48:28.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.082+0000 7f4affe00640 1 --2- 172.21.15.18:0/3791605644 >> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] conn(0x561f0de26200 0x561f0de24f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:28.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.082+0000 7f4affe00640 1 --2- 172.21.15.18:0/3791605644 >> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] conn(0x561f0de26200 0x561f0de24f10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9451afdaac9c0857 server_cookie=1d9290ec0c8749da in_seq=0 out_seq=0 2024-09-12T02:48:28.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.082+0000 7f4af4c00640 10 client.25138 ms_handle_connect on v2:172.21.15.176:6836/4286557016 2024-09-12T02:48:28.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.083+0000 7f4af4c00640 1 -- 172.21.15.18:0/3791605644 <== mds.3 v2:172.21.15.176:6836/4286557016 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x561f0dd08b30 con 0x561f0de26200 2024-09-12T02:48:28.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.083+0000 7f4af4c00640 10 client.25138 handle_command_reply: tid=0 2024-09-12T02:48:28.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.083+0000 7f4b10cab740 1 client.25138 shutdown 2024-09-12T02:48:28.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.083+0000 7f4b10cab740 1 -- 172.21.15.18:0/3791605644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9b330 msgr2=0x561f0ddc0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.083+0000 7f4b10cab740 1 --2- 172.21.15.18:0/3791605644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9b330 0x561f0ddc0cf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4af801e9b0 tx=0x7f4af80045e0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.083+0000 7f4b10cab740 1 -- 172.21.15.18:0/3791605644 shutdown_connections 2024-09-12T02:48:28.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.083+0000 7f4b10cab740 1 --2- 172.21.15.18:0/3791605644 >> [v2:172.21.15.176:6836/4286557016,v1:172.21.15.176:6837/4286557016] conn(0x561f0de26200 0x561f0de24f10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.083+0000 7f4b10cab740 1 --2- 172.21.15.18:0/3791605644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f0dda6510 0x561f0dd9ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.083+0000 7f4b10cab740 1 --2- 172.21.15.18:0/3791605644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561f0dd9bc50 0x561f0ddc1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.083+0000 7f4af4c00640 0 client.25138 ms_handle_reset on v2:172.21.15.176:6836/4286557016 2024-09-12T02:48:28.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.083+0000 7f4b10cab740 1 --2- 172.21.15.18:0/3791605644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561f0dd9b330 0x561f0ddc0cf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.083+0000 7f4b10cab740 1 -- 172.21.15.18:0/3791605644 >> 172.21.15.18:0/3791605644 conn(0x561f0dd978c0 msgr2=0x561f0dd96200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:28.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.083+0000 7f4b10cab740 1 -- 172.21.15.18:0/3791605644 shutdown_connections 2024-09-12T02:48:28.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.083+0000 7f4b10cab740 1 -- 172.21.15.18:0/3791605644 wait complete. 2024-09-12T02:48:28.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.083+0000 7f4b10cab740 20 client.25138 trim_cache size 0 max 16384 2024-09-12T02:48:28.090 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T02:48:28.090 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "c7666100-70af-11ef-bcea-c7b262605968", 2024-09-12T02:48:28.090 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 3, 2024-09-12T02:48:28.091 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24493, 2024-09-12T02:48:28.091 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-12T02:48:28.091 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-12T02:48:28.091 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-12T02:48:28.091 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 115.446606264, 2024-09-12T02:48:28.091 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 29, 2024-09-12T02:48:28.091 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 98, 2024-09-12T02:48:28.091 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 96, 2024-09-12T02:48:28.091 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 201.73679987 2024-09-12T02:48:28.091 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T02:48:28.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.084+0000 7f4b0e200640 1 -- 172.21.15.18:0/2679153651 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4aec0a2c00 msgr2=0x7f4aec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.084+0000 7f4b0e200640 1 --2- 172.21.15.18:0/2679153651 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4aec0a2c00 0x7f4aec0a50c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x561f0dd98720 tx=0x7f4af8005f90 comp rx=0 tx=0).stop 2024-09-12T02:48:28.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.084+0000 7f4b0e200640 1 -- 172.21.15.18:0/2679153651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b081049a0 msgr2=0x7f4b0819ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:28.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.084+0000 7f4b0e200640 1 --2- 172.21.15.18:0/2679153651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b081049a0 0x7f4b0819ab20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4af000e9f0 tx=0x7f4af000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.084+0000 7f4b0e200640 1 -- 172.21.15.18:0/2679153651 shutdown_connections 2024-09-12T02:48:28.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.084+0000 7f4b0e200640 1 --2- 172.21.15.18:0/2679153651 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f4aec0a2c00 0x7f4aec0a50c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.084+0000 7f4b0e200640 1 --2- 172.21.15.18:0/2679153651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b08109120 0x7f4b0819eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.084+0000 7f4b0e200640 1 --2- 172.21.15.18:0/2679153651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b081049a0 0x7f4b0819ab20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.084+0000 7f4b0e200640 1 --2- 172.21.15.18:0/2679153651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b08103ff0 0x7f4b0819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:28.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.084+0000 7f4b0e200640 1 -- 172.21.15.18:0/2679153651 >> 172.21.15.18:0/2679153651 conn(0x7f4b080ffa90 msgr2=0x7f4b081005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:28.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.084+0000 7f4b0e200640 1 -- 172.21.15.18:0/2679153651 shutdown_connections 2024-09-12T02:48:28.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:28.084+0000 7f4b0e200640 1 -- 172.21.15.18:0/2679153651 wait complete. 2024-09-12T02:48:28.800 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:28 smithi018 ceph-mon[30616]: pgmap v396: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T02:48:28.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:28 smithi176 ceph-mon[35713]: pgmap v396: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T02:48:29.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:28 smithi062 ceph-mon[35527]: pgmap v396: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T02:48:29.055 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T02:48:29.439 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:30.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.104+0000 7f3a07e00640 1 -- 172.21.15.18:0/334118779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a081034b0 msgr2=0x7f3a0810b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.104+0000 7f3a07e00640 1 --2- 172.21.15.18:0/334118779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a081034b0 0x7f3a0810b9a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009900 tx=0x7f39f002a480 comp rx=0 tx=0).stop 2024-09-12T02:48:30.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.104+0000 7f3a07e00640 1 -- 172.21.15.18:0/334118779 shutdown_connections 2024-09-12T02:48:30.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.104+0000 7f3a07e00640 1 --2- 172.21.15.18:0/334118779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a0810bfc0 0x7f3a0810e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.104+0000 7f3a07e00640 1 --2- 172.21.15.18:0/334118779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a081034b0 0x7f3a0810b9a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.104+0000 7f3a07e00640 1 --2- 172.21.15.18:0/334118779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a08102b90 0x7f3a08102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.104+0000 7f3a07e00640 1 -- 172.21.15.18:0/334118779 >> 172.21.15.18:0/334118779 conn(0x7f3a080fc610 msgr2=0x7f3a080fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:30.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.104+0000 7f3a07e00640 1 -- 172.21.15.18:0/334118779 shutdown_connections 2024-09-12T02:48:30.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.104+0000 7f3a07e00640 1 -- 172.21.15.18:0/334118779 wait complete. 2024-09-12T02:48:30.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.105+0000 7f3a07e00640 1 Processor -- start 2024-09-12T02:48:30.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.105+0000 7f3a07e00640 1 -- start start 2024-09-12T02:48:30.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.106+0000 7f3a07e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a08102b90 0x7f3a0819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.106+0000 7f3a07e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a081034b0 0x7f3a0819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.106+0000 7f3a07e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a0810bfc0 0x7f3a0819ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.106+0000 7f3a07e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3a08111e10 con 0x7f3a0810bfc0 2024-09-12T02:48:30.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.106+0000 7f3a07e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3a08111c90 con 0x7f3a08102b90 2024-09-12T02:48:30.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.106+0000 7f3a07e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3a08111f90 con 0x7f3a081034b0 2024-09-12T02:48:30.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.106+0000 7f3a06a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a08102b90 0x7f3a0819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.106+0000 7f3a07400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a0810bfc0 0x7f3a0819ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.106+0000 7f3a06a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a08102b90 0x7f3a0819a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:57766/0 (socket says 172.21.15.18:57766) 2024-09-12T02:48:30.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.106+0000 7f3a06a00640 1 -- 172.21.15.18:0/218297898 learned_addr learned my addr 172.21.15.18:0/218297898 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:30.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.106+0000 7f39fe000640 1 --2- 172.21.15.18:0/218297898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a081034b0 0x7f3a0819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.107+0000 7f3a06a00640 1 -- 172.21.15.18:0/218297898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a081034b0 msgr2=0x7f3a0819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.107+0000 7f3a06a00640 1 --2- 172.21.15.18:0/218297898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a081034b0 0x7f3a0819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.107+0000 7f3a06a00640 1 -- 172.21.15.18:0/218297898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a0810bfc0 msgr2=0x7f3a0819ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.107+0000 7f3a06a00640 1 --2- 172.21.15.18:0/218297898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a0810bfc0 0x7f3a0819ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.107+0000 7f3a06a00640 1 -- 172.21.15.18:0/218297898 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0819f450 con 0x7f3a08102b90 2024-09-12T02:48:30.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.107+0000 7f3a06a00640 1 --2- 172.21.15.18:0/218297898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a08102b90 0x7f3a0819a4a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f39f800e9f0 tx=0x7f39f800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:30.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.107+0000 7f3a0ca00640 1 -- 172.21.15.18:0/218297898 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f800cd80 con 0x7f3a08102b90 2024-09-12T02:48:30.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.107+0000 7f3a07e00640 1 -- 172.21.15.18:0/218297898 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a0819f740 con 0x7f3a08102b90 2024-09-12T02:48:30.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.107+0000 7f3a0ca00640 1 -- 172.21.15.18:0/218297898 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39f8010910 con 0x7f3a08102b90 2024-09-12T02:48:30.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.107+0000 7f3a0ca00640 1 -- 172.21.15.18:0/218297898 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f80188f0 con 0x7f3a08102b90 2024-09-12T02:48:30.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.107+0000 7f3a07e00640 1 -- 172.21.15.18:0/218297898 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a081a7020 con 0x7f3a08102b90 2024-09-12T02:48:30.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.110+0000 7f3a10824740 1 Processor -- start 2024-09-12T02:48:30.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.110+0000 7f3a10824740 1 -- start start 2024-09-12T02:48:30.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.111+0000 7f3a0ca00640 1 -- 172.21.15.18:0/218297898 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f39f8010ac0 con 0x7f3a08102b90 2024-09-12T02:48:30.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.111+0000 7f3a10824740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27f4e0 0x55bf6d27f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.111+0000 7f3a10824740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d27fe00 0x55bf6d28a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.111+0000 7f3a10824740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d28a6c0 0x55bf6d28cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.111+0000 7f3a10824740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bf6d1e50b0 con 0x55bf6d28a6c0 2024-09-12T02:48:30.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.111+0000 7f3a10824740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bf6d18cab0 con 0x55bf6d27f4e0 2024-09-12T02:48:30.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.111+0000 7f3a10824740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55bf6d1e1070 con 0x55bf6d27fe00 2024-09-12T02:48:30.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.111+0000 7f39fe000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d28a6c0 0x55bf6d28cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.111+0000 7f3a06a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d27fe00 0x55bf6d28a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.111+0000 7f39fe000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d28a6c0 0x55bf6d28cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43450/0 (socket says 172.21.15.18:43450) 2024-09-12T02:48:30.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.111+0000 7f39fe000640 1 -- 172.21.15.18:0/303225417 learned_addr learned my addr 172.21.15.18:0/303225417 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:30.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.111+0000 7f3a07400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27f4e0 0x55bf6d27f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.112+0000 7f39fe000640 1 -- 172.21.15.18:0/303225417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d27fe00 msgr2=0x55bf6d28a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:30.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.112+0000 7f39fe000640 1 --2- 172.21.15.18:0/303225417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d27fe00 0x55bf6d28a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.112+0000 7f39fe000640 1 -- 172.21.15.18:0/303225417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27f4e0 msgr2=0x55bf6d27f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:30.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.112+0000 7f39fe000640 1 --2- 172.21.15.18:0/303225417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27f4e0 0x55bf6d27f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.112+0000 7f39fe000640 1 -- 172.21.15.18:0/303225417 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf6d1994a0 con 0x55bf6d28a6c0 2024-09-12T02:48:30.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.112+0000 7f3a07400640 1 --2- 172.21.15.18:0/303225417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27f4e0 0x55bf6d27f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:30.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.112+0000 7f39fe000640 1 --2- 172.21.15.18:0/303225417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d28a6c0 0x55bf6d28cab0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009900 tx=0x7f39f0005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c959c775252cd34 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:30.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.112+0000 7f39f7e00640 1 -- 172.21.15.18:0/303225417 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0035040 con 0x55bf6d28a6c0 2024-09-12T02:48:30.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.112+0000 7f39f7e00640 1 -- 172.21.15.18:0/303225417 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39f0004400 con 0x55bf6d28a6c0 2024-09-12T02:48:30.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.112+0000 7f39f7e00640 1 -- 172.21.15.18:0/303225417 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f00035f0 con 0x55bf6d28a6c0 2024-09-12T02:48:30.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.113+0000 7f3a0ca00640 1 --2- 172.21.15.18:0/218297898 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f39ec0a2b80 0x7f39ec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.113+0000 7f3a0ca00640 1 -- 172.21.15.18:0/218297898 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f39f80cf800 con 0x7f3a08102b90 2024-09-12T02:48:30.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.113+0000 7f3a07400640 1 --2- 172.21.15.18:0/218297898 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f39ec0a2b80 0x7f39ec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.113+0000 7f3a10824740 1 -- 172.21.15.18:0/303225417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d28a6c0 msgr2=0x55bf6d28cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.113+0000 7f3a10824740 1 --2- 172.21.15.18:0/303225417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d28a6c0 0x55bf6d28cab0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009900 tx=0x7f39f0005de0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.113+0000 7f3a10824740 1 -- 172.21.15.18:0/303225417 shutdown_connections 2024-09-12T02:48:30.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.113+0000 7f3a10824740 1 --2- 172.21.15.18:0/303225417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d28a6c0 0x55bf6d28cab0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.113+0000 7f3a10824740 1 --2- 172.21.15.18:0/303225417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d27fe00 0x55bf6d28a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.113+0000 7f3a10824740 1 --2- 172.21.15.18:0/303225417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27f4e0 0x55bf6d27f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.113+0000 7f3a10824740 1 -- 172.21.15.18:0/303225417 >> 172.21.15.18:0/303225417 conn(0x55bf6d27ba70 msgr2=0x55bf6d27be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:30.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.114+0000 7f3a10824740 1 -- 172.21.15.18:0/303225417 shutdown_connections 2024-09-12T02:48:30.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.114+0000 7f3a07400640 1 --2- 172.21.15.18:0/218297898 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f39ec0a2b80 0x7f39ec0a5040 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3a00009fd0 tx=0x7f3a00009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:30.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.114+0000 7f3a10824740 1 -- 172.21.15.18:0/303225417 wait complete. 2024-09-12T02:48:30.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.114+0000 7f3a10824740 1 -- start start 2024-09-12T02:48:30.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.114+0000 7f3a10824740 1 Processor -- start 2024-09-12T02:48:30.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.115+0000 7f3a10824740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d27f4e0 0x55bf6d287560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.115+0000 7f3a10824740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27fe00 0x55bf6d287aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.115+0000 7f3a10824740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d28a6c0 0x55bf6d287fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.115+0000 7f3a10824740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bf6d28d330 con 0x55bf6d28a6c0 2024-09-12T02:48:30.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.115+0000 7f3a10824740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bf6d16d920 con 0x55bf6d27fe00 2024-09-12T02:48:30.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.115+0000 7f3a10824740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55bf6d28d4b0 con 0x55bf6d27f4e0 2024-09-12T02:48:30.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.115+0000 7f3a10824740 10 client.0 _ll_register_callbacks cb 0x55bf6d1918a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:30.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.115+0000 7f3a07400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d28a6c0 0x55bf6d287fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.115+0000 7f39fe000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27fe00 0x55bf6d287aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.115+0000 7f39fe000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27fe00 0x55bf6d287aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:57778/0 (socket says 172.21.15.18:57778) 2024-09-12T02:48:30.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.115+0000 7f39fe000640 1 -- 172.21.15.18:0/2382762830 learned_addr learned my addr 172.21.15.18:0/2382762830 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:30.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.115+0000 7f3a06a00640 1 --2- 172.21.15.18:0/2382762830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d27f4e0 0x55bf6d287560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.116+0000 7f39fe000640 1 -- 172.21.15.18:0/2382762830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d27f4e0 msgr2=0x55bf6d287560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:30.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.116+0000 7f39fe000640 1 --2- 172.21.15.18:0/2382762830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d27f4e0 0x55bf6d287560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.116+0000 7f39fe000640 1 -- 172.21.15.18:0/2382762830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d28a6c0 msgr2=0x55bf6d287fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:30.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.116+0000 7f39fe000640 1 --2- 172.21.15.18:0/2382762830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d28a6c0 0x55bf6d287fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.116+0000 7f39fe000640 1 -- 172.21.15.18:0/2382762830 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf6cf562b0 con 0x55bf6d27fe00 2024-09-12T02:48:30.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.116+0000 7f39fe000640 1 --2- 172.21.15.18:0/2382762830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27fe00 0x55bf6d287aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f39f00048f0 tx=0x7f39f0004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd4e1af23061b790 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:30.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.116+0000 7f39f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:48:30.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.116+0000 7f39f4c00640 1 -- 172.21.15.18:0/2382762830 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0052060 con 0x55bf6d27fe00 2024-09-12T02:48:30.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.116+0000 7f3a10824740 1 -- 172.21.15.18:0/2382762830 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39f0004400 con 0x55bf6d27fe00 2024-09-12T02:48:30.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.116+0000 7f39f4c00640 1 -- 172.21.15.18:0/2382762830 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f39f0004200 con 0x55bf6d27fe00 2024-09-12T02:48:30.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.117+0000 7f39f4c00640 1 -- 172.21.15.18:0/2382762830 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f39f0035070 con 0x55bf6d27fe00 2024-09-12T02:48:30.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.117+0000 7f3a10824740 10 client.25151 fetch_fsmap learned FSMap version 29 2024-09-12T02:48:30.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.117+0000 7f3a10824740 1 -- 172.21.15.18:0/2382762830 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bf6d298fc0 con 0x55bf6d27fe00 2024-09-12T02:48:30.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.117+0000 7f39f4c00640 1 -- 172.21.15.18:0/2382762830 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39f0004400 con 0x55bf6d27fe00 2024-09-12T02:48:30.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.117+0000 7f39f4c00640 1 -- 172.21.15.18:0/2382762830 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f39f0031a70 con 0x55bf6d27fe00 2024-09-12T02:48:30.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.117+0000 7f3a10824740 10 client.25151 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:48:30.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.117+0000 7f3a10824740 10 client.25151 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:48:30.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.117+0000 7f3a10824740 20 client.25151 populate_metadata read hostname 'smithi018' 2024-09-12T02:48:30.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.117+0000 7f3a10824740 1 --2- 172.21.15.18:0/2382762830 >> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] conn(0x55bf6d29b110 0x55bf6d29c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.117+0000 7f3a10824740 4 client.25151 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:30.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.117+0000 7f3a10824740 1 -- 172.21.15.18:0/2382762830 --> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf6d1f2620 con 0x55bf6d29b110 2024-09-12T02:48:30.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.118+0000 7f3a06a00640 1 --2- 172.21.15.18:0/2382762830 >> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] conn(0x55bf6d29b110 0x55bf6d29c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.118+0000 7f3a06a00640 1 --2- 172.21.15.18:0/2382762830 >> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] conn(0x55bf6d29b110 0x55bf6d29c580 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8d6ef29ca83a935b server_cookie=99ae0fa7fe55e7be in_seq=0 out_seq=0 2024-09-12T02:48:30.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.118+0000 7f39f4c00640 10 client.25151 ms_handle_connect on v2:172.21.15.176:6838/3957634398 2024-09-12T02:48:30.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.119+0000 7f39f4c00640 1 -- 172.21.15.18:0/2382762830 <== mds.2 v2:172.21.15.176:6838/3957634398 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bf6d1f2620 con 0x55bf6d29b110 2024-09-12T02:48:30.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.119+0000 7f39f4c00640 10 client.25151 handle_command_reply: tid=0 2024-09-12T02:48:30.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.119+0000 7f3a10824740 1 client.25151 shutdown 2024-09-12T02:48:30.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.119+0000 7f3a10824740 1 -- 172.21.15.18:0/2382762830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27fe00 msgr2=0x55bf6d287aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.119+0000 7f3a10824740 1 --2- 172.21.15.18:0/2382762830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27fe00 0x55bf6d287aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f39f00048f0 tx=0x7f39f0004af0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.119+0000 7f3a10824740 1 -- 172.21.15.18:0/2382762830 shutdown_connections 2024-09-12T02:48:30.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.119+0000 7f3a10824740 1 --2- 172.21.15.18:0/2382762830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d28a6c0 0x55bf6d287fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.119+0000 7f3a10824740 1 --2- 172.21.15.18:0/2382762830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27fe00 0x55bf6d287aa0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.119+0000 7f3a10824740 1 --2- 172.21.15.18:0/2382762830 >> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] conn(0x55bf6d29b110 0x55bf6d29c580 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.119+0000 7f3a10824740 1 --2- 172.21.15.18:0/2382762830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d27f4e0 0x55bf6d287560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.119+0000 7f3a10824740 1 -- 172.21.15.18:0/2382762830 >> 172.21.15.18:0/2382762830 conn(0x55bf6d27ba70 msgr2=0x55bf6d281750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:30.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.119+0000 7f39f4c00640 0 client.25151 ms_handle_reset on v2:172.21.15.176:6838/3957634398 2024-09-12T02:48:30.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.119+0000 7f3a10824740 1 -- 172.21.15.18:0/2382762830 shutdown_connections 2024-09-12T02:48:30.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.120+0000 7f3a10824740 1 -- 172.21.15.18:0/2382762830 wait complete. 2024-09-12T02:48:30.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.120+0000 7f3a10824740 20 client.25151 trim_cache size 0 max 16384 2024-09-12T02:48:30.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.138+0000 7f3a10824740 1 Processor -- start 2024-09-12T02:48:30.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.139+0000 7f3a10824740 1 -- start start 2024-09-12T02:48:30.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.139+0000 7f3a10824740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27f4e0 0x55bf6d29b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.139+0000 7f3a10824740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d27fe00 0x55bf6d281f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.139+0000 7f3a10824740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d28a6c0 0x55bf6d287e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.139+0000 7f3a10824740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bf6d29a8c0 con 0x55bf6d27fe00 2024-09-12T02:48:30.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.139+0000 7f3a10824740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bf6d29af90 con 0x55bf6d27f4e0 2024-09-12T02:48:30.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.139+0000 7f3a10824740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55bf6d29b660 con 0x55bf6d28a6c0 2024-09-12T02:48:30.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.139+0000 7f39fe000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d27fe00 0x55bf6d281f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.139+0000 7f39fe000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d27fe00 0x55bf6d281f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43474/0 (socket says 172.21.15.18:43474) 2024-09-12T02:48:30.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.139+0000 7f39fe000640 1 -- 172.21.15.18:0/3456768390 learned_addr learned my addr 172.21.15.18:0/3456768390 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:30.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.139+0000 7f3a07400640 1 --2- 172.21.15.18:0/3456768390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d28a6c0 0x55bf6d287e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.139+0000 7f3a06a00640 1 --2- 172.21.15.18:0/3456768390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27f4e0 0x55bf6d29b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.140+0000 7f39fe000640 1 -- 172.21.15.18:0/3456768390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d28a6c0 msgr2=0x55bf6d287e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:30.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.140+0000 7f39fe000640 1 --2- 172.21.15.18:0/3456768390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d28a6c0 0x55bf6d287e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.140+0000 7f39fe000640 1 -- 172.21.15.18:0/3456768390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27f4e0 msgr2=0x55bf6d29b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:30.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.140+0000 7f39fe000640 1 --2- 172.21.15.18:0/3456768390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27f4e0 0x55bf6d29b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.140+0000 7f39fe000640 1 -- 172.21.15.18:0/3456768390 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf6d28d450 con 0x55bf6d27fe00 2024-09-12T02:48:30.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.140+0000 7f39fe000640 1 --2- 172.21.15.18:0/3456768390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d27fe00 0x55bf6d281f40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f39f0031ec0 tx=0x7f39f0005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2142e843da32536d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:30.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.140+0000 7f39f7400640 1 -- 172.21.15.18:0/3456768390 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0052070 con 0x55bf6d27fe00 2024-09-12T02:48:30.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.140+0000 7f39f7400640 1 -- 172.21.15.18:0/3456768390 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39f0004e60 con 0x55bf6d27fe00 2024-09-12T02:48:30.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.140+0000 7f39f7400640 1 -- 172.21.15.18:0/3456768390 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0031970 con 0x55bf6d27fe00 2024-09-12T02:48:30.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.141+0000 7f3a10824740 1 -- 172.21.15.18:0/3456768390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d27fe00 msgr2=0x55bf6d281f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.141+0000 7f3a10824740 1 --2- 172.21.15.18:0/3456768390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d27fe00 0x55bf6d281f40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f39f0031ec0 tx=0x7f39f0005de0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.141+0000 7f3a10824740 1 -- 172.21.15.18:0/3456768390 shutdown_connections 2024-09-12T02:48:30.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.141+0000 7f3a10824740 1 --2- 172.21.15.18:0/3456768390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d28a6c0 0x55bf6d287e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.141+0000 7f3a10824740 1 --2- 172.21.15.18:0/3456768390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d27fe00 0x55bf6d281f40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.141+0000 7f3a10824740 1 --2- 172.21.15.18:0/3456768390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27f4e0 0x55bf6d29b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.141+0000 7f3a10824740 1 -- 172.21.15.18:0/3456768390 >> 172.21.15.18:0/3456768390 conn(0x55bf6d27ba70 msgr2=0x55bf6d288dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:30.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.141+0000 7f3a10824740 1 -- 172.21.15.18:0/3456768390 shutdown_connections 2024-09-12T02:48:30.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.141+0000 7f3a10824740 1 -- 172.21.15.18:0/3456768390 wait complete. 2024-09-12T02:48:30.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.142+0000 7f3a10824740 1 -- start start 2024-09-12T02:48:30.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.142+0000 7f3a10824740 1 Processor -- start 2024-09-12T02:48:30.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.142+0000 7f3a10824740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d27f4e0 0x55bf6d29e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.142+0000 7f3a10824740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27fe00 0x55bf6d29ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.142+0000 7f3a10824740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d28a6c0 0x55bf6d29f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.142+0000 7f3a10824740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bf6d29c400 con 0x55bf6d28a6c0 2024-09-12T02:48:30.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.142+0000 7f3a10824740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bf6d29bd30 con 0x55bf6d27fe00 2024-09-12T02:48:30.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.142+0000 7f3a10824740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55bf6d29cad0 con 0x55bf6d27f4e0 2024-09-12T02:48:30.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.142+0000 7f3a10824740 10 client.0 _ll_register_callbacks cb 0x7f3a000093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:30.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.143+0000 7f39fe000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27fe00 0x55bf6d29ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.143+0000 7f39fe000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27fe00 0x55bf6d29ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:57804/0 (socket says 172.21.15.18:57804) 2024-09-12T02:48:30.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.143+0000 7f39fe000640 1 -- 172.21.15.18:0/1745346532 learned_addr learned my addr 172.21.15.18:0/1745346532 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:30.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.143+0000 7f3a07400640 1 --2- 172.21.15.18:0/1745346532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d28a6c0 0x55bf6d29f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.143+0000 7f3a06a00640 1 --2- 172.21.15.18:0/1745346532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d27f4e0 0x55bf6d29e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.143+0000 7f39fe000640 1 -- 172.21.15.18:0/1745346532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d27f4e0 msgr2=0x55bf6d29e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:30.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.143+0000 7f39fe000640 1 --2- 172.21.15.18:0/1745346532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d27f4e0 0x55bf6d29e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.143+0000 7f39fe000640 1 -- 172.21.15.18:0/1745346532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d28a6c0 msgr2=0x55bf6d29f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:30.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.143+0000 7f39fe000640 1 --2- 172.21.15.18:0/1745346532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d28a6c0 0x55bf6d29f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.143+0000 7f39fe000640 1 -- 172.21.15.18:0/1745346532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf6d2a2f70 con 0x55bf6d27fe00 2024-09-12T02:48:30.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.143+0000 7f39fe000640 1 --2- 172.21.15.18:0/1745346532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27fe00 0x55bf6d29ebe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f39f002a9a0 tx=0x7f39f0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecf33548729545a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:30.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.143+0000 7f39f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:48:30.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.144+0000 7f39f4c00640 1 -- 172.21.15.18:0/1745346532 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0052030 con 0x55bf6d27fe00 2024-09-12T02:48:30.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.144+0000 7f3a10824740 1 -- 172.21.15.18:0/1745346532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39f0004e60 con 0x55bf6d27fe00 2024-09-12T02:48:30.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.144+0000 7f39f4c00640 1 -- 172.21.15.18:0/1745346532 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f39f0005390 con 0x55bf6d27fe00 2024-09-12T02:48:30.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.144+0000 7f39f4c00640 1 -- 172.21.15.18:0/1745346532 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f39f006c050 con 0x55bf6d27fe00 2024-09-12T02:48:30.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.144+0000 7f3a10824740 10 client.25157 fetch_fsmap learned FSMap version 29 2024-09-12T02:48:30.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.144+0000 7f3a10824740 1 -- 172.21.15.18:0/1745346532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bf6d305c30 con 0x55bf6d27fe00 2024-09-12T02:48:30.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.144+0000 7f39f4c00640 1 -- 172.21.15.18:0/1745346532 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39f0004e60 con 0x55bf6d27fe00 2024-09-12T02:48:30.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.145+0000 7f39f4c00640 1 -- 172.21.15.18:0/1745346532 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f39f0003a50 con 0x55bf6d27fe00 2024-09-12T02:48:30.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.145+0000 7f3a10824740 10 client.25157 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:48:30.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.145+0000 7f3a10824740 10 client.25157 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:48:30.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.145+0000 7f3a10824740 20 client.25157 populate_metadata read hostname 'smithi018' 2024-09-12T02:48:30.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.145+0000 7f3a10824740 1 --2- 172.21.15.18:0/1745346532 >> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] conn(0x55bf6d30a300 0x55bf6d309010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:30.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.145+0000 7f3a10824740 4 client.25157 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:48:30.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.145+0000 7f3a10824740 1 -- 172.21.15.18:0/1745346532 --> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] -- command(tid 0: {"prefix": "status"}) -- 0x55bf6d1ecb30 con 0x55bf6d30a300 2024-09-12T02:48:30.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.145+0000 7f3a06a00640 1 --2- 172.21.15.18:0/1745346532 >> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] conn(0x55bf6d30a300 0x55bf6d309010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:30.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.146+0000 7f3a06a00640 1 --2- 172.21.15.18:0/1745346532 >> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] conn(0x55bf6d30a300 0x55bf6d309010 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=90881fb8ef973646 server_cookie=2eca14806ee861f0 in_seq=0 out_seq=0 2024-09-12T02:48:30.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.146+0000 7f39f4c00640 10 client.25157 ms_handle_connect on v2:172.21.15.176:6838/3957634398 2024-09-12T02:48:30.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.146+0000 7f39f4c00640 1 -- 172.21.15.18:0/1745346532 <== mds.2 v2:172.21.15.176:6838/3957634398 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55bf6d1ecb30 con 0x55bf6d30a300 2024-09-12T02:48:30.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.146+0000 7f39f4c00640 10 client.25157 handle_command_reply: tid=0 2024-09-12T02:48:30.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.146+0000 7f3a10824740 1 client.25157 shutdown 2024-09-12T02:48:30.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.146+0000 7f3a10824740 1 -- 172.21.15.18:0/1745346532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27fe00 msgr2=0x55bf6d29ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.146+0000 7f3a10824740 1 --2- 172.21.15.18:0/1745346532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27fe00 0x55bf6d29ebe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f39f002a9a0 tx=0x7f39f0000bc0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.146+0000 7f3a10824740 1 -- 172.21.15.18:0/1745346532 shutdown_connections 2024-09-12T02:48:30.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.146+0000 7f3a10824740 1 --2- 172.21.15.18:0/1745346532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf6d28a6c0 0x55bf6d29f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.146+0000 7f3a10824740 1 --2- 172.21.15.18:0/1745346532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf6d27fe00 0x55bf6d29ebe0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.146+0000 7f3a10824740 1 --2- 172.21.15.18:0/1745346532 >> [v2:172.21.15.176:6838/3957634398,v1:172.21.15.176:6839/3957634398] conn(0x55bf6d30a300 0x55bf6d309010 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.146+0000 7f3a10824740 1 --2- 172.21.15.18:0/1745346532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf6d27f4e0 0x55bf6d29e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.146+0000 7f3a10824740 1 -- 172.21.15.18:0/1745346532 >> 172.21.15.18:0/1745346532 conn(0x55bf6d27ba70 msgr2=0x55bf6d27abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:30.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.146+0000 7f39f4c00640 0 client.25157 ms_handle_reset on v2:172.21.15.176:6838/3957634398 2024-09-12T02:48:30.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.146+0000 7f3a10824740 1 -- 172.21.15.18:0/1745346532 shutdown_connections 2024-09-12T02:48:30.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.146+0000 7f3a10824740 1 -- 172.21.15.18:0/1745346532 wait complete. 2024-09-12T02:48:30.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.147+0000 7f3a10824740 20 client.25157 trim_cache size 0 max 16384 2024-09-12T02:48:30.155 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T02:48:30.155 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "c7666100-70af-11ef-bcea-c7b262605968", 2024-09-12T02:48:30.155 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 2, 2024-09-12T02:48:30.155 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24508, 2024-09-12T02:48:30.155 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-12T02:48:30.156 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-12T02:48:30.156 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-12T02:48:30.156 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 118.514899808, 2024-09-12T02:48:30.156 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 29, 2024-09-12T02:48:30.156 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 98, 2024-09-12T02:48:30.156 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 96, 2024-09-12T02:48:30.156 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 198.37923669599999 2024-09-12T02:48:30.156 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T02:48:30.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.147+0000 7f3a07e00640 1 -- 172.21.15.18:0/218297898 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f39ec0a2b80 msgr2=0x7f39ec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.147+0000 7f3a07e00640 1 --2- 172.21.15.18:0/218297898 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f39ec0a2b80 0x7f39ec0a5040 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3a00009fd0 tx=0x7f3a00009500 comp rx=0 tx=0).stop 2024-09-12T02:48:30.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.147+0000 7f3a07e00640 1 -- 172.21.15.18:0/218297898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a08102b90 msgr2=0x7f3a0819a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:30.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.147+0000 7f3a07e00640 1 --2- 172.21.15.18:0/218297898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a08102b90 0x7f3a0819a4a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f39f800e9f0 tx=0x7f39f800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.147+0000 7f3a07e00640 1 -- 172.21.15.18:0/218297898 shutdown_connections 2024-09-12T02:48:30.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.147+0000 7f3a07e00640 1 --2- 172.21.15.18:0/218297898 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f39ec0a2b80 0x7f39ec0a5040 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.147+0000 7f3a07e00640 1 --2- 172.21.15.18:0/218297898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a0810bfc0 0x7f3a0819ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.147+0000 7f3a07e00640 1 --2- 172.21.15.18:0/218297898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a081034b0 0x7f3a0819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.147+0000 7f3a07e00640 1 --2- 172.21.15.18:0/218297898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a08102b90 0x7f3a0819a4a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:30.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.147+0000 7f3a07e00640 1 -- 172.21.15.18:0/218297898 >> 172.21.15.18:0/218297898 conn(0x7f3a080fc610 msgr2=0x7f3a0810d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:30.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.147+0000 7f3a07e00640 1 -- 172.21.15.18:0/218297898 shutdown_connections 2024-09-12T02:48:30.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:30.147+0000 7f3a07e00640 1 -- 172.21.15.18:0/218297898 wait complete. 2024-09-12T02:48:30.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:30 smithi176 ceph-mon[35713]: pgmap v397: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:48:31.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:30 smithi062 ceph-mon[35527]: pgmap v397: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:48:31.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:30 smithi018 ceph-mon[30616]: pgmap v397: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:48:31.147 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell mds.a status 2024-09-12T02:48:31.535 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.161+0000 7f9e94000640 1 -- 172.21.15.18:0/1306116110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e8c1049a0 msgr2=0x7f9e8c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.161+0000 7f9e94000640 1 --2- 172.21.15.18:0/1306116110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e8c1049a0 0x7f9e8c1089f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009900 tx=0x7f9e7802a400 comp rx=0 tx=0).stop 2024-09-12T02:48:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.161+0000 7f9e94000640 1 -- 172.21.15.18:0/1306116110 shutdown_connections 2024-09-12T02:48:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.161+0000 7f9e94000640 1 --2- 172.21.15.18:0/1306116110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e8c109120 0x7f9e8c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.161+0000 7f9e94000640 1 --2- 172.21.15.18:0/1306116110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e8c1049a0 0x7f9e8c1089f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.161+0000 7f9e94000640 1 --2- 172.21.15.18:0/1306116110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e8c103ff0 0x7f9e8c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.161+0000 7f9e94000640 1 -- 172.21.15.18:0/1306116110 >> 172.21.15.18:0/1306116110 conn(0x7f9e8c0ffa90 msgr2=0x7f9e8c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.161+0000 7f9e94000640 1 -- 172.21.15.18:0/1306116110 shutdown_connections 2024-09-12T02:48:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.161+0000 7f9e94000640 1 -- 172.21.15.18:0/1306116110 wait complete. 2024-09-12T02:48:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.162+0000 7f9e94000640 1 Processor -- start 2024-09-12T02:48:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.162+0000 7f9e94000640 1 -- start start 2024-09-12T02:48:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.163+0000 7f9e94000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e8c103ff0 0x7f9e8c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.163+0000 7f9e94000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e8c1049a0 0x7f9e8c19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.163+0000 7f9e94000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e8c109120 0x7f9e8c19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.163+0000 7f9e94000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c114140 con 0x7f9e8c109120 2024-09-12T02:48:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.163+0000 7f9e94000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c113fc0 con 0x7f9e8c1049a0 2024-09-12T02:48:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.163+0000 7f9e94000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c1142c0 con 0x7f9e8c103ff0 2024-09-12T02:48:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.163+0000 7f9e92000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e8c109120 0x7f9e8c19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.163+0000 7f9e90c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e8c1049a0 0x7f9e8c19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.163+0000 7f9e91600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e8c103ff0 0x7f9e8c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.163+0000 7f9e90c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e8c1049a0 0x7f9e8c19abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:57830/0 (socket says 172.21.15.18:57830) 2024-09-12T02:48:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.163+0000 7f9e90c00640 1 -- 172.21.15.18:0/722749708 learned_addr learned my addr 172.21.15.18:0/722749708 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.164+0000 7f9e91600640 1 -- 172.21.15.18:0/722749708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e8c1049a0 msgr2=0x7f9e8c19abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.164+0000 7f9e91600640 1 --2- 172.21.15.18:0/722749708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e8c1049a0 0x7f9e8c19abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.164+0000 7f9e91600640 1 -- 172.21.15.18:0/722749708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e8c109120 msgr2=0x7f9e8c19ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.164+0000 7f9e91600640 1 --2- 172.21.15.18:0/722749708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e8c109120 0x7f9e8c19ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.164+0000 7f9e91600640 1 -- 172.21.15.18:0/722749708 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8c19f630 con 0x7f9e8c103ff0 2024-09-12T02:48:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.164+0000 7f9e92000640 1 --2- 172.21.15.18:0/722749708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e8c109120 0x7f9e8c19ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.164+0000 7f9e91600640 1 --2- 172.21.15.18:0/722749708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e8c103ff0 0x7f9e8c19a680 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000e9f0 tx=0x7f9e8000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.164+0000 7f9e8a000640 1 -- 172.21.15.18:0/722749708 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8000ccc0 con 0x7f9e8c103ff0 2024-09-12T02:48:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.164+0000 7f9e94000640 1 -- 172.21.15.18:0/722749708 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8c19f920 con 0x7f9e8c103ff0 2024-09-12T02:48:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.164+0000 7f9e8a000640 1 -- 172.21.15.18:0/722749708 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e80005020 con 0x7f9e8c103ff0 2024-09-12T02:48:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.164+0000 7f9e8a000640 1 -- 172.21.15.18:0/722749708 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80004a00 con 0x7f9e8c103ff0 2024-09-12T02:48:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.164+0000 7f9e94000640 1 -- 172.21.15.18:0/722749708 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e8c1a7200 con 0x7f9e8c103ff0 2024-09-12T02:48:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.167+0000 7f9e965fd740 1 Processor -- start 2024-09-12T02:48:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.167+0000 7f9e965fd740 1 -- start start 2024-09-12T02:48:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.168+0000 7f9e965fd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 0x557b8dfb9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.168+0000 7f9e965fd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9c50 0x557b8dfc3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.168+0000 7f9e965fd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfc4510 0x557b8dfc6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.168+0000 7f9e8a000640 1 -- 172.21.15.18:0/722749708 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9e800051d0 con 0x7f9e8c103ff0 2024-09-12T02:48:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.168+0000 7f9e965fd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557b8df1f0b0 con 0x557b8dfb9c50 2024-09-12T02:48:32.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.168+0000 7f9e965fd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557b8dec6ab0 con 0x557b8dfb9330 2024-09-12T02:48:32.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.168+0000 7f9e965fd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x557b8df1b070 con 0x557b8dfc4510 2024-09-12T02:48:32.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.168+0000 7f9e91600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9c50 0x557b8dfc3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.168+0000 7f9e92000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 0x557b8dfb9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.168+0000 7f9e92000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 0x557b8dfb9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:57846/0 (socket says 172.21.15.18:57846) 2024-09-12T02:48:32.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.168+0000 7f9e92000640 1 -- 172.21.15.18:0/489769487 learned_addr learned my addr 172.21.15.18:0/489769487 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.168+0000 7f9e90c00640 1 --2- 172.21.15.18:0/489769487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfc4510 0x557b8dfc6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.169+0000 7f9e92000640 1 -- 172.21.15.18:0/489769487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfc4510 msgr2=0x557b8dfc6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.169+0000 7f9e92000640 1 --2- 172.21.15.18:0/489769487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfc4510 0x557b8dfc6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.169+0000 7f9e92000640 1 -- 172.21.15.18:0/489769487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9c50 msgr2=0x557b8dfc3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.169+0000 7f9e92000640 1 --2- 172.21.15.18:0/489769487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9c50 0x557b8dfc3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.169+0000 7f9e92000640 1 -- 172.21.15.18:0/489769487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b8ded34a0 con 0x557b8dfb9330 2024-09-12T02:48:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.169+0000 7f9e91600640 1 --2- 172.21.15.18:0/489769487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9c50 0x557b8dfc3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.169+0000 7f9e92000640 1 --2- 172.21.15.18:0/489769487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 0x557b8dfb9710 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9e84011790 tx=0x7f9e84011c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=959d83e15a06e8b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.169+0000 7f9e7e600640 1 -- 172.21.15.18:0/489769487 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84004d20 con 0x557b8dfb9330 2024-09-12T02:48:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.169+0000 7f9e7e600640 1 -- 172.21.15.18:0/489769487 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e84003970 con 0x557b8dfb9330 2024-09-12T02:48:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.169+0000 7f9e7e600640 1 -- 172.21.15.18:0/489769487 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84004540 con 0x557b8dfb9330 2024-09-12T02:48:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.169+0000 7f9e8a000640 1 --2- 172.21.15.18:0/722749708 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9e740a2c00 0x7f9e740a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.170+0000 7f9e8a000640 1 -- 172.21.15.18:0/722749708 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f9e800cf310 con 0x7f9e8c103ff0 2024-09-12T02:48:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.170+0000 7f9e91600640 1 --2- 172.21.15.18:0/722749708 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9e740a2c00 0x7f9e740a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.170+0000 7f9e965fd740 1 -- 172.21.15.18:0/489769487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 msgr2=0x557b8dfb9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.170+0000 7f9e965fd740 1 --2- 172.21.15.18:0/489769487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 0x557b8dfb9710 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9e84011790 tx=0x7f9e84011c50 comp rx=0 tx=0).stop 2024-09-12T02:48:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.170+0000 7f9e965fd740 1 -- 172.21.15.18:0/489769487 shutdown_connections 2024-09-12T02:48:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.170+0000 7f9e965fd740 1 --2- 172.21.15.18:0/489769487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfc4510 0x557b8dfc6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.170+0000 7f9e965fd740 1 --2- 172.21.15.18:0/489769487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9c50 0x557b8dfc3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.170+0000 7f9e965fd740 1 --2- 172.21.15.18:0/489769487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 0x557b8dfb9710 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.170+0000 7f9e965fd740 1 -- 172.21.15.18:0/489769487 >> 172.21.15.18:0/489769487 conn(0x557b8dfb58c0 msgr2=0x557b8dfb5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:32.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.170+0000 7f9e965fd740 1 -- 172.21.15.18:0/489769487 shutdown_connections 2024-09-12T02:48:32.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.170+0000 7f9e965fd740 1 -- 172.21.15.18:0/489769487 wait complete. 2024-09-12T02:48:32.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.170+0000 7f9e91600640 1 --2- 172.21.15.18:0/722749708 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9e740a2c00 0x7f9e740a50c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9e800cca00 tx=0x7f9e800d2d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:32.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.171+0000 7f9e965fd740 1 -- start start 2024-09-12T02:48:32.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.171+0000 7f9e965fd740 1 Processor -- start 2024-09-12T02:48:32.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.171+0000 7f9e965fd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 0x557b8dfc15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.171+0000 7f9e965fd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9c50 0x557b8dfc1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.171+0000 7f9e965fd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfc4510 0x557b8dfc2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.172+0000 7f9e965fd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557b8dfc7060 con 0x557b8dfb9c50 2024-09-12T02:48:32.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.172+0000 7f9e965fd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557b8dea7920 con 0x557b8dfb9330 2024-09-12T02:48:32.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.172+0000 7f9e965fd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x557b8dfc71e0 con 0x557b8dfc4510 2024-09-12T02:48:32.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.172+0000 7f9e965fd740 10 client.0 _ll_register_callbacks cb 0x557b8decb8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.172+0000 7f9e92000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 0x557b8dfc15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.172+0000 7f9e90c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9c50 0x557b8dfc1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.172+0000 7f9e92000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 0x557b8dfc15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:57854/0 (socket says 172.21.15.18:57854) 2024-09-12T02:48:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.172+0000 7f9e92000640 1 -- 172.21.15.18:0/2923072929 learned_addr learned my addr 172.21.15.18:0/2923072929 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.172+0000 7f9e92000640 1 --2- 172.21.15.18:0/2923072929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfc4510 0x557b8dfc2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.172+0000 7f9e90c00640 1 -- 172.21.15.18:0/2923072929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfc4510 msgr2=0x557b8dfc2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.172+0000 7f9e90c00640 1 --2- 172.21.15.18:0/2923072929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfc4510 0x557b8dfc2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.172+0000 7f9e90c00640 1 -- 172.21.15.18:0/2923072929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 msgr2=0x557b8dfc15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.172+0000 7f9e90c00640 1 --2- 172.21.15.18:0/2923072929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 0x557b8dfc15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.172+0000 7f9e90c00640 1 -- 172.21.15.18:0/2923072929 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b8dc902b0 con 0x557b8dfb9c50 2024-09-12T02:48:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.173+0000 7f9e90c00640 1 --2- 172.21.15.18:0/2923072929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9c50 0x557b8dfc1b30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009230 tx=0x7f9e78032ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d97e49ae7e51e77 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.173+0000 7f9e72a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:48:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.173+0000 7f9e72a00640 1 -- 172.21.15.18:0/2923072929 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e78035040 con 0x557b8dfb9c50 2024-09-12T02:48:32.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.173+0000 7f9e72a00640 1 -- 172.21.15.18:0/2923072929 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f9e780318b0 con 0x557b8dfb9c50 2024-09-12T02:48:32.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.173+0000 7f9e965fd740 1 -- 172.21.15.18:0/2923072929 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e84003970 con 0x557b8dfb9c50 2024-09-12T02:48:32.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.173+0000 7f9e72a00640 1 -- 172.21.15.18:0/2923072929 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9e7804f050 con 0x557b8dfb9c50 2024-09-12T02:48:32.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.173+0000 7f9e965fd740 10 client.15156 fetch_fsmap learned FSMap version 29 2024-09-12T02:48:32.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.173+0000 7f9e965fd740 1 -- 172.21.15.18:0/2923072929 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557b8dfd2df0 con 0x557b8dfb9c50 2024-09-12T02:48:32.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.174+0000 7f9e72a00640 1 -- 172.21.15.18:0/2923072929 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e84003970 con 0x557b8dfb9c50 2024-09-12T02:48:32.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.174+0000 7f9e72a00640 1 -- 172.21.15.18:0/2923072929 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9e780046c0 con 0x557b8dfb9c50 2024-09-12T02:48:32.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.174+0000 7f9e965fd740 10 client.15156 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:48:32.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.174+0000 7f9e965fd740 10 client.15156 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:48:32.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.174+0000 7f9e965fd740 20 client.15156 populate_metadata read hostname 'smithi018' 2024-09-12T02:48:32.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.174+0000 7f9e965fd740 1 --2- 172.21.15.18:0/2923072929 >> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] conn(0x557b8dfd53e0 0x557b8dfd6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.174+0000 7f9e965fd740 4 client.15156 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:32.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.174+0000 7f9e965fd740 1 -- 172.21.15.18:0/2923072929 --> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b8df2c620 con 0x557b8dfd53e0 2024-09-12T02:48:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.174+0000 7f9e92000640 1 --2- 172.21.15.18:0/2923072929 >> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] conn(0x557b8dfd53e0 0x557b8dfd6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.175+0000 7f9e92000640 1 --2- 172.21.15.18:0/2923072929 >> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] conn(0x557b8dfd53e0 0x557b8dfd6850 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5dee76932d9d2816 server_cookie=e81a6ffd9ef6d7fe in_seq=0 out_seq=0 2024-09-12T02:48:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.175+0000 7f9e72a00640 10 client.15156 ms_handle_connect on v2:172.21.15.18:6840/823308007 2024-09-12T02:48:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.176+0000 7f9e72a00640 1 -- 172.21.15.18:0/2923072929 <== mds.1 v2:172.21.15.18:6840/823308007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b8df2c620 con 0x557b8dfd53e0 2024-09-12T02:48:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.176+0000 7f9e72a00640 10 client.15156 handle_command_reply: tid=0 2024-09-12T02:48:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.176+0000 7f9e965fd740 1 client.15156 shutdown 2024-09-12T02:48:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.176+0000 7f9e965fd740 1 -- 172.21.15.18:0/2923072929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9c50 msgr2=0x557b8dfc1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.176+0000 7f9e965fd740 1 --2- 172.21.15.18:0/2923072929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9c50 0x557b8dfc1b30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009230 tx=0x7f9e78032ed0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.176+0000 7f9e965fd740 1 -- 172.21.15.18:0/2923072929 shutdown_connections 2024-09-12T02:48:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.176+0000 7f9e965fd740 1 --2- 172.21.15.18:0/2923072929 >> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] conn(0x557b8dfd53e0 0x557b8dfd6850 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.176+0000 7f9e965fd740 1 --2- 172.21.15.18:0/2923072929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfc4510 0x557b8dfc2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.176+0000 7f9e965fd740 1 --2- 172.21.15.18:0/2923072929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9c50 0x557b8dfc1b30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.176+0000 7f9e965fd740 1 --2- 172.21.15.18:0/2923072929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 0x557b8dfc15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.176+0000 7f9e72a00640 0 client.15156 ms_handle_reset on v2:172.21.15.18:6840/823308007 2024-09-12T02:48:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.176+0000 7f9e965fd740 1 -- 172.21.15.18:0/2923072929 >> 172.21.15.18:0/2923072929 conn(0x557b8dfb58c0 msgr2=0x557b8dfbb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.176+0000 7f9e965fd740 1 -- 172.21.15.18:0/2923072929 shutdown_connections 2024-09-12T02:48:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.176+0000 7f9e965fd740 1 -- 172.21.15.18:0/2923072929 wait complete. 2024-09-12T02:48:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.176+0000 7f9e965fd740 20 client.15156 trim_cache size 0 max 16384 2024-09-12T02:48:32.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.195+0000 7f9e965fd740 1 Processor -- start 2024-09-12T02:48:32.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.195+0000 7f9e965fd740 1 -- start start 2024-09-12T02:48:32.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.196+0000 7f9e965fd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9330 0x557b8dfd5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.196+0000 7f9e965fd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfb9c50 0x557b8dfbc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.196+0000 7f9e965fd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfc4510 0x557b8dfc1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.196+0000 7f9e965fd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557b8dfd4b90 con 0x557b8dfb9330 2024-09-12T02:48:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.196+0000 7f9e965fd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557b8dfd5260 con 0x557b8dfc4510 2024-09-12T02:48:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.196+0000 7f9e965fd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x557b8dfd5930 con 0x557b8dfb9c50 2024-09-12T02:48:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.196+0000 7f9e92000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9330 0x557b8dfd5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.196+0000 7f9e92000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9330 0x557b8dfd5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43526/0 (socket says 172.21.15.18:43526) 2024-09-12T02:48:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.196+0000 7f9e92000640 1 -- 172.21.15.18:0/2254446632 learned_addr learned my addr 172.21.15.18:0/2254446632 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.196+0000 7f9e90c00640 1 --2- 172.21.15.18:0/2254446632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfb9c50 0x557b8dfbc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.196+0000 7f9e92000640 1 --2- 172.21.15.18:0/2254446632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfc4510 0x557b8dfc1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.196+0000 7f9e92000640 1 -- 172.21.15.18:0/2254446632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfb9c50 msgr2=0x557b8dfbc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:32.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.196+0000 7f9e92000640 1 --2- 172.21.15.18:0/2254446632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfb9c50 0x557b8dfbc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.197+0000 7f9e92000640 1 -- 172.21.15.18:0/2254446632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfc4510 msgr2=0x557b8dfc1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:32.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.197+0000 7f9e92000640 1 --2- 172.21.15.18:0/2254446632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfc4510 0x557b8dfc1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.197+0000 7f9e92000640 1 -- 172.21.15.18:0/2254446632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b8dfc6c70 con 0x557b8dfb9330 2024-09-12T02:48:32.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.197+0000 7f9e92000640 1 --2- 172.21.15.18:0/2254446632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9330 0x557b8dfd5ab0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009b80 tx=0x7f9e84009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a60fe27a23d6af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:32.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.197+0000 7f9e7dc00640 1 -- 172.21.15.18:0/2254446632 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8401d040 con 0x557b8dfb9330 2024-09-12T02:48:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.197+0000 7f9e7dc00640 1 -- 172.21.15.18:0/2254446632 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e8402b030 con 0x557b8dfb9330 2024-09-12T02:48:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.197+0000 7f9e7dc00640 1 -- 172.21.15.18:0/2254446632 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840198c0 con 0x557b8dfb9330 2024-09-12T02:48:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.198+0000 7f9e965fd740 1 -- 172.21.15.18:0/2254446632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9330 msgr2=0x557b8dfd5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.198+0000 7f9e965fd740 1 --2- 172.21.15.18:0/2254446632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9330 0x557b8dfd5ab0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009b80 tx=0x7f9e84009500 comp rx=0 tx=0).stop 2024-09-12T02:48:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.198+0000 7f9e965fd740 1 -- 172.21.15.18:0/2254446632 shutdown_connections 2024-09-12T02:48:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.198+0000 7f9e965fd740 1 --2- 172.21.15.18:0/2254446632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfc4510 0x557b8dfc1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.198+0000 7f9e965fd740 1 --2- 172.21.15.18:0/2254446632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfb9c50 0x557b8dfbc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.198+0000 7f9e965fd740 1 --2- 172.21.15.18:0/2254446632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfb9330 0x557b8dfd5ab0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.198+0000 7f9e965fd740 1 -- 172.21.15.18:0/2254446632 >> 172.21.15.18:0/2254446632 conn(0x557b8dfb58c0 msgr2=0x557b8dfbadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.198+0000 7f9e965fd740 1 -- 172.21.15.18:0/2254446632 shutdown_connections 2024-09-12T02:48:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.198+0000 7f9e965fd740 1 -- 172.21.15.18:0/2254446632 wait complete. 2024-09-12T02:48:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.199+0000 7f9e965fd740 1 -- start start 2024-09-12T02:48:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.199+0000 7f9e965fd740 1 Processor -- start 2024-09-12T02:48:32.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.199+0000 7f9e965fd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 0x557b8dfdec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.199+0000 7f9e965fd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfb9c50 0x557b8dfdf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.199+0000 7f9e965fd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfc4510 0x557b8dfd9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.199+0000 7f9e965fd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557b8dfd66d0 con 0x557b8dfc4510 2024-09-12T02:48:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.199+0000 7f9e965fd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557b8dfd6000 con 0x557b8dfb9330 2024-09-12T02:48:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.199+0000 7f9e965fd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x557b8dfd6da0 con 0x557b8dfb9c50 2024-09-12T02:48:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.199+0000 7f9e965fd740 10 client.0 _ll_register_callbacks cb 0x7f9e78005dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.200+0000 7f9e92000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 0x557b8dfdec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.200+0000 7f9e92000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfc4510 0x557b8dfd9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.200+0000 7f9e92000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfc4510 0x557b8dfd9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43540/0 (socket says 172.21.15.18:43540) 2024-09-12T02:48:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.200+0000 7f9e92000640 1 -- 172.21.15.18:0/3123794692 learned_addr learned my addr 172.21.15.18:0/3123794692 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.200+0000 7f9e90c00640 1 --2- 172.21.15.18:0/3123794692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfb9c50 0x557b8dfdf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.200+0000 7f9e90c00640 1 -- 172.21.15.18:0/3123794692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 msgr2=0x557b8dfdec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.200+0000 7f9e90c00640 1 --2- 172.21.15.18:0/3123794692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 0x557b8dfdec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.200+0000 7f9e90c00640 1 -- 172.21.15.18:0/3123794692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfc4510 msgr2=0x557b8dfd9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.200+0000 7f9e90c00640 1 --2- 172.21.15.18:0/3123794692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfc4510 0x557b8dfd9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.200+0000 7f9e90c00640 1 -- 172.21.15.18:0/3123794692 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b8dfda150 con 0x557b8dfb9c50 2024-09-12T02:48:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.200+0000 7f9e92000640 1 --2- 172.21.15.18:0/3123794692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfc4510 0x557b8dfd9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.201+0000 7f9e90c00640 1 --2- 172.21.15.18:0/3123794692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfb9c50 0x557b8dfdf1d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009a20 tx=0x7f9e78004970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ac8425b57dabd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.201+0000 7f9e72a00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:48:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.201+0000 7f9e72a00640 1 -- 172.21.15.18:0/3123794692 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e78035040 con 0x557b8dfb9c50 2024-09-12T02:48:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.201+0000 7f9e965fd740 1 -- 172.21.15.18:0/3123794692 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e8402b030 con 0x557b8dfb9c50 2024-09-12T02:48:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.201+0000 7f9e72a00640 1 -- 172.21.15.18:0/3123794692 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f9e780317c0 con 0x557b8dfb9c50 2024-09-12T02:48:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.201+0000 7f9e72a00640 1 -- 172.21.15.18:0/3123794692 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9e78005850 con 0x557b8dfb9c50 2024-09-12T02:48:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.201+0000 7f9e965fd740 10 client.25174 fetch_fsmap learned FSMap version 29 2024-09-12T02:48:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.201+0000 7f9e965fd740 1 -- 172.21.15.18:0/3123794692 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557b8e048cc0 con 0x557b8dfb9c50 2024-09-12T02:48:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.202+0000 7f9e72a00640 1 -- 172.21.15.18:0/3123794692 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e8402b030 con 0x557b8dfb9c50 2024-09-12T02:48:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.202+0000 7f9e72a00640 1 -- 172.21.15.18:0/3123794692 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9e7805b030 con 0x557b8dfb9c50 2024-09-12T02:48:32.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.202+0000 7f9e965fd740 10 client.25174 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:48:32.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.202+0000 7f9e965fd740 10 client.25174 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:48:32.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.202+0000 7f9e965fd740 20 client.25174 populate_metadata read hostname 'smithi018' 2024-09-12T02:48:32.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.202+0000 7f9e965fd740 1 --2- 172.21.15.18:0/3123794692 >> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] conn(0x557b8e04d910 0x557b8e04c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:32.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.202+0000 7f9e965fd740 4 client.25174 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:48:32.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.202+0000 7f9e965fd740 1 -- 172.21.15.18:0/3123794692 --> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] -- command(tid 0: {"prefix": "status"}) -- 0x557b8dfb6470 con 0x557b8e04d910 2024-09-12T02:48:32.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.202+0000 7f9e92000640 1 --2- 172.21.15.18:0/3123794692 >> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] conn(0x557b8e04d910 0x557b8e04c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:32.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.203+0000 7f9e92000640 1 --2- 172.21.15.18:0/3123794692 >> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] conn(0x557b8e04d910 0x557b8e04c620 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=38869396346d6a49 server_cookie=e330d9c0ab902e52 in_seq=0 out_seq=0 2024-09-12T02:48:32.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.203+0000 7f9e72a00640 10 client.25174 ms_handle_connect on v2:172.21.15.18:6840/823308007 2024-09-12T02:48:32.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.203+0000 7f9e72a00640 1 -- 172.21.15.18:0/3123794692 <== mds.1 v2:172.21.15.18:6840/823308007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557b8dfb6470 con 0x557b8e04d910 2024-09-12T02:48:32.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.203+0000 7f9e72a00640 10 client.25174 handle_command_reply: tid=0 2024-09-12T02:48:32.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.203+0000 7f9e965fd740 1 client.25174 shutdown 2024-09-12T02:48:32.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.203+0000 7f9e965fd740 1 -- 172.21.15.18:0/3123794692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfb9c50 msgr2=0x557b8dfdf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.203+0000 7f9e965fd740 1 --2- 172.21.15.18:0/3123794692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfb9c50 0x557b8dfdf1d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009a20 tx=0x7f9e78004970 comp rx=0 tx=0).stop 2024-09-12T02:48:32.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.203+0000 7f9e965fd740 1 -- 172.21.15.18:0/3123794692 shutdown_connections 2024-09-12T02:48:32.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.203+0000 7f9e965fd740 1 --2- 172.21.15.18:0/3123794692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8dfc4510 0x557b8dfd9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.203+0000 7f9e965fd740 1 --2- 172.21.15.18:0/3123794692 >> [v2:172.21.15.18:6840/823308007,v1:172.21.15.18:6841/823308007] conn(0x557b8e04d910 0x557b8e04c620 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.203+0000 7f9e965fd740 1 --2- 172.21.15.18:0/3123794692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b8dfb9c50 0x557b8dfdf1d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.203+0000 7f9e965fd740 1 --2- 172.21.15.18:0/3123794692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b8dfb9330 0x557b8dfdec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.203+0000 7f9e965fd740 1 -- 172.21.15.18:0/3123794692 >> 172.21.15.18:0/3123794692 conn(0x557b8dfb58c0 msgr2=0x557b8dfb4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:32.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.203+0000 7f9e72a00640 0 client.25174 ms_handle_reset on v2:172.21.15.18:6840/823308007 2024-09-12T02:48:32.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.203+0000 7f9e965fd740 1 -- 172.21.15.18:0/3123794692 shutdown_connections 2024-09-12T02:48:32.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.204+0000 7f9e965fd740 1 -- 172.21.15.18:0/3123794692 wait complete. 2024-09-12T02:48:32.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.204+0000 7f9e965fd740 20 client.25174 trim_cache size 0 max 16384 2024-09-12T02:48:32.210 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T02:48:32.210 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "c7666100-70af-11ef-bcea-c7b262605968", 2024-09-12T02:48:32.210 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 1, 2024-09-12T02:48:32.210 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24526, 2024-09-12T02:48:32.210 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-12T02:48:32.210 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-12T02:48:32.210 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-12T02:48:32.210 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 121.579971648, 2024-09-12T02:48:32.210 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 29, 2024-09-12T02:48:32.211 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 98, 2024-09-12T02:48:32.211 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 96, 2024-09-12T02:48:32.211 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 192.44507218699999 2024-09-12T02:48:32.211 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T02:48:32.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.204+0000 7f9e94000640 1 -- 172.21.15.18:0/722749708 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9e740a2c00 msgr2=0x7f9e740a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.204+0000 7f9e94000640 1 --2- 172.21.15.18:0/722749708 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9e740a2c00 0x7f9e740a50c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9e800cca00 tx=0x7f9e800d2d50 comp rx=0 tx=0).stop 2024-09-12T02:48:32.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.204+0000 7f9e94000640 1 -- 172.21.15.18:0/722749708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e8c103ff0 msgr2=0x7f9e8c19a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:32.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.204+0000 7f9e94000640 1 --2- 172.21.15.18:0/722749708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e8c103ff0 0x7f9e8c19a680 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000e9f0 tx=0x7f9e8000edf0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.204+0000 7f9e94000640 1 -- 172.21.15.18:0/722749708 shutdown_connections 2024-09-12T02:48:32.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.204+0000 7f9e94000640 1 --2- 172.21.15.18:0/722749708 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f9e740a2c00 0x7f9e740a50c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.204+0000 7f9e94000640 1 --2- 172.21.15.18:0/722749708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e8c109120 0x7f9e8c19ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.204+0000 7f9e94000640 1 --2- 172.21.15.18:0/722749708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e8c1049a0 0x7f9e8c19abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.204+0000 7f9e94000640 1 --2- 172.21.15.18:0/722749708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e8c103ff0 0x7f9e8c19a680 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:32.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.204+0000 7f9e94000640 1 -- 172.21.15.18:0/722749708 >> 172.21.15.18:0/722749708 conn(0x7f9e8c0ffa90 msgr2=0x7f9e8c100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:32.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.205+0000 7f9e94000640 1 -- 172.21.15.18:0/722749708 shutdown_connections 2024-09-12T02:48:32.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:32.205+0000 7f9e94000640 1 -- 172.21.15.18:0/722749708 wait complete. 2024-09-12T02:48:32.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:32 smithi176 ceph-mon[35713]: pgmap v398: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:48:33.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:32 smithi062 ceph-mon[35527]: pgmap v398: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:48:33.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:32 smithi018 ceph-mon[30616]: pgmap v398: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:48:33.295 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:48:33.677 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:34.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.305+0000 7feedb200640 1 -- 172.21.15.18:0/3225410079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feedc102360 msgr2=0x7feedc10e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:34.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.305+0000 7feedb200640 1 --2- 172.21.15.18:0/3225410079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feedc102360 0x7feedc10e890 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feed4009cd0 tx=0x7feed402a8e0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.305+0000 7feedb200640 1 -- 172.21.15.18:0/3225410079 shutdown_connections 2024-09-12T02:48:34.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.305+0000 7feedb200640 1 --2- 172.21.15.18:0/3225410079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feedc102360 0x7feedc10e890 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.305+0000 7feedb200640 1 --2- 172.21.15.18:0/3225410079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc1019c0 0x7feedc101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.305+0000 7feedb200640 1 --2- 172.21.15.18:0/3225410079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feedc1079c0 0x7feedc107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.305+0000 7feedb200640 1 -- 172.21.15.18:0/3225410079 >> 172.21.15.18:0/3225410079 conn(0x7feedc0fd6e0 msgr2=0x7feedc0ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:34.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.305+0000 7feedb200640 1 -- 172.21.15.18:0/3225410079 shutdown_connections 2024-09-12T02:48:34.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.305+0000 7feedb200640 1 -- 172.21.15.18:0/3225410079 wait complete. 2024-09-12T02:48:34.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.306+0000 7feedb200640 1 Processor -- start 2024-09-12T02:48:34.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.307+0000 7feedb200640 1 -- start start 2024-09-12T02:48:34.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.307+0000 7feedb200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feedc1019c0 0x7feedc19a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.307+0000 7feedb200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feedc102360 0x7feedc19a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.307+0000 7feedb200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc1079c0 0x7feedc19ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.307+0000 7feedb200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feedc111e10 con 0x7feedc1019c0 2024-09-12T02:48:34.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.307+0000 7feedb200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7feedc111c90 con 0x7feedc102360 2024-09-12T02:48:34.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.307+0000 7feedb200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feedc111f90 con 0x7feedc1079c0 2024-09-12T02:48:34.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.307+0000 7feed9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feedc1019c0 0x7feedc19a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.307+0000 7feed9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feedc1019c0 0x7feedc19a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43550/0 (socket says 172.21.15.18:43550) 2024-09-12T02:48:34.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.307+0000 7feed9e00640 1 -- 172.21.15.18:0/4051525777 learned_addr learned my addr 172.21.15.18:0/4051525777 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:34.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.307+0000 7feed9400640 1 --2- 172.21.15.18:0/4051525777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feedc102360 0x7feedc19a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.308+0000 7feeda800640 1 --2- 172.21.15.18:0/4051525777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc1079c0 0x7feedc19ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.308+0000 7feed9e00640 1 -- 172.21.15.18:0/4051525777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc1079c0 msgr2=0x7feedc19ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:34.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.308+0000 7feed9e00640 1 --2- 172.21.15.18:0/4051525777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc1079c0 0x7feedc19ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.308+0000 7feed9e00640 1 -- 172.21.15.18:0/4051525777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feedc102360 msgr2=0x7feedc19a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:34.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.308+0000 7feed9e00640 1 --2- 172.21.15.18:0/4051525777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feedc102360 0x7feedc19a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.308+0000 7feed9e00640 1 -- 172.21.15.18:0/4051525777 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feedc19f370 con 0x7feedc1019c0 2024-09-12T02:48:34.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.308+0000 7feeda800640 1 --2- 172.21.15.18:0/4051525777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc1079c0 0x7feedc19ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:34.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.308+0000 7feed9e00640 1 --2- 172.21.15.18:0/4051525777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feedc1019c0 0x7feedc19a3c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7feecc00ea60 tx=0x7feecc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:34.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.308+0000 7feed2a00640 1 -- 172.21.15.18:0/4051525777 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc00cde0 con 0x7feedc1019c0 2024-09-12T02:48:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.308+0000 7feedb200640 1 -- 172.21.15.18:0/4051525777 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feedc19f660 con 0x7feedc1019c0 2024-09-12T02:48:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.308+0000 7feed2a00640 1 -- 172.21.15.18:0/4051525777 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feecc0035f0 con 0x7feedc1019c0 2024-09-12T02:48:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.308+0000 7feed2a00640 1 -- 172.21.15.18:0/4051525777 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc010670 con 0x7feedc1019c0 2024-09-12T02:48:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.309+0000 7feedb200640 1 -- 172.21.15.18:0/4051525777 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feedc1a6f40 con 0x7feedc1019c0 2024-09-12T02:48:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.311+0000 7feed2a00640 1 -- 172.21.15.18:0/4051525777 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7feecc0037a0 con 0x7feedc1019c0 2024-09-12T02:48:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.312+0000 7feee3624740 1 Processor -- start 2024-09-12T02:48:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.312+0000 7feee3624740 1 -- start start 2024-09-12T02:48:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.312+0000 7feee3624740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf684e0 0x5606dbf688c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.312+0000 7feee3624740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf73180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.312+0000 7feee3624740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf736c0 0x5606dbf75ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.312+0000 7feee3624740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5606dbece0b0 con 0x5606dbf684e0 2024-09-12T02:48:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.312+0000 7feee3624740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5606dbe75ab0 con 0x5606dbf736c0 2024-09-12T02:48:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.312+0000 7feee3624740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5606dbeca070 con 0x5606dbf68e00 2024-09-12T02:48:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.312+0000 7feeda800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf684e0 0x5606dbf688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.312+0000 7feed9400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf736c0 0x5606dbf75ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.312+0000 7feed9400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf736c0 0x5606dbf75ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:57908/0 (socket says 172.21.15.18:57908) 2024-09-12T02:48:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.312+0000 7feed9400640 1 -- 172.21.15.18:0/1935661518 learned_addr learned my addr 172.21.15.18:0/1935661518 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.312+0000 7feeda800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf684e0 0x5606dbf688c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43562/0 (socket says 172.21.15.18:43562) 2024-09-12T02:48:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.312+0000 7feed9e00640 1 --2- 172.21.15.18:0/1935661518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf73180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.313+0000 7feed9400640 1 -- 172.21.15.18:0/1935661518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 msgr2=0x5606dbf73180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.313+0000 7feed9400640 1 --2- 172.21.15.18:0/1935661518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf73180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.313+0000 7feed9400640 1 -- 172.21.15.18:0/1935661518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf684e0 msgr2=0x5606dbf688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.313+0000 7feed9400640 1 --2- 172.21.15.18:0/1935661518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf684e0 0x5606dbf688c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.313+0000 7feed9400640 1 -- 172.21.15.18:0/1935661518 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606dbe824a0 con 0x5606dbf736c0 2024-09-12T02:48:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.313+0000 7feed2a00640 1 --2- 172.21.15.18:0/4051525777 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7feec00a2b80 0x7feec00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.313+0000 7feed9400640 1 --2- 172.21.15.18:0/1935661518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf736c0 0x5606dbf75ab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feec800bc90 tx=0x7feec80107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32f6351838579a28 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:34.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.313+0000 7feed2a00640 1 -- 172.21.15.18:0/4051525777 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7feecc0cf770 con 0x7feedc1019c0 2024-09-12T02:48:34.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.313+0000 7feeda800640 1 --2- 172.21.15.18:0/4051525777 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7feec00a2b80 0x7feec00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.313+0000 7feec7000640 1 -- 172.21.15.18:0/1935661518 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8005220 con 0x5606dbf736c0 2024-09-12T02:48:34.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.314+0000 7feec7000640 1 -- 172.21.15.18:0/1935661518 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feec800be40 con 0x5606dbf736c0 2024-09-12T02:48:34.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.314+0000 7feec7000640 1 -- 172.21.15.18:0/1935661518 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8011790 con 0x5606dbf736c0 2024-09-12T02:48:34.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.314+0000 7feee3624740 1 -- 172.21.15.18:0/1935661518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf736c0 msgr2=0x5606dbf75ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:34.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.314+0000 7feeda800640 1 --2- 172.21.15.18:0/4051525777 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7feec00a2b80 0x7feec00a5040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7feed4004af0 tx=0x7feed4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:34.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.314+0000 7feee3624740 1 --2- 172.21.15.18:0/1935661518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf736c0 0x5606dbf75ab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feec800bc90 tx=0x7feec80107a0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.315+0000 7feee3624740 1 -- 172.21.15.18:0/1935661518 shutdown_connections 2024-09-12T02:48:34.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.315+0000 7feee3624740 1 --2- 172.21.15.18:0/1935661518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf736c0 0x5606dbf75ab0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.315+0000 7feee3624740 1 --2- 172.21.15.18:0/1935661518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf73180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.315+0000 7feee3624740 1 --2- 172.21.15.18:0/1935661518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf684e0 0x5606dbf688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.315+0000 7feee3624740 1 -- 172.21.15.18:0/1935661518 >> 172.21.15.18:0/1935661518 conn(0x5606dbf64a70 msgr2=0x5606dbf64e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.315+0000 7feee3624740 1 -- 172.21.15.18:0/1935661518 shutdown_connections 2024-09-12T02:48:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.315+0000 7feee3624740 1 -- 172.21.15.18:0/1935661518 wait complete. 2024-09-12T02:48:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.315+0000 7feee3624740 1 -- start start 2024-09-12T02:48:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.315+0000 7feee3624740 1 Processor -- start 2024-09-12T02:48:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.316+0000 7feee3624740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf684e0 0x5606dbf70510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.316+0000 7feee3624740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf70a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.316+0000 7feee3624740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf736c0 0x5606dbf70f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.316+0000 7feee3624740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5606dbf76330 con 0x5606dbf736c0 2024-09-12T02:48:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.316+0000 7feee3624740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5606dbe56920 con 0x5606dbf684e0 2024-09-12T02:48:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.316+0000 7feee3624740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5606dbf764b0 con 0x5606dbf68e00 2024-09-12T02:48:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.316+0000 7feee3624740 10 client.0 _ll_register_callbacks cb 0x5606dbe7a8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.316+0000 7feeda800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf736c0 0x5606dbf70f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.316+0000 7feeda800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf736c0 0x5606dbf70f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43564/0 (socket says 172.21.15.18:43564) 2024-09-12T02:48:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.316+0000 7feeda800640 1 -- 172.21.15.18:0/3082251455 learned_addr learned my addr 172.21.15.18:0/3082251455 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.316+0000 7feed9e00640 1 --2- 172.21.15.18:0/3082251455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf684e0 0x5606dbf70510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.316+0000 7feed9400640 1 --2- 172.21.15.18:0/3082251455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf70a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.317+0000 7feeda800640 1 -- 172.21.15.18:0/3082251455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 msgr2=0x5606dbf70a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.317+0000 7feeda800640 1 --2- 172.21.15.18:0/3082251455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf70a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.317+0000 7feeda800640 1 -- 172.21.15.18:0/3082251455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf684e0 msgr2=0x5606dbf70510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.317+0000 7feeda800640 1 --2- 172.21.15.18:0/3082251455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf684e0 0x5606dbf70510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.317+0000 7feeda800640 1 -- 172.21.15.18:0/3082251455 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606dbc3f2b0 con 0x5606dbf736c0 2024-09-12T02:48:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.317+0000 7feed9e00640 1 --2- 172.21.15.18:0/3082251455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf684e0 0x5606dbf70510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.317+0000 7feeda800640 1 --2- 172.21.15.18:0/3082251455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf736c0 0x5606dbf70f90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feed4031e70 tx=0x7feed402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844582cd4e09097a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.317+0000 7feebb400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:48:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.317+0000 7feebb400640 1 -- 172.21.15.18:0/3082251455 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4056060 con 0x5606dbf736c0 2024-09-12T02:48:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.317+0000 7feee3624740 1 -- 172.21.15.18:0/3082251455 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5606dbedb620 con 0x5606dbf736c0 2024-09-12T02:48:34.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.317+0000 7feebb400640 1 -- 172.21.15.18:0/3082251455 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7feed4041030 con 0x5606dbf736c0 2024-09-12T02:48:34.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.317+0000 7feebb400640 1 -- 172.21.15.18:0/3082251455 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feed405d050 con 0x5606dbf736c0 2024-09-12T02:48:34.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.317+0000 7feee3624740 10 client.15174 fetch_fsmap learned FSMap version 29 2024-09-12T02:48:34.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.317+0000 7feee3624740 1 -- 172.21.15.18:0/3082251455 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5606dbf81f90 con 0x5606dbf736c0 2024-09-12T02:48:34.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.318+0000 7feebb400640 1 -- 172.21.15.18:0/3082251455 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5606dbedb620 con 0x5606dbf736c0 2024-09-12T02:48:34.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.318+0000 7feebb400640 1 -- 172.21.15.18:0/3082251455 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7feed4030070 con 0x5606dbf736c0 2024-09-12T02:48:34.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.318+0000 7feee3624740 10 client.15174 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:48:34.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.318+0000 7feee3624740 10 client.15174 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:48:34.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.318+0000 7feee3624740 20 client.15174 populate_metadata read hostname 'smithi018' 2024-09-12T02:48:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.318+0000 7feee3624740 1 --2- 172.21.15.18:0/3082251455 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5606dbf84570 0x5606dbf859e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.318+0000 7feee3624740 4 client.15174 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:48:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.318+0000 7feee3624740 1 -- 172.21.15.18:0/3082251455 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606dbed5b30 con 0x5606dbf84570 2024-09-12T02:48:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.318+0000 7feed9e00640 1 --2- 172.21.15.18:0/3082251455 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5606dbf84570 0x5606dbf859e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.319+0000 7feed9e00640 1 --2- 172.21.15.18:0/3082251455 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5606dbf84570 0x5606dbf859e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad2d370f32415629 server_cookie=5f2b464fa77eab58 in_seq=0 out_seq=0 2024-09-12T02:48:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.319+0000 7feebb400640 10 client.15174 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:48:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.320+0000 7feebb400640 1 -- 172.21.15.18:0/3082251455 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5606dbed5b30 con 0x5606dbf84570 2024-09-12T02:48:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.320+0000 7feebb400640 10 client.15174 handle_command_reply: tid=0 2024-09-12T02:48:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.320+0000 7feee3624740 1 client.15174 shutdown 2024-09-12T02:48:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.320+0000 7feee3624740 1 -- 172.21.15.18:0/3082251455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf736c0 msgr2=0x5606dbf70f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.320+0000 7feee3624740 1 --2- 172.21.15.18:0/3082251455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf736c0 0x5606dbf70f90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feed4031e70 tx=0x7feed402a8e0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.320+0000 7feee3624740 1 -- 172.21.15.18:0/3082251455 shutdown_connections 2024-09-12T02:48:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.320+0000 7feee3624740 1 --2- 172.21.15.18:0/3082251455 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5606dbf84570 0x5606dbf859e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.320+0000 7feee3624740 1 --2- 172.21.15.18:0/3082251455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf736c0 0x5606dbf70f90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.320+0000 7feee3624740 1 --2- 172.21.15.18:0/3082251455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf70a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.320+0000 7feee3624740 1 --2- 172.21.15.18:0/3082251455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf684e0 0x5606dbf70510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.320+0000 7feebb400640 0 client.15174 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:48:34.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.320+0000 7feee3624740 1 -- 172.21.15.18:0/3082251455 >> 172.21.15.18:0/3082251455 conn(0x5606dbf64a70 msgr2=0x5606dbf6a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:34.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.320+0000 7feee3624740 1 -- 172.21.15.18:0/3082251455 shutdown_connections 2024-09-12T02:48:34.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.320+0000 7feee3624740 1 -- 172.21.15.18:0/3082251455 wait complete. 2024-09-12T02:48:34.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.320+0000 7feee3624740 20 client.15174 trim_cache size 0 max 16384 2024-09-12T02:48:34.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.339+0000 7feee3624740 1 Processor -- start 2024-09-12T02:48:34.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.339+0000 7feee3624740 1 -- start start 2024-09-12T02:48:34.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.339+0000 7feee3624740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf684e0 0x5606dbf5f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.339+0000 7feee3624740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf6ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.339+0000 7feee3624740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf736c0 0x5606dbf6f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.339+0000 7feee3624740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5606dbf83d20 con 0x5606dbf736c0 2024-09-12T02:48:34.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.339+0000 7feee3624740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5606dbf843f0 con 0x5606dbf684e0 2024-09-12T02:48:34.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.339+0000 7feee3624740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5606dbf84ac0 con 0x5606dbf68e00 2024-09-12T02:48:34.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.340+0000 7feed9400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf6ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.340+0000 7feed9e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf684e0 0x5606dbf5f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.340+0000 7feed9400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf6ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:52434/0 (socket says 172.21.15.18:52434) 2024-09-12T02:48:34.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.340+0000 7feed9400640 1 -- 172.21.15.18:0/2603783249 learned_addr learned my addr 172.21.15.18:0/2603783249 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:34.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.340+0000 7feeda800640 1 --2- 172.21.15.18:0/2603783249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf736c0 0x5606dbf6f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.340+0000 7feed9e00640 1 -- 172.21.15.18:0/2603783249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 msgr2=0x5606dbf6ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:34.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.340+0000 7feed9e00640 1 --2- 172.21.15.18:0/2603783249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf6ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.340+0000 7feed9e00640 1 -- 172.21.15.18:0/2603783249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf736c0 msgr2=0x5606dbf6f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:34.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.340+0000 7feed9e00640 1 --2- 172.21.15.18:0/2603783249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf736c0 0x5606dbf6f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.340+0000 7feed9e00640 1 -- 172.21.15.18:0/2603783249 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606dbf648a0 con 0x5606dbf684e0 2024-09-12T02:48:34.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.340+0000 7feed9400640 1 --2- 172.21.15.18:0/2603783249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf6ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:34.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.340+0000 7feed9e00640 1 --2- 172.21.15.18:0/2603783249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf684e0 0x5606dbf5f840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5606dbf658d0 tx=0x7feecc003f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55b9144e7ce5272 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:34.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.341+0000 7feec6600640 1 -- 172.21.15.18:0/2603783249 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc09bbc0 con 0x5606dbf684e0 2024-09-12T02:48:34.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.341+0000 7feec6600640 1 -- 172.21.15.18:0/2603783249 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feecc09ff70 con 0x5606dbf684e0 2024-09-12T02:48:34.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.341+0000 7feec6600640 1 -- 172.21.15.18:0/2603783249 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc0cf400 con 0x5606dbf684e0 2024-09-12T02:48:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.341+0000 7feee3624740 1 -- 172.21.15.18:0/2603783249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf684e0 msgr2=0x5606dbf5f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.341+0000 7feee3624740 1 --2- 172.21.15.18:0/2603783249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf684e0 0x5606dbf5f840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5606dbf658d0 tx=0x7feecc003f30 comp rx=0 tx=0).stop 2024-09-12T02:48:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.341+0000 7feee3624740 1 -- 172.21.15.18:0/2603783249 shutdown_connections 2024-09-12T02:48:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.341+0000 7feee3624740 1 --2- 172.21.15.18:0/2603783249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf736c0 0x5606dbf6f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.341+0000 7feee3624740 1 --2- 172.21.15.18:0/2603783249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf6ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.341+0000 7feee3624740 1 --2- 172.21.15.18:0/2603783249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf684e0 0x5606dbf5f840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.341+0000 7feee3624740 1 -- 172.21.15.18:0/2603783249 >> 172.21.15.18:0/2603783249 conn(0x5606dbf64a70 msgr2=0x5606dbf6b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.341+0000 7feee3624740 1 -- 172.21.15.18:0/2603783249 shutdown_connections 2024-09-12T02:48:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.342+0000 7feee3624740 1 -- 172.21.15.18:0/2603783249 wait complete. 2024-09-12T02:48:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.342+0000 7feee3624740 1 -- start start 2024-09-12T02:48:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.342+0000 7feee3624740 1 Processor -- start 2024-09-12T02:48:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.343+0000 7feee3624740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf684e0 0x5606dbf8e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.343+0000 7feee3624740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf6d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.343+0000 7feee3624740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf736c0 0x5606dbf6d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.343+0000 7feee3624740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5606dbf85860 con 0x5606dbf684e0 2024-09-12T02:48:34.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.343+0000 7feee3624740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5606dbf85190 con 0x5606dbf736c0 2024-09-12T02:48:34.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.343+0000 7feee3624740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5606dbf85f30 con 0x5606dbf68e00 2024-09-12T02:48:34.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.343+0000 7feee3624740 10 client.0 _ll_register_callbacks cb 0x7feed4031d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:48:34.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.343+0000 7feed9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf684e0 0x5606dbf8e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.343+0000 7feed9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf684e0 0x5606dbf8e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43590/0 (socket says 172.21.15.18:43590) 2024-09-12T02:48:34.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.343+0000 7feed9e00640 1 -- 172.21.15.18:0/2739039780 learned_addr learned my addr 172.21.15.18:0/2739039780 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:34.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.343+0000 7feed9400640 1 --2- 172.21.15.18:0/2739039780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf6d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.343+0000 7feeda800640 1 --2- 172.21.15.18:0/2739039780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf736c0 0x5606dbf6d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.343+0000 7feed9e00640 1 -- 172.21.15.18:0/2739039780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 msgr2=0x5606dbf6d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:34.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.343+0000 7feed9e00640 1 --2- 172.21.15.18:0/2739039780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf6d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.343+0000 7feed9e00640 1 -- 172.21.15.18:0/2739039780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf736c0 msgr2=0x5606dbf6d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:48:34.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.343+0000 7feed9e00640 1 --2- 172.21.15.18:0/2739039780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf736c0 0x5606dbf6d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.343+0000 7feed9e00640 1 -- 172.21.15.18:0/2739039780 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606dbf6e0d0 con 0x5606dbf684e0 2024-09-12T02:48:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.344+0000 7feed9e00640 1 --2- 172.21.15.18:0/2739039780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf684e0 0x5606dbf8e350 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feecc003ee0 tx=0x7feecc003bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e08911f10be78a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.344+0000 7feebb400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:48:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.344+0000 7feebb400640 1 -- 172.21.15.18:0/2739039780 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc063070 con 0x5606dbf684e0 2024-09-12T02:48:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.344+0000 7feebb400640 1 -- 172.21.15.18:0/2739039780 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7feecc099ec0 con 0x5606dbf684e0 2024-09-12T02:48:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.344+0000 7feee3624740 1 -- 172.21.15.18:0/2739039780 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feecc09ff70 con 0x5606dbf684e0 2024-09-12T02:48:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.344+0000 7feebb400640 1 -- 172.21.15.18:0/2739039780 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feecc0b8030 con 0x5606dbf684e0 2024-09-12T02:48:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.344+0000 7feee3624740 10 client.15180 fetch_fsmap learned FSMap version 29 2024-09-12T02:48:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.344+0000 7feee3624740 1 -- 172.21.15.18:0/2739039780 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5606dbfeece0 con 0x5606dbf684e0 2024-09-12T02:48:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.344+0000 7feebb400640 1 -- 172.21.15.18:0/2739039780 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feecc09ff70 con 0x5606dbf684e0 2024-09-12T02:48:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.345+0000 7feebb400640 1 -- 172.21.15.18:0/2739039780 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7feecc066020 con 0x5606dbf684e0 2024-09-12T02:48:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.345+0000 7feee3624740 10 client.15180 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:48:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.345+0000 7feee3624740 10 client.15180 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:48:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.345+0000 7feee3624740 20 client.15180 populate_metadata read hostname 'smithi018' 2024-09-12T02:48:34.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.345+0000 7feee3624740 1 --2- 172.21.15.18:0/2739039780 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5606dbff31f0 0x5606dbff1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:34.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.345+0000 7feee3624740 4 client.15180 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:48:34.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.345+0000 7feee3624740 1 -- 172.21.15.18:0/2739039780 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "status"}) -- 0x5606dbe51f80 con 0x5606dbff31f0 2024-09-12T02:48:34.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.345+0000 7feed9400640 1 --2- 172.21.15.18:0/2739039780 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5606dbff31f0 0x5606dbff1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:34.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.346+0000 7feed9400640 1 --2- 172.21.15.18:0/2739039780 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5606dbff31f0 0x5606dbff1f00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb4cb9ecc755875b server_cookie=8b74b89d8a38509e in_seq=0 out_seq=0 2024-09-12T02:48:34.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.346+0000 7feebb400640 10 client.15180 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:48:34.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.346+0000 7feebb400640 1 -- 172.21.15.18:0/2739039780 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5606dbe51f80 con 0x5606dbff31f0 2024-09-12T02:48:34.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.346+0000 7feebb400640 10 client.15180 handle_command_reply: tid=0 2024-09-12T02:48:34.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.346+0000 7feee3624740 1 client.15180 shutdown 2024-09-12T02:48:34.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.346+0000 7feee3624740 1 -- 172.21.15.18:0/2739039780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf684e0 msgr2=0x5606dbf8e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:34.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.346+0000 7feee3624740 1 --2- 172.21.15.18:0/2739039780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf684e0 0x5606dbf8e350 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feecc003ee0 tx=0x7feecc003bb0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.346+0000 7feee3624740 1 -- 172.21.15.18:0/2739039780 shutdown_connections 2024-09-12T02:48:34.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.346+0000 7feee3624740 1 --2- 172.21.15.18:0/2739039780 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5606dbff31f0 0x5606dbff1f00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.346+0000 7feee3624740 1 --2- 172.21.15.18:0/2739039780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5606dbf736c0 0x5606dbf6d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.346+0000 7feee3624740 1 --2- 172.21.15.18:0/2739039780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dbf68e00 0x5606dbf6d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.346+0000 7feee3624740 1 --2- 172.21.15.18:0/2739039780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606dbf684e0 0x5606dbf8e350 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.346+0000 7feebb400640 0 client.15180 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:48:34.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.346+0000 7feee3624740 1 -- 172.21.15.18:0/2739039780 >> 172.21.15.18:0/2739039780 conn(0x5606dbf64a70 msgr2=0x5606dbf69f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:34.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.347+0000 7feee3624740 1 -- 172.21.15.18:0/2739039780 shutdown_connections 2024-09-12T02:48:34.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.347+0000 7feee3624740 1 -- 172.21.15.18:0/2739039780 wait complete. 2024-09-12T02:48:34.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.347+0000 7feee3624740 20 client.15180 trim_cache size 0 max 16384 2024-09-12T02:48:34.356 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T02:48:34.356 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "c7666100-70af-11ef-bcea-c7b262605968", 2024-09-12T02:48:34.357 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-12T02:48:34.357 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24527, 2024-09-12T02:48:34.357 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-12T02:48:34.357 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-12T02:48:34.357 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-12T02:48:34.357 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 176.922816329, 2024-09-12T02:48:34.357 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 29, 2024-09-12T02:48:34.357 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 98, 2024-09-12T02:48:34.357 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 96, 2024-09-12T02:48:34.358 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 191.929924457 2024-09-12T02:48:34.358 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T02:48:34.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.347+0000 7feedb200640 1 -- 172.21.15.18:0/4051525777 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7feec00a2b80 msgr2=0x7feec00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:34.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.347+0000 7feedb200640 1 --2- 172.21.15.18:0/4051525777 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7feec00a2b80 0x7feec00a5040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7feed4004af0 tx=0x7feed4004a40 comp rx=0 tx=0).stop 2024-09-12T02:48:34.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.347+0000 7feedb200640 1 -- 172.21.15.18:0/4051525777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feedc1019c0 msgr2=0x7feedc19a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:34.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.347+0000 7feedb200640 1 --2- 172.21.15.18:0/4051525777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feedc1019c0 0x7feedc19a3c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7feecc00ea60 tx=0x7feecc00ef20 comp rx=0 tx=0).stop 2024-09-12T02:48:34.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.347+0000 7feedb200640 1 -- 172.21.15.18:0/4051525777 shutdown_connections 2024-09-12T02:48:34.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.348+0000 7feedb200640 1 --2- 172.21.15.18:0/4051525777 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7feec00a2b80 0x7feec00a5040 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.348+0000 7feedb200640 1 --2- 172.21.15.18:0/4051525777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc1079c0 0x7feedc19ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.348+0000 7feedb200640 1 --2- 172.21.15.18:0/4051525777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feedc102360 0x7feedc19a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.348+0000 7feedb200640 1 --2- 172.21.15.18:0/4051525777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feedc1019c0 0x7feedc19a3c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:34.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.348+0000 7feedb200640 1 -- 172.21.15.18:0/4051525777 >> 172.21.15.18:0/4051525777 conn(0x7feedc0fd6e0 msgr2=0x7feedc10d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:34.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.348+0000 7feedb200640 1 -- 172.21.15.18:0/4051525777 shutdown_connections 2024-09-12T02:48:34.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:34.348+0000 7feedb200640 1 -- 172.21.15.18:0/4051525777 wait complete. 2024-09-12T02:48:34.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:34 smithi176 ceph-mon[35713]: pgmap v399: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:48:35.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:34 smithi062 ceph-mon[35527]: pgmap v399: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:48:35.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:34 smithi018 ceph-mon[30616]: pgmap v399: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:48:35.333 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T02:48:35.342 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T02:48:35.342 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T02:48:35.343 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T02:48:35.343 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-12T02:48:35.344 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T02:48:35.344 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-12T02:48:35.344 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-12T02:48:35.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.500+0000 7fa366800640 1 -- 172.21.15.18:0/3844527302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa360074c50 msgr2=0x7fa3600750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:35.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.500+0000 7fa366800640 1 --2- 172.21.15.18:0/3844527302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa360074c50 0x7fa3600750b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009900 tx=0x7fa34c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.500+0000 7fa366800640 1 -- 172.21.15.18:0/3844527302 shutdown_connections 2024-09-12T02:48:35.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.500+0000 7fa366800640 1 --2- 172.21.15.18:0/3844527302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3601099b0 0x7fa36010be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.500+0000 7fa366800640 1 --2- 172.21.15.18:0/3844527302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa360074c50 0x7fa3600750b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.500+0000 7fa366800640 1 --2- 172.21.15.18:0/3844527302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa360076230 0x7fa360074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.500+0000 7fa366800640 1 -- 172.21.15.18:0/3844527302 >> 172.21.15.18:0/3844527302 conn(0x7fa3600fd2e0 msgr2=0x7fa3600ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:35.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.500+0000 7fa366800640 1 -- 172.21.15.18:0/3844527302 shutdown_connections 2024-09-12T02:48:35.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.500+0000 7fa366800640 1 -- 172.21.15.18:0/3844527302 wait complete. 2024-09-12T02:48:35.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.501+0000 7fa366800640 1 Processor -- start 2024-09-12T02:48:35.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.501+0000 7fa366800640 1 -- start start 2024-09-12T02:48:35.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.502+0000 7fa366800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa360074c50 0x7fa360199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:35.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.502+0000 7fa366800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa360076230 0x7fa36019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:35.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.502+0000 7fa366800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3601099b0 0x7fa3601a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:35.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.502+0000 7fa366800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa36010f9e0 con 0x7fa360074c50 2024-09-12T02:48:35.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.502+0000 7fa366800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa36010f860 con 0x7fa3601099b0 2024-09-12T02:48:35.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.502+0000 7fa366800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa36010fb60 con 0x7fa360076230 2024-09-12T02:48:35.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.502+0000 7fa35f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa360074c50 0x7fa360199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:35.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.502+0000 7fa35f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa360074c50 0x7fa360199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57478/0 (socket says 172.21.15.18:57478) 2024-09-12T02:48:35.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.502+0000 7fa35f400640 1 -- 172.21.15.18:0/523768435 learned_addr learned my addr 172.21.15.18:0/523768435 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:35.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.502+0000 7fa35ea00640 1 --2- 172.21.15.18:0/523768435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa360076230 0x7fa36019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:35.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.502+0000 7fa35fe00640 1 --2- 172.21.15.18:0/523768435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3601099b0 0x7fa3601a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:35.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.502+0000 7fa35f400640 1 -- 172.21.15.18:0/523768435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa360076230 msgr2=0x7fa36019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:35.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.502+0000 7fa35f400640 1 --2- 172.21.15.18:0/523768435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa360076230 0x7fa36019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.502+0000 7fa35f400640 1 -- 172.21.15.18:0/523768435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3601099b0 msgr2=0x7fa3601a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:35.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.502+0000 7fa35f400640 1 --2- 172.21.15.18:0/523768435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3601099b0 0x7fa3601a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:35.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.502+0000 7fa35f400640 1 -- 172.21.15.18:0/523768435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3601a1bf0 con 0x7fa360074c50 2024-09-12T02:48:35.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.503+0000 7fa35f400640 1 --2- 172.21.15.18:0/523768435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa360074c50 0x7fa360199fd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa35000ea60 tx=0x7fa35000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:35.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.503+0000 7fa357e00640 1 -- 172.21.15.18:0/523768435 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35000cde0 con 0x7fa360074c50 2024-09-12T02:48:35.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.503+0000 7fa357e00640 1 -- 172.21.15.18:0/523768435 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3500035f0 con 0x7fa360074c50 2024-09-12T02:48:35.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.503+0000 7fa366800640 1 -- 172.21.15.18:0/523768435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3601a1ee0 con 0x7fa360074c50 2024-09-12T02:48:35.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.503+0000 7fa357e00640 1 -- 172.21.15.18:0/523768435 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350010670 con 0x7fa360074c50 2024-09-12T02:48:35.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.503+0000 7fa366800640 1 -- 172.21.15.18:0/523768435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3601a2340 con 0x7fa360074c50 2024-09-12T02:48:35.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.504+0000 7fa366800640 1 -- 172.21.15.18:0/523768435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa360108730 con 0x7fa360074c50 2024-09-12T02:48:35.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.506+0000 7fa357e00640 1 -- 172.21.15.18:0/523768435 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa3500037a0 con 0x7fa360074c50 2024-09-12T02:48:35.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.507+0000 7fa357e00640 1 --2- 172.21.15.18:0/523768435 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa3440a2c30 0x7fa3440a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:35.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.507+0000 7fa357e00640 1 -- 172.21.15.18:0/523768435 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7fa3500cf700 con 0x7fa360074c50 2024-09-12T02:48:35.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.508+0000 7fa35ea00640 1 --2- 172.21.15.18:0/523768435 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa3440a2c30 0x7fa3440a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:35.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.508+0000 7fa35ea00640 1 --2- 172.21.15.18:0/523768435 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa3440a2c30 0x7fa3440a50f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa34c031440 tx=0x7fa34c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:35.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.511+0000 7fa357e00640 1 -- 172.21.15.18:0/523768435 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa35009c250 con 0x7fa360074c50 2024-09-12T02:48:35.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:35.750+0000 7fa366800640 1 -- 172.21.15.18:0/523768435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7fa360062ec0 con 0x7fa360074c50 2024-09-12T02:48:36.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:36.639+0000 7fa357e00640 1 -- 172.21.15.18:0/523768435 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7fa35009bb50 con 0x7fa360074c50 2024-09-12T02:48:36.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:36.643+0000 7fa366800640 1 -- 172.21.15.18:0/523768435 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa3440a2c30 msgr2=0x7fa3440a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:36.643+0000 7fa366800640 1 --2- 172.21.15.18:0/523768435 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa3440a2c30 0x7fa3440a50f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa34c031440 tx=0x7fa34c0315b0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:36.643+0000 7fa366800640 1 -- 172.21.15.18:0/523768435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa360074c50 msgr2=0x7fa360199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:36.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:36.643+0000 7fa366800640 1 --2- 172.21.15.18:0/523768435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa360074c50 0x7fa360199fd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa35000ea60 tx=0x7fa35000ef20 comp rx=0 tx=0).stop 2024-09-12T02:48:36.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:36.644+0000 7fa366800640 1 -- 172.21.15.18:0/523768435 shutdown_connections 2024-09-12T02:48:36.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:36.644+0000 7fa366800640 1 --2- 172.21.15.18:0/523768435 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7fa3440a2c30 0x7fa3440a50f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:36.644+0000 7fa366800640 1 --2- 172.21.15.18:0/523768435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3601099b0 0x7fa3601a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:36.644+0000 7fa366800640 1 --2- 172.21.15.18:0/523768435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa360076230 0x7fa36019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:36.644+0000 7fa366800640 1 --2- 172.21.15.18:0/523768435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa360074c50 0x7fa360199fd0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:36.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:36.644+0000 7fa366800640 1 -- 172.21.15.18:0/523768435 >> 172.21.15.18:0/523768435 conn(0x7fa3600fd2e0 msgr2=0x7fa360105900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:36.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:36.644+0000 7fa366800640 1 -- 172.21.15.18:0/523768435 shutdown_connections 2024-09-12T02:48:36.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:36.645+0000 7fa366800640 1 -- 172.21.15.18:0/523768435 wait complete. 2024-09-12T02:48:36.671 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T02:48:36.685 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T02:48:36.686 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-12T02:48:36.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:36.686 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-12T02:48:36.724 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-12T02:48:36.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:36.725 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:48:36.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:36.826 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-09-12T02:48:36.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:36 smithi018 ceph-mon[30616]: pgmap v400: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:48:36.905 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:36 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/523768435' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T02:48:36.905 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:36 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: ignoring --setuser ceph since I am not root 2024-09-12T02:48:36.905 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:36 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: ignoring --setgroup ceph since I am not root 2024-09-12T02:48:36.905 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:36 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:36.903+0000 7feadfe6a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:48:36.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:36 smithi176 ceph-mon[35713]: pgmap v400: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:48:36.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:36 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/523768435' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T02:48:36.979 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:36 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: ignoring --setuser ceph since I am not root 2024-09-12T02:48:36.979 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:36 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: ignoring --setgroup ceph since I am not root 2024-09-12T02:48:36.979 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:36 smithi176 ceph-mgr[37520]: -- 172.21.15.176:0/61258737 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55750393d0e0 con 0x55750391b400 2024-09-12T02:48:36.979 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:36 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:36.796+0000 7fc472471040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:48:36.979 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:36 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:36.853+0000 7fc472471040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:48:37.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:36 smithi062 ceph-mon[35527]: pgmap v400: 129 pgs: 129 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:48:37.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:36 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/523768435' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T02:48:37.016 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:36 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: ignoring --setuser ceph since I am not root 2024-09-12T02:48:37.016 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:36 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: ignoring --setgroup ceph since I am not root 2024-09-12T02:48:37.016 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:36 smithi062 ceph-mgr[36893]: -- 172.21.15.62:0/176351602 <== mon.2 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558b994290e0 con 0x558b99407000 2024-09-12T02:48:37.016 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:36 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:36.800+0000 7fc44a90a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:48:37.016 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:36 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:36.859+0000 7fc44a90a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:48:37.016 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:37 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:37.014+0000 7fc44a90a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:48:37.159 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:36 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:36.978+0000 7feadfe6a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:48:37.191 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-12T02:48:37.192 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:48:37.192 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:48:37.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T02:48:37.283 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:37 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:37.083+0000 7fc44a90a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:48:37.283 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:37 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:37.238+0000 7fc44a90a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:48:37.354 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:37.001+0000 7fc472471040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:48:37.354 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:37.068+0000 7fc472471040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:48:37.354 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:37.214+0000 7fc472471040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:48:37.354 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:37.353+0000 7fc472471040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:48:37.463 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:37 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:37.181+0000 7feadfe6a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:48:37.463 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:37 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:37.266+0000 7feadfe6a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:48:37.592 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:48:37.641 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:37 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:37.385+0000 7fc44a90a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:48:37.733 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:37 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/523768435' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T02:48:37.733 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:37 smithi018 ceph-mon[30616]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-12T02:48:37.733 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:37 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:37.461+0000 7feadfe6a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:48:37.733 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:37 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:37.652+0000 7feadfe6a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:48:37.910 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:37.662+0000 7fc472471040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:48:37.910 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:37.724+0000 7fc472471040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:48:37.911 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:37 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/523768435' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T02:48:37.911 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:37 smithi176 ceph-mon[35713]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-12T02:48:37.971 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:37 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/523768435' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T02:48:37.971 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:37 smithi062 ceph-mon[35527]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-12T02:48:37.972 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:37 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:37.713+0000 7fc44a90a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:48:37.972 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:37 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:37.777+0000 7fc44a90a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:48:37.972 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:37 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:37.970+0000 7fc44a90a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:48:38.228 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:37.909+0000 7fc472471040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:48:38.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.236+0000 7f4723200640 1 -- 172.21.15.18:0/991268305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4724102360 msgr2=0x7f472410e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:38.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.236+0000 7f4723200640 1 --2- 172.21.15.18:0/991268305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4724102360 0x7f472410e890 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f471c009ca0 tx=0x7f471c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.236+0000 7f4723200640 1 -- 172.21.15.18:0/991268305 shutdown_connections 2024-09-12T02:48:38.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.236+0000 7f4723200640 1 --2- 172.21.15.18:0/991268305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4724102360 0x7f472410e890 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.236+0000 7f4723200640 1 --2- 172.21.15.18:0/991268305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47241019c0 0x7f4724101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.236+0000 7f4723200640 1 --2- 172.21.15.18:0/991268305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47241079c0 0x7f4724107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.236+0000 7f4723200640 1 -- 172.21.15.18:0/991268305 >> 172.21.15.18:0/991268305 conn(0x7f47240fd740 msgr2=0x7f47240ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:38.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.236+0000 7f4723200640 1 -- 172.21.15.18:0/991268305 shutdown_connections 2024-09-12T02:48:38.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.236+0000 7f4723200640 1 -- 172.21.15.18:0/991268305 wait complete. 2024-09-12T02:48:38.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.237+0000 7f4723200640 1 Processor -- start 2024-09-12T02:48:38.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.237+0000 7f4723200640 1 -- start start 2024-09-12T02:48:38.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.238+0000 7f4723200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47241019c0 0x7f47240744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:38.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.238+0000 7f4723200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724102360 0x7f4724074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:38.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.238+0000 7f4723200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47241079c0 0x7f4724074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:38.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.238+0000 7f4723200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4724111e10 con 0x7f47241079c0 2024-09-12T02:48:38.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.238+0000 7f4723200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4724111c90 con 0x7f47241019c0 2024-09-12T02:48:38.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.238+0000 7f4723200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4724111f90 con 0x7f4724102360 2024-09-12T02:48:38.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.238+0000 7f4721e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47241019c0 0x7f47240744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:38.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.238+0000 7f4719400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724102360 0x7f4724074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:38.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.238+0000 7f4721e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47241019c0 0x7f47240744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:44376/0 (socket says 172.21.15.18:44376) 2024-09-12T02:48:38.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.238+0000 7f4719400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724102360 0x7f4724074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:42278/0 (socket says 172.21.15.18:42278) 2024-09-12T02:48:38.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.238+0000 7f4721e00640 1 -- 172.21.15.18:0/3423493604 learned_addr learned my addr 172.21.15.18:0/3423493604 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:38.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.238+0000 7f4722800640 1 --2- 172.21.15.18:0/3423493604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47241079c0 0x7f4724074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:38.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.239+0000 7f4719400640 1 -- 172.21.15.18:0/3423493604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47241019c0 msgr2=0x7f47240744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:38.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.239+0000 7f4719400640 1 --2- 172.21.15.18:0/3423493604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47241019c0 0x7f47240744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.239+0000 7f4719400640 1 -- 172.21.15.18:0/3423493604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47241079c0 msgr2=0x7f4724074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:38.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.239+0000 7f4719400640 1 --2- 172.21.15.18:0/3423493604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47241079c0 0x7f4724074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.239+0000 7f4719400640 1 -- 172.21.15.18:0/3423493604 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47241a66f0 con 0x7f4724102360 2024-09-12T02:48:38.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.239+0000 7f4722800640 1 --2- 172.21.15.18:0/3423493604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47241079c0 0x7f4724074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:48:38.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.239+0000 7f4721e00640 1 --2- 172.21.15.18:0/3423493604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47241019c0 0x7f47240744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:38.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.239+0000 7f4719400640 1 --2- 172.21.15.18:0/3423493604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724102360 0x7f4724074a30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f470c00e9f0 tx=0x7f470c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:38.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.239+0000 7f471b400640 1 -- 172.21.15.18:0/3423493604 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c00ccc0 con 0x7f4724102360 2024-09-12T02:48:38.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.239+0000 7f4723200640 1 -- 172.21.15.18:0/3423493604 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47241a69e0 con 0x7f4724102360 2024-09-12T02:48:38.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.239+0000 7f471b400640 1 -- 172.21.15.18:0/3423493604 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f470c010910 con 0x7f4724102360 2024-09-12T02:48:38.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.239+0000 7f471b400640 1 -- 172.21.15.18:0/3423493604 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c018960 con 0x7f4724102360 2024-09-12T02:48:38.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.239+0000 7f4723200640 1 -- 172.21.15.18:0/3423493604 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47241a6f20 con 0x7f4724102360 2024-09-12T02:48:38.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.240+0000 7f4723200640 1 -- 172.21.15.18:0/3423493604 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4724101e20 con 0x7f4724102360 2024-09-12T02:48:38.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.242+0000 7f471b400640 1 -- 172.21.15.18:0/3423493604 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f470c010ac0 con 0x7f4724102360 2024-09-12T02:48:38.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.244+0000 7f471b400640 1 --2- 172.21.15.18:0/3423493604 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47080a2bd0 0x7f47080a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:38.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.244+0000 7f4721e00640 1 -- 172.21.15.18:0/3423493604 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47080a2bd0 msgr2=0x7f47080a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/494888664 2024-09-12T02:48:38.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.244+0000 7f471b400640 1 -- 172.21.15.18:0/3423493604 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f470c0cf8f0 con 0x7f4724102360 2024-09-12T02:48:38.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.244+0000 7f4721e00640 1 --2- 172.21.15.18:0/3423493604 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47080a2bd0 0x7f47080a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:48:38.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.247+0000 7f471b400640 1 -- 172.21.15.18:0/3423493604 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f470c09c440 con 0x7f4724102360 2024-09-12T02:48:38.349 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:38 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:38.045+0000 7feadfe6a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:48:38.350 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:38 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:38.121+0000 7feadfe6a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:48:38.350 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:38 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:38.348+0000 7feadfe6a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:48:38.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.445+0000 7f4721e00640 1 -- 172.21.15.18:0/3423493604 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47080a2bd0 msgr2=0x7f47080a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/494888664 2024-09-12T02:48:38.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.445+0000 7f4721e00640 1 --2- 172.21.15.18:0/3423493604 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47080a2bd0 0x7f47080a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:48:38.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.468+0000 7f4723200640 1 -- 172.21.15.18:0/3423493604 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f47241a71b0 con 0x7f4724102360 2024-09-12T02:48:38.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.468+0000 7f471b400640 1 -- 172.21.15.18:0/3423493604 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+88 (secure 0 0 0) 0x7f470c09bd40 con 0x7f4724102360 2024-09-12T02:48:38.470 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T02:48:38.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.471+0000 7f4723200640 1 -- 172.21.15.18:0/3423493604 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47080a2bd0 msgr2=0x7f47080a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:48:38.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.471+0000 7f4723200640 1 --2- 172.21.15.18:0/3423493604 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47080a2bd0 0x7f47080a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.471+0000 7f4723200640 1 -- 172.21.15.18:0/3423493604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724102360 msgr2=0x7f4724074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:38.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.471+0000 7f4723200640 1 --2- 172.21.15.18:0/3423493604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724102360 0x7f4724074a30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f470c00e9f0 tx=0x7f470c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.472+0000 7f4723200640 1 -- 172.21.15.18:0/3423493604 shutdown_connections 2024-09-12T02:48:38.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.472+0000 7f4723200640 1 --2- 172.21.15.18:0/3423493604 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f47080a2bd0 0x7f47080a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.472+0000 7f4723200640 1 --2- 172.21.15.18:0/3423493604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47241079c0 0x7f4724074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.472+0000 7f4723200640 1 --2- 172.21.15.18:0/3423493604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4724102360 0x7f4724074a30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.472+0000 7f4723200640 1 --2- 172.21.15.18:0/3423493604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47241019c0 0x7f47240744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:38.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.472+0000 7f4723200640 1 -- 172.21.15.18:0/3423493604 >> 172.21.15.18:0/3423493604 conn(0x7f47240fd740 msgr2=0x7f47240fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:38.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.472+0000 7f4723200640 1 -- 172.21.15.18:0/3423493604 shutdown_connections 2024-09-12T02:48:38.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:38.472+0000 7f4723200640 1 -- 172.21.15.18:0/3423493604 wait complete. 2024-09-12T02:48:38.894 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:38 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3423493604' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:48:38.914 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:38 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3423493604' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:48:38.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:38 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3423493604' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:48:38.979 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:38 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:38.788+0000 7fc472471040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:48:38.979 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:38 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:38.855+0000 7fc472471040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:48:39.283 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:38 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:38.893+0000 7fc44a90a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:48:39.283 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:38 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:38.963+0000 7fc44a90a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:48:39.426 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:48:39.426 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:48:39.426 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-12T02:48:39.426 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:48:39.427 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:48:39.427 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:48:39.427 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:48:39.428 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:48:39.428 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:48:39.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:39.428 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-12T02:48:39.468 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:48:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:48:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:48:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-12T02:48:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:39.469 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:48:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-12T02:48:39.469 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:48:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:39.469 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-12T02:48:39.470 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:48:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-12T02:48:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:48:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42019sec preferred_lft 42019sec 2024-09-12T02:48:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-12T02:48:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:48:39.470 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:48:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:48:39.470 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-12T02:48:39.471 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:48:39.471 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:48:39.471 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-12T02:48:39.471 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:48:39.471 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2024-09-12T02:48:39.471 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2024-09-12T02:48:39.471 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:48:39.472 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-12T02:48:39.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:48:39.637 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:39.524+0000 7feadfe6a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:48:39.637 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:39.610+0000 7feadfe6a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:48:39.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:48:39.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:39.702 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:48:39.762 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-12T02:48:39.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:39.766 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-12T02:48:39.803 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-12T02:48:39.804 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:48:39.804 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:48:39.804 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:48:39.804 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:48:39.805 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:48:39.805 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-12T02:48:39.805 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:48:39.805 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:48:39.805 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:48:39.805 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-12T02:48:39.822 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:39 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:39.563+0000 7fc472471040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:48:39.822 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:39 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:39.678+0000 7fc472471040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:48:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:48:39.982 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:39 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:39.710+0000 7fc44a90a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:48:39.982 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:39 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:39.831+0000 7fc44a90a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:48:39.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:48:40.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:40.008 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-12T02:48:40.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:40.045 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-09-12T02:48:40.099 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:39 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:39.821+0000 7fc472471040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:48:40.099 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:39 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:39.883+0000 7fc472471040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:48:40.099 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:40.031+0000 7fc472471040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:48:40.099 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:40.098+0000 7fc472471040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:48:40.121 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:48:40.121 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-12T02:48:40.122 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:48:40.122 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T02:48:40.122 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-12T02:48:40.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:48:40.273 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:39 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:39.981+0000 7fc44a90a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:48:40.273 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:40 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:40.045+0000 7fc44a90a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:48:40.273 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:40 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:40.201+0000 7fc44a90a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:48:40.273 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:40 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:40.272+0000 7fc44a90a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:48:40.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:48:40.301 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T02:48:40.302 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:48:40.302 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-12T02:48:40.302 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T02:48:40.302 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:48:40.302 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T02:48:40.302 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T02:48:40.302 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T02:48:40.302 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-12T02:48:40.379 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:40.158+0000 7fc472471040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:48:40.379 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:40.314+0000 7fc472471040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:48:40.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:48:40.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:48:40.528 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:48:40.528 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-12T02:48:40.528 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-12T02:48:40.528 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:48:40.528 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-12T02:48:40.533 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:40 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:40.334+0000 7fc44a90a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:48:40.533 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:40 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:40.499+0000 7fc44a90a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:48:40.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:48:40.645 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:40.378+0000 7fc472471040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:48:40.645 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:40.444+0000 7fc472471040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:48:40.645 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:40.525+0000 7fc472471040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:48:40.645 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:40.584+0000 7fc472471040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:48:40.645 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:40.644+0000 7fc472471040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:48:40.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:48:40.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:48:40.700 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:48:40.737 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:48:40.737 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:48:40.737 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:48:40.759 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:40 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:40.607+0000 7feadfe6a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:48:40.759 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:40 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:40.757+0000 7feadfe6a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:48:40.794 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-12T02:48:40.794 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-12T02:48:40.794 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/86abb46b-ee82-4fa9-8957-2a3152e4d864 2024-09-12T02:48:40.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:40.795 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/86abb46b-ee82-4fa9-8957-2a3152e4d864 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-12T02:48:40.849 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:40 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:40.567+0000 7fc44a90a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:48:40.849 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:40 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:40.637+0000 7fc44a90a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:48:40.849 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:40 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:40.724+0000 7fc44a90a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:48:40.849 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:40 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:40.786+0000 7fc44a90a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:48:40.850 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:40 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:40.848+0000 7fc44a90a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:48:40.925 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-12T02:48:40.925 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-09-12T02:48:41.013 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:40 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:40.935+0000 7feadfe6a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:48:41.281 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:41 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:41.011+0000 7feadfe6a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:48:41.281 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:41 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:41.195+0000 7feadfe6a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:48:41.558 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:41 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:41.282+0000 7feadfe6a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:48:41.559 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:41 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:41.358+0000 7feadfe6a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:48:41.559 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:41 smithi018 ceph-mon[30616]: Standby manager daemon z restarted 2024-09-12T02:48:41.559 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:41 smithi018 ceph-mon[30616]: Standby manager daemon z started 2024-09-12T02:48:41.559 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:41 smithi018 ceph-mon[30616]: from='mgr.? 172.21.15.176:0/4096750063' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:48:41.559 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:41 smithi018 ceph-mon[30616]: from='mgr.? 172.21.15.176:0/4096750063' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:48:41.559 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:41 smithi018 ceph-mon[30616]: from='mgr.? 172.21.15.176:0/4096750063' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:48:41.559 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:41 smithi018 ceph-mon[30616]: from='mgr.? 172.21.15.176:0/4096750063' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:48:41.577 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-12T02:48:41.577 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-09-12T02:48:41.578 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.62:6789,172.21.15.176:6789" 2024-09-12T02:48:41.578 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@c7666100-70af-11ef-bcea-c7b262605968.cephfs=/volumes/qa/sv_1/86abb46b-ee82-4fa9-8957-2a3152e4d864 2024-09-12T02:48:41.578 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync,name=0,key=0,mon_addr=172.21.15.18:6789/172.21.15.62:6789/172.21.15.176:6789" will pass to kernel 2024-09-12T02:48:41.580 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:48:41.580 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:48:41.580 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:48:41.580 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:48:41.581 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:48:41.583 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:48:41.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:48:41.583 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:48:41.647 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:48:41.729 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 02:48:41 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z[37516]: 2024-09-12T02:48:41.429+0000 7fc472471040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:48:41.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:41 smithi176 ceph-mon[35713]: Standby manager daemon z restarted 2024-09-12T02:48:41.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:41 smithi176 ceph-mon[35713]: Standby manager daemon z started 2024-09-12T02:48:41.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:41 smithi176 ceph-mon[35713]: from='mgr.? 172.21.15.176:0/4096750063' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:48:41.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:41 smithi176 ceph-mon[35713]: from='mgr.? 172.21.15.176:0/4096750063' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:48:41.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:41 smithi176 ceph-mon[35713]: from='mgr.? 172.21.15.176:0/4096750063' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:48:41.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:41 smithi176 ceph-mon[35713]: from='mgr.? 172.21.15.176:0/4096750063' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:48:41.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:48:41.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:48:41.742 INFO:teuthology.orchestra.run.smithi018.stdout:client15213 2024-09-12T02:48:41.742 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:48:41.742 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:48:41.780 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:48:41.783 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 02:48:41 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y[36889]: 2024-09-12T02:48:41.684+0000 7fc44a90a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:48:41.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:41 smithi062 ceph-mon[35527]: Standby manager daemon z restarted 2024-09-12T02:48:41.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:41 smithi062 ceph-mon[35527]: Standby manager daemon z started 2024-09-12T02:48:41.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:41 smithi062 ceph-mon[35527]: from='mgr.? 172.21.15.176:0/4096750063' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:48:41.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:41 smithi062 ceph-mon[35527]: from='mgr.? 172.21.15.176:0/4096750063' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:48:41.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:41 smithi062 ceph-mon[35527]: from='mgr.? 172.21.15.176:0/4096750063' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:48:41.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:41 smithi062 ceph-mon[35527]: from='mgr.? 172.21.15.176:0/4096750063' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:48:41.835 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:41 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:41.557+0000 7feadfe6a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:48:41.835 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:41 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:41.643+0000 7feadfe6a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:48:41.835 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:41 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:41.730+0000 7feadfe6a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:48:41.835 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:41 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:41.833+0000 7feadfe6a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:48:41.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:48:41.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:48:41.914 INFO:teuthology.orchestra.run.smithi018.stdout:client15213 2024-09-12T02:48:41.914 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:48:42.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:48:42.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:48:42.046 INFO:teuthology.orchestra.run.smithi018.stdout:client15213 2024-09-12T02:48:42.046 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c7666100-70af-11ef-bcea-c7b262605968.client15213/status') 2024-09-12T02:48:42.101 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:41 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:41.910+0000 7feadfe6a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:48:42.101 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:41 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:41.985+0000 7feadfe6a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:48:42.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:48:42.148 INFO:teuthology.orchestra.run.smithi018.stdout:instance: client.15213 (3)192.168.0.1:0/1732343273 2024-09-12T02:48:42.149 INFO:teuthology.orchestra.run.smithi018.stdout:blocklisted: false 2024-09-12T02:48:42.149 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records in 2024-09-12T02:48:42.149 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records out 2024-09-12T02:48:42.149 INFO:teuthology.orchestra.run.smithi018.stderr:70 bytes copied, 5.8921e-05 s, 1.2 MB/s 2024-09-12T02:48:42.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:48:42.159 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T02:48:42.168 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T02:48:42.168 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-12T02:48:42.169 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-12T02:48:42.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.325+0000 7f3599200640 1 -- 172.21.15.18:0/4086558128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3594103d60 msgr2=0x7f3594104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:42.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.325+0000 7f3599200640 1 --2- 172.21.15.18:0/4086558128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3594103d60 0x7f3594104160 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3584009900 tx=0x7f358402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.326+0000 7f3599200640 1 -- 172.21.15.18:0/4086558128 shutdown_connections 2024-09-12T02:48:42.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.326+0000 7f3599200640 1 --2- 172.21.15.18:0/4086558128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3594105910 0x7f359410c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.326+0000 7f3599200640 1 --2- 172.21.15.18:0/4086558128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3594104f50 0x7f35941053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.326+0000 7f3599200640 1 --2- 172.21.15.18:0/4086558128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3594103d60 0x7f3594104160 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.326+0000 7f3599200640 1 -- 172.21.15.18:0/4086558128 >> 172.21.15.18:0/4086558128 conn(0x7f35940ff4e0 msgr2=0x7f3594101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:42.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.326+0000 7f3599200640 1 -- 172.21.15.18:0/4086558128 shutdown_connections 2024-09-12T02:48:42.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.326+0000 7f3599200640 1 -- 172.21.15.18:0/4086558128 wait complete. 2024-09-12T02:48:42.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.326+0000 7f3599200640 1 Processor -- start 2024-09-12T02:48:42.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.327+0000 7f3599200640 1 -- start start 2024-09-12T02:48:42.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.327+0000 7f3599200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3594103d60 0x7f3594199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:42.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.327+0000 7f3599200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3594104f50 0x7f359419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:42.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.327+0000 7f3599200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3594105910 0x7f35941a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:42.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.327+0000 7f3599200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f359410fa10 con 0x7f3594104f50 2024-09-12T02:48:42.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.327+0000 7f3599200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f359410f890 con 0x7f3594105910 2024-09-12T02:48:42.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.327+0000 7f3599200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f359410fb90 con 0x7f3594103d60 2024-09-12T02:48:42.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.327+0000 7f358be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3594104f50 0x7f359419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:42.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.327+0000 7f3591e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3594103d60 0x7f3594199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:42.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.327+0000 7f3592800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3594105910 0x7f35941a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:42.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.327+0000 7f358be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3594104f50 0x7f359419a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57530/0 (socket says 172.21.15.18:57530) 2024-09-12T02:48:42.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.327+0000 7f358be00640 1 -- 172.21.15.18:0/3670813784 learned_addr learned my addr 172.21.15.18:0/3670813784 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:42.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.328+0000 7f3591e00640 1 -- 172.21.15.18:0/3670813784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3594105910 msgr2=0x7f35941a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:42.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.328+0000 7f3591e00640 1 --2- 172.21.15.18:0/3670813784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3594105910 0x7f35941a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.328+0000 7f3591e00640 1 -- 172.21.15.18:0/3670813784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3594104f50 msgr2=0x7f359419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:42.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.328+0000 7f3591e00640 1 --2- 172.21.15.18:0/3670813784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3594104f50 0x7f359419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:42.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.328+0000 7f3591e00640 1 -- 172.21.15.18:0/3670813784 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35941a1c00 con 0x7f3594103d60 2024-09-12T02:48:42.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.328+0000 7f358be00640 1 --2- 172.21.15.18:0/3670813784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3594104f50 0x7f359419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:42.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.328+0000 7f3591e00640 1 --2- 172.21.15.18:0/3670813784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3594103d60 0x7f3594199fe0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3584009230 tx=0x7f3584032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:42.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.328+0000 7f358aa00640 1 -- 172.21.15.18:0/3670813784 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358403f030 con 0x7f3594103d60 2024-09-12T02:48:42.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.328+0000 7f3599200640 1 -- 172.21.15.18:0/3670813784 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35941a1e90 con 0x7f3594103d60 2024-09-12T02:48:42.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.328+0000 7f358aa00640 1 -- 172.21.15.18:0/3670813784 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3584003ce0 con 0x7f3594103d60 2024-09-12T02:48:42.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.328+0000 7f358aa00640 1 -- 172.21.15.18:0/3670813784 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3584035070 con 0x7f3594103d60 2024-09-12T02:48:42.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.329+0000 7f3599200640 1 -- 172.21.15.18:0/3670813784 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35941a22f0 con 0x7f3594103d60 2024-09-12T02:48:42.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.330+0000 7f3599200640 1 -- 172.21.15.18:0/3670813784 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f359410b080 con 0x7f3594103d60 2024-09-12T02:48:42.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.331+0000 7f358aa00640 1 -- 172.21.15.18:0/3670813784 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 20) ==== 137850+0+0 (secure 0 0 0) 0x7f3584042030 con 0x7f3594103d60 2024-09-12T02:48:42.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.333+0000 7f358aa00640 1 --2- 172.21.15.18:0/3670813784 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f35780a2d00 0x7f35780a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:42.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.333+0000 7f358be00640 1 -- 172.21.15.18:0/3670813784 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f35780a2d00 msgr2=0x7f35780a51c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/494888664 2024-09-12T02:48:42.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.333+0000 7f358aa00640 1 -- 172.21.15.18:0/3670813784 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9216+0+0 (secure 0 0 0) 0x7f35840ef7a0 con 0x7f3594103d60 2024-09-12T02:48:42.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.333+0000 7f358be00640 1 --2- 172.21.15.18:0/3670813784 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f35780a2d00 0x7f35780a51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:48:42.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.337+0000 7f358aa00640 1 -- 172.21.15.18:0/3670813784 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f35840bc2f0 con 0x7f3594103d60 2024-09-12T02:48:42.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.511+0000 7f358aa00640 1 -- 172.21.15.18:0/3670813784 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mgrmap(e 21) ==== 137850+0+0 (secure 0 0 0) 0x7f35840b8260 con 0x7f3594103d60 2024-09-12T02:48:42.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.534+0000 7f358be00640 1 -- 172.21.15.18:0/3670813784 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f35780a2d00 msgr2=0x7f35780a51c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/494888664 2024-09-12T02:48:42.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.534+0000 7f358be00640 1 --2- 172.21.15.18:0/3670813784 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f35780a2d00 0x7f35780a51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:48:42.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.566+0000 7f3599200640 1 -- 172.21.15.18:0/3670813784 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f3594062e90 con 0x7f3594103d60 2024-09-12T02:48:42.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:42 smithi062 ceph-mon[35527]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-09-12T02:48:42.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:42 smithi062 ceph-mon[35527]: Standby manager daemon y restarted 2024-09-12T02:48:42.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:42 smithi062 ceph-mon[35527]: Standby manager daemon y started 2024-09-12T02:48:42.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:42 smithi062 ceph-mon[35527]: from='mgr.? 172.21.15.62:0/2777157955' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:48:42.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:42 smithi062 ceph-mon[35527]: from='mgr.? 172.21.15.62:0/2777157955' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:48:42.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:42 smithi062 ceph-mon[35527]: from='mgr.? 172.21.15.62:0/2777157955' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:48:42.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:42 smithi062 ceph-mon[35527]: from='mgr.? 172.21.15.62:0/2777157955' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:48:42.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:42 smithi018 ceph-mon[30616]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-09-12T02:48:42.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:42 smithi018 ceph-mon[30616]: Standby manager daemon y restarted 2024-09-12T02:48:42.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:42 smithi018 ceph-mon[30616]: Standby manager daemon y started 2024-09-12T02:48:42.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:42 smithi018 ceph-mon[30616]: from='mgr.? 172.21.15.62:0/2777157955' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:48:42.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:42 smithi018 ceph-mon[30616]: from='mgr.? 172.21.15.62:0/2777157955' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:48:42.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:42 smithi018 ceph-mon[30616]: from='mgr.? 172.21.15.62:0/2777157955' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:48:42.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:42 smithi018 ceph-mon[30616]: from='mgr.? 172.21.15.62:0/2777157955' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:48:42.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.935+0000 7f358be00640 1 -- 172.21.15.18:0/3670813784 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f35780a2d00 msgr2=0x7f35780a51c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/494888664 2024-09-12T02:48:42.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.935+0000 7f358be00640 1 --2- 172.21.15.18:0/3670813784 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f35780a2d00 0x7f35780a51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:48:42.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:42 smithi176 ceph-mon[35713]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-09-12T02:48:42.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:42 smithi176 ceph-mon[35713]: Standby manager daemon y restarted 2024-09-12T02:48:42.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:42 smithi176 ceph-mon[35713]: Standby manager daemon y started 2024-09-12T02:48:42.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:42 smithi176 ceph-mon[35713]: from='mgr.? 172.21.15.62:0/2777157955' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:48:42.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:42 smithi176 ceph-mon[35713]: from='mgr.? 172.21.15.62:0/2777157955' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:48:42.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:42 smithi176 ceph-mon[35713]: from='mgr.? 172.21.15.62:0/2777157955' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:48:42.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:42 smithi176 ceph-mon[35713]: from='mgr.? 172.21.15.62:0/2777157955' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:48:42.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.984+0000 7f358aa00640 1 -- 172.21.15.18:0/3670813784 <== mon.1 v2:172.21.15.176:3300/0 8 ==== mgrmap(e 22) ==== 137518+0+0 (secure 0 0 0) 0x7f35840ecf10 con 0x7f3594103d60 2024-09-12T02:48:42.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.985+0000 7f358aa00640 1 -- 172.21.15.18:0/3670813784 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f35780a2d00 msgr2=0x7f35780a51c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:48:42.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:42.985+0000 7f358aa00640 1 --2- 172.21.15.18:0/3670813784 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f35780a2d00 0x7f35780a51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.335 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:42 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:42.966+0000 7feadfe6a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:48:43.335 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:43.332+0000 7fea39600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:48:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.507+0000 7f358aa00640 1 -- 172.21.15.18:0/3670813784 <== mon.1 v2:172.21.15.176:3300/0 9 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v30) ==== 117+0+0 (secure 0 0 0) 0x7f35840b1ad0 con 0x7f3594103d60 2024-09-12T02:48:43.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.510+0000 7f3599200640 1 -- 172.21.15.18:0/3670813784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3594103d60 msgr2=0x7f3594199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:43.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.510+0000 7f3599200640 1 --2- 172.21.15.18:0/3670813784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3594103d60 0x7f3594199fe0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3584009230 tx=0x7f3584032ce0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.511+0000 7f3599200640 1 -- 172.21.15.18:0/3670813784 shutdown_connections 2024-09-12T02:48:43.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.511+0000 7f3599200640 1 --2- 172.21.15.18:0/3670813784 >> [v2:172.21.15.18:6800/494888664,v1:172.21.15.18:6801/494888664] conn(0x7f35780a2d00 0x7f35780a51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.511+0000 7f3599200640 1 --2- 172.21.15.18:0/3670813784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3594105910 0x7f35941a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.511+0000 7f3599200640 1 --2- 172.21.15.18:0/3670813784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3594104f50 0x7f359419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.511+0000 7f3599200640 1 --2- 172.21.15.18:0/3670813784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3594103d60 0x7f3594199fe0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.511+0000 7f3599200640 1 -- 172.21.15.18:0/3670813784 >> 172.21.15.18:0/3670813784 conn(0x7f35940ff4e0 msgr2=0x7f3594108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.511+0000 7f3599200640 1 -- 172.21.15.18:0/3670813784 shutdown_connections 2024-09-12T02:48:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.511+0000 7f3599200640 1 -- 172.21.15.18:0/3670813784 wait complete. 2024-09-12T02:48:43.530 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-12T02:48:43.541 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T02:48:43.548 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T02:48:43.549 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-12T02:48:43.549 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-12T02:48:43.597 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:43.332+0000 7fea39600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:48:43.598 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:43.332+0000 7fea39600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:48:43.598 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:43.332+0000 7fea39600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:48:43.598 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:43.332+0000 7fea39600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:48:43.598 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:43.335+0000 7fea3d200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:48:43.598 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:43.335+0000 7fea3d200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:48:43.598 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:43.335+0000 7fea3d200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:48:43.598 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:43.335+0000 7fea3d200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:48:43.598 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:43.335+0000 7fea3d200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:48:43.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: mgrmap e21: x(active, since 10m), standbys: z, y 2024-09-12T02:48:43.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3670813784' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T02:48:43.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T02:48:43.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: Active manager daemon x restarted 2024-09-12T02:48:43.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: Activating manager daemon x 2024-09-12T02:48:43.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: osdmap e99: 12 total, 12 up, 12 in 2024-09-12T02:48:43.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: mgrmap e22: x(active, starting, since 0.0115604s), standbys: z, y 2024-09-12T02:48:43.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:48:43.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:48:43.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:48:43.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:48:43.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:48:43.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:48:43.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:48:43.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:48:43.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:48:43.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:48:43.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:48:43.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:48:43.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:48:43.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:48:43.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:48:43.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:48:43.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:48:43.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:48:43.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:48:43.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:48:43.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:48:43.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:48:43.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:48:43.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:48:43.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:48:43.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:48:43.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:48:43.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:48:43.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:48:43.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:48:43.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:48:43.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:48:43.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:48:43.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: Manager daemon x is now available 2024-09-12T02:48:43.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:48:43.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:48:43.603 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:48:43.603 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:48:43.603 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:43 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:48:43.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.726+0000 7ff3c7200640 1 -- 172.21.15.18:0/492133838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c8074f60 msgr2=0x7ff3c81097b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:43.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.726+0000 7ff3c7200640 1 --2- 172.21.15.18:0/492133838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c8074f60 0x7ff3c81097b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009900 tx=0x7ff3b402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.727+0000 7ff3c7200640 1 -- 172.21.15.18:0/492133838 shutdown_connections 2024-09-12T02:48:43.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.727+0000 7ff3c7200640 1 --2- 172.21.15.18:0/492133838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3c8109cf0 0x7ff3c810c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.727+0000 7ff3c7200640 1 --2- 172.21.15.18:0/492133838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c8074f60 0x7ff3c81097b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.727+0000 7ff3c7200640 1 --2- 172.21.15.18:0/492133838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3c8074620 0x7ff3c8074a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.727+0000 7ff3c7200640 1 -- 172.21.15.18:0/492133838 >> 172.21.15.18:0/492133838 conn(0x7ff3c80fd0d0 msgr2=0x7ff3c80ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:43.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.727+0000 7ff3c7200640 1 -- 172.21.15.18:0/492133838 shutdown_connections 2024-09-12T02:48:43.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.727+0000 7ff3c7200640 1 -- 172.21.15.18:0/492133838 wait complete. 2024-09-12T02:48:43.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: mgrmap e21: x(active, since 10m), standbys: z, y 2024-09-12T02:48:43.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3670813784' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T02:48:43.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T02:48:43.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: Active manager daemon x restarted 2024-09-12T02:48:43.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: Activating manager daemon x 2024-09-12T02:48:43.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: osdmap e99: 12 total, 12 up, 12 in 2024-09-12T02:48:43.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: mgrmap e22: x(active, starting, since 0.0115604s), standbys: z, y 2024-09-12T02:48:43.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:48:43.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:48:43.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:48:43.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:48:43.731 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:48:43.731 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:48:43.731 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:48:43.731 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:48:43.731 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:48:43.731 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:48:43.731 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:48:43.731 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:48:43.731 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:48:43.731 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:48:43.731 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:48:43.731 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:48:43.731 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:48:43.732 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:48:43.732 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:48:43.732 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:48:43.732 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:48:43.732 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:48:43.732 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:48:43.732 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:48:43.732 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:48:43.732 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:48:43.732 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:48:43.732 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:48:43.732 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:48:43.733 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:48:43.733 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:48:43.733 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:48:43.733 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:48:43.733 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: Manager daemon x is now available 2024-09-12T02:48:43.733 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:48:43.733 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:48:43.733 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:48:43.733 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:48:43.733 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:43 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:48:43.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.728+0000 7ff3c7200640 1 Processor -- start 2024-09-12T02:48:43.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.728+0000 7ff3c7200640 1 -- start start 2024-09-12T02:48:43.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.728+0000 7ff3c7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3c8074620 0x7ff3c8199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:43.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.728+0000 7ff3c7200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c8074f60 0x7ff3c819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:43.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.728+0000 7ff3c7200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3c8109cf0 0x7ff3c81a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:43.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.728+0000 7ff3c7200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c810f940 con 0x7ff3c8074620 2024-09-12T02:48:43.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.728+0000 7ff3c7200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c810f7c0 con 0x7ff3c8109cf0 2024-09-12T02:48:43.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.728+0000 7ff3c7200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c810fac0 con 0x7ff3c8074f60 2024-09-12T02:48:43.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.728+0000 7ff3c5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3c8074620 0x7ff3c8199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:43.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.728+0000 7ff3c5400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c8074f60 0x7ff3c819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:43.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.728+0000 7ff3c5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3c8074620 0x7ff3c8199fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57684/0 (socket says 172.21.15.18:57684) 2024-09-12T02:48:43.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.728+0000 7ff3c5e00640 1 -- 172.21.15.18:0/3155647702 learned_addr learned my addr 172.21.15.18:0/3155647702 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:43.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.728+0000 7ff3c6800640 1 --2- 172.21.15.18:0/3155647702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3c8109cf0 0x7ff3c81a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:43.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.729+0000 7ff3c5e00640 1 -- 172.21.15.18:0/3155647702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c8074f60 msgr2=0x7ff3c819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:43.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.729+0000 7ff3c5e00640 1 --2- 172.21.15.18:0/3155647702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c8074f60 0x7ff3c819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.729+0000 7ff3c5e00640 1 -- 172.21.15.18:0/3155647702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3c8109cf0 msgr2=0x7ff3c81a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:43.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.729+0000 7ff3c5e00640 1 --2- 172.21.15.18:0/3155647702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3c8109cf0 0x7ff3c81a1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.729+0000 7ff3c5e00640 1 -- 172.21.15.18:0/3155647702 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c81a1bc0 con 0x7ff3c8074620 2024-09-12T02:48:43.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.729+0000 7ff3c6800640 1 --2- 172.21.15.18:0/3155647702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3c8109cf0 0x7ff3c81a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:43.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.729+0000 7ff3c5e00640 1 --2- 172.21.15.18:0/3155647702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3c8074620 0x7ff3c8199fa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800e9f0 tx=0x7ff3b800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:43.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.729+0000 7ff3bea00640 1 -- 172.21.15.18:0/3155647702 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b800cd80 con 0x7ff3c8074620 2024-09-12T02:48:43.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.729+0000 7ff3bea00640 1 -- 172.21.15.18:0/3155647702 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3b8010910 con 0x7ff3c8074620 2024-09-12T02:48:43.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.729+0000 7ff3bea00640 1 -- 172.21.15.18:0/3155647702 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80188f0 con 0x7ff3c8074620 2024-09-12T02:48:43.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.730+0000 7ff3c7200640 1 -- 172.21.15.18:0/3155647702 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c81a1eb0 con 0x7ff3c8074620 2024-09-12T02:48:43.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.730+0000 7ff3c7200640 1 -- 172.21.15.18:0/3155647702 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c81a2260 con 0x7ff3c8074620 2024-09-12T02:48:43.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.731+0000 7ff3c7200640 1 -- 172.21.15.18:0/3155647702 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c8074a20 con 0x7ff3c8074620 2024-09-12T02:48:43.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.733+0000 7ff3bea00640 1 -- 172.21.15.18:0/3155647702 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 22) ==== 137518+0+0 (secure 0 0 0) 0x7ff3b8010ac0 con 0x7ff3c8074620 2024-09-12T02:48:43.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.734+0000 7ff3bea00640 1 -- 172.21.15.18:0/3155647702 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7ff3b80cf360 con 0x7ff3c8074620 2024-09-12T02:48:43.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.742+0000 7ff3bea00640 1 -- 172.21.15.18:0/3155647702 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff3b809bb30 con 0x7ff3c8074620 2024-09-12T02:48:43.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: mgrmap e21: x(active, since 10m), standbys: z, y 2024-09-12T02:48:43.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3670813784' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T02:48:43.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T02:48:43.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: Active manager daemon x restarted 2024-09-12T02:48:43.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: Activating manager daemon x 2024-09-12T02:48:43.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: osdmap e99: 12 total, 12 up, 12 in 2024-09-12T02:48:43.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: mgrmap e22: x(active, starting, since 0.0115604s), standbys: z, y 2024-09-12T02:48:43.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:48:43.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:48:43.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:48:43.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:48:43.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:48:43.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:48:43.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:48:43.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:48:43.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:48:43.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:48:43.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:48:43.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:48:43.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:48:43.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:48:43.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:48:43.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:48:43.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:48:43.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:48:43.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:48:43.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:48:43.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:48:43.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:48:43.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:48:43.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:48:43.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:48:43.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:48:43.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:48:43.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:48:43.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:48:43.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:48:43.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:48:43.786 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:48:43.787 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:48:43.787 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: Manager daemon x is now available 2024-09-12T02:48:43.787 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:48:43.787 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:48:43.787 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:48:43.787 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:48:43.787 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:43 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:48:43.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.960+0000 7ff3c7200640 1 -- 172.21.15.18:0/3155647702 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7ff3c81085c0 con 0x7ff3c8074620 2024-09-12T02:48:43.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.965+0000 7ff3bea00640 1 -- 172.21.15.18:0/3155647702 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v26)=0 v26) ==== 129+0+0 (secure 0 0 0) 0x7ff3b809fe30 con 0x7ff3c8074620 2024-09-12T02:48:43.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.969+0000 7ff3c7200640 1 -- 172.21.15.18:0/3155647702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3c8074620 msgr2=0x7ff3c8199fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:43.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.969+0000 7ff3c7200640 1 --2- 172.21.15.18:0/3155647702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3c8074620 0x7ff3c8199fa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800e9f0 tx=0x7ff3b800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.969+0000 7ff3c7200640 1 -- 172.21.15.18:0/3155647702 shutdown_connections 2024-09-12T02:48:43.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.969+0000 7ff3c7200640 1 --2- 172.21.15.18:0/3155647702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3c8109cf0 0x7ff3c81a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.969+0000 7ff3c7200640 1 --2- 172.21.15.18:0/3155647702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c8074f60 0x7ff3c819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.969+0000 7ff3c7200640 1 --2- 172.21.15.18:0/3155647702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3c8074620 0x7ff3c8199fa0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:43.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.969+0000 7ff3c7200640 1 -- 172.21.15.18:0/3155647702 >> 172.21.15.18:0/3155647702 conn(0x7ff3c80fd0d0 msgr2=0x7ff3c8105790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:43.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.969+0000 7ff3c7200640 1 -- 172.21.15.18:0/3155647702 shutdown_connections 2024-09-12T02:48:43.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:43.969+0000 7ff3c7200640 1 -- 172.21.15.18:0/3155647702 wait complete. 2024-09-12T02:48:43.997 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-12T02:48:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.170+0000 7f3e80200640 1 -- 172.21.15.18:0/2175412509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e78104f50 msgr2=0x7f3e781053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.170+0000 7f3e80200640 1 --2- 172.21.15.18:0/2175412509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e78104f50 0x7f3e781053d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009900 tx=0x7f3e6402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.170+0000 7f3e80200640 1 -- 172.21.15.18:0/2175412509 shutdown_connections 2024-09-12T02:48:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.170+0000 7f3e80200640 1 --2- 172.21.15.18:0/2175412509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e78105910 0x7f3e7810c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.170+0000 7f3e80200640 1 --2- 172.21.15.18:0/2175412509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e78104f50 0x7f3e781053d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.170+0000 7f3e80200640 1 --2- 172.21.15.18:0/2175412509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e78103d60 0x7f3e78104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.170+0000 7f3e80200640 1 -- 172.21.15.18:0/2175412509 >> 172.21.15.18:0/2175412509 conn(0x7f3e780ff4e0 msgr2=0x7f3e78101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:44.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.171+0000 7f3e80200640 1 -- 172.21.15.18:0/2175412509 shutdown_connections 2024-09-12T02:48:44.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.171+0000 7f3e80200640 1 -- 172.21.15.18:0/2175412509 wait complete. 2024-09-12T02:48:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.171+0000 7f3e80200640 1 Processor -- start 2024-09-12T02:48:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.172+0000 7f3e80200640 1 -- start start 2024-09-12T02:48:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.172+0000 7f3e80200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e78103d60 0x7f3e78199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.172+0000 7f3e80200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e78104f50 0x7f3e7819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.172+0000 7f3e80200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e78105910 0x7f3e781a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.172+0000 7f3e80200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7810fa10 con 0x7f3e78104f50 2024-09-12T02:48:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.172+0000 7f3e80200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7810f890 con 0x7f3e78105910 2024-09-12T02:48:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.172+0000 7f3e80200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7810fb90 con 0x7f3e78103d60 2024-09-12T02:48:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.172+0000 7f3e7d800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e78103d60 0x7f3e78199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.172+0000 7f3e7d800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e78103d60 0x7f3e78199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:42464/0 (socket says 172.21.15.18:42464) 2024-09-12T02:48:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.172+0000 7f3e7d800640 1 -- 172.21.15.18:0/936240142 learned_addr learned my addr 172.21.15.18:0/936240142 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.172+0000 7f3e7e200640 1 --2- 172.21.15.18:0/936240142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e78105910 0x7f3e781a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.172+0000 7f3e7ce00640 1 --2- 172.21.15.18:0/936240142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e78104f50 0x7f3e7819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.173+0000 7f3e7d800640 1 -- 172.21.15.18:0/936240142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e78105910 msgr2=0x7f3e781a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.173+0000 7f3e7d800640 1 --2- 172.21.15.18:0/936240142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e78105910 0x7f3e781a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.173+0000 7f3e7d800640 1 -- 172.21.15.18:0/936240142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e78104f50 msgr2=0x7f3e7819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.173+0000 7f3e7d800640 1 --2- 172.21.15.18:0/936240142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e78104f50 0x7f3e7819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.173+0000 7f3e7d800640 1 -- 172.21.15.18:0/936240142 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e781a1bf0 con 0x7f3e78103d60 2024-09-12T02:48:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.173+0000 7f3e7e200640 1 --2- 172.21.15.18:0/936240142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e78105910 0x7f3e781a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.173+0000 7f3e7d800640 1 --2- 172.21.15.18:0/936240142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e78103d60 0x7f3e78199fd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00e9c0 tx=0x7f3e6c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.173+0000 7f3e76000640 1 -- 172.21.15.18:0/936240142 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c00cd80 con 0x7f3e78103d60 2024-09-12T02:48:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.173+0000 7f3e76000640 1 -- 172.21.15.18:0/936240142 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e6c0035f0 con 0x7f3e78103d60 2024-09-12T02:48:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.173+0000 7f3e76000640 1 -- 172.21.15.18:0/936240142 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c010690 con 0x7f3e78103d60 2024-09-12T02:48:44.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.173+0000 7f3e80200640 1 -- 172.21.15.18:0/936240142 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e781a1ee0 con 0x7f3e78103d60 2024-09-12T02:48:44.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.174+0000 7f3e80200640 1 -- 172.21.15.18:0/936240142 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e781a2350 con 0x7f3e78103d60 2024-09-12T02:48:44.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.175+0000 7f3e80200640 1 -- 172.21.15.18:0/936240142 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e7810b080 con 0x7f3e78103d60 2024-09-12T02:48:44.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.178+0000 7f3e76000640 1 -- 172.21.15.18:0/936240142 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 23) ==== 137645+0+0 (secure 0 0 0) 0x7f3e6c0037a0 con 0x7f3e78103d60 2024-09-12T02:48:44.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.179+0000 7f3e76000640 1 --2- 172.21.15.18:0/936240142 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3e600a2ac0 0x7f3e600a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.179+0000 7f3e76000640 1 -- 172.21.15.18:0/936240142 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f3e6c0cf530 con 0x7f3e78103d60 2024-09-12T02:48:44.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.180+0000 7f3e7ce00640 1 --2- 172.21.15.18:0/936240142 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3e600a2ac0 0x7f3e600a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.180+0000 7f3e76000640 1 -- 172.21.15.18:0/936240142 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e6c09c260 con 0x7f3e78103d60 2024-09-12T02:48:44.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.181+0000 7f3e7ce00640 1 --2- 172.21.15.18:0/936240142 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3e600a2ac0 0x7f3e600a4f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3e64006010 tx=0x7f3e64000bc0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:44.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.370+0000 7f3e80200640 1 -- 172.21.15.18:0/936240142 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f3e7802d7c0 con 0x7f3e78103d60 2024-09-12T02:48:44.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.376+0000 7f3e76000640 1 -- 172.21.15.18:0/936240142 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v27)=0 v27) ==== 138+0+0 (secure 0 0 0) 0x7f3e6c09bb60 con 0x7f3e78103d60 2024-09-12T02:48:44.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.380+0000 7f3e80200640 1 -- 172.21.15.18:0/936240142 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3e600a2ac0 msgr2=0x7f3e600a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.380+0000 7f3e80200640 1 --2- 172.21.15.18:0/936240142 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3e600a2ac0 0x7f3e600a4f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3e64006010 tx=0x7f3e64000bc0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.380+0000 7f3e80200640 1 -- 172.21.15.18:0/936240142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e78103d60 msgr2=0x7f3e78199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.380+0000 7f3e80200640 1 --2- 172.21.15.18:0/936240142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e78103d60 0x7f3e78199fd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00e9c0 tx=0x7f3e6c00ee80 comp rx=0 tx=0).stop 2024-09-12T02:48:44.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.380+0000 7f3e80200640 1 -- 172.21.15.18:0/936240142 shutdown_connections 2024-09-12T02:48:44.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.380+0000 7f3e80200640 1 --2- 172.21.15.18:0/936240142 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3e600a2ac0 0x7f3e600a4f80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.380+0000 7f3e80200640 1 --2- 172.21.15.18:0/936240142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e78105910 0x7f3e781a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.380+0000 7f3e80200640 1 --2- 172.21.15.18:0/936240142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e78104f50 0x7f3e7819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.380+0000 7f3e80200640 1 --2- 172.21.15.18:0/936240142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e78103d60 0x7f3e78199fd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.381+0000 7f3e80200640 1 -- 172.21.15.18:0/936240142 >> 172.21.15.18:0/936240142 conn(0x7f3e780ff4e0 msgr2=0x7f3e78108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:44.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.381+0000 7f3e80200640 1 -- 172.21.15.18:0/936240142 shutdown_connections 2024-09-12T02:48:44.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.381+0000 7f3e80200640 1 -- 172.21.15.18:0/936240142 wait complete. 2024-09-12T02:48:44.405 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-12T02:48:44.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.565+0000 7f3b6fe00640 1 -- 172.21.15.18:0/1874141803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b70107620 msgr2=0x7f3b70109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.565+0000 7f3b6fe00640 1 --2- 172.21.15.18:0/1874141803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b70107620 0x7f3b70109a90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009ca0 tx=0x7f3b6802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.565+0000 7f3b6fe00640 1 -- 172.21.15.18:0/1874141803 shutdown_connections 2024-09-12T02:48:44.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.565+0000 7f3b6fe00640 1 --2- 172.21.15.18:0/1874141803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b70107620 0x7f3b70109a90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.565+0000 7f3b6fe00640 1 --2- 172.21.15.18:0/1874141803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b70104cf0 0x7f3b701070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.565+0000 7f3b6fe00640 1 --2- 172.21.15.18:0/1874141803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b701023c0 0x7f3b701047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.565+0000 7f3b6fe00640 1 -- 172.21.15.18:0/1874141803 >> 172.21.15.18:0/1874141803 conn(0x7f3b700fbfa0 msgr2=0x7f3b700fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:44.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.565+0000 7f3b6fe00640 1 -- 172.21.15.18:0/1874141803 shutdown_connections 2024-09-12T02:48:44.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.565+0000 7f3b6fe00640 1 -- 172.21.15.18:0/1874141803 wait complete. 2024-09-12T02:48:44.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.566+0000 7f3b6fe00640 1 Processor -- start 2024-09-12T02:48:44.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.566+0000 7f3b6fe00640 1 -- start start 2024-09-12T02:48:44.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.566+0000 7f3b6fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b701023c0 0x7f3b70199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.566+0000 7f3b6fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b70104cf0 0x7f3b7019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.566+0000 7f3b6fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b70107620 0x7f3b701a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.566+0000 7f3b6fe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7010d650 con 0x7f3b70104cf0 2024-09-12T02:48:44.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.566+0000 7f3b6fe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7010d4d0 con 0x7f3b701023c0 2024-09-12T02:48:44.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.566+0000 7f3b6fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7010d7d0 con 0x7f3b70107620 2024-09-12T02:48:44.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.566+0000 7f3b6ea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b701023c0 0x7f3b70199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.566+0000 7f3b6ea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b701023c0 0x7f3b70199eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:44540/0 (socket says 172.21.15.18:44540) 2024-09-12T02:48:44.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.566+0000 7f3b6ea00640 1 -- 172.21.15.18:0/679723642 learned_addr learned my addr 172.21.15.18:0/679723642 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:44.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.567+0000 7f3b6f400640 1 --2- 172.21.15.18:0/679723642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b70107620 0x7f3b701a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.567+0000 7f3b67e00640 1 --2- 172.21.15.18:0/679723642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b70104cf0 0x7f3b7019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.567+0000 7f3b6ea00640 1 -- 172.21.15.18:0/679723642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b70107620 msgr2=0x7f3b701a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.567+0000 7f3b6ea00640 1 --2- 172.21.15.18:0/679723642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b70107620 0x7f3b701a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.567+0000 7f3b6ea00640 1 -- 172.21.15.18:0/679723642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b70104cf0 msgr2=0x7f3b7019a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.567+0000 7f3b6ea00640 1 --2- 172.21.15.18:0/679723642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b70104cf0 0x7f3b7019a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.567+0000 7f3b6ea00640 1 -- 172.21.15.18:0/679723642 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b701a1ad0 con 0x7f3b701023c0 2024-09-12T02:48:44.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.567+0000 7f3b6ea00640 1 --2- 172.21.15.18:0/679723642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b701023c0 0x7f3b70199eb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000e9f0 tx=0x7f3b6000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:44.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.567+0000 7f3b67400640 1 -- 172.21.15.18:0/679723642 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6000cd80 con 0x7f3b701023c0 2024-09-12T02:48:44.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.567+0000 7f3b67400640 1 -- 172.21.15.18:0/679723642 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b60010910 con 0x7f3b701023c0 2024-09-12T02:48:44.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.567+0000 7f3b6fe00640 1 -- 172.21.15.18:0/679723642 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b701a1dc0 con 0x7f3b701023c0 2024-09-12T02:48:44.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.567+0000 7f3b67400640 1 -- 172.21.15.18:0/679723642 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b60018990 con 0x7f3b701023c0 2024-09-12T02:48:44.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.568+0000 7f3b6fe00640 1 -- 172.21.15.18:0/679723642 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b701a2280 con 0x7f3b701023c0 2024-09-12T02:48:44.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.569+0000 7f3b6fe00640 1 -- 172.21.15.18:0/679723642 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b70109110 con 0x7f3b701023c0 2024-09-12T02:48:44.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.570+0000 7f3b67400640 1 -- 172.21.15.18:0/679723642 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 23) ==== 137645+0+0 (secure 0 0 0) 0x7f3b60010ac0 con 0x7f3b701023c0 2024-09-12T02:48:44.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.572+0000 7f3b67400640 1 --2- 172.21.15.18:0/679723642 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3b540a29f0 0x7f3b540a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.572+0000 7f3b67400640 1 -- 172.21.15.18:0/679723642 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f3b600cf580 con 0x7f3b701023c0 2024-09-12T02:48:44.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.572+0000 7f3b67e00640 1 --2- 172.21.15.18:0/679723642 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3b540a29f0 0x7f3b540a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.573+0000 7f3b67e00640 1 --2- 172.21.15.18:0/679723642 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3b540a29f0 0x7f3b540a4eb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3b7019b3c0 tx=0x7f3b58005f90 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:44.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.574+0000 7f3b67400640 1 -- 172.21.15.18:0/679723642 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b6009bca0 con 0x7f3b701023c0 2024-09-12T02:48:44.777 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:44 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T02:48:44.778 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:44 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:48:44.778 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:44 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.778 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:44 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.778 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:44 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.778 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:44 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.778 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:44 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3155647702' entity='client.admin' 2024-09-12T02:48:44.778 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:44 smithi176 ceph-mon[35713]: mgrmap e23: x(active, since 1.02521s), standbys: z, y 2024-09-12T02:48:44.778 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:44 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.778 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:44 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.778 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:44 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' 2024-09-12T02:48:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:44 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T02:48:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:44 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:48:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:44 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:44 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:44 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:44 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:44 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3155647702' entity='client.admin' 2024-09-12T02:48:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:44 smithi062 ceph-mon[35527]: mgrmap e23: x(active, since 1.02521s), standbys: z, y 2024-09-12T02:48:44.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:44 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:44 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:44 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' 2024-09-12T02:48:44.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.787+0000 7f3b6fe00640 1 -- 172.21.15.18:0/679723642 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f3b70062630 con 0x7f3b701023c0 2024-09-12T02:48:44.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.793+0000 7f3b67400640 1 -- 172.21.15.18:0/679723642 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v28)=0 v28) ==== 133+0+0 (secure 0 0 0) 0x7f3b6009ffa0 con 0x7f3b701023c0 2024-09-12T02:48:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.795+0000 7f3b6fe00640 1 -- 172.21.15.18:0/679723642 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3b540a29f0 msgr2=0x7f3b540a4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.795+0000 7f3b6fe00640 1 --2- 172.21.15.18:0/679723642 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3b540a29f0 0x7f3b540a4eb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3b7019b3c0 tx=0x7f3b58005f90 comp rx=0 tx=0).stop 2024-09-12T02:48:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.795+0000 7f3b6fe00640 1 -- 172.21.15.18:0/679723642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b701023c0 msgr2=0x7f3b70199eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.795+0000 7f3b6fe00640 1 --2- 172.21.15.18:0/679723642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b701023c0 0x7f3b70199eb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000e9f0 tx=0x7f3b6000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.795+0000 7f3b6fe00640 1 -- 172.21.15.18:0/679723642 shutdown_connections 2024-09-12T02:48:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.795+0000 7f3b6fe00640 1 --2- 172.21.15.18:0/679723642 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3b540a29f0 0x7f3b540a4eb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.795+0000 7f3b6fe00640 1 --2- 172.21.15.18:0/679723642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b70107620 0x7f3b701a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.795+0000 7f3b6fe00640 1 --2- 172.21.15.18:0/679723642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b70104cf0 0x7f3b7019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.795+0000 7f3b6fe00640 1 --2- 172.21.15.18:0/679723642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b701023c0 0x7f3b70199eb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.795+0000 7f3b6fe00640 1 -- 172.21.15.18:0/679723642 >> 172.21.15.18:0/679723642 conn(0x7f3b700fbfa0 msgr2=0x7f3b70101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.795+0000 7f3b6fe00640 1 -- 172.21.15.18:0/679723642 shutdown_connections 2024-09-12T02:48:44.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.796+0000 7f3b6fe00640 1 -- 172.21.15.18:0/679723642 wait complete. 2024-09-12T02:48:44.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T02:48:44.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:48:44.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3155647702' entity='client.admin' 2024-09-12T02:48:44.813 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-mon[30616]: mgrmap e23: x(active, since 1.02521s), standbys: z, y 2024-09-12T02:48:44.813 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.813 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:44.813 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' 2024-09-12T02:48:44.814 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-12T02:48:44.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.979+0000 7fbb56200640 1 -- 172.21.15.18:0/2243869130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb50103050 msgr2=0x7fbb50103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.979+0000 7fbb56200640 1 --2- 172.21.15.18:0/2243869130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb50103050 0x7fbb50103450 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009900 tx=0x7fbb4002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.979+0000 7fbb56200640 1 -- 172.21.15.18:0/2243869130 shutdown_connections 2024-09-12T02:48:44.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.979+0000 7fbb56200640 1 --2- 172.21.15.18:0/2243869130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb50101f40 0x7fbb50109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.979+0000 7fbb56200640 1 --2- 172.21.15.18:0/2243869130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb50101580 0x7fbb50101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.979+0000 7fbb56200640 1 --2- 172.21.15.18:0/2243869130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb50103050 0x7fbb50103450 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.979+0000 7fbb56200640 1 -- 172.21.15.18:0/2243869130 >> 172.21.15.18:0/2243869130 conn(0x7fbb500fd0d0 msgr2=0x7fbb500ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:44.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.980+0000 7fbb56200640 1 -- 172.21.15.18:0/2243869130 shutdown_connections 2024-09-12T02:48:44.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.980+0000 7fbb56200640 1 -- 172.21.15.18:0/2243869130 wait complete. 2024-09-12T02:48:44.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.981+0000 7fbb56200640 1 Processor -- start 2024-09-12T02:48:44.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.981+0000 7fbb56200640 1 -- start start 2024-09-12T02:48:44.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.982+0000 7fbb56200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb50101580 0x7fbb5019a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.982+0000 7fbb56200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb50101f40 0x7fbb5019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.982+0000 7fbb56200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb50103050 0x7fbb501a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.982+0000 7fbb56200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5010d740 con 0x7fbb50103050 2024-09-12T02:48:44.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.982+0000 7fbb56200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5010d5c0 con 0x7fbb50101580 2024-09-12T02:48:44.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.982+0000 7fbb56200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5010d8c0 con 0x7fbb50101f40 2024-09-12T02:48:44.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.982+0000 7fbb54e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb50101580 0x7fbb5019a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.982+0000 7fbb54e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb50101580 0x7fbb5019a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:38498/0 (socket says 172.21.15.18:38498) 2024-09-12T02:48:44.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.982+0000 7fbb54e00640 1 -- 172.21.15.18:0/2527320318 learned_addr learned my addr 172.21.15.18:0/2527320318 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:44.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.982+0000 7fbb55800640 1 --2- 172.21.15.18:0/2527320318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb50103050 0x7fbb501a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.982+0000 7fbb47e00640 1 --2- 172.21.15.18:0/2527320318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb50101f40 0x7fbb5019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.982+0000 7fbb54e00640 1 -- 172.21.15.18:0/2527320318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb50101f40 msgr2=0x7fbb5019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.982+0000 7fbb54e00640 1 --2- 172.21.15.18:0/2527320318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb50101f40 0x7fbb5019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.982+0000 7fbb54e00640 1 -- 172.21.15.18:0/2527320318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb50103050 msgr2=0x7fbb501a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:44.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.982+0000 7fbb54e00640 1 --2- 172.21.15.18:0/2527320318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb50103050 0x7fbb501a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:44.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.982+0000 7fbb54e00640 1 -- 172.21.15.18:0/2527320318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb501a1c20 con 0x7fbb50101580 2024-09-12T02:48:44.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.983+0000 7fbb55800640 1 --2- 172.21.15.18:0/2527320318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb50103050 0x7fbb501a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:44.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.983+0000 7fbb54e00640 1 --2- 172.21.15.18:0/2527320318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb50101580 0x7fbb5019a000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbb40031440 tx=0x7fbb40032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:44.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.983+0000 7fbb4e000640 1 -- 172.21.15.18:0/2527320318 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4003f030 con 0x7fbb50101580 2024-09-12T02:48:44.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.983+0000 7fbb56200640 1 -- 172.21.15.18:0/2527320318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb501a1eb0 con 0x7fbb50101580 2024-09-12T02:48:44.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.983+0000 7fbb4e000640 1 -- 172.21.15.18:0/2527320318 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb40003ce0 con 0x7fbb50101580 2024-09-12T02:48:44.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.983+0000 7fbb4e000640 1 -- 172.21.15.18:0/2527320318 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40035070 con 0x7fbb50101580 2024-09-12T02:48:44.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.983+0000 7fbb56200640 1 -- 172.21.15.18:0/2527320318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb501a2310 con 0x7fbb50101580 2024-09-12T02:48:44.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.984+0000 7fbb56200640 1 -- 172.21.15.18:0/2527320318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb501a2540 con 0x7fbb50101580 2024-09-12T02:48:44.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.986+0000 7fbb4e000640 1 -- 172.21.15.18:0/2527320318 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 23) ==== 137645+0+0 (secure 0 0 0) 0x7fbb40042030 con 0x7fbb50101580 2024-09-12T02:48:44.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.987+0000 7fbb4e000640 1 --2- 172.21.15.18:0/2527320318 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fbb340a29f0 0x7fbb340a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:44.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.987+0000 7fbb4e000640 1 -- 172.21.15.18:0/2527320318 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fbb400ef550 con 0x7fbb50101580 2024-09-12T02:48:44.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.988+0000 7fbb47e00640 1 --2- 172.21.15.18:0/2527320318 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fbb340a29f0 0x7fbb340a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:44.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.988+0000 7fbb47e00640 1 --2- 172.21.15.18:0/2527320318 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fbb340a29f0 0x7fbb340a4eb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbb5019b510 tx=0x7fbb38005f90 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:44.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:44.991+0000 7fbb4e000640 1 -- 172.21.15.18:0/2527320318 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb400bbc30 con 0x7fbb50101580 2024-09-12T02:48:45.116 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:44.985+0000 7fea1a200640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:02:48:44] ENGINE Error in HTTPServer.serve 2024-09-12T02:48:45.116 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: Traceback (most recent call last): 2024-09-12T02:48:45.116 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:48:45.116 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: self._connections.run(self.expiration_interval) 2024-09-12T02:48:45.117 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:48:45.117 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: self._run(expiration_interval) 2024-09-12T02:48:45.117 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:48:45.117 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:48:45.117 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:48:45.117 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:48:45.117 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:48:45.118 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: s = self.context.wrap_socket( 2024-09-12T02:48:45.118 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:48:45.118 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: return self.sslsocket_class._create( 2024-09-12T02:48:45.118 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:48:45.118 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: self.do_handshake() 2024-09-12T02:48:45.118 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:48:45.118 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: self._sslobj.do_handshake() 2024-09-12T02:48:45.118 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:48:45.118 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:48:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:48:45.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.218+0000 7fbb56200640 1 -- 172.21.15.18:0/2527320318 --> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fbb50075b40 con 0x7fbb340a29f0 2024-09-12T02:48:45.292 INFO:teuthology.orchestra.run.smithi018.stdout:Schedule set for path / 2024-09-12T02:48:45.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.290+0000 7fbb4e000640 1 -- 172.21.15.18:0/2527320318 <== mgr.25213 v2:172.21.15.18:6800/4058201283 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fbb50075b40 con 0x7fbb340a29f0 2024-09-12T02:48:45.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.293+0000 7fbb56200640 1 -- 172.21.15.18:0/2527320318 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fbb340a29f0 msgr2=0x7fbb340a4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.293+0000 7fbb56200640 1 --2- 172.21.15.18:0/2527320318 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fbb340a29f0 0x7fbb340a4eb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbb5019b510 tx=0x7fbb38005f90 comp rx=0 tx=0).stop 2024-09-12T02:48:45.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.293+0000 7fbb56200640 1 -- 172.21.15.18:0/2527320318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb50101580 msgr2=0x7fbb5019a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.293+0000 7fbb56200640 1 --2- 172.21.15.18:0/2527320318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb50101580 0x7fbb5019a000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbb40031440 tx=0x7fbb40032ce0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.293+0000 7fbb56200640 1 -- 172.21.15.18:0/2527320318 shutdown_connections 2024-09-12T02:48:45.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.293+0000 7fbb56200640 1 --2- 172.21.15.18:0/2527320318 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fbb340a29f0 0x7fbb340a4eb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.293+0000 7fbb56200640 1 --2- 172.21.15.18:0/2527320318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb50103050 0x7fbb501a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.293+0000 7fbb56200640 1 --2- 172.21.15.18:0/2527320318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb50101f40 0x7fbb5019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.293+0000 7fbb56200640 1 --2- 172.21.15.18:0/2527320318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb50101580 0x7fbb5019a000 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.293+0000 7fbb56200640 1 -- 172.21.15.18:0/2527320318 >> 172.21.15.18:0/2527320318 conn(0x7fbb500fd0d0 msgr2=0x7fbb50074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:45.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.293+0000 7fbb56200640 1 -- 172.21.15.18:0/2527320318 shutdown_connections 2024-09-12T02:48:45.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.293+0000 7fbb56200640 1 -- 172.21.15.18:0/2527320318 wait complete. 2024-09-12T02:48:45.311 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-12T02:48:45.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.475+0000 7f9b85200640 1 -- 172.21.15.18:0/890189956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b80103b70 msgr2=0x7f9b80103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.475+0000 7f9b85200640 1 --2- 172.21.15.18:0/890189956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b80103b70 0x7f9b80103f70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009900 tx=0x7f9b7002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.475+0000 7f9b85200640 1 -- 172.21.15.18:0/890189956 shutdown_connections 2024-09-12T02:48:45.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.475+0000 7f9b85200640 1 --2- 172.21.15.18:0/890189956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b80105720 0x7f9b8010bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.475+0000 7f9b85200640 1 --2- 172.21.15.18:0/890189956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b80104d60 0x7f9b801051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.475+0000 7f9b85200640 1 --2- 172.21.15.18:0/890189956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b80103b70 0x7f9b80103f70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.475+0000 7f9b85200640 1 -- 172.21.15.18:0/890189956 >> 172.21.15.18:0/890189956 conn(0x7f9b800ff310 msgr2=0x7f9b80101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:45.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.475+0000 7f9b85200640 1 -- 172.21.15.18:0/890189956 shutdown_connections 2024-09-12T02:48:45.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.475+0000 7f9b85200640 1 -- 172.21.15.18:0/890189956 wait complete. 2024-09-12T02:48:45.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.476+0000 7f9b85200640 1 Processor -- start 2024-09-12T02:48:45.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.476+0000 7f9b85200640 1 -- start start 2024-09-12T02:48:45.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.476+0000 7f9b85200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b80103b70 0x7f9b80199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.476+0000 7f9b85200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b80104d60 0x7f9b8019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.476+0000 7f9b85200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b80105720 0x7f9b801a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.476+0000 7f9b85200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8010f7d0 con 0x7f9b80105720 2024-09-12T02:48:45.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.476+0000 7f9b85200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8010f650 con 0x7f9b80104d60 2024-09-12T02:48:45.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.476+0000 7f9b85200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8010f950 con 0x7f9b80103b70 2024-09-12T02:48:45.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.476+0000 7f9b7f400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b80103b70 0x7f9b80199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.477+0000 7f9b7fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b80105720 0x7f9b801a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.477+0000 7f9b7ea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b80104d60 0x7f9b8019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.477+0000 7f9b7f400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b80103b70 0x7f9b80199e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:43342/0 (socket says 172.21.15.18:43342) 2024-09-12T02:48:45.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.477+0000 7f9b7f400640 1 -- 172.21.15.18:0/1212568049 learned_addr learned my addr 172.21.15.18:0/1212568049 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:45.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.477+0000 7f9b7f400640 1 -- 172.21.15.18:0/1212568049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b80104d60 msgr2=0x7f9b8019a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.477+0000 7f9b7f400640 1 --2- 172.21.15.18:0/1212568049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b80104d60 0x7f9b8019a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.477+0000 7f9b7f400640 1 -- 172.21.15.18:0/1212568049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b80105720 msgr2=0x7f9b801a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.477+0000 7f9b7f400640 1 --2- 172.21.15.18:0/1212568049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b80105720 0x7f9b801a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.477+0000 7f9b7f400640 1 -- 172.21.15.18:0/1212568049 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b801a1aa0 con 0x7f9b80103b70 2024-09-12T02:48:45.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.477+0000 7f9b7f400640 1 --2- 172.21.15.18:0/1212568049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b80103b70 0x7f9b80199e80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9b70031610 tx=0x7f9b70004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:45.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.477+0000 7f9b77e00640 1 -- 172.21.15.18:0/1212568049 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7003f030 con 0x7f9b80103b70 2024-09-12T02:48:45.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.477+0000 7f9b77e00640 1 -- 172.21.15.18:0/1212568049 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b70003ad0 con 0x7f9b80103b70 2024-09-12T02:48:45.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.478+0000 7f9b85200640 1 -- 172.21.15.18:0/1212568049 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b801a1d30 con 0x7f9b80103b70 2024-09-12T02:48:45.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.478+0000 7f9b77e00640 1 -- 172.21.15.18:0/1212568049 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b70035070 con 0x7f9b80103b70 2024-09-12T02:48:45.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.478+0000 7f9b85200640 1 -- 172.21.15.18:0/1212568049 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b801a21d0 con 0x7f9b80103b70 2024-09-12T02:48:45.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.479+0000 7f9b85200640 1 -- 172.21.15.18:0/1212568049 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b8010afb0 con 0x7f9b80103b70 2024-09-12T02:48:45.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.482+0000 7f9b77e00640 1 -- 172.21.15.18:0/1212568049 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 23) ==== 137645+0+0 (secure 0 0 0) 0x7f9b70042030 con 0x7f9b80103b70 2024-09-12T02:48:45.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.483+0000 7f9b77e00640 1 --2- 172.21.15.18:0/1212568049 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f9b640a2970 0x7f9b640a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:45.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.483+0000 7f9b77e00640 1 -- 172.21.15.18:0/1212568049 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f9b700ef700 con 0x7f9b80103b70 2024-09-12T02:48:45.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.484+0000 7f9b7ea00640 1 --2- 172.21.15.18:0/1212568049 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f9b640a2970 0x7f9b640a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:45.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.484+0000 7f9b7ea00640 1 --2- 172.21.15.18:0/1212568049 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f9b640a2970 0x7f9b640a4e30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c0095f0 tx=0x7f9b6c005f90 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:45.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.487+0000 7f9b77e00640 1 -- 172.21.15.18:0/1212568049 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9b700bc430 con 0x7f9b80103b70 2024-09-12T02:48:45.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.706+0000 7f9b85200640 1 -- 172.21.15.18:0/1212568049 --> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f9b80062790 con 0x7f9b640a2970 2024-09-12T02:48:45.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:45 smithi062 ceph-mon[35527]: [12/Sep/2024:02:48:44] ENGINE Bus STARTING 2024-09-12T02:48:45.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:45 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' 2024-09-12T02:48:45.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:45 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:45.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:45 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:45.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:45 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:45.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.795+0000 7f9b77e00640 1 -- 172.21.15.18:0/1212568049 <== mgr.25213 v2:172.21.15.18:6800/4058201283 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f9b80062790 con 0x7f9b640a2970 2024-09-12T02:48:45.796 INFO:teuthology.orchestra.run.smithi018.stdout:Retention added to path / 2024-09-12T02:48:45.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.799+0000 7f9b85200640 1 -- 172.21.15.18:0/1212568049 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f9b640a2970 msgr2=0x7f9b640a4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.799+0000 7f9b85200640 1 --2- 172.21.15.18:0/1212568049 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f9b640a2970 0x7f9b640a4e30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c0095f0 tx=0x7f9b6c005f90 comp rx=0 tx=0).stop 2024-09-12T02:48:45.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.799+0000 7f9b85200640 1 -- 172.21.15.18:0/1212568049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b80103b70 msgr2=0x7f9b80199e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:45.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.799+0000 7f9b85200640 1 --2- 172.21.15.18:0/1212568049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b80103b70 0x7f9b80199e80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9b70031610 tx=0x7f9b70004270 comp rx=0 tx=0).stop 2024-09-12T02:48:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.801+0000 7f9b85200640 1 -- 172.21.15.18:0/1212568049 shutdown_connections 2024-09-12T02:48:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.801+0000 7f9b85200640 1 --2- 172.21.15.18:0/1212568049 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f9b640a2970 0x7f9b640a4e30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.801+0000 7f9b85200640 1 --2- 172.21.15.18:0/1212568049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b80105720 0x7f9b801a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.801+0000 7f9b85200640 1 --2- 172.21.15.18:0/1212568049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b80104d60 0x7f9b8019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.801+0000 7f9b85200640 1 --2- 172.21.15.18:0/1212568049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b80103b70 0x7f9b80199e80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.801+0000 7f9b85200640 1 -- 172.21.15.18:0/1212568049 >> 172.21.15.18:0/1212568049 conn(0x7f9b800ff310 msgr2=0x7f9b80108180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.802+0000 7f9b85200640 1 -- 172.21.15.18:0/1212568049 shutdown_connections 2024-09-12T02:48:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:45.802+0000 7f9b85200640 1 -- 172.21.15.18:0/1212568049 wait complete. 2024-09-12T02:48:45.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:45 smithi018 ceph-mon[30616]: [12/Sep/2024:02:48:44] ENGINE Bus STARTING 2024-09-12T02:48:45.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:45 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' 2024-09-12T02:48:45.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:45 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:45.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:45 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:45.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:45 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:45.821 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-12T02:48:45.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:45 smithi176 ceph-mon[35713]: [12/Sep/2024:02:48:44] ENGINE Bus STARTING 2024-09-12T02:48:45.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:45 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' 2024-09-12T02:48:45.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:45 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:45.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:45 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:45.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:45 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.007+0000 7f4b42e00640 1 -- 172.21.15.18:0/3292788324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b3c1014f0 msgr2=0x7f4b3c1019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:46.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.007+0000 7f4b42e00640 1 --2- 172.21.15.18:0/3292788324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b3c1014f0 0x7f4b3c1019a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4b34009be0 tx=0x7f4b3402a6c0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.007+0000 7f4b42e00640 1 -- 172.21.15.18:0/3292788324 shutdown_connections 2024-09-12T02:48:46.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.007+0000 7f4b42e00640 1 --2- 172.21.15.18:0/3292788324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b3c1014f0 0x7f4b3c1019a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.007+0000 7f4b42e00640 1 --2- 172.21.15.18:0/3292788324 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b3c100b50 0x7f4b3c100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.007+0000 7f4b42e00640 1 --2- 172.21.15.18:0/3292788324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b3c100210 0x7f4b3c100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.007+0000 7f4b42e00640 1 -- 172.21.15.18:0/3292788324 >> 172.21.15.18:0/3292788324 conn(0x7f4b3c0fbfa0 msgr2=0x7f4b3c0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:46.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.007+0000 7f4b42e00640 1 -- 172.21.15.18:0/3292788324 shutdown_connections 2024-09-12T02:48:46.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.008+0000 7f4b42e00640 1 -- 172.21.15.18:0/3292788324 wait complete. 2024-09-12T02:48:46.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.008+0000 7f4b42e00640 1 Processor -- start 2024-09-12T02:48:46.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.008+0000 7f4b42e00640 1 -- start start 2024-09-12T02:48:46.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.009+0000 7f4b42e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b3c100210 0x7f4b3c199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.009+0000 7f4b42e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b3c100b50 0x7f4b3c19a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.009+0000 7f4b42e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b3c1014f0 0x7f4b3c1a1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.009+0000 7f4b42e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c10f730 con 0x7f4b3c1014f0 2024-09-12T02:48:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.009+0000 7f4b42e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c10f5b0 con 0x7f4b3c100210 2024-09-12T02:48:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.009+0000 7f4b42e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c10f8b0 con 0x7f4b3c100b50 2024-09-12T02:48:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.009+0000 7f4b41a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b3c100210 0x7f4b3c199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.009+0000 7f4b41000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b3c100b50 0x7f4b3c19a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.009+0000 7f4b42400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b3c1014f0 0x7f4b3c1a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.009+0000 7f4b41a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b3c100210 0x7f4b3c199db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:38554/0 (socket says 172.21.15.18:38554) 2024-09-12T02:48:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.009+0000 7f4b41a00640 1 -- 172.21.15.18:0/401206236 learned_addr learned my addr 172.21.15.18:0/401206236 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.009+0000 7f4b41000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b3c100b50 0x7f4b3c19a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:43364/0 (socket says 172.21.15.18:43364) 2024-09-12T02:48:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.009+0000 7f4b41a00640 1 -- 172.21.15.18:0/401206236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b3c100b50 msgr2=0x7f4b3c19a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.009+0000 7f4b41a00640 1 --2- 172.21.15.18:0/401206236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b3c100b50 0x7f4b3c19a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.009+0000 7f4b41a00640 1 -- 172.21.15.18:0/401206236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b3c1014f0 msgr2=0x7f4b3c1a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.009+0000 7f4b41a00640 1 --2- 172.21.15.18:0/401206236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b3c1014f0 0x7f4b3c1a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.009+0000 7f4b41a00640 1 -- 172.21.15.18:0/401206236 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3c1a19d0 con 0x7f4b3c100210 2024-09-12T02:48:46.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.010+0000 7f4b41a00640 1 --2- 172.21.15.18:0/401206236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b3c100210 0x7f4b3c199db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000e9f0 tx=0x7f4b3000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:46.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.010+0000 7f4b3a000640 1 -- 172.21.15.18:0/401206236 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3000ccc0 con 0x7f4b3c100210 2024-09-12T02:48:46.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.010+0000 7f4b3a000640 1 -- 172.21.15.18:0/401206236 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b30010910 con 0x7f4b3c100210 2024-09-12T02:48:46.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.010+0000 7f4b42e00640 1 -- 172.21.15.18:0/401206236 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3c1a1cc0 con 0x7f4b3c100210 2024-09-12T02:48:46.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.010+0000 7f4b3a000640 1 -- 172.21.15.18:0/401206236 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b300188a0 con 0x7f4b3c100210 2024-09-12T02:48:46.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.010+0000 7f4b42e00640 1 -- 172.21.15.18:0/401206236 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b3c1a21c0 con 0x7f4b3c100210 2024-09-12T02:48:46.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.011+0000 7f4b42e00640 1 -- 172.21.15.18:0/401206236 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b3c10af60 con 0x7f4b3c100210 2024-09-12T02:48:46.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.013+0000 7f4b3a000640 1 -- 172.21.15.18:0/401206236 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 24) ==== 137953+0+0 (secure 0 0 0) 0x7f4b30010ac0 con 0x7f4b3c100210 2024-09-12T02:48:46.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.014+0000 7f4b3a000640 1 --2- 172.21.15.18:0/401206236 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4b240a2cf0 0x7f4b240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.015+0000 7f4b3a000640 1 -- 172.21.15.18:0/401206236 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f4b300cfc60 con 0x7f4b3c100210 2024-09-12T02:48:46.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.015+0000 7f4b41000640 1 --2- 172.21.15.18:0/401206236 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4b240a2cf0 0x7f4b240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.015+0000 7f4b41000640 1 --2- 172.21.15.18:0/401206236 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4b240a2cf0 0x7f4b240a51b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c19b2c0 tx=0x7f4b28009260 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:46.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.018+0000 7f4b3a000640 1 -- 172.21.15.18:0/401206236 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b3009c460 con 0x7f4b3c100210 2024-09-12T02:48:46.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.251+0000 7f4b42e00640 1 -- 172.21.15.18:0/401206236 --> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f4b3c062630 con 0x7f4b240a2cf0 2024-09-12T02:48:46.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.258+0000 7f4b3a000640 1 -- 172.21.15.18:0/401206236 <== mgr.25213 v2:172.21.15.18:6800/4058201283 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f4b3c062630 con 0x7f4b240a2cf0 2024-09-12T02:48:46.259 INFO:teuthology.orchestra.run.smithi018.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-12T00:00:00", "created": "2024-09-12T02:48:45", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-12T02:48:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.260+0000 7f4b42e00640 1 -- 172.21.15.18:0/401206236 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4b240a2cf0 msgr2=0x7f4b240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.260+0000 7f4b42e00640 1 --2- 172.21.15.18:0/401206236 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4b240a2cf0 0x7f4b240a51b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c19b2c0 tx=0x7f4b28009260 comp rx=0 tx=0).stop 2024-09-12T02:48:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.260+0000 7f4b42e00640 1 -- 172.21.15.18:0/401206236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b3c100210 msgr2=0x7f4b3c199db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.260+0000 7f4b42e00640 1 --2- 172.21.15.18:0/401206236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b3c100210 0x7f4b3c199db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000e9f0 tx=0x7f4b3000edf0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.260+0000 7f4b42e00640 1 -- 172.21.15.18:0/401206236 shutdown_connections 2024-09-12T02:48:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.260+0000 7f4b42e00640 1 --2- 172.21.15.18:0/401206236 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4b240a2cf0 0x7f4b240a51b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.260+0000 7f4b42e00640 1 --2- 172.21.15.18:0/401206236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b3c1014f0 0x7f4b3c1a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.260+0000 7f4b42e00640 1 --2- 172.21.15.18:0/401206236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b3c100b50 0x7f4b3c19a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.260+0000 7f4b42e00640 1 --2- 172.21.15.18:0/401206236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b3c100210 0x7f4b3c199db0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.261+0000 7f4b42e00640 1 -- 172.21.15.18:0/401206236 >> 172.21.15.18:0/401206236 conn(0x7f4b3c0fbfa0 msgr2=0x7f4b3c0fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:46.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.261+0000 7f4b42e00640 1 -- 172.21.15.18:0/401206236 shutdown_connections 2024-09-12T02:48:46.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.261+0000 7f4b42e00640 1 -- 172.21.15.18:0/401206236 wait complete. 2024-09-12T02:48:46.278 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-12T02:48:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.442+0000 7f605a200640 1 -- 172.21.15.18:0/2737834151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6054101b60 msgr2=0x7f6054101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.442+0000 7f605a200640 1 --2- 172.21.15.18:0/2737834151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6054101b60 0x7f6054101f60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6044009900 tx=0x7f604402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.442+0000 7f605a200640 1 -- 172.21.15.18:0/2737834151 shutdown_connections 2024-09-12T02:48:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.442+0000 7f605a200640 1 --2- 172.21.15.18:0/2737834151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6054103710 0x7f6054109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.442+0000 7f605a200640 1 --2- 172.21.15.18:0/2737834151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6054102d50 0x7f60541031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.442+0000 7f605a200640 1 --2- 172.21.15.18:0/2737834151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6054101b60 0x7f6054101f60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.442+0000 7f605a200640 1 -- 172.21.15.18:0/2737834151 >> 172.21.15.18:0/2737834151 conn(0x7f60540fd2e0 msgr2=0x7f60540ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.442+0000 7f605a200640 1 -- 172.21.15.18:0/2737834151 shutdown_connections 2024-09-12T02:48:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.442+0000 7f605a200640 1 -- 172.21.15.18:0/2737834151 wait complete. 2024-09-12T02:48:46.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.443+0000 7f605a200640 1 Processor -- start 2024-09-12T02:48:46.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.443+0000 7f605a200640 1 -- start start 2024-09-12T02:48:46.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.443+0000 7f605a200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6054101b60 0x7f6054197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.443+0000 7f605a200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6054102d50 0x7f6054198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.443+0000 7f605a200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6054103710 0x7f605419f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.443+0000 7f605a200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f605410d830 con 0x7f6054103710 2024-09-12T02:48:46.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.443+0000 7f605a200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f605410d6b0 con 0x7f6054102d50 2024-09-12T02:48:46.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.443+0000 7f605a200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f605410d9b0 con 0x7f6054101b60 2024-09-12T02:48:46.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.444+0000 7f6053400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6054101b60 0x7f6054197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.444+0000 7f6053400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6054101b60 0x7f6054197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:43380/0 (socket says 172.21.15.18:43380) 2024-09-12T02:48:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.444+0000 7f6053400640 1 -- 172.21.15.18:0/1122403896 learned_addr learned my addr 172.21.15.18:0/1122403896 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.444+0000 7f6053e00640 1 --2- 172.21.15.18:0/1122403896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6054103710 0x7f605419f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.444+0000 7f604aa00640 1 --2- 172.21.15.18:0/1122403896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6054102d50 0x7f6054198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.444+0000 7f6053400640 1 -- 172.21.15.18:0/1122403896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6054102d50 msgr2=0x7f6054198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.444+0000 7f6053400640 1 --2- 172.21.15.18:0/1122403896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6054102d50 0x7f6054198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.444+0000 7f6053400640 1 -- 172.21.15.18:0/1122403896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6054103710 msgr2=0x7f605419f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.444+0000 7f6053400640 1 --2- 172.21.15.18:0/1122403896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6054103710 0x7f605419f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.444+0000 7f6053400640 1 -- 172.21.15.18:0/1122403896 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605419fa10 con 0x7f6054101b60 2024-09-12T02:48:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.444+0000 7f6053e00640 1 --2- 172.21.15.18:0/1122403896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6054103710 0x7f605419f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:48:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.445+0000 7f6053400640 1 --2- 172.21.15.18:0/1122403896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6054101b60 0x7f6054197df0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6044031440 tx=0x7f6044032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.445+0000 7f6050c00640 1 -- 172.21.15.18:0/1122403896 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604403f030 con 0x7f6054101b60 2024-09-12T02:48:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.445+0000 7f6050c00640 1 -- 172.21.15.18:0/1122403896 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6044003ce0 con 0x7f6054101b60 2024-09-12T02:48:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.445+0000 7f605a200640 1 -- 172.21.15.18:0/1122403896 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605419fca0 con 0x7f6054101b60 2024-09-12T02:48:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.445+0000 7f6050c00640 1 -- 172.21.15.18:0/1122403896 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044035070 con 0x7f6054101b60 2024-09-12T02:48:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.445+0000 7f605a200640 1 -- 172.21.15.18:0/1122403896 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60541a0190 con 0x7f6054101b60 2024-09-12T02:48:46.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.446+0000 7f605a200640 1 -- 172.21.15.18:0/1122403896 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6054108f00 con 0x7f6054101b60 2024-09-12T02:48:46.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.448+0000 7f6050c00640 1 -- 172.21.15.18:0/1122403896 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 24) ==== 137953+0+0 (secure 0 0 0) 0x7f6044042030 con 0x7f6054101b60 2024-09-12T02:48:46.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.449+0000 7f6050c00640 1 --2- 172.21.15.18:0/1122403896 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f60380a2e20 0x7f60380a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:46.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.449+0000 7f6050c00640 1 -- 172.21.15.18:0/1122403896 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f60440effb0 con 0x7f6054101b60 2024-09-12T02:48:46.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.450+0000 7f604aa00640 1 --2- 172.21.15.18:0/1122403896 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f60380a2e20 0x7f60380a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:46.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.450+0000 7f604aa00640 1 --2- 172.21.15.18:0/1122403896 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f60380a2e20 0x7f60380a52e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f603c0095f0 tx=0x7f603c005f90 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:48:46.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.453+0000 7f6050c00640 1 -- 172.21.15.18:0/1122403896 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60440bc160 con 0x7f6054101b60 2024-09-12T02:48:46.527 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: [12/Sep/2024:02:48:44] ENGINE Serving on http://172.21.15.18:8765 2024-09-12T02:48:46.527 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: [12/Sep/2024:02:48:44] ENGINE Serving on https://172.21.15.18:7150 2024-09-12T02:48:46.527 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: [12/Sep/2024:02:48:44] ENGINE Bus STARTED 2024-09-12T02:48:46.528 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: [12/Sep/2024:02:48:44] ENGINE Error in HTTPServer.serve 2024-09-12T02:48:46.528 INFO:journalctl@ceph.mon.a.smithi018.stdout: Traceback (most recent call last): 2024-09-12T02:48:46.528 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:48:46.528 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:48:46.528 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:48:46.529 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._run(expiration_interval) 2024-09-12T02:48:46.529 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:48:46.529 INFO:journalctl@ceph.mon.a.smithi018.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:48:46.529 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:48:46.529 INFO:journalctl@ceph.mon.a.smithi018.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:48:46.529 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:48:46.530 INFO:journalctl@ceph.mon.a.smithi018.stdout: s = self.context.wrap_socket( 2024-09-12T02:48:46.530 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:48:46.530 INFO:journalctl@ceph.mon.a.smithi018.stdout: return self.sslsocket_class._create( 2024-09-12T02:48:46.530 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:48:46.530 INFO:journalctl@ceph.mon.a.smithi018.stdout: self.do_handshake() 2024-09-12T02:48:46.530 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:48:46.530 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._sslobj.do_handshake() 2024-09-12T02:48:46.530 INFO:journalctl@ceph.mon.a.smithi018.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:48:46.530 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:48:46.531 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='client.25280 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:46.531 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.531 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='client.25297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:46.531 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: mgrmap e24: x(active, since 2s), standbys: z, y 2024-09-12T02:48:46.531 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.532 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.532 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.532 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.532 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.532 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.532 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.532 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.533 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.533 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.533 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.533 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.533 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.533 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.533 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.533 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.533 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.534 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.534 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.534 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.667+0000 7f605a200640 1 -- 172.21.15.18:0/1122403896 --> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f6054062630 con 0x7f60380a2e20 2024-09-12T02:48:46.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.675+0000 7f6050c00640 1 -- 172.21.15.18:0/1122403896 <== mgr.25213 v2:172.21.15.18:6800/4058201283 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f6054062630 con 0x7f60380a2e20 2024-09-12T02:48:46.677 INFO:teuthology.orchestra.run.smithi018.stdout:/ 1m 6m3h 2024-09-12T02:48:46.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.678+0000 7f605a200640 1 -- 172.21.15.18:0/1122403896 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f60380a2e20 msgr2=0x7f60380a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:46.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.678+0000 7f605a200640 1 --2- 172.21.15.18:0/1122403896 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f60380a2e20 0x7f60380a52e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f603c0095f0 tx=0x7f603c005f90 comp rx=0 tx=0).stop 2024-09-12T02:48:46.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.678+0000 7f605a200640 1 -- 172.21.15.18:0/1122403896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6054101b60 msgr2=0x7f6054197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:46.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.678+0000 7f605a200640 1 --2- 172.21.15.18:0/1122403896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6054101b60 0x7f6054197df0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6044031440 tx=0x7f6044032ce0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.678+0000 7f605a200640 1 -- 172.21.15.18:0/1122403896 shutdown_connections 2024-09-12T02:48:46.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.678+0000 7f605a200640 1 --2- 172.21.15.18:0/1122403896 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f60380a2e20 0x7f60380a52e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.678+0000 7f605a200640 1 --2- 172.21.15.18:0/1122403896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6054103710 0x7f605419f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.678+0000 7f605a200640 1 --2- 172.21.15.18:0/1122403896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6054102d50 0x7f6054198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.678+0000 7f605a200640 1 --2- 172.21.15.18:0/1122403896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6054101b60 0x7f6054197df0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:46.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.678+0000 7f605a200640 1 -- 172.21.15.18:0/1122403896 >> 172.21.15.18:0/1122403896 conn(0x7f60540fd2e0 msgr2=0x7f60541060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:46.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.678+0000 7f605a200640 1 -- 172.21.15.18:0/1122403896 shutdown_connections 2024-09-12T02:48:46.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T02:48:46.678+0000 7f605a200640 1 -- 172.21.15.18:0/1122403896 wait complete. 2024-09-12T02:48:46.696 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-12T02:48:46.756 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-12T02:48:46.766 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-12T02:48:46.775 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-12T02:48:46.775 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-12T02:48:46.781 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T02:48:46.794 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:48:46.795 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T02:48:46.795 INFO:tasks.workunit:timeout=3h 2024-09-12T02:48:46.795 INFO:tasks.workunit:cleanup=True 2024-09-12T02:48:46.796 DEBUG:teuthology.orchestra.run.smithi018:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:48:46.797 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: [12/Sep/2024:02:48:44] ENGINE Serving on http://172.21.15.18:8765 2024-09-12T02:48:46.797 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: [12/Sep/2024:02:48:44] ENGINE Serving on https://172.21.15.18:7150 2024-09-12T02:48:46.797 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: [12/Sep/2024:02:48:44] ENGINE Bus STARTED 2024-09-12T02:48:46.797 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: [12/Sep/2024:02:48:44] ENGINE Error in HTTPServer.serve 2024-09-12T02:48:46.797 INFO:journalctl@ceph.mon.b.smithi062.stdout: Traceback (most recent call last): 2024-09-12T02:48:46.797 INFO:journalctl@ceph.mon.b.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:48:46.797 INFO:journalctl@ceph.mon.b.smithi062.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:48:46.797 INFO:journalctl@ceph.mon.b.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:48:46.797 INFO:journalctl@ceph.mon.b.smithi062.stdout: self._run(expiration_interval) 2024-09-12T02:48:46.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:48:46.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:48:46.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:48:46.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:48:46.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:48:46.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: s = self.context.wrap_socket( 2024-09-12T02:48:46.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:48:46.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: return self.sslsocket_class._create( 2024-09-12T02:48:46.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:48:46.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: self.do_handshake() 2024-09-12T02:48:46.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:48:46.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: self._sslobj.do_handshake() 2024-09-12T02:48:46.798 INFO:journalctl@ceph.mon.b.smithi062.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:48:46.798 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:48:46.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='client.25280 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:46.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='client.25297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:46.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: mgrmap e24: x(active, since 2s), standbys: z, y 2024-09-12T02:48:46.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.800 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:46 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.829 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.829 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:46 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.839 INFO:teuthology.orchestra.run.smithi018.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T02:48:46.839 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-12T02:48:46.839 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-12T02:48:46.840 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:48:46.840 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-12T02:48:46.840 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-12 02:46:45.757416949 +0000 2024-09-12T02:48:46.840 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-12 02:46:45.757416949 +0000 2024-09-12T02:48:46.840 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-12 02:48:41.638631035 +0000 2024-09-12T02:48:46.840 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-12 02:46:45.757416949 +0000 2024-09-12T02:48:46.840 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T02:48:46.840 DEBUG:teuthology.orchestra.run.smithi018:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T02:48:46.948 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:48:46.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: [12/Sep/2024:02:48:44] ENGINE Serving on http://172.21.15.18:8765 2024-09-12T02:48:46.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: [12/Sep/2024:02:48:44] ENGINE Serving on https://172.21.15.18:7150 2024-09-12T02:48:46.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: [12/Sep/2024:02:48:44] ENGINE Bus STARTED 2024-09-12T02:48:46.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: [12/Sep/2024:02:48:44] ENGINE Error in HTTPServer.serve 2024-09-12T02:48:46.979 INFO:journalctl@ceph.mon.c.smithi176.stdout: Traceback (most recent call last): 2024-09-12T02:48:46.979 INFO:journalctl@ceph.mon.c.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:48:46.979 INFO:journalctl@ceph.mon.c.smithi176.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:48:46.979 INFO:journalctl@ceph.mon.c.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:48:46.980 INFO:journalctl@ceph.mon.c.smithi176.stdout: self._run(expiration_interval) 2024-09-12T02:48:46.980 INFO:journalctl@ceph.mon.c.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:48:46.980 INFO:journalctl@ceph.mon.c.smithi176.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:48:46.980 INFO:journalctl@ceph.mon.c.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:48:46.980 INFO:journalctl@ceph.mon.c.smithi176.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:48:46.980 INFO:journalctl@ceph.mon.c.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:48:46.980 INFO:journalctl@ceph.mon.c.smithi176.stdout: s = self.context.wrap_socket( 2024-09-12T02:48:46.980 INFO:journalctl@ceph.mon.c.smithi176.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:48:46.980 INFO:journalctl@ceph.mon.c.smithi176.stdout: return self.sslsocket_class._create( 2024-09-12T02:48:46.980 INFO:journalctl@ceph.mon.c.smithi176.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:48:46.980 INFO:journalctl@ceph.mon.c.smithi176.stdout: self.do_handshake() 2024-09-12T02:48:46.981 INFO:journalctl@ceph.mon.c.smithi176.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:48:46.981 INFO:journalctl@ceph.mon.c.smithi176.stdout: self._sslobj.do_handshake() 2024-09-12T02:48:46.981 INFO:journalctl@ceph.mon.c.smithi176.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:48:46.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:48:46.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='client.25280 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:46.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='client.25297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:46.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: mgrmap e24: x(active, since 2s), standbys: z, y 2024-09-12T02:48:46.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.982 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.983 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.983 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:46.983 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.983 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:46 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:46.986 INFO:tasks.workunit.client.0.smithi018.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T02:48:47.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:47 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi176 to 176.0M 2024-09-12T02:48:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:47 smithi018 ceph-mon[30616]: Unable to set osd_memory_target on smithi176 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-12T02:48:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:47 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi062 to 176.0M 2024-09-12T02:48:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:47 smithi018 ceph-mon[30616]: Unable to set osd_memory_target on smithi062 to 184597504: error parsing value: Value '184597504' is below minimum 939524096 2024-09-12T02:48:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:47 smithi018 ceph-mon[30616]: from='client.25298 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:47.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:47 smithi018 ceph-mon[30616]: from='client.25309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:47.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:47 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi176 to 176.0M 2024-09-12T02:48:47.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:47 smithi176 ceph-mon[35713]: Unable to set osd_memory_target on smithi176 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-12T02:48:47.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:47 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi062 to 176.0M 2024-09-12T02:48:47.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:47 smithi176 ceph-mon[35713]: Unable to set osd_memory_target on smithi062 to 184597504: error parsing value: Value '184597504' is below minimum 939524096 2024-09-12T02:48:47.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:47 smithi176 ceph-mon[35713]: from='client.25298 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:47.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:47 smithi176 ceph-mon[35713]: from='client.25309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:48.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:47 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi176 to 176.0M 2024-09-12T02:48:48.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:47 smithi062 ceph-mon[35527]: Unable to set osd_memory_target on smithi176 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-12T02:48:48.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:47 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi062 to 176.0M 2024-09-12T02:48:48.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:47 smithi062 ceph-mon[35527]: Unable to set osd_memory_target on smithi062 to 184597504: error parsing value: Value '184597504' is below minimum 939524096 2024-09-12T02:48:48.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:47 smithi062 ceph-mon[35527]: from='client.25298 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:48.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:47 smithi062 ceph-mon[35527]: from='client.25309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:48:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:48:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: mgrmap e25: x(active, since 4s), standbys: z, y 2024-09-12T02:48:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi018 to 177.5M 2024-09-12T02:48:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: Unable to set osd_memory_target on smithi018 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-12T02:48:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:48:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:48:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-12T02:48:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: Updating smithi062:/etc/ceph/ceph.conf 2024-09-12T02:48:48.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:48 smithi018 ceph-mon[30616]: Updating smithi176:/etc/ceph/ceph.conf 2024-09-12T02:48:48.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:48:48.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: mgrmap e25: x(active, since 4s), standbys: z, y 2024-09-12T02:48:48.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:48.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:48.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:48.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:48.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:48.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:48.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:48.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:48.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:48.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:48.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi018 to 177.5M 2024-09-12T02:48:48.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: Unable to set osd_memory_target on smithi018 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-12T02:48:48.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:48:48.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:48:48.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-12T02:48:48.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: Updating smithi062:/etc/ceph/ceph.conf 2024-09-12T02:48:48.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:48 smithi176 ceph-mon[35713]: Updating smithi176:/etc/ceph/ceph.conf 2024-09-12T02:48:49.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:48:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: mgrmap e25: x(active, since 4s), standbys: z, y 2024-09-12T02:48:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi018 to 177.5M 2024-09-12T02:48:49.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: Unable to set osd_memory_target on smithi018 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-12T02:48:49.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:48:49.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:48:49.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-12T02:48:49.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: Updating smithi062:/etc/ceph/ceph.conf 2024-09-12T02:48:49.035 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:48 smithi062 ceph-mon[35527]: Updating smithi176:/etc/ceph/ceph.conf 2024-09-12T02:48:49.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:49 smithi176 ceph-mon[35713]: Updating smithi176:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:48:49.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:49 smithi176 ceph-mon[35713]: Updating smithi062:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:48:49.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:49 smithi176 ceph-mon[35713]: Updating smithi176:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:48:49.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:49 smithi176 ceph-mon[35713]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:48:49.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:49 smithi176 ceph-mon[35713]: Updating smithi018:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:48:49.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:49 smithi176 ceph-mon[35713]: Updating smithi176:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:48:49.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:49 smithi176 ceph-mon[35713]: Updating smithi062:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:48:49.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:49 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:49.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:49 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:49.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:49 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:49.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:49 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:49.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:49 smithi176 ceph-mon[35713]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:48:50.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:49 smithi062 ceph-mon[35527]: Updating smithi176:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:48:50.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:49 smithi062 ceph-mon[35527]: Updating smithi062:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:48:50.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:49 smithi062 ceph-mon[35527]: Updating smithi176:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:48:50.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:49 smithi062 ceph-mon[35527]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:48:50.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:49 smithi062 ceph-mon[35527]: Updating smithi018:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:48:50.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:49 smithi062 ceph-mon[35527]: Updating smithi176:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:48:50.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:49 smithi062 ceph-mon[35527]: Updating smithi062:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:48:50.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:49 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:50.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:49 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:50.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:49 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:50.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:49 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:50.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:49 smithi062 ceph-mon[35527]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:48:50.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:49 smithi018 ceph-mon[30616]: Updating smithi176:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:48:50.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:49 smithi018 ceph-mon[30616]: Updating smithi062:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:48:50.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:49 smithi018 ceph-mon[30616]: Updating smithi176:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:48:50.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:49 smithi018 ceph-mon[30616]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:48:50.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:49 smithi018 ceph-mon[30616]: Updating smithi018:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:48:50.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:49 smithi018 ceph-mon[30616]: Updating smithi176:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:48:50.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:49 smithi018 ceph-mon[30616]: Updating smithi062:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:48:50.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:49 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:50.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:49 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:50.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:49 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:50.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:49 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:50.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:49 smithi018 ceph-mon[30616]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:48:51.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:50 smithi062 ceph-mon[35527]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:48:51.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:50 smithi062 ceph-mon[35527]: Updating smithi018:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:48:51.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:50 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:51.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:50 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:51.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:50 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:51.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:50 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:48:51.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:50 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:48:51.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:50 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:48:51.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:50 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:51.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:50 smithi018 ceph-mon[30616]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:48:51.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:50 smithi018 ceph-mon[30616]: Updating smithi018:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:48:51.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:50 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:51.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:50 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:51.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:50 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:51.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:50 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:48:51.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:50 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:48:51.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:50 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:48:51.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:50 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:51.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:50 smithi176 ceph-mon[35713]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:48:51.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:50 smithi176 ceph-mon[35713]: Updating smithi018:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:48:51.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:50 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:51.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:50 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:51.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:50 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:51.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:50 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:48:51.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:50 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:48:51.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:50 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:48:51.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:50 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:48:53.031 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:52 smithi176 ceph-mon[35713]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 79 op/s 2024-09-12T02:48:53.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:52 smithi062 ceph-mon[35527]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 79 op/s 2024-09-12T02:48:53.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:52 smithi018 ceph-mon[30616]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 79 op/s 2024-09-12T02:48:55.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:54 smithi062 ceph-mon[35527]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-09-12T02:48:55.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:54 smithi018 ceph-mon[30616]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-09-12T02:48:55.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:54 smithi176 ceph-mon[35713]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-09-12T02:48:57.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:56 smithi062 ceph-mon[35527]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-09-12T02:48:57.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:56 smithi018 ceph-mon[30616]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-09-12T02:48:57.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:56 smithi176 ceph-mon[35713]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-09-12T02:48:59.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:48:58 smithi062 ceph-mon[35527]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-12T02:48:59.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:48:58 smithi018 ceph-mon[30616]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-12T02:48:59.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:48:58 smithi176 ceph-mon[35713]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-12T02:48:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.993+0000 7f4cfd400640 1 -- 172.21.15.18:0/3983853235 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf81048e0 msgr2=0x7f4cf8108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.993+0000 7f4cfd400640 1 --2- 172.21.15.18:0/3983853235 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf81048e0 0x7f4cf8108920 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009900 tx=0x7f4ce002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:48:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.993+0000 7f4cfd400640 1 -- 172.21.15.18:0/3983853235 shutdown_connections 2024-09-12T02:48:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.993+0000 7f4cfd400640 1 --2- 172.21.15.18:0/3983853235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf8109080 0x7f4cf8110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.993+0000 7f4cfd400640 1 --2- 172.21.15.18:0/3983853235 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf81048e0 0x7f4cf8108920 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.993+0000 7f4cfd400640 1 --2- 172.21.15.18:0/3983853235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cf8103f30 0x7f4cf8104310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.993+0000 7f4cfd400640 1 -- 172.21.15.18:0/3983853235 >> 172.21.15.18:0/3983853235 conn(0x7f4cf80ff980 msgr2=0x7f4cf8101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:48:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.993+0000 7f4cfd400640 1 -- 172.21.15.18:0/3983853235 shutdown_connections 2024-09-12T02:48:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.993+0000 7f4cfd400640 1 -- 172.21.15.18:0/3983853235 wait complete. 2024-09-12T02:48:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.994+0000 7f4cfd400640 1 Processor -- start 2024-09-12T02:48:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.994+0000 7f4cfd400640 1 -- start start 2024-09-12T02:48:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.994+0000 7f4cfd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf8103f30 0x7f4cf819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.994+0000 7f4cfd400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf8109080 0x7f4cf819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.994+0000 7f4cfd400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cf819ee80 0x7f4cf819f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:48:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.994+0000 7f4cfd400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf81140f0 con 0x7f4cf8103f30 2024-09-12T02:48:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.994+0000 7f4cfd400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf8113f70 con 0x7f4cf8109080 2024-09-12T02:48:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.994+0000 7f4cfd400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf8114270 con 0x7f4cf819ee80 2024-09-12T02:48:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.995+0000 7f4cf6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf8103f30 0x7f4cf819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.995+0000 7f4cf6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf8103f30 0x7f4cf819a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49726/0 (socket says 172.21.15.18:49726) 2024-09-12T02:48:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.995+0000 7f4cede00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf8109080 0x7f4cf819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.995+0000 7f4cf6800640 1 -- 172.21.15.18:0/4124592759 learned_addr learned my addr 172.21.15.18:0/4124592759 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:48:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.995+0000 7f4cf7200640 1 --2- 172.21.15.18:0/4124592759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cf819ee80 0x7f4cf819f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:48:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.995+0000 7f4cf6800640 1 -- 172.21.15.18:0/4124592759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cf819ee80 msgr2=0x7f4cf819f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:48:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.995+0000 7f4cf6800640 1 --2- 172.21.15.18:0/4124592759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cf819ee80 0x7f4cf819f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:48:59.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.995+0000 7f4cf6800640 1 -- 172.21.15.18:0/4124592759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf8109080 msgr2=0x7f4cf819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.995+0000 7f4cf6800640 1 --2- 172.21.15.18:0/4124592759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf8109080 0x7f4cf819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.995+0000 7f4cf6800640 1 -- 172.21.15.18:0/4124592759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf819f970 con 0x7f4cf8103f30 2024-09-12T02:49:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.995+0000 7f4cede00640 1 --2- 172.21.15.18:0/4124592759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf8109080 0x7f4cf819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.995+0000 7f4cf6800640 1 --2- 172.21.15.18:0/4124592759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf8103f30 0x7f4cf819a5c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800e9f0 tx=0x7f4ce800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.996+0000 7f4cefe00640 1 -- 172.21.15.18:0/4124592759 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce800cd80 con 0x7f4cf8103f30 2024-09-12T02:49:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.996+0000 7f4cefe00640 1 -- 172.21.15.18:0/4124592759 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ce8005500 con 0x7f4cf8103f30 2024-09-12T02:49:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.996+0000 7f4cfd400640 1 -- 172.21.15.18:0/4124592759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf819fc60 con 0x7f4cf8103f30 2024-09-12T02:49:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.996+0000 7f4cefe00640 1 -- 172.21.15.18:0/4124592759 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8010690 con 0x7f4cf8103f30 2024-09-12T02:49:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.996+0000 7f4cfd400640 1 -- 172.21.15.18:0/4124592759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf81a73d0 con 0x7f4cf8103f30 2024-09-12T02:49:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.999+0000 7f4d003fd740 1 Processor -- start 2024-09-12T02:49:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.999+0000 7f4d003fd740 1 -- start start 2024-09-12T02:49:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.999+0000 7f4cefe00640 1 -- 172.21.15.18:0/4124592759 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 25) ==== 138009+0+0 (secure 0 0 0) 0x7f4ce80046c0 con 0x7f4cf8103f30 2024-09-12T02:49:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.999+0000 7f4d003fd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91a1e0 0x55f18c91a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.999+0000 7f4d003fd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c91ab00 0x55f18c924e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.999+0000 7f4d003fd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c9253a0 0x55f18c927790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.999+0000 7f4d003fd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f18c880100 con 0x55f18c91a1e0 2024-09-12T02:49:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.999+0000 7f4d003fd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f18c8281b0 con 0x55f18c9253a0 2024-09-12T02:49:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:48:59.999+0000 7f4d003fd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f18c87c0c0 con 0x55f18c91ab00 2024-09-12T02:49:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.000+0000 7f4cede00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c9253a0 0x55f18c927790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.000+0000 7f4cede00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c9253a0 0x55f18c927790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:38002/0 (socket says 172.21.15.18:38002) 2024-09-12T02:49:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.000+0000 7f4cf6800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c91ab00 0x55f18c924e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.000+0000 7f4cede00640 1 -- 172.21.15.18:0/3189750671 learned_addr learned my addr 172.21.15.18:0/3189750671 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.000+0000 7f4cf7200640 1 --2- 172.21.15.18:0/3189750671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91a1e0 0x55f18c91a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.000+0000 7f4cede00640 1 -- 172.21.15.18:0/3189750671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c91ab00 msgr2=0x55f18c924e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.000+0000 7f4cede00640 1 --2- 172.21.15.18:0/3189750671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c91ab00 0x55f18c924e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.000+0000 7f4cede00640 1 -- 172.21.15.18:0/3189750671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91a1e0 msgr2=0x55f18c91a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.000+0000 7f4cede00640 1 --2- 172.21.15.18:0/3189750671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91a1e0 0x55f18c91a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.000+0000 7f4cede00640 1 -- 172.21.15.18:0/3189750671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f18c593210 con 0x55f18c9253a0 2024-09-12T02:49:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.000+0000 7f4cede00640 1 --2- 172.21.15.18:0/3189750671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c9253a0 0x55f18c927790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009900 tx=0x7f4ce0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f84ecea01a876b16 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.001+0000 7f4ce7400640 1 -- 172.21.15.18:0/3189750671 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0035040 con 0x55f18c9253a0 2024-09-12T02:49:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.001+0000 7f4ce7400640 1 -- 172.21.15.18:0/3189750671 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ce0004760 con 0x55f18c9253a0 2024-09-12T02:49:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.001+0000 7f4ce7400640 1 -- 172.21.15.18:0/3189750671 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce00039b0 con 0x55f18c9253a0 2024-09-12T02:49:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.001+0000 7f4cefe00640 1 --2- 172.21.15.18:0/4124592759 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4cdc0a2e40 0x7f4cdc0a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.001+0000 7f4cefe00640 1 -- 172.21.15.18:0/4124592759 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f4ce80cfea0 con 0x7f4cf8103f30 2024-09-12T02:49:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.001+0000 7f4cf7200640 1 --2- 172.21.15.18:0/4124592759 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4cdc0a2e40 0x7f4cdc0a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.001+0000 7f4d003fd740 1 -- 172.21.15.18:0/3189750671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c9253a0 msgr2=0x55f18c927790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:00.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.001+0000 7f4d003fd740 1 --2- 172.21.15.18:0/3189750671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c9253a0 0x55f18c927790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009900 tx=0x7f4ce0000bc0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.001+0000 7f4d003fd740 1 -- 172.21.15.18:0/3189750671 shutdown_connections 2024-09-12T02:49:00.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.001+0000 7f4d003fd740 1 --2- 172.21.15.18:0/3189750671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c9253a0 0x55f18c927790 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.001+0000 7f4d003fd740 1 --2- 172.21.15.18:0/3189750671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c91ab00 0x55f18c924e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.001+0000 7f4d003fd740 1 --2- 172.21.15.18:0/3189750671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91a1e0 0x55f18c91a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.002+0000 7f4d003fd740 1 -- 172.21.15.18:0/3189750671 >> 172.21.15.18:0/3189750671 conn(0x55f18c916750 msgr2=0x55f18c916b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:00.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.002+0000 7f4d003fd740 1 -- 172.21.15.18:0/3189750671 shutdown_connections 2024-09-12T02:49:00.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.002+0000 7f4d003fd740 1 -- 172.21.15.18:0/3189750671 wait complete. 2024-09-12T02:49:00.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.002+0000 7f4cf7200640 1 --2- 172.21.15.18:0/4124592759 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4cdc0a2e40 0x7f4cdc0a5300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0005fd0 tx=0x7f4cf0009500 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:00.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.002+0000 7f4d003fd740 1 -- start start 2024-09-12T02:49:00.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.002+0000 7f4d003fd740 1 Processor -- start 2024-09-12T02:49:00.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.003+0000 7f4d003fd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c91a1e0 0x55f18c922340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.003+0000 7f4d003fd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91ab00 0x55f18c922880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.003+0000 7f4d003fd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c9253a0 0x55f18c922dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.003+0000 7f4d003fd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f18c927f70 con 0x55f18c91ab00 2024-09-12T02:49:00.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.003+0000 7f4d003fd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f18c809090 con 0x55f18c91a1e0 2024-09-12T02:49:00.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.003+0000 7f4d003fd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f18c9280f0 con 0x55f18c9253a0 2024-09-12T02:49:00.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.003+0000 7f4d003fd740 10 client.0 _ll_register_callbacks cb 0x55f18c85df30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:00.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.003+0000 7f4cf6800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c91a1e0 0x55f18c922340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.003+0000 7f4cf6800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c91a1e0 0x55f18c922340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:38008/0 (socket says 172.21.15.18:38008) 2024-09-12T02:49:00.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.003+0000 7f4cf6800640 1 -- 172.21.15.18:0/1990127231 learned_addr learned my addr 172.21.15.18:0/1990127231 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:00.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.003+0000 7f4cede00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91ab00 0x55f18c922880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.003+0000 7f4cf7200640 1 --2- 172.21.15.18:0/1990127231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c9253a0 0x55f18c922dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.003+0000 7f4cf6800640 1 -- 172.21.15.18:0/1990127231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c9253a0 msgr2=0x55f18c922dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:00.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.003+0000 7f4cf6800640 1 --2- 172.21.15.18:0/1990127231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c9253a0 0x55f18c922dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.004+0000 7f4cf6800640 1 -- 172.21.15.18:0/1990127231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91ab00 msgr2=0x55f18c922880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.004+0000 7f4cf6800640 1 --2- 172.21.15.18:0/1990127231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91ab00 0x55f18c922880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.004+0000 7f4cf6800640 1 -- 172.21.15.18:0/1990127231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f18c65f620 con 0x55f18c91a1e0 2024-09-12T02:49:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.004+0000 7f4cf7200640 1 --2- 172.21.15.18:0/1990127231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c9253a0 0x55f18c922dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.004+0000 7f4cf6800640 1 --2- 172.21.15.18:0/1990127231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c91a1e0 0x55f18c922340 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80cd1a0 tx=0x7f4ce8005730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83da54315633bbf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.004+0000 7f4cdbe00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:49:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.004+0000 7f4cdbe00640 1 -- 172.21.15.18:0/1990127231 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce809b790 con 0x55f18c91a1e0 2024-09-12T02:49:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.004+0000 7f4d003fd740 1 -- 172.21.15.18:0/1990127231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ce0004760 con 0x55f18c91a1e0 2024-09-12T02:49:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.004+0000 7f4cdbe00640 1 -- 172.21.15.18:0/1990127231 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f4ce80cd3c0 con 0x55f18c91a1e0 2024-09-12T02:49:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.004+0000 7f4cdbe00640 1 -- 172.21.15.18:0/1990127231 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4ce809c530 con 0x55f18c91a1e0 2024-09-12T02:49:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.004+0000 7f4d003fd740 10 client.25316 fetch_fsmap learned FSMap version 30 2024-09-12T02:49:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.004+0000 7f4d003fd740 1 -- 172.21.15.18:0/1990127231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f18c933c30 con 0x55f18c91a1e0 2024-09-12T02:49:00.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.004+0000 7f4cdbe00640 1 -- 172.21.15.18:0/1990127231 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ce0004760 con 0x55f18c91a1e0 2024-09-12T02:49:00.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.005+0000 7f4cdbe00640 1 -- 172.21.15.18:0/1990127231 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f4ce809b280 con 0x55f18c91a1e0 2024-09-12T02:49:00.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.005+0000 7f4d003fd740 10 client.25316 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T02:49:00.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.005+0000 7f4d003fd740 10 client.25316 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:00.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.005+0000 7f4d003fd740 20 client.25316 populate_metadata read hostname 'smithi018' 2024-09-12T02:49:00.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.005+0000 7f4d003fd740 1 --2- 172.21.15.18:0/1990127231 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55f18c9350f0 0x55f18c9374e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.005+0000 7f4d003fd740 4 client.25316 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:00.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.005+0000 7f4d003fd740 1 -- 172.21.15.18:0/1990127231 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f18c88d830 con 0x55f18c9350f0 2024-09-12T02:49:00.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.005+0000 7f4cede00640 1 --2- 172.21.15.18:0/1990127231 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55f18c9350f0 0x55f18c9374e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.005+0000 7f4cede00640 1 --2- 172.21.15.18:0/1990127231 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55f18c9350f0 0x55f18c9374e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff119ce5be64e442 server_cookie=a65e057033f89a37 in_seq=0 out_seq=0 2024-09-12T02:49:00.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.005+0000 7f4cdbe00640 10 client.25316 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:00.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.006+0000 7f4cdbe00640 1 -- 172.21.15.18:0/1990127231 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f18c88d830 con 0x55f18c9350f0 2024-09-12T02:49:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.006+0000 7f4cdbe00640 10 client.25316 handle_command_reply: tid=0 2024-09-12T02:49:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.006+0000 7f4d003fd740 1 client.25316 shutdown 2024-09-12T02:49:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.006+0000 7f4d003fd740 1 -- 172.21.15.18:0/1990127231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c91a1e0 msgr2=0x55f18c922340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.006+0000 7f4d003fd740 1 --2- 172.21.15.18:0/1990127231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c91a1e0 0x55f18c922340 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80cd1a0 tx=0x7f4ce8005730 comp rx=0 tx=0).stop 2024-09-12T02:49:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.007+0000 7f4d003fd740 1 -- 172.21.15.18:0/1990127231 shutdown_connections 2024-09-12T02:49:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.007+0000 7f4d003fd740 1 --2- 172.21.15.18:0/1990127231 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55f18c9350f0 0x55f18c9374e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.007+0000 7f4d003fd740 1 --2- 172.21.15.18:0/1990127231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c9253a0 0x55f18c922dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.007+0000 7f4d003fd740 1 --2- 172.21.15.18:0/1990127231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91ab00 0x55f18c922880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.007+0000 7f4d003fd740 1 --2- 172.21.15.18:0/1990127231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c91a1e0 0x55f18c922340 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.007+0000 7f4cdbe00640 0 client.25316 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.007+0000 7f4d003fd740 1 -- 172.21.15.18:0/1990127231 >> 172.21.15.18:0/1990127231 conn(0x55f18c916750 msgr2=0x55f18c91c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.007+0000 7f4d003fd740 1 -- 172.21.15.18:0/1990127231 shutdown_connections 2024-09-12T02:49:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.007+0000 7f4d003fd740 1 -- 172.21.15.18:0/1990127231 wait complete. 2024-09-12T02:49:00.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.007+0000 7f4d003fd740 20 client.25316 trim_cache size 0 max 16384 2024-09-12T02:49:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.022+0000 7f4d003fd740 1 Processor -- start 2024-09-12T02:49:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.022+0000 7f4d003fd740 1 -- start start 2024-09-12T02:49:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.022+0000 7f4d003fd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c91a1e0 0x55f18c9241a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.022+0000 7f4d003fd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91ab00 0x55f18c93cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.022+0000 7f4d003fd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c9253a0 0x55f18c93d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.022+0000 7f4d003fd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf81b1180 con 0x55f18c91ab00 2024-09-12T02:49:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.022+0000 7f4d003fd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf81b2cc0 con 0x55f18c91a1e0 2024-09-12T02:49:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.022+0000 7f4d003fd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf81b1850 con 0x55f18c9253a0 2024-09-12T02:49:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.023+0000 7f4cf6800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c91a1e0 0x55f18c9241a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.023+0000 7f4cf6800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c91a1e0 0x55f18c9241a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:38012/0 (socket says 172.21.15.18:38012) 2024-09-12T02:49:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.023+0000 7f4cf6800640 1 -- 172.21.15.18:0/2839077218 learned_addr learned my addr 172.21.15.18:0/2839077218 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.023+0000 7f4cede00640 1 --2- 172.21.15.18:0/2839077218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91ab00 0x55f18c93cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.023+0000 7f4cf7200640 1 --2- 172.21.15.18:0/2839077218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c9253a0 0x55f18c93d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.023+0000 7f4cf6800640 1 -- 172.21.15.18:0/2839077218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c9253a0 msgr2=0x55f18c93d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.023+0000 7f4cf6800640 1 --2- 172.21.15.18:0/2839077218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c9253a0 0x55f18c93d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.023+0000 7f4cf6800640 1 -- 172.21.15.18:0/2839077218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91ab00 msgr2=0x55f18c93cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.023+0000 7f4cf6800640 1 --2- 172.21.15.18:0/2839077218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91ab00 0x55f18c93cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.023+0000 7f4cf6800640 1 -- 172.21.15.18:0/2839077218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f18c91a000 con 0x55f18c91a1e0 2024-09-12T02:49:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.023+0000 7f4cf6800640 1 --2- 172.21.15.18:0/2839077218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c91a1e0 0x55f18c9241a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8098290 tx=0x7f4ce800cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82605004f8cc01b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.023+0000 7f4ce6a00640 1 -- 172.21.15.18:0/2839077218 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce809b790 con 0x55f18c91a1e0 2024-09-12T02:49:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.023+0000 7f4ce6a00640 1 -- 172.21.15.18:0/2839077218 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ce80a01e0 con 0x55f18c91a1e0 2024-09-12T02:49:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.023+0000 7f4ce6a00640 1 -- 172.21.15.18:0/2839077218 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce809b280 con 0x55f18c91a1e0 2024-09-12T02:49:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.024+0000 7f4d003fd740 1 -- 172.21.15.18:0/2839077218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c91a1e0 msgr2=0x55f18c9241a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.024+0000 7f4d003fd740 1 --2- 172.21.15.18:0/2839077218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c91a1e0 0x55f18c9241a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8098290 tx=0x7f4ce800cf60 comp rx=0 tx=0).stop 2024-09-12T02:49:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.024+0000 7f4d003fd740 1 -- 172.21.15.18:0/2839077218 shutdown_connections 2024-09-12T02:49:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.024+0000 7f4d003fd740 1 --2- 172.21.15.18:0/2839077218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c9253a0 0x55f18c93d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.024+0000 7f4d003fd740 1 --2- 172.21.15.18:0/2839077218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91ab00 0x55f18c93cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.024+0000 7f4d003fd740 1 --2- 172.21.15.18:0/2839077218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c91a1e0 0x55f18c9241a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.024+0000 7f4d003fd740 1 -- 172.21.15.18:0/2839077218 >> 172.21.15.18:0/2839077218 conn(0x55f18c916750 msgr2=0x55f18c923a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.024+0000 7f4d003fd740 1 -- 172.21.15.18:0/2839077218 shutdown_connections 2024-09-12T02:49:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.024+0000 7f4d003fd740 1 -- 172.21.15.18:0/2839077218 wait complete. 2024-09-12T02:49:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.025+0000 7f4d003fd740 1 -- start start 2024-09-12T02:49:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.025+0000 7f4d003fd740 1 Processor -- start 2024-09-12T02:49:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.025+0000 7f4d003fd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c91a1e0 0x55f18c92d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.025+0000 7f4d003fd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91ab00 0x55f18c92da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.025+0000 7f4d003fd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c9253a0 0x55f18c91eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.025+0000 7f4d003fd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf81b25f0 con 0x55f18c91ab00 2024-09-12T02:49:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.025+0000 7f4d003fd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf81b1f20 con 0x55f18c9253a0 2024-09-12T02:49:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.025+0000 7f4d003fd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf81af160 con 0x55f18c91a1e0 2024-09-12T02:49:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.025+0000 7f4d003fd740 10 client.0 _ll_register_callbacks cb 0x7f4ce80d3640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.025+0000 7f4cede00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91ab00 0x55f18c92da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.025+0000 7f4cf6800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c91a1e0 0x55f18c92d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.026+0000 7f4cf7200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c9253a0 0x55f18c91eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.026+0000 7f4cf6800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c91a1e0 0x55f18c92d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:42512/0 (socket says 172.21.15.18:42512) 2024-09-12T02:49:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.026+0000 7f4cede00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91ab00 0x55f18c92da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49760/0 (socket says 172.21.15.18:49760) 2024-09-12T02:49:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.026+0000 7f4cf6800640 1 -- 172.21.15.18:0/3290498883 learned_addr learned my addr 172.21.15.18:0/3290498883 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.026+0000 7f4cede00640 1 -- 172.21.15.18:0/3290498883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c91a1e0 msgr2=0x55f18c92d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.026+0000 7f4cede00640 1 --2- 172.21.15.18:0/3290498883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c91a1e0 0x55f18c92d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.026+0000 7f4cede00640 1 -- 172.21.15.18:0/3290498883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c9253a0 msgr2=0x55f18c91eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.026+0000 7f4cede00640 1 --2- 172.21.15.18:0/3290498883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c9253a0 0x55f18c91eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.026+0000 7f4cede00640 1 -- 172.21.15.18:0/3290498883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f18c91f350 con 0x55f18c91ab00 2024-09-12T02:49:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.026+0000 7f4cf7200640 1 --2- 172.21.15.18:0/3290498883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c9253a0 0x55f18c91eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.026+0000 7f4cede00640 1 --2- 172.21.15.18:0/3290498883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91ab00 0x55f18c92da70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4ce002a910 tx=0x7f4ce0004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92fc4fab99ed0d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.026+0000 7f4cdbe00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:49:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.026+0000 7f4cdbe00640 1 -- 172.21.15.18:0/3290498883 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0035040 con 0x55f18c91ab00 2024-09-12T02:49:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.027+0000 7f4d003fd740 1 -- 172.21.15.18:0/3290498883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ce80a01e0 con 0x55f18c91ab00 2024-09-12T02:49:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.027+0000 7f4cdbe00640 1 -- 172.21.15.18:0/3290498883 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f4ce0004fd0 con 0x55f18c91ab00 2024-09-12T02:49:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.027+0000 7f4cdbe00640 1 -- 172.21.15.18:0/3290498883 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4ce0060050 con 0x55f18c91ab00 2024-09-12T02:49:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.027+0000 7f4d003fd740 10 client.15321 fetch_fsmap learned FSMap version 30 2024-09-12T02:49:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.027+0000 7f4d003fd740 1 -- 172.21.15.18:0/3290498883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f18c99f8e0 con 0x55f18c91ab00 2024-09-12T02:49:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.027+0000 7f4cdbe00640 1 -- 172.21.15.18:0/3290498883 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ce80a01e0 con 0x55f18c91ab00 2024-09-12T02:49:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.027+0000 7f4cdbe00640 1 -- 172.21.15.18:0/3290498883 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f4ce0003c70 con 0x55f18c91ab00 2024-09-12T02:49:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.027+0000 7f4d003fd740 10 client.15321 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T02:49:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.027+0000 7f4d003fd740 10 client.15321 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.027+0000 7f4d003fd740 20 client.15321 populate_metadata read hostname 'smithi018' 2024-09-12T02:49:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.027+0000 7f4d003fd740 1 --2- 172.21.15.18:0/3290498883 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55f18c99fc20 0x55f18c9a2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.027+0000 7f4d003fd740 4 client.15321 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:49:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.027+0000 7f4d003fd740 1 -- 172.21.15.18:0/3290498883 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f18c887b80 con 0x55f18c99fc20 2024-09-12T02:49:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.028+0000 7f4cf6800640 1 --2- 172.21.15.18:0/3290498883 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55f18c99fc20 0x55f18c9a2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.028+0000 7f4cf6800640 1 --2- 172.21.15.18:0/3290498883 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55f18c99fc20 0x55f18c9a2040 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca24d07b45569464 server_cookie=54fdce7d7209468e in_seq=0 out_seq=0 2024-09-12T02:49:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.028+0000 7f4cdbe00640 10 client.15321 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.041+0000 7f4cdbe00640 1 -- 172.21.15.18:0/3290498883 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f18c887b80 con 0x55f18c99fc20 2024-09-12T02:49:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.041+0000 7f4cdbe00640 10 client.15321 handle_command_reply: tid=0 2024-09-12T02:49:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.041+0000 7f4d003fd740 1 client.15321 shutdown 2024-09-12T02:49:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.041+0000 7f4d003fd740 1 -- 172.21.15.18:0/3290498883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91ab00 msgr2=0x55f18c92da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.041+0000 7f4d003fd740 1 --2- 172.21.15.18:0/3290498883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91ab00 0x55f18c92da70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4ce002a910 tx=0x7f4ce0004f60 comp rx=0 tx=0).stop 2024-09-12T02:49:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.041+0000 7f4d003fd740 1 -- 172.21.15.18:0/3290498883 shutdown_connections 2024-09-12T02:49:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.041+0000 7f4d003fd740 1 --2- 172.21.15.18:0/3290498883 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55f18c99fc20 0x55f18c9a2040 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.041+0000 7f4d003fd740 1 --2- 172.21.15.18:0/3290498883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f18c9253a0 0x55f18c91eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.041+0000 7f4d003fd740 1 --2- 172.21.15.18:0/3290498883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f18c91ab00 0x55f18c92da70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.041+0000 7f4d003fd740 1 --2- 172.21.15.18:0/3290498883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f18c91a1e0 0x55f18c92d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.041+0000 7f4cdbe00640 0 client.15321 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.041+0000 7f4d003fd740 1 -- 172.21.15.18:0/3290498883 >> 172.21.15.18:0/3290498883 conn(0x55f18c916750 msgr2=0x55f18c91bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.041+0000 7f4d003fd740 1 -- 172.21.15.18:0/3290498883 shutdown_connections 2024-09-12T02:49:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.041+0000 7f4d003fd740 1 -- 172.21.15.18:0/3290498883 wait complete. 2024-09-12T02:49:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.041+0000 7f4d003fd740 20 client.15321 trim_cache size 0 max 16384 2024-09-12T02:49:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:49:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:49:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:49:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:49:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.042+0000 7f4cfd400640 1 -- 172.21.15.18:0/4124592759 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4cdc0a2e40 msgr2=0x7f4cdc0a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.042+0000 7f4cfd400640 1 --2- 172.21.15.18:0/4124592759 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4cdc0a2e40 0x7f4cdc0a5300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0005fd0 tx=0x7f4cf0009500 comp rx=0 tx=0).stop 2024-09-12T02:49:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.042+0000 7f4cfd400640 1 -- 172.21.15.18:0/4124592759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf8103f30 msgr2=0x7f4cf819a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.042+0000 7f4cfd400640 1 --2- 172.21.15.18:0/4124592759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf8103f30 0x7f4cf819a5c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800e9f0 tx=0x7f4ce800edf0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.042+0000 7f4cfd400640 1 -- 172.21.15.18:0/4124592759 shutdown_connections 2024-09-12T02:49:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.042+0000 7f4cfd400640 1 --2- 172.21.15.18:0/4124592759 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4cdc0a2e40 0x7f4cdc0a5300 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.042+0000 7f4cfd400640 1 --2- 172.21.15.18:0/4124592759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cf819ee80 0x7f4cf819f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.042+0000 7f4cfd400640 1 --2- 172.21.15.18:0/4124592759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf8109080 0x7f4cf819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.042+0000 7f4cfd400640 1 --2- 172.21.15.18:0/4124592759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf8103f30 0x7f4cf819a5c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.042+0000 7f4cfd400640 1 -- 172.21.15.18:0/4124592759 >> 172.21.15.18:0/4124592759 conn(0x7f4cf80ff980 msgr2=0x7f4cf8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.042+0000 7f4cfd400640 1 -- 172.21.15.18:0/4124592759 shutdown_connections 2024-09-12T02:49:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:00.042+0000 7f4cfd400640 1 -- 172.21.15.18:0/4124592759 wait complete. 2024-09-12T02:49:01.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:00 smithi062 ceph-mon[35527]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-12T02:49:01.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:00 smithi018 ceph-mon[30616]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-12T02:49:01.101 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:49:00 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:49:00.810+0000 7fea0da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:49:01.101 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:49:00 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:49:00.810+0000 7fea0da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:49:01.101 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:49:00 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:49:00.810+0000 7fea0da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:49:01.101 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:49:00 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:49:00.810+0000 7fea0da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:49:01.101 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 02:49:00 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T02:49:00.810+0000 7fea0da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:49:01.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:00 smithi176 ceph-mon[35713]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-12T02:49:03.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:02 smithi062 ceph-mon[35527]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 54 op/s 2024-09-12T02:49:03.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:02 smithi062 ceph-mon[35527]: mgrmap e26: x(active, since 18s), standbys: z, y 2024-09-12T02:49:03.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:02 smithi018 ceph-mon[30616]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 54 op/s 2024-09-12T02:49:03.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:02 smithi018 ceph-mon[30616]: mgrmap e26: x(active, since 18s), standbys: z, y 2024-09-12T02:49:03.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:02 smithi176 ceph-mon[35713]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 54 op/s 2024-09-12T02:49:03.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:02 smithi176 ceph-mon[35713]: mgrmap e26: x(active, since 18s), standbys: z, y 2024-09-12T02:49:05.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:04 smithi062 ceph-mon[35527]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:49:05.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:04 smithi018 ceph-mon[30616]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:49:05.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:04 smithi176 ceph-mon[35713]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:49:07.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:06 smithi062 ceph-mon[35527]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 32 op/s 2024-09-12T02:49:07.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:06 smithi018 ceph-mon[30616]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 32 op/s 2024-09-12T02:49:07.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:06 smithi176 ceph-mon[35713]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 32 op/s 2024-09-12T02:49:08.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:08 smithi018 ceph-mon[30616]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-09-12T02:49:08.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:08 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:49:09.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:08 smithi062 ceph-mon[35527]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-09-12T02:49:09.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:08 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:49:09.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:08 smithi176 ceph-mon[35713]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-09-12T02:49:09.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:08 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:49:11.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:10 smithi062 ceph-mon[35527]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-09-12T02:49:11.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:10 smithi018 ceph-mon[30616]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-09-12T02:49:11.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:10 smithi176 ceph-mon[35713]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-09-12T02:49:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:12 smithi062 ceph-mon[35527]: pgmap v17: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 KiB/s wr, 33 op/s 2024-09-12T02:49:13.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:12 smithi018 ceph-mon[30616]: pgmap v17: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 KiB/s wr, 33 op/s 2024-09-12T02:49:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.159+0000 7efcf0e00640 1 -- 172.21.15.18:0/1607165910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcec112af0 msgr2=0x7efcec114ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.159+0000 7efcf0e00640 1 --2- 172.21.15.18:0/1607165910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcec112af0 0x7efcec114ee0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efce4009ca0 tx=0x7efce402a950 comp rx=0 tx=0).stop 2024-09-12T02:49:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.159+0000 7efcf0e00640 1 -- 172.21.15.18:0/1607165910 shutdown_connections 2024-09-12T02:49:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.159+0000 7efcf0e00640 1 --2- 172.21.15.18:0/1607165910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcec112af0 0x7efcec114ee0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.159+0000 7efcf0e00640 1 --2- 172.21.15.18:0/1607165910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcec074eb0 0x7efcec1125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.159+0000 7efcf0e00640 1 --2- 172.21.15.18:0/1607165910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcec074590 0x7efcec074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.159+0000 7efcf0e00640 1 -- 172.21.15.18:0/1607165910 >> 172.21.15.18:0/1607165910 conn(0x7efcec0fd7e0 msgr2=0x7efcec0ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.159+0000 7efcf0e00640 1 -- 172.21.15.18:0/1607165910 shutdown_connections 2024-09-12T02:49:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.159+0000 7efcf0e00640 1 -- 172.21.15.18:0/1607165910 wait complete. 2024-09-12T02:49:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.161+0000 7efcf0e00640 1 Processor -- start 2024-09-12T02:49:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.161+0000 7efcf0e00640 1 -- start start 2024-09-12T02:49:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.161+0000 7efcf0e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcec074590 0x7efcec1a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.161+0000 7efcf0e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcec074eb0 0x7efcec1a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.161+0000 7efcf0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcec112af0 0x7efcec19e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.162+0000 7efcf0e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efcec118520 con 0x7efcec112af0 2024-09-12T02:49:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.162+0000 7efcf0e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efcec1183a0 con 0x7efcec074590 2024-09-12T02:49:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.162+0000 7efcf0e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efcec1186a0 con 0x7efcec074eb0 2024-09-12T02:49:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.162+0000 7efcea800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcec112af0 0x7efcec19e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.162+0000 7efce9e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcec074590 0x7efcec1a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.162+0000 7efce9e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcec074590 0x7efcec1a4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:44330/0 (socket says 172.21.15.18:44330) 2024-09-12T02:49:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.162+0000 7efce9e00640 1 -- 172.21.15.18:0/4251175406 learned_addr learned my addr 172.21.15.18:0/4251175406 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.162+0000 7efce3e00640 1 --2- 172.21.15.18:0/4251175406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcec074eb0 0x7efcec1a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.162+0000 7efce9e00640 1 -- 172.21.15.18:0/4251175406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcec074eb0 msgr2=0x7efcec1a4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.162+0000 7efce9e00640 1 --2- 172.21.15.18:0/4251175406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcec074eb0 0x7efcec1a4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.162+0000 7efce9e00640 1 -- 172.21.15.18:0/4251175406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcec112af0 msgr2=0x7efcec19e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.162+0000 7efce9e00640 1 --2- 172.21.15.18:0/4251175406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcec112af0 0x7efcec19e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.162+0000 7efce9e00640 1 -- 172.21.15.18:0/4251175406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcec19ef50 con 0x7efcec074590 2024-09-12T02:49:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.163+0000 7efce9e00640 1 --2- 172.21.15.18:0/4251175406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcec074590 0x7efcec1a4610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00e9f0 tx=0x7efcdc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.163+0000 7efce2a00640 1 -- 172.21.15.18:0/4251175406 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcdc00cd80 con 0x7efcec074590 2024-09-12T02:49:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.163+0000 7efce2a00640 1 -- 172.21.15.18:0/4251175406 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcdc010910 con 0x7efcec074590 2024-09-12T02:49:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.163+0000 7efcf0e00640 1 -- 172.21.15.18:0/4251175406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcec19f240 con 0x7efcec074590 2024-09-12T02:49:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.163+0000 7efce2a00640 1 -- 172.21.15.18:0/4251175406 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcdc018990 con 0x7efcec074590 2024-09-12T02:49:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.163+0000 7efcf0e00640 1 -- 172.21.15.18:0/4251175406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcec1ab460 con 0x7efcec074590 2024-09-12T02:49:13.176 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.166+0000 7efcf3e81740 1 Processor -- start 2024-09-12T02:49:13.176 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.166+0000 7efcf3e81740 1 -- start start 2024-09-12T02:49:13.176 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.166+0000 7efcf3e81740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4591e0 0x55bfde4595c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.176 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.166+0000 7efcf3e81740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 0x55bfde463e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.176 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.166+0000 7efcf3e81740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4643a0 0x55bfde466790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.176 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.166+0000 7efcf3e81740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bfde3bf100 con 0x55bfde4591e0 2024-09-12T02:49:13.176 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.166+0000 7efcf3e81740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bfde3671b0 con 0x55bfde459b00 2024-09-12T02:49:13.176 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.166+0000 7efcf3e81740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55bfde3bb0c0 con 0x55bfde4643a0 2024-09-12T02:49:13.177 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.167+0000 7efcea800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4591e0 0x55bfde4595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.177 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.167+0000 7efce2a00640 1 -- 172.21.15.18:0/4251175406 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 26) ==== 138066+0+0 (secure 0 0 0) 0x7efcdc010ac0 con 0x7efcec074590 2024-09-12T02:49:13.177 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.167+0000 7efcea800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4591e0 0x55bfde4595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43428/0 (socket says 172.21.15.18:43428) 2024-09-12T02:49:13.177 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.167+0000 7efcea800640 1 -- 172.21.15.18:0/1469099000 learned_addr learned my addr 172.21.15.18:0/1469099000 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:13.177 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.167+0000 7efce3e00640 1 --2- 172.21.15.18:0/1469099000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4643a0 0x55bfde466790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.177 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.167+0000 7efce9e00640 1 --2- 172.21.15.18:0/1469099000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 0x55bfde463e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.177 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.167+0000 7efcea800640 1 -- 172.21.15.18:0/1469099000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4643a0 msgr2=0x55bfde466790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:13.177 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.167+0000 7efcea800640 1 --2- 172.21.15.18:0/1469099000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4643a0 0x55bfde466790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.177 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.167+0000 7efcea800640 1 -- 172.21.15.18:0/1469099000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 msgr2=0x55bfde463e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:13.177 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.167+0000 7efcea800640 1 --2- 172.21.15.18:0/1469099000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 0x55bfde463e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.167+0000 7efcea800640 1 -- 172.21.15.18:0/1469099000 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfde0d2210 con 0x55bfde4591e0 2024-09-12T02:49:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.168+0000 7efcea800640 1 --2- 172.21.15.18:0/1469099000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4591e0 0x55bfde4595c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efce4009ca0 tx=0x7efce4005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba9a5364e971078 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.168+0000 7efcdb400640 1 -- 172.21.15.18:0/1469099000 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce4048070 con 0x55bfde4591e0 2024-09-12T02:49:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.168+0000 7efcdb400640 1 -- 172.21.15.18:0/1469099000 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efce4003e50 con 0x55bfde4591e0 2024-09-12T02:49:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.168+0000 7efcdb400640 1 -- 172.21.15.18:0/1469099000 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce4034040 con 0x55bfde4591e0 2024-09-12T02:49:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.169+0000 7efce2a00640 1 --2- 172.21.15.18:0/4251175406 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efcd00a2ec0 0x7efcd00a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.169+0000 7efcf3e81740 1 -- 172.21.15.18:0/1469099000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4591e0 msgr2=0x55bfde4595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.169+0000 7efcf3e81740 1 --2- 172.21.15.18:0/1469099000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4591e0 0x55bfde4595c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efce4009ca0 tx=0x7efce4005f80 comp rx=0 tx=0).stop 2024-09-12T02:49:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.169+0000 7efce2a00640 1 -- 172.21.15.18:0/4251175406 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7efcdc0cfe40 con 0x7efcec074590 2024-09-12T02:49:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.169+0000 7efcf3e81740 1 -- 172.21.15.18:0/1469099000 shutdown_connections 2024-09-12T02:49:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.169+0000 7efcf3e81740 1 --2- 172.21.15.18:0/1469099000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4643a0 0x55bfde466790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.169+0000 7efcf3e81740 1 --2- 172.21.15.18:0/1469099000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 0x55bfde463e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.169+0000 7efcf3e81740 1 --2- 172.21.15.18:0/1469099000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4591e0 0x55bfde4595c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.169+0000 7efcf3e81740 1 -- 172.21.15.18:0/1469099000 >> 172.21.15.18:0/1469099000 conn(0x55bfde455750 msgr2=0x55bfde455b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.169+0000 7efce9e00640 1 --2- 172.21.15.18:0/4251175406 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efcd00a2ec0 0x7efcd00a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.169+0000 7efcf3e81740 1 -- 172.21.15.18:0/1469099000 shutdown_connections 2024-09-12T02:49:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.169+0000 7efcf3e81740 1 -- 172.21.15.18:0/1469099000 wait complete. 2024-09-12T02:49:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.170+0000 7efcf3e81740 1 -- start start 2024-09-12T02:49:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.170+0000 7efce9e00640 1 --2- 172.21.15.18:0/4251175406 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efcd00a2ec0 0x7efcd00a5380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0cd050 tx=0x7efcdc000bc0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.170+0000 7efcf3e81740 1 Processor -- start 2024-09-12T02:49:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.171+0000 7efcf3e81740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4591e0 0x55bfde4613a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.171+0000 7efcf3e81740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 0x55bfde4618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.171+0000 7efcf3e81740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4643a0 0x55bfde461e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.171+0000 7efcf3e81740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bfde466f70 con 0x55bfde4643a0 2024-09-12T02:49:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.171+0000 7efcf3e81740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bfde348090 con 0x55bfde459b00 2024-09-12T02:49:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.171+0000 7efcf3e81740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55bfde4670f0 con 0x55bfde4591e0 2024-09-12T02:49:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.171+0000 7efcf3e81740 10 client.0 _ll_register_callbacks cb 0x55bfde39cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.171+0000 7efcea800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4643a0 0x55bfde461e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.171+0000 7efcea800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4643a0 0x55bfde461e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43440/0 (socket says 172.21.15.18:43440) 2024-09-12T02:49:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.171+0000 7efcea800640 1 -- 172.21.15.18:0/3694080921 learned_addr learned my addr 172.21.15.18:0/3694080921 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.171+0000 7efce3e00640 1 --2- 172.21.15.18:0/3694080921 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 0x55bfde4618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.171+0000 7efcea800640 1 --2- 172.21.15.18:0/3694080921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4591e0 0x55bfde4613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.172+0000 7efce3e00640 1 -- 172.21.15.18:0/3694080921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4591e0 msgr2=0x55bfde4613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.172+0000 7efce3e00640 1 --2- 172.21.15.18:0/3694080921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4591e0 0x55bfde4613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.172+0000 7efce3e00640 1 -- 172.21.15.18:0/3694080921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4643a0 msgr2=0x55bfde461e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.172+0000 7efce3e00640 1 --2- 172.21.15.18:0/3694080921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4643a0 0x55bfde461e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.172+0000 7efce3e00640 1 -- 172.21.15.18:0/3694080921 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfde19e620 con 0x55bfde459b00 2024-09-12T02:49:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.172+0000 7efce3e00640 1 --2- 172.21.15.18:0/3694080921 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 0x55bfde4618e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efcec0ffd00 tx=0x7efcd4012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87a25835c81336a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.172+0000 7efccfe00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:49:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.172+0000 7efccfe00640 1 -- 172.21.15.18:0/3694080921 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd400f8f0 con 0x55bfde459b00 2024-09-12T02:49:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.172+0000 7efccfe00640 1 -- 172.21.15.18:0/3694080921 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7efcd400fa90 con 0x55bfde459b00 2024-09-12T02:49:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.172+0000 7efcf3e81740 1 -- 172.21.15.18:0/3694080921 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efce4003e50 con 0x55bfde459b00 2024-09-12T02:49:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.173+0000 7efccfe00640 1 -- 172.21.15.18:0/3694080921 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7efcd400fc90 con 0x55bfde459b00 2024-09-12T02:49:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.173+0000 7efcf3e81740 10 client.25340 fetch_fsmap learned FSMap version 32 2024-09-12T02:49:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.173+0000 7efcf3e81740 1 -- 172.21.15.18:0/3694080921 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bfde472c80 con 0x55bfde459b00 2024-09-12T02:49:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.173+0000 7efccfe00640 1 -- 172.21.15.18:0/3694080921 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efce4003e50 con 0x55bfde459b00 2024-09-12T02:49:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.173+0000 7efccfe00640 1 -- 172.21.15.18:0/3694080921 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7efcd40104c0 con 0x55bfde459b00 2024-09-12T02:49:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.173+0000 7efcf3e81740 10 client.25340 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T02:49:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.173+0000 7efcf3e81740 10 client.25340 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.173+0000 7efcf3e81740 20 client.25340 populate_metadata read hostname 'smithi018' 2024-09-12T02:49:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.173+0000 7efcf3e81740 1 --2- 172.21.15.18:0/3694080921 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bfde474200 0x55bfde476620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.173+0000 7efcf3e81740 4 client.25340 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.173+0000 7efcf3e81740 1 -- 172.21.15.18:0/3694080921 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfde3cc830 con 0x55bfde474200 2024-09-12T02:49:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.174+0000 7efcea800640 1 --2- 172.21.15.18:0/3694080921 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bfde474200 0x55bfde476620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.174+0000 7efcea800640 1 --2- 172.21.15.18:0/3694080921 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bfde474200 0x55bfde476620 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e879cb638671e69 server_cookie=70fe413dc4e35212 in_seq=0 out_seq=0 2024-09-12T02:49:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.174+0000 7efccfe00640 10 client.25340 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.175+0000 7efccfe00640 1 -- 172.21.15.18:0/3694080921 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bfde3cc830 con 0x55bfde474200 2024-09-12T02:49:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.175+0000 7efccfe00640 10 client.25340 handle_command_reply: tid=0 2024-09-12T02:49:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.175+0000 7efcf3e81740 1 client.25340 shutdown 2024-09-12T02:49:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.175+0000 7efcf3e81740 1 -- 172.21.15.18:0/3694080921 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 msgr2=0x55bfde4618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.175+0000 7efcf3e81740 1 --2- 172.21.15.18:0/3694080921 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 0x55bfde4618e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efcec0ffd00 tx=0x7efcd4012b60 comp rx=0 tx=0).stop 2024-09-12T02:49:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.175+0000 7efcf3e81740 1 -- 172.21.15.18:0/3694080921 shutdown_connections 2024-09-12T02:49:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.175+0000 7efcf3e81740 1 --2- 172.21.15.18:0/3694080921 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bfde474200 0x55bfde476620 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.175+0000 7efcf3e81740 1 --2- 172.21.15.18:0/3694080921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4643a0 0x55bfde461e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.175+0000 7efcf3e81740 1 --2- 172.21.15.18:0/3694080921 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 0x55bfde4618e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.175+0000 7efcf3e81740 1 --2- 172.21.15.18:0/3694080921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4591e0 0x55bfde4613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.175+0000 7efccfe00640 0 client.25340 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.175+0000 7efcf3e81740 1 -- 172.21.15.18:0/3694080921 >> 172.21.15.18:0/3694080921 conn(0x55bfde455750 msgr2=0x55bfde45b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.176+0000 7efcf3e81740 1 -- 172.21.15.18:0/3694080921 shutdown_connections 2024-09-12T02:49:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.176+0000 7efcf3e81740 1 -- 172.21.15.18:0/3694080921 wait complete. 2024-09-12T02:49:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.176+0000 7efcf3e81740 20 client.25340 trim_cache size 0 max 16384 2024-09-12T02:49:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.191+0000 7efcf3e81740 1 Processor -- start 2024-09-12T02:49:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.191+0000 7efcf3e81740 1 -- start start 2024-09-12T02:49:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.191+0000 7efcf3e81740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde4591e0 0x55bfde463200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.191+0000 7efcf3e81740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde459b00 0x55bfde47bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.191+0000 7efcf3e81740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4643a0 0x55bfde47c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.191+0000 7efcf3e81740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efcec1b5600 con 0x55bfde459b00 2024-09-12T02:49:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.191+0000 7efcf3e81740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efcec1b71a0 con 0x55bfde4591e0 2024-09-12T02:49:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.191+0000 7efcf3e81740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efcec1b5cd0 con 0x55bfde4643a0 2024-09-12T02:49:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.191+0000 7efce3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde459b00 0x55bfde47bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.192+0000 7efce3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde459b00 0x55bfde47bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43454/0 (socket says 172.21.15.18:43454) 2024-09-12T02:49:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.192+0000 7efce3e00640 1 -- 172.21.15.18:0/2657495627 learned_addr learned my addr 172.21.15.18:0/2657495627 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.192+0000 7efcea800640 1 --2- 172.21.15.18:0/2657495627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde4591e0 0x55bfde463200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.192+0000 7efcea800640 1 --2- 172.21.15.18:0/2657495627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4643a0 0x55bfde47c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.192+0000 7efce3e00640 1 -- 172.21.15.18:0/2657495627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4643a0 msgr2=0x55bfde47c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.192+0000 7efce3e00640 1 --2- 172.21.15.18:0/2657495627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4643a0 0x55bfde47c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.192+0000 7efce3e00640 1 -- 172.21.15.18:0/2657495627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde4591e0 msgr2=0x55bfde463200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.192+0000 7efce3e00640 1 --2- 172.21.15.18:0/2657495627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde4591e0 0x55bfde463200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.192+0000 7efce3e00640 1 -- 172.21.15.18:0/2657495627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfde450d60 con 0x55bfde459b00 2024-09-12T02:49:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.192+0000 7efce3e00640 1 --2- 172.21.15.18:0/2657495627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde459b00 0x55bfde47bef0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efcd4010960 tx=0x7efcd4005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753e4fd9c6e16386 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.193+0000 7efcdaa00640 1 -- 172.21.15.18:0/2657495627 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd4000e60 con 0x55bfde459b00 2024-09-12T02:49:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.193+0000 7efcdaa00640 1 -- 172.21.15.18:0/2657495627 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcd4009dc0 con 0x55bfde459b00 2024-09-12T02:49:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.193+0000 7efcdaa00640 1 -- 172.21.15.18:0/2657495627 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd4010430 con 0x55bfde459b00 2024-09-12T02:49:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.193+0000 7efcf3e81740 1 -- 172.21.15.18:0/2657495627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde459b00 msgr2=0x55bfde47bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.193+0000 7efcf3e81740 1 --2- 172.21.15.18:0/2657495627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde459b00 0x55bfde47bef0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efcd4010960 tx=0x7efcd4005e30 comp rx=0 tx=0).stop 2024-09-12T02:49:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.193+0000 7efcf3e81740 1 -- 172.21.15.18:0/2657495627 shutdown_connections 2024-09-12T02:49:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.193+0000 7efcf3e81740 1 --2- 172.21.15.18:0/2657495627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4643a0 0x55bfde47c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.193+0000 7efcf3e81740 1 --2- 172.21.15.18:0/2657495627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde459b00 0x55bfde47bef0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.193+0000 7efcf3e81740 1 --2- 172.21.15.18:0/2657495627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde4591e0 0x55bfde463200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.193+0000 7efcf3e81740 1 -- 172.21.15.18:0/2657495627 >> 172.21.15.18:0/2657495627 conn(0x55bfde455750 msgr2=0x55bfde462af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.194+0000 7efcf3e81740 1 -- 172.21.15.18:0/2657495627 shutdown_connections 2024-09-12T02:49:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.194+0000 7efcf3e81740 1 -- 172.21.15.18:0/2657495627 wait complete. 2024-09-12T02:49:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.194+0000 7efcf3e81740 1 -- start start 2024-09-12T02:49:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.194+0000 7efcf3e81740 1 Processor -- start 2024-09-12T02:49:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.195+0000 7efcf3e81740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4591e0 0x55bfde46cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.195+0000 7efcf3e81740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 0x55bfde45e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.195+0000 7efcf3e81740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4643a0 0x55bfde45e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.195+0000 7efcf3e81740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efcec1b6a70 con 0x55bfde4643a0 2024-09-12T02:49:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.195+0000 7efcf3e81740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efcec1b63a0 con 0x55bfde459b00 2024-09-12T02:49:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.195+0000 7efcf3e81740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efcec1b35e0 con 0x55bfde4591e0 2024-09-12T02:49:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.195+0000 7efcf3e81740 10 client.0 _ll_register_callbacks cb 0x7efcd4009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.195+0000 7efcea800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4591e0 0x55bfde46cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.195+0000 7efce3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 0x55bfde45e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.195+0000 7efcea800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4643a0 0x55bfde45e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.195+0000 7efce3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 0x55bfde45e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:44362/0 (socket says 172.21.15.18:44362) 2024-09-12T02:49:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.195+0000 7efce3e00640 1 -- 172.21.15.18:0/342670318 learned_addr learned my addr 172.21.15.18:0/342670318 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.196+0000 7efce3e00640 1 -- 172.21.15.18:0/342670318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4591e0 msgr2=0x55bfde46cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.196+0000 7efce3e00640 1 --2- 172.21.15.18:0/342670318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4591e0 0x55bfde46cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.196+0000 7efce3e00640 1 -- 172.21.15.18:0/342670318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4643a0 msgr2=0x55bfde45e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.196+0000 7efce3e00640 1 --2- 172.21.15.18:0/342670318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4643a0 0x55bfde45e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.196+0000 7efce3e00640 1 -- 172.21.15.18:0/342670318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfde4ddec0 con 0x55bfde459b00 2024-09-12T02:49:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.196+0000 7efcea800640 1 --2- 172.21.15.18:0/342670318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4643a0 0x55bfde45e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.196+0000 7efce3e00640 1 --2- 172.21.15.18:0/342670318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 0x55bfde45e250 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efcd4010a00 tx=0x7efcd4005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff871205fb481ffa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.196+0000 7efccfe00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:49:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.196+0000 7efccfe00640 1 -- 172.21.15.18:0/342670318 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd4010640 con 0x55bfde459b00 2024-09-12T02:49:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.196+0000 7efcf3e81740 1 -- 172.21.15.18:0/342670318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcd4009dc0 con 0x55bfde459b00 2024-09-12T02:49:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.196+0000 7efccfe00640 1 -- 172.21.15.18:0/342670318 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7efcd40035f0 con 0x55bfde459b00 2024-09-12T02:49:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.197+0000 7efccfe00640 1 -- 172.21.15.18:0/342670318 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7efcd40050c0 con 0x55bfde459b00 2024-09-12T02:49:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.197+0000 7efcf3e81740 10 client.25346 fetch_fsmap learned FSMap version 32 2024-09-12T02:49:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.197+0000 7efcf3e81740 1 -- 172.21.15.18:0/342670318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bfde4df070 con 0x55bfde459b00 2024-09-12T02:49:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.197+0000 7efccfe00640 1 -- 172.21.15.18:0/342670318 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcd4009dc0 con 0x55bfde459b00 2024-09-12T02:49:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.197+0000 7efccfe00640 1 -- 172.21.15.18:0/342670318 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7efcd401c470 con 0x55bfde459b00 2024-09-12T02:49:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.197+0000 7efcf3e81740 10 client.25346 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T02:49:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.197+0000 7efcf3e81740 10 client.25346 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.197+0000 7efcf3e81740 20 client.25346 populate_metadata read hostname 'smithi018' 2024-09-12T02:49:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.197+0000 7efcf3e81740 1 --2- 172.21.15.18:0/342670318 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bfde4df7f0 0x55bfde4e1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.197+0000 7efcf3e81740 4 client.25346 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:49:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.197+0000 7efcf3e81740 1 -- 172.21.15.18:0/342670318 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bfde3c6b80 con 0x55bfde4df7f0 2024-09-12T02:49:13.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.197+0000 7efcea800640 1 --2- 172.21.15.18:0/342670318 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bfde4df7f0 0x55bfde4e1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.198+0000 7efcea800640 1 --2- 172.21.15.18:0/342670318 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bfde4df7f0 0x55bfde4e1c10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a50a2946681176b6 server_cookie=85d8faafb9029a11 in_seq=0 out_seq=0 2024-09-12T02:49:13.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.198+0000 7efccfe00640 10 client.25346 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:13.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.205+0000 7efccfe00640 1 -- 172.21.15.18:0/342670318 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bfde3c6b80 con 0x55bfde4df7f0 2024-09-12T02:49:13.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.205+0000 7efccfe00640 10 client.25346 handle_command_reply: tid=0 2024-09-12T02:49:13.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.205+0000 7efcf3e81740 1 client.25346 shutdown 2024-09-12T02:49:13.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.205+0000 7efcf3e81740 1 -- 172.21.15.18:0/342670318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 msgr2=0x55bfde45e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.205+0000 7efcf3e81740 1 --2- 172.21.15.18:0/342670318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 0x55bfde45e250 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efcd4010a00 tx=0x7efcd4005fa0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.205+0000 7efcf3e81740 1 -- 172.21.15.18:0/342670318 shutdown_connections 2024-09-12T02:49:13.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.205+0000 7efcf3e81740 1 --2- 172.21.15.18:0/342670318 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bfde4df7f0 0x55bfde4e1c10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.205+0000 7efcf3e81740 1 --2- 172.21.15.18:0/342670318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bfde4643a0 0x55bfde45e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.205+0000 7efcf3e81740 1 --2- 172.21.15.18:0/342670318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bfde459b00 0x55bfde45e250 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.205+0000 7efcf3e81740 1 --2- 172.21.15.18:0/342670318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bfde4591e0 0x55bfde46cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.205+0000 7efcf3e81740 1 -- 172.21.15.18:0/342670318 >> 172.21.15.18:0/342670318 conn(0x55bfde455750 msgr2=0x55bfde461b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:13.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.205+0000 7efccfe00640 0 client.25346 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:13.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.206+0000 7efcf3e81740 1 -- 172.21.15.18:0/342670318 shutdown_connections 2024-09-12T02:49:13.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.206+0000 7efcf3e81740 1 -- 172.21.15.18:0/342670318 wait complete. 2024-09-12T02:49:13.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.206+0000 7efcf3e81740 20 client.25346 trim_cache size 0 max 16384 2024-09-12T02:49:13.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:49:13.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:49:13.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:49:13.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:49:13.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.206+0000 7efcf0e00640 1 -- 172.21.15.18:0/4251175406 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efcd00a2ec0 msgr2=0x7efcd00a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.206+0000 7efcf0e00640 1 --2- 172.21.15.18:0/4251175406 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efcd00a2ec0 0x7efcd00a5380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0cd050 tx=0x7efcdc000bc0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.206+0000 7efcf0e00640 1 -- 172.21.15.18:0/4251175406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcec074590 msgr2=0x7efcec1a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.206+0000 7efcf0e00640 1 --2- 172.21.15.18:0/4251175406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcec074590 0x7efcec1a4610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00e9f0 tx=0x7efcdc00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.206+0000 7efcf0e00640 1 -- 172.21.15.18:0/4251175406 shutdown_connections 2024-09-12T02:49:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.206+0000 7efcf0e00640 1 --2- 172.21.15.18:0/4251175406 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efcd00a2ec0 0x7efcd00a5380 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.206+0000 7efcf0e00640 1 --2- 172.21.15.18:0/4251175406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcec112af0 0x7efcec19e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.207+0000 7efcf0e00640 1 --2- 172.21.15.18:0/4251175406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcec074eb0 0x7efcec1a4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.207+0000 7efcf0e00640 1 --2- 172.21.15.18:0/4251175406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcec074590 0x7efcec1a4610 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.207+0000 7efcf0e00640 1 -- 172.21.15.18:0/4251175406 >> 172.21.15.18:0/4251175406 conn(0x7efcec0fd7e0 msgr2=0x7efcec0fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.207+0000 7efcf0e00640 1 -- 172.21.15.18:0/4251175406 shutdown_connections 2024-09-12T02:49:13.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:13.207+0000 7efcf0e00640 1 -- 172.21.15.18:0/4251175406 wait complete. 2024-09-12T02:49:13.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:12 smithi176 ceph-mon[35713]: pgmap v17: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 KiB/s wr, 33 op/s 2024-09-12T02:49:14.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:13 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:49:14.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:13 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:49:14.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:13 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:49:15.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:14 smithi018 ceph-mon[30616]: pgmap v18: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 29 op/s 2024-09-12T02:49:15.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:14 smithi176 ceph-mon[35713]: pgmap v18: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 29 op/s 2024-09-12T02:49:15.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:14 smithi062 ceph-mon[35527]: pgmap v18: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 29 op/s 2024-09-12T02:49:16.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:15 smithi018 ceph-mon[30616]: pgmap v19: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 KiB/s wr, 35 op/s 2024-09-12T02:49:16.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:15 smithi176 ceph-mon[35713]: pgmap v19: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 KiB/s wr, 35 op/s 2024-09-12T02:49:16.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:15 smithi062 ceph-mon[35527]: pgmap v19: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 KiB/s wr, 35 op/s 2024-09-12T02:49:18.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:18 smithi018 ceph-mon[30616]: pgmap v20: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-12T02:49:18.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:18 smithi176 ceph-mon[35713]: pgmap v20: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-12T02:49:18.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:18 smithi062 ceph-mon[35527]: pgmap v20: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-12T02:49:20.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:20 smithi018 ceph-mon[30616]: pgmap v21: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-12T02:49:20.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:20 smithi176 ceph-mon[35713]: pgmap v21: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-12T02:49:20.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:20 smithi062 ceph-mon[35527]: pgmap v21: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-12T02:49:22.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:22 smithi018 ceph-mon[30616]: pgmap v22: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.4 KiB/s wr, 15 op/s 2024-09-12T02:49:22.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:22 smithi176 ceph-mon[35713]: pgmap v22: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.4 KiB/s wr, 15 op/s 2024-09-12T02:49:22.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:22 smithi062 ceph-mon[35527]: pgmap v22: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.4 KiB/s wr, 15 op/s 2024-09-12T02:49:24.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:24 smithi018 ceph-mon[30616]: pgmap v23: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-12T02:49:24.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:24 smithi176 ceph-mon[35713]: pgmap v23: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-12T02:49:24.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:24 smithi062 ceph-mon[35527]: pgmap v23: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-12T02:49:26.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.384+0000 7f1ed7e00640 1 -- 172.21.15.18:0/2463839841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ed81018b0 msgr2=0x7f1ed8101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:26.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.384+0000 7f1ed7e00640 1 --2- 172.21.15.18:0/2463839841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ed81018b0 0x7f1ed8101d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009930 tx=0x7f1ec402a440 comp rx=0 tx=0).stop 2024-09-12T02:49:26.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.384+0000 7f1ed7e00640 1 -- 172.21.15.18:0/2463839841 shutdown_connections 2024-09-12T02:49:26.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.384+0000 7f1ed7e00640 1 --2- 172.21.15.18:0/2463839841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ed8102250 0x7f1ed810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.384+0000 7f1ed7e00640 1 --2- 172.21.15.18:0/2463839841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ed81018b0 0x7f1ed8101d10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.384+0000 7f1ed7e00640 1 --2- 172.21.15.18:0/2463839841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ed81078c0 0x7f1ed8107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.384+0000 7f1ed7e00640 1 -- 172.21.15.18:0/2463839841 >> 172.21.15.18:0/2463839841 conn(0x7f1ed80fd5d0 msgr2=0x7f1ed80ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.384+0000 7f1ed7e00640 1 -- 172.21.15.18:0/2463839841 shutdown_connections 2024-09-12T02:49:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.385+0000 7f1ed7e00640 1 -- 172.21.15.18:0/2463839841 wait complete. 2024-09-12T02:49:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.386+0000 7f1ed7e00640 1 Processor -- start 2024-09-12T02:49:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.386+0000 7f1ed7e00640 1 -- start start 2024-09-12T02:49:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.387+0000 7f1ed7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ed81018b0 0x7f1ed80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.387+0000 7f1ed7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ed8102250 0x7f1ed8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.387+0000 7f1ed7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ed81078c0 0x7f1ed8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.387+0000 7f1ed7e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed8111d50 con 0x7f1ed81018b0 2024-09-12T02:49:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.387+0000 7f1ed7e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed8111bd0 con 0x7f1ed81078c0 2024-09-12T02:49:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.387+0000 7f1ed7e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed8111ed0 con 0x7f1ed8102250 2024-09-12T02:49:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.387+0000 7f1ed6000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ed8102250 0x7f1ed8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.387+0000 7f1ed6000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ed8102250 0x7f1ed8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:54688/0 (socket says 172.21.15.18:54688) 2024-09-12T02:49:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.387+0000 7f1ed6000640 1 -- 172.21.15.18:0/2877007934 learned_addr learned my addr 172.21.15.18:0/2877007934 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.387+0000 7f1ed6a00640 1 --2- 172.21.15.18:0/2877007934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ed81018b0 0x7f1ed80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.387+0000 7f1ed7400640 1 --2- 172.21.15.18:0/2877007934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ed81078c0 0x7f1ed8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.388+0000 7f1ed6000640 1 -- 172.21.15.18:0/2877007934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ed81078c0 msgr2=0x7f1ed8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.388+0000 7f1ed6000640 1 --2- 172.21.15.18:0/2877007934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ed81078c0 0x7f1ed8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.388+0000 7f1ed6000640 1 -- 172.21.15.18:0/2877007934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ed81018b0 msgr2=0x7f1ed80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.388+0000 7f1ed6000640 1 --2- 172.21.15.18:0/2877007934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ed81018b0 0x7f1ed80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.388+0000 7f1ed6000640 1 -- 172.21.15.18:0/2877007934 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed81a6760 con 0x7f1ed8102250 2024-09-12T02:49:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.388+0000 7f1ed6a00640 1 --2- 172.21.15.18:0/2877007934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ed81018b0 0x7f1ed80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.388+0000 7f1ed6000640 1 --2- 172.21.15.18:0/2877007934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ed8102250 0x7f1ed8074a30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1ec402a960 tx=0x7f1ec4003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.388+0000 7f1ecf400640 1 -- 172.21.15.18:0/2877007934 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec403f070 con 0x7f1ed8102250 2024-09-12T02:49:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.388+0000 7f1ecf400640 1 -- 172.21.15.18:0/2877007934 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ec4031c90 con 0x7f1ed8102250 2024-09-12T02:49:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.388+0000 7f1ecf400640 1 -- 172.21.15.18:0/2877007934 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4035030 con 0x7f1ed8102250 2024-09-12T02:49:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.388+0000 7f1ed7e00640 1 -- 172.21.15.18:0/2877007934 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed81a69f0 con 0x7f1ed8102250 2024-09-12T02:49:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.389+0000 7f1ed7e00640 1 -- 172.21.15.18:0/2877007934 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed81a6e90 con 0x7f1ed8102250 2024-09-12T02:49:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.393+0000 7f1ecf400640 1 -- 172.21.15.18:0/2877007934 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 26) ==== 138066+0+0 (secure 0 0 0) 0x7f1ec4042070 con 0x7f1ed8102250 2024-09-12T02:49:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.393+0000 7f1ee0809740 1 Processor -- start 2024-09-12T02:49:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.393+0000 7f1ee0809740 1 -- start start 2024-09-12T02:49:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.394+0000 7f1ee0809740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9165433b0 0x55c916543790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.394+0000 7f1ee0809740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c916543cd0 0x55c91654e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.394+0000 7f1ee0809740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91654e570 0x55c916550960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.394+0000 7f1ee0809740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c9164a9100 con 0x55c91654e570 2024-09-12T02:49:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.394+0000 7f1ee0809740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c9164511b0 con 0x55c916543cd0 2024-09-12T02:49:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.394+0000 7f1ee0809740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c9164a50c0 con 0x55c9165433b0 2024-09-12T02:49:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.394+0000 7f1ed7400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9165433b0 0x55c916543790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.394+0000 7f1ed6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91654e570 0x55c916550960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.394+0000 7f1ed6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91654e570 0x55c916550960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44046/0 (socket says 172.21.15.18:44046) 2024-09-12T02:49:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.394+0000 7f1ed6000640 1 -- 172.21.15.18:0/3508100233 learned_addr learned my addr 172.21.15.18:0/3508100233 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.395+0000 7f1ed6000640 1 -- 172.21.15.18:0/3508100233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9165433b0 msgr2=0x55c916543790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.395+0000 7f1ed6000640 1 --2- 172.21.15.18:0/3508100233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9165433b0 0x55c916543790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.395+0000 7f1ed6000640 1 -- 172.21.15.18:0/3508100233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c916543cd0 msgr2=0x55c91654e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.395+0000 7f1ed6a00640 1 --2- 172.21.15.18:0/3508100233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c916543cd0 0x55c91654e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.395+0000 7f1ed6000640 1 --2- 172.21.15.18:0/3508100233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c916543cd0 0x55c91654e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.395+0000 7f1ed6000640 1 -- 172.21.15.18:0/3508100233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9161bc210 con 0x55c91654e570 2024-09-12T02:49:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.395+0000 7f1ed6000640 1 --2- 172.21.15.18:0/3508100233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91654e570 0x55c916550960 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1ec40ece80 tx=0x7f1ec40f3f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197c1960dedc54d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.395+0000 7f1ec3e00640 1 -- 172.21.15.18:0/3508100233 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec40ff070 con 0x55c91654e570 2024-09-12T02:49:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.395+0000 7f1ecf400640 1 --2- 172.21.15.18:0/2877007934 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1ebc0a2e90 0x7f1ebc0a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.396+0000 7f1ec3e00640 1 -- 172.21.15.18:0/3508100233 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ec40f6960 con 0x55c91654e570 2024-09-12T02:49:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.396+0000 7f1ecf400640 1 -- 172.21.15.18:0/2877007934 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f1ec40efd30 con 0x7f1ed8102250 2024-09-12T02:49:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.396+0000 7f1ec3e00640 1 -- 172.21.15.18:0/3508100233 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec40b7f50 con 0x55c91654e570 2024-09-12T02:49:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.396+0000 7f1ed7400640 1 --2- 172.21.15.18:0/2877007934 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1ebc0a2e90 0x7f1ebc0a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.397+0000 7f1ee0809740 1 -- 172.21.15.18:0/3508100233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91654e570 msgr2=0x55c916550960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.397+0000 7f1ee0809740 1 --2- 172.21.15.18:0/3508100233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91654e570 0x55c916550960 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1ec40ece80 tx=0x7f1ec40f3f60 comp rx=0 tx=0).stop 2024-09-12T02:49:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.397+0000 7f1ed7400640 1 --2- 172.21.15.18:0/2877007934 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1ebc0a2e90 0x7f1ebc0a5350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0005fd0 tx=0x7f1ed0009500 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.397+0000 7f1ee0809740 1 -- 172.21.15.18:0/3508100233 shutdown_connections 2024-09-12T02:49:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.397+0000 7f1ee0809740 1 --2- 172.21.15.18:0/3508100233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91654e570 0x55c916550960 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.397+0000 7f1ee0809740 1 --2- 172.21.15.18:0/3508100233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c916543cd0 0x55c91654e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.397+0000 7f1ee0809740 1 --2- 172.21.15.18:0/3508100233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9165433b0 0x55c916543790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.397+0000 7f1ee0809740 1 -- 172.21.15.18:0/3508100233 >> 172.21.15.18:0/3508100233 conn(0x55c91653f920 msgr2=0x55c91653fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.397+0000 7f1ee0809740 1 -- 172.21.15.18:0/3508100233 shutdown_connections 2024-09-12T02:49:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.397+0000 7f1ee0809740 1 -- 172.21.15.18:0/3508100233 wait complete. 2024-09-12T02:49:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.398+0000 7f1ee0809740 1 -- start start 2024-09-12T02:49:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.398+0000 7f1ee0809740 1 Processor -- start 2024-09-12T02:49:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.399+0000 7f1ee0809740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9165433b0 0x55c91654b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.399+0000 7f1ee0809740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c916543cd0 0x55c91654bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.399+0000 7f1ee0809740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91654e570 0x55c91654c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.399+0000 7f1ee0809740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c916550f00 con 0x55c91654e570 2024-09-12T02:49:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.399+0000 7f1ee0809740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c916432090 con 0x55c9165433b0 2024-09-12T02:49:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.399+0000 7f1ee0809740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c916551080 con 0x55c916543cd0 2024-09-12T02:49:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.399+0000 7f1ee0809740 10 client.0 _ll_register_callbacks cb 0x55c916486f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.399+0000 7f1ed6000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c916543cd0 0x55c91654bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.399+0000 7f1ed6000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c916543cd0 0x55c91654bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:54694/0 (socket says 172.21.15.18:54694) 2024-09-12T02:49:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.399+0000 7f1ed6a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9165433b0 0x55c91654b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.399+0000 7f1ed6000640 1 -- 172.21.15.18:0/3921337038 learned_addr learned my addr 172.21.15.18:0/3921337038 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.400+0000 7f1ed7400640 1 --2- 172.21.15.18:0/3921337038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91654e570 0x55c91654c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.400+0000 7f1ed6000640 1 -- 172.21.15.18:0/3921337038 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9165433b0 msgr2=0x55c91654b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.400+0000 7f1ed6000640 1 --2- 172.21.15.18:0/3921337038 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9165433b0 0x55c91654b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.400+0000 7f1ed6000640 1 -- 172.21.15.18:0/3921337038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91654e570 msgr2=0x55c91654c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.400+0000 7f1ed6000640 1 --2- 172.21.15.18:0/3921337038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91654e570 0x55c91654c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.400+0000 7f1ed6000640 1 -- 172.21.15.18:0/3921337038 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c916288620 con 0x55c916543cd0 2024-09-12T02:49:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.400+0000 7f1ed7400640 1 --2- 172.21.15.18:0/3921337038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91654e570 0x55c91654c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:49:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.400+0000 7f1ed6000640 1 --2- 172.21.15.18:0/3921337038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c916543cd0 0x55c91654bac0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ec40c3340 tx=0x7f1ec402a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac8a174809d750fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.400+0000 7f1ec0c00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:49:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.400+0000 7f1ec0c00640 1 -- 172.21.15.18:0/3921337038 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec40bb430 con 0x55c916543cd0 2024-09-12T02:49:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.400+0000 7f1ec0c00640 1 -- 172.21.15.18:0/3921337038 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f1ec40bb100 con 0x55c916543cd0 2024-09-12T02:49:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.400+0000 7f1ee0809740 1 -- 172.21.15.18:0/3921337038 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ec40f6960 con 0x55c916543cd0 2024-09-12T02:49:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.401+0000 7f1ec0c00640 1 -- 172.21.15.18:0/3921337038 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1ec40bb610 con 0x55c916543cd0 2024-09-12T02:49:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.401+0000 7f1ee0809740 10 client.25363 fetch_fsmap learned FSMap version 32 2024-09-12T02:49:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.401+0000 7f1ee0809740 1 -- 172.21.15.18:0/3921337038 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c916550f00 con 0x55c916543cd0 2024-09-12T02:49:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.401+0000 7f1ec0c00640 1 -- 172.21.15.18:0/3921337038 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ec40f6960 con 0x55c916543cd0 2024-09-12T02:49:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.401+0000 7f1ec0c00640 1 -- 172.21.15.18:0/3921337038 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f1ec40f4040 con 0x55c916543cd0 2024-09-12T02:49:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.401+0000 7f1ee0809740 10 client.25363 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T02:49:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.401+0000 7f1ee0809740 10 client.25363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.401+0000 7f1ee0809740 20 client.25363 populate_metadata read hostname 'smithi018' 2024-09-12T02:49:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.401+0000 7f1ee0809740 1 --2- 172.21.15.18:0/3921337038 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c91655de30 0x55c916560270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.401+0000 7f1ee0809740 4 client.25363 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.401+0000 7f1ee0809740 1 -- 172.21.15.18:0/3921337038 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9164b6830 con 0x55c91655de30 2024-09-12T02:49:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.402+0000 7f1ed6a00640 1 --2- 172.21.15.18:0/3921337038 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c91655de30 0x55c916560270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.402+0000 7f1ed6a00640 1 --2- 172.21.15.18:0/3921337038 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c91655de30 0x55c916560270 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2475ef0ae36a213b server_cookie=e2f78602c523bf2b in_seq=0 out_seq=0 2024-09-12T02:49:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.402+0000 7f1ec0c00640 10 client.25363 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.403+0000 7f1ec0c00640 1 -- 172.21.15.18:0/3921337038 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c9164b6830 con 0x55c91655de30 2024-09-12T02:49:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.403+0000 7f1ec0c00640 10 client.25363 handle_command_reply: tid=0 2024-09-12T02:49:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.403+0000 7f1ee0809740 1 client.25363 shutdown 2024-09-12T02:49:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.403+0000 7f1ee0809740 1 -- 172.21.15.18:0/3921337038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c916543cd0 msgr2=0x55c91654bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.403+0000 7f1ee0809740 1 --2- 172.21.15.18:0/3921337038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c916543cd0 0x55c91654bac0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ec40c3340 tx=0x7f1ec402a440 comp rx=0 tx=0).stop 2024-09-12T02:49:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.403+0000 7f1ee0809740 1 -- 172.21.15.18:0/3921337038 shutdown_connections 2024-09-12T02:49:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.403+0000 7f1ee0809740 1 --2- 172.21.15.18:0/3921337038 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c91655de30 0x55c916560270 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.403+0000 7f1ee0809740 1 --2- 172.21.15.18:0/3921337038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91654e570 0x55c91654c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.403+0000 7f1ee0809740 1 --2- 172.21.15.18:0/3921337038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c916543cd0 0x55c91654bac0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.403+0000 7f1ee0809740 1 --2- 172.21.15.18:0/3921337038 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9165433b0 0x55c91654b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.403+0000 7f1ee0809740 1 -- 172.21.15.18:0/3921337038 >> 172.21.15.18:0/3921337038 conn(0x55c91653f920 msgr2=0x55c916545630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.404+0000 7f1ec0c00640 0 client.25363 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.404+0000 7f1ee0809740 1 -- 172.21.15.18:0/3921337038 shutdown_connections 2024-09-12T02:49:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.404+0000 7f1ee0809740 1 -- 172.21.15.18:0/3921337038 wait complete. 2024-09-12T02:49:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.404+0000 7f1ee0809740 20 client.25363 trim_cache size 0 max 16384 2024-09-12T02:49:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.434+0000 7f1ee0809740 1 Processor -- start 2024-09-12T02:49:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.434+0000 7f1ee0809740 1 -- start start 2024-09-12T02:49:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.434+0000 7f1ee0809740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9165433b0 0x55c916545e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.434+0000 7f1ee0809740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c916543cd0 0x55c91654be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.434+0000 7f1ee0809740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91654e570 0x55c91654d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.434+0000 7f1ee0809740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed81b1100 con 0x55c916543cd0 2024-09-12T02:49:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.434+0000 7f1ee0809740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed81b2ca0 con 0x55c91654e570 2024-09-12T02:49:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.434+0000 7f1ee0809740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed81b17d0 con 0x55c9165433b0 2024-09-12T02:49:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.435+0000 7f1ed6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c916543cd0 0x55c91654be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.435+0000 7f1ed6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9165433b0 0x55c916545e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.435+0000 7f1ed6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9165433b0 0x55c916545e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:54710/0 (socket says 172.21.15.18:54710) 2024-09-12T02:49:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.435+0000 7f1ed6a00640 1 -- 172.21.15.18:0/1515629277 learned_addr learned my addr 172.21.15.18:0/1515629277 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.435+0000 7f1ed7400640 1 --2- 172.21.15.18:0/1515629277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91654e570 0x55c91654d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.435+0000 7f1ed6a00640 1 -- 172.21.15.18:0/1515629277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91654e570 msgr2=0x55c91654d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.435+0000 7f1ed6a00640 1 --2- 172.21.15.18:0/1515629277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91654e570 0x55c91654d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.435+0000 7f1ed6a00640 1 -- 172.21.15.18:0/1515629277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c916543cd0 msgr2=0x55c91654be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.435+0000 7f1ed6a00640 1 --2- 172.21.15.18:0/1515629277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c916543cd0 0x55c91654be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.435+0000 7f1ed6a00640 1 -- 172.21.15.18:0/1515629277 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c91653f5f0 con 0x55c9165433b0 2024-09-12T02:49:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.435+0000 7f1ed6000640 1 --2- 172.21.15.18:0/1515629277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c916543cd0 0x55c91654be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.436+0000 7f1ed6a00640 1 --2- 172.21.15.18:0/1515629277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9165433b0 0x55c916545e20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80097b0 tx=0x7f1ec8013830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d748f56290d1f8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.436+0000 7f1ec3400640 1 -- 172.21.15.18:0/1515629277 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec801c460 con 0x55c9165433b0 2024-09-12T02:49:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.436+0000 7f1ec3400640 1 -- 172.21.15.18:0/1515629277 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ec801cae0 con 0x55c9165433b0 2024-09-12T02:49:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.436+0000 7f1ec3400640 1 -- 172.21.15.18:0/1515629277 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8011a30 con 0x55c9165433b0 2024-09-12T02:49:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.437+0000 7f1ee0809740 1 -- 172.21.15.18:0/1515629277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9165433b0 msgr2=0x55c916545e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.437+0000 7f1ee0809740 1 --2- 172.21.15.18:0/1515629277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9165433b0 0x55c916545e20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80097b0 tx=0x7f1ec8013830 comp rx=0 tx=0).stop 2024-09-12T02:49:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.437+0000 7f1ee0809740 1 -- 172.21.15.18:0/1515629277 shutdown_connections 2024-09-12T02:49:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.437+0000 7f1ee0809740 1 --2- 172.21.15.18:0/1515629277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91654e570 0x55c91654d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.437+0000 7f1ee0809740 1 --2- 172.21.15.18:0/1515629277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c916543cd0 0x55c91654be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.437+0000 7f1ee0809740 1 --2- 172.21.15.18:0/1515629277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c9165433b0 0x55c916545e20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.437+0000 7f1ee0809740 1 -- 172.21.15.18:0/1515629277 >> 172.21.15.18:0/1515629277 conn(0x55c91653f920 msgr2=0x55c91654ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.437+0000 7f1ee0809740 1 -- 172.21.15.18:0/1515629277 shutdown_connections 2024-09-12T02:49:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.437+0000 7f1ee0809740 1 -- 172.21.15.18:0/1515629277 wait complete. 2024-09-12T02:49:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.438+0000 7f1ee0809740 1 -- start start 2024-09-12T02:49:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.438+0000 7f1ee0809740 1 Processor -- start 2024-09-12T02:49:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.438+0000 7f1ee0809740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9165433b0 0x55c9165518e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.438+0000 7f1ee0809740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c916543cd0 0x55c916551e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.438+0000 7f1ee0809740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91654e570 0x55c9165c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.439+0000 7f1ee0809740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed81b2570 con 0x55c9165433b0 2024-09-12T02:49:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.439+0000 7f1ee0809740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed81b1ea0 con 0x55c91654e570 2024-09-12T02:49:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.439+0000 7f1ee0809740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed81af0e0 con 0x55c916543cd0 2024-09-12T02:49:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.439+0000 7f1ee0809740 10 client.0 _ll_register_callbacks cb 0x7f1ed0009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.439+0000 7f1ed6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9165433b0 0x55c9165518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.439+0000 7f1ed6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9165433b0 0x55c9165518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44070/0 (socket says 172.21.15.18:44070) 2024-09-12T02:49:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.439+0000 7f1ed6a00640 1 -- 172.21.15.18:0/4003235338 learned_addr learned my addr 172.21.15.18:0/4003235338 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.439+0000 7f1ed6000640 1 --2- 172.21.15.18:0/4003235338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c916543cd0 0x55c916551e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.439+0000 7f1ed7400640 1 --2- 172.21.15.18:0/4003235338 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91654e570 0x55c9165c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.439+0000 7f1ed6a00640 1 -- 172.21.15.18:0/4003235338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c916543cd0 msgr2=0x55c916551e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.439+0000 7f1ed6a00640 1 --2- 172.21.15.18:0/4003235338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c916543cd0 0x55c916551e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.439+0000 7f1ed6a00640 1 -- 172.21.15.18:0/4003235338 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91654e570 msgr2=0x55c9165c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.439+0000 7f1ed6a00640 1 --2- 172.21.15.18:0/4003235338 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91654e570 0x55c9165c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.439+0000 7f1ed6a00640 1 -- 172.21.15.18:0/4003235338 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9165c7140 con 0x55c9165433b0 2024-09-12T02:49:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.439+0000 7f1ed6000640 1 --2- 172.21.15.18:0/4003235338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c916543cd0 0x55c916551e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:49:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.439+0000 7f1ed7400640 1 --2- 172.21.15.18:0/4003235338 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91654e570 0x55c9165c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.440+0000 7f1ed6a00640 1 --2- 172.21.15.18:0/4003235338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9165433b0 0x55c9165518e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8011500 tx=0x7f1ec8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5167468d6132ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.440+0000 7f1ec0c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:49:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.440+0000 7f1ec0c00640 1 -- 172.21.15.18:0/4003235338 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec801c660 con 0x55c9165433b0 2024-09-12T02:49:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.440+0000 7f1ec0c00640 1 -- 172.21.15.18:0/4003235338 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f1ec801c800 con 0x55c9165433b0 2024-09-12T02:49:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.440+0000 7f1ee0809740 1 -- 172.21.15.18:0/4003235338 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ec801cae0 con 0x55c9165433b0 2024-09-12T02:49:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.440+0000 7f1ec0c00640 1 -- 172.21.15.18:0/4003235338 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1ec80117b0 con 0x55c9165433b0 2024-09-12T02:49:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.440+0000 7f1ee0809740 10 client.15360 fetch_fsmap learned FSMap version 32 2024-09-12T02:49:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.440+0000 7f1ee0809740 1 -- 172.21.15.18:0/4003235338 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c9165c8450 con 0x55c9165433b0 2024-09-12T02:49:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.441+0000 7f1ec0c00640 1 -- 172.21.15.18:0/4003235338 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ec801cae0 con 0x55c9165433b0 2024-09-12T02:49:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.441+0000 7f1ec0c00640 1 -- 172.21.15.18:0/4003235338 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f1ec8030470 con 0x55c9165433b0 2024-09-12T02:49:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.441+0000 7f1ee0809740 10 client.15360 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T02:49:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.441+0000 7f1ee0809740 10 client.15360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.441+0000 7f1ee0809740 20 client.15360 populate_metadata read hostname 'smithi018' 2024-09-12T02:49:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.442+0000 7f1ee0809740 1 --2- 172.21.15.18:0/4003235338 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c9165c8b80 0x55c9165cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.442+0000 7f1ee0809740 4 client.15360 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:49:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.442+0000 7f1ee0809740 1 -- 172.21.15.18:0/4003235338 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c9164b0b80 con 0x55c9165c8b80 2024-09-12T02:49:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.442+0000 7f1ed6000640 1 --2- 172.21.15.18:0/4003235338 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c9165c8b80 0x55c9165cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.442+0000 7f1ec0c00640 10 client.15360 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.442+0000 7f1ed6000640 1 --2- 172.21.15.18:0/4003235338 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c9165c8b80 0x55c9165cafa0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3267f74fc59c2421 server_cookie=ed1551a6f0f5d499 in_seq=0 out_seq=0 2024-09-12T02:49:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.450+0000 7f1ec0c00640 1 -- 172.21.15.18:0/4003235338 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c9164b0b80 con 0x55c9165c8b80 2024-09-12T02:49:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.450+0000 7f1ec0c00640 10 client.15360 handle_command_reply: tid=0 2024-09-12T02:49:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.450+0000 7f1ee0809740 1 client.15360 shutdown 2024-09-12T02:49:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.450+0000 7f1ee0809740 1 -- 172.21.15.18:0/4003235338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9165433b0 msgr2=0x55c9165518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.450+0000 7f1ee0809740 1 --2- 172.21.15.18:0/4003235338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9165433b0 0x55c9165518e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8011500 tx=0x7f1ec8009da0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.450+0000 7f1ee0809740 1 -- 172.21.15.18:0/4003235338 shutdown_connections 2024-09-12T02:49:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.450+0000 7f1ee0809740 1 --2- 172.21.15.18:0/4003235338 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c9165c8b80 0x55c9165cafa0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.450+0000 7f1ee0809740 1 --2- 172.21.15.18:0/4003235338 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91654e570 0x55c9165c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.450+0000 7f1ee0809740 1 --2- 172.21.15.18:0/4003235338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c916543cd0 0x55c916551e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.450+0000 7f1ee0809740 1 --2- 172.21.15.18:0/4003235338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9165433b0 0x55c9165518e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.450+0000 7f1ee0809740 1 -- 172.21.15.18:0/4003235338 >> 172.21.15.18:0/4003235338 conn(0x55c91653f920 msgr2=0x55c9165598e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.450+0000 7f1ec0c00640 0 client.15360 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.450+0000 7f1ee0809740 1 -- 172.21.15.18:0/4003235338 shutdown_connections 2024-09-12T02:49:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.451+0000 7f1ee0809740 1 -- 172.21.15.18:0/4003235338 wait complete. 2024-09-12T02:49:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.451+0000 7f1ee0809740 20 client.15360 trim_cache size 0 max 16384 2024-09-12T02:49:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:49:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:49:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:49:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:49:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.451+0000 7f1ed7e00640 1 -- 172.21.15.18:0/2877007934 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1ebc0a2e90 msgr2=0x7f1ebc0a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.451+0000 7f1ed7e00640 1 --2- 172.21.15.18:0/2877007934 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1ebc0a2e90 0x7f1ebc0a5350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0005fd0 tx=0x7f1ed0009500 comp rx=0 tx=0).stop 2024-09-12T02:49:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.451+0000 7f1ed7e00640 1 -- 172.21.15.18:0/2877007934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ed8102250 msgr2=0x7f1ed8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.451+0000 7f1ed7e00640 1 --2- 172.21.15.18:0/2877007934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ed8102250 0x7f1ed8074a30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1ec402a960 tx=0x7f1ec4003b20 comp rx=0 tx=0).stop 2024-09-12T02:49:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.452+0000 7f1ed7e00640 1 -- 172.21.15.18:0/2877007934 shutdown_connections 2024-09-12T02:49:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.452+0000 7f1ed7e00640 1 --2- 172.21.15.18:0/2877007934 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1ebc0a2e90 0x7f1ebc0a5350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.452+0000 7f1ed7e00640 1 --2- 172.21.15.18:0/2877007934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ed81078c0 0x7f1ed8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.452+0000 7f1ed7e00640 1 --2- 172.21.15.18:0/2877007934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ed8102250 0x7f1ed8074a30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.452+0000 7f1ed7e00640 1 --2- 172.21.15.18:0/2877007934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ed81018b0 0x7f1ed80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.452+0000 7f1ed7e00640 1 -- 172.21.15.18:0/2877007934 >> 172.21.15.18:0/2877007934 conn(0x7f1ed80fd5d0 msgr2=0x7f1ed80fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.452+0000 7f1ed7e00640 1 -- 172.21.15.18:0/2877007934 shutdown_connections 2024-09-12T02:49:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:26.452+0000 7f1ed7e00640 1 -- 172.21.15.18:0/2877007934 wait complete. 2024-09-12T02:49:26.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:26 smithi176 ceph-mon[35713]: pgmap v24: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-09-12T02:49:26.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:26 smithi062 ceph-mon[35527]: pgmap v24: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-09-12T02:49:26.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:26 smithi018 ceph-mon[30616]: pgmap v24: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-09-12T02:49:28.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:28 smithi176 ceph-mon[35713]: pgmap v25: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T02:49:28.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:28 smithi062 ceph-mon[35527]: pgmap v25: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T02:49:28.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:28 smithi018 ceph-mon[30616]: pgmap v25: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T02:49:30.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:30 smithi176 ceph-mon[35713]: pgmap v26: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T02:49:30.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:30 smithi062 ceph-mon[35527]: pgmap v26: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T02:49:30.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:30 smithi018 ceph-mon[30616]: pgmap v26: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T02:49:32.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:32 smithi176 ceph-mon[35713]: pgmap v27: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-12T02:49:32.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:32 smithi062 ceph-mon[35527]: pgmap v27: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-12T02:49:32.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:32 smithi018 ceph-mon[30616]: pgmap v27: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-12T02:49:34.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:34 smithi176 ceph-mon[35713]: pgmap v28: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-12T02:49:34.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:34 smithi062 ceph-mon[35527]: pgmap v28: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-12T02:49:34.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:34 smithi018 ceph-mon[30616]: pgmap v28: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-12T02:49:36.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:36 smithi176 ceph-mon[35713]: pgmap v29: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-12T02:49:36.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:36 smithi062 ceph-mon[35527]: pgmap v29: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-12T02:49:36.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:36 smithi018 ceph-mon[30616]: pgmap v29: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-12T02:49:38.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:38 smithi176 ceph-mon[35713]: pgmap v30: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-12T02:49:38.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:38 smithi062 ceph-mon[35527]: pgmap v30: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-12T02:49:38.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:38 smithi018 ceph-mon[30616]: pgmap v30: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-12T02:49:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.609+0000 7f84c7e00640 1 -- 172.21.15.18:0/2177295439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84c8109ba0 msgr2=0x7f84c8109f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.609+0000 7f84c7e00640 1 --2- 172.21.15.18:0/2177295439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84c8109ba0 0x7f84c8109f80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009cd0 tx=0x7f84b802a8e0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.609+0000 7f84c7e00640 1 -- 172.21.15.18:0/2177295439 shutdown_connections 2024-09-12T02:49:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.609+0000 7f84c7e00640 1 --2- 172.21.15.18:0/2177295439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c81044a0 0x7f84c81109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.609+0000 7f84c7e00640 1 --2- 172.21.15.18:0/2177295439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c8103b00 0x7f84c8103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.609+0000 7f84c7e00640 1 --2- 172.21.15.18:0/2177295439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84c8109ba0 0x7f84c8109f80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.609+0000 7f84c7e00640 1 -- 172.21.15.18:0/2177295439 >> 172.21.15.18:0/2177295439 conn(0x7f84c80ff7c0 msgr2=0x7f84c8101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.610+0000 7f84c7e00640 1 -- 172.21.15.18:0/2177295439 shutdown_connections 2024-09-12T02:49:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.610+0000 7f84c7e00640 1 -- 172.21.15.18:0/2177295439 wait complete. 2024-09-12T02:49:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.611+0000 7f84c7e00640 1 Processor -- start 2024-09-12T02:49:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.611+0000 7f84c7e00640 1 -- start start 2024-09-12T02:49:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.611+0000 7f84c7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84c8103b00 0x7f84c8076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.611+0000 7f84c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c81044a0 0x7f84c8076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.611+0000 7f84c7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c8109ba0 0x7f84c8077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.611+0000 7f84c7e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f84c8113f10 con 0x7f84c81044a0 2024-09-12T02:49:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.611+0000 7f84c7e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f84c8113d90 con 0x7f84c8109ba0 2024-09-12T02:49:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.611+0000 7f84c7e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84c8114090 con 0x7f84c8103b00 2024-09-12T02:49:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.612+0000 7f84c6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c81044a0 0x7f84c8076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.612+0000 7f84c6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84c8103b00 0x7f84c8076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.612+0000 7f84c6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c81044a0 0x7f84c8076c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47660/0 (socket says 172.21.15.18:47660) 2024-09-12T02:49:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.612+0000 7f84c6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84c8103b00 0x7f84c8076700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:34612/0 (socket says 172.21.15.18:34612) 2024-09-12T02:49:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.612+0000 7f84c6000640 1 -- 172.21.15.18:0/2407107558 learned_addr learned my addr 172.21.15.18:0/2407107558 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.612+0000 7f84c7400640 1 --2- 172.21.15.18:0/2407107558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c8109ba0 0x7f84c8077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.612+0000 7f84c6000640 1 -- 172.21.15.18:0/2407107558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84c8103b00 msgr2=0x7f84c8076700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.612+0000 7f84c6000640 1 --2- 172.21.15.18:0/2407107558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84c8103b00 0x7f84c8076700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.612+0000 7f84c6000640 1 -- 172.21.15.18:0/2407107558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c8109ba0 msgr2=0x7f84c8077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.612+0000 7f84c6000640 1 --2- 172.21.15.18:0/2407107558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c8109ba0 0x7f84c8077180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.612+0000 7f84c6000640 1 -- 172.21.15.18:0/2407107558 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c81aab00 con 0x7f84c81044a0 2024-09-12T02:49:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.612+0000 7f84c6a00640 1 --2- 172.21.15.18:0/2407107558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84c8103b00 0x7f84c8076700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.612+0000 7f84c7400640 1 --2- 172.21.15.18:0/2407107558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c8109ba0 0x7f84c8077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.613+0000 7f84c6000640 1 --2- 172.21.15.18:0/2407107558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c81044a0 0x7f84c8076c40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f84b400ea20 tx=0x7f84b400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.613+0000 7f84cca00640 1 -- 172.21.15.18:0/2407107558 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b400cd80 con 0x7f84c81044a0 2024-09-12T02:49:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.613+0000 7f84cca00640 1 -- 172.21.15.18:0/2407107558 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84b4010910 con 0x7f84c81044a0 2024-09-12T02:49:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.613+0000 7f84c7e00640 1 -- 172.21.15.18:0/2407107558 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c81aadf0 con 0x7f84c81044a0 2024-09-12T02:49:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.613+0000 7f84cca00640 1 -- 172.21.15.18:0/2407107558 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b4018920 con 0x7f84c81044a0 2024-09-12T02:49:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.613+0000 7f84c7e00640 1 -- 172.21.15.18:0/2407107558 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c81ab260 con 0x7f84c81044a0 2024-09-12T02:49:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.616+0000 7f84d0c57740 1 Processor -- start 2024-09-12T02:49:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.617+0000 7f84d0c57740 1 -- start start 2024-09-12T02:49:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.617+0000 7f84d0c57740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf2c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.617+0000 7f84d0c57740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2ccd0 0x55b8fbf37030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.617+0000 7f84d0c57740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 0x55b8fbf39960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.617+0000 7f84d0c57740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b8fbe92100 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.617+0000 7f84d0c57740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b8fbe3a1b0 con 0x55b8fbf2ccd0 2024-09-12T02:49:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.617+0000 7f84d0c57740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55b8fbe8e0c0 con 0x55b8fbf37570 2024-09-12T02:49:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.617+0000 7f84c7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf2c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.617+0000 7f84c7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf2c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47662/0 (socket says 172.21.15.18:47662) 2024-09-12T02:49:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.617+0000 7f84c7400640 1 -- 172.21.15.18:0/685519336 learned_addr learned my addr 172.21.15.18:0/685519336 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.618+0000 7f84c7400640 1 -- 172.21.15.18:0/685519336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 msgr2=0x55b8fbf39960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:49:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.618+0000 7f84c7400640 1 --2- 172.21.15.18:0/685519336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 0x55b8fbf39960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.618+0000 7f84c7400640 1 -- 172.21.15.18:0/685519336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2ccd0 msgr2=0x55b8fbf37030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.618+0000 7f84c7400640 1 --2- 172.21.15.18:0/685519336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2ccd0 0x55b8fbf37030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.618+0000 7f84c7400640 1 -- 172.21.15.18:0/685519336 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8fbba5210 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.618+0000 7f84cca00640 1 -- 172.21.15.18:0/2407107558 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 26) ==== 138066+0+0 (secure 0 0 0) 0x7f84b4010ac0 con 0x7f84c81044a0 2024-09-12T02:49:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.618+0000 7f84c7400640 1 --2- 172.21.15.18:0/685519336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf2c790 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f84c0011440 tx=0x7f84c0011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218d9a3aa8db2a20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.619+0000 7f84b3e00640 1 -- 172.21.15.18:0/685519336 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c0004020 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.619+0000 7f84b3e00640 1 -- 172.21.15.18:0/685519336 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84c00041c0 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.619+0000 7f84b3e00640 1 -- 172.21.15.18:0/685519336 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c000f950 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.619+0000 7f84d0c57740 1 -- 172.21.15.18:0/685519336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 msgr2=0x55b8fbf2c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.619+0000 7f84d0c57740 1 --2- 172.21.15.18:0/685519336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf2c790 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f84c0011440 tx=0x7f84c0011900 comp rx=0 tx=0).stop 2024-09-12T02:49:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.619+0000 7f84d0c57740 1 -- 172.21.15.18:0/685519336 shutdown_connections 2024-09-12T02:49:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.619+0000 7f84d0c57740 1 --2- 172.21.15.18:0/685519336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 0x55b8fbf39960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.619+0000 7f84d0c57740 1 --2- 172.21.15.18:0/685519336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2ccd0 0x55b8fbf37030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.619+0000 7f84d0c57740 1 --2- 172.21.15.18:0/685519336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf2c790 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.620+0000 7f84d0c57740 1 -- 172.21.15.18:0/685519336 >> 172.21.15.18:0/685519336 conn(0x55b8fbf28920 msgr2=0x55b8fbf28d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.620+0000 7f84d0c57740 1 -- 172.21.15.18:0/685519336 shutdown_connections 2024-09-12T02:49:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.620+0000 7f84d0c57740 1 -- 172.21.15.18:0/685519336 wait complete. 2024-09-12T02:49:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.620+0000 7f84cca00640 1 --2- 172.21.15.18:0/2407107558 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f84ac0a2d20 0x7f84ac0a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.620+0000 7f84cca00640 1 -- 172.21.15.18:0/2407107558 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f84b40cfe40 con 0x7f84c81044a0 2024-09-12T02:49:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.620+0000 7f84d0c57740 1 -- start start 2024-09-12T02:49:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.620+0000 7f84c6a00640 1 --2- 172.21.15.18:0/2407107558 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f84ac0a2d20 0x7f84ac0a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.621+0000 7f84d0c57740 1 Processor -- start 2024-09-12T02:49:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.621+0000 7f84d0c57740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf34590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.621+0000 7f84d0c57740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2ccd0 0x55b8fbf34ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.621+0000 7f84d0c57740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 0x55b8fbf35010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.621+0000 7f84c6a00640 1 --2- 172.21.15.18:0/2407107558 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f84ac0a2d20 0x7f84ac0a51e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f84b8006010 tx=0x7f84b80093a0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.621+0000 7f84d0c57740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b8fbf39ff0 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.621+0000 7f84d0c57740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b8fbe1b090 con 0x55b8fbf2ccd0 2024-09-12T02:49:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.621+0000 7f84d0c57740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55b8fbf3a170 con 0x55b8fbf37570 2024-09-12T02:49:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.622+0000 7f84d0c57740 10 client.0 _ll_register_callbacks cb 0x55b8fbe6ff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.622+0000 7f84c6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf34590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.622+0000 7f84c6000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2ccd0 0x55b8fbf34ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.622+0000 7f84c6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf34590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47670/0 (socket says 172.21.15.18:47670) 2024-09-12T02:49:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.622+0000 7f84c6a00640 1 -- 172.21.15.18:0/2562274454 learned_addr learned my addr 172.21.15.18:0/2562274454 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.622+0000 7f84c7400640 1 --2- 172.21.15.18:0/2562274454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 0x55b8fbf35010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.622+0000 7f84c6000640 1 -- 172.21.15.18:0/2562274454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 msgr2=0x55b8fbf35010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.622+0000 7f84c6000640 1 --2- 172.21.15.18:0/2562274454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 0x55b8fbf35010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.622+0000 7f84c6000640 1 -- 172.21.15.18:0/2562274454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 msgr2=0x55b8fbf34590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.622+0000 7f84c6000640 1 --2- 172.21.15.18:0/2562274454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf34590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.622+0000 7f84c6000640 1 -- 172.21.15.18:0/2562274454 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8fbc71620 con 0x55b8fbf2ccd0 2024-09-12T02:49:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.623+0000 7f84c6000640 1 --2- 172.21.15.18:0/2562274454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2ccd0 0x55b8fbf34ad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f84b40ccfc0 tx=0x7f84b409bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4f9331995323cd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.623+0000 7f84b0c00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:49:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.623+0000 7f84b0c00640 1 -- 172.21.15.18:0/2562274454 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b409a160 con 0x55b8fbf2ccd0 2024-09-12T02:49:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.623+0000 7f84d0c57740 1 -- 172.21.15.18:0/2562274454 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84c00041c0 con 0x55b8fbf2ccd0 2024-09-12T02:49:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.623+0000 7f84b0c00640 1 -- 172.21.15.18:0/2562274454 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f84b409b1f0 con 0x55b8fbf2ccd0 2024-09-12T02:49:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.623+0000 7f84b0c00640 1 -- 172.21.15.18:0/2562274454 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f84b409b3f0 con 0x55b8fbf2ccd0 2024-09-12T02:49:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.623+0000 7f84d0c57740 10 client.25370 fetch_fsmap learned FSMap version 32 2024-09-12T02:49:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.623+0000 7f84d0c57740 1 -- 172.21.15.18:0/2562274454 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b8fbf45f00 con 0x55b8fbf2ccd0 2024-09-12T02:49:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.624+0000 7f84b0c00640 1 -- 172.21.15.18:0/2562274454 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84c00041c0 con 0x55b8fbf2ccd0 2024-09-12T02:49:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.624+0000 7f84b0c00640 1 -- 172.21.15.18:0/2562274454 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f84b4018ac0 con 0x55b8fbf2ccd0 2024-09-12T02:49:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.624+0000 7f84d0c57740 10 client.25370 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T02:49:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.624+0000 7f84d0c57740 10 client.25370 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.624+0000 7f84d0c57740 20 client.25370 populate_metadata read hostname 'smithi018' 2024-09-12T02:49:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.624+0000 7f84d0c57740 1 --2- 172.21.15.18:0/2562274454 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55b8fbf473c0 0x55b8fbf497b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.624+0000 7f84d0c57740 4 client.25370 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.624+0000 7f84d0c57740 1 -- 172.21.15.18:0/2562274454 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8fbe9f830 con 0x55b8fbf473c0 2024-09-12T02:49:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.625+0000 7f84c6a00640 1 --2- 172.21.15.18:0/2562274454 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55b8fbf473c0 0x55b8fbf497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.625+0000 7f84c6a00640 1 --2- 172.21.15.18:0/2562274454 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55b8fbf473c0 0x55b8fbf497b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2e646156c6fb55a server_cookie=cf65d3160e76ab96 in_seq=0 out_seq=0 2024-09-12T02:49:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.625+0000 7f84b0c00640 10 client.25370 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.626+0000 7f84b0c00640 1 -- 172.21.15.18:0/2562274454 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b8fbe9f830 con 0x55b8fbf473c0 2024-09-12T02:49:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.626+0000 7f84b0c00640 10 client.25370 handle_command_reply: tid=0 2024-09-12T02:49:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.626+0000 7f84d0c57740 1 client.25370 shutdown 2024-09-12T02:49:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.626+0000 7f84d0c57740 1 -- 172.21.15.18:0/2562274454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2ccd0 msgr2=0x55b8fbf34ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.626+0000 7f84d0c57740 1 --2- 172.21.15.18:0/2562274454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2ccd0 0x55b8fbf34ad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f84b40ccfc0 tx=0x7f84b409bca0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.626+0000 7f84d0c57740 1 -- 172.21.15.18:0/2562274454 shutdown_connections 2024-09-12T02:49:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.626+0000 7f84d0c57740 1 --2- 172.21.15.18:0/2562274454 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55b8fbf473c0 0x55b8fbf497b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.626+0000 7f84d0c57740 1 --2- 172.21.15.18:0/2562274454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 0x55b8fbf35010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.626+0000 7f84d0c57740 1 --2- 172.21.15.18:0/2562274454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2ccd0 0x55b8fbf34ad0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.627+0000 7f84b0c00640 0 client.25370 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.627+0000 7f84d0c57740 1 --2- 172.21.15.18:0/2562274454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf34590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.627+0000 7f84d0c57740 1 -- 172.21.15.18:0/2562274454 >> 172.21.15.18:0/2562274454 conn(0x55b8fbf28920 msgr2=0x55b8fbf2e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.627+0000 7f84d0c57740 1 -- 172.21.15.18:0/2562274454 shutdown_connections 2024-09-12T02:49:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.627+0000 7f84d0c57740 1 -- 172.21.15.18:0/2562274454 wait complete. 2024-09-12T02:49:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.627+0000 7f84d0c57740 20 client.25370 trim_cache size 0 max 16384 2024-09-12T02:49:39.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.656+0000 7f84d0c57740 1 Processor -- start 2024-09-12T02:49:39.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.656+0000 7f84d0c57740 1 -- start start 2024-09-12T02:49:39.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.657+0000 7f84d0c57740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf2ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.657+0000 7f84d0c57740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2ccd0 0x55b8fbf34e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.657+0000 7f84d0c57740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 0x55b8fbf4f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.657+0000 7f84d0c57740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f84c81b5610 con 0x55b8fbf2ccd0 2024-09-12T02:49:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.657+0000 7f84d0c57740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f84c81b71b0 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.657+0000 7f84d0c57740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84c81b5ce0 con 0x55b8fbf37570 2024-09-12T02:49:39.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.657+0000 7f84c6a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf2ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:39.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.657+0000 7f84c6a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf2ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:51348/0 (socket says 172.21.15.18:51348) 2024-09-12T02:49:39.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.657+0000 7f84c6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2ccd0 0x55b8fbf34e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:39.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.657+0000 7f84c6a00640 1 -- 172.21.15.18:0/3936640134 learned_addr learned my addr 172.21.15.18:0/3936640134 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:39.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.657+0000 7f84c7400640 1 --2- 172.21.15.18:0/3936640134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 0x55b8fbf4f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:39.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.658+0000 7f84c6a00640 1 -- 172.21.15.18:0/3936640134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 msgr2=0x55b8fbf4f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:39.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.658+0000 7f84c6a00640 1 --2- 172.21.15.18:0/3936640134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 0x55b8fbf4f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.658+0000 7f84c6a00640 1 -- 172.21.15.18:0/3936640134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2ccd0 msgr2=0x55b8fbf34e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.658+0000 7f84c6a00640 1 --2- 172.21.15.18:0/3936640134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2ccd0 0x55b8fbf34e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.658+0000 7f84c6a00640 1 -- 172.21.15.18:0/3936640134 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8fbf49de0 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.658+0000 7f84c6a00640 1 --2- 172.21.15.18:0/3936640134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf2ee70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009ca0 tx=0x7f84b8041000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1e3a192077dc193 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.659+0000 7f84b3400640 1 -- 172.21.15.18:0/3936640134 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b8055070 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.659+0000 7f84b3400640 1 -- 172.21.15.18:0/3936640134 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84b8004520 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.659+0000 7f84b3400640 1 -- 172.21.15.18:0/3936640134 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b8050ae0 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.659+0000 7f84d0c57740 1 -- 172.21.15.18:0/3936640134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2c3b0 msgr2=0x55b8fbf2ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.659+0000 7f84d0c57740 1 --2- 172.21.15.18:0/3936640134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf2ee70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009ca0 tx=0x7f84b8041000 comp rx=0 tx=0).stop 2024-09-12T02:49:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.659+0000 7f84d0c57740 1 -- 172.21.15.18:0/3936640134 shutdown_connections 2024-09-12T02:49:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.659+0000 7f84d0c57740 1 --2- 172.21.15.18:0/3936640134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 0x55b8fbf4f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.659+0000 7f84d0c57740 1 --2- 172.21.15.18:0/3936640134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2ccd0 0x55b8fbf34e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.659+0000 7f84d0c57740 1 --2- 172.21.15.18:0/3936640134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf2ee70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.659+0000 7f84d0c57740 1 -- 172.21.15.18:0/3936640134 >> 172.21.15.18:0/3936640134 conn(0x55b8fbf28920 msgr2=0x55b8fbf279c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.660+0000 7f84d0c57740 1 -- 172.21.15.18:0/3936640134 shutdown_connections 2024-09-12T02:49:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.660+0000 7f84d0c57740 1 -- 172.21.15.18:0/3936640134 wait complete. 2024-09-12T02:49:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.660+0000 7f84d0c57740 1 -- start start 2024-09-12T02:49:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.660+0000 7f84d0c57740 1 Processor -- start 2024-09-12T02:49:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.661+0000 7f84d0c57740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf3fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.661+0000 7f84d0c57740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2ccd0 0x55b8fbf3b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.661+0000 7f84d0c57740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 0x55b8fbf3b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.661+0000 7f84d0c57740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f84c81b6a80 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.661+0000 7f84d0c57740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f84c81b63b0 con 0x55b8fbf2ccd0 2024-09-12T02:49:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.661+0000 7f84d0c57740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84c81b35f0 con 0x55b8fbf37570 2024-09-12T02:49:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.661+0000 7f84d0c57740 10 client.0 _ll_register_callbacks cb 0x7f84b4009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.661+0000 7f84c6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf3fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.662+0000 7f84c6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf3fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47690/0 (socket says 172.21.15.18:47690) 2024-09-12T02:49:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.662+0000 7f84c6a00640 1 -- 172.21.15.18:0/2755944897 learned_addr learned my addr 172.21.15.18:0/2755944897 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.662+0000 7f84c7400640 1 --2- 172.21.15.18:0/2755944897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 0x55b8fbf3b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.662+0000 7f84c6000640 1 --2- 172.21.15.18:0/2755944897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2ccd0 0x55b8fbf3b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.662+0000 7f84c6a00640 1 -- 172.21.15.18:0/2755944897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 msgr2=0x55b8fbf3b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.662+0000 7f84c6a00640 1 --2- 172.21.15.18:0/2755944897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 0x55b8fbf3b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.662+0000 7f84c6a00640 1 -- 172.21.15.18:0/2755944897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2ccd0 msgr2=0x55b8fbf3b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.662+0000 7f84c6a00640 1 --2- 172.21.15.18:0/2755944897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2ccd0 0x55b8fbf3b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.662+0000 7f84c6a00640 1 -- 172.21.15.18:0/2755944897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8fbf295b0 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.662+0000 7f84c7400640 1 --2- 172.21.15.18:0/2755944897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 0x55b8fbf3b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.662+0000 7f84c6a00640 1 --2- 172.21.15.18:0/2755944897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf3fe20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f84b802a920 tx=0x7f84b8031a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3b83c329a29494 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.662+0000 7f84b0c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:49:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.663+0000 7f84b0c00640 1 -- 172.21.15.18:0/2755944897 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b8055070 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.663+0000 7f84d0c57740 1 -- 172.21.15.18:0/2755944897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84b8004520 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.663+0000 7f84b0c00640 1 -- 172.21.15.18:0/2755944897 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f84b80503d0 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.663+0000 7f84b0c00640 1 -- 172.21.15.18:0/2755944897 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f84b8003fc0 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.663+0000 7f84d0c57740 10 client.15378 fetch_fsmap learned FSMap version 32 2024-09-12T02:49:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.663+0000 7f84d0c57740 1 -- 172.21.15.18:0/2755944897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b8fbfb2060 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.664+0000 7f84b0c00640 1 -- 172.21.15.18:0/2755944897 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84b8004520 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.664+0000 7f84b0c00640 1 -- 172.21.15.18:0/2755944897 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f84b8030070 con 0x55b8fbf2c3b0 2024-09-12T02:49:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.664+0000 7f84d0c57740 10 client.15378 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T02:49:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.664+0000 7f84d0c57740 10 client.15378 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.664+0000 7f84d0c57740 20 client.15378 populate_metadata read hostname 'smithi018' 2024-09-12T02:49:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.664+0000 7f84d0c57740 1 --2- 172.21.15.18:0/2755944897 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55b8fbfb2720 0x55b8fbfb4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.664+0000 7f84d0c57740 4 client.15378 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:49:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.664+0000 7f84d0c57740 1 -- 172.21.15.18:0/2755944897 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b8fbe99b80 con 0x55b8fbfb2720 2024-09-12T02:49:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.665+0000 7f84c6000640 1 --2- 172.21.15.18:0/2755944897 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55b8fbfb2720 0x55b8fbfb4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.666+0000 7f84b0c00640 10 client.15378 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:39.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.666+0000 7f84c6000640 1 --2- 172.21.15.18:0/2755944897 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55b8fbfb2720 0x55b8fbfb4b10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f71c74607dcad501 server_cookie=5c290fd9a6fc8826 in_seq=0 out_seq=0 2024-09-12T02:49:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.670+0000 7f84b0c00640 1 -- 172.21.15.18:0/2755944897 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b8fbe99b80 con 0x55b8fbfb2720 2024-09-12T02:49:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.670+0000 7f84b0c00640 10 client.15378 handle_command_reply: tid=0 2024-09-12T02:49:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.670+0000 7f84d0c57740 1 client.15378 shutdown 2024-09-12T02:49:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.670+0000 7f84d0c57740 1 -- 172.21.15.18:0/2755944897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 msgr2=0x55b8fbf3fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.670+0000 7f84d0c57740 1 --2- 172.21.15.18:0/2755944897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf3fe20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f84b802a920 tx=0x7f84b8031a70 comp rx=0 tx=0).stop 2024-09-12T02:49:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.670+0000 7f84d0c57740 1 -- 172.21.15.18:0/2755944897 shutdown_connections 2024-09-12T02:49:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.670+0000 7f84d0c57740 1 --2- 172.21.15.18:0/2755944897 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55b8fbfb2720 0x55b8fbfb4b10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.670+0000 7f84d0c57740 1 --2- 172.21.15.18:0/2755944897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b8fbf37570 0x55b8fbf3b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.670+0000 7f84d0c57740 1 --2- 172.21.15.18:0/2755944897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b8fbf2ccd0 0x55b8fbf3b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.670+0000 7f84d0c57740 1 --2- 172.21.15.18:0/2755944897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8fbf2c3b0 0x55b8fbf3fe20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.670+0000 7f84d0c57740 1 -- 172.21.15.18:0/2755944897 >> 172.21.15.18:0/2755944897 conn(0x55b8fbf28920 msgr2=0x55b8fbf35c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.670+0000 7f84b0c00640 0 client.15378 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.670+0000 7f84d0c57740 1 -- 172.21.15.18:0/2755944897 shutdown_connections 2024-09-12T02:49:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.671+0000 7f84d0c57740 1 -- 172.21.15.18:0/2755944897 wait complete. 2024-09-12T02:49:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.671+0000 7f84d0c57740 20 client.15378 trim_cache size 0 max 16384 2024-09-12T02:49:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:49:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:49:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:49:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:49:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.671+0000 7f84c7e00640 1 -- 172.21.15.18:0/2407107558 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f84ac0a2d20 msgr2=0x7f84ac0a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.671+0000 7f84c7e00640 1 --2- 172.21.15.18:0/2407107558 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f84ac0a2d20 0x7f84ac0a51e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f84b8006010 tx=0x7f84b80093a0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.671+0000 7f84c7e00640 1 -- 172.21.15.18:0/2407107558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c81044a0 msgr2=0x7f84c8076c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.671+0000 7f84c7e00640 1 --2- 172.21.15.18:0/2407107558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c81044a0 0x7f84c8076c40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f84b400ea20 tx=0x7f84b400eee0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.672+0000 7f84c7e00640 1 -- 172.21.15.18:0/2407107558 shutdown_connections 2024-09-12T02:49:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.672+0000 7f84c7e00640 1 --2- 172.21.15.18:0/2407107558 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f84ac0a2d20 0x7f84ac0a51e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.672+0000 7f84c7e00640 1 --2- 172.21.15.18:0/2407107558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c8109ba0 0x7f84c8077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.672+0000 7f84c7e00640 1 --2- 172.21.15.18:0/2407107558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c81044a0 0x7f84c8076c40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.672+0000 7f84c7e00640 1 --2- 172.21.15.18:0/2407107558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84c8103b00 0x7f84c8076700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.672+0000 7f84c7e00640 1 -- 172.21.15.18:0/2407107558 >> 172.21.15.18:0/2407107558 conn(0x7f84c80ff7c0 msgr2=0x7f84c81000f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.672+0000 7f84c7e00640 1 -- 172.21.15.18:0/2407107558 shutdown_connections 2024-09-12T02:49:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:39.672+0000 7f84c7e00640 1 -- 172.21.15.18:0/2407107558 wait complete. 2024-09-12T02:49:40.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:40 smithi176 ceph-mon[35713]: pgmap v31: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-12T02:49:40.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:40 smithi062 ceph-mon[35527]: pgmap v31: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-12T02:49:40.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:40 smithi018 ceph-mon[30616]: pgmap v31: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-12T02:49:42.489 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:42 smithi176 ceph-mon[35713]: pgmap v32: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-12T02:49:42.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:42 smithi062 ceph-mon[35527]: pgmap v32: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-12T02:49:42.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:42 smithi018 ceph-mon[30616]: pgmap v32: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-12T02:49:44.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:44 smithi176 ceph-mon[35713]: pgmap v33: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:49:44.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:44 smithi062 ceph-mon[35527]: pgmap v33: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:49:44.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:44 smithi018 ceph-mon[30616]: pgmap v33: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:49:46.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:46 smithi176 ceph-mon[35713]: pgmap v34: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-12T02:49:46.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:46 smithi062 ceph-mon[35527]: pgmap v34: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-12T02:49:46.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:46 smithi018 ceph-mon[30616]: pgmap v34: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-12T02:49:48.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:48 smithi176 ceph-mon[35713]: pgmap v35: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T02:49:48.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:48 smithi062 ceph-mon[35527]: pgmap v35: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T02:49:48.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:48 smithi018 ceph-mon[30616]: pgmap v35: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T02:49:49.963 INFO:tasks.workunit.client.0.smithi018.stderr:Updating files: 62% (8068/12903) Updating files: 63% (8129/12903) Updating files: 64% (8258/12903) Updating files: 65% (8387/12903) Updating files: 66% (8516/12903) Updating files: 67% (8646/12903) Updating files: 68% (8775/12903) Updating files: 69% (8904/12903) Updating files: 70% (9033/12903) Updating files: 71% (9162/12903) Updating files: 72% (9291/12903) Updating files: 73% (9420/12903) Updating files: 74% (9549/12903) Updating files: 75% (9678/12903) Updating files: 76% (9807/12903) Updating files: 77% (9936/12903) Updating files: 78% (10065/12903) Updating files: 79% (10194/12903) Updating files: 80% (10323/12903) Updating files: 81% (10452/12903) Updating files: 82% (10581/12903) Updating files: 83% (10710/12903) Updating files: 84% (10839/12903) Updating files: 85% (10968/12903) Updating files: 86% (11097/12903) Updating files: 87% (11226/12903) Updating files: 88% (11355/12903) Updating files: 89% (11484/12903) Updating files: 90% (11613/12903) Updating files: 91% (11742/12903) Updating files: 92% (11871/12903) Updating files: 93% (12000/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 98% (12659/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T02:49:50.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:50 smithi176 ceph-mon[35713]: pgmap v36: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-12T02:49:50.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:50 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:49:50.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:50 smithi062 ceph-mon[35527]: pgmap v36: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-12T02:49:50.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:50 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:49:50.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:50 smithi018 ceph-mon[30616]: pgmap v36: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-12T02:49:50.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:50 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:49:51.115 INFO:tasks.workunit.client.0.smithi018.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T02:49:51.116 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-12T02:49:51.116 INFO:tasks.workunit.client.0.smithi018.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T02:49:51.116 INFO:tasks.workunit.client.0.smithi018.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T02:49:51.116 INFO:tasks.workunit.client.0.smithi018.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T02:49:51.116 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-12T02:49:51.116 INFO:tasks.workunit.client.0.smithi018.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T02:49:51.116 INFO:tasks.workunit.client.0.smithi018.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T02:49:51.116 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-12T02:49:51.116 INFO:tasks.workunit.client.0.smithi018.stderr: git switch -c 2024-09-12T02:49:51.116 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-12T02:49:51.116 INFO:tasks.workunit.client.0.smithi018.stderr:Or undo this operation with: 2024-09-12T02:49:51.116 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-12T02:49:51.117 INFO:tasks.workunit.client.0.smithi018.stderr: git switch - 2024-09-12T02:49:51.117 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-12T02:49:51.117 INFO:tasks.workunit.client.0.smithi018.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T02:49:51.117 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-12T02:49:51.117 INFO:tasks.workunit.client.0.smithi018.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T02:49:51.131 DEBUG:teuthology.orchestra.run.smithi018:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T02:49:51.219 INFO:tasks.workunit.client.0.smithi018.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T02:49:51.223 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:49:51.223 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T02:49:51.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:51 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:49:51.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:51 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:49:51.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:51 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:49:51.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:51 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:49:51.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:51 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:49:51.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:51 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:49:51.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:51 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:49:51.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:51 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:49:51.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:51 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:49:51.951 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T02:49:52.056 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T02:49:52.122 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:49:52.125 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:49:52.126 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T02:49:52.191 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:49:52.199 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T02:49:52.199 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T02:49:52.235 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-09-12T02:49:52.236 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-09-12T02:49:52.236 DEBUG:teuthology.orchestra.run.smithi018:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-09-12T02:49:52.326 INFO:tasks.workunit.client.0.smithi018.stdout:getting blogbench 2024-09-12T02:49:52.326 INFO:tasks.workunit.client.0.smithi018.stderr:+ echo 'getting blogbench' 2024-09-12T02:49:52.326 INFO:tasks.workunit.client.0.smithi018.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-12T02:49:52.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:52 smithi176 ceph-mon[35713]: pgmap v37: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-12T02:49:52.480 INFO:tasks.workunit.client.0.smithi018.stderr:--2024-09-12 02:49:52-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-12T02:49:52.481 INFO:tasks.workunit.client.0.smithi018.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-12T02:49:52.502 INFO:tasks.workunit.client.0.smithi018.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-12T02:49:52.523 INFO:tasks.workunit.client.0.smithi018.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T02:49:52.523 INFO:tasks.workunit.client.0.smithi018.stderr:Length: 103355 (101K) [application/octet-stream] 2024-09-12T02:49:52.525 INFO:tasks.workunit.client.0.smithi018.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-09-12T02:49:52.530 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-12T02:49:52.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:52 smithi062 ceph-mon[35527]: pgmap v37: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-12T02:49:52.564 INFO:tasks.workunit.client.0.smithi018.stderr: 0K .......... .......... .......... .......... .......... 49% 1.27M 0s 2024-09-12T02:49:52.585 INFO:tasks.workunit.client.0.smithi018.stderr: 50K .......... .......... .......... .......... .......... 99% 2.41M 0s 2024-09-12T02:49:52.585 INFO:tasks.workunit.client.0.smithi018.stderr: 100K 100% 1.74T=0.06s 2024-09-12T02:49:52.585 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-12T02:49:52.585 INFO:tasks.workunit.client.0.smithi018.stderr:2024-09-12 02:49:52 (1.68 MB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-09-12T02:49:52.585 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-12T02:49:52.585 INFO:tasks.workunit.client.0.smithi018.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-09-12T02:49:52.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:52 smithi018 ceph-mon[30616]: pgmap v37: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-12T02:49:52.630 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/ 2024-09-12T02:49:52.631 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/m4/ 2024-09-12T02:49:52.633 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-09-12T02:49:52.634 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/man/ 2024-09-12T02:49:52.636 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/man/blogbench.8 2024-09-12T02:49:52.637 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/man/Makefile.am 2024-09-12T02:49:52.639 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/man/Makefile.in 2024-09-12T02:49:52.641 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/ 2024-09-12T02:49:52.642 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/mysnprintf.c 2024-09-12T02:49:52.644 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/mysnprintf.h 2024-09-12T02:49:52.646 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/blogbench.c 2024-09-12T02:49:52.647 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/blogbench.h 2024-09-12T02:49:52.649 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/fakesnprintf.c 2024-09-12T02:49:52.651 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/fakesnprintf.h 2024-09-12T02:49:52.653 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/blogbench_p.h 2024-09-12T02:49:52.654 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-09-12T02:49:52.656 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-09-12T02:49:52.657 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/Makefile.am 2024-09-12T02:49:52.658 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/Makefile.in 2024-09-12T02:49:52.660 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/process.c 2024-09-12T02:49:52.661 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/globals.h 2024-09-12T02:49:52.662 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/commenter.c 2024-09-12T02:49:52.663 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/rewriter.c 2024-09-12T02:49:52.664 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/reader.c 2024-09-12T02:49:52.665 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/writer.c 2024-09-12T02:49:52.666 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/src/helpers.c 2024-09-12T02:49:52.667 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/NEWS 2024-09-12T02:49:52.669 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/compile 2024-09-12T02:49:52.670 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/depcomp 2024-09-12T02:49:52.671 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/aclocal.m4 2024-09-12T02:49:52.673 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/README 2024-09-12T02:49:52.674 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/configure 2024-09-12T02:49:52.678 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/configure.ac 2024-09-12T02:49:52.679 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/config.guess 2024-09-12T02:49:52.681 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/install-sh 2024-09-12T02:49:52.682 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/config.sub 2024-09-12T02:49:52.683 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/missing 2024-09-12T02:49:52.684 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/mkinstalldirs 2024-09-12T02:49:52.685 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/Makefile.am 2024-09-12T02:49:52.686 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/Makefile.in 2024-09-12T02:49:52.687 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/config.h.in 2024-09-12T02:49:52.689 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/AUTHORS 2024-09-12T02:49:52.690 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/INSTALL 2024-09-12T02:49:52.691 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/ChangeLog 2024-09-12T02:49:52.692 INFO:tasks.workunit.client.0.smithi018.stdout:blogbench-1.0/COPYING 2024-09-12T02:49:52.693 INFO:tasks.workunit.client.0.smithi018.stderr:+ cd blogbench-1.0/ 2024-09-12T02:49:52.694 INFO:tasks.workunit.client.0.smithi018.stdout:making blogbench 2024-09-12T02:49:52.694 INFO:tasks.workunit.client.0.smithi018.stderr:+ echo 'making blogbench' 2024-09-12T02:49:52.694 INFO:tasks.workunit.client.0.smithi018.stderr:+ ./configure 2024-09-12T02:49:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.793+0000 7fd306600640 1 -- 172.21.15.18:0/3836776214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300103f30 msgr2=0x7fd300104310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.793+0000 7fd306600640 1 --2- 172.21.15.18:0/3836776214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300103f30 0x7fd300104310 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009900 tx=0x7fd2f002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.794+0000 7fd306600640 1 -- 172.21.15.18:0/3836776214 shutdown_connections 2024-09-12T02:49:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.794+0000 7fd306600640 1 --2- 172.21.15.18:0/3836776214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd300109080 0x7fd300110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.794+0000 7fd306600640 1 --2- 172.21.15.18:0/3836776214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3001048e0 0x7fd300108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.794+0000 7fd306600640 1 --2- 172.21.15.18:0/3836776214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300103f30 0x7fd300104310 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.794+0000 7fd306600640 1 -- 172.21.15.18:0/3836776214 >> 172.21.15.18:0/3836776214 conn(0x7fd3000ff980 msgr2=0x7fd300101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.794+0000 7fd306600640 1 -- 172.21.15.18:0/3836776214 shutdown_connections 2024-09-12T02:49:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.794+0000 7fd306600640 1 -- 172.21.15.18:0/3836776214 wait complete. 2024-09-12T02:49:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.795+0000 7fd306600640 1 Processor -- start 2024-09-12T02:49:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.795+0000 7fd306600640 1 -- start start 2024-09-12T02:49:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.795+0000 7fd306600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300103f30 0x7fd30019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.795+0000 7fd306600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd300109080 0x7fd30019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.795+0000 7fd306600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd30019ee20 0x7fd30019f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.795+0000 7fd306600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd3001140f0 con 0x7fd300103f30 2024-09-12T02:49:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.795+0000 7fd306600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd300113f70 con 0x7fd300109080 2024-09-12T02:49:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.795+0000 7fd306600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd300114270 con 0x7fd30019ee20 2024-09-12T02:49:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.795+0000 7fd2ff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300103f30 0x7fd30019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.795+0000 7fd2ff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300103f30 0x7fd30019a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44082/0 (socket says 172.21.15.18:44082) 2024-09-12T02:49:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.795+0000 7fd2ff400640 1 -- 172.21.15.18:0/3668535431 learned_addr learned my addr 172.21.15.18:0/3668535431 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.796+0000 7fd2fea00640 1 --2- 172.21.15.18:0/3668535431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd300109080 0x7fd30019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.796+0000 7fd2ffe00640 1 --2- 172.21.15.18:0/3668535431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd30019ee20 0x7fd30019f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.796+0000 7fd2fea00640 1 -- 172.21.15.18:0/3668535431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd30019ee20 msgr2=0x7fd30019f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.796+0000 7fd2fea00640 1 --2- 172.21.15.18:0/3668535431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd30019ee20 0x7fd30019f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.796+0000 7fd2fea00640 1 -- 172.21.15.18:0/3668535431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300103f30 msgr2=0x7fd30019a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.796+0000 7fd2fea00640 1 --2- 172.21.15.18:0/3668535431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300103f30 0x7fd30019a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.796+0000 7fd2fea00640 1 -- 172.21.15.18:0/3668535431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30019f910 con 0x7fd300109080 2024-09-12T02:49:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.796+0000 7fd2ff400640 1 --2- 172.21.15.18:0/3668535431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300103f30 0x7fd30019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.796+0000 7fd2fea00640 1 --2- 172.21.15.18:0/3668535431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd300109080 0x7fd30019aaa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec005fd0 tx=0x7fd2ec00dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.796+0000 7fd2f7e00640 1 -- 172.21.15.18:0/3668535431 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec009c00 con 0x7fd300109080 2024-09-12T02:49:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.797+0000 7fd306600640 1 -- 172.21.15.18:0/3668535431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd30019fc00 con 0x7fd300109080 2024-09-12T02:49:52.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.797+0000 7fd2f7e00640 1 -- 172.21.15.18:0/3668535431 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2ec009da0 con 0x7fd300109080 2024-09-12T02:49:52.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.797+0000 7fd2f7e00640 1 -- 172.21.15.18:0/3668535431 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec010460 con 0x7fd300109080 2024-09-12T02:49:52.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.797+0000 7fd306600640 1 -- 172.21.15.18:0/3668535431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3001a7440 con 0x7fd300109080 2024-09-12T02:49:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.800+0000 7fd2f7e00640 1 -- 172.21.15.18:0/3668535431 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 26) ==== 138066+0+0 (secure 0 0 0) 0x7fd2ec003f50 con 0x7fd300109080 2024-09-12T02:49:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.800+0000 7fd3094b5740 1 Processor -- start 2024-09-12T02:49:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.801+0000 7fd3094b5740 1 -- start start 2024-09-12T02:49:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.801+0000 7fd3094b5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 0x558050dd75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.801+0000 7fd3094b5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050de1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.801+0000 7fd3094b5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050de23a0 0x558050de4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.801+0000 7fd3094b5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558050d3d100 con 0x558050de23a0 2024-09-12T02:49:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.801+0000 7fd3094b5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558050ce51b0 con 0x558050dd71e0 2024-09-12T02:49:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.801+0000 7fd3094b5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x558050d390c0 con 0x558050dd7b00 2024-09-12T02:49:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.801+0000 7fd2ffe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 0x558050dd75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.801+0000 7fd2ffe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 0x558050dd75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:47680/0 (socket says 172.21.15.18:47680) 2024-09-12T02:49:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.801+0000 7fd2ffe00640 1 -- 172.21.15.18:0/4034917646 learned_addr learned my addr 172.21.15.18:0/4034917646 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.801+0000 7fd2fea00640 1 --2- 172.21.15.18:0/4034917646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050de23a0 0x558050de4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.801+0000 7fd2ff400640 1 --2- 172.21.15.18:0/4034917646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050de1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.802+0000 7fd2ffe00640 1 -- 172.21.15.18:0/4034917646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 msgr2=0x558050de1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.802+0000 7fd2ffe00640 1 --2- 172.21.15.18:0/4034917646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050de1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.802+0000 7fd2ffe00640 1 -- 172.21.15.18:0/4034917646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050de23a0 msgr2=0x558050de4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.802+0000 7fd2ffe00640 1 --2- 172.21.15.18:0/4034917646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050de23a0 0x558050de4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.802+0000 7fd2ffe00640 1 -- 172.21.15.18:0/4034917646 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558050a50210 con 0x558050dd71e0 2024-09-12T02:49:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.802+0000 7fd2ffe00640 1 --2- 172.21.15.18:0/4034917646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 0x558050dd75c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009f70 tx=0x7fd2f8010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59cdd19fc7c4daf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.802+0000 7fd2f7e00640 1 --2- 172.21.15.18:0/3668535431 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd2e40a2f40 0x7fd2e40a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.802+0000 7fd2f4c00640 1 -- 172.21.15.18:0/4034917646 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8016070 con 0x558050dd71e0 2024-09-12T02:49:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.802+0000 7fd2f7e00640 1 -- 172.21.15.18:0/3668535431 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fd2ec0cf5f0 con 0x7fd300109080 2024-09-12T02:49:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.802+0000 7fd2f4c00640 1 -- 172.21.15.18:0/4034917646 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2f8004d20 con 0x558050dd71e0 2024-09-12T02:49:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.802+0000 7fd2f4c00640 1 -- 172.21.15.18:0/4034917646 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8012950 con 0x558050dd71e0 2024-09-12T02:49:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.802+0000 7fd2ff400640 1 --2- 172.21.15.18:0/3668535431 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd2e40a2f40 0x7fd2e40a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.803+0000 7fd3094b5740 1 -- 172.21.15.18:0/4034917646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 msgr2=0x558050dd75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.803+0000 7fd3094b5740 1 --2- 172.21.15.18:0/4034917646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 0x558050dd75c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009f70 tx=0x7fd2f8010800 comp rx=0 tx=0).stop 2024-09-12T02:49:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.803+0000 7fd2ff400640 1 --2- 172.21.15.18:0/3668535431 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd2e40a2f40 0x7fd2e40a5400 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0005c40 tx=0x7fd2f00046c0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.803+0000 7fd3094b5740 1 -- 172.21.15.18:0/4034917646 shutdown_connections 2024-09-12T02:49:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.803+0000 7fd3094b5740 1 --2- 172.21.15.18:0/4034917646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050de23a0 0x558050de4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.803+0000 7fd3094b5740 1 --2- 172.21.15.18:0/4034917646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050de1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.803+0000 7fd3094b5740 1 --2- 172.21.15.18:0/4034917646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 0x558050dd75c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.803+0000 7fd3094b5740 1 -- 172.21.15.18:0/4034917646 >> 172.21.15.18:0/4034917646 conn(0x558050dd3750 msgr2=0x558050dd3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.803+0000 7fd3094b5740 1 -- 172.21.15.18:0/4034917646 shutdown_connections 2024-09-12T02:49:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.803+0000 7fd3094b5740 1 -- 172.21.15.18:0/4034917646 wait complete. 2024-09-12T02:49:52.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.804+0000 7fd3094b5740 1 -- start start 2024-09-12T02:49:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.804+0000 7fd3094b5740 1 Processor -- start 2024-09-12T02:49:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.804+0000 7fd3094b5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050dd71e0 0x558050ddf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.804+0000 7fd3094b5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050ddf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.804+0000 7fd3094b5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050de23a0 0x558050ddfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.804+0000 7fd3094b5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558050de4f70 con 0x558050dd71e0 2024-09-12T02:49:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.804+0000 7fd3094b5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558050cc6090 con 0x558050de23a0 2024-09-12T02:49:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.804+0000 7fd3094b5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x558050de50f0 con 0x558050dd7b00 2024-09-12T02:49:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.804+0000 7fd3094b5740 10 client.0 _ll_register_callbacks cb 0x558050d1af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.805+0000 7fd2ff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050dd71e0 0x558050ddf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.805+0000 7fd2ff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050dd71e0 0x558050ddf3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44090/0 (socket says 172.21.15.18:44090) 2024-09-12T02:49:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.805+0000 7fd2ff400640 1 -- 172.21.15.18:0/111295734 learned_addr learned my addr 172.21.15.18:0/111295734 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.805+0000 7fd2fea00640 1 --2- 172.21.15.18:0/111295734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050ddf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.805+0000 7fd2ffe00640 1 --2- 172.21.15.18:0/111295734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050de23a0 0x558050ddfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.805+0000 7fd2ffe00640 1 -- 172.21.15.18:0/111295734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 msgr2=0x558050ddf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.805+0000 7fd2ffe00640 1 --2- 172.21.15.18:0/111295734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050ddf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.805+0000 7fd2ffe00640 1 -- 172.21.15.18:0/111295734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050dd71e0 msgr2=0x558050ddf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.805+0000 7fd2ffe00640 1 --2- 172.21.15.18:0/111295734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050dd71e0 0x558050ddf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.805+0000 7fd2ffe00640 1 -- 172.21.15.18:0/111295734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558050b1c620 con 0x558050de23a0 2024-09-12T02:49:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.805+0000 7fd2fea00640 1 --2- 172.21.15.18:0/111295734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050ddf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.805+0000 7fd2ff400640 1 --2- 172.21.15.18:0/111295734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050dd71e0 0x558050ddf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.806+0000 7fd2ffe00640 1 --2- 172.21.15.18:0/111295734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050de23a0 0x558050ddfe20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8019000 tx=0x7fd2f8004c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62c58f8d25925351 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.806+0000 7fd2e9600640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:49:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.806+0000 7fd2e9600640 1 -- 172.21.15.18:0/111295734 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8016070 con 0x558050de23a0 2024-09-12T02:49:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.806+0000 7fd3094b5740 1 -- 172.21.15.18:0/111295734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2f8004d20 con 0x558050de23a0 2024-09-12T02:49:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.806+0000 7fd2e9600640 1 -- 172.21.15.18:0/111295734 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fd2f8003b80 con 0x558050de23a0 2024-09-12T02:49:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.806+0000 7fd2e9600640 1 -- 172.21.15.18:0/111295734 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd2f802d050 con 0x558050de23a0 2024-09-12T02:49:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.806+0000 7fd3094b5740 10 client.25388 fetch_fsmap learned FSMap version 32 2024-09-12T02:49:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.806+0000 7fd3094b5740 1 -- 172.21.15.18:0/111295734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558050df0c80 con 0x558050de23a0 2024-09-12T02:49:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.806+0000 7fd2e9600640 1 -- 172.21.15.18:0/111295734 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2f8004d20 con 0x558050de23a0 2024-09-12T02:49:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.807+0000 7fd2e9600640 1 -- 172.21.15.18:0/111295734 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fd2f800f040 con 0x558050de23a0 2024-09-12T02:49:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.807+0000 7fd3094b5740 10 client.25388 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T02:49:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.807+0000 7fd3094b5740 10 client.25388 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.807+0000 7fd3094b5740 20 client.25388 populate_metadata read hostname 'smithi018' 2024-09-12T02:49:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.807+0000 7fd3094b5740 1 --2- 172.21.15.18:0/111295734 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x558050df20f0 0x558050df44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.807+0000 7fd3094b5740 4 client.25388 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:49:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.807+0000 7fd3094b5740 1 -- 172.21.15.18:0/111295734 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558050d4a830 con 0x558050df20f0 2024-09-12T02:49:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.807+0000 7fd2ff400640 1 --2- 172.21.15.18:0/111295734 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x558050df20f0 0x558050df44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.808+0000 7fd2ff400640 1 --2- 172.21.15.18:0/111295734 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x558050df20f0 0x558050df44e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1e36cf56c823530 server_cookie=915d4c84c3228e19 in_seq=0 out_seq=0 2024-09-12T02:49:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.808+0000 7fd2e9600640 10 client.25388 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.809+0000 7fd2e9600640 1 -- 172.21.15.18:0/111295734 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558050d4a830 con 0x558050df20f0 2024-09-12T02:49:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.809+0000 7fd2e9600640 10 client.25388 handle_command_reply: tid=0 2024-09-12T02:49:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.809+0000 7fd3094b5740 1 client.25388 shutdown 2024-09-12T02:49:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.809+0000 7fd3094b5740 1 -- 172.21.15.18:0/111295734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050de23a0 msgr2=0x558050ddfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.809+0000 7fd3094b5740 1 --2- 172.21.15.18:0/111295734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050de23a0 0x558050ddfe20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8019000 tx=0x7fd2f8004c70 comp rx=0 tx=0).stop 2024-09-12T02:49:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.809+0000 7fd3094b5740 1 -- 172.21.15.18:0/111295734 shutdown_connections 2024-09-12T02:49:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.809+0000 7fd3094b5740 1 --2- 172.21.15.18:0/111295734 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x558050df20f0 0x558050df44e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.809+0000 7fd3094b5740 1 --2- 172.21.15.18:0/111295734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050de23a0 0x558050ddfe20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.809+0000 7fd3094b5740 1 --2- 172.21.15.18:0/111295734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050ddf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.809+0000 7fd3094b5740 1 --2- 172.21.15.18:0/111295734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050dd71e0 0x558050ddf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.809+0000 7fd2e9600640 0 client.25388 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.809+0000 7fd3094b5740 1 -- 172.21.15.18:0/111295734 >> 172.21.15.18:0/111295734 conn(0x558050dd3750 msgr2=0x558050dd9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.809+0000 7fd3094b5740 1 -- 172.21.15.18:0/111295734 shutdown_connections 2024-09-12T02:49:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.809+0000 7fd3094b5740 1 -- 172.21.15.18:0/111295734 wait complete. 2024-09-12T02:49:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.809+0000 7fd3094b5740 20 client.25388 trim_cache size 0 max 16384 2024-09-12T02:49:52.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.827+0000 7fd3094b5740 1 Processor -- start 2024-09-12T02:49:52.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.827+0000 7fd3094b5740 1 -- start start 2024-09-12T02:49:52.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.827+0000 7fd3094b5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 0x558050dce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.827+0000 7fd3094b5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050ddfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.827+0000 7fd3094b5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050de23a0 0x558050dde230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.827+0000 7fd3094b5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd3001b11b0 con 0x558050de23a0 2024-09-12T02:49:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.827+0000 7fd3094b5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd3001b2d50 con 0x558050dd71e0 2024-09-12T02:49:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.827+0000 7fd3094b5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd3001b1880 con 0x558050dd7b00 2024-09-12T02:49:52.830 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.828+0000 7fd2ffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050de23a0 0x558050dde230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.828+0000 7fd2ff400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 0x558050dce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.828+0000 7fd2fea00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050ddfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.828+0000 7fd2ff400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 0x558050dce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:47690/0 (socket says 172.21.15.18:47690) 2024-09-12T02:49:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.828+0000 7fd2ff400640 1 -- 172.21.15.18:0/97270111 learned_addr learned my addr 172.21.15.18:0/97270111 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.828+0000 7fd2ff400640 1 -- 172.21.15.18:0/97270111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 msgr2=0x558050ddfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.828+0000 7fd2ff400640 1 --2- 172.21.15.18:0/97270111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050ddfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.828+0000 7fd2ff400640 1 -- 172.21.15.18:0/97270111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050de23a0 msgr2=0x558050dde230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.828+0000 7fd2ff400640 1 --2- 172.21.15.18:0/97270111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050de23a0 0x558050dde230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.828+0000 7fd2ff400640 1 -- 172.21.15.18:0/97270111 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558050dd4800 con 0x558050dd71e0 2024-09-12T02:49:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.828+0000 7fd2ff400640 1 --2- 172.21.15.18:0/97270111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 0x558050dce8d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0000c00 tx=0x7fd2f0040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19bca747fa228edd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.829+0000 7fd2ebe00640 1 -- 172.21.15.18:0/97270111 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0035040 con 0x558050dd71e0 2024-09-12T02:49:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.829+0000 7fd2ebe00640 1 -- 172.21.15.18:0/97270111 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2f0058030 con 0x558050dd71e0 2024-09-12T02:49:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.829+0000 7fd2ebe00640 1 -- 172.21.15.18:0/97270111 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f003dc50 con 0x558050dd71e0 2024-09-12T02:49:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.829+0000 7fd3094b5740 1 -- 172.21.15.18:0/97270111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 msgr2=0x558050dce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.829+0000 7fd3094b5740 1 --2- 172.21.15.18:0/97270111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 0x558050dce8d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0000c00 tx=0x7fd2f0040000 comp rx=0 tx=0).stop 2024-09-12T02:49:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.829+0000 7fd3094b5740 1 -- 172.21.15.18:0/97270111 shutdown_connections 2024-09-12T02:49:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.829+0000 7fd3094b5740 1 --2- 172.21.15.18:0/97270111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050de23a0 0x558050dde230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.829+0000 7fd3094b5740 1 --2- 172.21.15.18:0/97270111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050ddfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.829+0000 7fd3094b5740 1 --2- 172.21.15.18:0/97270111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 0x558050dce8d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.829+0000 7fd3094b5740 1 -- 172.21.15.18:0/97270111 >> 172.21.15.18:0/97270111 conn(0x558050dd3750 msgr2=0x558050dddb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.829+0000 7fd3094b5740 1 -- 172.21.15.18:0/97270111 shutdown_connections 2024-09-12T02:49:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.830+0000 7fd3094b5740 1 -- 172.21.15.18:0/97270111 wait complete. 2024-09-12T02:49:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.830+0000 7fd3094b5740 1 -- start start 2024-09-12T02:49:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.830+0000 7fd3094b5740 1 Processor -- start 2024-09-12T02:49:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd3094b5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 0x558050ddcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd3094b5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050dea340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd3094b5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050de23a0 0x558050dea880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd3094b5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd3001b2620 con 0x558050de23a0 2024-09-12T02:49:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd3094b5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd3001b1f50 con 0x558050dd71e0 2024-09-12T02:49:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd3094b5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd3001af190 con 0x558050dd7b00 2024-09-12T02:49:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd3094b5740 10 client.0 _ll_register_callbacks cb 0x7fd2ec0d2f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:49:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd2ffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050de23a0 0x558050dea880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd2ffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050de23a0 0x558050dea880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44120/0 (socket says 172.21.15.18:44120) 2024-09-12T02:49:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd2ffe00640 1 -- 172.21.15.18:0/2112323202 learned_addr learned my addr 172.21.15.18:0/2112323202 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:49:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd2ff400640 1 --2- 172.21.15.18:0/2112323202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 0x558050ddcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd2fea00640 1 --2- 172.21.15.18:0/2112323202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050dea340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd2ffe00640 1 -- 172.21.15.18:0/2112323202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 msgr2=0x558050dea340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd2ffe00640 1 --2- 172.21.15.18:0/2112323202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050dea340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd2ffe00640 1 -- 172.21.15.18:0/2112323202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 msgr2=0x558050ddcea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:49:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd2ffe00640 1 --2- 172.21.15.18:0/2112323202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 0x558050ddcea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd2ffe00640 1 -- 172.21.15.18:0/2112323202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558050ddb5f0 con 0x558050de23a0 2024-09-12T02:49:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.831+0000 7fd2fea00640 1 --2- 172.21.15.18:0/2112323202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050dea340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:49:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.832+0000 7fd2ffe00640 1 --2- 172.21.15.18:0/2112323202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050de23a0 0x558050dea880 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8010840 tx=0x7fd2f8009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5ecf07375a1404 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.832+0000 7fd2e9600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:49:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.832+0000 7fd2e9600640 1 -- 172.21.15.18:0/2112323202 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8037060 con 0x558050de23a0 2024-09-12T02:49:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.832+0000 7fd2e9600640 1 -- 172.21.15.18:0/2112323202 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fd2f8004ce0 con 0x558050de23a0 2024-09-12T02:49:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.832+0000 7fd3094b5740 1 -- 172.21.15.18:0/2112323202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2f0058030 con 0x558050de23a0 2024-09-12T02:49:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.832+0000 7fd2e9600640 1 -- 172.21.15.18:0/2112323202 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd2f8016040 con 0x558050de23a0 2024-09-12T02:49:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.832+0000 7fd3094b5740 10 client.15396 fetch_fsmap learned FSMap version 32 2024-09-12T02:49:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.832+0000 7fd3094b5740 1 -- 172.21.15.18:0/2112323202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558050e5bc30 con 0x558050de23a0 2024-09-12T02:49:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.832+0000 7fd2e9600640 1 -- 172.21.15.18:0/2112323202 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2f0058030 con 0x558050de23a0 2024-09-12T02:49:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.832+0000 7fd2e9600640 1 -- 172.21.15.18:0/2112323202 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fd2f80129d0 con 0x558050de23a0 2024-09-12T02:49:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.833+0000 7fd3094b5740 10 client.15396 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T02:49:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.833+0000 7fd3094b5740 10 client.15396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:49:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.833+0000 7fd3094b5740 20 client.15396 populate_metadata read hostname 'smithi018' 2024-09-12T02:49:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.833+0000 7fd3094b5740 1 --2- 172.21.15.18:0/2112323202 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x558050e5c350 0x558050e5e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.833+0000 7fd3094b5740 4 client.15396 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:49:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.833+0000 7fd3094b5740 1 -- 172.21.15.18:0/2112323202 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558050d44b80 con 0x558050e5c350 2024-09-12T02:49:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.833+0000 7fd2ff400640 1 --2- 172.21.15.18:0/2112323202 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x558050e5c350 0x558050e5e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.833+0000 7fd2ff400640 1 --2- 172.21.15.18:0/2112323202 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x558050e5c350 0x558050e5e770 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=212c1310247f57f3 server_cookie=7aeba6c71e781280 in_seq=0 out_seq=0 2024-09-12T02:49:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.833+0000 7fd2e9600640 10 client.15396 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.837+0000 7fd2e9600640 1 -- 172.21.15.18:0/2112323202 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558050d44b80 con 0x558050e5c350 2024-09-12T02:49:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.837+0000 7fd2e9600640 10 client.15396 handle_command_reply: tid=0 2024-09-12T02:49:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.837+0000 7fd3094b5740 1 client.15396 shutdown 2024-09-12T02:49:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.837+0000 7fd3094b5740 1 -- 172.21.15.18:0/2112323202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050de23a0 msgr2=0x558050dea880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.837+0000 7fd3094b5740 1 --2- 172.21.15.18:0/2112323202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050de23a0 0x558050dea880 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8010840 tx=0x7fd2f8009b90 comp rx=0 tx=0).stop 2024-09-12T02:49:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.837+0000 7fd3094b5740 1 -- 172.21.15.18:0/2112323202 shutdown_connections 2024-09-12T02:49:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.837+0000 7fd3094b5740 1 --2- 172.21.15.18:0/2112323202 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x558050e5c350 0x558050e5e770 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.837+0000 7fd3094b5740 1 --2- 172.21.15.18:0/2112323202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558050de23a0 0x558050dea880 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.837+0000 7fd2e9600640 0 client.15396 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:49:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.837+0000 7fd3094b5740 1 --2- 172.21.15.18:0/2112323202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558050dd7b00 0x558050dea340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.837+0000 7fd3094b5740 1 --2- 172.21.15.18:0/2112323202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558050dd71e0 0x558050ddcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.837+0000 7fd3094b5740 1 -- 172.21.15.18:0/2112323202 >> 172.21.15.18:0/2112323202 conn(0x558050dd3750 msgr2=0x558050dde340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.837+0000 7fd3094b5740 1 -- 172.21.15.18:0/2112323202 shutdown_connections 2024-09-12T02:49:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.837+0000 7fd3094b5740 1 -- 172.21.15.18:0/2112323202 wait complete. 2024-09-12T02:49:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.838+0000 7fd3094b5740 20 client.15396 trim_cache size 0 max 16384 2024-09-12T02:49:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:49:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:49:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:49:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:49:52.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.838+0000 7fd306600640 1 -- 172.21.15.18:0/3668535431 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd2e40a2f40 msgr2=0x7fd2e40a5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:52.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.838+0000 7fd306600640 1 --2- 172.21.15.18:0/3668535431 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd2e40a2f40 0x7fd2e40a5400 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0005c40 tx=0x7fd2f00046c0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.838+0000 7fd306600640 1 -- 172.21.15.18:0/3668535431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd300109080 msgr2=0x7fd30019aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:52.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.838+0000 7fd306600640 1 --2- 172.21.15.18:0/3668535431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd300109080 0x7fd30019aaa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec005fd0 tx=0x7fd2ec00dde0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.838+0000 7fd306600640 1 -- 172.21.15.18:0/3668535431 shutdown_connections 2024-09-12T02:49:52.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.838+0000 7fd306600640 1 --2- 172.21.15.18:0/3668535431 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd2e40a2f40 0x7fd2e40a5400 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.838+0000 7fd306600640 1 --2- 172.21.15.18:0/3668535431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd30019ee20 0x7fd30019f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.838+0000 7fd306600640 1 --2- 172.21.15.18:0/3668535431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd300109080 0x7fd30019aaa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.838+0000 7fd306600640 1 --2- 172.21.15.18:0/3668535431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300103f30 0x7fd30019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.838+0000 7fd306600640 1 -- 172.21.15.18:0/3668535431 >> 172.21.15.18:0/3668535431 conn(0x7fd3000ff980 msgr2=0x7fd300101ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:52.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.838+0000 7fd306600640 1 -- 172.21.15.18:0/3668535431 shutdown_connections 2024-09-12T02:49:52.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:49:52.838+0000 7fd306600640 1 -- 172.21.15.18:0/3668535431 wait complete. 2024-09-12T02:49:52.938 INFO:tasks.workunit.client.0.smithi018.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-12T02:49:53.951 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether build environment is sane... yes 2024-09-12T02:49:53.969 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gawk... gawk 2024-09-12T02:49:53.994 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether make sets $(MAKE)... yes 2024-09-12T02:49:54.015 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gcc... gcc 2024-09-12T02:49:54.107 INFO:tasks.workunit.client.0.smithi018.stdout:checking for C compiler default output file name... a.out 2024-09-12T02:49:54.111 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether the C compiler works... yes 2024-09-12T02:49:54.115 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether we are cross compiling... no 2024-09-12T02:49:54.173 INFO:tasks.workunit.client.0.smithi018.stdout:checking for suffix of executables... 2024-09-12T02:49:54.232 INFO:tasks.workunit.client.0.smithi018.stdout:checking for suffix of object files... o 2024-09-12T02:49:54.291 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether we are using the GNU C compiler... yes 2024-09-12T02:49:54.352 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether gcc accepts -g... yes 2024-09-12T02:49:54.456 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gcc option to accept ANSI C... none needed 2024-09-12T02:49:54.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:54 smithi176 ceph-mon[35713]: pgmap v38: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T02:49:54.520 INFO:tasks.workunit.client.0.smithi018.stdout:checking for style of include used by make... GNU 2024-09-12T02:49:54.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:54 smithi062 ceph-mon[35527]: pgmap v38: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T02:49:54.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:54 smithi018 ceph-mon[30616]: pgmap v38: 129 pgs: 129 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T02:49:54.647 INFO:tasks.workunit.client.0.smithi018.stdout:checking dependency style of gcc... gcc3 2024-09-12T02:49:54.647 INFO:tasks.workunit.client.0.smithi018.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-12T02:49:54.764 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to run the C preprocessor... gcc -E 2024-09-12T02:49:54.839 INFO:tasks.workunit.client.0.smithi018.stdout:checking for egrep... grep -E 2024-09-12T02:49:54.859 INFO:tasks.workunit.client.0.smithi018.stdout:checking for AIX... no 2024-09-12T02:49:54.959 INFO:tasks.workunit.client.0.smithi018.stdout:checking for library containing strerror... none required 2024-09-12T02:49:55.197 INFO:tasks.workunit.client.0.smithi018.stdout:checking for ANSI C header files... yes 2024-09-12T02:49:55.266 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-12T02:49:55.346 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/types.h... yes 2024-09-12T02:49:55.432 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/stat.h... yes 2024-09-12T02:49:55.517 INFO:tasks.workunit.client.0.smithi018.stdout:checking for stdlib.h... yes 2024-09-12T02:49:55.602 INFO:tasks.workunit.client.0.smithi018.stdout:checking for string.h... yes 2024-09-12T02:49:55.697 INFO:tasks.workunit.client.0.smithi018.stdout:checking for memory.h... yes 2024-09-12T02:49:55.789 INFO:tasks.workunit.client.0.smithi018.stdout:checking for strings.h... yes 2024-09-12T02:49:55.872 INFO:tasks.workunit.client.0.smithi018.stdout:checking for inttypes.h... yes 2024-09-12T02:49:56.016 INFO:tasks.workunit.client.0.smithi018.stdout:checking for stdint.h... yes 2024-09-12T02:49:56.106 INFO:tasks.workunit.client.0.smithi018.stdout:checking for unistd.h... yes 2024-09-12T02:49:56.126 INFO:tasks.workunit.client.0.smithi018.stdout:checking for memory.h... (cached) yes 2024-09-12T02:49:56.139 INFO:tasks.workunit.client.0.smithi018.stdout:checking for strings.h... (cached) yes 2024-09-12T02:49:56.153 INFO:tasks.workunit.client.0.smithi018.stdout:checking for unistd.h... (cached) yes 2024-09-12T02:49:56.236 INFO:tasks.workunit.client.0.smithi018.stdout:checking locale.h usability... yes 2024-09-12T02:49:56.273 INFO:tasks.workunit.client.0.smithi018.stdout:checking locale.h presence... yes 2024-09-12T02:49:56.274 INFO:tasks.workunit.client.0.smithi018.stdout:checking for locale.h... yes 2024-09-12T02:49:56.297 INFO:tasks.workunit.client.0.smithi018.stdout:checking for stdlib.h... (cached) yes 2024-09-12T02:49:56.311 INFO:tasks.workunit.client.0.smithi018.stdout:checking for string.h... (cached) yes 2024-09-12T02:49:56.402 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:56 smithi018 ceph-mon[30616]: pgmap v39: 129 pgs: 129 active+clean; 1.5 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-12T02:49:56.406 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/socket.h usability... yes 2024-09-12T02:49:56.446 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/socket.h presence... yes 2024-09-12T02:49:56.447 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/socket.h... yes 2024-09-12T02:49:56.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:56 smithi176 ceph-mon[35713]: pgmap v39: 129 pgs: 129 active+clean; 1.5 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-12T02:49:56.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:56 smithi062 ceph-mon[35527]: pgmap v39: 129 pgs: 129 active+clean; 1.5 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-12T02:49:56.538 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/time.h usability... yes 2024-09-12T02:49:56.574 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/time.h presence... yes 2024-09-12T02:49:56.576 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/time.h... yes 2024-09-12T02:49:56.666 INFO:tasks.workunit.client.0.smithi018.stdout:checking fcntl.h usability... yes 2024-09-12T02:49:56.703 INFO:tasks.workunit.client.0.smithi018.stdout:checking fcntl.h presence... yes 2024-09-12T02:49:56.705 INFO:tasks.workunit.client.0.smithi018.stdout:checking for fcntl.h... yes 2024-09-12T02:49:56.832 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/fcntl.h usability... yes 2024-09-12T02:49:56.870 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/fcntl.h presence... yes 2024-09-12T02:49:56.872 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/fcntl.h... yes 2024-09-12T02:49:56.996 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/param.h usability... yes 2024-09-12T02:49:57.041 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/param.h presence... yes 2024-09-12T02:49:57.043 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/param.h... yes 2024-09-12T02:49:57.126 INFO:tasks.workunit.client.0.smithi018.stdout:checking ioctl.h usability... no 2024-09-12T02:49:57.163 INFO:tasks.workunit.client.0.smithi018.stdout:checking ioctl.h presence... no 2024-09-12T02:49:57.165 INFO:tasks.workunit.client.0.smithi018.stdout:checking for ioctl.h... no 2024-09-12T02:49:57.254 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/ioctl.h usability... yes 2024-09-12T02:49:57.291 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/ioctl.h presence... yes 2024-09-12T02:49:57.293 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/ioctl.h... yes 2024-09-12T02:49:57.381 INFO:tasks.workunit.client.0.smithi018.stdout:checking return type of signal handlers... void 2024-09-12T02:49:57.458 INFO:tasks.workunit.client.0.smithi018.stdout:checking for size_t... yes 2024-09-12T02:49:57.526 INFO:tasks.workunit.client.0.smithi018.stdout:checking for dev_t... yes 2024-09-12T02:49:57.603 INFO:tasks.workunit.client.0.smithi018.stdout:checking for short... yes 2024-09-12T02:49:57.729 INFO:tasks.workunit.client.0.smithi018.stdout:checking size of short... 2 2024-09-12T02:49:57.807 INFO:tasks.workunit.client.0.smithi018.stdout:checking for int... yes 2024-09-12T02:49:57.918 INFO:tasks.workunit.client.0.smithi018.stdout:checking size of int... 4 2024-09-12T02:49:58.055 INFO:tasks.workunit.client.0.smithi018.stdout:checking for long... yes 2024-09-12T02:49:58.175 INFO:tasks.workunit.client.0.smithi018.stdout:checking size of long... 8 2024-09-12T02:49:58.253 INFO:tasks.workunit.client.0.smithi018.stdout:checking for long long... yes 2024-09-12T02:49:58.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:49:58 smithi018 ceph-mon[30616]: pgmap v40: 129 pgs: 129 active+clean; 1.5 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-09-12T02:49:58.359 INFO:tasks.workunit.client.0.smithi018.stdout:checking size of long long... 8 2024-09-12T02:49:58.434 INFO:tasks.workunit.client.0.smithi018.stdout:checking for ssize_t... yes 2024-09-12T02:49:58.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:49:58 smithi176 ceph-mon[35713]: pgmap v40: 129 pgs: 129 active+clean; 1.5 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-09-12T02:49:58.502 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sig_atomic_t... yes 2024-09-12T02:49:58.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:49:58 smithi062 ceph-mon[35527]: pgmap v40: 129 pgs: 129 active+clean; 1.5 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-09-12T02:49:58.581 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether gcc needs -traditional... no 2024-09-12T02:49:58.643 INFO:tasks.workunit.client.0.smithi018.stdout:checking for an ANSI C-conforming const... yes 2024-09-12T02:49:58.691 INFO:tasks.workunit.client.0.smithi018.stdout:checking for inline... inline 2024-09-12T02:49:58.804 INFO:tasks.workunit.client.0.smithi018.stdout:checking for working alloca.h... yes 2024-09-12T02:49:58.910 INFO:tasks.workunit.client.0.smithi018.stdout:checking for alloca... yes 2024-09-12T02:49:59.022 INFO:tasks.workunit.client.0.smithi018.stdout:checking for working memcmp... yes 2024-09-12T02:49:59.117 INFO:tasks.workunit.client.0.smithi018.stdout:checking for strftime... yes 2024-09-12T02:49:59.232 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-09-12T02:49:59.332 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether stat accepts an empty string... no 2024-09-12T02:49:59.432 INFO:tasks.workunit.client.0.smithi018.stdout:checking for vprintf... yes 2024-09-12T02:49:59.533 INFO:tasks.workunit.client.0.smithi018.stdout:checking for _doprnt... no 2024-09-12T02:49:59.583 INFO:tasks.workunit.client.0.smithi018.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-12T02:49:59.613 INFO:tasks.workunit.client.0.smithi018.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-12T02:49:59.717 INFO:tasks.workunit.client.0.smithi018.stdout:checking for the pthreads library -lpthreads... no 2024-09-12T02:49:59.814 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether pthreads work without any flags... yes 2024-09-12T02:49:59.900 INFO:tasks.workunit.client.0.smithi018.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-09-12T02:49:59.900 INFO:tasks.workunit.client.0.smithi018.stdout:checking if more special flags are required for pthreads... no 2024-09-12T02:49:59.900 INFO:tasks.workunit.client.0.smithi018.stdout:checking for cc_r... gcc 2024-09-12T02:50:00.019 INFO:tasks.workunit.client.0.smithi018.stdout:checking for setrlimit... yes 2024-09-12T02:50:00.125 INFO:tasks.workunit.client.0.smithi018.stdout:checking for setproctitle... no 2024-09-12T02:50:00.226 INFO:tasks.workunit.client.0.smithi018.stdout:checking for getopt_long... yes 2024-09-12T02:50:00.330 INFO:tasks.workunit.client.0.smithi018.stdout:checking for strtoull... yes 2024-09-12T02:50:00.436 INFO:tasks.workunit.client.0.smithi018.stdout:checking for strtoq... yes 2024-09-12T02:50:00.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:00 smithi176 ceph-mon[35713]: pgmap v41: 129 pgs: 129 active+clean; 3.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 184 KiB/s wr, 20 op/s 2024-09-12T02:50:00.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:00 smithi176 ceph-mon[35713]: overall HEALTH_OK 2024-09-12T02:50:00.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:00 smithi062 ceph-mon[35527]: pgmap v41: 129 pgs: 129 active+clean; 3.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 184 KiB/s wr, 20 op/s 2024-09-12T02:50:00.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:00 smithi062 ceph-mon[35527]: overall HEALTH_OK 2024-09-12T02:50:00.541 INFO:tasks.workunit.client.0.smithi018.stdout:checking for snprintf... yes 2024-09-12T02:50:00.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:00 smithi018 ceph-mon[30616]: pgmap v41: 129 pgs: 129 active+clean; 3.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 184 KiB/s wr, 20 op/s 2024-09-12T02:50:00.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:00 smithi018 ceph-mon[30616]: overall HEALTH_OK 2024-09-12T02:50:00.647 INFO:tasks.workunit.client.0.smithi018.stdout:checking for vsnprintf... yes 2024-09-12T02:50:00.753 INFO:tasks.workunit.client.0.smithi018.stdout:checking for vfprintf... yes 2024-09-12T02:50:00.863 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gethostname... yes 2024-09-12T02:50:00.982 INFO:tasks.workunit.client.0.smithi018.stdout:checking for setlocale... yes 2024-09-12T02:50:01.093 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sync... yes 2024-09-12T02:50:01.199 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether snprintf is C99 conformant... done 2024-09-12T02:50:01.221 INFO:tasks.workunit.client.0.smithi018.stdout:configure: creating ./config.status 2024-09-12T02:50:01.504 INFO:tasks.workunit.client.0.smithi018.stdout:config.status: creating Makefile 2024-09-12T02:50:01.543 INFO:tasks.workunit.client.0.smithi018.stdout:config.status: creating src/Makefile 2024-09-12T02:50:01.583 INFO:tasks.workunit.client.0.smithi018.stdout:config.status: creating man/Makefile 2024-09-12T02:50:01.603 INFO:tasks.workunit.client.0.smithi018.stdout:config.status: creating config.h 2024-09-12T02:50:01.690 INFO:tasks.workunit.client.0.smithi018.stdout:config.status: executing depfiles commands 2024-09-12T02:50:01.963 INFO:tasks.workunit.client.0.smithi018.stderr:+ make 2024-09-12T02:50:01.974 INFO:tasks.workunit.client.0.smithi018.stdout:make all-recursive 2024-09-12T02:50:01.978 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-12T02:50:01.984 INFO:tasks.workunit.client.0.smithi018.stdout:Making all in src 2024-09-12T02:50:01.993 INFO:tasks.workunit.client.0.smithi018.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-12T02:50:01.993 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-09-12T02:50:01.993 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-09-12T02:50:02.149 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-09-12T02:50:02.149 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-09-12T02:50:02.243 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-09-12T02:50:02.244 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-09-12T02:50:02.324 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-09-12T02:50:02.324 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-09-12T02:50:02.402 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-09-12T02:50:02.402 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-09-12T02:50:02.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:02 smithi176 ceph-mon[35713]: pgmap v42: 129 pgs: 129 active+clean; 4.2 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 258 KiB/s wr, 35 op/s 2024-09-12T02:50:02.479 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-09-12T02:50:02.480 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-09-12T02:50:02.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:02 smithi062 ceph-mon[35527]: pgmap v42: 129 pgs: 129 active+clean; 4.2 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 258 KiB/s wr, 35 op/s 2024-09-12T02:50:02.553 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-09-12T02:50:02.553 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-09-12T02:50:02.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:02 smithi018 ceph-mon[30616]: pgmap v42: 129 pgs: 129 active+clean; 4.2 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 258 KiB/s wr, 35 op/s 2024-09-12T02:50:02.657 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-09-12T02:50:02.658 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-09-12T02:50:02.716 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-09-12T02:50:02.716 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-09-12T02:50:02.775 INFO:tasks.workunit.client.0.smithi018.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-09-12T02:50:02.775 INFO:tasks.workunit.client.0.smithi018.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-09-12T02:50:02.835 INFO:tasks.workunit.client.0.smithi018.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-09-12T02:50:02.864 INFO:tasks.workunit.client.0.smithi018.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-12T02:50:02.865 INFO:tasks.workunit.client.0.smithi018.stdout:Making all in man 2024-09-12T02:50:02.889 INFO:tasks.workunit.client.0.smithi018.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-12T02:50:02.889 INFO:tasks.workunit.client.0.smithi018.stdout:make[2]: Nothing to be done for 'all'. 2024-09-12T02:50:02.889 INFO:tasks.workunit.client.0.smithi018.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-12T02:50:02.892 INFO:tasks.workunit.client.0.smithi018.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-12T02:50:02.895 INFO:tasks.workunit.client.0.smithi018.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-12T02:50:02.895 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-12T02:50:02.896 INFO:tasks.workunit.client.0.smithi018.stderr:+ cd src 2024-09-12T02:50:02.896 INFO:tasks.workunit.client.0.smithi018.stderr:+ mkdir blogtest_in 2024-09-12T02:50:02.899 INFO:tasks.workunit.client.0.smithi018.stdout:running blogbench 2024-09-12T02:50:02.900 INFO:tasks.workunit.client.0.smithi018.stderr:+ echo 'running blogbench' 2024-09-12T02:50:02.900 INFO:tasks.workunit.client.0.smithi018.stderr:+ ./blogbench -d blogtest_in 2024-09-12T02:50:02.900 INFO:tasks.workunit.client.0.smithi018.stdout: 2024-09-12T02:50:02.901 INFO:tasks.workunit.client.0.smithi018.stdout:Frequency = 10 secs 2024-09-12T02:50:02.901 INFO:tasks.workunit.client.0.smithi018.stdout:Scratch dir = [blogtest_in] 2024-09-12T02:50:04.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:04 smithi176 ceph-mon[35713]: pgmap v43: 129 pgs: 129 active+clean; 4.2 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 258 KiB/s wr, 32 op/s 2024-09-12T02:50:04.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:04 smithi062 ceph-mon[35527]: pgmap v43: 129 pgs: 129 active+clean; 4.2 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 258 KiB/s wr, 32 op/s 2024-09-12T02:50:04.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:04 smithi018 ceph-mon[30616]: pgmap v43: 129 pgs: 129 active+clean; 4.2 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 258 KiB/s wr, 32 op/s 2024-09-12T02:50:04.825 INFO:tasks.workunit.client.0.smithi018.stdout:Spawning 3 writers... 2024-09-12T02:50:04.825 INFO:tasks.workunit.client.0.smithi018.stdout:Spawning 1 rewriters... 2024-09-12T02:50:04.825 INFO:tasks.workunit.client.0.smithi018.stdout:Spawning 5 commenters... 2024-09-12T02:50:04.825 INFO:tasks.workunit.client.0.smithi018.stdout:Spawning 100 readers... 2024-09-12T02:50:04.832 INFO:tasks.workunit.client.0.smithi018.stdout:Benchmarking for 30 iterations. 2024-09-12T02:50:04.832 INFO:tasks.workunit.client.0.smithi018.stdout:The test will run during 5 minutes. 2024-09-12T02:50:04.833 INFO:tasks.workunit.client.0.smithi018.stdout: 2024-09-12T02:50:04.833 INFO:tasks.workunit.client.0.smithi018.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-09-12T02:50:05.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.963+0000 7f3c0e400640 1 -- 172.21.15.18:0/982437956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c08103ae0 msgr2=0x7f3c08103f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:05.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.963+0000 7f3c0e400640 1 --2- 172.21.15.18:0/982437956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c08103ae0 0x7f3c08103f40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009900 tx=0x7f3bf402a410 comp rx=0 tx=0).stop 2024-09-12T02:50:05.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.963+0000 7f3c0e400640 1 -- 172.21.15.18:0/982437956 shutdown_connections 2024-09-12T02:50:05.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.963+0000 7f3c0e400640 1 --2- 172.21.15.18:0/982437956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c08104480 0x7f3c081109b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:05.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.963+0000 7f3c0e400640 1 --2- 172.21.15.18:0/982437956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c08103ae0 0x7f3c08103f40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:05.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.963+0000 7f3c0e400640 1 --2- 172.21.15.18:0/982437956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c08109b80 0x7f3c08109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:05.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.963+0000 7f3c0e400640 1 -- 172.21.15.18:0/982437956 >> 172.21.15.18:0/982437956 conn(0x7f3c080ff7c0 msgr2=0x7f3c08101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:05.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.963+0000 7f3c0e400640 1 -- 172.21.15.18:0/982437956 shutdown_connections 2024-09-12T02:50:05.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.963+0000 7f3c0e400640 1 -- 172.21.15.18:0/982437956 wait complete. 2024-09-12T02:50:05.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.964+0000 7f3c0e400640 1 Processor -- start 2024-09-12T02:50:05.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.964+0000 7f3c0e400640 1 -- start start 2024-09-12T02:50:05.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.964+0000 7f3c0e400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c08103ae0 0x7f3c0819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:05.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.964+0000 7f3c0e400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c08104480 0x7f3c0819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.964+0000 7f3c0e400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c08109b80 0x7f3c0819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.964+0000 7f3c0e400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3c08113f80 con 0x7f3c08103ae0 2024-09-12T02:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.964+0000 7f3c0e400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3c08113e00 con 0x7f3c08104480 2024-09-12T02:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.964+0000 7f3c0e400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3c08114100 con 0x7f3c08109b80 2024-09-12T02:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.965+0000 7f3c0d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c08103ae0 0x7f3c0819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.965+0000 7f3c07e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c08104480 0x7f3c0819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.965+0000 7f3c07e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c08104480 0x7f3c0819a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:41562/0 (socket says 172.21.15.18:41562) 2024-09-12T02:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.965+0000 7f3c0d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c08103ae0 0x7f3c0819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48040/0 (socket says 172.21.15.18:48040) 2024-09-12T02:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.965+0000 7f3c07e00640 1 -- 172.21.15.18:0/2031369315 learned_addr learned my addr 172.21.15.18:0/2031369315 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.965+0000 7f3c0da00640 1 --2- 172.21.15.18:0/2031369315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c08109b80 0x7f3c0819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.965+0000 7f3c07e00640 1 -- 172.21.15.18:0/2031369315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c08109b80 msgr2=0x7f3c0819ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.965+0000 7f3c07e00640 1 --2- 172.21.15.18:0/2031369315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c08109b80 0x7f3c0819ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.965+0000 7f3c07e00640 1 -- 172.21.15.18:0/2031369315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c08103ae0 msgr2=0x7f3c0819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.965+0000 7f3c07e00640 1 --2- 172.21.15.18:0/2031369315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c08103ae0 0x7f3c0819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.965+0000 7f3c07e00640 1 -- 172.21.15.18:0/2031369315 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0819f460 con 0x7f3c08104480 2024-09-12T02:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.965+0000 7f3c0d000640 1 --2- 172.21.15.18:0/2031369315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c08103ae0 0x7f3c0819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.965+0000 7f3c07e00640 1 --2- 172.21.15.18:0/2031369315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c08104480 0x7f3c0819a9b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3bf402aa00 tx=0x7f3bf4003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.966+0000 7f3c05600640 1 -- 172.21.15.18:0/2031369315 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf403f070 con 0x7f3c08104480 2024-09-12T02:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.966+0000 7f3c05600640 1 -- 172.21.15.18:0/2031369315 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bf4031c30 con 0x7f3c08104480 2024-09-12T02:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.966+0000 7f3c05600640 1 -- 172.21.15.18:0/2031369315 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4035030 con 0x7f3c08104480 2024-09-12T02:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.966+0000 7f3c0e400640 1 -- 172.21.15.18:0/2031369315 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c0819f6f0 con 0x7f3c08104480 2024-09-12T02:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.966+0000 7f3c0e400640 1 -- 172.21.15.18:0/2031369315 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c081a6fe0 con 0x7f3c08104480 2024-09-12T02:50:05.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.970+0000 7f3c12a54740 1 Processor -- start 2024-09-12T02:50:05.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.970+0000 7f3c12a54740 1 -- start start 2024-09-12T02:50:05.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.970+0000 7f3c05600640 1 -- 172.21.15.18:0/2031369315 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 26) ==== 138066+0+0 (secure 0 0 0) 0x7f3bf4042070 con 0x7f3c08104480 2024-09-12T02:50:05.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.971+0000 7f3c12a54740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca0123b0 0x5597ca012790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:05.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.971+0000 7f3c12a54740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca012cd0 0x5597ca01d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:05.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.971+0000 7f3c12a54740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca01d570 0x5597ca01f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.971+0000 7f3c12a54740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5597c9f78100 con 0x5597ca0123b0 2024-09-12T02:50:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.971+0000 7f3c12a54740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5597c9f201b0 con 0x5597ca012cd0 2024-09-12T02:50:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.971+0000 7f3c12a54740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5597c9f740c0 con 0x5597ca01d570 2024-09-12T02:50:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.971+0000 7f3c0d000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca012cd0 0x5597ca01d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.971+0000 7f3c0da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca0123b0 0x5597ca012790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.971+0000 7f3c0d000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca012cd0 0x5597ca01d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:41572/0 (socket says 172.21.15.18:41572) 2024-09-12T02:50:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.971+0000 7f3c0d000640 1 -- 172.21.15.18:0/2891591583 learned_addr learned my addr 172.21.15.18:0/2891591583 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.971+0000 7f3c07e00640 1 --2- 172.21.15.18:0/2891591583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca01d570 0x5597ca01f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.971+0000 7f3c0da00640 1 -- 172.21.15.18:0/2891591583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca01d570 msgr2=0x5597ca01f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.971+0000 7f3c0da00640 1 --2- 172.21.15.18:0/2891591583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca01d570 0x5597ca01f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.971+0000 7f3c0da00640 1 -- 172.21.15.18:0/2891591583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca012cd0 msgr2=0x5597ca01d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.971+0000 7f3c0da00640 1 --2- 172.21.15.18:0/2891591583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca012cd0 0x5597ca01d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.971+0000 7f3c0da00640 1 -- 172.21.15.18:0/2891591583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597c9c8b210 con 0x5597ca0123b0 2024-09-12T02:50:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.971+0000 7f3c07e00640 1 --2- 172.21.15.18:0/2891591583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca01d570 0x5597ca01f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:50:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.972+0000 7f3c0da00640 1 --2- 172.21.15.18:0/2891591583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca0123b0 0x5597ca012790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009f00 tx=0x7f3c00011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab41e5bc39cf95c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.972+0000 7f3c05600640 1 --2- 172.21.15.18:0/2031369315 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3bf00a2e90 0x7f3bf00a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.972+0000 7f3bfa000640 1 -- 172.21.15.18:0/2891591583 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00004d20 con 0x5597ca0123b0 2024-09-12T02:50:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.972+0000 7f3bfa000640 1 -- 172.21.15.18:0/2891591583 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c00004030 con 0x5597ca0123b0 2024-09-12T02:50:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.972+0000 7f3bfa000640 1 -- 172.21.15.18:0/2891591583 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00005260 con 0x5597ca0123b0 2024-09-12T02:50:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.972+0000 7f3c05600640 1 -- 172.21.15.18:0/2031369315 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f3bf40eff10 con 0x7f3c08104480 2024-09-12T02:50:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.973+0000 7f3c0d000640 1 --2- 172.21.15.18:0/2031369315 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3bf00a2e90 0x7f3bf00a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.973+0000 7f3c12a54740 1 -- 172.21.15.18:0/2891591583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca0123b0 msgr2=0x5597ca012790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.973+0000 7f3c12a54740 1 --2- 172.21.15.18:0/2891591583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca0123b0 0x5597ca012790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009f00 tx=0x7f3c00011810 comp rx=0 tx=0).stop 2024-09-12T02:50:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.973+0000 7f3c12a54740 1 -- 172.21.15.18:0/2891591583 shutdown_connections 2024-09-12T02:50:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.973+0000 7f3c12a54740 1 --2- 172.21.15.18:0/2891591583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca01d570 0x5597ca01f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.973+0000 7f3c12a54740 1 --2- 172.21.15.18:0/2891591583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca012cd0 0x5597ca01d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.973+0000 7f3c12a54740 1 --2- 172.21.15.18:0/2891591583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca0123b0 0x5597ca012790 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.973+0000 7f3c12a54740 1 -- 172.21.15.18:0/2891591583 >> 172.21.15.18:0/2891591583 conn(0x5597ca00e920 msgr2=0x5597ca00ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.973+0000 7f3c0d000640 1 --2- 172.21.15.18:0/2031369315 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3bf00a2e90 0x7f3bf00a5350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x5597ca00f780 tx=0x7f3bfc005f90 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.973+0000 7f3c12a54740 1 -- 172.21.15.18:0/2891591583 shutdown_connections 2024-09-12T02:50:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.974+0000 7f3c12a54740 1 -- 172.21.15.18:0/2891591583 wait complete. 2024-09-12T02:50:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.974+0000 7f3c12a54740 1 -- start start 2024-09-12T02:50:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.974+0000 7f3c12a54740 1 Processor -- start 2024-09-12T02:50:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.980+0000 7f3c12a54740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca0123b0 0x5597ca01a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.980+0000 7f3c12a54740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca012cd0 0x5597ca01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.980+0000 7f3c12a54740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca01d570 0x5597ca01b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.980+0000 7f3c12a54740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5597ca01ff90 con 0x5597ca01d570 2024-09-12T02:50:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.980+0000 7f3c12a54740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5597c9f01090 con 0x5597ca0123b0 2024-09-12T02:50:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.980+0000 7f3c12a54740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5597ca020110 con 0x5597ca012cd0 2024-09-12T02:50:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.981+0000 7f3c12a54740 10 client.0 _ll_register_callbacks cb 0x5597c9f55f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.981+0000 7f3c07e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca012cd0 0x5597ca01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.981+0000 7f3c07e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca012cd0 0x5597ca01abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:49256/0 (socket says 172.21.15.18:49256) 2024-09-12T02:50:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.981+0000 7f3c07e00640 1 -- 172.21.15.18:0/2615528826 learned_addr learned my addr 172.21.15.18:0/2615528826 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.982+0000 7f3c07e00640 1 -- 172.21.15.18:0/2615528826 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca0123b0 msgr2=0x5597ca01a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:50:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.982+0000 7f3c07e00640 1 --2- 172.21.15.18:0/2615528826 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca0123b0 0x5597ca01a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:05.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.982+0000 7f3c07e00640 1 -- 172.21.15.18:0/2615528826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca01d570 msgr2=0x5597ca01b130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:50:05.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.982+0000 7f3c07e00640 1 --2- 172.21.15.18:0/2615528826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca01d570 0x5597ca01b130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:05.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.982+0000 7f3c07e00640 1 -- 172.21.15.18:0/2615528826 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597c9d57620 con 0x5597ca012cd0 2024-09-12T02:50:05.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.983+0000 7f3c07e00640 1 --2- 172.21.15.18:0/2615528826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca012cd0 0x5597ca01abf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4000c00 tx=0x7f3bf4009620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9acde7741cf7ef83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.983+0000 7f3beea00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:50:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.983+0000 7f3beea00640 1 -- 172.21.15.18:0/2615528826 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4049070 con 0x5597ca012cd0 2024-09-12T02:50:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.984+0000 7f3c12a54740 1 -- 172.21.15.18:0/2615528826 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c00004030 con 0x5597ca012cd0 2024-09-12T02:50:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.984+0000 7f3beea00640 1 -- 172.21.15.18:0/2615528826 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f3bf40bc400 con 0x5597ca012cd0 2024-09-12T02:50:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.984+0000 7f3beea00640 1 -- 172.21.15.18:0/2615528826 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3bf40bbae0 con 0x5597ca012cd0 2024-09-12T02:50:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.986+0000 7f3c12a54740 10 client.25411 fetch_fsmap learned FSMap version 32 2024-09-12T02:50:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.986+0000 7f3c12a54740 1 -- 172.21.15.18:0/2615528826 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5597ca01ffe0 con 0x5597ca012cd0 2024-09-12T02:50:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.987+0000 7f3beea00640 1 -- 172.21.15.18:0/2615528826 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c00004030 con 0x5597ca012cd0 2024-09-12T02:50:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.987+0000 7f3beea00640 1 -- 172.21.15.18:0/2615528826 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f3bf40c46d0 con 0x5597ca012cd0 2024-09-12T02:50:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.987+0000 7f3c12a54740 10 client.25411 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T02:50:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.987+0000 7f3c12a54740 10 client.25411 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:50:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.987+0000 7f3c12a54740 20 client.25411 populate_metadata read hostname 'smithi018' 2024-09-12T02:50:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.987+0000 7f3c12a54740 1 --2- 172.21.15.18:0/2615528826 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5597ca03e2e0 0x5597ca0407a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.987+0000 7f3c12a54740 4 client.25411 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:50:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.987+0000 7f3c12a54740 1 -- 172.21.15.18:0/2615528826 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597c9f85830 con 0x5597ca03e2e0 2024-09-12T02:50:05.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.988+0000 7f3c0d000640 1 --2- 172.21.15.18:0/2615528826 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5597ca03e2e0 0x5597ca0407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.988+0000 7f3c0d000640 1 --2- 172.21.15.18:0/2615528826 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5597ca03e2e0 0x5597ca0407a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd08845320301bcb server_cookie=b60c0799c760c871 in_seq=0 out_seq=0 2024-09-12T02:50:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.988+0000 7f3beea00640 10 client.25411 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:50:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.989+0000 7f3beea00640 1 -- 172.21.15.18:0/2615528826 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5597c9f85830 con 0x5597ca03e2e0 2024-09-12T02:50:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.989+0000 7f3beea00640 10 client.25411 handle_command_reply: tid=0 2024-09-12T02:50:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.989+0000 7f3c12a54740 1 client.25411 shutdown 2024-09-12T02:50:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.989+0000 7f3c12a54740 1 -- 172.21.15.18:0/2615528826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca012cd0 msgr2=0x5597ca01abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.989+0000 7f3c12a54740 1 --2- 172.21.15.18:0/2615528826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca012cd0 0x5597ca01abf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4000c00 tx=0x7f3bf4009620 comp rx=0 tx=0).stop 2024-09-12T02:50:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.989+0000 7f3c12a54740 1 -- 172.21.15.18:0/2615528826 shutdown_connections 2024-09-12T02:50:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.989+0000 7f3c12a54740 1 --2- 172.21.15.18:0/2615528826 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5597ca03e2e0 0x5597ca0407a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.989+0000 7f3c12a54740 1 --2- 172.21.15.18:0/2615528826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca01d570 0x5597ca01b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.989+0000 7f3c12a54740 1 --2- 172.21.15.18:0/2615528826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca012cd0 0x5597ca01abf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.989+0000 7f3c12a54740 1 --2- 172.21.15.18:0/2615528826 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca0123b0 0x5597ca01a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.989+0000 7f3c12a54740 1 -- 172.21.15.18:0/2615528826 >> 172.21.15.18:0/2615528826 conn(0x5597ca00e920 msgr2=0x5597ca014680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.989+0000 7f3beea00640 0 client.25411 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:50:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.990+0000 7f3c12a54740 1 -- 172.21.15.18:0/2615528826 shutdown_connections 2024-09-12T02:50:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.990+0000 7f3c12a54740 1 -- 172.21.15.18:0/2615528826 wait complete. 2024-09-12T02:50:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:05.990+0000 7f3c12a54740 20 client.25411 trim_cache size 0 max 16384 2024-09-12T02:50:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.006+0000 7f3c12a54740 1 Processor -- start 2024-09-12T02:50:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.006+0000 7f3c12a54740 1 -- start start 2024-09-12T02:50:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.007+0000 7f3c12a54740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca0123b0 0x5597ca014e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.007+0000 7f3c12a54740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca012cd0 0x5597ca046070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.007+0000 7f3c12a54740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca01d570 0x5597ca0465b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.007+0000 7f3c12a54740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3c08071650 con 0x5597ca0123b0 2024-09-12T02:50:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.007+0000 7f3c12a54740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3c080731f0 con 0x5597ca01d570 2024-09-12T02:50:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.007+0000 7f3c12a54740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3c08071d20 con 0x5597ca012cd0 2024-09-12T02:50:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.007+0000 7f3c0da00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca01d570 0x5597ca0465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.007+0000 7f3c0da00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca01d570 0x5597ca0465b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:41588/0 (socket says 172.21.15.18:41588) 2024-09-12T02:50:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.007+0000 7f3c0da00640 1 -- 172.21.15.18:0/4154048920 learned_addr learned my addr 172.21.15.18:0/4154048920 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.007+0000 7f3c0da00640 1 -- 172.21.15.18:0/4154048920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca012cd0 msgr2=0x5597ca046070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.007+0000 7f3c0da00640 1 --2- 172.21.15.18:0/4154048920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca012cd0 0x5597ca046070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.007+0000 7f3c0d000640 1 --2- 172.21.15.18:0/4154048920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca0123b0 0x5597ca014e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.008+0000 7f3c0da00640 1 -- 172.21.15.18:0/4154048920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca0123b0 msgr2=0x5597ca014e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.008+0000 7f3c0da00640 1 --2- 172.21.15.18:0/4154048920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca0123b0 0x5597ca014e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.008+0000 7f3c0da00640 1 -- 172.21.15.18:0/4154048920 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597ca01fcd0 con 0x5597ca01d570 2024-09-12T02:50:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.008+0000 7f3c0d000640 1 --2- 172.21.15.18:0/4154048920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca0123b0 0x5597ca014e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:50:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.008+0000 7f3c0da00640 1 --2- 172.21.15.18:0/4154048920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca01d570 0x5597ca0465b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3c00006010 tx=0x7f3c00005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f3b29eeed91266d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.008+0000 7f3bf9600640 1 -- 172.21.15.18:0/4154048920 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0001e040 con 0x5597ca01d570 2024-09-12T02:50:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.008+0000 7f3bf9600640 1 -- 172.21.15.18:0/4154048920 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c00029070 con 0x5597ca01d570 2024-09-12T02:50:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.008+0000 7f3bf9600640 1 -- 172.21.15.18:0/4154048920 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00024790 con 0x5597ca01d570 2024-09-12T02:50:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.009+0000 7f3c12a54740 1 -- 172.21.15.18:0/4154048920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca01d570 msgr2=0x5597ca0465b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.009+0000 7f3c12a54740 1 --2- 172.21.15.18:0/4154048920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca01d570 0x5597ca0465b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3c00006010 tx=0x7f3c00005bd0 comp rx=0 tx=0).stop 2024-09-12T02:50:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.009+0000 7f3c12a54740 1 -- 172.21.15.18:0/4154048920 shutdown_connections 2024-09-12T02:50:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.009+0000 7f3c12a54740 1 --2- 172.21.15.18:0/4154048920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca01d570 0x5597ca0465b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.009+0000 7f3c12a54740 1 --2- 172.21.15.18:0/4154048920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca012cd0 0x5597ca046070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.009+0000 7f3c12a54740 1 --2- 172.21.15.18:0/4154048920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca0123b0 0x5597ca014e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.009+0000 7f3c12a54740 1 -- 172.21.15.18:0/4154048920 >> 172.21.15.18:0/4154048920 conn(0x5597ca00e920 msgr2=0x5597ca01c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.009+0000 7f3c12a54740 1 -- 172.21.15.18:0/4154048920 shutdown_connections 2024-09-12T02:50:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.009+0000 7f3c12a54740 1 -- 172.21.15.18:0/4154048920 wait complete. 2024-09-12T02:50:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.010+0000 7f3c12a54740 1 -- start start 2024-09-12T02:50:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.010+0000 7f3c12a54740 1 Processor -- start 2024-09-12T02:50:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.010+0000 7f3c12a54740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca0123b0 0x5597ca025a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.010+0000 7f3c12a54740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca012cd0 0x5597ca017360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.010+0000 7f3c12a54740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca01d570 0x5597ca0178a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.010+0000 7f3c12a54740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3c08072ac0 con 0x5597ca012cd0 2024-09-12T02:50:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.010+0000 7f3c12a54740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3c080723f0 con 0x5597ca01d570 2024-09-12T02:50:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.010+0000 7f3c12a54740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0806f630 con 0x5597ca0123b0 2024-09-12T02:50:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.010+0000 7f3c12a54740 10 client.0 _ll_register_callbacks cb 0x7f3bf40045a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.011+0000 7f3c07e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca012cd0 0x5597ca017360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.011+0000 7f3c0d000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca0123b0 0x5597ca025a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.011+0000 7f3c0d000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca0123b0 0x5597ca025a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:49284/0 (socket says 172.21.15.18:49284) 2024-09-12T02:50:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.011+0000 7f3c07e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca012cd0 0x5597ca017360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48062/0 (socket says 172.21.15.18:48062) 2024-09-12T02:50:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.011+0000 7f3c0d000640 1 -- 172.21.15.18:0/1214804087 learned_addr learned my addr 172.21.15.18:0/1214804087 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.011+0000 7f3c0da00640 1 --2- 172.21.15.18:0/1214804087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca01d570 0x5597ca0178a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.011+0000 7f3c0d000640 1 -- 172.21.15.18:0/1214804087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca01d570 msgr2=0x5597ca0178a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.011+0000 7f3c0d000640 1 --2- 172.21.15.18:0/1214804087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca01d570 0x5597ca0178a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.011+0000 7f3c0d000640 1 -- 172.21.15.18:0/1214804087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca012cd0 msgr2=0x5597ca017360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.011+0000 7f3c0d000640 1 --2- 172.21.15.18:0/1214804087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca012cd0 0x5597ca017360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.011+0000 7f3c0d000640 1 -- 172.21.15.18:0/1214804087 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597ca017fe0 con 0x5597ca0123b0 2024-09-12T02:50:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.011+0000 7f3c0da00640 1 --2- 172.21.15.18:0/1214804087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca01d570 0x5597ca0178a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:50:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.011+0000 7f3c0d000640 1 --2- 172.21.15.18:0/1214804087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca0123b0 0x5597ca025a20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5597ca040fe0 tx=0x7f3bfc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=564f2c89f6aedd05 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.011+0000 7f3beea00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:50:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.012+0000 7f3beea00640 1 -- 172.21.15.18:0/1214804087 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc00fdc0 con 0x5597ca0123b0 2024-09-12T02:50:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.012+0000 7f3beea00640 1 -- 172.21.15.18:0/1214804087 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f3bfc005020 con 0x5597ca0123b0 2024-09-12T02:50:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.012+0000 7f3c12a54740 1 -- 172.21.15.18:0/1214804087 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c00029070 con 0x5597ca0123b0 2024-09-12T02:50:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.012+0000 7f3beea00640 1 -- 172.21.15.18:0/1214804087 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3bfc039050 con 0x5597ca0123b0 2024-09-12T02:50:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.012+0000 7f3c12a54740 10 client.25414 fetch_fsmap learned FSMap version 32 2024-09-12T02:50:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.012+0000 7f3c12a54740 1 -- 172.21.15.18:0/1214804087 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5597ca0a8f90 con 0x5597ca0123b0 2024-09-12T02:50:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.012+0000 7f3beea00640 1 -- 172.21.15.18:0/1214804087 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c00029070 con 0x5597ca0123b0 2024-09-12T02:50:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.013+0000 7f3beea00640 1 -- 172.21.15.18:0/1214804087 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f3bfc0292a0 con 0x5597ca0123b0 2024-09-12T02:50:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.013+0000 7f3c12a54740 10 client.25414 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T02:50:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.013+0000 7f3c12a54740 10 client.25414 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:50:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.013+0000 7f3c12a54740 20 client.25414 populate_metadata read hostname 'smithi018' 2024-09-12T02:50:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.013+0000 7f3c12a54740 1 --2- 172.21.15.18:0/1214804087 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5597ca0a9770 0x5597ca0abb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.013+0000 7f3c12a54740 4 client.25414 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:50:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.013+0000 7f3c12a54740 1 -- 172.21.15.18:0/1214804087 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5597c9f7fb80 con 0x5597ca0a9770 2024-09-12T02:50:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.013+0000 7f3c07e00640 1 --2- 172.21.15.18:0/1214804087 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5597ca0a9770 0x5597ca0abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.014+0000 7f3c07e00640 1 --2- 172.21.15.18:0/1214804087 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5597ca0a9770 0x5597ca0abb90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcde39040f6d3bd9 server_cookie=e0d0dda65dcfbcb9 in_seq=0 out_seq=0 2024-09-12T02:50:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.014+0000 7f3beea00640 10 client.25414 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:50:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.020+0000 7f3beea00640 1 -- 172.21.15.18:0/1214804087 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5597c9f7fb80 con 0x5597ca0a9770 2024-09-12T02:50:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.020+0000 7f3beea00640 10 client.25414 handle_command_reply: tid=0 2024-09-12T02:50:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.020+0000 7f3c12a54740 1 client.25414 shutdown 2024-09-12T02:50:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.020+0000 7f3c12a54740 1 -- 172.21.15.18:0/1214804087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca0123b0 msgr2=0x5597ca025a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.020+0000 7f3c12a54740 1 --2- 172.21.15.18:0/1214804087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca0123b0 0x5597ca025a20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5597ca040fe0 tx=0x7f3bfc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:50:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.021+0000 7f3c12a54740 1 -- 172.21.15.18:0/1214804087 shutdown_connections 2024-09-12T02:50:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.021+0000 7f3c12a54740 1 --2- 172.21.15.18:0/1214804087 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5597ca0a9770 0x5597ca0abb90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.021+0000 7f3c12a54740 1 --2- 172.21.15.18:0/1214804087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5597ca01d570 0x5597ca0178a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.021+0000 7f3c12a54740 1 --2- 172.21.15.18:0/1214804087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597ca012cd0 0x5597ca017360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.021+0000 7f3beea00640 0 client.25414 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:50:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.021+0000 7f3c12a54740 1 --2- 172.21.15.18:0/1214804087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597ca0123b0 0x5597ca025a20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.021+0000 7f3c12a54740 1 -- 172.21.15.18:0/1214804087 >> 172.21.15.18:0/1214804087 conn(0x5597ca00e920 msgr2=0x5597ca00d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.021+0000 7f3c12a54740 1 -- 172.21.15.18:0/1214804087 shutdown_connections 2024-09-12T02:50:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.021+0000 7f3c12a54740 1 -- 172.21.15.18:0/1214804087 wait complete. 2024-09-12T02:50:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.021+0000 7f3c12a54740 20 client.25414 trim_cache size 0 max 16384 2024-09-12T02:50:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:50:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:50:06.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:50:06.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:50:06.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.022+0000 7f3c0e400640 1 -- 172.21.15.18:0/2031369315 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3bf00a2e90 msgr2=0x7f3bf00a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:06.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.022+0000 7f3c0e400640 1 --2- 172.21.15.18:0/2031369315 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3bf00a2e90 0x7f3bf00a5350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x5597ca00f780 tx=0x7f3bfc005f90 comp rx=0 tx=0).stop 2024-09-12T02:50:06.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.022+0000 7f3c0e400640 1 -- 172.21.15.18:0/2031369315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c08104480 msgr2=0x7f3c0819a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:06.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.022+0000 7f3c0e400640 1 --2- 172.21.15.18:0/2031369315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c08104480 0x7f3c0819a9b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3bf402aa00 tx=0x7f3bf4003c10 comp rx=0 tx=0).stop 2024-09-12T02:50:06.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.022+0000 7f3c0e400640 1 -- 172.21.15.18:0/2031369315 shutdown_connections 2024-09-12T02:50:06.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.022+0000 7f3c0e400640 1 --2- 172.21.15.18:0/2031369315 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3bf00a2e90 0x7f3bf00a5350 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:06.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.022+0000 7f3c0e400640 1 --2- 172.21.15.18:0/2031369315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c08109b80 0x7f3c0819ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:06.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.022+0000 7f3c0e400640 1 --2- 172.21.15.18:0/2031369315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c08104480 0x7f3c0819a9b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:06.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.022+0000 7f3c0e400640 1 --2- 172.21.15.18:0/2031369315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c08103ae0 0x7f3c0819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:06.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.022+0000 7f3c0e400640 1 -- 172.21.15.18:0/2031369315 >> 172.21.15.18:0/2031369315 conn(0x7f3c080ff7c0 msgr2=0x7f3c08100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:06.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.022+0000 7f3c0e400640 1 -- 172.21.15.18:0/2031369315 shutdown_connections 2024-09-12T02:50:06.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:06.022+0000 7f3c0e400640 1 -- 172.21.15.18:0/2031369315 wait complete. 2024-09-12T02:50:06.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:06 smithi176 ceph-mon[35713]: pgmap v44: 129 pgs: 129 active+clean; 5.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 461 KiB/s wr, 81 op/s 2024-09-12T02:50:06.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:06 smithi062 ceph-mon[35527]: pgmap v44: 129 pgs: 129 active+clean; 5.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 461 KiB/s wr, 81 op/s 2024-09-12T02:50:06.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:06 smithi018 ceph-mon[30616]: pgmap v44: 129 pgs: 129 active+clean; 5.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 461 KiB/s wr, 81 op/s 2024-09-12T02:50:08.466 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:08 smithi018 ceph-mon[30616]: pgmap v45: 129 pgs: 129 active+clean; 5.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 447 KiB/s wr, 76 op/s 2024-09-12T02:50:08.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:08 smithi176 ceph-mon[35713]: pgmap v45: 129 pgs: 129 active+clean; 5.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 447 KiB/s wr, 76 op/s 2024-09-12T02:50:08.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:08 smithi062 ceph-mon[35527]: pgmap v45: 129 pgs: 129 active+clean; 5.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 447 KiB/s wr, 76 op/s 2024-09-12T02:50:10.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:10 smithi176 ceph-mon[35713]: pgmap v46: 129 pgs: 129 active+clean; 13 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 1.1 MiB/s wr, 81 op/s 2024-09-12T02:50:10.495 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:10 smithi018 ceph-mon[30616]: pgmap v46: 129 pgs: 129 active+clean; 13 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 1.1 MiB/s wr, 81 op/s 2024-09-12T02:50:10.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:10 smithi062 ceph-mon[35527]: pgmap v46: 129 pgs: 129 active+clean; 13 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 1.1 MiB/s wr, 81 op/s 2024-09-12T02:50:12.448 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:12 smithi018 ceph-mon[30616]: pgmap v47: 129 pgs: 129 active+clean; 13 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 954 KiB/s wr, 77 op/s 2024-09-12T02:50:12.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:12 smithi176 ceph-mon[35713]: pgmap v47: 129 pgs: 129 active+clean; 13 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 954 KiB/s wr, 77 op/s 2024-09-12T02:50:12.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:12 smithi062 ceph-mon[35527]: pgmap v47: 129 pgs: 129 active+clean; 13 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 954 KiB/s wr, 77 op/s 2024-09-12T02:50:14.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:14 smithi176 ceph-mon[35713]: pgmap v48: 129 pgs: 129 active+clean; 13 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 880 KiB/s wr, 61 op/s 2024-09-12T02:50:14.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:14 smithi062 ceph-mon[35527]: pgmap v48: 129 pgs: 129 active+clean; 13 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 880 KiB/s wr, 61 op/s 2024-09-12T02:50:14.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:14 smithi018 ceph-mon[30616]: pgmap v48: 129 pgs: 129 active+clean; 13 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 880 KiB/s wr, 61 op/s 2024-09-12T02:50:14.833 INFO:tasks.workunit.client.0.smithi018.stdout: 16 253666 945 167874 715 99330 1333 2024-09-12T02:50:16.318 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:16 smithi018 ceph-mon[30616]: pgmap v49: 129 pgs: 129 active+clean; 32 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 148 op/s 2024-09-12T02:50:16.318 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:16 smithi018 ceph-mon[30616]: mgrmap e27: x(active, since 92s), standbys: z, y 2024-09-12T02:50:16.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:16 smithi176 ceph-mon[35713]: pgmap v49: 129 pgs: 129 active+clean; 32 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 148 op/s 2024-09-12T02:50:16.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:16 smithi176 ceph-mon[35713]: mgrmap e27: x(active, since 92s), standbys: z, y 2024-09-12T02:50:16.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:16 smithi062 ceph-mon[35527]: pgmap v49: 129 pgs: 129 active+clean; 32 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 148 op/s 2024-09-12T02:50:16.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:16 smithi062 ceph-mon[35527]: mgrmap e27: x(active, since 92s), standbys: z, y 2024-09-12T02:50:18.301 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:18 smithi018 ceph-mon[30616]: pgmap v50: 129 pgs: 129 active+clean; 32 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 99 op/s 2024-09-12T02:50:18.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:18 smithi176 ceph-mon[35713]: pgmap v50: 129 pgs: 129 active+clean; 32 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 99 op/s 2024-09-12T02:50:18.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:18 smithi062 ceph-mon[35527]: pgmap v50: 129 pgs: 129 active+clean; 32 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 99 op/s 2024-09-12T02:50:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 -- 172.21.15.18:0/448968353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb9c107b80 msgr2=0x7ffb9c107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 --2- 172.21.15.18:0/448968353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb9c107b80 0x7ffb9c107f60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009930 tx=0x7ffb8c02a420 comp rx=0 tx=0).stop 2024-09-12T02:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 -- 172.21.15.18:0/448968353 shutdown_connections 2024-09-12T02:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 --2- 172.21.15.18:0/448968353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb9c102480 0x7ffb9c10e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 --2- 172.21.15.18:0/448968353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb9c101ae0 0x7ffb9c101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 --2- 172.21.15.18:0/448968353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb9c107b80 0x7ffb9c107f60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 -- 172.21.15.18:0/448968353 >> 172.21.15.18:0/448968353 conn(0x7ffb9c0fd7e0 msgr2=0x7ffb9c0ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 -- 172.21.15.18:0/448968353 shutdown_connections 2024-09-12T02:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 -- 172.21.15.18:0/448968353 wait complete. 2024-09-12T02:50:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 Processor -- start 2024-09-12T02:50:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 -- start start 2024-09-12T02:50:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb9c101ae0 0x7ffb9c19a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb9c102480 0x7ffb9c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb9c107b80 0x7ffb9c19ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c111f30 con 0x7ffb9c102480 2024-09-12T02:50:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c111db0 con 0x7ffb9c101ae0 2024-09-12T02:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1120b0 con 0x7ffb9c107b80 2024-09-12T02:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffb99e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb9c101ae0 0x7ffb9c19a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffb99e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb9c101ae0 0x7ffb9c19a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:43606/0 (socket says 172.21.15.18:43606) 2024-09-12T02:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffb99e00640 1 -- 172.21.15.18:0/2579276529 learned_addr learned my addr 172.21.15.18:0/2579276529 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffb99400640 1 --2- 172.21.15.18:0/2579276529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb9c102480 0x7ffb9c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffb9a800640 1 --2- 172.21.15.18:0/2579276529 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb9c107b80 0x7ffb9c19ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffb99e00640 1 -- 172.21.15.18:0/2579276529 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb9c107b80 msgr2=0x7ffb9c19ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffb99e00640 1 --2- 172.21.15.18:0/2579276529 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb9c107b80 0x7ffb9c19ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffb99e00640 1 -- 172.21.15.18:0/2579276529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb9c102480 msgr2=0x7ffb9c19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffb99e00640 1 --2- 172.21.15.18:0/2579276529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb9c102480 0x7ffb9c19aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffb99e00640 1 -- 172.21.15.18:0/2579276529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9c19f570 con 0x7ffb9c101ae0 2024-09-12T02:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffb99e00640 1 --2- 172.21.15.18:0/2579276529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb9c101ae0 0x7ffb9c19a580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009230 tx=0x7ffb8c004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffb92a00640 1 -- 172.21.15.18:0/2579276529 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c03f030 con 0x7ffb9c101ae0 2024-09-12T02:50:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffb92a00640 1 -- 172.21.15.18:0/2579276529 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb8c004440 con 0x7ffb9c101ae0 2024-09-12T02:50:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 -- 172.21.15.18:0/2579276529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb9c19f800 con 0x7ffb9c101ae0 2024-09-12T02:50:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffb92a00640 1 -- 172.21.15.18:0/2579276529 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c035070 con 0x7ffb9c101ae0 2024-09-12T02:50:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.139+0000 7ffba1000640 1 -- 172.21.15.18:0/2579276529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb9c1a70f0 con 0x7ffb9c101ae0 2024-09-12T02:50:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 Processor -- start 2024-09-12T02:50:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 -- start start 2024-09-12T02:50:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988481e0 0x55c6988485c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c698848b00 0x55c698852e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6988533a0 0x55c698855790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c6987ae100 con 0x55c698848b00 2024-09-12T02:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c6987561b0 con 0x55c6988481e0 2024-09-12T02:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c6987aa0c0 con 0x55c6988533a0 2024-09-12T02:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb92a00640 1 -- 172.21.15.18:0/2579276529 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7ffb8c042030 con 0x7ffb9c101ae0 2024-09-12T02:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb9a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988481e0 0x55c6988485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb9a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988481e0 0x55c6988485c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:43618/0 (socket says 172.21.15.18:43618) 2024-09-12T02:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb9a800640 1 -- 172.21.15.18:0/562165406 learned_addr learned my addr 172.21.15.18:0/562165406 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb99400640 1 --2- 172.21.15.18:0/562165406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6988533a0 0x55c698855790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb99e00640 1 --2- 172.21.15.18:0/562165406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c698848b00 0x55c698852e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb9a800640 1 -- 172.21.15.18:0/562165406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6988533a0 msgr2=0x55c698855790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb9a800640 1 --2- 172.21.15.18:0/562165406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6988533a0 0x55c698855790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb9a800640 1 -- 172.21.15.18:0/562165406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c698848b00 msgr2=0x55c698852e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb9a800640 1 --2- 172.21.15.18:0/562165406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c698848b00 0x55c698852e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb9a800640 1 -- 172.21.15.18:0/562165406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6984c1210 con 0x55c6988481e0 2024-09-12T02:50:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb9a800640 1 --2- 172.21.15.18:0/562165406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988481e0 0x55c6988485c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009f50 tx=0x7ffb940118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=788f9956d4fb9c0f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb87400640 1 -- 172.21.15.18:0/562165406 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94004d20 con 0x55c6988481e0 2024-09-12T02:50:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb87400640 1 -- 172.21.15.18:0/562165406 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb94004050 con 0x55c6988481e0 2024-09-12T02:50:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb87400640 1 -- 172.21.15.18:0/562165406 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94005280 con 0x55c6988481e0 2024-09-12T02:50:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 -- 172.21.15.18:0/562165406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988481e0 msgr2=0x55c6988485c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/562165406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988481e0 0x55c6988485c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009f50 tx=0x7ffb940118d0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb92a00640 1 --2- 172.21.15.18:0/2579276529 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ffb800a2da0 0x7ffb800a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb92a00640 1 -- 172.21.15.18:0/2579276529 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7ffb8c0ef7d0 con 0x7ffb9c101ae0 2024-09-12T02:50:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 -- 172.21.15.18:0/562165406 shutdown_connections 2024-09-12T02:50:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/562165406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6988533a0 0x55c698855790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/562165406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c698848b00 0x55c698852e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/562165406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988481e0 0x55c6988485c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 -- 172.21.15.18:0/562165406 >> 172.21.15.18:0/562165406 conn(0x55c698844750 msgr2=0x55c698844b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb9a800640 1 --2- 172.21.15.18:0/2579276529 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ffb800a2da0 0x7ffb800a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 -- 172.21.15.18:0/562165406 shutdown_connections 2024-09-12T02:50:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 -- 172.21.15.18:0/562165406 wait complete. 2024-09-12T02:50:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 -- start start 2024-09-12T02:50:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffba3dc5740 1 Processor -- start 2024-09-12T02:50:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.145+0000 7ffb9a800640 1 --2- 172.21.15.18:0/2579276529 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ffb800a2da0 0x7ffb800a5260 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffb9401b040 tx=0x7ffb94004720 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6988481e0 0x55c698850210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c698848b00 0x55c698850750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988533a0 0x55c698850c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c698855f70 con 0x55c698848b00 2024-09-12T02:50:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c698737090 con 0x55c6988533a0 2024-09-12T02:50:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c6988560f0 con 0x55c6988481e0 2024-09-12T02:50:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 10 client.0 _ll_register_callbacks cb 0x55c69878bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb99400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c698848b00 0x55c698850750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb99e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6988481e0 0x55c698850210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb9a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988533a0 0x55c698850c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb99e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6988481e0 0x55c698850210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:54786/0 (socket says 172.21.15.18:54786) 2024-09-12T02:50:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb99e00640 1 -- 172.21.15.18:0/416396511 learned_addr learned my addr 172.21.15.18:0/416396511 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb99400640 1 --2- 172.21.15.18:0/416396511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c698848b00 0x55c698850750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35804/0 (socket says 172.21.15.18:35804) 2024-09-12T02:50:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb99e00640 1 -- 172.21.15.18:0/416396511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988533a0 msgr2=0x55c698850c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb99e00640 1 --2- 172.21.15.18:0/416396511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988533a0 0x55c698850c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb99e00640 1 -- 172.21.15.18:0/416396511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c698848b00 msgr2=0x55c698850750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb99e00640 1 --2- 172.21.15.18:0/416396511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c698848b00 0x55c698850750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb99e00640 1 -- 172.21.15.18:0/416396511 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c69858d620 con 0x55c6988481e0 2024-09-12T02:50:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb99400640 1 --2- 172.21.15.18:0/416396511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c698848b00 0x55c698850750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:50:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb9a800640 1 --2- 172.21.15.18:0/416396511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988533a0 0x55c698850c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:50:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb99e00640 1 --2- 172.21.15.18:0/416396511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6988481e0 0x55c698850210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009a50 tx=0x7ffb8c0bb580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=329d7e55392cfc6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb7be00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:50:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb7be00640 1 -- 172.21.15.18:0/416396511 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c049050 con 0x55c6988481e0 2024-09-12T02:50:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 -- 172.21.15.18:0/416396511 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb94004050 con 0x55c6988481e0 2024-09-12T02:50:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb7be00640 1 -- 172.21.15.18:0/416396511 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7ffb8c0ecd80 con 0x55c6988481e0 2024-09-12T02:50:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb7be00640 1 -- 172.21.15.18:0/416396511 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ffb8c0ecf80 con 0x55c6988481e0 2024-09-12T02:50:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 10 client.25426 fetch_fsmap learned FSMap version 32 2024-09-12T02:50:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 -- 172.21.15.18:0/416396511 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c698855fc0 con 0x55c6988481e0 2024-09-12T02:50:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb7be00640 1 -- 172.21.15.18:0/416396511 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb94004050 con 0x55c6988481e0 2024-09-12T02:50:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb7be00640 1 -- 172.21.15.18:0/416396511 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7ffb8c0ef020 con 0x55c6988481e0 2024-09-12T02:50:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 10 client.25426 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T02:50:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 10 client.25426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:50:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 20 client.25426 populate_metadata read hostname 'smithi018' 2024-09-12T02:50:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/416396511 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c698862f20 0x55c698865380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 4 client.25426 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:50:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 -- 172.21.15.18:0/416396511 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6987bb830 con 0x55c698862f20 2024-09-12T02:50:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb99400640 1 --2- 172.21.15.18:0/416396511 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c698862f20 0x55c698865380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb99400640 1 --2- 172.21.15.18:0/416396511 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c698862f20 0x55c698865380 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cadf8bef893d6251 server_cookie=b92e63184420f9b9 in_seq=0 out_seq=0 2024-09-12T02:50:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb7be00640 10 client.25426 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:50:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb7be00640 1 -- 172.21.15.18:0/416396511 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c6987bb830 con 0x55c698862f20 2024-09-12T02:50:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb7be00640 10 client.25426 handle_command_reply: tid=0 2024-09-12T02:50:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 client.25426 shutdown 2024-09-12T02:50:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 -- 172.21.15.18:0/416396511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6988481e0 msgr2=0x55c698850210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/416396511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6988481e0 0x55c698850210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009a50 tx=0x7ffb8c0bb580 comp rx=0 tx=0).stop 2024-09-12T02:50:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 -- 172.21.15.18:0/416396511 shutdown_connections 2024-09-12T02:50:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/416396511 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c698862f20 0x55c698865380 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/416396511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988533a0 0x55c698850c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/416396511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c698848b00 0x55c698850750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffb7be00640 0 client.25426 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:50:19.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/416396511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6988481e0 0x55c698850210 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 -- 172.21.15.18:0/416396511 >> 172.21.15.18:0/416396511 conn(0x55c698844750 msgr2=0x55c69884a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:19.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 -- 172.21.15.18:0/416396511 shutdown_connections 2024-09-12T02:50:19.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 1 -- 172.21.15.18:0/416396511 wait complete. 2024-09-12T02:50:19.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.151+0000 7ffba3dc5740 20 client.25426 trim_cache size 0 max 16384 2024-09-12T02:50:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 Processor -- start 2024-09-12T02:50:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 -- start start 2024-09-12T02:50:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6988481e0 0x55c698850ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c698848b00 0x55c698843720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c6988533a0 0x55c69886ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1b1220 con 0x55c6988533a0 2024-09-12T02:50:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1b2dc0 con 0x55c698848b00 2024-09-12T02:50:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1b18f0 con 0x55c6988481e0 2024-09-12T02:50:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb9a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c6988533a0 0x55c69886ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb9a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c6988533a0 0x55c69886ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35806/0 (socket says 172.21.15.18:35806) 2024-09-12T02:50:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb9a800640 1 -- 172.21.15.18:0/3362541584 learned_addr learned my addr 172.21.15.18:0/3362541584 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb99400640 1 --2- 172.21.15.18:0/3362541584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c698848b00 0x55c698843720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb99e00640 1 --2- 172.21.15.18:0/3362541584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6988481e0 0x55c698850ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb9a800640 1 -- 172.21.15.18:0/3362541584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6988481e0 msgr2=0x55c698850ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb9a800640 1 --2- 172.21.15.18:0/3362541584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6988481e0 0x55c698850ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb9a800640 1 -- 172.21.15.18:0/3362541584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c698848b00 msgr2=0x55c698843720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb9a800640 1 --2- 172.21.15.18:0/3362541584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c698848b00 0x55c698843720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb9a800640 1 -- 172.21.15.18:0/3362541584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c698844580 con 0x55c6988533a0 2024-09-12T02:50:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb99400640 1 --2- 172.21.15.18:0/3362541584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c698848b00 0x55c698843720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:50:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb9a800640 1 --2- 172.21.15.18:0/3362541584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c6988533a0 0x55c69886ac00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffb9401a000 tx=0x7ffb94009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30023cbd05bafa2d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb86a00640 1 -- 172.21.15.18:0/3362541584 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb940055c0 con 0x55c6988533a0 2024-09-12T02:50:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb86a00640 1 -- 172.21.15.18:0/3362541584 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb94029040 con 0x55c6988533a0 2024-09-12T02:50:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb86a00640 1 -- 172.21.15.18:0/3362541584 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94025cf0 con 0x55c6988533a0 2024-09-12T02:50:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 -- 172.21.15.18:0/3362541584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c6988533a0 msgr2=0x55c69886ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/3362541584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c6988533a0 0x55c69886ac00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffb9401a000 tx=0x7ffb94009500 comp rx=0 tx=0).stop 2024-09-12T02:50:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 -- 172.21.15.18:0/3362541584 shutdown_connections 2024-09-12T02:50:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/3362541584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c6988533a0 0x55c69886ac00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/3362541584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c698848b00 0x55c698843720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/3362541584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6988481e0 0x55c698850ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 -- 172.21.15.18:0/3362541584 >> 172.21.15.18:0/3362541584 conn(0x55c698844750 msgr2=0x55c698843010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 -- 172.21.15.18:0/3362541584 shutdown_connections 2024-09-12T02:50:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 -- 172.21.15.18:0/3362541584 wait complete. 2024-09-12T02:50:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 -- start start 2024-09-12T02:50:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 Processor -- start 2024-09-12T02:50:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c6988481e0 0x55c69885b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c698848b00 0x55c69884cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988533a0 0x55c69884d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1b2690 con 0x55c6988481e0 2024-09-12T02:50:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1b1fc0 con 0x55c6988533a0 2024-09-12T02:50:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1af200 con 0x55c698848b00 2024-09-12T02:50:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffba3dc5740 10 client.0 _ll_register_callbacks cb 0x7ffb8c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb99e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c6988481e0 0x55c69885b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb99e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c6988481e0 0x55c69885b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35816/0 (socket says 172.21.15.18:35816) 2024-09-12T02:50:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb99e00640 1 -- 172.21.15.18:0/1515482262 learned_addr learned my addr 172.21.15.18:0/1515482262 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb9a800640 1 --2- 172.21.15.18:0/1515482262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988533a0 0x55c69884d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb99400640 1 --2- 172.21.15.18:0/1515482262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c698848b00 0x55c69884cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb99e00640 1 -- 172.21.15.18:0/1515482262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c698848b00 msgr2=0x55c69884cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb99e00640 1 --2- 172.21.15.18:0/1515482262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c698848b00 0x55c69884cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb99e00640 1 -- 172.21.15.18:0/1515482262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988533a0 msgr2=0x55c69884d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.169+0000 7ffb99e00640 1 --2- 172.21.15.18:0/1515482262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988533a0 0x55c69884d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffb99e00640 1 -- 172.21.15.18:0/1515482262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c69883fd60 con 0x55c6988481e0 2024-09-12T02:50:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffb9a800640 1 --2- 172.21.15.18:0/1515482262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988533a0 0x55c69884d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:50:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffb99e00640 1 --2- 172.21.15.18:0/1515482262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c6988481e0 0x55c69885b7d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0b9c30 tx=0x7ffb8c003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde99216ab4b810 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffb7be00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:50:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffb7be00640 1 -- 172.21.15.18:0/1515482262 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c0b7c20 con 0x55c6988481e0 2024-09-12T02:50:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffb7be00640 1 -- 172.21.15.18:0/1515482262 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7ffb8c0ef560 con 0x55c6988481e0 2024-09-12T02:50:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffba3dc5740 1 -- 172.21.15.18:0/1515482262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb94029040 con 0x55c6988481e0 2024-09-12T02:50:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffb7be00640 1 -- 172.21.15.18:0/1515482262 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ffb8c0bb750 con 0x55c6988481e0 2024-09-12T02:50:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffba3dc5740 10 client.15426 fetch_fsmap learned FSMap version 32 2024-09-12T02:50:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffba3dc5740 1 -- 172.21.15.18:0/1515482262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c6988cd7a0 con 0x55c6988481e0 2024-09-12T02:50:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffb7be00640 1 -- 172.21.15.18:0/1515482262 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb94029040 con 0x55c6988481e0 2024-09-12T02:50:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffb7be00640 1 -- 172.21.15.18:0/1515482262 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7ffb8c0ef040 con 0x55c6988481e0 2024-09-12T02:50:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffba3dc5740 10 client.15426 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T02:50:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffba3dc5740 10 client.15426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:50:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffba3dc5740 20 client.15426 populate_metadata read hostname 'smithi018' 2024-09-12T02:50:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/1515482262 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c6988cde10 0x55c6988d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffba3dc5740 4 client.15426 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:50:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffba3dc5740 1 -- 172.21.15.18:0/1515482262 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c6987b5b80 con 0x55c6988cde10 2024-09-12T02:50:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffb99400640 1 --2- 172.21.15.18:0/1515482262 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c6988cde10 0x55c6988d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffb99400640 1 --2- 172.21.15.18:0/1515482262 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c6988cde10 0x55c6988d0230 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5124a904371740fc server_cookie=78352ddd75d95e13 in_seq=0 out_seq=0 2024-09-12T02:50:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.175+0000 7ffb7be00640 10 client.15426 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:50:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffb7be00640 1 -- 172.21.15.18:0/1515482262 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c6987b5b80 con 0x55c6988cde10 2024-09-12T02:50:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffb7be00640 10 client.15426 handle_command_reply: tid=0 2024-09-12T02:50:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba3dc5740 1 client.15426 shutdown 2024-09-12T02:50:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba3dc5740 1 -- 172.21.15.18:0/1515482262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c6988481e0 msgr2=0x55c69885b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/1515482262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c6988481e0 0x55c69885b7d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0b9c30 tx=0x7ffb8c003f30 comp rx=0 tx=0).stop 2024-09-12T02:50:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba3dc5740 1 -- 172.21.15.18:0/1515482262 shutdown_connections 2024-09-12T02:50:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/1515482262 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c6988cde10 0x55c6988d0230 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/1515482262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c6988533a0 0x55c69884d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/1515482262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c698848b00 0x55c69884cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffb7be00640 0 client.15426 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:50:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba3dc5740 1 --2- 172.21.15.18:0/1515482262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c6988481e0 0x55c69885b7d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba3dc5740 1 -- 172.21.15.18:0/1515482262 >> 172.21.15.18:0/1515482262 conn(0x55c698844750 msgr2=0x55c69885e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba3dc5740 1 -- 172.21.15.18:0/1515482262 shutdown_connections 2024-09-12T02:50:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba3dc5740 1 -- 172.21.15.18:0/1515482262 wait complete. 2024-09-12T02:50:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba3dc5740 20 client.15426 trim_cache size 0 max 16384 2024-09-12T02:50:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:50:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:50:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:50:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:50:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba1000640 1 -- 172.21.15.18:0/2579276529 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ffb800a2da0 msgr2=0x7ffb800a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba1000640 1 --2- 172.21.15.18:0/2579276529 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ffb800a2da0 0x7ffb800a5260 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffb9401b040 tx=0x7ffb94004720 comp rx=0 tx=0).stop 2024-09-12T02:50:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba1000640 1 -- 172.21.15.18:0/2579276529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb9c101ae0 msgr2=0x7ffb9c19a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba1000640 1 --2- 172.21.15.18:0/2579276529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb9c101ae0 0x7ffb9c19a580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009230 tx=0x7ffb8c004040 comp rx=0 tx=0).stop 2024-09-12T02:50:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba1000640 1 -- 172.21.15.18:0/2579276529 shutdown_connections 2024-09-12T02:50:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba1000640 1 --2- 172.21.15.18:0/2579276529 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ffb800a2da0 0x7ffb800a5260 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba1000640 1 --2- 172.21.15.18:0/2579276529 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb9c107b80 0x7ffb9c19ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba1000640 1 --2- 172.21.15.18:0/2579276529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb9c102480 0x7ffb9c19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba1000640 1 --2- 172.21.15.18:0/2579276529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb9c101ae0 0x7ffb9c19a580 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba1000640 1 -- 172.21.15.18:0/2579276529 >> 172.21.15.18:0/2579276529 conn(0x7ffb9c0fd7e0 msgr2=0x7ffb9c0fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba1000640 1 -- 172.21.15.18:0/2579276529 shutdown_connections 2024-09-12T02:50:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:19.181+0000 7ffba1000640 1 -- 172.21.15.18:0/2579276529 wait complete. 2024-09-12T02:50:20.300 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:20 smithi018 ceph-mon[30616]: pgmap v51: 129 pgs: 129 active+clean; 50 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 215 op/s 2024-09-12T02:50:20.300 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:20 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:50:20.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:20 smithi176 ceph-mon[35713]: pgmap v51: 129 pgs: 129 active+clean; 50 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 215 op/s 2024-09-12T02:50:20.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:20 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:50:20.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:20 smithi062 ceph-mon[35527]: pgmap v51: 129 pgs: 129 active+clean; 50 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 215 op/s 2024-09-12T02:50:20.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:20 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:50:22.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:22 smithi176 ceph-mon[35713]: pgmap v52: 129 pgs: 129 active+clean; 54 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 242 op/s 2024-09-12T02:50:22.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:22 smithi062 ceph-mon[35527]: pgmap v52: 129 pgs: 129 active+clean; 54 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 242 op/s 2024-09-12T02:50:22.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:22 smithi018 ceph-mon[30616]: pgmap v52: 129 pgs: 129 active+clean; 54 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 242 op/s 2024-09-12T02:50:24.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:24 smithi176 ceph-mon[35713]: pgmap v53: 129 pgs: 129 active+clean; 54 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 235 op/s 2024-09-12T02:50:24.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:24 smithi062 ceph-mon[35527]: pgmap v53: 129 pgs: 129 active+clean; 54 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 235 op/s 2024-09-12T02:50:24.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:24 smithi018 ceph-mon[30616]: pgmap v53: 129 pgs: 129 active+clean; 54 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 235 op/s 2024-09-12T02:50:24.833 INFO:tasks.workunit.client.0.smithi018.stdout: 23 121586 400 73669 235 42641 503 2024-09-12T02:50:25.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:25 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:50:25.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:25 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:50:25.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:25 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:50:26.507 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:26 smithi018 ceph-mon[30616]: pgmap v54: 129 pgs: 129 active+clean; 58 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 272 op/s 2024-09-12T02:50:26.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:26 smithi062 ceph-mon[35527]: pgmap v54: 129 pgs: 129 active+clean; 58 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 272 op/s 2024-09-12T02:50:26.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:26 smithi176 ceph-mon[35713]: pgmap v54: 129 pgs: 129 active+clean; 58 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 272 op/s 2024-09-12T02:50:28.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:28 smithi062 ceph-mon[35527]: pgmap v55: 129 pgs: 129 active+clean; 58 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 2.6 MiB/s wr, 184 op/s 2024-09-12T02:50:28.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:28 smithi018 ceph-mon[30616]: pgmap v55: 129 pgs: 129 active+clean; 58 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 2.6 MiB/s wr, 184 op/s 2024-09-12T02:50:28.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:28 smithi176 ceph-mon[35713]: pgmap v55: 129 pgs: 129 active+clean; 58 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 2.6 MiB/s wr, 184 op/s 2024-09-12T02:50:30.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:30 smithi062 ceph-mon[35527]: pgmap v56: 129 pgs: 129 active+clean; 66 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 208 op/s 2024-09-12T02:50:30.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:30 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:50:30.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:30 smithi018 ceph-mon[30616]: pgmap v56: 129 pgs: 129 active+clean; 66 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 208 op/s 2024-09-12T02:50:30.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:30 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:50:30.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:30 smithi176 ceph-mon[35713]: pgmap v56: 129 pgs: 129 active+clean; 66 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 208 op/s 2024-09-12T02:50:30.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:30 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:50:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.530+0000 7f3ba7e00640 1 -- 172.21.15.18:0/4139048860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ba01091f0 msgr2=0x7f3ba01095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.530+0000 7f3ba7e00640 1 --2- 172.21.15.18:0/4139048860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ba01091f0 0x7f3ba01095d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009930 tx=0x7f3b9402a480 comp rx=0 tx=0).stop 2024-09-12T02:50:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.533+0000 7f3ba7e00640 1 -- 172.21.15.18:0/4139048860 shutdown_connections 2024-09-12T02:50:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.533+0000 7f3ba7e00640 1 --2- 172.21.15.18:0/4139048860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ba0114ab0 0x7f3ba0116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.533+0000 7f3ba7e00640 1 --2- 172.21.15.18:0/4139048860 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba0109b10 0x7f3ba0114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.533+0000 7f3ba7e00640 1 --2- 172.21.15.18:0/4139048860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ba01091f0 0x7f3ba01095d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.533+0000 7f3ba7e00640 1 -- 172.21.15.18:0/4139048860 >> 172.21.15.18:0/4139048860 conn(0x7f3ba006cc60 msgr2=0x7f3ba006d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.533+0000 7f3ba7e00640 1 -- 172.21.15.18:0/4139048860 shutdown_connections 2024-09-12T02:50:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.533+0000 7f3ba7e00640 1 -- 172.21.15.18:0/4139048860 wait complete. 2024-09-12T02:50:32.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:32 smithi062 ceph-mon[35527]: pgmap v57: 129 pgs: 129 active+clean; 66 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 92 op/s 2024-09-12T02:50:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.534+0000 7f3ba7e00640 1 Processor -- start 2024-09-12T02:50:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.536+0000 7f3ba7e00640 1 -- start start 2024-09-12T02:50:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.536+0000 7f3ba7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba01091f0 0x7f3ba010c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.537+0000 7f3ba7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ba0109b10 0x7f3ba010cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.537+0000 7f3ba5400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba01091f0 0x7f3ba010c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.537+0000 7f3ba5400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba01091f0 0x7f3ba010c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:33026/0 (socket says 172.21.15.18:33026) 2024-09-12T02:50:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.537+0000 7f3ba4a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ba0109b10 0x7f3ba010cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.537+0000 7f3ba4a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ba0109b10 0x7f3ba010cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:39666/0 (socket says 172.21.15.18:39666) 2024-09-12T02:50:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.537+0000 7f3ba7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ba0114ab0 0x7f3ba010d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.537+0000 7f3ba7e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba011a520 con 0x7f3ba0114ab0 2024-09-12T02:50:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.537+0000 7f3ba7e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba011a3a0 con 0x7f3ba0109b10 2024-09-12T02:50:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.537+0000 7f3ba7e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba011a6a0 con 0x7f3ba01091f0 2024-09-12T02:50:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.538+0000 7f3ba5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ba0114ab0 0x7f3ba010d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.538+0000 7f3ba5400640 1 -- 172.21.15.18:0/230221294 learned_addr learned my addr 172.21.15.18:0/230221294 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.538+0000 7f3ba5e00640 1 --2- 172.21.15.18:0/230221294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ba0114ab0 0x7f3ba010d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40102/0 (socket says 172.21.15.18:40102) 2024-09-12T02:50:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.539+0000 7f3ba5400640 1 -- 172.21.15.18:0/230221294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ba0109b10 msgr2=0x7f3ba010cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.539+0000 7f3ba5400640 1 --2- 172.21.15.18:0/230221294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ba0109b10 0x7f3ba010cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.539+0000 7f3ba5400640 1 -- 172.21.15.18:0/230221294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ba0114ab0 msgr2=0x7f3ba010d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.539+0000 7f3ba5400640 1 --2- 172.21.15.18:0/230221294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ba0114ab0 0x7f3ba010d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.539+0000 7f3ba5400640 1 -- 172.21.15.18:0/230221294 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba01a4b30 con 0x7f3ba01091f0 2024-09-12T02:50:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.539+0000 7f3ba5e00640 1 --2- 172.21.15.18:0/230221294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ba0114ab0 0x7f3ba010d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:50:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.541+0000 7f3ba5400640 1 --2- 172.21.15.18:0/230221294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba01091f0 0x7f3ba010c5e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3b94006010 tx=0x7f3b94003bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.541+0000 7f3b9e000640 1 -- 172.21.15.18:0/230221294 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b94040030 con 0x7f3ba01091f0 2024-09-12T02:50:32.542 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.541+0000 7f3b9e000640 1 -- 172.21.15.18:0/230221294 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b94003fd0 con 0x7f3ba01091f0 2024-09-12T02:50:32.542 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.541+0000 7f3b9e000640 1 -- 172.21.15.18:0/230221294 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9403c900 con 0x7f3ba01091f0 2024-09-12T02:50:32.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.546+0000 7f3ba7e00640 1 -- 172.21.15.18:0/230221294 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba01a4dc0 con 0x7f3ba01091f0 2024-09-12T02:50:32.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.546+0000 7f3ba7e00640 1 -- 172.21.15.18:0/230221294 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba01a5230 con 0x7f3ba01091f0 2024-09-12T02:50:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.557+0000 7f3b9e000640 1 -- 172.21.15.18:0/230221294 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f3b94043030 con 0x7f3ba01091f0 2024-09-12T02:50:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.559+0000 7f3b9e000640 1 --2- 172.21.15.18:0/230221294 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3b880a2d70 0x7f3b880a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.560+0000 7f3baae05740 1 Processor -- start 2024-09-12T02:50:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.560+0000 7f3ba4a00640 1 --2- 172.21.15.18:0/230221294 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3b880a2d70 0x7f3b880a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.562+0000 7f3baae05740 1 -- start start 2024-09-12T02:50:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.562+0000 7f3baae05740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299670f3b0 0x56299670f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.562+0000 7f3baae05740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670fcd0 0x56299671a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.562+0000 7f3baae05740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299671a570 0x56299671c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.562+0000 7f3baae05740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562996675100 con 0x56299671a570 2024-09-12T02:50:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.562+0000 7f3baae05740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56299661d1b0 con 0x56299670f3b0 2024-09-12T02:50:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.562+0000 7f3baae05740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5629966710c0 con 0x56299670fcd0 2024-09-12T02:50:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.563+0000 7f3ba5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299671a570 0x56299671c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.563+0000 7f3ba5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299671a570 0x56299671c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40116/0 (socket says 172.21.15.18:40116) 2024-09-12T02:50:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.563+0000 7f3ba5e00640 1 -- 172.21.15.18:0/3840854586 learned_addr learned my addr 172.21.15.18:0/3840854586 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.564+0000 7f3ba5e00640 1 -- 172.21.15.18:0/3840854586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670fcd0 msgr2=0x56299671a030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:50:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.564+0000 7f3ba5e00640 1 --2- 172.21.15.18:0/3840854586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670fcd0 0x56299671a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.564+0000 7f3ba5e00640 1 -- 172.21.15.18:0/3840854586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299670f3b0 msgr2=0x56299670f790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:50:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.564+0000 7f3ba5e00640 1 --2- 172.21.15.18:0/3840854586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299670f3b0 0x56299670f790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.564+0000 7f3b9e000640 1 -- 172.21.15.18:0/230221294 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f3b940f0140 con 0x7f3ba01091f0 2024-09-12T02:50:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.564+0000 7f3ba5e00640 1 -- 172.21.15.18:0/3840854586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562996388210 con 0x56299671a570 2024-09-12T02:50:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.565+0000 7f3ba4a00640 1 --2- 172.21.15.18:0/230221294 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3b880a2d70 0x7f3b880a5230 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3ba010dda0 tx=0x7f3b8c005f90 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.565+0000 7f3ba5e00640 1 --2- 172.21.15.18:0/3840854586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299671a570 0x56299671c960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3b98010400 tx=0x7f3b980108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a309714075b17292 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.567+0000 7f3b92600640 1 -- 172.21.15.18:0/3840854586 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b98011760 con 0x56299671a570 2024-09-12T02:50:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.567+0000 7f3b92600640 1 -- 172.21.15.18:0/3840854586 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b98011de0 con 0x56299671a570 2024-09-12T02:50:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.567+0000 7f3b92600640 1 -- 172.21.15.18:0/3840854586 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9801a380 con 0x56299671a570 2024-09-12T02:50:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.568+0000 7f3baae05740 1 -- 172.21.15.18:0/3840854586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299671a570 msgr2=0x56299671c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.568+0000 7f3baae05740 1 --2- 172.21.15.18:0/3840854586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299671a570 0x56299671c960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3b98010400 tx=0x7f3b980108c0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.568+0000 7f3baae05740 1 -- 172.21.15.18:0/3840854586 shutdown_connections 2024-09-12T02:50:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.568+0000 7f3baae05740 1 --2- 172.21.15.18:0/3840854586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299671a570 0x56299671c960 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.568+0000 7f3baae05740 1 --2- 172.21.15.18:0/3840854586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670fcd0 0x56299671a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.568+0000 7f3baae05740 1 --2- 172.21.15.18:0/3840854586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299670f3b0 0x56299670f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.568+0000 7f3baae05740 1 -- 172.21.15.18:0/3840854586 >> 172.21.15.18:0/3840854586 conn(0x56299670b920 msgr2=0x56299670bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:32.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.570+0000 7f3baae05740 1 -- 172.21.15.18:0/3840854586 shutdown_connections 2024-09-12T02:50:32.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.570+0000 7f3baae05740 1 -- 172.21.15.18:0/3840854586 wait complete. 2024-09-12T02:50:32.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.570+0000 7f3baae05740 1 -- start start 2024-09-12T02:50:32.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.571+0000 7f3baae05740 1 Processor -- start 2024-09-12T02:50:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.572+0000 7f3baae05740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670f3b0 0x5629967176f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.572+0000 7f3baae05740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299670fcd0 0x562996717c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.572+0000 7f3baae05740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299671a570 0x562996718170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.572+0000 7f3baae05740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56299671cff0 con 0x56299671a570 2024-09-12T02:50:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.572+0000 7f3baae05740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5629965fe090 con 0x56299670fcd0 2024-09-12T02:50:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.572+0000 7f3baae05740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56299671d170 con 0x56299670f3b0 2024-09-12T02:50:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.573+0000 7f3baae05740 10 client.0 _ll_register_callbacks cb 0x562996652f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.573+0000 7f3ba5400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670f3b0 0x5629967176f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.573+0000 7f3ba5400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670f3b0 0x5629967176f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:33028/0 (socket says 172.21.15.18:33028) 2024-09-12T02:50:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.573+0000 7f3ba5400640 1 -- 172.21.15.18:0/3060527188 learned_addr learned my addr 172.21.15.18:0/3060527188 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.574+0000 7f3ba4a00640 1 --2- 172.21.15.18:0/3060527188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299670fcd0 0x562996717c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.576+0000 7f3ba5e00640 1 --2- 172.21.15.18:0/3060527188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299671a570 0x562996718170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.576+0000 7f3ba5e00640 1 -- 172.21.15.18:0/3060527188 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670f3b0 msgr2=0x5629967176f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.576+0000 7f3ba5e00640 1 --2- 172.21.15.18:0/3060527188 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670f3b0 0x5629967176f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.576+0000 7f3ba5e00640 1 -- 172.21.15.18:0/3060527188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299670fcd0 msgr2=0x562996717c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.576+0000 7f3ba5e00640 1 --2- 172.21.15.18:0/3060527188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299670fcd0 0x562996717c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.576+0000 7f3ba5e00640 1 -- 172.21.15.18:0/3060527188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562996454620 con 0x56299671a570 2024-09-12T02:50:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.577+0000 7f3ba5e00640 1 --2- 172.21.15.18:0/3060527188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299671a570 0x562996718170 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3b98010dc0 tx=0x7f3b9801cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33229e65ff10b33c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.579+0000 7f3b86a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:50:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.579+0000 7f3b86a00640 1 -- 172.21.15.18:0/3060527188 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9802a060 con 0x56299671a570 2024-09-12T02:50:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.579+0000 7f3b86a00640 1 -- 172.21.15.18:0/3060527188 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f3b98011560 con 0x56299671a570 2024-09-12T02:50:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.583+0000 7f3baae05740 1 -- 172.21.15.18:0/3060527188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b98011de0 con 0x56299671a570 2024-09-12T02:50:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.583+0000 7f3b86a00640 1 -- 172.21.15.18:0/3060527188 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3b98009bb0 con 0x56299671a570 2024-09-12T02:50:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.583+0000 7f3baae05740 10 client.15438 fetch_fsmap learned FSMap version 35 2024-09-12T02:50:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.583+0000 7f3baae05740 1 -- 172.21.15.18:0/3060527188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562996728fe0 con 0x56299671a570 2024-09-12T02:50:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.584+0000 7f3b86a00640 1 -- 172.21.15.18:0/3060527188 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b98011de0 con 0x56299671a570 2024-09-12T02:50:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.584+0000 7f3b86a00640 1 -- 172.21.15.18:0/3060527188 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 35) ==== 8390+0+0 (secure 0 0 0) 0x7f3b9802e3d0 con 0x56299671a570 2024-09-12T02:50:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.585+0000 7f3baae05740 10 client.15438 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T02:50:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.585+0000 7f3baae05740 10 client.15438 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:50:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.585+0000 7f3baae05740 20 client.15438 populate_metadata read hostname 'smithi018' 2024-09-12T02:50:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.585+0000 7f3baae05740 1 --2- 172.21.15.18:0/3060527188 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56299672a450 0x56299672c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.585+0000 7f3baae05740 4 client.15438 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:50:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.585+0000 7f3baae05740 1 -- 172.21.15.18:0/3060527188 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562996682830 con 0x56299672a450 2024-09-12T02:50:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.586+0000 7f3ba5400640 1 --2- 172.21.15.18:0/3060527188 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56299672a450 0x56299672c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.586+0000 7f3b86a00640 10 client.15438 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:50:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.586+0000 7f3ba5400640 1 --2- 172.21.15.18:0/3060527188 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56299672a450 0x56299672c840 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd1aa1a54a6d3981 server_cookie=85dac39f23593dce in_seq=0 out_seq=0 2024-09-12T02:50:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.591+0000 7f3b86a00640 1 -- 172.21.15.18:0/3060527188 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562996682830 con 0x56299672a450 2024-09-12T02:50:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.591+0000 7f3b86a00640 10 client.15438 handle_command_reply: tid=0 2024-09-12T02:50:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.591+0000 7f3baae05740 1 client.15438 shutdown 2024-09-12T02:50:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.593+0000 7f3baae05740 1 -- 172.21.15.18:0/3060527188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299671a570 msgr2=0x562996718170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.593+0000 7f3baae05740 1 --2- 172.21.15.18:0/3060527188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299671a570 0x562996718170 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3b98010dc0 tx=0x7f3b9801cbe0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.594+0000 7f3baae05740 1 -- 172.21.15.18:0/3060527188 shutdown_connections 2024-09-12T02:50:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.594+0000 7f3baae05740 1 --2- 172.21.15.18:0/3060527188 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56299672a450 0x56299672c840 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.594+0000 7f3baae05740 1 --2- 172.21.15.18:0/3060527188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299671a570 0x562996718170 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.594+0000 7f3baae05740 1 --2- 172.21.15.18:0/3060527188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299670fcd0 0x562996717c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.594+0000 7f3baae05740 1 --2- 172.21.15.18:0/3060527188 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670f3b0 0x5629967176f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.594+0000 7f3baae05740 1 -- 172.21.15.18:0/3060527188 >> 172.21.15.18:0/3060527188 conn(0x56299670b920 msgr2=0x562996711680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.594+0000 7f3b86a00640 0 client.15438 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:50:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.594+0000 7f3baae05740 1 -- 172.21.15.18:0/3060527188 shutdown_connections 2024-09-12T02:50:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.595+0000 7f3baae05740 1 -- 172.21.15.18:0/3060527188 wait complete. 2024-09-12T02:50:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.595+0000 7f3baae05740 20 client.15438 trim_cache size 0 max 16384 2024-09-12T02:50:32.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:32 smithi018 ceph-mon[30616]: pgmap v57: 129 pgs: 129 active+clean; 66 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 92 op/s 2024-09-12T02:50:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.641+0000 7f3baae05740 1 Processor -- start 2024-09-12T02:50:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.641+0000 7f3baae05740 1 -- start start 2024-09-12T02:50:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.641+0000 7f3baae05740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299670f3b0 0x562996712990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.641+0000 7f3baae05740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670fcd0 0x562996712ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.641+0000 7f3baae05740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299671a570 0x562996714930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.642+0000 7f3baae05740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba01c66f0 con 0x56299670f3b0 2024-09-12T02:50:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.642+0000 7f3baae05740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba01c8320 con 0x56299671a570 2024-09-12T02:50:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.642+0000 7f3baae05740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba01c6e50 con 0x56299670fcd0 2024-09-12T02:50:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.642+0000 7f3ba5e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299671a570 0x562996714930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.642+0000 7f3ba5e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299671a570 0x562996714930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:39678/0 (socket says 172.21.15.18:39678) 2024-09-12T02:50:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.642+0000 7f3ba5e00640 1 -- 172.21.15.18:0/3524706144 learned_addr learned my addr 172.21.15.18:0/3524706144 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.642+0000 7f3ba4a00640 1 --2- 172.21.15.18:0/3524706144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670fcd0 0x562996712ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.642+0000 7f3ba5400640 1 --2- 172.21.15.18:0/3524706144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299670f3b0 0x562996712990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.642+0000 7f3ba5e00640 1 -- 172.21.15.18:0/3524706144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670fcd0 msgr2=0x562996712ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.642+0000 7f3ba5e00640 1 --2- 172.21.15.18:0/3524706144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670fcd0 0x562996712ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.642+0000 7f3ba5e00640 1 -- 172.21.15.18:0/3524706144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299670f3b0 msgr2=0x562996712990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.642+0000 7f3ba5e00640 1 --2- 172.21.15.18:0/3524706144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299670f3b0 0x562996712990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.642+0000 7f3ba5e00640 1 -- 172.21.15.18:0/3524706144 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56299670f130 con 0x56299671a570 2024-09-12T02:50:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.642+0000 7f3ba5400640 1 --2- 172.21.15.18:0/3524706144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299670f3b0 0x562996712990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:50:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.643+0000 7f3ba5e00640 1 --2- 172.21.15.18:0/3524706144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299671a570 0x562996714930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3b98002230 tx=0x7f3b98010ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2c48b87a0395fd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.643+0000 7f3b91c00640 1 -- 172.21.15.18:0/3524706144 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9801c790 con 0x56299671a570 2024-09-12T02:50:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.643+0000 7f3b91c00640 1 -- 172.21.15.18:0/3524706144 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b9802eb40 con 0x56299671a570 2024-09-12T02:50:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.644+0000 7f3b91c00640 1 -- 172.21.15.18:0/3524706144 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b98011a40 con 0x56299671a570 2024-09-12T02:50:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.646+0000 7f3baae05740 1 -- 172.21.15.18:0/3524706144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299671a570 msgr2=0x562996714930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.646+0000 7f3baae05740 1 --2- 172.21.15.18:0/3524706144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299671a570 0x562996714930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3b98002230 tx=0x7f3b98010ef0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.647+0000 7f3baae05740 1 -- 172.21.15.18:0/3524706144 shutdown_connections 2024-09-12T02:50:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.647+0000 7f3baae05740 1 --2- 172.21.15.18:0/3524706144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299671a570 0x562996714930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.647+0000 7f3baae05740 1 --2- 172.21.15.18:0/3524706144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670fcd0 0x562996712ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.647+0000 7f3baae05740 1 --2- 172.21.15.18:0/3524706144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299670f3b0 0x562996712990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.647+0000 7f3baae05740 1 -- 172.21.15.18:0/3524706144 >> 172.21.15.18:0/3524706144 conn(0x56299670b920 msgr2=0x562996710550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.649+0000 7f3baae05740 1 -- 172.21.15.18:0/3524706144 shutdown_connections 2024-09-12T02:50:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.649+0000 7f3baae05740 1 -- 172.21.15.18:0/3524706144 wait complete. 2024-09-12T02:50:32.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.649+0000 7f3baae05740 1 -- start start 2024-09-12T02:50:32.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.650+0000 7f3baae05740 1 Processor -- start 2024-09-12T02:50:32.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.651+0000 7f3baae05740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670f3b0 0x56299672fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.651+0000 7f3baae05740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299670fcd0 0x56299672beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.652+0000 7f3ba4a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299670fcd0 0x56299672beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.652+0000 7f3ba4a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299670fcd0 0x56299672beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40144/0 (socket says 172.21.15.18:40144) 2024-09-12T02:50:32.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.652+0000 7f3ba5400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670f3b0 0x56299672fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.653+0000 7f3ba5400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670f3b0 0x56299672fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:33036/0 (socket says 172.21.15.18:33036) 2024-09-12T02:50:32.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.653+0000 7f3ba4a00640 1 -- 172.21.15.18:0/1149098337 learned_addr learned my addr 172.21.15.18:0/1149098337 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:32.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.653+0000 7f3baae05740 1 --2- 172.21.15.18:0/1149098337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299671a570 0x56299672c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.653+0000 7f3ba5e00640 1 --2- 172.21.15.18:0/1149098337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299671a570 0x56299672c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.654+0000 7f3baae05740 1 -- 172.21.15.18:0/1149098337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba01c7bf0 con 0x56299670fcd0 2024-09-12T02:50:32.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.654+0000 7f3baae05740 1 -- 172.21.15.18:0/1149098337 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba01c7520 con 0x56299671a570 2024-09-12T02:50:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.654+0000 7f3baae05740 1 -- 172.21.15.18:0/1149098337 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba01c4700 con 0x56299670f3b0 2024-09-12T02:50:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.654+0000 7f3baae05740 10 client.0 _ll_register_callbacks cb 0x7f3b98009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.655+0000 7f3ba4a00640 1 -- 172.21.15.18:0/1149098337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670f3b0 msgr2=0x56299672fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.655+0000 7f3ba4a00640 1 --2- 172.21.15.18:0/1149098337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670f3b0 0x56299672fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.655+0000 7f3ba4a00640 1 -- 172.21.15.18:0/1149098337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299671a570 msgr2=0x56299672c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.655+0000 7f3ba4a00640 1 --2- 172.21.15.18:0/1149098337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299671a570 0x56299672c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.655+0000 7f3ba4a00640 1 -- 172.21.15.18:0/1149098337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56299672cbd0 con 0x56299670fcd0 2024-09-12T02:50:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.655+0000 7f3ba5e00640 1 --2- 172.21.15.18:0/1149098337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299671a570 0x56299672c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:50:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.656+0000 7f3ba4a00640 1 --2- 172.21.15.18:0/1149098337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299670fcd0 0x56299672beb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x56299670c780 tx=0x7f3b8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d1abc5cd8263bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.656+0000 7f3b86a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:50:32.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.657+0000 7f3b86a00640 1 -- 172.21.15.18:0/1149098337 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c02c060 con 0x56299670fcd0 2024-09-12T02:50:32.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.657+0000 7f3b86a00640 1 -- 172.21.15.18:0/1149098337 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f3b8c01c540 con 0x56299670fcd0 2024-09-12T02:50:32.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.659+0000 7f3baae05740 1 -- 172.21.15.18:0/1149098337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b9802eb40 con 0x56299670fcd0 2024-09-12T02:50:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.663+0000 7f3b86a00640 1 -- 172.21.15.18:0/1149098337 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3b8c01c740 con 0x56299670fcd0 2024-09-12T02:50:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.663+0000 7f3baae05740 10 client.15441 fetch_fsmap learned FSMap version 35 2024-09-12T02:50:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.663+0000 7f3baae05740 1 -- 172.21.15.18:0/1149098337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562996793d40 con 0x56299670fcd0 2024-09-12T02:50:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.664+0000 7f3b86a00640 1 -- 172.21.15.18:0/1149098337 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b9802eb40 con 0x56299670fcd0 2024-09-12T02:50:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.665+0000 7f3b86a00640 1 -- 172.21.15.18:0/1149098337 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 35) ==== 8390+0+0 (secure 0 0 0) 0x7f3b8c027a10 con 0x56299670fcd0 2024-09-12T02:50:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.665+0000 7f3baae05740 10 client.15441 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T02:50:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.665+0000 7f3baae05740 10 client.15441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:50:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.665+0000 7f3baae05740 20 client.15441 populate_metadata read hostname 'smithi018' 2024-09-12T02:50:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.665+0000 7f3baae05740 1 --2- 172.21.15.18:0/1149098337 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5629967944a0 0x5629967968c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.666+0000 7f3baae05740 4 client.15441 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:50:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.666+0000 7f3ba5400640 1 --2- 172.21.15.18:0/1149098337 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5629967944a0 0x5629967968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.666+0000 7f3baae05740 1 -- 172.21.15.18:0/1149098337 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56299667cb80 con 0x5629967944a0 2024-09-12T02:50:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.667+0000 7f3ba5400640 1 --2- 172.21.15.18:0/1149098337 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5629967944a0 0x5629967968c0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7d9973add4c665d server_cookie=602ea8faadf6b2d0 in_seq=0 out_seq=0 2024-09-12T02:50:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:32.667+0000 7f3b86a00640 10 client.15441 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:50:32.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:32 smithi176 ceph-mon[35713]: pgmap v57: 129 pgs: 129 active+clean; 66 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 92 op/s 2024-09-12T02:50:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.378+0000 7f3b86a00640 1 -- 172.21.15.18:0/1149098337 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56299667cb80 con 0x5629967944a0 2024-09-12T02:50:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.378+0000 7f3b86a00640 10 client.15441 handle_command_reply: tid=0 2024-09-12T02:50:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.378+0000 7f3baae05740 1 client.15441 shutdown 2024-09-12T02:50:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.378+0000 7f3baae05740 1 -- 172.21.15.18:0/1149098337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299670fcd0 msgr2=0x56299672beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.378+0000 7f3baae05740 1 --2- 172.21.15.18:0/1149098337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299670fcd0 0x56299672beb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x56299670c780 tx=0x7f3b8c004730 comp rx=0 tx=0).stop 2024-09-12T02:50:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.379+0000 7f3baae05740 1 -- 172.21.15.18:0/1149098337 shutdown_connections 2024-09-12T02:50:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.379+0000 7f3baae05740 1 --2- 172.21.15.18:0/1149098337 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5629967944a0 0x5629967968c0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.379+0000 7f3baae05740 1 --2- 172.21.15.18:0/1149098337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56299671a570 0x56299672c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.379+0000 7f3baae05740 1 --2- 172.21.15.18:0/1149098337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56299670fcd0 0x56299672beb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.379+0000 7f3baae05740 1 --2- 172.21.15.18:0/1149098337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56299670f3b0 0x56299672fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.379+0000 7f3baae05740 1 -- 172.21.15.18:0/1149098337 >> 172.21.15.18:0/1149098337 conn(0x56299670b920 msgr2=0x562996715b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.379+0000 7f3b86a00640 0 client.15441 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:50:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.379+0000 7f3baae05740 1 -- 172.21.15.18:0/1149098337 shutdown_connections 2024-09-12T02:50:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.379+0000 7f3baae05740 1 -- 172.21.15.18:0/1149098337 wait complete. 2024-09-12T02:50:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.379+0000 7f3baae05740 20 client.15441 trim_cache size 0 max 16384 2024-09-12T02:50:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:50:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:50:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:50:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:50:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.380+0000 7f3ba7e00640 1 -- 172.21.15.18:0/230221294 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3b880a2d70 msgr2=0x7f3b880a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.380+0000 7f3ba7e00640 1 --2- 172.21.15.18:0/230221294 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3b880a2d70 0x7f3b880a5230 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3ba010dda0 tx=0x7f3b8c005f90 comp rx=0 tx=0).stop 2024-09-12T02:50:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.380+0000 7f3ba7e00640 1 -- 172.21.15.18:0/230221294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba01091f0 msgr2=0x7f3ba010c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.380+0000 7f3ba7e00640 1 --2- 172.21.15.18:0/230221294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba01091f0 0x7f3ba010c5e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3b94006010 tx=0x7f3b94003bd0 comp rx=0 tx=0).stop 2024-09-12T02:50:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.380+0000 7f3ba7e00640 1 -- 172.21.15.18:0/230221294 shutdown_connections 2024-09-12T02:50:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.380+0000 7f3ba7e00640 1 --2- 172.21.15.18:0/230221294 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f3b880a2d70 0x7f3b880a5230 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.380+0000 7f3ba7e00640 1 --2- 172.21.15.18:0/230221294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ba0114ab0 0x7f3ba010d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.380+0000 7f3ba7e00640 1 --2- 172.21.15.18:0/230221294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ba0109b10 0x7f3ba010cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.380+0000 7f3ba7e00640 1 --2- 172.21.15.18:0/230221294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba01091f0 0x7f3ba010c5e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.380+0000 7f3ba7e00640 1 -- 172.21.15.18:0/230221294 >> 172.21.15.18:0/230221294 conn(0x7f3ba006cc60 msgr2=0x7f3ba010a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.380+0000 7f3ba7e00640 1 -- 172.21.15.18:0/230221294 shutdown_connections 2024-09-12T02:50:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:33.380+0000 7f3ba7e00640 1 -- 172.21.15.18:0/230221294 wait complete. 2024-09-12T02:50:34.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:34 smithi062 ceph-mon[35527]: pgmap v58: 129 pgs: 129 active+clean; 66 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 60 op/s 2024-09-12T02:50:34.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:34 smithi018 ceph-mon[30616]: pgmap v58: 129 pgs: 129 active+clean; 66 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 60 op/s 2024-09-12T02:50:34.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:34 smithi176 ceph-mon[35713]: pgmap v58: 129 pgs: 129 active+clean; 66 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 60 op/s 2024-09-12T02:50:34.833 INFO:tasks.workunit.client.0.smithi018.stdout: 37 316761 847 199952 743 122805 953 2024-09-12T02:50:36.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:36 smithi062 ceph-mon[35527]: pgmap v59: 129 pgs: 129 active+clean; 74 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 202 op/s 2024-09-12T02:50:36.549 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:36 smithi018 ceph-mon[30616]: pgmap v59: 129 pgs: 129 active+clean; 74 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 202 op/s 2024-09-12T02:50:36.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:36 smithi176 ceph-mon[35713]: pgmap v59: 129 pgs: 129 active+clean; 74 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 202 op/s 2024-09-12T02:50:38.456 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:38 smithi018 ceph-mon[30616]: pgmap v60: 129 pgs: 129 active+clean; 74 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 165 op/s 2024-09-12T02:50:38.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:38 smithi062 ceph-mon[35527]: pgmap v60: 129 pgs: 129 active+clean; 74 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 165 op/s 2024-09-12T02:50:38.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:38 smithi176 ceph-mon[35713]: pgmap v60: 129 pgs: 129 active+clean; 74 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 165 op/s 2024-09-12T02:50:40.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:40 smithi062 ceph-mon[35527]: pgmap v61: 129 pgs: 129 active+clean; 108 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.8 MiB/s wr, 393 op/s 2024-09-12T02:50:40.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:40 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:50:40.613 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:40 smithi018 ceph-mon[30616]: pgmap v61: 129 pgs: 129 active+clean; 108 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.8 MiB/s wr, 393 op/s 2024-09-12T02:50:40.613 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:40 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:50:40.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:40 smithi176 ceph-mon[35713]: pgmap v61: 129 pgs: 129 active+clean; 108 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.8 MiB/s wr, 393 op/s 2024-09-12T02:50:40.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:40 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:50:42.402 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:42 smithi018 ceph-mon[30616]: pgmap v62: 129 pgs: 129 active+clean; 108 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.0 MiB/s wr, 369 op/s 2024-09-12T02:50:42.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:42 smithi176 ceph-mon[35713]: pgmap v62: 129 pgs: 129 active+clean; 108 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.0 MiB/s wr, 369 op/s 2024-09-12T02:50:42.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:42 smithi062 ceph-mon[35527]: pgmap v62: 129 pgs: 129 active+clean; 108 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.0 MiB/s wr, 369 op/s 2024-09-12T02:50:44.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:44 smithi018 ceph-mon[30616]: pgmap v63: 129 pgs: 129 active+clean; 108 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.0 MiB/s wr, 369 op/s 2024-09-12T02:50:44.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:44 smithi062 ceph-mon[35527]: pgmap v63: 129 pgs: 129 active+clean; 108 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.0 MiB/s wr, 369 op/s 2024-09-12T02:50:44.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:44 smithi176 ceph-mon[35713]: pgmap v63: 129 pgs: 129 active+clean; 108 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.0 MiB/s wr, 369 op/s 2024-09-12T02:50:44.866 INFO:tasks.workunit.client.0.smithi018.stdout: 47 239187 434 146776 370 77441 256 2024-09-12T02:50:46.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:46 smithi018 ceph-mon[30616]: pgmap v64: 129 pgs: 129 active+clean; 175 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.8 MiB/s wr, 693 op/s 2024-09-12T02:50:46.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.533+0000 7fdb05c00640 1 -- 172.21.15.18:0/2174811343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb00109080 msgr2=0x7fdb00110bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:46.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.533+0000 7fdb05c00640 1 --2- 172.21.15.18:0/2174811343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb00109080 0x7fdb00110bd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8009ca0 tx=0x7fdaf802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.534+0000 7fdb05c00640 1 -- 172.21.15.18:0/2174811343 shutdown_connections 2024-09-12T02:50:46.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.534+0000 7fdb05c00640 1 --2- 172.21.15.18:0/2174811343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb00109080 0x7fdb00110bd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.534+0000 7fdb05c00640 1 --2- 172.21.15.18:0/2174811343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb001048e0 0x7fdb00108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.534+0000 7fdb05c00640 1 --2- 172.21.15.18:0/2174811343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb00103f30 0x7fdb00104310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.534+0000 7fdb05c00640 1 -- 172.21.15.18:0/2174811343 >> 172.21.15.18:0/2174811343 conn(0x7fdb000ff980 msgr2=0x7fdb00101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:46.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.534+0000 7fdb05c00640 1 -- 172.21.15.18:0/2174811343 shutdown_connections 2024-09-12T02:50:46.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.534+0000 7fdb05c00640 1 -- 172.21.15.18:0/2174811343 wait complete. 2024-09-12T02:50:46.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.535+0000 7fdb05c00640 1 Processor -- start 2024-09-12T02:50:46.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.536+0000 7fdb05c00640 1 -- start start 2024-09-12T02:50:46.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.536+0000 7fdb05c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb00103f30 0x7fdb001109f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.536+0000 7fdb05c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb00109080 0x7fdb0010da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.536+0000 7fdb05c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb0010dfd0 0x7fdb0010e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.536+0000 7fdb05c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdb001140a0 con 0x7fdb00103f30 2024-09-12T02:50:46.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.536+0000 7fdb05c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdb00113f20 con 0x7fdb0010dfd0 2024-09-12T02:50:46.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.536+0000 7fdb05c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdb00114220 con 0x7fdb00109080 2024-09-12T02:50:46.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.536+0000 7fdaff400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb0010dfd0 0x7fdb0010e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.536+0000 7fdafea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb00103f30 0x7fdb001109f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.536+0000 7fdaff400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb0010dfd0 0x7fdb0010e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:49986/0 (socket says 172.21.15.18:49986) 2024-09-12T02:50:46.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.536+0000 7fdaff400640 1 -- 172.21.15.18:0/1664487130 learned_addr learned my addr 172.21.15.18:0/1664487130 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:46.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.537+0000 7fdaf6000640 1 --2- 172.21.15.18:0/1664487130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb00109080 0x7fdb0010da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.537+0000 7fdaff400640 1 -- 172.21.15.18:0/1664487130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb00109080 msgr2=0x7fdb0010da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:46.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.537+0000 7fdaff400640 1 --2- 172.21.15.18:0/1664487130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb00109080 0x7fdb0010da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.537+0000 7fdaff400640 1 -- 172.21.15.18:0/1664487130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb00103f30 msgr2=0x7fdb001109f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:46.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.537+0000 7fdaff400640 1 --2- 172.21.15.18:0/1664487130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb00103f30 0x7fdb001109f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.537+0000 7fdaff400640 1 -- 172.21.15.18:0/1664487130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb00072e20 con 0x7fdb0010dfd0 2024-09-12T02:50:46.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.539+0000 7fdaff400640 1 --2- 172.21.15.18:0/1664487130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb0010dfd0 0x7fdb0010e480 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8003f10 tx=0x7fdaf8003f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:46.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.539+0000 7fdaf7e00640 1 -- 172.21.15.18:0/1664487130 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8031650 con 0x7fdb0010dfd0 2024-09-12T02:50:46.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.539+0000 7fdaf7e00640 1 -- 172.21.15.18:0/1664487130 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdaf80317f0 con 0x7fdb0010dfd0 2024-09-12T02:50:46.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.539+0000 7fdaf7e00640 1 -- 172.21.15.18:0/1664487130 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf802fad0 con 0x7fdb0010dfd0 2024-09-12T02:50:46.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.539+0000 7fdb05c00640 1 -- 172.21.15.18:0/1664487130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb000730b0 con 0x7fdb0010dfd0 2024-09-12T02:50:46.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.539+0000 7fdb05c00640 1 -- 172.21.15.18:0/1664487130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb000735b0 con 0x7fdb0010dfd0 2024-09-12T02:50:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.543+0000 7fdaf7e00640 1 -- 172.21.15.18:0/1664487130 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fdaf802fcb0 con 0x7fdb0010dfd0 2024-09-12T02:50:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.543+0000 7fdb08a8d740 1 Processor -- start 2024-09-12T02:50:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.543+0000 7fdb08a8d740 1 -- start start 2024-09-12T02:50:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.544+0000 7fdb08a8d740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab211e0 0x5618cab215c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.544+0000 7fdb08a8d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab21b00 0x5618cab2be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.544+0000 7fdb08a8d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab2c3a0 0x5618cab2e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.544+0000 7fdb08a8d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5618caa87100 con 0x5618cab21b00 2024-09-12T02:50:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.544+0000 7fdb08a8d740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5618caa2f1b0 con 0x5618cab211e0 2024-09-12T02:50:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.544+0000 7fdb08a8d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5618caa830c0 con 0x5618cab2c3a0 2024-09-12T02:50:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.545+0000 7fdafea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab21b00 0x5618cab2be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.545+0000 7fdaf6000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab2c3a0 0x5618cab2e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.545+0000 7fdaf6000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab211e0 0x5618cab215c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.545+0000 7fdaf6000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab211e0 0x5618cab215c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:49996/0 (socket says 172.21.15.18:49996) 2024-09-12T02:50:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.545+0000 7fdaf6000640 1 -- 172.21.15.18:0/2842331256 learned_addr learned my addr 172.21.15.18:0/2842331256 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.545+0000 7fdafea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab21b00 0x5618cab2be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48394/0 (socket says 172.21.15.18:48394) 2024-09-12T02:50:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.545+0000 7fdaf6000640 1 -- 172.21.15.18:0/2842331256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab2c3a0 msgr2=0x5618cab2e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.545+0000 7fdaf6000640 1 --2- 172.21.15.18:0/2842331256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab2c3a0 0x5618cab2e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.545+0000 7fdaf6000640 1 -- 172.21.15.18:0/2842331256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab21b00 msgr2=0x5618cab2be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.545+0000 7fdaf6000640 1 --2- 172.21.15.18:0/2842331256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab21b00 0x5618cab2be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.545+0000 7fdaf7e00640 1 --2- 172.21.15.18:0/1664487130 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fdae40a2e70 0x7fdae40a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.545+0000 7fdaf6000640 1 -- 172.21.15.18:0/2842331256 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618ca79a210 con 0x5618cab211e0 2024-09-12T02:50:46.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.546+0000 7fdaf7e00640 1 -- 172.21.15.18:0/1664487130 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fdaf80f0bf0 con 0x7fdb0010dfd0 2024-09-12T02:50:46.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.546+0000 7fdaf6000640 1 --2- 172.21.15.18:0/2842331256 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab211e0 0x5618cab215c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdae8010920 tx=0x7fdae8005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39877c6ef5d78365 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:46.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.546+0000 7fdaefe00640 1 -- 172.21.15.18:0/2842331256 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8016030 con 0x5618cab211e0 2024-09-12T02:50:46.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.546+0000 7fdaefe00640 1 -- 172.21.15.18:0/2842331256 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdae800e3b0 con 0x5618cab211e0 2024-09-12T02:50:46.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.546+0000 7fdaefe00640 1 -- 172.21.15.18:0/2842331256 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8019040 con 0x5618cab211e0 2024-09-12T02:50:46.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.547+0000 7fdaf6000640 1 --2- 172.21.15.18:0/1664487130 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fdae40a2e70 0x7fdae40a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.547+0000 7fdb08a8d740 1 -- 172.21.15.18:0/2842331256 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab211e0 msgr2=0x5618cab215c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:46.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.547+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/2842331256 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab211e0 0x5618cab215c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdae8010920 tx=0x7fdae8005f90 comp rx=0 tx=0).stop 2024-09-12T02:50:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.547+0000 7fdb08a8d740 1 -- 172.21.15.18:0/2842331256 shutdown_connections 2024-09-12T02:50:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.547+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/2842331256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab2c3a0 0x5618cab2e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.547+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/2842331256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab21b00 0x5618cab2be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.547+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/2842331256 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab211e0 0x5618cab215c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.548+0000 7fdb08a8d740 1 -- 172.21.15.18:0/2842331256 >> 172.21.15.18:0/2842331256 conn(0x5618cab1d750 msgr2=0x5618cab1db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.548+0000 7fdaf6000640 1 --2- 172.21.15.18:0/1664487130 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fdae40a2e70 0x7fdae40a5330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdae80092e0 tx=0x7fdae8010520 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.548+0000 7fdb08a8d740 1 -- 172.21.15.18:0/2842331256 shutdown_connections 2024-09-12T02:50:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.549+0000 7fdb08a8d740 1 -- 172.21.15.18:0/2842331256 wait complete. 2024-09-12T02:50:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.549+0000 7fdb08a8d740 1 -- start start 2024-09-12T02:50:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.549+0000 7fdb08a8d740 1 Processor -- start 2024-09-12T02:50:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.550+0000 7fdb08a8d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab211e0 0x5618cab29250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.550+0000 7fdb08a8d740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab21b00 0x5618cab29790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.550+0000 7fdb08a8d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab2c3a0 0x5618cab29cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.550+0000 7fdb08a8d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5618cab2ef70 con 0x5618cab211e0 2024-09-12T02:50:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.550+0000 7fdb08a8d740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5618caa10090 con 0x5618cab21b00 2024-09-12T02:50:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.550+0000 7fdb08a8d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5618cab2f0f0 con 0x5618cab2c3a0 2024-09-12T02:50:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.550+0000 7fdb08a8d740 10 client.0 _ll_register_callbacks cb 0x5618caa64f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.551+0000 7fdaf6000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab21b00 0x5618cab29790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.551+0000 7fdaf6000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab21b00 0x5618cab29790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:49998/0 (socket says 172.21.15.18:49998) 2024-09-12T02:50:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.551+0000 7fdaf6000640 1 -- 172.21.15.18:0/4216976766 learned_addr learned my addr 172.21.15.18:0/4216976766 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.551+0000 7fdafea00640 1 --2- 172.21.15.18:0/4216976766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab211e0 0x5618cab29250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.551+0000 7fdaff400640 1 --2- 172.21.15.18:0/4216976766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab2c3a0 0x5618cab29cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.551+0000 7fdaf6000640 1 -- 172.21.15.18:0/4216976766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab2c3a0 msgr2=0x5618cab29cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.551+0000 7fdaf6000640 1 --2- 172.21.15.18:0/4216976766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab2c3a0 0x5618cab29cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.551+0000 7fdaf6000640 1 -- 172.21.15.18:0/4216976766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab211e0 msgr2=0x5618cab29250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.551+0000 7fdaf6000640 1 --2- 172.21.15.18:0/4216976766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab211e0 0x5618cab29250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.551+0000 7fdaf6000640 1 -- 172.21.15.18:0/4216976766 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618ca866620 con 0x5618cab21b00 2024-09-12T02:50:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.552+0000 7fdaf6000640 1 --2- 172.21.15.18:0/4216976766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab21b00 0x5618cab29790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdae800ef50 tx=0x7fdae801f6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9094f666052b20d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.552+0000 7fdaecc00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:50:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.552+0000 7fdaecc00640 1 -- 172.21.15.18:0/4216976766 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8016030 con 0x5618cab21b00 2024-09-12T02:50:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.552+0000 7fdb08a8d740 1 -- 172.21.15.18:0/4216976766 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdae800e3b0 con 0x5618cab21b00 2024-09-12T02:50:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.552+0000 7fdaecc00640 1 -- 172.21.15.18:0/4216976766 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fdae800e560 con 0x5618cab21b00 2024-09-12T02:50:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.552+0000 7fdaecc00640 1 -- 172.21.15.18:0/4216976766 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fdae8040050 con 0x5618cab21b00 2024-09-12T02:50:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.552+0000 7fdb08a8d740 10 client.25451 fetch_fsmap learned FSMap version 36 2024-09-12T02:50:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.553+0000 7fdb08a8d740 1 -- 172.21.15.18:0/4216976766 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5618cab3aad0 con 0x5618cab21b00 2024-09-12T02:50:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.553+0000 7fdaecc00640 1 -- 172.21.15.18:0/4216976766 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdae800e3b0 con 0x5618cab21b00 2024-09-12T02:50:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.553+0000 7fdaecc00640 1 -- 172.21.15.18:0/4216976766 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 36) ==== 8394+0+0 (secure 0 0 0) 0x7fdae800f850 con 0x5618cab21b00 2024-09-12T02:50:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.554+0000 7fdb08a8d740 10 client.25451 fetch_fsmap finished waiting for FSMap version 36 2024-09-12T02:50:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.554+0000 7fdb08a8d740 10 client.25451 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:50:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.554+0000 7fdb08a8d740 20 client.25451 populate_metadata read hostname 'smithi018' 2024-09-12T02:50:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.554+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/4216976766 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5618cab3be20 0x5618cab3e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.554+0000 7fdb08a8d740 4 client.25451 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:50:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.554+0000 7fdb08a8d740 1 -- 172.21.15.18:0/4216976766 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618caa94830 con 0x5618cab3be20 2024-09-12T02:50:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.554+0000 7fdafea00640 1 --2- 172.21.15.18:0/4216976766 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5618cab3be20 0x5618cab3e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.555+0000 7fdafea00640 1 --2- 172.21.15.18:0/4216976766 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5618cab3be20 0x5618cab3e210 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba997751f86e404c server_cookie=f229d0fa660a6272 in_seq=0 out_seq=0 2024-09-12T02:50:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.555+0000 7fdaecc00640 10 client.25451 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:50:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.556+0000 7fdaecc00640 1 -- 172.21.15.18:0/4216976766 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5618caa94830 con 0x5618cab3be20 2024-09-12T02:50:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.556+0000 7fdaecc00640 10 client.25451 handle_command_reply: tid=0 2024-09-12T02:50:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.556+0000 7fdb08a8d740 1 client.25451 shutdown 2024-09-12T02:50:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.556+0000 7fdb08a8d740 1 -- 172.21.15.18:0/4216976766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab21b00 msgr2=0x5618cab29790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.556+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/4216976766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab21b00 0x5618cab29790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdae800ef50 tx=0x7fdae801f6e0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.557+0000 7fdb08a8d740 1 -- 172.21.15.18:0/4216976766 shutdown_connections 2024-09-12T02:50:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.557+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/4216976766 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5618cab3be20 0x5618cab3e210 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.557+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/4216976766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab2c3a0 0x5618cab29cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.557+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/4216976766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab21b00 0x5618cab29790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.557+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/4216976766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab211e0 0x5618cab29250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.557+0000 7fdb08a8d740 1 -- 172.21.15.18:0/4216976766 >> 172.21.15.18:0/4216976766 conn(0x5618cab1d750 msgr2=0x5618cab234b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.557+0000 7fdaecc00640 0 client.25451 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:50:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.557+0000 7fdb08a8d740 1 -- 172.21.15.18:0/4216976766 shutdown_connections 2024-09-12T02:50:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.557+0000 7fdb08a8d740 1 -- 172.21.15.18:0/4216976766 wait complete. 2024-09-12T02:50:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.557+0000 7fdb08a8d740 20 client.25451 trim_cache size 0 max 16384 2024-09-12T02:50:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.575+0000 7fdb08a8d740 1 Processor -- start 2024-09-12T02:50:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.575+0000 7fdb08a8d740 1 -- start start 2024-09-12T02:50:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.575+0000 7fdb08a8d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab211e0 0x5618cab438a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.575+0000 7fdb08a8d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab21b00 0x5618cab43de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.575+0000 7fdb08a8d740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab2c3a0 0x5618cab22c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.575+0000 7fdb08a8d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdb001c6560 con 0x5618cab211e0 2024-09-12T02:50:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.575+0000 7fdb08a8d740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdb001c81c0 con 0x5618cab2c3a0 2024-09-12T02:50:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.575+0000 7fdb08a8d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdb001c6cf0 con 0x5618cab21b00 2024-09-12T02:50:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.576+0000 7fdaff400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab2c3a0 0x5618cab22c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.576+0000 7fdafea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab211e0 0x5618cab438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.576+0000 7fdaff400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab2c3a0 0x5618cab22c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:50014/0 (socket says 172.21.15.18:50014) 2024-09-12T02:50:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.576+0000 7fdaff400640 1 -- 172.21.15.18:0/3544938651 learned_addr learned my addr 172.21.15.18:0/3544938651 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.576+0000 7fdaf6000640 1 --2- 172.21.15.18:0/3544938651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab21b00 0x5618cab43de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.576+0000 7fdafea00640 1 -- 172.21.15.18:0/3544938651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab21b00 msgr2=0x5618cab43de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.576+0000 7fdafea00640 1 --2- 172.21.15.18:0/3544938651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab21b00 0x5618cab43de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.576+0000 7fdafea00640 1 -- 172.21.15.18:0/3544938651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab2c3a0 msgr2=0x5618cab22c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.576+0000 7fdafea00640 1 --2- 172.21.15.18:0/3544938651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab2c3a0 0x5618cab22c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.576+0000 7fdafea00640 1 -- 172.21.15.18:0/3544938651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618cab1d580 con 0x5618cab211e0 2024-09-12T02:50:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.577+0000 7fdaff400640 1 --2- 172.21.15.18:0/3544938651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab2c3a0 0x5618cab22c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:50:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.577+0000 7fdafea00640 1 --2- 172.21.15.18:0/3544938651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab211e0 0x5618cab438a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0000c00 tx=0x7fdaf000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1464076d14b74313 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.577+0000 7fdaef400640 1 -- 172.21.15.18:0/3544938651 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0003d20 con 0x5618cab211e0 2024-09-12T02:50:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.577+0000 7fdaef400640 1 -- 172.21.15.18:0/3544938651 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdaf0003ec0 con 0x5618cab211e0 2024-09-12T02:50:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.577+0000 7fdaef400640 1 -- 172.21.15.18:0/3544938651 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0011870 con 0x5618cab211e0 2024-09-12T02:50:46.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.578+0000 7fdb08a8d740 1 -- 172.21.15.18:0/3544938651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab211e0 msgr2=0x5618cab438a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:46.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.578+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/3544938651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab211e0 0x5618cab438a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0000c00 tx=0x7fdaf000b390 comp rx=0 tx=0).stop 2024-09-12T02:50:46.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.578+0000 7fdb08a8d740 1 -- 172.21.15.18:0/3544938651 shutdown_connections 2024-09-12T02:50:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.578+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/3544938651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab2c3a0 0x5618cab22c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.578+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/3544938651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab21b00 0x5618cab43de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.578+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/3544938651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab211e0 0x5618cab438a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.578+0000 7fdb08a8d740 1 -- 172.21.15.18:0/3544938651 >> 172.21.15.18:0/3544938651 conn(0x5618cab1d750 msgr2=0x5618cab27b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.579+0000 7fdb08a8d740 1 -- 172.21.15.18:0/3544938651 shutdown_connections 2024-09-12T02:50:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.579+0000 7fdb08a8d740 1 -- 172.21.15.18:0/3544938651 wait complete. 2024-09-12T02:50:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.579+0000 7fdb08a8d740 1 -- start start 2024-09-12T02:50:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.579+0000 7fdb08a8d740 1 Processor -- start 2024-09-12T02:50:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.580+0000 7fdb08a8d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab211e0 0x5618cab2f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.580+0000 7fdb08a8d740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab21b00 0x5618cab2fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.580+0000 7fdb08a8d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab2c3a0 0x5618caba4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.580+0000 7fdb08a8d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdb001c7a90 con 0x5618cab211e0 2024-09-12T02:50:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.580+0000 7fdb08a8d740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdb001c73c0 con 0x5618cab21b00 2024-09-12T02:50:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.580+0000 7fdb08a8d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdb001c4540 con 0x5618cab2c3a0 2024-09-12T02:50:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.580+0000 7fdb08a8d740 10 client.0 _ll_register_callbacks cb 0x7fdaf000b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:50:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.580+0000 7fdaf6000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab21b00 0x5618cab2fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.580+0000 7fdaf6000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab21b00 0x5618cab2fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:50018/0 (socket says 172.21.15.18:50018) 2024-09-12T02:50:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.580+0000 7fdaf6000640 1 -- 172.21.15.18:0/84333420 learned_addr learned my addr 172.21.15.18:0/84333420 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:50:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.580+0000 7fdafea00640 1 --2- 172.21.15.18:0/84333420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab211e0 0x5618cab2f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.581+0000 7fdaff400640 1 --2- 172.21.15.18:0/84333420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab2c3a0 0x5618caba4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.581+0000 7fdaf6000640 1 -- 172.21.15.18:0/84333420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab2c3a0 msgr2=0x5618caba4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.581+0000 7fdaf6000640 1 --2- 172.21.15.18:0/84333420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab2c3a0 0x5618caba4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.581+0000 7fdaf6000640 1 -- 172.21.15.18:0/84333420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab211e0 msgr2=0x5618cab2f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:50:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.581+0000 7fdaf6000640 1 --2- 172.21.15.18:0/84333420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab211e0 0x5618cab2f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.581+0000 7fdaf6000640 1 -- 172.21.15.18:0/84333420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618cab18d60 con 0x5618cab21b00 2024-09-12T02:50:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.581+0000 7fdaff400640 1 --2- 172.21.15.18:0/84333420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab2c3a0 0x5618caba4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:50:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.581+0000 7fdafea00640 1 --2- 172.21.15.18:0/84333420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab211e0 0x5618cab2f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:50:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.581+0000 7fdaf6000640 1 --2- 172.21.15.18:0/84333420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab21b00 0x5618cab2fe20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdae800fd90 tx=0x7fdae8009c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1ec1d4a8140feda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:50:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.582+0000 7fdaecc00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:50:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.582+0000 7fdaecc00640 1 -- 172.21.15.18:0/84333420 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8049060 con 0x5618cab21b00 2024-09-12T02:50:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.582+0000 7fdaecc00640 1 -- 172.21.15.18:0/84333420 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fdae800f990 con 0x5618cab21b00 2024-09-12T02:50:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.582+0000 7fdb08a8d740 1 -- 172.21.15.18:0/84333420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdaf0003ec0 con 0x5618cab21b00 2024-09-12T02:50:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.582+0000 7fdaecc00640 1 -- 172.21.15.18:0/84333420 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fdae8050050 con 0x5618cab21b00 2024-09-12T02:50:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.582+0000 7fdb08a8d740 10 client.25457 fetch_fsmap learned FSMap version 36 2024-09-12T02:50:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.582+0000 7fdb08a8d740 1 -- 172.21.15.18:0/84333420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5618caba5eb0 con 0x5618cab21b00 2024-09-12T02:50:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.583+0000 7fdaecc00640 1 -- 172.21.15.18:0/84333420 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdaf0003ec0 con 0x5618cab21b00 2024-09-12T02:50:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.583+0000 7fdaecc00640 1 -- 172.21.15.18:0/84333420 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 36) ==== 8394+0+0 (secure 0 0 0) 0x7fdae80225f0 con 0x5618cab21b00 2024-09-12T02:50:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.583+0000 7fdb08a8d740 10 client.25457 fetch_fsmap finished waiting for FSMap version 36 2024-09-12T02:50:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.583+0000 7fdb08a8d740 10 client.25457 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:50:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.583+0000 7fdb08a8d740 20 client.25457 populate_metadata read hostname 'smithi018' 2024-09-12T02:50:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.583+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/84333420 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5618caba65d0 0x5618caba89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:50:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.583+0000 7fdb08a8d740 4 client.25457 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:50:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.583+0000 7fdb08a8d740 1 -- 172.21.15.18:0/84333420 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5618caa8eb80 con 0x5618caba65d0 2024-09-12T02:50:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.583+0000 7fdafea00640 1 --2- 172.21.15.18:0/84333420 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5618caba65d0 0x5618caba89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:50:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.584+0000 7fdafea00640 1 --2- 172.21.15.18:0/84333420 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5618caba65d0 0x5618caba89f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec76a5e8113571c0 server_cookie=3bd9048b5a0f7383 in_seq=0 out_seq=0 2024-09-12T02:50:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.584+0000 7fdaecc00640 10 client.25457 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:50:46.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:46 smithi176 ceph-mon[35713]: pgmap v64: 129 pgs: 129 active+clean; 175 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.8 MiB/s wr, 693 op/s 2024-09-12T02:50:46.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:46 smithi062 ceph-mon[35527]: pgmap v64: 129 pgs: 129 active+clean; 175 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.8 MiB/s wr, 693 op/s 2024-09-12T02:50:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.953+0000 7fdaecc00640 1 -- 172.21.15.18:0/84333420 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5618caa8eb80 con 0x5618caba65d0 2024-09-12T02:50:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.953+0000 7fdaecc00640 10 client.25457 handle_command_reply: tid=0 2024-09-12T02:50:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.955+0000 7fdb08a8d740 1 client.25457 shutdown 2024-09-12T02:50:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.970+0000 7fdb08a8d740 1 -- 172.21.15.18:0/84333420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab21b00 msgr2=0x5618cab2fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.970+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/84333420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab21b00 0x5618cab2fe20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdae800fd90 tx=0x7fdae8009c90 comp rx=0 tx=0).stop 2024-09-12T02:50:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.975+0000 7fdb08a8d740 1 -- 172.21.15.18:0/84333420 shutdown_connections 2024-09-12T02:50:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.975+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/84333420 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5618caba65d0 0x5618caba89f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.975+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/84333420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5618cab2c3a0 0x5618caba4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.975+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/84333420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618cab21b00 0x5618cab2fe20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.976+0000 7fdb08a8d740 1 --2- 172.21.15.18:0/84333420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618cab211e0 0x5618cab2f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.976+0000 7fdb08a8d740 1 -- 172.21.15.18:0/84333420 >> 172.21.15.18:0/84333420 conn(0x5618cab1d750 msgr2=0x5618cab22c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.976+0000 7fdaecc00640 0 client.25457 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:50:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.994+0000 7fdb08a8d740 1 -- 172.21.15.18:0/84333420 shutdown_connections 2024-09-12T02:50:46.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.994+0000 7fdb08a8d740 1 -- 172.21.15.18:0/84333420 wait complete. 2024-09-12T02:50:46.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:46.997+0000 7fdb08a8d740 20 client.25457 trim_cache size 0 max 16384 2024-09-12T02:50:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:50:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:50:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:50:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:50:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:47.017+0000 7fdb05c00640 1 -- 172.21.15.18:0/1664487130 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fdae40a2e70 msgr2=0x7fdae40a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:47.017+0000 7fdb05c00640 1 --2- 172.21.15.18:0/1664487130 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fdae40a2e70 0x7fdae40a5330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdae80092e0 tx=0x7fdae8010520 comp rx=0 tx=0).stop 2024-09-12T02:50:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:47.017+0000 7fdb05c00640 1 -- 172.21.15.18:0/1664487130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb0010dfd0 msgr2=0x7fdb0010e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:50:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:47.017+0000 7fdb05c00640 1 --2- 172.21.15.18:0/1664487130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb0010dfd0 0x7fdb0010e480 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8003f10 tx=0x7fdaf8003f40 comp rx=0 tx=0).stop 2024-09-12T02:50:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:47.028+0000 7fdb05c00640 1 -- 172.21.15.18:0/1664487130 shutdown_connections 2024-09-12T02:50:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:47.028+0000 7fdb05c00640 1 --2- 172.21.15.18:0/1664487130 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fdae40a2e70 0x7fdae40a5330 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:47.028+0000 7fdb05c00640 1 --2- 172.21.15.18:0/1664487130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb0010dfd0 0x7fdb0010e480 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:47.028+0000 7fdb05c00640 1 --2- 172.21.15.18:0/1664487130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb00109080 0x7fdb0010da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:47.028+0000 7fdb05c00640 1 --2- 172.21.15.18:0/1664487130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb00103f30 0x7fdb001109f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:50:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:47.028+0000 7fdb05c00640 1 -- 172.21.15.18:0/1664487130 >> 172.21.15.18:0/1664487130 conn(0x7fdb000ff980 msgr2=0x7fdb001003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:50:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:47.028+0000 7fdb05c00640 1 -- 172.21.15.18:0/1664487130 shutdown_connections 2024-09-12T02:50:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:50:47.028+0000 7fdb05c00640 1 -- 172.21.15.18:0/1664487130 wait complete. 2024-09-12T02:50:48.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:48 smithi018 ceph-mon[30616]: pgmap v65: 129 pgs: 129 active+clean; 175 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.0 MiB/s wr, 551 op/s 2024-09-12T02:50:48.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:48 smithi176 ceph-mon[35713]: pgmap v65: 129 pgs: 129 active+clean; 175 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.0 MiB/s wr, 551 op/s 2024-09-12T02:50:48.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:48 smithi062 ceph-mon[35527]: pgmap v65: 129 pgs: 129 active+clean; 175 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.0 MiB/s wr, 551 op/s 2024-09-12T02:50:50.607 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:50 smithi018 ceph-mon[30616]: pgmap v66: 129 pgs: 129 active+clean; 183 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 696 op/s 2024-09-12T02:50:50.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:50 smithi176 ceph-mon[35713]: pgmap v66: 129 pgs: 129 active+clean; 183 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 696 op/s 2024-09-12T02:50:50.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:50 smithi062 ceph-mon[35527]: pgmap v66: 129 pgs: 129 active+clean; 183 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 696 op/s 2024-09-12T02:50:51.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:51 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:50:51.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:51 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:50:51.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:51 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:50:52.603 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:52 smithi018 ceph-mon[30616]: pgmap v67: 129 pgs: 129 active+clean; 183 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.8 MiB/s wr, 468 op/s 2024-09-12T02:50:52.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:52 smithi176 ceph-mon[35713]: pgmap v67: 129 pgs: 129 active+clean; 183 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.8 MiB/s wr, 468 op/s 2024-09-12T02:50:52.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:52 smithi062 ceph-mon[35527]: pgmap v67: 129 pgs: 129 active+clean; 183 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.8 MiB/s wr, 468 op/s 2024-09-12T02:50:54.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:54 smithi018 ceph-mon[30616]: pgmap v68: 129 pgs: 129 active+clean; 183 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.8 MiB/s wr, 468 op/s 2024-09-12T02:50:54.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:54 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:50:54.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:54 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:50:54.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:54 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:50:54.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:54 smithi176 ceph-mon[35713]: pgmap v68: 129 pgs: 129 active+clean; 183 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.8 MiB/s wr, 468 op/s 2024-09-12T02:50:54.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:54 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:50:54.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:54 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:50:54.730 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:54 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:50:54.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:54 smithi062 ceph-mon[35527]: pgmap v68: 129 pgs: 129 active+clean; 183 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.8 MiB/s wr, 468 op/s 2024-09-12T02:50:54.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:54 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:50:54.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:54 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:50:54.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:54 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:50:54.862 INFO:tasks.workunit.client.0.smithi018.stdout: 70 353589 1157 226705 1170 98667 457 2024-09-12T02:50:56.628 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:56 smithi018 ceph-mon[30616]: pgmap v69: 129 pgs: 129 active+clean; 192 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.6 MiB/s wr, 518 op/s 2024-09-12T02:50:56.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:56 smithi176 ceph-mon[35713]: pgmap v69: 129 pgs: 129 active+clean; 192 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.6 MiB/s wr, 518 op/s 2024-09-12T02:50:56.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:56 smithi062 ceph-mon[35527]: pgmap v69: 129 pgs: 129 active+clean; 192 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.6 MiB/s wr, 518 op/s 2024-09-12T02:50:58.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:58 smithi018 ceph-mon[30616]: pgmap v70: 129 pgs: 129 active+clean; 192 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 194 op/s 2024-09-12T02:50:58.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:58 smithi176 ceph-mon[35713]: pgmap v70: 129 pgs: 129 active+clean; 192 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 194 op/s 2024-09-12T02:50:58.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:58 smithi062 ceph-mon[35527]: pgmap v70: 129 pgs: 129 active+clean; 192 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 194 op/s 2024-09-12T02:50:59.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:50:59 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:50:59.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:50:59 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:50:59.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:50:59 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:51:00.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:00 smithi176 ceph-mon[35713]: pgmap v71: 129 pgs: 129 active+clean; 230 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.2 MiB/s wr, 362 op/s 2024-09-12T02:51:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.759+0000 7fdfc5600640 1 -- 172.21.15.18:0/952064477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc0114ab0 msgr2=0x7fdfc0116ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.759+0000 7fdfc5600640 1 --2- 172.21.15.18:0/952064477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc0114ab0 0x7fdfc0116ea0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009900 tx=0x7fdfb002a400 comp rx=0 tx=0).stop 2024-09-12T02:51:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.760+0000 7fdfc5600640 1 -- 172.21.15.18:0/952064477 shutdown_connections 2024-09-12T02:51:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.760+0000 7fdfc5600640 1 --2- 172.21.15.18:0/952064477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc0114ab0 0x7fdfc0116ea0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.760+0000 7fdfc5600640 1 --2- 172.21.15.18:0/952064477 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfc0109b10 0x7fdfc0114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.760+0000 7fdfc5600640 1 --2- 172.21.15.18:0/952064477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfc01091f0 0x7fdfc01095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.762+0000 7fdfc5600640 1 -- 172.21.15.18:0/952064477 >> 172.21.15.18:0/952064477 conn(0x7fdfc006cbf0 msgr2=0x7fdfc006d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:00.764 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.762+0000 7fdfc5600640 1 -- 172.21.15.18:0/952064477 shutdown_connections 2024-09-12T02:51:00.764 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.762+0000 7fdfc5600640 1 -- 172.21.15.18:0/952064477 wait complete. 2024-09-12T02:51:00.764 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.763+0000 7fdfc5600640 1 Processor -- start 2024-09-12T02:51:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.764+0000 7fdfc5600640 1 -- start start 2024-09-12T02:51:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.768+0000 7fdfc5600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfc01091f0 0x7fdfc011e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.768+0000 7fdfc5600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfc0109b10 0x7fdfc011ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.768+0000 7fdfc5600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc0114ab0 0x7fdfc01244d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.768+0000 7fdfc5600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc010c390 con 0x7fdfc0109b10 2024-09-12T02:51:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.768+0000 7fdfc5600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc010c210 con 0x7fdfc0114ab0 2024-09-12T02:51:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.768+0000 7fdfc5600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc0118450 con 0x7fdfc01091f0 2024-09-12T02:51:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.768+0000 7fdfbfe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfc01091f0 0x7fdfc011e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.768+0000 7fdfbfe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfc01091f0 0x7fdfc011e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:60352/0 (socket says 172.21.15.18:60352) 2024-09-12T02:51:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.768+0000 7fdfbfe00640 1 -- 172.21.15.18:0/2983095552 learned_addr learned my addr 172.21.15.18:0/2983095552 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.769+0000 7fdfbf400640 1 --2- 172.21.15.18:0/2983095552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfc0109b10 0x7fdfc011ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.769+0000 7fdfbfe00640 1 -- 172.21.15.18:0/2983095552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc0114ab0 msgr2=0x7fdfc01244d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.769+0000 7fdfbfe00640 1 --2- 172.21.15.18:0/2983095552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc0114ab0 0x7fdfc01244d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.769+0000 7fdfbfe00640 1 -- 172.21.15.18:0/2983095552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfc0109b10 msgr2=0x7fdfc011ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.769+0000 7fdfbfe00640 1 --2- 172.21.15.18:0/2983095552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfc0109b10 0x7fdfc011ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.769+0000 7fdfbfe00640 1 -- 172.21.15.18:0/2983095552 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc0124d90 con 0x7fdfc01091f0 2024-09-12T02:51:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.769+0000 7fdfbf400640 1 --2- 172.21.15.18:0/2983095552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfc0109b10 0x7fdfc011ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.769+0000 7fdfbfe00640 1 --2- 172.21.15.18:0/2983095552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfc01091f0 0x7fdfc011e7c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00ea60 tx=0x7fdfac00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.771+0000 7fdfbcc00640 1 -- 172.21.15.18:0/2983095552 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac00cde0 con 0x7fdfc01091f0 2024-09-12T02:51:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.771+0000 7fdfbcc00640 1 -- 172.21.15.18:0/2983095552 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfac0035f0 con 0x7fdfc01091f0 2024-09-12T02:51:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.771+0000 7fdfbcc00640 1 -- 172.21.15.18:0/2983095552 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac010690 con 0x7fdfc01091f0 2024-09-12T02:51:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.771+0000 7fdfc5600640 1 -- 172.21.15.18:0/2983095552 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc0119930 con 0x7fdfc01091f0 2024-09-12T02:51:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.771+0000 7fdfc5600640 1 -- 172.21.15.18:0/2983095552 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc0119e30 con 0x7fdfc01091f0 2024-09-12T02:51:00.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:00 smithi062 ceph-mon[35527]: pgmap v71: 129 pgs: 129 active+clean; 230 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.2 MiB/s wr, 362 op/s 2024-09-12T02:51:00.783 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.782+0000 7fdfc9c2c740 1 Processor -- start 2024-09-12T02:51:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.782+0000 7fdfc9c2c740 1 -- start start 2024-09-12T02:51:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.783+0000 7fdfc9c2c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55951115b3b0 0x55951115b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.783+0000 7fdfc9c2c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115bcd0 0x559511166030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.783+0000 7fdfc9c2c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559511166570 0x559511168960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.783+0000 7fdfc9c2c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5595110c1100 con 0x55951115bcd0 2024-09-12T02:51:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.783+0000 7fdfc9c2c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5595110691b0 con 0x559511166570 2024-09-12T02:51:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.783+0000 7fdfc9c2c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5595110bd0c0 con 0x55951115b3b0 2024-09-12T02:51:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.784+0000 7fdfbf400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559511166570 0x559511168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.784+0000 7fdfbf400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559511166570 0x559511168960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:54694/0 (socket says 172.21.15.18:54694) 2024-09-12T02:51:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.784+0000 7fdfbf400640 1 -- 172.21.15.18:0/514137974 learned_addr learned my addr 172.21.15.18:0/514137974 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:00.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.784+0000 7fdfc4c00640 1 --2- 172.21.15.18:0/514137974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55951115b3b0 0x55951115b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:00.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.784+0000 7fdfc4c00640 1 -- 172.21.15.18:0/514137974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559511166570 msgr2=0x559511168960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:00.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.784+0000 7fdfc4c00640 1 --2- 172.21.15.18:0/514137974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559511166570 0x559511168960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.784+0000 7fdfc4c00640 1 -- 172.21.15.18:0/514137974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115bcd0 msgr2=0x559511166030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:51:00.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.784+0000 7fdfc4c00640 1 --2- 172.21.15.18:0/514137974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115bcd0 0x559511166030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.785+0000 7fdfc4c00640 1 -- 172.21.15.18:0/514137974 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559510dd4210 con 0x55951115b3b0 2024-09-12T02:51:00.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.785+0000 7fdfbcc00640 1 -- 172.21.15.18:0/2983095552 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fdfac0037a0 con 0x7fdfc01091f0 2024-09-12T02:51:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.785+0000 7fdfc4c00640 1 --2- 172.21.15.18:0/514137974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55951115b3b0 0x55951115b790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdfb002a920 tx=0x7fdfb0005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b52c1703eeae6e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.786+0000 7fdfb5200640 1 -- 172.21.15.18:0/514137974 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb003e070 con 0x55951115b3b0 2024-09-12T02:51:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.786+0000 7fdfb5200640 1 -- 172.21.15.18:0/514137974 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfb0005530 con 0x55951115b3b0 2024-09-12T02:51:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.787+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/514137974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55951115b3b0 msgr2=0x55951115b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.787+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/514137974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55951115b3b0 0x55951115b790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdfb002a920 tx=0x7fdfb0005de0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.787+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/514137974 shutdown_connections 2024-09-12T02:51:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.787+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/514137974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559511166570 0x559511168960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.787+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/514137974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115bcd0 0x559511166030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.787+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/514137974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55951115b3b0 0x55951115b790 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.787+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/514137974 >> 172.21.15.18:0/514137974 conn(0x559511157920 msgr2=0x559511157d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.790+0000 7fdfbcc00640 1 --2- 172.21.15.18:0/2983095552 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fdfa40a2d70 0x7fdfa40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.790+0000 7fdfbcc00640 1 -- 172.21.15.18:0/2983095552 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fdfac0cfb80 con 0x7fdfc01091f0 2024-09-12T02:51:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.791+0000 7fdfbf400640 1 --2- 172.21.15.18:0/2983095552 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fdfa40a2d70 0x7fdfa40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.791+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/514137974 shutdown_connections 2024-09-12T02:51:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.792+0000 7fdfbf400640 1 --2- 172.21.15.18:0/2983095552 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fdfa40a2d70 0x7fdfa40a5230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x559511158ca0 tx=0x7fdfb8009500 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.792+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/514137974 wait complete. 2024-09-12T02:51:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.793+0000 7fdfc9c2c740 1 -- start start 2024-09-12T02:51:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.793+0000 7fdfc9c2c740 1 Processor -- start 2024-09-12T02:51:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.793+0000 7fdfc9c2c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115b3b0 0x5595111634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.794+0000 7fdfc9c2c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55951115bcd0 0x5595111639f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.794+0000 7fdfbfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115b3b0 0x5595111634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.794+0000 7fdfbf400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55951115bcd0 0x5595111639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.794+0000 7fdfbf400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55951115bcd0 0x5595111639f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:60372/0 (socket says 172.21.15.18:60372) 2024-09-12T02:51:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.794+0000 7fdfbf400640 1 -- 172.21.15.18:0/2116905570 learned_addr learned my addr 172.21.15.18:0/2116905570 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.794+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/2116905570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559511166570 0x559511163f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.795+0000 7fdfc4c00640 1 --2- 172.21.15.18:0/2116905570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559511166570 0x559511163f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.795+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/2116905570 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559511169190 con 0x55951115b3b0 2024-09-12T02:51:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.795+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/2116905570 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55951104a090 con 0x559511166570 2024-09-12T02:51:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.795+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/2116905570 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x559511169310 con 0x55951115bcd0 2024-09-12T02:51:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.796+0000 7fdfbfe00640 1 -- 172.21.15.18:0/2116905570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55951115bcd0 msgr2=0x5595111639f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.796+0000 7fdfbfe00640 1 --2- 172.21.15.18:0/2116905570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55951115bcd0 0x5595111639f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.796+0000 7fdfbfe00640 1 -- 172.21.15.18:0/2116905570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559511166570 msgr2=0x559511163f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.796+0000 7fdfbfe00640 1 --2- 172.21.15.18:0/2116905570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559511166570 0x559511163f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.796+0000 7fdfbfe00640 1 -- 172.21.15.18:0/2116905570 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559510ea0620 con 0x55951115b3b0 2024-09-12T02:51:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.796+0000 7fdfc4c00640 1 --2- 172.21.15.18:0/2116905570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559511166570 0x559511163f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.796+0000 7fdfc9c2c740 10 client.0 _ll_register_callbacks cb 0x55951109ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.796+0000 7fdfbfe00640 1 --2- 172.21.15.18:0/2116905570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115b3b0 0x5595111634b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0ccf10 tx=0x7fdfac09b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22fdaf6c6e19a068 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.798+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/2116905570 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfb0005530 con 0x55951115b3b0 2024-09-12T02:51:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.796+0000 7fdfa9600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:51:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.798+0000 7fdfa9600640 1 -- 172.21.15.18:0/2116905570 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0a0090 con 0x55951115b3b0 2024-09-12T02:51:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.798+0000 7fdfa9600640 1 -- 172.21.15.18:0/2116905570 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fdfac098350 con 0x55951115b3b0 2024-09-12T02:51:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.798+0000 7fdfa9600640 1 -- 172.21.15.18:0/2116905570 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fdfac0a4950 con 0x55951115b3b0 2024-09-12T02:51:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.798+0000 7fdfc9c2c740 10 client.15465 fetch_fsmap learned FSMap version 37 2024-09-12T02:51:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.798+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/2116905570 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=37}) -- 0x559511174c70 con 0x55951115b3b0 2024-09-12T02:51:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.799+0000 7fdfa9600640 1 -- 172.21.15.18:0/2116905570 <== mon.0 v2:172.21.15.18:3300/0 4 ==== fsmap(e 37) ==== 8390+0+0 (secure 0 0 0) 0x7fdfac09b130 con 0x55951115b3b0 2024-09-12T02:51:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.799+0000 7fdfc9c2c740 10 client.15465 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T02:51:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.799+0000 7fdfc9c2c740 10 client.15465 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:51:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.799+0000 7fdfc9c2c740 20 client.15465 populate_metadata read hostname 'smithi018' 2024-09-12T02:51:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.799+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/2116905570 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x559511176130 0x5595111785c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.799+0000 7fdfc9c2c740 4 client.15465 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:51:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.799+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/2116905570 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595110ce830 con 0x559511176130 2024-09-12T02:51:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.800+0000 7fdfbf400640 1 --2- 172.21.15.18:0/2116905570 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x559511176130 0x5595111785c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.801+0000 7fdfa9600640 10 client.15465 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:51:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.801+0000 7fdfbf400640 1 --2- 172.21.15.18:0/2116905570 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x559511176130 0x5595111785c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa406addcd525101 server_cookie=a7ab6592ac880d06 in_seq=0 out_seq=0 2024-09-12T02:51:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.803+0000 7fdfa9600640 1 -- 172.21.15.18:0/2116905570 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5595110ce830 con 0x559511176130 2024-09-12T02:51:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.803+0000 7fdfa9600640 10 client.15465 handle_command_reply: tid=0 2024-09-12T02:51:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.803+0000 7fdfc9c2c740 1 client.15465 shutdown 2024-09-12T02:51:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.805+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/2116905570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115b3b0 msgr2=0x5595111634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.805+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/2116905570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115b3b0 0x5595111634b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0ccf10 tx=0x7fdfac09b910 comp rx=0 tx=0).stop 2024-09-12T02:51:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.805+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/2116905570 shutdown_connections 2024-09-12T02:51:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.805+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/2116905570 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x559511176130 0x5595111785c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.805+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/2116905570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559511166570 0x559511163f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.805+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/2116905570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55951115bcd0 0x5595111639f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.805+0000 7fdfa9600640 0 client.15465 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:51:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.805+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/2116905570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115b3b0 0x5595111634b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.805+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/2116905570 >> 172.21.15.18:0/2116905570 conn(0x559511157920 msgr2=0x55951115d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.805+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/2116905570 shutdown_connections 2024-09-12T02:51:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.806+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/2116905570 wait complete. 2024-09-12T02:51:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.806+0000 7fdfc9c2c740 20 client.15465 trim_cache size 0 max 16384 2024-09-12T02:51:00.846 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.845+0000 7fdfc9c2c740 1 Processor -- start 2024-09-12T02:51:00.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:00 smithi018 ceph-mon[30616]: pgmap v71: 129 pgs: 129 active+clean; 230 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.2 MiB/s wr, 362 op/s 2024-09-12T02:51:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.849+0000 7fdfc9c2c740 1 -- start start 2024-09-12T02:51:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.849+0000 7fdfc9c2c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115bcd0 0x55951115de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.849+0000 7fdfc9c2c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559511166570 0x55951117ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.849+0000 7fdfc9c2c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5595111571d0 0x55951117e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.849+0000 7fdfc9c2c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc01c6460 con 0x55951115bcd0 2024-09-12T02:51:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.849+0000 7fdfc9c2c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc01c8090 con 0x5595111571d0 2024-09-12T02:51:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.849+0000 7fdfc9c2c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc01c6bf0 con 0x559511166570 2024-09-12T02:51:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.850+0000 7fdfc4c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5595111571d0 0x55951117e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.850+0000 7fdfc4c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5595111571d0 0x55951117e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:54702/0 (socket says 172.21.15.18:54702) 2024-09-12T02:51:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.850+0000 7fdfc4c00640 1 -- 172.21.15.18:0/2167872937 learned_addr learned my addr 172.21.15.18:0/2167872937 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.850+0000 7fdfbfe00640 1 --2- 172.21.15.18:0/2167872937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115bcd0 0x55951115de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.850+0000 7fdfbf400640 1 --2- 172.21.15.18:0/2167872937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559511166570 0x55951117ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:00.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.850+0000 7fdfc4c00640 1 -- 172.21.15.18:0/2167872937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559511166570 msgr2=0x55951117ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:00.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.850+0000 7fdfc4c00640 1 --2- 172.21.15.18:0/2167872937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559511166570 0x55951117ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.850+0000 7fdfc4c00640 1 -- 172.21.15.18:0/2167872937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115bcd0 msgr2=0x55951115de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:00.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.850+0000 7fdfc4c00640 1 --2- 172.21.15.18:0/2167872937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115bcd0 0x55951115de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.850+0000 7fdfc4c00640 1 -- 172.21.15.18:0/2167872937 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559511158ab0 con 0x5595111571d0 2024-09-12T02:51:00.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.850+0000 7fdfbfe00640 1 --2- 172.21.15.18:0/2167872937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115bcd0 0x55951115de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:51:00.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.851+0000 7fdfc4c00640 1 --2- 172.21.15.18:0/2167872937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5595111571d0 0x55951117e410 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0004b40 tx=0x7fdfb0005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dacb9fc4f1a16edd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.852+0000 7fdfabe00640 1 -- 172.21.15.18:0/2167872937 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb003e040 con 0x5595111571d0 2024-09-12T02:51:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.852+0000 7fdfabe00640 1 -- 172.21.15.18:0/2167872937 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfb0009520 con 0x5595111571d0 2024-09-12T02:51:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.852+0000 7fdfabe00640 1 -- 172.21.15.18:0/2167872937 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00039f0 con 0x5595111571d0 2024-09-12T02:51:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.853+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/2167872937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5595111571d0 msgr2=0x55951117e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.853+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/2167872937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5595111571d0 0x55951117e410 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0004b40 tx=0x7fdfb0005850 comp rx=0 tx=0).stop 2024-09-12T02:51:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.854+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/2167872937 shutdown_connections 2024-09-12T02:51:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.854+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/2167872937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5595111571d0 0x55951117e410 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.854+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/2167872937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559511166570 0x55951117ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.854+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/2167872937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115bcd0 0x55951115de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.854+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/2167872937 >> 172.21.15.18:0/2167872937 conn(0x559511157920 msgr2=0x559511165420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:00.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.854+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/2167872937 shutdown_connections 2024-09-12T02:51:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.856+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/2167872937 wait complete. 2024-09-12T02:51:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.856+0000 7fdfc9c2c740 1 -- start start 2024-09-12T02:51:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.857+0000 7fdfc9c2c740 1 Processor -- start 2024-09-12T02:51:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.858+0000 7fdfc9c2c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5595111571d0 0x55951116e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.858+0000 7fdfc9c2c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115bcd0 0x55951116eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.859+0000 7fdfc9c2c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559511166570 0x55951116b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.859+0000 7fdfc9c2c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc01c7990 con 0x55951115bcd0 2024-09-12T02:51:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.859+0000 7fdfc9c2c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc01c72c0 con 0x5595111571d0 2024-09-12T02:51:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.859+0000 7fdfc9c2c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc01c4440 con 0x559511166570 2024-09-12T02:51:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.860+0000 7fdfc9c2c740 10 client.0 _ll_register_callbacks cb 0x7fdfac009490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.860+0000 7fdfc4c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559511166570 0x55951116b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.860+0000 7fdfc4c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559511166570 0x55951116b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:60398/0 (socket says 172.21.15.18:60398) 2024-09-12T02:51:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.860+0000 7fdfc4c00640 1 -- 172.21.15.18:0/1038790998 learned_addr learned my addr 172.21.15.18:0/1038790998 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.860+0000 7fdfbf400640 1 --2- 172.21.15.18:0/1038790998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115bcd0 0x55951116eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.860+0000 7fdfbfe00640 1 --2- 172.21.15.18:0/1038790998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5595111571d0 0x55951116e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.861+0000 7fdfc4c00640 1 -- 172.21.15.18:0/1038790998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5595111571d0 msgr2=0x55951116e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.861+0000 7fdfc4c00640 1 --2- 172.21.15.18:0/1038790998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5595111571d0 0x55951116e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.861+0000 7fdfc4c00640 1 -- 172.21.15.18:0/1038790998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115bcd0 msgr2=0x55951116eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.861+0000 7fdfc4c00640 1 --2- 172.21.15.18:0/1038790998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115bcd0 0x55951116eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.861+0000 7fdfc4c00640 1 -- 172.21.15.18:0/1038790998 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55951116bac0 con 0x559511166570 2024-09-12T02:51:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.861+0000 7fdfbfe00640 1 --2- 172.21.15.18:0/1038790998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5595111571d0 0x55951116e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.861+0000 7fdfbf400640 1 --2- 172.21.15.18:0/1038790998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115bcd0 0x55951116eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:51:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.861+0000 7fdfc4c00640 1 --2- 172.21.15.18:0/1038790998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559511166570 0x55951116b580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0005c40 tx=0x7fdfb00043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bcb1c43f82f6301 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.862+0000 7fdfa9600640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:51:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.862+0000 7fdfa9600640 1 -- 172.21.15.18:0/1038790998 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb003e070 con 0x559511166570 2024-09-12T02:51:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.862+0000 7fdfa9600640 1 -- 172.21.15.18:0/1038790998 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fdfb0005060 con 0x559511166570 2024-09-12T02:51:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.862+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/1038790998 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfb0009520 con 0x559511166570 2024-09-12T02:51:00.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.866+0000 7fdfa9600640 1 -- 172.21.15.18:0/1038790998 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fdfb005d050 con 0x559511166570 2024-09-12T02:51:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.869+0000 7fdfc9c2c740 10 client.25480 fetch_fsmap learned FSMap version 37 2024-09-12T02:51:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.869+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/1038790998 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5595111e14b0 con 0x559511166570 2024-09-12T02:51:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.870+0000 7fdfa9600640 1 -- 172.21.15.18:0/1038790998 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfb0009520 con 0x559511166570 2024-09-12T02:51:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.870+0000 7fdfa9600640 1 -- 172.21.15.18:0/1038790998 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 37) ==== 8390+0+0 (secure 0 0 0) 0x7fdfb004c070 con 0x559511166570 2024-09-12T02:51:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.870+0000 7fdfc9c2c740 10 client.25480 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T02:51:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.870+0000 7fdfc9c2c740 10 client.25480 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:51:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.870+0000 7fdfc9c2c740 20 client.25480 populate_metadata read hostname 'smithi018' 2024-09-12T02:51:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.870+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/1038790998 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5595111e16e0 0x5595111e3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:00.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.870+0000 7fdfc9c2c740 4 client.25480 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:51:00.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.870+0000 7fdfbfe00640 1 --2- 172.21.15.18:0/1038790998 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5595111e16e0 0x5595111e3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:00.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.870+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/1038790998 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5595110c8b80 con 0x5595111e16e0 2024-09-12T02:51:00.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.871+0000 7fdfa9600640 10 client.25480 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:51:00.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:00.871+0000 7fdfbfe00640 1 --2- 172.21.15.18:0/1038790998 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5595111e16e0 0x5595111e3ad0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc4268e266e10745 server_cookie=55d0e037311e952b in_seq=0 out_seq=0 2024-09-12T02:51:02.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:02 smithi176 ceph-mon[35713]: pgmap v72: 129 pgs: 129 active+clean; 230 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 218 op/s 2024-09-12T02:51:02.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:02 smithi062 ceph-mon[35527]: pgmap v72: 129 pgs: 129 active+clean; 230 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 218 op/s 2024-09-12T02:51:02.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:02 smithi018 ceph-mon[30616]: pgmap v72: 129 pgs: 129 active+clean; 230 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 218 op/s 2024-09-12T02:51:04.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:04 smithi176 ceph-mon[35713]: pgmap v73: 129 pgs: 129 active+clean; 230 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 218 op/s 2024-09-12T02:51:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.730+0000 7fdfa9600640 1 -- 172.21.15.18:0/1038790998 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5595110c8b80 con 0x5595111e16e0 2024-09-12T02:51:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.730+0000 7fdfa9600640 10 client.25480 handle_command_reply: tid=0 2024-09-12T02:51:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.730+0000 7fdfc9c2c740 1 client.25480 shutdown 2024-09-12T02:51:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.730+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/1038790998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559511166570 msgr2=0x55951116b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.730+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/1038790998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559511166570 0x55951116b580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0005c40 tx=0x7fdfb00043b0 comp rx=0 tx=0).stop 2024-09-12T02:51:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.731+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/1038790998 shutdown_connections 2024-09-12T02:51:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.731+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/1038790998 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5595111e16e0 0x5595111e3ad0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.731+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/1038790998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559511166570 0x55951116b580 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.731+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/1038790998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55951115bcd0 0x55951116eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.731+0000 7fdfc9c2c740 1 --2- 172.21.15.18:0/1038790998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5595111571d0 0x55951116e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.731+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/1038790998 >> 172.21.15.18:0/1038790998 conn(0x559511157920 msgr2=0x559511163450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.731+0000 7fdfa9600640 0 client.25480 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:51:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.732+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/1038790998 shutdown_connections 2024-09-12T02:51:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.732+0000 7fdfc9c2c740 1 -- 172.21.15.18:0/1038790998 wait complete. 2024-09-12T02:51:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.732+0000 7fdfc9c2c740 20 client.25480 trim_cache size 0 max 16384 2024-09-12T02:51:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:51:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:51:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:51:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:51:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.733+0000 7fdfc5600640 1 -- 172.21.15.18:0/2983095552 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fdfa40a2d70 msgr2=0x7fdfa40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.733+0000 7fdfc5600640 1 --2- 172.21.15.18:0/2983095552 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fdfa40a2d70 0x7fdfa40a5230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x559511158ca0 tx=0x7fdfb8009500 comp rx=0 tx=0).stop 2024-09-12T02:51:04.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.733+0000 7fdfc5600640 1 -- 172.21.15.18:0/2983095552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfc01091f0 msgr2=0x7fdfc011e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:04.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.733+0000 7fdfc5600640 1 --2- 172.21.15.18:0/2983095552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfc01091f0 0x7fdfc011e7c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00ea60 tx=0x7fdfac00ef20 comp rx=0 tx=0).stop 2024-09-12T02:51:04.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.734+0000 7fdfc5600640 1 -- 172.21.15.18:0/2983095552 shutdown_connections 2024-09-12T02:51:04.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.734+0000 7fdfc5600640 1 --2- 172.21.15.18:0/2983095552 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fdfa40a2d70 0x7fdfa40a5230 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:04.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.734+0000 7fdfc5600640 1 --2- 172.21.15.18:0/2983095552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc0114ab0 0x7fdfc01244d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:04.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.734+0000 7fdfc5600640 1 --2- 172.21.15.18:0/2983095552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfc0109b10 0x7fdfc011ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:04.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.734+0000 7fdfc5600640 1 --2- 172.21.15.18:0/2983095552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfc01091f0 0x7fdfc011e7c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:04.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.734+0000 7fdfc5600640 1 -- 172.21.15.18:0/2983095552 >> 172.21.15.18:0/2983095552 conn(0x7fdfc006cbf0 msgr2=0x7fdfc00706e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:04.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.734+0000 7fdfc5600640 1 -- 172.21.15.18:0/2983095552 shutdown_connections 2024-09-12T02:51:04.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:04.734+0000 7fdfc5600640 1 -- 172.21.15.18:0/2983095552 wait complete. 2024-09-12T02:51:04.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:04 smithi062 ceph-mon[35527]: pgmap v73: 129 pgs: 129 active+clean; 230 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 218 op/s 2024-09-12T02:51:04.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:04 smithi018 ceph-mon[30616]: pgmap v73: 129 pgs: 129 active+clean; 230 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 218 op/s 2024-09-12T02:51:04.862 INFO:tasks.workunit.client.0.smithi018.stdout: 84 343147 782 229363 864 79925 21 2024-09-12T02:51:06.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:06 smithi176 ceph-mon[35713]: pgmap v74: 129 pgs: 129 active+clean; 282 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.7 MiB/s wr, 561 op/s 2024-09-12T02:51:06.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:06 smithi062 ceph-mon[35527]: pgmap v74: 129 pgs: 129 active+clean; 282 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.7 MiB/s wr, 561 op/s 2024-09-12T02:51:06.865 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:06 smithi018 ceph-mon[30616]: pgmap v74: 129 pgs: 129 active+clean; 282 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.7 MiB/s wr, 561 op/s 2024-09-12T02:51:08.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:08 smithi176 ceph-mon[35713]: pgmap v75: 129 pgs: 129 active+clean; 282 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.9 MiB/s wr, 511 op/s 2024-09-12T02:51:08.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:08 smithi062 ceph-mon[35527]: pgmap v75: 129 pgs: 129 active+clean; 282 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.9 MiB/s wr, 511 op/s 2024-09-12T02:51:08.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:08 smithi018 ceph-mon[30616]: pgmap v75: 129 pgs: 129 active+clean; 282 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.9 MiB/s wr, 511 op/s 2024-09-12T02:51:10.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:10 smithi176 ceph-mon[35713]: pgmap v76: 129 pgs: 129 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.9 MiB/s wr, 562 op/s 2024-09-12T02:51:10.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:10 smithi062 ceph-mon[35527]: pgmap v76: 129 pgs: 129 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.9 MiB/s wr, 562 op/s 2024-09-12T02:51:10.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:10 smithi018 ceph-mon[30616]: pgmap v76: 129 pgs: 129 active+clean; 304 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.9 MiB/s wr, 562 op/s 2024-09-12T02:51:12.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:12 smithi176 ceph-mon[35713]: pgmap v77: 129 pgs: 129 active+clean; 316 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.4 MiB/s wr, 449 op/s 2024-09-12T02:51:12.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:12 smithi062 ceph-mon[35527]: pgmap v77: 129 pgs: 129 active+clean; 316 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.4 MiB/s wr, 449 op/s 2024-09-12T02:51:12.875 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:12 smithi018 ceph-mon[30616]: pgmap v77: 129 pgs: 129 active+clean; 316 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.4 MiB/s wr, 449 op/s 2024-09-12T02:51:14.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:14 smithi176 ceph-mon[35713]: pgmap v78: 129 pgs: 129 active+clean; 316 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.4 MiB/s wr, 449 op/s 2024-09-12T02:51:14.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:14 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:51:14.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:14 smithi062 ceph-mon[35527]: pgmap v78: 129 pgs: 129 active+clean; 316 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.4 MiB/s wr, 449 op/s 2024-09-12T02:51:14.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:14 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:51:14.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:14 smithi018 ceph-mon[30616]: pgmap v78: 129 pgs: 129 active+clean; 316 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.4 MiB/s wr, 449 op/s 2024-09-12T02:51:14.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:14 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:51:14.862 INFO:tasks.workunit.client.0.smithi018.stdout: 113 335790 1662 223340 1149 61934 14 2024-09-12T02:51:16.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:16 smithi176 ceph-mon[35713]: pgmap v79: 129 pgs: 129 active+clean; 326 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.4 MiB/s wr, 486 op/s 2024-09-12T02:51:16.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:16 smithi062 ceph-mon[35527]: pgmap v79: 129 pgs: 129 active+clean; 326 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.4 MiB/s wr, 486 op/s 2024-09-12T02:51:16.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:16 smithi018 ceph-mon[30616]: pgmap v79: 129 pgs: 129 active+clean; 326 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.4 MiB/s wr, 486 op/s 2024-09-12T02:51:17.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.853+0000 7ff2d9000640 1 -- 172.21.15.18:0/1979841551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2d4104480 msgr2=0x7ff2d41109b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.853+0000 7ff2d9000640 1 --2- 172.21.15.18:0/1979841551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2d4104480 0x7ff2d41109b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009cd0 tx=0x7ff2cc02a8f0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.853+0000 7ff2d9000640 1 -- 172.21.15.18:0/1979841551 shutdown_connections 2024-09-12T02:51:17.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.853+0000 7ff2d9000640 1 --2- 172.21.15.18:0/1979841551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2d4104480 0x7ff2d41109b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.853+0000 7ff2d9000640 1 --2- 172.21.15.18:0/1979841551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2d4103ae0 0x7ff2d4103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.853+0000 7ff2d9000640 1 --2- 172.21.15.18:0/1979841551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2d4109b80 0x7ff2d4109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.853+0000 7ff2d9000640 1 -- 172.21.15.18:0/1979841551 >> 172.21.15.18:0/1979841551 conn(0x7ff2d40ff7c0 msgr2=0x7ff2d4101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:17.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.853+0000 7ff2d9000640 1 -- 172.21.15.18:0/1979841551 shutdown_connections 2024-09-12T02:51:17.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.853+0000 7ff2d9000640 1 -- 172.21.15.18:0/1979841551 wait complete. 2024-09-12T02:51:17.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.854+0000 7ff2d9000640 1 Processor -- start 2024-09-12T02:51:17.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.854+0000 7ff2d9000640 1 -- start start 2024-09-12T02:51:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.854+0000 7ff2d9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2d4103ae0 0x7ff2d419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.854+0000 7ff2d9000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2d4104480 0x7ff2d419a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.854+0000 7ff2d9000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2d4109b80 0x7ff2d419ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.854+0000 7ff2d9000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d4113ef0 con 0x7ff2d4103ae0 2024-09-12T02:51:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.854+0000 7ff2d9000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d4113d70 con 0x7ff2d4109b80 2024-09-12T02:51:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.854+0000 7ff2d9000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d4114070 con 0x7ff2d4104480 2024-09-12T02:51:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.855+0000 7ff2d3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2d4103ae0 0x7ff2d419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.855+0000 7ff2d3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2d4103ae0 0x7ff2d419a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39444/0 (socket says 172.21.15.18:39444) 2024-09-12T02:51:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.855+0000 7ff2d3400640 1 -- 172.21.15.18:0/3279763010 learned_addr learned my addr 172.21.15.18:0/3279763010 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.855+0000 7ff2d3e00640 1 --2- 172.21.15.18:0/3279763010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2d4109b80 0x7ff2d419ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.855+0000 7ff2d2a00640 1 --2- 172.21.15.18:0/3279763010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2d4104480 0x7ff2d419a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.855+0000 7ff2d3400640 1 -- 172.21.15.18:0/3279763010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2d4104480 msgr2=0x7ff2d419a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.855+0000 7ff2d3400640 1 --2- 172.21.15.18:0/3279763010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2d4104480 0x7ff2d419a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.855+0000 7ff2d3400640 1 -- 172.21.15.18:0/3279763010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2d4109b80 msgr2=0x7ff2d419ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.855+0000 7ff2d3400640 1 --2- 172.21.15.18:0/3279763010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2d4109b80 0x7ff2d419ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.855+0000 7ff2d3400640 1 -- 172.21.15.18:0/3279763010 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d419f410 con 0x7ff2d4103ae0 2024-09-12T02:51:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.855+0000 7ff2d3400640 1 --2- 172.21.15.18:0/3279763010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2d4103ae0 0x7ff2d419a420 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400e9f0 tx=0x7ff2c400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.856+0000 7ff2cbe00640 1 -- 172.21.15.18:0/3279763010 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c400cd80 con 0x7ff2d4103ae0 2024-09-12T02:51:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.856+0000 7ff2cbe00640 1 -- 172.21.15.18:0/3279763010 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2c4010910 con 0x7ff2d4103ae0 2024-09-12T02:51:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.856+0000 7ff2d9000640 1 -- 172.21.15.18:0/3279763010 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d419f700 con 0x7ff2d4103ae0 2024-09-12T02:51:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.856+0000 7ff2cbe00640 1 -- 172.21.15.18:0/3279763010 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4018990 con 0x7ff2d4103ae0 2024-09-12T02:51:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.856+0000 7ff2d9000640 1 -- 172.21.15.18:0/3279763010 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d41a6f90 con 0x7ff2d4103ae0 2024-09-12T02:51:17.860 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.859+0000 7ff2dd642740 1 Processor -- start 2024-09-12T02:51:17.860 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.859+0000 7ff2cbe00640 1 -- 172.21.15.18:0/3279763010 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7ff2c4010ac0 con 0x7ff2d4103ae0 2024-09-12T02:51:17.860 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.859+0000 7ff2dd642740 1 -- start start 2024-09-12T02:51:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.859+0000 7ff2dd642740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a0493b0 0x561a4a049790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.859+0000 7ff2dd642740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a049cd0 0x561a4a054030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.859+0000 7ff2dd642740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a054570 0x561a4a056960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.859+0000 7ff2dd642740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561a49faf100 con 0x561a4a054570 2024-09-12T02:51:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.859+0000 7ff2dd642740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561a49f571b0 con 0x561a4a0493b0 2024-09-12T02:51:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.859+0000 7ff2dd642740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561a49fab0c0 con 0x561a4a049cd0 2024-09-12T02:51:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.860+0000 7ff2d2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a054570 0x561a4a056960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.860+0000 7ff2d3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a0493b0 0x561a4a049790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.860+0000 7ff2d3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a0493b0 0x561a4a049790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:58716/0 (socket says 172.21.15.18:58716) 2024-09-12T02:51:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.860+0000 7ff2d3e00640 1 -- 172.21.15.18:0/1817842810 learned_addr learned my addr 172.21.15.18:0/1817842810 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.860+0000 7ff2d3400640 1 --2- 172.21.15.18:0/1817842810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a049cd0 0x561a4a054030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.860+0000 7ff2d2a00640 1 -- 172.21.15.18:0/1817842810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a049cd0 msgr2=0x561a4a054030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.860+0000 7ff2d2a00640 1 --2- 172.21.15.18:0/1817842810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a049cd0 0x561a4a054030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.860+0000 7ff2d2a00640 1 -- 172.21.15.18:0/1817842810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a0493b0 msgr2=0x561a4a049790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.860+0000 7ff2d2a00640 1 --2- 172.21.15.18:0/1817842810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a0493b0 0x561a4a049790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.860+0000 7ff2d2a00640 1 -- 172.21.15.18:0/1817842810 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a49cc2210 con 0x561a4a054570 2024-09-12T02:51:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.860+0000 7ff2cbe00640 1 --2- 172.21.15.18:0/3279763010 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff2b80a2cf0 0x7ff2b80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.860+0000 7ff2d2a00640 1 --2- 172.21.15.18:0/1817842810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a054570 0x561a4a056960 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009bd0 tx=0x7ff2c0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2a082166524c62 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.860+0000 7ff2cbe00640 1 -- 172.21.15.18:0/3279763010 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7ff2c40cfb00 con 0x7ff2d4103ae0 2024-09-12T02:51:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.860+0000 7ff2d3e00640 1 --2- 172.21.15.18:0/3279763010 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff2b80a2cf0 0x7ff2b80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.861+0000 7ff2c8c00640 1 -- 172.21.15.18:0/1817842810 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0004230 con 0x561a4a054570 2024-09-12T02:51:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.861+0000 7ff2c8c00640 1 -- 172.21.15.18:0/1817842810 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2c0009e40 con 0x561a4a054570 2024-09-12T02:51:17.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.861+0000 7ff2c8c00640 1 -- 172.21.15.18:0/1817842810 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0004d50 con 0x561a4a054570 2024-09-12T02:51:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.861+0000 7ff2dd642740 1 -- 172.21.15.18:0/1817842810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a054570 msgr2=0x561a4a056960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.861+0000 7ff2d3e00640 1 --2- 172.21.15.18:0/3279763010 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff2b80a2cf0 0x7ff2b80a51b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc035000 tx=0x7ff2cc005ef0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.861+0000 7ff2dd642740 1 --2- 172.21.15.18:0/1817842810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a054570 0x561a4a056960 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009bd0 tx=0x7ff2c0011810 comp rx=0 tx=0).stop 2024-09-12T02:51:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.861+0000 7ff2dd642740 1 -- 172.21.15.18:0/1817842810 shutdown_connections 2024-09-12T02:51:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.861+0000 7ff2dd642740 1 --2- 172.21.15.18:0/1817842810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a054570 0x561a4a056960 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.861+0000 7ff2dd642740 1 --2- 172.21.15.18:0/1817842810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a049cd0 0x561a4a054030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.861+0000 7ff2dd642740 1 --2- 172.21.15.18:0/1817842810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a0493b0 0x561a4a049790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.862+0000 7ff2dd642740 1 -- 172.21.15.18:0/1817842810 >> 172.21.15.18:0/1817842810 conn(0x561a4a045920 msgr2=0x561a4a045d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.862+0000 7ff2dd642740 1 -- 172.21.15.18:0/1817842810 shutdown_connections 2024-09-12T02:51:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.862+0000 7ff2dd642740 1 -- 172.21.15.18:0/1817842810 wait complete. 2024-09-12T02:51:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.862+0000 7ff2dd642740 1 -- start start 2024-09-12T02:51:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.862+0000 7ff2dd642740 1 Processor -- start 2024-09-12T02:51:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.863+0000 7ff2dd642740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a0493b0 0x561a4a0514c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.863+0000 7ff2dd642740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a049cd0 0x561a4a051a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.863+0000 7ff2dd642740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a054570 0x561a4a051f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.863+0000 7ff2dd642740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561a4a0570e0 con 0x561a4a054570 2024-09-12T02:51:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.863+0000 7ff2dd642740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561a49f38090 con 0x561a4a0493b0 2024-09-12T02:51:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.863+0000 7ff2dd642740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561a4a057260 con 0x561a4a049cd0 2024-09-12T02:51:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.863+0000 7ff2dd642740 10 client.0 _ll_register_callbacks cb 0x561a49f8cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.863+0000 7ff2d3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a054570 0x561a4a051f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.863+0000 7ff2d3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a054570 0x561a4a051f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39460/0 (socket says 172.21.15.18:39460) 2024-09-12T02:51:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.863+0000 7ff2d3e00640 1 -- 172.21.15.18:0/3448005020 learned_addr learned my addr 172.21.15.18:0/3448005020 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.863+0000 7ff2d2a00640 1 --2- 172.21.15.18:0/3448005020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a049cd0 0x561a4a051a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.863+0000 7ff2d3400640 1 --2- 172.21.15.18:0/3448005020 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a0493b0 0x561a4a0514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.863+0000 7ff2d3e00640 1 -- 172.21.15.18:0/3448005020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a049cd0 msgr2=0x561a4a051a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.863+0000 7ff2d3e00640 1 --2- 172.21.15.18:0/3448005020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a049cd0 0x561a4a051a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.863+0000 7ff2d3e00640 1 -- 172.21.15.18:0/3448005020 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a0493b0 msgr2=0x561a4a0514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.863+0000 7ff2d3e00640 1 --2- 172.21.15.18:0/3448005020 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a0493b0 0x561a4a0514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.863+0000 7ff2d3e00640 1 -- 172.21.15.18:0/3448005020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a49d8e620 con 0x561a4a054570 2024-09-12T02:51:17.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.864+0000 7ff2d3e00640 1 --2- 172.21.15.18:0/3448005020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a054570 0x561a4a051f40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc030aa0 tx=0x7ff2cc02a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92498b056b6861b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.864+0000 7ff2bd600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:51:17.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.864+0000 7ff2bd600640 1 -- 172.21.15.18:0/3448005020 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc031440 con 0x561a4a054570 2024-09-12T02:51:17.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.864+0000 7ff2bd600640 1 -- 172.21.15.18:0/3448005020 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7ff2cc0315e0 con 0x561a4a054570 2024-09-12T02:51:17.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.864+0000 7ff2dd642740 1 -- 172.21.15.18:0/3448005020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561a49fbc830 con 0x561a4a054570 2024-09-12T02:51:17.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.864+0000 7ff2bd600640 1 -- 172.21.15.18:0/3448005020 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ff2cc05b050 con 0x561a4a054570 2024-09-12T02:51:17.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.864+0000 7ff2dd642740 10 client.15480 fetch_fsmap learned FSMap version 38 2024-09-12T02:51:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.864+0000 7ff2dd642740 1 -- 172.21.15.18:0/3448005020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561a4a062dd0 con 0x561a4a054570 2024-09-12T02:51:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.865+0000 7ff2bd600640 1 -- 172.21.15.18:0/3448005020 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x561a49fbc830 con 0x561a4a054570 2024-09-12T02:51:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.865+0000 7ff2bd600640 1 -- 172.21.15.18:0/3448005020 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8386+0+0 (secure 0 0 0) 0x7ff2cc047840 con 0x561a4a054570 2024-09-12T02:51:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.865+0000 7ff2dd642740 10 client.15480 fetch_fsmap finished waiting for FSMap version 38 2024-09-12T02:51:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.865+0000 7ff2dd642740 10 client.15480 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:51:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.865+0000 7ff2dd642740 20 client.15480 populate_metadata read hostname 'smithi018' 2024-09-12T02:51:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.865+0000 7ff2dd642740 1 --2- 172.21.15.18:0/3448005020 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561a4a064290 0x561a4a0666c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.865+0000 7ff2dd642740 4 client.15480 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:51:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.865+0000 7ff2dd642740 1 -- 172.21.15.18:0/3448005020 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a49fb6b80 con 0x561a4a064290 2024-09-12T02:51:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.865+0000 7ff2d3400640 1 --2- 172.21.15.18:0/3448005020 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561a4a064290 0x561a4a0666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.866+0000 7ff2d3400640 1 --2- 172.21.15.18:0/3448005020 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561a4a064290 0x561a4a0666c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2e3f771bd874f95 server_cookie=eea6ff6470fa077c in_seq=0 out_seq=0 2024-09-12T02:51:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.866+0000 7ff2bd600640 10 client.15480 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:51:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.867+0000 7ff2bd600640 1 -- 172.21.15.18:0/3448005020 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561a49fb6b80 con 0x561a4a064290 2024-09-12T02:51:17.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.867+0000 7ff2bd600640 10 client.15480 handle_command_reply: tid=0 2024-09-12T02:51:17.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.867+0000 7ff2dd642740 1 client.15480 shutdown 2024-09-12T02:51:17.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.867+0000 7ff2dd642740 1 -- 172.21.15.18:0/3448005020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a054570 msgr2=0x561a4a051f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.867+0000 7ff2dd642740 1 --2- 172.21.15.18:0/3448005020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a054570 0x561a4a051f40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc030aa0 tx=0x7ff2cc02a8f0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.867+0000 7ff2dd642740 1 -- 172.21.15.18:0/3448005020 shutdown_connections 2024-09-12T02:51:17.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.867+0000 7ff2dd642740 1 --2- 172.21.15.18:0/3448005020 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561a4a064290 0x561a4a0666c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.867+0000 7ff2dd642740 1 --2- 172.21.15.18:0/3448005020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a054570 0x561a4a051f40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.867+0000 7ff2dd642740 1 --2- 172.21.15.18:0/3448005020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a049cd0 0x561a4a051a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.867+0000 7ff2dd642740 1 --2- 172.21.15.18:0/3448005020 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a0493b0 0x561a4a0514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.867+0000 7ff2bd600640 0 client.15480 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:51:17.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.867+0000 7ff2dd642740 1 -- 172.21.15.18:0/3448005020 >> 172.21.15.18:0/3448005020 conn(0x561a4a045920 msgr2=0x561a4a04b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:17.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.867+0000 7ff2dd642740 1 -- 172.21.15.18:0/3448005020 shutdown_connections 2024-09-12T02:51:17.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.867+0000 7ff2dd642740 1 -- 172.21.15.18:0/3448005020 wait complete. 2024-09-12T02:51:17.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.867+0000 7ff2dd642740 20 client.15480 trim_cache size 0 max 16384 2024-09-12T02:51:17.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.882+0000 7ff2dd642740 1 Processor -- start 2024-09-12T02:51:17.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.882+0000 7ff2dd642740 1 -- start start 2024-09-12T02:51:17.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.883+0000 7ff2dd642740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a0493b0 0x561a4a053320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.883+0000 7ff2dd642740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a049cd0 0x561a4a06c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.883+0000 7ff2dd642740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a054570 0x561a4a06c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.883+0000 7ff2dd642740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d41b1070 con 0x561a4a049cd0 2024-09-12T02:51:17.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.883+0000 7ff2dd642740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d41b2c70 con 0x561a4a054570 2024-09-12T02:51:17.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.883+0000 7ff2dd642740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d41b1800 con 0x561a4a0493b0 2024-09-12T02:51:17.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.883+0000 7ff2d2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a049cd0 0x561a4a06c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.883+0000 7ff2d2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a049cd0 0x561a4a06c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39472/0 (socket says 172.21.15.18:39472) 2024-09-12T02:51:17.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.883+0000 7ff2d2a00640 1 -- 172.21.15.18:0/1574346375 learned_addr learned my addr 172.21.15.18:0/1574346375 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:17.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.883+0000 7ff2d3400640 1 --2- 172.21.15.18:0/1574346375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a0493b0 0x561a4a053320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.883+0000 7ff2d3e00640 1 --2- 172.21.15.18:0/1574346375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a054570 0x561a4a06c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.883+0000 7ff2d2a00640 1 -- 172.21.15.18:0/1574346375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a0493b0 msgr2=0x561a4a053320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.883+0000 7ff2d2a00640 1 --2- 172.21.15.18:0/1574346375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a0493b0 0x561a4a053320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.883+0000 7ff2d2a00640 1 -- 172.21.15.18:0/1574346375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a054570 msgr2=0x561a4a06c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.883+0000 7ff2d2a00640 1 --2- 172.21.15.18:0/1574346375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a054570 0x561a4a06c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.883+0000 7ff2d2a00640 1 -- 172.21.15.18:0/1574346375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a4a049b00 con 0x561a4a049cd0 2024-09-12T02:51:17.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.884+0000 7ff2d2a00640 1 --2- 172.21.15.18:0/1574346375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a049cd0 0x561a4a06c020 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00058c0 tx=0x7ff2c0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae93f0d82b175d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.884+0000 7ff2bfe00640 1 -- 172.21.15.18:0/1574346375 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c001e040 con 0x561a4a049cd0 2024-09-12T02:51:17.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.884+0000 7ff2bfe00640 1 -- 172.21.15.18:0/1574346375 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2c0004710 con 0x561a4a049cd0 2024-09-12T02:51:17.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.884+0000 7ff2bfe00640 1 -- 172.21.15.18:0/1574346375 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c00246e0 con 0x561a4a049cd0 2024-09-12T02:51:17.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.884+0000 7ff2dd642740 1 -- 172.21.15.18:0/1574346375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a049cd0 msgr2=0x561a4a06c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:17.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.884+0000 7ff2dd642740 1 --2- 172.21.15.18:0/1574346375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a049cd0 0x561a4a06c020 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00058c0 tx=0x7ff2c0009780 comp rx=0 tx=0).stop 2024-09-12T02:51:17.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.885+0000 7ff2dd642740 1 -- 172.21.15.18:0/1574346375 shutdown_connections 2024-09-12T02:51:17.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.885+0000 7ff2dd642740 1 --2- 172.21.15.18:0/1574346375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a054570 0x561a4a06c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.885+0000 7ff2dd642740 1 --2- 172.21.15.18:0/1574346375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a049cd0 0x561a4a06c020 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.885+0000 7ff2dd642740 1 --2- 172.21.15.18:0/1574346375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a0493b0 0x561a4a053320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.885+0000 7ff2dd642740 1 -- 172.21.15.18:0/1574346375 >> 172.21.15.18:0/1574346375 conn(0x561a4a045920 msgr2=0x561a4a052c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:17.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.885+0000 7ff2dd642740 1 -- 172.21.15.18:0/1574346375 shutdown_connections 2024-09-12T02:51:17.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.885+0000 7ff2dd642740 1 -- 172.21.15.18:0/1574346375 wait complete. 2024-09-12T02:51:17.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.885+0000 7ff2dd642740 1 -- start start 2024-09-12T02:51:17.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.885+0000 7ff2dd642740 1 Processor -- start 2024-09-12T02:51:17.891 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2dd642740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a0493b0 0x561a4a058300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2dd642740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a049cd0 0x561a4a058840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2dd642740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a054570 0x561a4a058d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2dd642740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d41b25a0 con 0x561a4a049cd0 2024-09-12T02:51:17.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2dd642740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d41b1ed0 con 0x561a4a054570 2024-09-12T02:51:17.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2dd642740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d41af050 con 0x561a4a0493b0 2024-09-12T02:51:17.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2dd642740 10 client.0 _ll_register_callbacks cb 0x7ff2cc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:17.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2d2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a049cd0 0x561a4a058840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2d2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a049cd0 0x561a4a058840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39488/0 (socket says 172.21.15.18:39488) 2024-09-12T02:51:17.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2d2a00640 1 -- 172.21.15.18:0/2899066627 learned_addr learned my addr 172.21.15.18:0/2899066627 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:17.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2d3400640 1 --2- 172.21.15.18:0/2899066627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a0493b0 0x561a4a058300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2d3e00640 1 --2- 172.21.15.18:0/2899066627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a054570 0x561a4a058d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2d2a00640 1 -- 172.21.15.18:0/2899066627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a0493b0 msgr2=0x561a4a058300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2d2a00640 1 --2- 172.21.15.18:0/2899066627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a0493b0 0x561a4a058300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2d2a00640 1 -- 172.21.15.18:0/2899066627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a054570 msgr2=0x561a4a058d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:17.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2d2a00640 1 --2- 172.21.15.18:0/2899066627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a054570 0x561a4a058d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:17.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2d2a00640 1 -- 172.21.15.18:0/2899066627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a4a0ce0a0 con 0x561a4a049cd0 2024-09-12T02:51:17.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.886+0000 7ff2d3400640 1 --2- 172.21.15.18:0/2899066627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a0493b0 0x561a4a058300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:17.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.887+0000 7ff2d2a00640 1 --2- 172.21.15.18:0/2899066627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a049cd0 0x561a4a058840 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009b40 tx=0x7ff2c0003a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b07fdbd874fc04 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:17.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.887+0000 7ff2bd600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:51:17.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.887+0000 7ff2bd600640 1 -- 172.21.15.18:0/2899066627 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c00040e0 con 0x561a4a049cd0 2024-09-12T02:51:17.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.887+0000 7ff2dd642740 1 -- 172.21.15.18:0/2899066627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2c0004710 con 0x561a4a049cd0 2024-09-12T02:51:17.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.887+0000 7ff2bd600640 1 -- 172.21.15.18:0/2899066627 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7ff2c0004280 con 0x561a4a049cd0 2024-09-12T02:51:17.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.887+0000 7ff2bd600640 1 -- 172.21.15.18:0/2899066627 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ff2c003c050 con 0x561a4a049cd0 2024-09-12T02:51:17.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.887+0000 7ff2dd642740 10 client.15486 fetch_fsmap learned FSMap version 38 2024-09-12T02:51:17.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.887+0000 7ff2dd642740 1 -- 172.21.15.18:0/2899066627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561a4a0cf370 con 0x561a4a049cd0 2024-09-12T02:51:17.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.887+0000 7ff2bd600640 1 -- 172.21.15.18:0/2899066627 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2c0004710 con 0x561a4a049cd0 2024-09-12T02:51:17.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.888+0000 7ff2bd600640 1 -- 172.21.15.18:0/2899066627 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8386+0+0 (secure 0 0 0) 0x7ff2c0018070 con 0x561a4a049cd0 2024-09-12T02:51:17.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.888+0000 7ff2dd642740 10 client.15486 fetch_fsmap finished waiting for FSMap version 38 2024-09-12T02:51:17.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.888+0000 7ff2dd642740 10 client.15486 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:51:17.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.888+0000 7ff2dd642740 20 client.15486 populate_metadata read hostname 'smithi018' 2024-09-12T02:51:17.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.888+0000 7ff2dd642740 1 --2- 172.21.15.18:0/2899066627 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561a4a0cf840 0x561a4a0d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:17.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.888+0000 7ff2dd642740 4 client.15486 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:51:17.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.888+0000 7ff2dd642740 1 -- 172.21.15.18:0/2899066627 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561a49f337c0 con 0x561a4a0cf840 2024-09-12T02:51:17.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.888+0000 7ff2d3400640 1 --2- 172.21.15.18:0/2899066627 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561a4a0cf840 0x561a4a0d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:17.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.888+0000 7ff2d3400640 1 --2- 172.21.15.18:0/2899066627 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561a4a0cf840 0x561a4a0d1c60 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8847796c77cdf632 server_cookie=8436d70647e7e26 in_seq=0 out_seq=0 2024-09-12T02:51:17.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:17.888+0000 7ff2bd600640 10 client.15486 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:51:18.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:18 smithi176 ceph-mon[35713]: pgmap v80: 129 pgs: 129 active+clean; 326 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.9 MiB/s wr, 142 op/s 2024-09-12T02:51:18.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:18 smithi062 ceph-mon[35527]: pgmap v80: 129 pgs: 129 active+clean; 326 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.9 MiB/s wr, 142 op/s 2024-09-12T02:51:18.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:18 smithi018 ceph-mon[30616]: pgmap v80: 129 pgs: 129 active+clean; 326 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.9 MiB/s wr, 142 op/s 2024-09-12T02:51:20.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:20 smithi176 ceph-mon[35713]: pgmap v81: 129 pgs: 129 active+clean; 330 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.2 MiB/s wr, 185 op/s 2024-09-12T02:51:20.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:20 smithi062 ceph-mon[35527]: pgmap v81: 129 pgs: 129 active+clean; 330 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.2 MiB/s wr, 185 op/s 2024-09-12T02:51:20.854 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:20 smithi018 ceph-mon[30616]: pgmap v81: 129 pgs: 129 active+clean; 330 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.2 MiB/s wr, 185 op/s 2024-09-12T02:51:22.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:22 smithi176 ceph-mon[35713]: pgmap v82: 129 pgs: 129 active+clean; 330 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 151 op/s 2024-09-12T02:51:22.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:22 smithi062 ceph-mon[35527]: pgmap v82: 129 pgs: 129 active+clean; 330 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 151 op/s 2024-09-12T02:51:22.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:22 smithi018 ceph-mon[30616]: pgmap v82: 129 pgs: 129 active+clean; 330 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 151 op/s 2024-09-12T02:51:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.926+0000 7ff2bd600640 1 -- 172.21.15.18:0/2899066627 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561a49f337c0 con 0x561a4a0cf840 2024-09-12T02:51:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.926+0000 7ff2bd600640 10 client.15486 handle_command_reply: tid=0 2024-09-12T02:51:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.926+0000 7ff2dd642740 1 client.15486 shutdown 2024-09-12T02:51:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.926+0000 7ff2dd642740 1 -- 172.21.15.18:0/2899066627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a049cd0 msgr2=0x561a4a058840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.926+0000 7ff2dd642740 1 --2- 172.21.15.18:0/2899066627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a049cd0 0x561a4a058840 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009b40 tx=0x7ff2c0003a40 comp rx=0 tx=0).stop 2024-09-12T02:51:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.926+0000 7ff2dd642740 1 -- 172.21.15.18:0/2899066627 shutdown_connections 2024-09-12T02:51:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.926+0000 7ff2dd642740 1 --2- 172.21.15.18:0/2899066627 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561a4a0cf840 0x561a4a0d1c60 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.926+0000 7ff2dd642740 1 --2- 172.21.15.18:0/2899066627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561a4a054570 0x561a4a058d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.926+0000 7ff2dd642740 1 --2- 172.21.15.18:0/2899066627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a4a049cd0 0x561a4a058840 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.926+0000 7ff2dd642740 1 --2- 172.21.15.18:0/2899066627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561a4a0493b0 0x561a4a058300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.926+0000 7ff2bd600640 0 client.15486 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:51:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.926+0000 7ff2dd642740 1 -- 172.21.15.18:0/2899066627 >> 172.21.15.18:0/2899066627 conn(0x561a4a045920 msgr2=0x561a4a04b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.926+0000 7ff2dd642740 1 -- 172.21.15.18:0/2899066627 shutdown_connections 2024-09-12T02:51:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.926+0000 7ff2dd642740 1 -- 172.21.15.18:0/2899066627 wait complete. 2024-09-12T02:51:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.926+0000 7ff2dd642740 20 client.15486 trim_cache size 0 max 16384 2024-09-12T02:51:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:51:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:51:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:51:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:51:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.927+0000 7ff2d9000640 1 -- 172.21.15.18:0/3279763010 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff2b80a2cf0 msgr2=0x7ff2b80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.927+0000 7ff2d9000640 1 --2- 172.21.15.18:0/3279763010 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff2b80a2cf0 0x7ff2b80a51b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc035000 tx=0x7ff2cc005ef0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.927+0000 7ff2d9000640 1 -- 172.21.15.18:0/3279763010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2d4103ae0 msgr2=0x7ff2d419a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.927+0000 7ff2d9000640 1 --2- 172.21.15.18:0/3279763010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2d4103ae0 0x7ff2d419a420 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400e9f0 tx=0x7ff2c400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.927+0000 7ff2d9000640 1 -- 172.21.15.18:0/3279763010 shutdown_connections 2024-09-12T02:51:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.927+0000 7ff2d9000640 1 --2- 172.21.15.18:0/3279763010 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff2b80a2cf0 0x7ff2b80a51b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.927+0000 7ff2d9000640 1 --2- 172.21.15.18:0/3279763010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2d4109b80 0x7ff2d419ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.927+0000 7ff2d9000640 1 --2- 172.21.15.18:0/3279763010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2d4104480 0x7ff2d419a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.927+0000 7ff2d9000640 1 --2- 172.21.15.18:0/3279763010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2d4103ae0 0x7ff2d419a420 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.927+0000 7ff2d9000640 1 -- 172.21.15.18:0/3279763010 >> 172.21.15.18:0/3279763010 conn(0x7ff2d40ff7c0 msgr2=0x7ff2d4100000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.927+0000 7ff2d9000640 1 -- 172.21.15.18:0/3279763010 shutdown_connections 2024-09-12T02:51:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:22.927+0000 7ff2d9000640 1 -- 172.21.15.18:0/3279763010 wait complete. 2024-09-12T02:51:24.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:24 smithi176 ceph-mon[35713]: pgmap v83: 129 pgs: 129 active+clean; 330 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 95 op/s 2024-09-12T02:51:24.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:24 smithi062 ceph-mon[35527]: pgmap v83: 129 pgs: 129 active+clean; 330 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 95 op/s 2024-09-12T02:51:24.808 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:24 smithi018 ceph-mon[30616]: pgmap v83: 129 pgs: 129 active+clean; 330 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 95 op/s 2024-09-12T02:51:24.862 INFO:tasks.workunit.client.0.smithi018.stdout: 136 203035 1257 130183 987 31099 36 2024-09-12T02:51:26.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:26 smithi176 ceph-mon[35713]: pgmap v84: 129 pgs: 129 active+clean; 337 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 135 op/s 2024-09-12T02:51:26.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:26 smithi062 ceph-mon[35527]: pgmap v84: 129 pgs: 129 active+clean; 337 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 135 op/s 2024-09-12T02:51:26.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:26 smithi018 ceph-mon[30616]: pgmap v84: 129 pgs: 129 active+clean; 337 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 135 op/s 2024-09-12T02:51:28.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:28 smithi176 ceph-mon[35713]: pgmap v85: 129 pgs: 129 active+clean; 337 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 1.1 MiB/s wr, 98 op/s 2024-09-12T02:51:28.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:28 smithi062 ceph-mon[35527]: pgmap v85: 129 pgs: 129 active+clean; 337 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 1.1 MiB/s wr, 98 op/s 2024-09-12T02:51:28.890 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:28 smithi018 ceph-mon[30616]: pgmap v85: 129 pgs: 129 active+clean; 337 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 1.1 MiB/s wr, 98 op/s 2024-09-12T02:51:30.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:30 smithi176 ceph-mon[35713]: pgmap v86: 129 pgs: 129 active+clean; 348 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 131 op/s 2024-09-12T02:51:30.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:30 smithi062 ceph-mon[35527]: pgmap v86: 129 pgs: 129 active+clean; 348 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 131 op/s 2024-09-12T02:51:30.856 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:30 smithi018 ceph-mon[30616]: pgmap v86: 129 pgs: 129 active+clean; 348 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 131 op/s 2024-09-12T02:51:32.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:32 smithi176 ceph-mon[35713]: pgmap v87: 129 pgs: 129 active+clean; 348 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 94 op/s 2024-09-12T02:51:32.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:32 smithi062 ceph-mon[35527]: pgmap v87: 129 pgs: 129 active+clean; 348 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 94 op/s 2024-09-12T02:51:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:32 smithi018 ceph-mon[30616]: pgmap v87: 129 pgs: 129 active+clean; 348 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 94 op/s 2024-09-12T02:51:34.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:34 smithi176 ceph-mon[35713]: pgmap v88: 129 pgs: 129 active+clean; 348 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 78 op/s 2024-09-12T02:51:34.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:34 smithi062 ceph-mon[35527]: pgmap v88: 129 pgs: 129 active+clean; 348 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 78 op/s 2024-09-12T02:51:34.860 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:34 smithi018 ceph-mon[30616]: pgmap v88: 129 pgs: 129 active+clean; 348 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 78 op/s 2024-09-12T02:51:34.866 INFO:tasks.workunit.client.0.smithi018.stdout: 163 460574 1548 291507 1415 54411 57 2024-09-12T02:51:36.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:36 smithi062 ceph-mon[35527]: pgmap v89: 129 pgs: 129 active+clean; 388 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.3 MiB/s wr, 210 op/s 2024-09-12T02:51:36.871 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:36 smithi018 ceph-mon[30616]: pgmap v89: 129 pgs: 129 active+clean; 388 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.3 MiB/s wr, 210 op/s 2024-09-12T02:51:36.981 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:36 smithi176 ceph-mon[35713]: pgmap v89: 129 pgs: 129 active+clean; 388 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.3 MiB/s wr, 210 op/s 2024-09-12T02:51:37.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.397+0000 7fc165a00640 1 -- 172.21.15.18:0/1481919377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1601091f0 msgr2=0x7fc160110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:37.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.397+0000 7fc165a00640 1 --2- 172.21.15.18:0/1481919377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1601091f0 0x7fc160110250 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009860 tx=0x7fc14c02a380 comp rx=0 tx=0).stop 2024-09-12T02:51:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.435+0000 7fc165a00640 1 -- 172.21.15.18:0/1481919377 shutdown_connections 2024-09-12T02:51:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.435+0000 7fc165a00640 1 --2- 172.21.15.18:0/1481919377 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc16011b140 0x7fc16011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.435+0000 7fc165a00640 1 --2- 172.21.15.18:0/1481919377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1601095d0 0x7fc160109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.435+0000 7fc165a00640 1 --2- 172.21.15.18:0/1481919377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1601091f0 0x7fc160110250 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.435+0000 7fc165a00640 1 -- 172.21.15.18:0/1481919377 >> 172.21.15.18:0/1481919377 conn(0x7fc16006cbf0 msgr2=0x7fc16006d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.436+0000 7fc165a00640 1 -- 172.21.15.18:0/1481919377 shutdown_connections 2024-09-12T02:51:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.436+0000 7fc165a00640 1 -- 172.21.15.18:0/1481919377 wait complete. 2024-09-12T02:51:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.437+0000 7fc165a00640 1 Processor -- start 2024-09-12T02:51:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.464+0000 7fc165a00640 1 -- start start 2024-09-12T02:51:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.464+0000 7fc165a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1601091f0 0x7fc160118720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.464+0000 7fc165a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1601095d0 0x7fc1601117a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.464+0000 7fc165a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc16011b140 0x7fc160111ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.464+0000 7fc165a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc160120b10 con 0x7fc1601095d0 2024-09-12T02:51:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.464+0000 7fc165a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc160120990 con 0x7fc16011b140 2024-09-12T02:51:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.464+0000 7fc165a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc160120c90 con 0x7fc1601091f0 2024-09-12T02:51:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.465+0000 7fc165000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc16011b140 0x7fc160111ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.465+0000 7fc165000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc16011b140 0x7fc160111ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:35244/0 (socket says 172.21.15.18:35244) 2024-09-12T02:51:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.465+0000 7fc165000640 1 -- 172.21.15.18:0/3895400632 learned_addr learned my addr 172.21.15.18:0/3895400632 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.466+0000 7fc165000640 1 -- 172.21.15.18:0/3895400632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1601091f0 msgr2=0x7fc160118720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:51:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.466+0000 7fc165000640 1 --2- 172.21.15.18:0/3895400632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1601091f0 0x7fc160118720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.466+0000 7fc165000640 1 -- 172.21.15.18:0/3895400632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1601095d0 msgr2=0x7fc1601117a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.466+0000 7fc165000640 1 --2- 172.21.15.18:0/3895400632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1601095d0 0x7fc1601117a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.466+0000 7fc165000640 1 -- 172.21.15.18:0/3895400632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1601122d0 con 0x7fc16011b140 2024-09-12T02:51:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.468+0000 7fc165000640 1 --2- 172.21.15.18:0/3895400632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc16011b140 0x7fc160111ce0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc158009fd0 tx=0x7fc15800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:37.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.472+0000 7fc15cc00640 1 -- 172.21.15.18:0/3895400632 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158004b20 con 0x7fc16011b140 2024-09-12T02:51:37.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.472+0000 7fc15cc00640 1 -- 172.21.15.18:0/3895400632 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc158003e50 con 0x7fc16011b140 2024-09-12T02:51:37.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.472+0000 7fc15cc00640 1 -- 172.21.15.18:0/3895400632 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15800b630 con 0x7fc16011b140 2024-09-12T02:51:37.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.472+0000 7fc165a00640 1 -- 172.21.15.18:0/3895400632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1601125c0 con 0x7fc16011b140 2024-09-12T02:51:37.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.472+0000 7fc165a00640 1 -- 172.21.15.18:0/3895400632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc160116570 con 0x7fc16011b140 2024-09-12T02:51:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.516+0000 7fc169e5b740 1 Processor -- start 2024-09-12T02:51:37.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.547+0000 7fc15cc00640 1 -- 172.21.15.18:0/3895400632 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fc15801d020 con 0x7fc16011b140 2024-09-12T02:51:37.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.553+0000 7fc15cc00640 1 --2- 172.21.15.18:0/3895400632 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc1440a2f00 0x7fc1440a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.564+0000 7fc169e5b740 1 -- start start 2024-09-12T02:51:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.565+0000 7fc169e5b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961d3b0 0x55e34961d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.565+0000 7fc169e5b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e34961dcd0 0x55e349628030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.565+0000 7fc169e5b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e349628570 0x55e34962a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.565+0000 7fc169e5b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e349583100 con 0x55e34961d3b0 2024-09-12T02:51:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.565+0000 7fc169e5b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e34952b1b0 con 0x55e34961dcd0 2024-09-12T02:51:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.565+0000 7fc169e5b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e34957f0c0 con 0x55e349628570 2024-09-12T02:51:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.566+0000 7fc15fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961d3b0 0x55e34961d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:37.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.577+0000 7fc15fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961d3b0 0x55e34961d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51104/0 (socket says 172.21.15.18:51104) 2024-09-12T02:51:37.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.577+0000 7fc15fe00640 1 -- 172.21.15.18:0/62041650 learned_addr learned my addr 172.21.15.18:0/62041650 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:37.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.578+0000 7fc15fe00640 1 -- 172.21.15.18:0/62041650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e349628570 msgr2=0x55e34962a960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:51:37.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.578+0000 7fc15fe00640 1 --2- 172.21.15.18:0/62041650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e349628570 0x55e34962a960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.578+0000 7fc15fe00640 1 -- 172.21.15.18:0/62041650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e34961dcd0 msgr2=0x55e349628030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:51:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.578+0000 7fc15fe00640 1 --2- 172.21.15.18:0/62041650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e34961dcd0 0x55e349628030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.578+0000 7fc15fe00640 1 -- 172.21.15.18:0/62041650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e349296210 con 0x55e34961d3b0 2024-09-12T02:51:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.579+0000 7fc15fe00640 1 --2- 172.21.15.18:0/62041650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961d3b0 0x55e34961d790 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009980 tx=0x7fc14c0304e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4976dae88e6192a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.592+0000 7fc15cc00640 1 -- 172.21.15.18:0/3895400632 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fc1580cf850 con 0x7fc16011b140 2024-09-12T02:51:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.597+0000 7fc15f400640 1 --2- 172.21.15.18:0/3895400632 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc1440a2f00 0x7fc1440a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.601+0000 7fc155600640 1 -- 172.21.15.18:0/62041650 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c037040 con 0x55e34961d3b0 2024-09-12T02:51:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.601+0000 7fc155600640 1 -- 172.21.15.18:0/62041650 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc14c040070 con 0x55e34961d3b0 2024-09-12T02:51:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.601+0000 7fc155600640 1 -- 172.21.15.18:0/62041650 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c003850 con 0x55e34961d3b0 2024-09-12T02:51:37.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.634+0000 7fc15f400640 1 --2- 172.21.15.18:0/3895400632 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc1440a2f00 0x7fc1440a53c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc150005d00 tx=0x7fc150005850 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:37.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.637+0000 7fc169e5b740 1 -- 172.21.15.18:0/62041650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961d3b0 msgr2=0x55e34961d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:37.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.637+0000 7fc169e5b740 1 --2- 172.21.15.18:0/62041650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961d3b0 0x55e34961d790 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009980 tx=0x7fc14c0304e0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.661+0000 7fc169e5b740 1 -- 172.21.15.18:0/62041650 shutdown_connections 2024-09-12T02:51:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.661+0000 7fc169e5b740 1 --2- 172.21.15.18:0/62041650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e349628570 0x55e34962a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.661+0000 7fc169e5b740 1 --2- 172.21.15.18:0/62041650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e34961dcd0 0x55e349628030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.661+0000 7fc169e5b740 1 --2- 172.21.15.18:0/62041650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961d3b0 0x55e34961d790 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.661+0000 7fc169e5b740 1 -- 172.21.15.18:0/62041650 >> 172.21.15.18:0/62041650 conn(0x55e349619920 msgr2=0x55e349619d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:37.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.694+0000 7fc169e5b740 1 -- 172.21.15.18:0/62041650 shutdown_connections 2024-09-12T02:51:37.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.694+0000 7fc169e5b740 1 -- 172.21.15.18:0/62041650 wait complete. 2024-09-12T02:51:37.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.695+0000 7fc169e5b740 1 -- start start 2024-09-12T02:51:37.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.695+0000 7fc169e5b740 1 Processor -- start 2024-09-12T02:51:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.719+0000 7fc169e5b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961d3b0 0x55e349625550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.719+0000 7fc169e5b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e34961dcd0 0x55e349625a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.719+0000 7fc169e5b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e349628570 0x55e349625fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.719+0000 7fc169e5b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e34962b0b0 con 0x55e34961d3b0 2024-09-12T02:51:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.719+0000 7fc169e5b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e34950c090 con 0x55e349628570 2024-09-12T02:51:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.719+0000 7fc169e5b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e34962b230 con 0x55e34961dcd0 2024-09-12T02:51:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.720+0000 7fc169e5b740 10 client.0 _ll_register_callbacks cb 0x55e349560f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:37.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.721+0000 7fc15fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961d3b0 0x55e349625550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:37.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.721+0000 7fc15fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961d3b0 0x55e349625550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51106/0 (socket says 172.21.15.18:51106) 2024-09-12T02:51:37.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.721+0000 7fc15fe00640 1 -- 172.21.15.18:0/3063494608 learned_addr learned my addr 172.21.15.18:0/3063494608 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:37.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.723+0000 7fc15fe00640 1 -- 172.21.15.18:0/3063494608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e34961dcd0 msgr2=0x55e349625a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:51:37.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.723+0000 7fc15fe00640 1 --2- 172.21.15.18:0/3063494608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e34961dcd0 0x55e349625a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.723+0000 7fc15fe00640 1 -- 172.21.15.18:0/3063494608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e349628570 msgr2=0x55e349625fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:51:37.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.723+0000 7fc15fe00640 1 --2- 172.21.15.18:0/3063494608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e349628570 0x55e349625fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.723+0000 7fc15fe00640 1 -- 172.21.15.18:0/3063494608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e349362620 con 0x55e34961d3b0 2024-09-12T02:51:37.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.724+0000 7fc15fe00640 1 --2- 172.21.15.18:0/3063494608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961d3b0 0x55e349625550 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc14c03d040 tx=0x7fc14c005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2dba7359a117a9e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:37.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.740+0000 7fc14a000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:51:37.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.740+0000 7fc14a000640 1 -- 172.21.15.18:0/3063494608 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c04b020 con 0x55e34961d3b0 2024-09-12T02:51:37.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.740+0000 7fc14a000640 1 -- 172.21.15.18:0/3063494608 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fc14c032640 con 0x55e34961d3b0 2024-09-12T02:51:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.742+0000 7fc169e5b740 1 -- 172.21.15.18:0/3063494608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc14c040070 con 0x55e34961d3b0 2024-09-12T02:51:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.799+0000 7fc14a000640 1 -- 172.21.15.18:0/3063494608 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc14c037040 con 0x55e34961d3b0 2024-09-12T02:51:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.823+0000 7fc169e5b740 10 client.15495 fetch_fsmap learned FSMap version 38 2024-09-12T02:51:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.823+0000 7fc169e5b740 1 -- 172.21.15.18:0/3063494608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55e349636ee0 con 0x55e34961d3b0 2024-09-12T02:51:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.827+0000 7fc14a000640 1 -- 172.21.15.18:0/3063494608 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc14c040070 con 0x55e34961d3b0 2024-09-12T02:51:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.827+0000 7fc14a000640 1 -- 172.21.15.18:0/3063494608 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8386+0+0 (secure 0 0 0) 0x7fc14c03a070 con 0x55e34961d3b0 2024-09-12T02:51:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.839+0000 7fc169e5b740 10 client.15495 fetch_fsmap finished waiting for FSMap version 38 2024-09-12T02:51:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.839+0000 7fc169e5b740 10 client.15495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:51:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.839+0000 7fc169e5b740 20 client.15495 populate_metadata read hostname 'smithi018' 2024-09-12T02:51:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.839+0000 7fc169e5b740 1 --2- 172.21.15.18:0/3063494608 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e349638230 0x55e34963a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:37.846 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.839+0000 7fc169e5b740 4 client.15495 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:51:37.846 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.839+0000 7fc169e5b740 1 -- 172.21.15.18:0/3063494608 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e349590830 con 0x55e349638230 2024-09-12T02:51:37.846 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.843+0000 7fc15f400640 1 --2- 172.21.15.18:0/3063494608 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e349638230 0x55e34963a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:37.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.852+0000 7fc15f400640 1 --2- 172.21.15.18:0/3063494608 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e349638230 0x55e34963a620 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=908fdef368af6cb7 server_cookie=b0b51e6742ec82de in_seq=0 out_seq=0 2024-09-12T02:51:37.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.852+0000 7fc14a000640 10 client.15495 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:51:37.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.856+0000 7fc14a000640 1 -- 172.21.15.18:0/3063494608 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e349590830 con 0x55e349638230 2024-09-12T02:51:37.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.856+0000 7fc14a000640 10 client.15495 handle_command_reply: tid=0 2024-09-12T02:51:37.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.857+0000 7fc169e5b740 1 client.15495 shutdown 2024-09-12T02:51:37.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.879+0000 7fc169e5b740 1 -- 172.21.15.18:0/3063494608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961d3b0 msgr2=0x55e349625550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:37.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.879+0000 7fc169e5b740 1 --2- 172.21.15.18:0/3063494608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961d3b0 0x55e349625550 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc14c03d040 tx=0x7fc14c005fa0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.888+0000 7fc169e5b740 1 -- 172.21.15.18:0/3063494608 shutdown_connections 2024-09-12T02:51:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.888+0000 7fc169e5b740 1 --2- 172.21.15.18:0/3063494608 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e349638230 0x55e34963a620 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.888+0000 7fc169e5b740 1 --2- 172.21.15.18:0/3063494608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e349628570 0x55e349625fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.888+0000 7fc169e5b740 1 --2- 172.21.15.18:0/3063494608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e34961dcd0 0x55e349625a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.888+0000 7fc169e5b740 1 --2- 172.21.15.18:0/3063494608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961d3b0 0x55e349625550 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.888+0000 7fc169e5b740 1 -- 172.21.15.18:0/3063494608 >> 172.21.15.18:0/3063494608 conn(0x55e349619920 msgr2=0x55e34961f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.888+0000 7fc14a000640 0 client.15495 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:51:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.912+0000 7fc169e5b740 1 -- 172.21.15.18:0/3063494608 shutdown_connections 2024-09-12T02:51:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.917+0000 7fc169e5b740 1 -- 172.21.15.18:0/3063494608 wait complete. 2024-09-12T02:51:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:37.917+0000 7fc169e5b740 20 client.15495 trim_cache size 0 max 16384 2024-09-12T02:51:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.568+0000 7fc169e5b740 1 Processor -- start 2024-09-12T02:51:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.584+0000 7fc169e5b740 1 -- start start 2024-09-12T02:51:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.584+0000 7fc169e5b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e34961d3b0 0x55e349623e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.584+0000 7fc169e5b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961dcd0 0x55e349625e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.584+0000 7fc169e5b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e349628570 0x55e34963d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.584+0000 7fc169e5b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc1601c6660 con 0x55e34961dcd0 2024-09-12T02:51:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.584+0000 7fc169e5b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc1601c8260 con 0x55e349628570 2024-09-12T02:51:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.584+0000 7fc169e5b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc1601c6df0 con 0x55e34961d3b0 2024-09-12T02:51:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.585+0000 7fc15f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961dcd0 0x55e349625e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.585+0000 7fc15f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961dcd0 0x55e349625e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51120/0 (socket says 172.21.15.18:51120) 2024-09-12T02:51:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.585+0000 7fc15f400640 1 -- 172.21.15.18:0/3873124008 learned_addr learned my addr 172.21.15.18:0/3873124008 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.586+0000 7fc15f400640 1 -- 172.21.15.18:0/3873124008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e34961d3b0 msgr2=0x55e349623e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:51:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.586+0000 7fc15f400640 1 --2- 172.21.15.18:0/3873124008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e34961d3b0 0x55e349623e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.586+0000 7fc15f400640 1 -- 172.21.15.18:0/3873124008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e349628570 msgr2=0x55e34963d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.586+0000 7fc15f400640 1 --2- 172.21.15.18:0/3873124008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e349628570 0x55e34963d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.586+0000 7fc15f400640 1 -- 172.21.15.18:0/3873124008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3496244e0 con 0x55e34961dcd0 2024-09-12T02:51:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.597+0000 7fc15f400640 1 --2- 172.21.15.18:0/3873124008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961dcd0 0x55e349625e00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc15000b2f0 tx=0x7fc150010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b5bd911e8b5953 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.600+0000 7fc154c00640 1 -- 172.21.15.18:0/3873124008 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15001e460 con 0x55e34961dcd0 2024-09-12T02:51:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.600+0000 7fc154c00640 1 -- 172.21.15.18:0/3873124008 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc15002c070 con 0x55e34961dcd0 2024-09-12T02:51:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.600+0000 7fc154c00640 1 -- 172.21.15.18:0/3873124008 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150027990 con 0x55e34961dcd0 2024-09-12T02:51:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.604+0000 7fc169e5b740 1 -- 172.21.15.18:0/3873124008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961dcd0 msgr2=0x55e349625e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.605+0000 7fc169e5b740 1 --2- 172.21.15.18:0/3873124008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961dcd0 0x55e349625e00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc15000b2f0 tx=0x7fc150010000 comp rx=0 tx=0).stop 2024-09-12T02:51:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.621+0000 7fc169e5b740 1 -- 172.21.15.18:0/3873124008 shutdown_connections 2024-09-12T02:51:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.621+0000 7fc169e5b740 1 --2- 172.21.15.18:0/3873124008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e349628570 0x55e34963d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.621+0000 7fc169e5b740 1 --2- 172.21.15.18:0/3873124008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e34961dcd0 0x55e349625e00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.621+0000 7fc169e5b740 1 --2- 172.21.15.18:0/3873124008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e34961d3b0 0x55e349623e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.621+0000 7fc169e5b740 1 -- 172.21.15.18:0/3873124008 >> 172.21.15.18:0/3873124008 conn(0x55e349619920 msgr2=0x55e3496274c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:38.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.636+0000 7fc169e5b740 1 -- 172.21.15.18:0/3873124008 shutdown_connections 2024-09-12T02:51:38.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.636+0000 7fc169e5b740 1 -- 172.21.15.18:0/3873124008 wait complete. 2024-09-12T02:51:38.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.636+0000 7fc169e5b740 1 -- start start 2024-09-12T02:51:38.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.637+0000 7fc169e5b740 1 Processor -- start 2024-09-12T02:51:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.644+0000 7fc169e5b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e34961d3b0 0x55e34963b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.644+0000 7fc169e5b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e34961dcd0 0x55e34963b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.644+0000 7fc169e5b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e349628570 0x55e34963bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.644+0000 7fc169e5b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc1601c7b90 con 0x55e349628570 2024-09-12T02:51:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.644+0000 7fc169e5b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc1601c74c0 con 0x55e34961d3b0 2024-09-12T02:51:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.644+0000 7fc169e5b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc1601c4640 con 0x55e34961dcd0 2024-09-12T02:51:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.644+0000 7fc169e5b740 10 client.0 _ll_register_callbacks cb 0x7fc158009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.645+0000 7fc165000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e349628570 0x55e34963bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.646+0000 7fc165000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e349628570 0x55e34963bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51134/0 (socket says 172.21.15.18:51134) 2024-09-12T02:51:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.646+0000 7fc165000640 1 -- 172.21.15.18:0/3229174502 learned_addr learned my addr 172.21.15.18:0/3229174502 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.648+0000 7fc165000640 1 -- 172.21.15.18:0/3229174502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e34961dcd0 msgr2=0x55e34963b570 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:51:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.648+0000 7fc165000640 1 --2- 172.21.15.18:0/3229174502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e34961dcd0 0x55e34963b570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.648+0000 7fc165000640 1 -- 172.21.15.18:0/3229174502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e34961d3b0 msgr2=0x55e34963b030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:51:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.648+0000 7fc165000640 1 --2- 172.21.15.18:0/3229174502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e34961d3b0 0x55e34963b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.648+0000 7fc165000640 1 -- 172.21.15.18:0/3229174502 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3496a1b70 con 0x55e349628570 2024-09-12T02:51:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.649+0000 7fc165000640 1 --2- 172.21.15.18:0/3229174502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e349628570 0x55e34963bab0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc158009fa0 tx=0x7fc15809b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1759ac69a35a7cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:38.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.662+0000 7fc14a000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:51:38.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.662+0000 7fc14a000640 1 -- 172.21.15.18:0/3229174502 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15801a040 con 0x55e349628570 2024-09-12T02:51:38.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.662+0000 7fc14a000640 1 -- 172.21.15.18:0/3229174502 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fc1580a4130 con 0x55e349628570 2024-09-12T02:51:38.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.674+0000 7fc169e5b740 1 -- 172.21.15.18:0/3229174502 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc15002c070 con 0x55e349628570 2024-09-12T02:51:38.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.674+0000 7fc14a000640 1 -- 172.21.15.18:0/3229174502 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc1580cd000 con 0x55e349628570 2024-09-12T02:51:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.677+0000 7fc169e5b740 10 client.15501 fetch_fsmap learned FSMap version 38 2024-09-12T02:51:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.677+0000 7fc169e5b740 1 -- 172.21.15.18:0/3229174502 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55e3496a2ec0 con 0x55e349628570 2024-09-12T02:51:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.686+0000 7fc14a000640 1 -- 172.21.15.18:0/3229174502 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc15002c070 con 0x55e349628570 2024-09-12T02:51:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.686+0000 7fc14a000640 1 -- 172.21.15.18:0/3229174502 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8386+0+0 (secure 0 0 0) 0x7fc15800b040 con 0x55e349628570 2024-09-12T02:51:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.686+0000 7fc169e5b740 10 client.15501 fetch_fsmap finished waiting for FSMap version 38 2024-09-12T02:51:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.686+0000 7fc169e5b740 10 client.15501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:51:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.686+0000 7fc169e5b740 20 client.15501 populate_metadata read hostname 'smithi018' 2024-09-12T02:51:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.686+0000 7fc169e5b740 1 --2- 172.21.15.18:0/3229174502 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e3496a3610 0x55e3496a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.686+0000 7fc169e5b740 4 client.15501 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:51:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.686+0000 7fc169e5b740 1 -- 172.21.15.18:0/3229174502 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e34958ab80 con 0x55e3496a3610 2024-09-12T02:51:38.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.692+0000 7fc15fe00640 1 --2- 172.21.15.18:0/3229174502 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e3496a3610 0x55e3496a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:38.712 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.704+0000 7fc15fe00640 1 --2- 172.21.15.18:0/3229174502 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e3496a3610 0x55e3496a5a30 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91cb46b4a9f32ec4 server_cookie=8e54eb7d190f66ac in_seq=0 out_seq=0 2024-09-12T02:51:38.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:38.712+0000 7fc14a000640 10 client.15501 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:51:38.854 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:38 smithi018 ceph-mon[30616]: pgmap v90: 129 pgs: 129 active+clean; 388 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 171 op/s 2024-09-12T02:51:38.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:38 smithi176 ceph-mon[35713]: pgmap v90: 129 pgs: 129 active+clean; 388 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 171 op/s 2024-09-12T02:51:39.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:38 smithi062 ceph-mon[35527]: pgmap v90: 129 pgs: 129 active+clean; 388 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 171 op/s 2024-09-12T02:51:40.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:40 smithi018 ceph-mon[30616]: pgmap v91: 129 pgs: 129 active+clean; 491 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 521 op/s 2024-09-12T02:51:40.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:40 smithi176 ceph-mon[35713]: pgmap v91: 129 pgs: 129 active+clean; 491 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 521 op/s 2024-09-12T02:51:41.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:40 smithi062 ceph-mon[35527]: pgmap v91: 129 pgs: 129 active+clean; 491 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 521 op/s 2024-09-12T02:51:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.543+0000 7fc14a000640 1 -- 172.21.15.18:0/3229174502 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e34958ab80 con 0x55e3496a3610 2024-09-12T02:51:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.543+0000 7fc14a000640 10 client.15501 handle_command_reply: tid=0 2024-09-12T02:51:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.544+0000 7fc169e5b740 1 client.15501 shutdown 2024-09-12T02:51:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.544+0000 7fc169e5b740 1 -- 172.21.15.18:0/3229174502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e349628570 msgr2=0x55e34963bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.544+0000 7fc169e5b740 1 --2- 172.21.15.18:0/3229174502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e349628570 0x55e34963bab0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc158009fa0 tx=0x7fc15809b550 comp rx=0 tx=0).stop 2024-09-12T02:51:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.544+0000 7fc169e5b740 1 -- 172.21.15.18:0/3229174502 shutdown_connections 2024-09-12T02:51:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.544+0000 7fc169e5b740 1 --2- 172.21.15.18:0/3229174502 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e3496a3610 0x55e3496a5a30 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.544+0000 7fc169e5b740 1 --2- 172.21.15.18:0/3229174502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e349628570 0x55e34963bab0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.544+0000 7fc169e5b740 1 --2- 172.21.15.18:0/3229174502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e34961dcd0 0x55e34963b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.544+0000 7fc169e5b740 1 --2- 172.21.15.18:0/3229174502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e34961d3b0 0x55e34963b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.544+0000 7fc169e5b740 1 -- 172.21.15.18:0/3229174502 >> 172.21.15.18:0/3229174502 conn(0x55e349619920 msgr2=0x55e349633dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.544+0000 7fc14a000640 0 client.15501 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:51:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.544+0000 7fc169e5b740 1 -- 172.21.15.18:0/3229174502 shutdown_connections 2024-09-12T02:51:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.544+0000 7fc169e5b740 1 -- 172.21.15.18:0/3229174502 wait complete. 2024-09-12T02:51:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.545+0000 7fc169e5b740 20 client.15501 trim_cache size 0 max 16384 2024-09-12T02:51:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:51:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:51:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:51:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:51:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.545+0000 7fc165a00640 1 -- 172.21.15.18:0/3895400632 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc1440a2f00 msgr2=0x7fc1440a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.545+0000 7fc165a00640 1 --2- 172.21.15.18:0/3895400632 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc1440a2f00 0x7fc1440a53c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc150005d00 tx=0x7fc150005850 comp rx=0 tx=0).stop 2024-09-12T02:51:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.545+0000 7fc165a00640 1 -- 172.21.15.18:0/3895400632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc16011b140 msgr2=0x7fc160111ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.545+0000 7fc165a00640 1 --2- 172.21.15.18:0/3895400632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc16011b140 0x7fc160111ce0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc158009fd0 tx=0x7fc15800c800 comp rx=0 tx=0).stop 2024-09-12T02:51:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.545+0000 7fc165a00640 1 -- 172.21.15.18:0/3895400632 shutdown_connections 2024-09-12T02:51:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.545+0000 7fc165a00640 1 --2- 172.21.15.18:0/3895400632 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc1440a2f00 0x7fc1440a53c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.545+0000 7fc165a00640 1 --2- 172.21.15.18:0/3895400632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc16011b140 0x7fc160111ce0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.545+0000 7fc165a00640 1 --2- 172.21.15.18:0/3895400632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1601095d0 0x7fc1601117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.545+0000 7fc165a00640 1 --2- 172.21.15.18:0/3895400632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1601091f0 0x7fc160118720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.545+0000 7fc165a00640 1 -- 172.21.15.18:0/3895400632 >> 172.21.15.18:0/3895400632 conn(0x7fc16006cbf0 msgr2=0x7fc16011b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.546+0000 7fc165a00640 1 -- 172.21.15.18:0/3895400632 shutdown_connections 2024-09-12T02:51:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:42.546+0000 7fc165a00640 1 -- 172.21.15.18:0/3895400632 wait complete. 2024-09-12T02:51:42.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:42 smithi018 ceph-mon[30616]: pgmap v92: 129 pgs: 129 active+clean; 535 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 16 MiB/s wr, 625 op/s 2024-09-12T02:51:42.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:42 smithi176 ceph-mon[35713]: pgmap v92: 129 pgs: 129 active+clean; 535 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 16 MiB/s wr, 625 op/s 2024-09-12T02:51:43.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:42 smithi062 ceph-mon[35527]: pgmap v92: 129 pgs: 129 active+clean; 535 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 16 MiB/s wr, 625 op/s 2024-09-12T02:51:44.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:44 smithi018 ceph-mon[30616]: pgmap v93: 129 pgs: 129 active+clean; 535 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 16 MiB/s wr, 619 op/s 2024-09-12T02:51:44.867 INFO:tasks.workunit.client.0.smithi018.stdout: 165 292388 115 187516 181 31602 67 2024-09-12T02:51:44.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:44 smithi176 ceph-mon[35713]: pgmap v93: 129 pgs: 129 active+clean; 535 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 16 MiB/s wr, 619 op/s 2024-09-12T02:51:45.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:44 smithi062 ceph-mon[35527]: pgmap v93: 129 pgs: 129 active+clean; 535 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 16 MiB/s wr, 619 op/s 2024-09-12T02:51:46.856 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:46 smithi018 ceph-mon[30616]: pgmap v94: 129 pgs: 129 active+clean; 555 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 19 MiB/s wr, 1.60k op/s 2024-09-12T02:51:46.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:46 smithi176 ceph-mon[35713]: pgmap v94: 129 pgs: 129 active+clean; 555 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 19 MiB/s wr, 1.60k op/s 2024-09-12T02:51:47.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:46 smithi062 ceph-mon[35527]: pgmap v94: 129 pgs: 129 active+clean; 555 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 19 MiB/s wr, 1.60k op/s 2024-09-12T02:51:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:48 smithi018 ceph-mon[30616]: pgmap v95: 129 pgs: 129 active+clean; 555 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 15 MiB/s wr, 1.47k op/s 2024-09-12T02:51:48.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:48 smithi176 ceph-mon[35713]: pgmap v95: 129 pgs: 129 active+clean; 555 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 15 MiB/s wr, 1.47k op/s 2024-09-12T02:51:49.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:48 smithi062 ceph-mon[35527]: pgmap v95: 129 pgs: 129 active+clean; 555 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 15 MiB/s wr, 1.47k op/s 2024-09-12T02:51:50.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:50 smithi018 ceph-mon[30616]: pgmap v96: 129 pgs: 129 active+clean; 556 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 16 MiB/s wr, 1.49k op/s 2024-09-12T02:51:50.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:50 smithi176 ceph-mon[35713]: pgmap v96: 129 pgs: 129 active+clean; 556 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 16 MiB/s wr, 1.49k op/s 2024-09-12T02:51:51.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:50 smithi062 ceph-mon[35527]: pgmap v96: 129 pgs: 129 active+clean; 556 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 16 MiB/s wr, 1.49k op/s 2024-09-12T02:51:52.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:52 smithi176 ceph-mon[35713]: pgmap v97: 129 pgs: 129 active+clean; 558 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.0 MiB/s wr, 1.15k op/s 2024-09-12T02:51:53.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:52 smithi062 ceph-mon[35527]: pgmap v97: 129 pgs: 129 active+clean; 558 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.0 MiB/s wr, 1.15k op/s 2024-09-12T02:51:53.107 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:52 smithi018 ceph-mon[30616]: pgmap v97: 129 pgs: 129 active+clean; 558 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.0 MiB/s wr, 1.15k op/s 2024-09-12T02:51:54.881 INFO:tasks.workunit.client.0.smithi018.stdout: 193 562915 1515 359036 1267 56619 63 2024-09-12T02:51:54.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:54 smithi176 ceph-mon[35713]: pgmap v98: 129 pgs: 129 active+clean; 558 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 3.2 MiB/s wr, 1.01k op/s 2024-09-12T02:51:54.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:54 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:51:55.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:54 smithi062 ceph-mon[35527]: pgmap v98: 129 pgs: 129 active+clean; 558 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 3.2 MiB/s wr, 1.01k op/s 2024-09-12T02:51:55.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:54 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:51:55.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:54 smithi018 ceph-mon[30616]: pgmap v98: 129 pgs: 129 active+clean; 558 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 3.2 MiB/s wr, 1.01k op/s 2024-09-12T02:51:55.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:54 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:51:56.917 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:56 smithi018 ceph-mon[30616]: pgmap v99: 129 pgs: 129 active+clean; 566 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 1.06k op/s 2024-09-12T02:51:56.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:56 smithi176 ceph-mon[35713]: pgmap v99: 129 pgs: 129 active+clean; 566 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 1.06k op/s 2024-09-12T02:51:57.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:56 smithi062 ceph-mon[35527]: pgmap v99: 129 pgs: 129 active+clean; 566 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 1.06k op/s 2024-09-12T02:51:57.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.565+0000 7f6d5e000640 1 -- 172.21.15.18:0/1890246850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d5811b140 msgr2=0x7f6d5811d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.565+0000 7f6d5e000640 1 --2- 172.21.15.18:0/1890246850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d5811b140 0x7f6d5811d530 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009900 tx=0x7f6d4802a440 comp rx=0 tx=0).stop 2024-09-12T02:51:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.565+0000 7f6d5e000640 1 -- 172.21.15.18:0/1890246850 shutdown_connections 2024-09-12T02:51:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.566+0000 7f6d5e000640 1 --2- 172.21.15.18:0/1890246850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d5811b140 0x7f6d5811d530 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.566+0000 7f6d5e000640 1 --2- 172.21.15.18:0/1890246850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d581095d0 0x7f6d58109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.566+0000 7f6d5e000640 1 --2- 172.21.15.18:0/1890246850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d581091f0 0x7f6d58110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.566+0000 7f6d5e000640 1 -- 172.21.15.18:0/1890246850 >> 172.21.15.18:0/1890246850 conn(0x7f6d5806cbf0 msgr2=0x7f6d5806d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.566+0000 7f6d5e000640 1 -- 172.21.15.18:0/1890246850 shutdown_connections 2024-09-12T02:51:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.566+0000 7f6d5e000640 1 -- 172.21.15.18:0/1890246850 wait complete. 2024-09-12T02:51:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.568+0000 7f6d5e000640 1 Processor -- start 2024-09-12T02:51:57.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.572+0000 7f6d5e000640 1 -- start start 2024-09-12T02:51:57.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.572+0000 7f6d5e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d581091f0 0x7f6d5811a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.572+0000 7f6d5e000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d581095d0 0x7f6d5811aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.572+0000 7f6d5e000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d5811b140 0x7f6d581135a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.572+0000 7f6d5e000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d58120b70 con 0x7f6d581091f0 2024-09-12T02:51:57.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.572+0000 7f6d5e000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6d581209f0 con 0x7f6d5811b140 2024-09-12T02:51:57.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.572+0000 7f6d5e000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6d58120cf0 con 0x7f6d581095d0 2024-09-12T02:51:57.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.574+0000 7f6d5cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d581091f0 0x7f6d5811a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:57.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.574+0000 7f6d5cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d581091f0 0x7f6d5811a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43420/0 (socket says 172.21.15.18:43420) 2024-09-12T02:51:57.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.574+0000 7f6d5cc00640 1 -- 172.21.15.18:0/225381839 learned_addr learned my addr 172.21.15.18:0/225381839 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:57.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.574+0000 7f6d5d600640 1 --2- 172.21.15.18:0/225381839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d5811b140 0x7f6d581135a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:57.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.574+0000 7f6d57e00640 1 --2- 172.21.15.18:0/225381839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d581095d0 0x7f6d5811aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.576+0000 7f6d57e00640 1 -- 172.21.15.18:0/225381839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d5811b140 msgr2=0x7f6d581135a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.576+0000 7f6d57e00640 1 --2- 172.21.15.18:0/225381839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d5811b140 0x7f6d581135a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.576+0000 7f6d57e00640 1 -- 172.21.15.18:0/225381839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d581091f0 msgr2=0x7f6d5811a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.576+0000 7f6d57e00640 1 --2- 172.21.15.18:0/225381839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d581091f0 0x7f6d5811a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.576+0000 7f6d57e00640 1 -- 172.21.15.18:0/225381839 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d58113e60 con 0x7f6d581095d0 2024-09-12T02:51:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.583+0000 7f6d57e00640 1 --2- 172.21.15.18:0/225381839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d581095d0 0x7f6d5811aa10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400d6d0 tx=0x7f6d4400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:57.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.589+0000 7f6d5cc00640 1 --2- 172.21.15.18:0/225381839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d581091f0 0x7f6d5811a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:57.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.589+0000 7f6d55600640 1 -- 172.21.15.18:0/225381839 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d44017070 con 0x7f6d581095d0 2024-09-12T02:51:57.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.589+0000 7f6d55600640 1 -- 172.21.15.18:0/225381839 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d44009820 con 0x7f6d581095d0 2024-09-12T02:51:57.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.589+0000 7f6d55600640 1 -- 172.21.15.18:0/225381839 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d44004ce0 con 0x7f6d581095d0 2024-09-12T02:51:57.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.594+0000 7f6d5e000640 1 -- 172.21.15.18:0/225381839 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d58114150 con 0x7f6d581095d0 2024-09-12T02:51:57.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.594+0000 7f6d5e000640 1 -- 172.21.15.18:0/225381839 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d581181d0 con 0x7f6d581095d0 2024-09-12T02:51:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.596+0000 7f6d5d600640 1 --2- 172.21.15.18:0/225381839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d5811b140 0x7f6d581135a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.610+0000 7f6d625ec740 1 Processor -- start 2024-09-12T02:51:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.615+0000 7f6d625ec740 1 -- start start 2024-09-12T02:51:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.615+0000 7f6d625ec740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf6173b0 0x561cbf617790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.615+0000 7f6d625ec740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf617cd0 0x561cbf622030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.615+0000 7f6d625ec740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf622570 0x561cbf624960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.615+0000 7f6d625ec740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561cbf57d100 con 0x561cbf617cd0 2024-09-12T02:51:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.615+0000 7f6d625ec740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561cbf5251b0 con 0x561cbf622570 2024-09-12T02:51:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.615+0000 7f6d625ec740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561cbf5790c0 con 0x561cbf6173b0 2024-09-12T02:51:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.616+0000 7f6d5d600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf6173b0 0x561cbf617790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.616+0000 7f6d5d600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf6173b0 0x561cbf617790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:34828/0 (socket says 172.21.15.18:34828) 2024-09-12T02:51:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.616+0000 7f6d5d600640 1 -- 172.21.15.18:0/2723841852 learned_addr learned my addr 172.21.15.18:0/2723841852 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.617+0000 7f6d5cc00640 1 --2- 172.21.15.18:0/2723841852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf617cd0 0x561cbf622030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.618+0000 7f6d5cc00640 1 -- 172.21.15.18:0/2723841852 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf6173b0 msgr2=0x561cbf617790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.618+0000 7f6d5cc00640 1 --2- 172.21.15.18:0/2723841852 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf6173b0 0x561cbf617790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.618+0000 7f6d5cc00640 1 -- 172.21.15.18:0/2723841852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf622570 msgr2=0x561cbf624960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:51:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.618+0000 7f6d5cc00640 1 --2- 172.21.15.18:0/2723841852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf622570 0x561cbf624960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.618+0000 7f6d5cc00640 1 -- 172.21.15.18:0/2723841852 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cbf290210 con 0x561cbf617cd0 2024-09-12T02:51:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.618+0000 7f6d5cc00640 1 --2- 172.21.15.18:0/2723841852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf617cd0 0x561cbf622030 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000e7c0 tx=0x7f6d50009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9655acfd4c9785 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:57.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.642+0000 7f6d4dc00640 1 -- 172.21.15.18:0/2723841852 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50017020 con 0x561cbf617cd0 2024-09-12T02:51:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.642+0000 7f6d4dc00640 1 -- 172.21.15.18:0/2723841852 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d5000ee60 con 0x561cbf617cd0 2024-09-12T02:51:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.642+0000 7f6d4dc00640 1 -- 172.21.15.18:0/2723841852 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50013d70 con 0x561cbf617cd0 2024-09-12T02:51:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.643+0000 7f6d55600640 1 -- 172.21.15.18:0/225381839 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f6d440099d0 con 0x7f6d581095d0 2024-09-12T02:51:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.646+0000 7f6d55600640 1 --2- 172.21.15.18:0/225381839 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6d3c0a2ec0 0x7f6d3c0a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.646+0000 7f6d55600640 1 -- 172.21.15.18:0/225381839 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f6d440cf350 con 0x7f6d581095d0 2024-09-12T02:51:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.647+0000 7f6d5d600640 1 --2- 172.21.15.18:0/225381839 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6d3c0a2ec0 0x7f6d3c0a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.655+0000 7f6d5d600640 1 --2- 172.21.15.18:0/225381839 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6d3c0a2ec0 0x7f6d3c0a5380 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6d480096c0 tx=0x7f6d4800b040 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.659+0000 7f6d625ec740 1 -- 172.21.15.18:0/2723841852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf617cd0 msgr2=0x561cbf622030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.659+0000 7f6d625ec740 1 --2- 172.21.15.18:0/2723841852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf617cd0 0x561cbf622030 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000e7c0 tx=0x7f6d50009790 comp rx=0 tx=0).stop 2024-09-12T02:51:57.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.697+0000 7f6d625ec740 1 -- 172.21.15.18:0/2723841852 shutdown_connections 2024-09-12T02:51:57.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.697+0000 7f6d625ec740 1 --2- 172.21.15.18:0/2723841852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf622570 0x561cbf624960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.697+0000 7f6d625ec740 1 --2- 172.21.15.18:0/2723841852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf617cd0 0x561cbf622030 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.697+0000 7f6d625ec740 1 --2- 172.21.15.18:0/2723841852 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf6173b0 0x561cbf617790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.697+0000 7f6d625ec740 1 -- 172.21.15.18:0/2723841852 >> 172.21.15.18:0/2723841852 conn(0x561cbf613920 msgr2=0x561cbf613d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:57.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.705+0000 7f6d625ec740 1 -- 172.21.15.18:0/2723841852 shutdown_connections 2024-09-12T02:51:57.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.705+0000 7f6d625ec740 1 -- 172.21.15.18:0/2723841852 wait complete. 2024-09-12T02:51:57.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.706+0000 7f6d625ec740 1 -- start start 2024-09-12T02:51:57.710 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.706+0000 7f6d625ec740 1 Processor -- start 2024-09-12T02:51:57.710 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.707+0000 7f6d625ec740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf6173b0 0x561cbf61f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.708+0000 7f6d625ec740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf617cd0 0x561cbf61fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.709+0000 7f6d5cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf6173b0 0x561cbf61f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.709+0000 7f6d5cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf6173b0 0x561cbf61f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43442/0 (socket says 172.21.15.18:43442) 2024-09-12T02:51:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.709+0000 7f6d625ec740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf622570 0x561cbf61ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.710+0000 7f6d57e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf617cd0 0x561cbf61fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.710+0000 7f6d57e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf617cd0 0x561cbf61fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:51266/0 (socket says 172.21.15.18:51266) 2024-09-12T02:51:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.710+0000 7f6d5d600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf622570 0x561cbf61ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.710+0000 7f6d5d600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf622570 0x561cbf61ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:34842/0 (socket says 172.21.15.18:34842) 2024-09-12T02:51:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.710+0000 7f6d5cc00640 1 -- 172.21.15.18:0/2456578344 learned_addr learned my addr 172.21.15.18:0/2456578344 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.710+0000 7f6d625ec740 1 -- 172.21.15.18:0/2456578344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561cbf6250b0 con 0x561cbf6173b0 2024-09-12T02:51:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.710+0000 7f6d625ec740 1 -- 172.21.15.18:0/2456578344 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561cbf506090 con 0x561cbf617cd0 2024-09-12T02:51:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.710+0000 7f6d625ec740 1 -- 172.21.15.18:0/2456578344 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561cbf625230 con 0x561cbf622570 2024-09-12T02:51:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.713+0000 7f6d57e00640 1 -- 172.21.15.18:0/2456578344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf622570 msgr2=0x561cbf61ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.713+0000 7f6d57e00640 1 --2- 172.21.15.18:0/2456578344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf622570 0x561cbf61ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.713+0000 7f6d57e00640 1 -- 172.21.15.18:0/2456578344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf6173b0 msgr2=0x561cbf61f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.713+0000 7f6d57e00640 1 --2- 172.21.15.18:0/2456578344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf6173b0 0x561cbf61f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.713+0000 7f6d57e00640 1 -- 172.21.15.18:0/2456578344 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cbf35c620 con 0x561cbf617cd0 2024-09-12T02:51:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.713+0000 7f6d5cc00640 1 --2- 172.21.15.18:0/2456578344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf6173b0 0x561cbf61f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.714+0000 7f6d57e00640 1 --2- 172.21.15.18:0/2456578344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf617cd0 0x561cbf61fa30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6d440cc680 tx=0x7f6d4409aef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7161b37ac5178f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.720+0000 7f6d625ec740 10 client.0 _ll_register_callbacks cb 0x561cbf55af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.720+0000 7f6d625ec740 1 -- 172.21.15.18:0/2456578344 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d5000ee60 con 0x561cbf617cd0 2024-09-12T02:51:57.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.738+0000 7f6d42000640 10 client.25502 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:51:57.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.738+0000 7f6d42000640 1 -- 172.21.15.18:0/2456578344 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d440cf150 con 0x561cbf617cd0 2024-09-12T02:51:57.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.738+0000 7f6d42000640 1 -- 172.21.15.18:0/2456578344 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f6d440cc900 con 0x561cbf617cd0 2024-09-12T02:51:57.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.738+0000 7f6d42000640 1 -- 172.21.15.18:0/2456578344 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f6d440ccb00 con 0x561cbf617cd0 2024-09-12T02:51:57.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.748+0000 7f6d625ec740 10 client.25502 fetch_fsmap learned FSMap version 38 2024-09-12T02:51:57.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.748+0000 7f6d625ec740 1 -- 172.21.15.18:0/2456578344 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({fsmap=38}) -- 0x561cbf630c50 con 0x561cbf617cd0 2024-09-12T02:51:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.752+0000 7f6d42000640 1 -- 172.21.15.18:0/2456578344 <== mon.2 v2:172.21.15.62:3300/0 4 ==== fsmap(e 38) ==== 8386+0+0 (secure 0 0 0) 0x7f6d440b4220 con 0x561cbf617cd0 2024-09-12T02:51:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.752+0000 7f6d625ec740 10 client.25502 fetch_fsmap finished waiting for FSMap version 38 2024-09-12T02:51:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.752+0000 7f6d625ec740 10 client.25502 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:51:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.752+0000 7f6d625ec740 20 client.25502 populate_metadata read hostname 'smithi018' 2024-09-12T02:51:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.752+0000 7f6d625ec740 1 --2- 172.21.15.18:0/2456578344 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561cbf6320c0 0x561cbf634550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.752+0000 7f6d625ec740 4 client.25502 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:51:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.752+0000 7f6d625ec740 1 -- 172.21.15.18:0/2456578344 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cbf58a830 con 0x561cbf6320c0 2024-09-12T02:51:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.760+0000 7f6d5cc00640 1 --2- 172.21.15.18:0/2456578344 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561cbf6320c0 0x561cbf634550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.769+0000 7f6d5cc00640 1 --2- 172.21.15.18:0/2456578344 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561cbf6320c0 0x561cbf634550 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e8f8efa8bab8f9f server_cookie=ee1f3219cbab8fe8 in_seq=0 out_seq=0 2024-09-12T02:51:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.769+0000 7f6d42000640 10 client.25502 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:51:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.773+0000 7f6d42000640 1 -- 172.21.15.18:0/2456578344 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561cbf58a830 con 0x561cbf6320c0 2024-09-12T02:51:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.773+0000 7f6d42000640 10 client.25502 handle_command_reply: tid=0 2024-09-12T02:51:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.773+0000 7f6d625ec740 1 client.25502 shutdown 2024-09-12T02:51:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.773+0000 7f6d625ec740 1 -- 172.21.15.18:0/2456578344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf617cd0 msgr2=0x561cbf61fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.773+0000 7f6d625ec740 1 --2- 172.21.15.18:0/2456578344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf617cd0 0x561cbf61fa30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6d440cc680 tx=0x7f6d4409aef0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.774+0000 7f6d625ec740 1 -- 172.21.15.18:0/2456578344 shutdown_connections 2024-09-12T02:51:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.774+0000 7f6d625ec740 1 --2- 172.21.15.18:0/2456578344 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561cbf6320c0 0x561cbf634550 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.774+0000 7f6d625ec740 1 --2- 172.21.15.18:0/2456578344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf622570 0x561cbf61ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.774+0000 7f6d625ec740 1 --2- 172.21.15.18:0/2456578344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf617cd0 0x561cbf61fa30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.774+0000 7f6d625ec740 1 --2- 172.21.15.18:0/2456578344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf6173b0 0x561cbf61f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.774+0000 7f6d625ec740 1 -- 172.21.15.18:0/2456578344 >> 172.21.15.18:0/2456578344 conn(0x561cbf613920 msgr2=0x561cbf619680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.774+0000 7f6d42000640 0 client.25502 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:51:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.777+0000 7f6d625ec740 1 -- 172.21.15.18:0/2456578344 shutdown_connections 2024-09-12T02:51:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.789+0000 7f6d625ec740 1 -- 172.21.15.18:0/2456578344 wait complete. 2024-09-12T02:51:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.790+0000 7f6d625ec740 20 client.25502 trim_cache size 0 max 16384 2024-09-12T02:51:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.864+0000 7f6d625ec740 1 Processor -- start 2024-09-12T02:51:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.865+0000 7f6d625ec740 1 -- start start 2024-09-12T02:51:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.867+0000 7f6d625ec740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf6173b0 0x561cbf619e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.867+0000 7f6d625ec740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf617cd0 0x561cbf621350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.868+0000 7f6d5cc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf6173b0 0x561cbf619e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:57.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.868+0000 7f6d5cc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf6173b0 0x561cbf619e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:34848/0 (socket says 172.21.15.18:34848) 2024-09-12T02:51:57.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.868+0000 7f6d57e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf617cd0 0x561cbf621350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:57.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.868+0000 7f6d57e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf617cd0 0x561cbf621350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43452/0 (socket says 172.21.15.18:43452) 2024-09-12T02:51:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.868+0000 7f6d625ec740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf622570 0x561cbf61fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.868+0000 7f6d57e00640 1 -- 172.21.15.18:0/1822451712 learned_addr learned my addr 172.21.15.18:0/1822451712 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.868+0000 7f6d5d600640 1 --2- 172.21.15.18:0/1822451712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf622570 0x561cbf61fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.868+0000 7f6d625ec740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5807da00 con 0x561cbf617cd0 2024-09-12T02:51:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.868+0000 7f6d625ec740 1 -- 172.21.15.18:0/1822451712 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5807f600 con 0x561cbf622570 2024-09-12T02:51:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.869+0000 7f6d625ec740 1 -- 172.21.15.18:0/1822451712 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5807e190 con 0x561cbf6173b0 2024-09-12T02:51:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.869+0000 7f6d5d600640 1 -- 172.21.15.18:0/1822451712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf6173b0 msgr2=0x561cbf619e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.869+0000 7f6d5d600640 1 --2- 172.21.15.18:0/1822451712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf6173b0 0x561cbf619e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.869+0000 7f6d5d600640 1 -- 172.21.15.18:0/1822451712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf617cd0 msgr2=0x561cbf621350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.870+0000 7f6d5d600640 1 --2- 172.21.15.18:0/1822451712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf617cd0 0x561cbf621350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.870+0000 7f6d5d600640 1 -- 172.21.15.18:0/1822451712 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cbf614ab0 con 0x561cbf622570 2024-09-12T02:51:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.870+0000 7f6d57e00640 1 --2- 172.21.15.18:0/1822451712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf617cd0 0x561cbf621350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.870+0000 7f6d5d600640 1 --2- 172.21.15.18:0/1822451712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf622570 0x561cbf61fda0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6d4802aa30 tx=0x7f6d48062000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0978a1d977dc75b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.872+0000 7f6d4d200640 1 -- 172.21.15.18:0/1822451712 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48078070 con 0x561cbf622570 2024-09-12T02:51:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.873+0000 7f6d4d200640 1 -- 172.21.15.18:0/1822451712 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d48068940 con 0x561cbf622570 2024-09-12T02:51:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.873+0000 7f6d4d200640 1 -- 172.21.15.18:0/1822451712 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48035040 con 0x561cbf622570 2024-09-12T02:51:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.874+0000 7f6d625ec740 1 -- 172.21.15.18:0/1822451712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf622570 msgr2=0x561cbf61fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.874+0000 7f6d625ec740 1 --2- 172.21.15.18:0/1822451712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf622570 0x561cbf61fda0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6d4802aa30 tx=0x7f6d48062000 comp rx=0 tx=0).stop 2024-09-12T02:51:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.886+0000 7f6d625ec740 1 -- 172.21.15.18:0/1822451712 shutdown_connections 2024-09-12T02:51:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.886+0000 7f6d625ec740 1 --2- 172.21.15.18:0/1822451712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf622570 0x561cbf61fda0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.886+0000 7f6d625ec740 1 --2- 172.21.15.18:0/1822451712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf617cd0 0x561cbf621350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.886+0000 7f6d625ec740 1 --2- 172.21.15.18:0/1822451712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf6173b0 0x561cbf619e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.886+0000 7f6d625ec740 1 -- 172.21.15.18:0/1822451712 >> 172.21.15.18:0/1822451712 conn(0x561cbf613920 msgr2=0x561cbf620c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:57.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.886+0000 7f6d625ec740 1 -- 172.21.15.18:0/1822451712 shutdown_connections 2024-09-12T02:51:57.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.886+0000 7f6d625ec740 1 -- 172.21.15.18:0/1822451712 wait complete. 2024-09-12T02:51:57.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.887+0000 7f6d625ec740 1 -- start start 2024-09-12T02:51:57.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.887+0000 7f6d625ec740 1 Processor -- start 2024-09-12T02:51:57.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.891+0000 7f6d625ec740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf6173b0 0x561cbf62a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.892+0000 7f6d5cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf6173b0 0x561cbf62a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:57.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.892+0000 7f6d5cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf6173b0 0x561cbf62a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43458/0 (socket says 172.21.15.18:43458) 2024-09-12T02:51:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.892+0000 7f6d5cc00640 1 -- 172.21.15.18:0/3643356489 learned_addr learned my addr 172.21.15.18:0/3643356489 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:51:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.892+0000 7f6d625ec740 1 --2- 172.21.15.18:0/3643356489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf617cd0 0x561cbf62aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.892+0000 7f6d625ec740 1 --2- 172.21.15.18:0/3643356489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf622570 0x561cbf61bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.892+0000 7f6d57e00640 1 --2- 172.21.15.18:0/3643356489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf617cd0 0x561cbf62aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.892+0000 7f6d625ec740 1 -- 172.21.15.18:0/3643356489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5807ef30 con 0x561cbf6173b0 2024-09-12T02:51:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.892+0000 7f6d625ec740 1 -- 172.21.15.18:0/3643356489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5807e860 con 0x561cbf617cd0 2024-09-12T02:51:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.892+0000 7f6d625ec740 1 -- 172.21.15.18:0/3643356489 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6d58114a80 con 0x561cbf622570 2024-09-12T02:51:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.893+0000 7f6d5d600640 1 --2- 172.21.15.18:0/3643356489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf622570 0x561cbf61bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.893+0000 7f6d5d600640 1 -- 172.21.15.18:0/3643356489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf617cd0 msgr2=0x561cbf62aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.893+0000 7f6d5d600640 1 --2- 172.21.15.18:0/3643356489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf617cd0 0x561cbf62aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.893+0000 7f6d5d600640 1 -- 172.21.15.18:0/3643356489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf6173b0 msgr2=0x561cbf62a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:51:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.893+0000 7f6d5d600640 1 --2- 172.21.15.18:0/3643356489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf6173b0 0x561cbf62a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.893+0000 7f6d5d600640 1 -- 172.21.15.18:0/3643356489 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cbf61c190 con 0x561cbf622570 2024-09-12T02:51:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.894+0000 7f6d5cc00640 1 --2- 172.21.15.18:0/3643356489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf6173b0 0x561cbf62a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:51:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.894+0000 7f6d5d600640 1 --2- 172.21.15.18:0/3643356489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf622570 0x561cbf61bb50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6d480314e0 tx=0x7f6d48032f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=530f886ff5501c2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:51:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.895+0000 7f6d625ec740 10 client.0 _ll_register_callbacks cb 0x7f6d44005810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:51:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.895+0000 7f6d625ec740 1 -- 172.21.15.18:0/3643356489 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d48068940 con 0x561cbf622570 2024-09-12T02:51:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.895+0000 7f6d42000640 10 client.25519 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:51:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.895+0000 7f6d42000640 1 -- 172.21.15.18:0/3643356489 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48078070 con 0x561cbf622570 2024-09-12T02:51:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.895+0000 7f6d42000640 1 -- 172.21.15.18:0/3643356489 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f6d48068cf0 con 0x561cbf622570 2024-09-12T02:51:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.896+0000 7f6d42000640 1 -- 172.21.15.18:0/3643356489 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f6d4807e460 con 0x561cbf622570 2024-09-12T02:51:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.896+0000 7f6d625ec740 10 client.25519 fetch_fsmap learned FSMap version 38 2024-09-12T02:51:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.896+0000 7f6d625ec740 1 -- 172.21.15.18:0/3643356489 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({fsmap=38}) -- 0x561cbf69c3b0 con 0x561cbf622570 2024-09-12T02:51:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.896+0000 7f6d42000640 1 -- 172.21.15.18:0/3643356489 <== mon.1 v2:172.21.15.176:3300/0 4 ==== fsmap(e 38) ==== 8386+0+0 (secure 0 0 0) 0x7f6d48066040 con 0x561cbf622570 2024-09-12T02:51:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.896+0000 7f6d625ec740 10 client.25519 fetch_fsmap finished waiting for FSMap version 38 2024-09-12T02:51:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.896+0000 7f6d625ec740 10 client.25519 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:51:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.896+0000 7f6d625ec740 20 client.25519 populate_metadata read hostname 'smithi018' 2024-09-12T02:51:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.896+0000 7f6d625ec740 1 --2- 172.21.15.18:0/3643356489 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561cbf69c9a0 0x561cbf69ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:51:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.898+0000 7f6d625ec740 4 client.25519 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:51:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.898+0000 7f6d625ec740 1 -- 172.21.15.18:0/3643356489 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561cbf584b80 con 0x561cbf69c9a0 2024-09-12T02:51:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.898+0000 7f6d5cc00640 1 --2- 172.21.15.18:0/3643356489 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561cbf69c9a0 0x561cbf69ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:51:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.898+0000 7f6d5cc00640 1 --2- 172.21.15.18:0/3643356489 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561cbf69c9a0 0x561cbf69ee30 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=346c5e2e9b85be03 server_cookie=2d908873219afc47 in_seq=0 out_seq=0 2024-09-12T02:51:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:57.902+0000 7f6d42000640 10 client.25519 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:51:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.552+0000 7f6d42000640 1 -- 172.21.15.18:0/3643356489 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561cbf584b80 con 0x561cbf69c9a0 2024-09-12T02:51:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.552+0000 7f6d42000640 10 client.25519 handle_command_reply: tid=0 2024-09-12T02:51:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.552+0000 7f6d625ec740 1 client.25519 shutdown 2024-09-12T02:51:58.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.553+0000 7f6d625ec740 1 -- 172.21.15.18:0/3643356489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf622570 msgr2=0x561cbf61bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:58.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.553+0000 7f6d625ec740 1 --2- 172.21.15.18:0/3643356489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf622570 0x561cbf61bb50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6d480314e0 tx=0x7f6d48032f60 comp rx=0 tx=0).stop 2024-09-12T02:51:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.583+0000 7f6d625ec740 1 -- 172.21.15.18:0/3643356489 shutdown_connections 2024-09-12T02:51:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.583+0000 7f6d625ec740 1 --2- 172.21.15.18:0/3643356489 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561cbf69c9a0 0x561cbf69ee30 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.583+0000 7f6d625ec740 1 --2- 172.21.15.18:0/3643356489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561cbf622570 0x561cbf61bb50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.583+0000 7f6d625ec740 1 --2- 172.21.15.18:0/3643356489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561cbf617cd0 0x561cbf62aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.583+0000 7f6d625ec740 1 --2- 172.21.15.18:0/3643356489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cbf6173b0 0x561cbf62a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.583+0000 7f6d42000640 0 client.25519 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:51:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.583+0000 7f6d625ec740 1 -- 172.21.15.18:0/3643356489 >> 172.21.15.18:0/3643356489 conn(0x561cbf613920 msgr2=0x561cbf6212c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.595+0000 7f6d625ec740 1 -- 172.21.15.18:0/3643356489 shutdown_connections 2024-09-12T02:51:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.604+0000 7f6d625ec740 1 -- 172.21.15.18:0/3643356489 wait complete. 2024-09-12T02:51:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.612+0000 7f6d625ec740 20 client.25519 trim_cache size 0 max 16384 2024-09-12T02:51:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:51:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:51:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:51:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:51:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.674+0000 7f6d5e000640 1 -- 172.21.15.18:0/225381839 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6d3c0a2ec0 msgr2=0x7f6d3c0a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.674+0000 7f6d5e000640 1 --2- 172.21.15.18:0/225381839 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6d3c0a2ec0 0x7f6d3c0a5380 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6d480096c0 tx=0x7f6d4800b040 comp rx=0 tx=0).stop 2024-09-12T02:51:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.674+0000 7f6d5e000640 1 -- 172.21.15.18:0/225381839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d581095d0 msgr2=0x7f6d5811aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:51:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.674+0000 7f6d5e000640 1 --2- 172.21.15.18:0/225381839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d581095d0 0x7f6d5811aa10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400d6d0 tx=0x7f6d4400db90 comp rx=0 tx=0).stop 2024-09-12T02:51:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.698+0000 7f6d5e000640 1 -- 172.21.15.18:0/225381839 shutdown_connections 2024-09-12T02:51:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.698+0000 7f6d5e000640 1 --2- 172.21.15.18:0/225381839 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6d3c0a2ec0 0x7f6d3c0a5380 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.698+0000 7f6d5e000640 1 --2- 172.21.15.18:0/225381839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d5811b140 0x7f6d581135a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.698+0000 7f6d5e000640 1 --2- 172.21.15.18:0/225381839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d581095d0 0x7f6d5811aa10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.698+0000 7f6d5e000640 1 --2- 172.21.15.18:0/225381839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d581091f0 0x7f6d5811a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:51:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.698+0000 7f6d5e000640 1 -- 172.21.15.18:0/225381839 >> 172.21.15.18:0/225381839 conn(0x7f6d5806cbf0 msgr2=0x7f6d58071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:51:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.724+0000 7f6d5e000640 1 -- 172.21.15.18:0/225381839 shutdown_connections 2024-09-12T02:51:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:51:58.735+0000 7f6d5e000640 1 -- 172.21.15.18:0/225381839 wait complete. 2024-09-12T02:51:58.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:51:58 smithi176 ceph-mon[35713]: pgmap v100: 129 pgs: 129 active+clean; 566 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 78 op/s 2024-09-12T02:51:59.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:51:58 smithi062 ceph-mon[35527]: pgmap v100: 129 pgs: 129 active+clean; 566 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 78 op/s 2024-09-12T02:51:59.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:51:58 smithi018 ceph-mon[30616]: pgmap v100: 129 pgs: 129 active+clean; 566 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 78 op/s 2024-09-12T02:52:00.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:00 smithi176 ceph-mon[35713]: pgmap v101: 129 pgs: 129 active+clean; 571 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 216 op/s 2024-09-12T02:52:01.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:00 smithi062 ceph-mon[35527]: pgmap v101: 129 pgs: 129 active+clean; 571 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 216 op/s 2024-09-12T02:52:01.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:00 smithi018 ceph-mon[30616]: pgmap v101: 129 pgs: 129 active+clean; 571 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 216 op/s 2024-09-12T02:52:01.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:01 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:52:02.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:01 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:52:02.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:01 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:52:02.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:02 smithi176 ceph-mon[35713]: pgmap v102: 129 pgs: 129 active+clean; 572 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 274 op/s 2024-09-12T02:52:03.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:02 smithi062 ceph-mon[35527]: pgmap v102: 129 pgs: 129 active+clean; 572 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 274 op/s 2024-09-12T02:52:03.127 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:02 smithi018 ceph-mon[30616]: pgmap v102: 129 pgs: 129 active+clean; 572 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 274 op/s 2024-09-12T02:52:04.667 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:04 smithi018 ceph-mon[30616]: pgmap v103: 129 pgs: 129 active+clean; 572 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 261 op/s 2024-09-12T02:52:04.891 INFO:tasks.workunit.client.0.smithi018.stdout: 217 599997 1386 382659 1444 54954 59 2024-09-12T02:52:04.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:04 smithi176 ceph-mon[35713]: pgmap v103: 129 pgs: 129 active+clean; 572 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 261 op/s 2024-09-12T02:52:05.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:04 smithi062 ceph-mon[35527]: pgmap v103: 129 pgs: 129 active+clean; 572 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 261 op/s 2024-09-12T02:52:06.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:06 smithi176 ceph-mon[35713]: pgmap v104: 129 pgs: 129 active+clean; 642 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.9 MiB/s wr, 492 op/s 2024-09-12T02:52:06.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:06 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:52:07.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:06 smithi062 ceph-mon[35527]: pgmap v104: 129 pgs: 129 active+clean; 642 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.9 MiB/s wr, 492 op/s 2024-09-12T02:52:07.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:06 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:52:07.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:06 smithi018 ceph-mon[30616]: pgmap v104: 129 pgs: 129 active+clean; 642 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.9 MiB/s wr, 492 op/s 2024-09-12T02:52:07.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:06 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:52:08.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:08 smithi176 ceph-mon[35713]: pgmap v105: 129 pgs: 129 active+clean; 647 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.5 MiB/s wr, 478 op/s 2024-09-12T02:52:08.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:08 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:52:08.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:08 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:52:08.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:08 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:52:09.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:08 smithi062 ceph-mon[35527]: pgmap v105: 129 pgs: 129 active+clean; 647 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.5 MiB/s wr, 478 op/s 2024-09-12T02:52:09.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:08 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:52:09.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:08 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:52:09.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:08 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:52:09.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:08 smithi018 ceph-mon[30616]: pgmap v105: 129 pgs: 129 active+clean; 647 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.5 MiB/s wr, 478 op/s 2024-09-12T02:52:09.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:08 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:52:09.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:08 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:52:09.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:08 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:52:11.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:10 smithi062 ceph-mon[35527]: pgmap v106: 129 pgs: 129 active+clean; 707 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 681 op/s 2024-09-12T02:52:11.131 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:10 smithi018 ceph-mon[30616]: pgmap v106: 129 pgs: 129 active+clean; 707 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 681 op/s 2024-09-12T02:52:11.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:10 smithi176 ceph-mon[35713]: pgmap v106: 129 pgs: 129 active+clean; 707 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 681 op/s 2024-09-12T02:52:12.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:11 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:52:12.108 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:11 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:52:12.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:11 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:52:12.872 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:12 smithi018 ceph-mon[30616]: pgmap v107: 129 pgs: 129 active+clean; 728 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 14 MiB/s wr, 623 op/s 2024-09-12T02:52:13.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:12 smithi062 ceph-mon[35527]: pgmap v107: 129 pgs: 129 active+clean; 728 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 14 MiB/s wr, 623 op/s 2024-09-12T02:52:13.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:12 smithi176 ceph-mon[35713]: pgmap v107: 129 pgs: 129 active+clean; 728 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 14 MiB/s wr, 623 op/s 2024-09-12T02:52:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.423+0000 7efd03200640 1 -- 172.21.15.18:0/119581069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd04109e10 msgr2=0x7efd04112260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.423+0000 7efd03200640 1 --2- 172.21.15.18:0/119581069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd04109e10 0x7efd04112260 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efcf0007380 tx=0x7efcf002aff0 comp rx=0 tx=0).stop 2024-09-12T02:52:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.432+0000 7efd03200640 1 -- 172.21.15.18:0/119581069 shutdown_connections 2024-09-12T02:52:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.432+0000 7efd03200640 1 --2- 172.21.15.18:0/119581069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd04112920 0x7efd04114db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.432+0000 7efd03200640 1 --2- 172.21.15.18:0/119581069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd04109e10 0x7efd04112260 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.432+0000 7efd03200640 1 --2- 172.21.15.18:0/119581069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd04109460 0x7efd04109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.432+0000 7efd03200640 1 -- 172.21.15.18:0/119581069 >> 172.21.15.18:0/119581069 conn(0x7efd0406cbf0 msgr2=0x7efd0406d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.434+0000 7efd03200640 1 -- 172.21.15.18:0/119581069 shutdown_connections 2024-09-12T02:52:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.436+0000 7efd03200640 1 -- 172.21.15.18:0/119581069 wait complete. 2024-09-12T02:52:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.440+0000 7efd03200640 1 Processor -- start 2024-09-12T02:52:14.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.444+0000 7efd03200640 1 -- start start 2024-09-12T02:52:14.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.444+0000 7efd03200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd04109460 0x7efd0411ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:14.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.445+0000 7efd03200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd04112920 0x7efd0411f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:14.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.445+0000 7efd01400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd04112920 0x7efd0411f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:14.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.445+0000 7efd01400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd04112920 0x7efd0411f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42158/0 (socket says 172.21.15.18:42158) 2024-09-12T02:52:14.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.445+0000 7efd01e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd04109460 0x7efd0411ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:14.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.445+0000 7efd01e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd04109460 0x7efd0411ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:38016/0 (socket says 172.21.15.18:38016) 2024-09-12T02:52:14.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.445+0000 7efd01400640 1 -- 172.21.15.18:0/3418143259 learned_addr learned my addr 172.21.15.18:0/3418143259 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:52:14.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.446+0000 7efd03200640 1 --2- 172.21.15.18:0/3418143259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd04117e30 0x7efd041182b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:14.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.446+0000 7efd03200640 1 -- 172.21.15.18:0/3418143259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd04120a30 con 0x7efd04112920 2024-09-12T02:52:14.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.446+0000 7efd03200640 1 -- 172.21.15.18:0/3418143259 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efd041208b0 con 0x7efd04109460 2024-09-12T02:52:14.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.446+0000 7efd03200640 1 -- 172.21.15.18:0/3418143259 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efd04120bb0 con 0x7efd04117e30 2024-09-12T02:52:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.446+0000 7efd02800640 1 --2- 172.21.15.18:0/3418143259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd04117e30 0x7efd041182b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.447+0000 7efd01e00640 1 -- 172.21.15.18:0/3418143259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd04117e30 msgr2=0x7efd041182b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.447+0000 7efd01e00640 1 --2- 172.21.15.18:0/3418143259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd04117e30 0x7efd041182b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.447+0000 7efd01e00640 1 -- 172.21.15.18:0/3418143259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd04112920 msgr2=0x7efd0411f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.447+0000 7efd01e00640 1 --2- 172.21.15.18:0/3418143259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd04112920 0x7efd0411f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.447+0000 7efd01e00640 1 -- 172.21.15.18:0/3418143259 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd04118b70 con 0x7efd04109460 2024-09-12T02:52:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.447+0000 7efd01400640 1 --2- 172.21.15.18:0/3418143259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd04112920 0x7efd0411f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.448+0000 7efd01e00640 1 --2- 172.21.15.18:0/3418143259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd04109460 0x7efd0411ed10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efcf400be90 tx=0x7efcf400dca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.468+0000 7efcfaa00640 1 -- 172.21.15.18:0/3418143259 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf4004230 con 0x7efd04109460 2024-09-12T02:52:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.468+0000 7efcfaa00640 1 -- 172.21.15.18:0/3418143259 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcf40043d0 con 0x7efd04109460 2024-09-12T02:52:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.468+0000 7efcfaa00640 1 -- 172.21.15.18:0/3418143259 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf4032470 con 0x7efd04109460 2024-09-12T02:52:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.486+0000 7efd03200640 1 -- 172.21.15.18:0/3418143259 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd0411c8f0 con 0x7efd04109460 2024-09-12T02:52:14.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.486+0000 7efd03200640 1 -- 172.21.15.18:0/3418143259 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd0411cdc0 con 0x7efd04109460 2024-09-12T02:52:14.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.505+0000 7efcfaa00640 1 -- 172.21.15.18:0/3418143259 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7efcf40035f0 con 0x7efd04109460 2024-09-12T02:52:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.520+0000 7efcfaa00640 1 --2- 172.21.15.18:0/3418143259 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efce80a2f00 0x7efce80a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:14.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.544+0000 7efcfaa00640 1 -- 172.21.15.18:0/3418143259 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7efcf40f1290 con 0x7efd04109460 2024-09-12T02:52:14.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.543+0000 7efd01400640 1 --2- 172.21.15.18:0/3418143259 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efce80a2f00 0x7efce80a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:14.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.551+0000 7efd01400640 1 --2- 172.21.15.18:0/3418143259 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efce80a2f00 0x7efce80a53c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efcf0033880 tx=0x7efcf002d040 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:14.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.566+0000 7efd0b9d2740 1 Processor -- start 2024-09-12T02:52:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.575+0000 7efd0b9d2740 1 -- start start 2024-09-12T02:52:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.575+0000 7efd0b9d2740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673f33b0 0x55e7673f3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.575+0000 7efd0b9d2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673f3cd0 0x55e7673fe030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.575+0000 7efd0b9d2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673fe570 0x55e767400960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.575+0000 7efd0b9d2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e767359100 con 0x55e7673fe570 2024-09-12T02:52:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.575+0000 7efd0b9d2740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e7673011b0 con 0x55e7673f33b0 2024-09-12T02:52:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.575+0000 7efd0b9d2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e7673550c0 con 0x55e7673f3cd0 2024-09-12T02:52:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.580+0000 7efd02800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673fe570 0x55e767400960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.580+0000 7efd02800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673fe570 0x55e767400960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42166/0 (socket says 172.21.15.18:42166) 2024-09-12T02:52:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.580+0000 7efd02800640 1 -- 172.21.15.18:0/1525794005 learned_addr learned my addr 172.21.15.18:0/1525794005 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:52:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.580+0000 7efd02800640 1 -- 172.21.15.18:0/1525794005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673f3cd0 msgr2=0x55e7673fe030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:52:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.580+0000 7efd02800640 1 --2- 172.21.15.18:0/1525794005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673f3cd0 0x55e7673fe030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.580+0000 7efd02800640 1 -- 172.21.15.18:0/1525794005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673f33b0 msgr2=0x55e7673f3790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:52:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.580+0000 7efd02800640 1 --2- 172.21.15.18:0/1525794005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673f33b0 0x55e7673f3790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.580+0000 7efd02800640 1 -- 172.21.15.18:0/1525794005 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e76706c210 con 0x55e7673fe570 2024-09-12T02:52:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.581+0000 7efd02800640 1 --2- 172.21.15.18:0/1525794005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673fe570 0x55e767400960 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efcfc008d40 tx=0x7efcfc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3c72ddc242e8f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.606+0000 7efcef000640 1 -- 172.21.15.18:0/1525794005 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc014070 con 0x55e7673fe570 2024-09-12T02:52:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.606+0000 7efcef000640 1 -- 172.21.15.18:0/1525794005 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcfc003b70 con 0x55e7673fe570 2024-09-12T02:52:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.606+0000 7efcef000640 1 -- 172.21.15.18:0/1525794005 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc010800 con 0x55e7673fe570 2024-09-12T02:52:14.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.627+0000 7efd0b9d2740 1 -- 172.21.15.18:0/1525794005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673fe570 msgr2=0x55e767400960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:14.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.627+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/1525794005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673fe570 0x55e767400960 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efcfc008d40 tx=0x7efcfc00e720 comp rx=0 tx=0).stop 2024-09-12T02:52:14.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.663+0000 7efd0b9d2740 1 -- 172.21.15.18:0/1525794005 shutdown_connections 2024-09-12T02:52:14.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.663+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/1525794005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673fe570 0x55e767400960 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:14.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.663+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/1525794005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673f3cd0 0x55e7673fe030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:14.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.663+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/1525794005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673f33b0 0x55e7673f3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:14.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.663+0000 7efd0b9d2740 1 -- 172.21.15.18:0/1525794005 >> 172.21.15.18:0/1525794005 conn(0x55e7673ef920 msgr2=0x55e7673efd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.711+0000 7efd0b9d2740 1 -- 172.21.15.18:0/1525794005 shutdown_connections 2024-09-12T02:52:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.713+0000 7efd0b9d2740 1 -- 172.21.15.18:0/1525794005 wait complete. 2024-09-12T02:52:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.713+0000 7efd0b9d2740 1 -- start start 2024-09-12T02:52:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.714+0000 7efd0b9d2740 1 Processor -- start 2024-09-12T02:52:14.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.726+0000 7efd0b9d2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673f33b0 0x55e7673fb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.726+0000 7efd0b9d2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673f3cd0 0x55e7673fbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.726+0000 7efd0b9d2740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673fe570 0x55e7673fc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.726+0000 7efd0b9d2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e767401050 con 0x55e7673f33b0 2024-09-12T02:52:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.726+0000 7efd0b9d2740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e7672e2090 con 0x55e7673fe570 2024-09-12T02:52:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.726+0000 7efd0b9d2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e7674011d0 con 0x55e7673f3cd0 2024-09-12T02:52:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.726+0000 7efd0b9d2740 10 client.0 _ll_register_callbacks cb 0x55e767336f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.727+0000 7efd01e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673f33b0 0x55e7673fb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.727+0000 7efd01e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673f33b0 0x55e7673fb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42174/0 (socket says 172.21.15.18:42174) 2024-09-12T02:52:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.727+0000 7efd01e00640 1 -- 172.21.15.18:0/4141220250 learned_addr learned my addr 172.21.15.18:0/4141220250 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:52:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.728+0000 7efd01400640 1 --2- 172.21.15.18:0/4141220250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673f3cd0 0x55e7673fbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.728+0000 7efd02800640 1 --2- 172.21.15.18:0/4141220250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673fe570 0x55e7673fc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.730+0000 7efd01e00640 1 -- 172.21.15.18:0/4141220250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673f3cd0 msgr2=0x55e7673fbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.730+0000 7efd01e00640 1 --2- 172.21.15.18:0/4141220250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673f3cd0 0x55e7673fbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.730+0000 7efd01e00640 1 -- 172.21.15.18:0/4141220250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673fe570 msgr2=0x55e7673fc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.730+0000 7efd01e00640 1 --2- 172.21.15.18:0/4141220250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673fe570 0x55e7673fc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.730+0000 7efd01e00640 1 -- 172.21.15.18:0/4141220250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e767138620 con 0x55e7673f33b0 2024-09-12T02:52:14.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.752+0000 7efd01e00640 1 --2- 172.21.15.18:0/4141220250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673f33b0 0x55e7673fb5c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efcf40b9de0 tx=0x7efcf40bce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526950a9b6b9aa46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:14.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.770+0000 7efce3400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:52:14.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.770+0000 7efce3400640 1 -- 172.21.15.18:0/4141220250 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf40eea40 con 0x55e7673f33b0 2024-09-12T02:52:14.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.770+0000 7efce3400640 1 -- 172.21.15.18:0/4141220250 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7efcf40bc860 con 0x55e7673f33b0 2024-09-12T02:52:14.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.853+0000 7efd0b9d2740 1 -- 172.21.15.18:0/4141220250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcfc003b70 con 0x55e7673f33b0 2024-09-12T02:52:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.855+0000 7efce3400640 1 -- 172.21.15.18:0/4141220250 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7efcf40c17c0 con 0x55e7673f33b0 2024-09-12T02:52:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.855+0000 7efd0b9d2740 10 client.15531 fetch_fsmap learned FSMap version 41 2024-09-12T02:52:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.855+0000 7efd0b9d2740 1 -- 172.21.15.18:0/4141220250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55e76740cfd0 con 0x55e7673f33b0 2024-09-12T02:52:14.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.869+0000 7efce3400640 1 -- 172.21.15.18:0/4141220250 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcfc003b70 con 0x55e7673f33b0 2024-09-12T02:52:14.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.869+0000 7efce3400640 1 -- 172.21.15.18:0/4141220250 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 41) ==== 8402+0+0 (secure 0 0 0) 0x7efcf40bc2d0 con 0x55e7673f33b0 2024-09-12T02:52:14.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.874+0000 7efd0b9d2740 10 client.15531 fetch_fsmap finished waiting for FSMap version 41 2024-09-12T02:52:14.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.874+0000 7efd0b9d2740 10 client.15531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:14.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.875+0000 7efd0b9d2740 20 client.15531 populate_metadata read hostname 'smithi018' 2024-09-12T02:52:14.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.875+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/4141220250 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e76740e490 0x55e767410880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:14.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.875+0000 7efd0b9d2740 4 client.15531 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:14.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.875+0000 7efd0b9d2740 1 -- 172.21.15.18:0/4141220250 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e767366830 con 0x55e76740e490 2024-09-12T02:52:14.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.875+0000 7efd01400640 1 --2- 172.21.15.18:0/4141220250 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e76740e490 0x55e767410880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:14.889 INFO:tasks.workunit.client.0.smithi018.stdout: 231 500292 479 316313 617 45883 47 2024-09-12T02:52:14.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.892+0000 7efd01400640 1 --2- 172.21.15.18:0/4141220250 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e76740e490 0x55e767410880 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90caba6597fe31e7 server_cookie=7b6ab20945f41a16 in_seq=0 out_seq=0 2024-09-12T02:52:14.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.892+0000 7efce3400640 10 client.15531 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:52:14.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.896+0000 7efce3400640 1 -- 172.21.15.18:0/4141220250 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e767366830 con 0x55e76740e490 2024-09-12T02:52:14.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.896+0000 7efce3400640 10 client.15531 handle_command_reply: tid=0 2024-09-12T02:52:14.909 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.905+0000 7efd0b9d2740 1 client.15531 shutdown 2024-09-12T02:52:14.909 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.908+0000 7efd0b9d2740 1 -- 172.21.15.18:0/4141220250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673f33b0 msgr2=0x55e7673fb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:14.909 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.908+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/4141220250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673f33b0 0x55e7673fb5c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efcf40b9de0 tx=0x7efcf40bce30 comp rx=0 tx=0).stop 2024-09-12T02:52:14.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.941+0000 7efd0b9d2740 1 -- 172.21.15.18:0/4141220250 shutdown_connections 2024-09-12T02:52:14.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.941+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/4141220250 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e76740e490 0x55e767410880 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:14.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.941+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/4141220250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673fe570 0x55e7673fc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:14.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.941+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/4141220250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673f3cd0 0x55e7673fbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.941+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/4141220250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673f33b0 0x55e7673fb5c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.941+0000 7efd0b9d2740 1 -- 172.21.15.18:0/4141220250 >> 172.21.15.18:0/4141220250 conn(0x55e7673ef920 msgr2=0x55e7673f5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.941+0000 7efce3400640 0 client.15531 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:52:14.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.949+0000 7efd0b9d2740 1 -- 172.21.15.18:0/4141220250 shutdown_connections 2024-09-12T02:52:14.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.951+0000 7efd0b9d2740 1 -- 172.21.15.18:0/4141220250 wait complete. 2024-09-12T02:52:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:14.951+0000 7efd0b9d2740 20 client.15531 trim_cache size 0 max 16384 2024-09-12T02:52:15.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:14 smithi062 ceph-mon[35527]: pgmap v108: 129 pgs: 129 active+clean; 728 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 14 MiB/s wr, 546 op/s 2024-09-12T02:52:15.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:14 smithi018 ceph-mon[30616]: pgmap v108: 129 pgs: 129 active+clean; 728 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 14 MiB/s wr, 546 op/s 2024-09-12T02:52:15.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:14 smithi176 ceph-mon[35713]: pgmap v108: 129 pgs: 129 active+clean; 728 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 14 MiB/s wr, 546 op/s 2024-09-12T02:52:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.639+0000 7efd0b9d2740 1 Processor -- start 2024-09-12T02:52:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.683+0000 7efd0b9d2740 1 -- start start 2024-09-12T02:52:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.683+0000 7efd0b9d2740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673f33b0 0x55e7673fd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.683+0000 7efd0b9d2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673f3cd0 0x55e767416070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.683+0000 7efd0b9d2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673fe570 0x55e7674165b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.683+0000 7efd0b9d2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd0407d900 con 0x55e7673f3cd0 2024-09-12T02:52:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.683+0000 7efd0b9d2740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efd0407f5c0 con 0x55e7673f33b0 2024-09-12T02:52:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.683+0000 7efd0b9d2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efd0407e090 con 0x55e7673fe570 2024-09-12T02:52:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.684+0000 7efd02800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673fe570 0x55e7674165b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.684+0000 7efd02800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673fe570 0x55e7674165b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:55716/0 (socket says 172.21.15.18:55716) 2024-09-12T02:52:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.684+0000 7efd02800640 1 -- 172.21.15.18:0/4279094813 learned_addr learned my addr 172.21.15.18:0/4279094813 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:52:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.684+0000 7efd01e00640 1 --2- 172.21.15.18:0/4279094813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673f33b0 0x55e7673fd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.685+0000 7efd01e00640 1 -- 172.21.15.18:0/4279094813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673fe570 msgr2=0x55e7674165b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.685+0000 7efd01e00640 1 --2- 172.21.15.18:0/4279094813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673fe570 0x55e7674165b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.685+0000 7efd01e00640 1 -- 172.21.15.18:0/4279094813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673f3cd0 msgr2=0x55e767416070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.685+0000 7efd01e00640 1 --2- 172.21.15.18:0/4279094813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673f3cd0 0x55e767416070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.685+0000 7efd01e00640 1 -- 172.21.15.18:0/4279094813 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7673f3130 con 0x55e7673f33b0 2024-09-12T02:52:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.700+0000 7efd01e00640 1 --2- 172.21.15.18:0/4279094813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673f33b0 0x55e7673fd420 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efcf4005dc0 tx=0x7efcf40bcea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d70cf1cac97c32c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:15.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.734+0000 7efcee600640 1 -- 172.21.15.18:0/4279094813 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf40c6080 con 0x55e7673f33b0 2024-09-12T02:52:15.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.734+0000 7efcee600640 1 -- 172.21.15.18:0/4279094813 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcf40c2c70 con 0x55e7673f33b0 2024-09-12T02:52:15.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.734+0000 7efcee600640 1 -- 172.21.15.18:0/4279094813 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf40ee840 con 0x55e7673f33b0 2024-09-12T02:52:15.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.755+0000 7efd0b9d2740 1 -- 172.21.15.18:0/4279094813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673f33b0 msgr2=0x55e7673fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:15.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.755+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/4279094813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673f33b0 0x55e7673fd420 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efcf4005dc0 tx=0x7efcf40bcea0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.785+0000 7efd0b9d2740 1 -- 172.21.15.18:0/4279094813 shutdown_connections 2024-09-12T02:52:15.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.785+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/4279094813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673fe570 0x55e7674165b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.785+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/4279094813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673f3cd0 0x55e767416070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.785+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/4279094813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673f33b0 0x55e7673fd420 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.785+0000 7efd0b9d2740 1 -- 172.21.15.18:0/4279094813 >> 172.21.15.18:0/4279094813 conn(0x55e7673ef920 msgr2=0x55e7673fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:15.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.828+0000 7efd0b9d2740 1 -- 172.21.15.18:0/4279094813 shutdown_connections 2024-09-12T02:52:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.848+0000 7efd0b9d2740 1 -- 172.21.15.18:0/4279094813 wait complete. 2024-09-12T02:52:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.849+0000 7efd0b9d2740 1 -- start start 2024-09-12T02:52:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.849+0000 7efd0b9d2740 1 Processor -- start 2024-09-12T02:52:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.885+0000 7efd0b9d2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673f33b0 0x55e767406e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.885+0000 7efd0b9d2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673f3cd0 0x55e767402140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.885+0000 7efd0b9d2740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673fe570 0x55e767402710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.886+0000 7efd0b9d2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd0407eef0 con 0x55e7673f33b0 2024-09-12T02:52:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.886+0000 7efd0b9d2740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efd0407e760 con 0x55e7673fe570 2024-09-12T02:52:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.886+0000 7efd0b9d2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efd0407b8e0 con 0x55e7673f3cd0 2024-09-12T02:52:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.886+0000 7efd0b9d2740 10 client.0 _ll_register_callbacks cb 0x7efcf40bd270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.886+0000 7efd02800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673fe570 0x55e767402710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.886+0000 7efd02800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673fe570 0x55e767402710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:49750/0 (socket says 172.21.15.18:49750) 2024-09-12T02:52:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.886+0000 7efd02800640 1 -- 172.21.15.18:0/3892736289 learned_addr learned my addr 172.21.15.18:0/3892736289 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:52:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.887+0000 7efd01e00640 1 --2- 172.21.15.18:0/3892736289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673f33b0 0x55e767406e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.888+0000 7efd01e00640 1 -- 172.21.15.18:0/3892736289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673f3cd0 msgr2=0x55e767402140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:52:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.888+0000 7efd01e00640 1 --2- 172.21.15.18:0/3892736289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673f3cd0 0x55e767402140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.888+0000 7efd01e00640 1 -- 172.21.15.18:0/3892736289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673fe570 msgr2=0x55e767402710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.888+0000 7efd01e00640 1 --2- 172.21.15.18:0/3892736289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673fe570 0x55e767402710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.888+0000 7efd01e00640 1 -- 172.21.15.18:0/3892736289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e767402f40 con 0x55e7673f33b0 2024-09-12T02:52:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.890+0000 7efd01e00640 1 --2- 172.21.15.18:0/3892736289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673f33b0 0x55e767406e20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efcf40bd3a0 tx=0x7efcf40b9d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1fe638c007d246b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:15.937 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.937+0000 7efce3400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:52:15.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.937+0000 7efce3400640 1 -- 172.21.15.18:0/3892736289 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf40d6220 con 0x55e7673f33b0 2024-09-12T02:52:15.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.937+0000 7efce3400640 1 -- 172.21.15.18:0/3892736289 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7efcf40ee840 con 0x55e7673f33b0 2024-09-12T02:52:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.958+0000 7efd0b9d2740 1 -- 172.21.15.18:0/3892736289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcf40c2c70 con 0x55e7673f33b0 2024-09-12T02:52:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.966+0000 7efce3400640 1 -- 172.21.15.18:0/3892736289 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7efcf40eea40 con 0x55e7673f33b0 2024-09-12T02:52:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.981+0000 7efd0b9d2740 10 client.15534 fetch_fsmap learned FSMap version 41 2024-09-12T02:52:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:15.981+0000 7efd0b9d2740 1 -- 172.21.15.18:0/3892736289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55e767479150 con 0x55e7673f33b0 2024-09-12T02:52:16.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:16.013+0000 7efce3400640 1 -- 172.21.15.18:0/3892736289 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcf40c2c70 con 0x55e7673f33b0 2024-09-12T02:52:16.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:16.013+0000 7efce3400640 1 -- 172.21.15.18:0/3892736289 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 41) ==== 8402+0+0 (secure 0 0 0) 0x7efcf40099b0 con 0x55e7673f33b0 2024-09-12T02:52:16.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:16.015+0000 7efd0b9d2740 10 client.15534 fetch_fsmap finished waiting for FSMap version 41 2024-09-12T02:52:16.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:16.015+0000 7efd0b9d2740 10 client.15534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:16.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:16.015+0000 7efd0b9d2740 20 client.15534 populate_metadata read hostname 'smithi018' 2024-09-12T02:52:16.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:16.015+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/3892736289 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e7674794e0 0x55e76747b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:16.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:16.015+0000 7efd0b9d2740 4 client.15534 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:52:16.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:16.015+0000 7efd0b9d2740 1 -- 172.21.15.18:0/3892736289 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e767360b80 con 0x55e7674794e0 2024-09-12T02:52:16.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:16.026+0000 7efd01400640 1 --2- 172.21.15.18:0/3892736289 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e7674794e0 0x55e76747b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:16.034+0000 7efd01400640 1 --2- 172.21.15.18:0/3892736289 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e7674794e0 0x55e76747b8d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9170a88630cfa976 server_cookie=30e61ae76248f2e0 in_seq=0 out_seq=0 2024-09-12T02:52:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:16.034+0000 7efce3400640 10 client.15534 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:52:17.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:16 smithi062 ceph-mon[35527]: pgmap v109: 129 pgs: 129 active+clean; 785 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 19 MiB/s wr, 698 op/s 2024-09-12T02:52:17.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:16 smithi018 ceph-mon[30616]: pgmap v109: 129 pgs: 129 active+clean; 785 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 19 MiB/s wr, 698 op/s 2024-09-12T02:52:17.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:16 smithi176 ceph-mon[35713]: pgmap v109: 129 pgs: 129 active+clean; 785 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 19 MiB/s wr, 698 op/s 2024-09-12T02:52:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.116+0000 7efce3400640 1 -- 172.21.15.18:0/3892736289 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e767360b80 con 0x55e7674794e0 2024-09-12T02:52:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.116+0000 7efce3400640 10 client.15534 handle_command_reply: tid=0 2024-09-12T02:52:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.116+0000 7efd0b9d2740 1 client.15534 shutdown 2024-09-12T02:52:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.117+0000 7efd0b9d2740 1 -- 172.21.15.18:0/3892736289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673f33b0 msgr2=0x55e767406e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.117+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/3892736289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673f33b0 0x55e767406e20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efcf40bd3a0 tx=0x7efcf40b9d50 comp rx=0 tx=0).stop 2024-09-12T02:52:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.118+0000 7efd0b9d2740 1 -- 172.21.15.18:0/3892736289 shutdown_connections 2024-09-12T02:52:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.118+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/3892736289 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55e7674794e0 0x55e76747b8d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.118+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/3892736289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e7673fe570 0x55e767402710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.118+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/3892736289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e7673f3cd0 0x55e767402140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.118+0000 7efd0b9d2740 1 --2- 172.21.15.18:0/3892736289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7673f33b0 0x55e767406e20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.118+0000 7efd0b9d2740 1 -- 172.21.15.18:0/3892736289 >> 172.21.15.18:0/3892736289 conn(0x55e7673ef920 msgr2=0x55e7673f5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.119+0000 7efce3400640 0 client.15534 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:52:18.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.119+0000 7efd0b9d2740 1 -- 172.21.15.18:0/3892736289 shutdown_connections 2024-09-12T02:52:18.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.120+0000 7efd0b9d2740 1 -- 172.21.15.18:0/3892736289 wait complete. 2024-09-12T02:52:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:52:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:52:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:52:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:52:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.124+0000 7efd0b9d2740 20 client.15534 trim_cache size 0 max 16384 2024-09-12T02:52:18.151 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.146+0000 7efd03200640 1 -- 172.21.15.18:0/3418143259 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efce80a2f00 msgr2=0x7efce80a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.146+0000 7efd03200640 1 --2- 172.21.15.18:0/3418143259 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efce80a2f00 0x7efce80a53c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efcf0033880 tx=0x7efcf002d040 comp rx=0 tx=0).stop 2024-09-12T02:52:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.146+0000 7efd03200640 1 -- 172.21.15.18:0/3418143259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd04109460 msgr2=0x7efd0411ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.146+0000 7efd03200640 1 --2- 172.21.15.18:0/3418143259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd04109460 0x7efd0411ed10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efcf400be90 tx=0x7efcf400dca0 comp rx=0 tx=0).stop 2024-09-12T02:52:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.146+0000 7efd03200640 1 -- 172.21.15.18:0/3418143259 shutdown_connections 2024-09-12T02:52:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.146+0000 7efd03200640 1 --2- 172.21.15.18:0/3418143259 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efce80a2f00 0x7efce80a53c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.146+0000 7efd03200640 1 --2- 172.21.15.18:0/3418143259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd04117e30 0x7efd041182b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.146+0000 7efd03200640 1 --2- 172.21.15.18:0/3418143259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd04112920 0x7efd0411f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.146+0000 7efd03200640 1 --2- 172.21.15.18:0/3418143259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd04109460 0x7efd0411ed10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.146+0000 7efd03200640 1 -- 172.21.15.18:0/3418143259 >> 172.21.15.18:0/3418143259 conn(0x7efd0406cbf0 msgr2=0x7efd040705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.150+0000 7efd03200640 1 -- 172.21.15.18:0/3418143259 shutdown_connections 2024-09-12T02:52:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:18.150+0000 7efd03200640 1 -- 172.21.15.18:0/3418143259 wait complete. 2024-09-12T02:52:19.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:18 smithi062 ceph-mon[35527]: pgmap v110: 129 pgs: 129 active+clean; 802 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 533 op/s 2024-09-12T02:52:19.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:18 smithi018 ceph-mon[30616]: pgmap v110: 129 pgs: 129 active+clean; 802 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 533 op/s 2024-09-12T02:52:19.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:18 smithi176 ceph-mon[35713]: pgmap v110: 129 pgs: 129 active+clean; 802 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 533 op/s 2024-09-12T02:52:21.118 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:20 smithi018 ceph-mon[30616]: pgmap v111: 129 pgs: 129 active+clean; 798 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 14 MiB/s wr, 819 op/s 2024-09-12T02:52:21.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:20 smithi176 ceph-mon[35713]: pgmap v111: 129 pgs: 129 active+clean; 798 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 14 MiB/s wr, 819 op/s 2024-09-12T02:52:21.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:20 smithi062 ceph-mon[35527]: pgmap v111: 129 pgs: 129 active+clean; 798 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 14 MiB/s wr, 819 op/s 2024-09-12T02:52:23.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:22 smithi018 ceph-mon[30616]: pgmap v112: 129 pgs: 129 active+clean; 798 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.3 MiB/s wr, 797 op/s 2024-09-12T02:52:23.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:22 smithi176 ceph-mon[35713]: pgmap v112: 129 pgs: 129 active+clean; 798 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.3 MiB/s wr, 797 op/s 2024-09-12T02:52:23.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:22 smithi062 ceph-mon[35527]: pgmap v112: 129 pgs: 129 active+clean; 798 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.3 MiB/s wr, 797 op/s 2024-09-12T02:52:24.903 INFO:tasks.workunit.client.0.smithi018.stdout: 258 617899 1245 395563 1619 52882 358 2024-09-12T02:52:25.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:24 smithi018 ceph-mon[30616]: pgmap v113: 129 pgs: 129 active+clean; 798 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.4 MiB/s wr, 718 op/s 2024-09-12T02:52:25.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:24 smithi176 ceph-mon[35713]: pgmap v113: 129 pgs: 129 active+clean; 798 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.4 MiB/s wr, 718 op/s 2024-09-12T02:52:25.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:24 smithi062 ceph-mon[35527]: pgmap v113: 129 pgs: 129 active+clean; 798 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.4 MiB/s wr, 718 op/s 2024-09-12T02:52:27.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:26 smithi018 ceph-mon[30616]: pgmap v114: 129 pgs: 129 active+clean; 811 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.6 MiB/s wr, 771 op/s 2024-09-12T02:52:27.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:26 smithi176 ceph-mon[35713]: pgmap v114: 129 pgs: 129 active+clean; 811 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.6 MiB/s wr, 771 op/s 2024-09-12T02:52:27.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:26 smithi062 ceph-mon[35527]: pgmap v114: 129 pgs: 129 active+clean; 811 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.6 MiB/s wr, 771 op/s 2024-09-12T02:52:29.085 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:28 smithi062 ceph-mon[35527]: pgmap v115: 129 pgs: 129 active+clean; 816 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 643 op/s 2024-09-12T02:52:29.106 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:28 smithi018 ceph-mon[30616]: pgmap v115: 129 pgs: 129 active+clean; 816 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 643 op/s 2024-09-12T02:52:29.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:28 smithi176 ceph-mon[35713]: pgmap v115: 129 pgs: 129 active+clean; 816 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 643 op/s 2024-09-12T02:52:31.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:30 smithi018 ceph-mon[30616]: pgmap v116: 129 pgs: 129 active+clean; 844 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.0 MiB/s wr, 669 op/s 2024-09-12T02:52:31.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:30 smithi176 ceph-mon[35713]: pgmap v116: 129 pgs: 129 active+clean; 844 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.0 MiB/s wr, 669 op/s 2024-09-12T02:52:31.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:30 smithi062 ceph-mon[35527]: pgmap v116: 129 pgs: 129 active+clean; 844 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.0 MiB/s wr, 669 op/s 2024-09-12T02:52:33.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:32 smithi018 ceph-mon[30616]: pgmap v117: 129 pgs: 129 active+clean; 847 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.8 MiB/s wr, 363 op/s 2024-09-12T02:52:33.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:32 smithi176 ceph-mon[35713]: pgmap v117: 129 pgs: 129 active+clean; 847 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.8 MiB/s wr, 363 op/s 2024-09-12T02:52:33.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:32 smithi062 ceph-mon[35527]: pgmap v117: 129 pgs: 129 active+clean; 847 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.8 MiB/s wr, 363 op/s 2024-09-12T02:52:34.872 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:34 smithi018 ceph-mon[30616]: pgmap v118: 129 pgs: 129 active+clean; 851 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 205 op/s 2024-09-12T02:52:34.899 INFO:tasks.workunit.client.0.smithi018.stdout: 280 534848 1224 343283 936 60396 1377 2024-09-12T02:52:35.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:34 smithi176 ceph-mon[35713]: pgmap v118: 129 pgs: 129 active+clean; 851 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 205 op/s 2024-09-12T02:52:35.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:34 smithi062 ceph-mon[35527]: pgmap v118: 129 pgs: 129 active+clean; 851 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 205 op/s 2024-09-12T02:52:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:35.957+0000 7fca73200640 1 -- 172.21.15.18:0/84873123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6c1091f0 msgr2=0x7fca6c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:35.957+0000 7fca73200640 1 --2- 172.21.15.18:0/84873123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6c1091f0 0x7fca6c110250 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fca58009950 tx=0x7fca5802a480 comp rx=0 tx=0).stop 2024-09-12T02:52:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.013+0000 7fca73200640 1 -- 172.21.15.18:0/84873123 shutdown_connections 2024-09-12T02:52:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.013+0000 7fca73200640 1 --2- 172.21.15.18:0/84873123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca6c11b140 0x7fca6c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.013+0000 7fca73200640 1 --2- 172.21.15.18:0/84873123 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca6c1095d0 0x7fca6c109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.013+0000 7fca73200640 1 --2- 172.21.15.18:0/84873123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6c1091f0 0x7fca6c110250 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.013+0000 7fca73200640 1 -- 172.21.15.18:0/84873123 >> 172.21.15.18:0/84873123 conn(0x7fca6c06ce00 msgr2=0x7fca6c06d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.024+0000 7fca73200640 1 -- 172.21.15.18:0/84873123 shutdown_connections 2024-09-12T02:52:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.028+0000 7fca73200640 1 -- 172.21.15.18:0/84873123 wait complete. 2024-09-12T02:52:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.029+0000 7fca73200640 1 Processor -- start 2024-09-12T02:52:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.035+0000 7fca73200640 1 -- start start 2024-09-12T02:52:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.036+0000 7fca73200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca6c1091f0 0x7fca6c1a7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.040+0000 7fca73200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca6c1095d0 0x7fca6c1a7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.041+0000 7fca73200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6c11b140 0x7fca6c1aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.042+0000 7fca71200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6c11b140 0x7fca6c1aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.042+0000 7fca71200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6c11b140 0x7fca6c1aba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52812/0 (socket says 172.21.15.18:52812) 2024-09-12T02:52:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.042+0000 7fca6b400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca6c1095d0 0x7fca6c1a7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.042+0000 7fca6b400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca6c1095d0 0x7fca6c1a7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:46980/0 (socket says 172.21.15.18:46980) 2024-09-12T02:52:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.042+0000 7fca71200640 1 -- 172.21.15.18:0/3494480949 learned_addr learned my addr 172.21.15.18:0/3494480949 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:52:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.042+0000 7fca73200640 1 -- 172.21.15.18:0/3494480949 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c120df0 con 0x7fca6c11b140 2024-09-12T02:52:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.042+0000 7fca73200640 1 -- 172.21.15.18:0/3494480949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c120c70 con 0x7fca6c1091f0 2024-09-12T02:52:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.042+0000 7fca73200640 1 -- 172.21.15.18:0/3494480949 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c120f70 con 0x7fca6c1095d0 2024-09-12T02:52:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.043+0000 7fca71200640 1 -- 172.21.15.18:0/3494480949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca6c1095d0 msgr2=0x7fca6c1a7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.043+0000 7fca71200640 1 --2- 172.21.15.18:0/3494480949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca6c1095d0 0x7fca6c1a7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.043+0000 7fca71200640 1 -- 172.21.15.18:0/3494480949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca6c1091f0 msgr2=0x7fca6c1a7150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:52:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.043+0000 7fca71200640 1 --2- 172.21.15.18:0/3494480949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca6c1091f0 0x7fca6c1a7150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.043+0000 7fca71200640 1 -- 172.21.15.18:0/3494480949 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca6c1ac140 con 0x7fca6c11b140 2024-09-12T02:52:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.044+0000 7fca71200640 1 --2- 172.21.15.18:0/3494480949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6c11b140 0x7fca6c1aba10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fca6400ecd0 tx=0x7fca6400c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.050+0000 7fca68c00640 1 -- 172.21.15.18:0/3494480949 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64004b20 con 0x7fca6c11b140 2024-09-12T02:52:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.050+0000 7fca68c00640 1 -- 172.21.15.18:0/3494480949 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca64004cc0 con 0x7fca6c11b140 2024-09-12T02:52:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.050+0000 7fca68c00640 1 -- 172.21.15.18:0/3494480949 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca640226e0 con 0x7fca6c11b140 2024-09-12T02:52:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.051+0000 7fca73200640 1 -- 172.21.15.18:0/3494480949 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca6c1ac430 con 0x7fca6c11b140 2024-09-12T02:52:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.051+0000 7fca73200640 1 -- 172.21.15.18:0/3494480949 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca6c110920 con 0x7fca6c11b140 2024-09-12T02:52:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.083+0000 7fca761cc740 1 Processor -- start 2024-09-12T02:52:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.085+0000 7fca68c00640 1 -- 172.21.15.18:0/3494480949 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fca64022880 con 0x7fca6c11b140 2024-09-12T02:52:36.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.108+0000 7fca68c00640 1 --2- 172.21.15.18:0/3494480949 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fca500a2f80 0x7fca500a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.111+0000 7fca6b400640 1 --2- 172.21.15.18:0/3494480949 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fca500a2f80 0x7fca500a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:36.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.113+0000 7fca761cc740 1 -- start start 2024-09-12T02:52:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.113+0000 7fca761cc740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260ee01e0 0x55d260ee05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.114+0000 7fca761cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee0b00 0x55d260eeae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.114+0000 7fca761cc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260eeb3a0 0x55d260eed790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.114+0000 7fca761cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d260e46100 con 0x55d260ee0b00 2024-09-12T02:52:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.114+0000 7fca761cc740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d260dee1b0 con 0x55d260ee01e0 2024-09-12T02:52:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.114+0000 7fca761cc740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d260e420c0 con 0x55d260eeb3a0 2024-09-12T02:52:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.115+0000 7fca68c00640 1 -- 172.21.15.18:0/3494480949 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fca640e07e0 con 0x7fca6c11b140 2024-09-12T02:52:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.117+0000 7fca6b400640 1 --2- 172.21.15.18:0/3494480949 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fca500a2f80 0x7fca500a5440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fca6c11d470 tx=0x7fca5c0090e0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.125+0000 7fca6be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260ee01e0 0x55d260ee05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.125+0000 7fca6be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260ee01e0 0x55d260ee05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:42520/0 (socket says 172.21.15.18:42520) 2024-09-12T02:52:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.125+0000 7fca6be00640 1 -- 172.21.15.18:0/979284469 learned_addr learned my addr 172.21.15.18:0/979284469 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:52:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.125+0000 7fca6b400640 1 --2- 172.21.15.18:0/979284469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee0b00 0x55d260eeae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.126+0000 7fca6b400640 1 -- 172.21.15.18:0/979284469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260eeb3a0 msgr2=0x55d260eed790 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:52:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.126+0000 7fca6b400640 1 --2- 172.21.15.18:0/979284469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260eeb3a0 0x55d260eed790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.126+0000 7fca6b400640 1 -- 172.21.15.18:0/979284469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260ee01e0 msgr2=0x55d260ee05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.126+0000 7fca6b400640 1 --2- 172.21.15.18:0/979284469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260ee01e0 0x55d260ee05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.126+0000 7fca6b400640 1 -- 172.21.15.18:0/979284469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d260b59210 con 0x55d260ee0b00 2024-09-12T02:52:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.126+0000 7fca6b400640 1 --2- 172.21.15.18:0/979284469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee0b00 0x55d260eeae60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00ea60 tx=0x7fca5c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6ee84224eaf08e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.129+0000 7fca61600640 1 -- 172.21.15.18:0/979284469 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c01b040 con 0x55d260ee0b00 2024-09-12T02:52:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.129+0000 7fca61600640 1 -- 172.21.15.18:0/979284469 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca5c024070 con 0x55d260ee0b00 2024-09-12T02:52:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.129+0000 7fca61600640 1 -- 172.21.15.18:0/979284469 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c01f650 con 0x55d260ee0b00 2024-09-12T02:52:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.131+0000 7fca761cc740 1 -- 172.21.15.18:0/979284469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee0b00 msgr2=0x55d260eeae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.131+0000 7fca761cc740 1 --2- 172.21.15.18:0/979284469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee0b00 0x55d260eeae60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00ea60 tx=0x7fca5c011000 comp rx=0 tx=0).stop 2024-09-12T02:52:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.148+0000 7fca761cc740 1 -- 172.21.15.18:0/979284469 shutdown_connections 2024-09-12T02:52:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.148+0000 7fca761cc740 1 --2- 172.21.15.18:0/979284469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260eeb3a0 0x55d260eed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.148+0000 7fca761cc740 1 --2- 172.21.15.18:0/979284469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee0b00 0x55d260eeae60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.148+0000 7fca761cc740 1 --2- 172.21.15.18:0/979284469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260ee01e0 0x55d260ee05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.148+0000 7fca761cc740 1 -- 172.21.15.18:0/979284469 >> 172.21.15.18:0/979284469 conn(0x55d260edc750 msgr2=0x55d260edcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.155+0000 7fca761cc740 1 -- 172.21.15.18:0/979284469 shutdown_connections 2024-09-12T02:52:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.156+0000 7fca761cc740 1 -- 172.21.15.18:0/979284469 wait complete. 2024-09-12T02:52:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.156+0000 7fca761cc740 1 -- start start 2024-09-12T02:52:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.157+0000 7fca761cc740 1 Processor -- start 2024-09-12T02:52:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.157+0000 7fca761cc740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260ee01e0 0x55d260ee8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.157+0000 7fca761cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee0b00 0x55d260ee88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.158+0000 7fca6be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260ee01e0 0x55d260ee8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:36.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.158+0000 7fca6be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260ee01e0 0x55d260ee8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:42534/0 (socket says 172.21.15.18:42534) 2024-09-12T02:52:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.160+0000 7fca6be00640 1 -- 172.21.15.18:0/446948016 learned_addr learned my addr 172.21.15.18:0/446948016 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:52:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.160+0000 7fca6b400640 1 --2- 172.21.15.18:0/446948016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee0b00 0x55d260ee88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.160+0000 7fca761cc740 1 --2- 172.21.15.18:0/446948016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260eeb3a0 0x55d260ee8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.162+0000 7fca761cc740 1 -- 172.21.15.18:0/446948016 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d260eedf70 con 0x55d260ee0b00 2024-09-12T02:52:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.162+0000 7fca761cc740 1 -- 172.21.15.18:0/446948016 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d260dcf090 con 0x55d260ee01e0 2024-09-12T02:52:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.162+0000 7fca761cc740 1 -- 172.21.15.18:0/446948016 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d260eee0f0 con 0x55d260eeb3a0 2024-09-12T02:52:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.163+0000 7fca6be00640 1 -- 172.21.15.18:0/446948016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260eeb3a0 msgr2=0x55d260ee8df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:52:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.163+0000 7fca6be00640 1 --2- 172.21.15.18:0/446948016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260eeb3a0 0x55d260ee8df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.163+0000 7fca6be00640 1 -- 172.21.15.18:0/446948016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee0b00 msgr2=0x55d260ee88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.163+0000 7fca6be00640 1 --2- 172.21.15.18:0/446948016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee0b00 0x55d260ee88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.163+0000 7fca6be00640 1 -- 172.21.15.18:0/446948016 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d260c25620 con 0x55d260ee01e0 2024-09-12T02:52:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.163+0000 7fca6b400640 1 --2- 172.21.15.18:0/446948016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee0b00 0x55d260ee88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:36.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.183+0000 7fca6be00640 1 --2- 172.21.15.18:0/446948016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260ee01e0 0x55d260ee8370 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca580098a0 tx=0x7fca58005250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14be919c839983ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:36.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.186+0000 7fca56000640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:52:36.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.193+0000 7fca56000640 1 -- 172.21.15.18:0/446948016 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58035030 con 0x55d260ee01e0 2024-09-12T02:52:36.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.194+0000 7fca56000640 1 -- 172.21.15.18:0/446948016 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fca580048c0 con 0x55d260ee01e0 2024-09-12T02:52:36.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.194+0000 7fca56000640 10 client.0 inactive, discarding osd_map(99..99 src has 1..99) 2024-09-12T02:52:36.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.196+0000 7fca761cc740 10 client.0 _ll_register_callbacks cb 0x55d260e23f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:36.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.196+0000 7fca761cc740 1 -- 172.21.15.18:0/446948016 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca5c024070 con 0x55d260ee01e0 2024-09-12T02:52:36.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.198+0000 7fca56000640 1 -- 172.21.15.18:0/446948016 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fca58005d10 con 0x55d260ee01e0 2024-09-12T02:52:36.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.199+0000 7fca761cc740 10 client.25529 fetch_fsmap learned FSMap version 41 2024-09-12T02:52:36.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.199+0000 7fca761cc740 1 -- 172.21.15.18:0/446948016 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({fsmap=41}) -- 0x55d260ef9ae0 con 0x55d260ee01e0 2024-09-12T02:52:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.199+0000 7fca56000640 1 -- 172.21.15.18:0/446948016 <== mon.2 v2:172.21.15.62:3300/0 4 ==== fsmap(e 41) ==== 8402+0+0 (secure 0 0 0) 0x7fca58004ac0 con 0x55d260ee01e0 2024-09-12T02:52:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.199+0000 7fca761cc740 10 client.25529 fetch_fsmap finished waiting for FSMap version 41 2024-09-12T02:52:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.199+0000 7fca761cc740 10 client.25529 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.199+0000 7fca761cc740 20 client.25529 populate_metadata read hostname 'smithi018' 2024-09-12T02:52:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.200+0000 7fca761cc740 1 --2- 172.21.15.18:0/446948016 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d260efaee0 0x55d260efd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.200+0000 7fca761cc740 4 client.25529 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:36.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.200+0000 7fca761cc740 1 -- 172.21.15.18:0/446948016 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d260e53830 con 0x55d260efaee0 2024-09-12T02:52:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.203+0000 7fca6b400640 1 --2- 172.21.15.18:0/446948016 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d260efaee0 0x55d260efd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.204+0000 7fca6b400640 1 --2- 172.21.15.18:0/446948016 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d260efaee0 0x55d260efd370 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0a0eee3c8c62a37 server_cookie=54a39a0aaf1f8599 in_seq=0 out_seq=0 2024-09-12T02:52:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.204+0000 7fca56000640 10 client.25529 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:52:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.225+0000 7fca56000640 1 -- 172.21.15.18:0/446948016 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d260e53830 con 0x55d260efaee0 2024-09-12T02:52:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.225+0000 7fca56000640 10 client.25529 handle_command_reply: tid=0 2024-09-12T02:52:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.230+0000 7fca761cc740 1 client.25529 shutdown 2024-09-12T02:52:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.232+0000 7fca761cc740 1 -- 172.21.15.18:0/446948016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260ee01e0 msgr2=0x55d260ee8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.232+0000 7fca761cc740 1 --2- 172.21.15.18:0/446948016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260ee01e0 0x55d260ee8370 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca580098a0 tx=0x7fca58005250 comp rx=0 tx=0).stop 2024-09-12T02:52:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.232+0000 7fca761cc740 1 -- 172.21.15.18:0/446948016 shutdown_connections 2024-09-12T02:52:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.232+0000 7fca761cc740 1 --2- 172.21.15.18:0/446948016 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d260efaee0 0x55d260efd370 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.232+0000 7fca761cc740 1 --2- 172.21.15.18:0/446948016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260eeb3a0 0x55d260ee8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.232+0000 7fca761cc740 1 --2- 172.21.15.18:0/446948016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee0b00 0x55d260ee88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.232+0000 7fca761cc740 1 --2- 172.21.15.18:0/446948016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260ee01e0 0x55d260ee8370 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca580098a0 tx=0x7fca58005250 comp rx=0 tx=0).stop 2024-09-12T02:52:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.232+0000 7fca761cc740 1 -- 172.21.15.18:0/446948016 >> 172.21.15.18:0/446948016 conn(0x55d260edc750 msgr2=0x55d260ee24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.236+0000 7fca56000640 0 client.25529 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:52:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.246+0000 7fca761cc740 1 -- 172.21.15.18:0/446948016 shutdown_connections 2024-09-12T02:52:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.251+0000 7fca761cc740 1 -- 172.21.15.18:0/446948016 wait complete. 2024-09-12T02:52:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.260+0000 7fca761cc740 20 client.25529 trim_cache size 0 max 16384 2024-09-12T02:52:36.777 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.776+0000 7fca761cc740 1 Processor -- start 2024-09-12T02:52:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.776+0000 7fca761cc740 1 -- start start 2024-09-12T02:52:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.776+0000 7fca761cc740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260ee0b00 0x55d260f02c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.776+0000 7fca761cc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260eeb3a0 0x55d260f031c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.776+0000 7fca761cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee1c40 0x55d260ee20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.776+0000 7fca761cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c00ffb0 con 0x55d260ee1c40 2024-09-12T02:52:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.776+0000 7fca761cc740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c011c70 con 0x55d260ee0b00 2024-09-12T02:52:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.776+0000 7fca761cc740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c010740 con 0x55d260eeb3a0 2024-09-12T02:52:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.777+0000 7fca6b400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260eeb3a0 0x55d260f031c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.777+0000 7fca6b400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260eeb3a0 0x55d260f031c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:47008/0 (socket says 172.21.15.18:47008) 2024-09-12T02:52:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.777+0000 7fca6b400640 1 -- 172.21.15.18:0/167627520 learned_addr learned my addr 172.21.15.18:0/167627520 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:52:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.777+0000 7fca71200640 1 --2- 172.21.15.18:0/167627520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee1c40 0x55d260ee20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.777+0000 7fca6b400640 1 -- 172.21.15.18:0/167627520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260ee0b00 msgr2=0x55d260f02c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:52:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.777+0000 7fca6b400640 1 --2- 172.21.15.18:0/167627520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260ee0b00 0x55d260f02c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.777+0000 7fca6b400640 1 -- 172.21.15.18:0/167627520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee1c40 msgr2=0x55d260ee20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.777+0000 7fca6b400640 1 --2- 172.21.15.18:0/167627520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee1c40 0x55d260ee20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.777+0000 7fca6b400640 1 -- 172.21.15.18:0/167627520 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d260ed7d60 con 0x55d260eeb3a0 2024-09-12T02:52:36.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.779+0000 7fca6b400640 1 --2- 172.21.15.18:0/167627520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260eeb3a0 0x55d260f031c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00ea60 tx=0x7fca5c009150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7c4963077b1a955 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.781+0000 7fca60c00640 1 -- 172.21.15.18:0/167627520 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c013cc0 con 0x55d260eeb3a0 2024-09-12T02:52:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.781+0000 7fca60c00640 1 -- 172.21.15.18:0/167627520 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca5c004040 con 0x55d260eeb3a0 2024-09-12T02:52:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.781+0000 7fca60c00640 1 -- 172.21.15.18:0/167627520 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c0039c0 con 0x55d260eeb3a0 2024-09-12T02:52:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.792+0000 7fca761cc740 1 -- 172.21.15.18:0/167627520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260eeb3a0 msgr2=0x55d260f031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.792+0000 7fca761cc740 1 --2- 172.21.15.18:0/167627520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260eeb3a0 0x55d260f031c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00ea60 tx=0x7fca5c009150 comp rx=0 tx=0).stop 2024-09-12T02:52:36.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.804+0000 7fca761cc740 1 -- 172.21.15.18:0/167627520 shutdown_connections 2024-09-12T02:52:36.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.804+0000 7fca761cc740 1 --2- 172.21.15.18:0/167627520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee1c40 0x55d260ee20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.804+0000 7fca761cc740 1 --2- 172.21.15.18:0/167627520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260eeb3a0 0x55d260f031c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.804+0000 7fca761cc740 1 --2- 172.21.15.18:0/167627520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260ee0b00 0x55d260f02c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.804+0000 7fca761cc740 1 -- 172.21.15.18:0/167627520 >> 172.21.15.18:0/167627520 conn(0x55d260edc750 msgr2=0x55d260edcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:36.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.814+0000 7fca761cc740 1 -- 172.21.15.18:0/167627520 shutdown_connections 2024-09-12T02:52:36.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.814+0000 7fca761cc740 1 -- 172.21.15.18:0/167627520 wait complete. 2024-09-12T02:52:36.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.814+0000 7fca761cc740 1 -- start start 2024-09-12T02:52:36.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.815+0000 7fca761cc740 1 Processor -- start 2024-09-12T02:52:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.828+0000 7fca761cc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260ee0b00 0x55d260ee5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.828+0000 7fca761cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee1c40 0x55d260ee5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.828+0000 7fca761cc740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260eeb3a0 0x55d260ee5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.828+0000 7fca761cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c0115a0 con 0x55d260ee1c40 2024-09-12T02:52:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.828+0000 7fca761cc740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c010e10 con 0x55d260eeb3a0 2024-09-12T02:52:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.828+0000 7fca761cc740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c00df90 con 0x55d260ee0b00 2024-09-12T02:52:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.828+0000 7fca761cc740 10 client.0 _ll_register_callbacks cb 0x7fca58009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.829+0000 7fca71200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260eeb3a0 0x55d260ee5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.830+0000 7fca71200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260eeb3a0 0x55d260ee5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:42560/0 (socket says 172.21.15.18:42560) 2024-09-12T02:52:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.830+0000 7fca71200640 1 -- 172.21.15.18:0/1556329600 learned_addr learned my addr 172.21.15.18:0/1556329600 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:52:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.830+0000 7fca6be00640 1 --2- 172.21.15.18:0/1556329600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260ee0b00 0x55d260ee5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.830+0000 7fca6be00640 1 -- 172.21.15.18:0/1556329600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260eeb3a0 msgr2=0x55d260ee5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.830+0000 7fca6be00640 1 --2- 172.21.15.18:0/1556329600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260eeb3a0 0x55d260ee5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.830+0000 7fca6be00640 1 -- 172.21.15.18:0/1556329600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee1c40 msgr2=0x55d260ee5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.831+0000 7fca6b400640 1 --2- 172.21.15.18:0/1556329600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee1c40 0x55d260ee5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.831+0000 7fca6be00640 1 --2- 172.21.15.18:0/1556329600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee1c40 0x55d260ee5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.831+0000 7fca6be00640 1 -- 172.21.15.18:0/1556329600 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d260f64ea0 con 0x55d260ee0b00 2024-09-12T02:52:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.831+0000 7fca6b400640 1 --2- 172.21.15.18:0/1556329600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee1c40 0x55d260ee5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:52:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.837+0000 7fca6be00640 1 --2- 172.21.15.18:0/1556329600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260ee0b00 0x55d260ee5550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fca58009230 tx=0x7fca5802a480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=971a40e19ccc8c38 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.839+0000 7fca56000640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:52:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.839+0000 7fca56000640 1 -- 172.21.15.18:0/1556329600 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58005250 con 0x55d260ee0b00 2024-09-12T02:52:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.839+0000 7fca56000640 1 -- 172.21.15.18:0/1556329600 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fca580319c0 con 0x55d260ee0b00 2024-09-12T02:52:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.847+0000 7fca761cc740 1 -- 172.21.15.18:0/1556329600 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca5c004040 con 0x55d260ee0b00 2024-09-12T02:52:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.876+0000 7fca56000640 1 -- 172.21.15.18:0/1556329600 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fca58004bf0 con 0x55d260ee0b00 2024-09-12T02:52:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.881+0000 7fca761cc740 10 client.25540 fetch_fsmap learned FSMap version 41 2024-09-12T02:52:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.881+0000 7fca761cc740 1 -- 172.21.15.18:0/1556329600 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55d260f66150 con 0x55d260ee0b00 2024-09-12T02:52:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.887+0000 7fca56000640 1 -- 172.21.15.18:0/1556329600 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca5c004040 con 0x55d260ee0b00 2024-09-12T02:52:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.887+0000 7fca56000640 1 -- 172.21.15.18:0/1556329600 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 41) ==== 8402+0+0 (secure 0 0 0) 0x7fca58077020 con 0x55d260ee0b00 2024-09-12T02:52:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.887+0000 7fca761cc740 10 client.25540 fetch_fsmap finished waiting for FSMap version 41 2024-09-12T02:52:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.887+0000 7fca761cc740 10 client.25540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.887+0000 7fca761cc740 20 client.25540 populate_metadata read hostname 'smithi018' 2024-09-12T02:52:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.887+0000 7fca761cc740 1 --2- 172.21.15.18:0/1556329600 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d260f66810 0x55d260f68c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.887+0000 7fca761cc740 4 client.25540 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:52:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.887+0000 7fca761cc740 1 -- 172.21.15.18:0/1556329600 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d260e4db80 con 0x55d260f66810 2024-09-12T02:52:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.891+0000 7fca6b400640 1 --2- 172.21.15.18:0/1556329600 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d260f66810 0x55d260f68c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.902+0000 7fca6b400640 1 --2- 172.21.15.18:0/1556329600 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d260f66810 0x55d260f68c00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdd6d468eece84fb server_cookie=a96d78bb7e6f93ae in_seq=0 out_seq=0 2024-09-12T02:52:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:36.904+0000 7fca56000640 10 client.25540 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:52:37.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:36 smithi018 ceph-mon[30616]: pgmap v119: 129 pgs: 129 active+clean; 934 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 12 MiB/s wr, 483 op/s 2024-09-12T02:52:37.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:36 smithi176 ceph-mon[35713]: pgmap v119: 129 pgs: 129 active+clean; 934 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 12 MiB/s wr, 483 op/s 2024-09-12T02:52:37.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:36 smithi062 ceph-mon[35527]: pgmap v119: 129 pgs: 129 active+clean; 934 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 12 MiB/s wr, 483 op/s 2024-09-12T02:52:39.157 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:38 smithi018 ceph-mon[30616]: pgmap v120: 129 pgs: 129 active+clean; 950 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 492 op/s 2024-09-12T02:52:39.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:38 smithi176 ceph-mon[35713]: pgmap v120: 129 pgs: 129 active+clean; 950 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 492 op/s 2024-09-12T02:52:39.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:38 smithi062 ceph-mon[35527]: pgmap v120: 129 pgs: 129 active+clean; 950 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 492 op/s 2024-09-12T02:52:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.529+0000 7fca56000640 1 -- 172.21.15.18:0/1556329600 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d260e4db80 con 0x55d260f66810 2024-09-12T02:52:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.530+0000 7fca56000640 10 client.25540 handle_command_reply: tid=0 2024-09-12T02:52:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.530+0000 7fca761cc740 1 client.25540 shutdown 2024-09-12T02:52:39.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.536+0000 7fca761cc740 1 -- 172.21.15.18:0/1556329600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260ee0b00 msgr2=0x55d260ee5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:39.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.536+0000 7fca761cc740 1 --2- 172.21.15.18:0/1556329600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260ee0b00 0x55d260ee5550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fca58009230 tx=0x7fca5802a480 comp rx=0 tx=0).stop 2024-09-12T02:52:39.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.537+0000 7fca761cc740 1 -- 172.21.15.18:0/1556329600 shutdown_connections 2024-09-12T02:52:39.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.537+0000 7fca761cc740 1 --2- 172.21.15.18:0/1556329600 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d260f66810 0x55d260f68c00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.537+0000 7fca761cc740 1 --2- 172.21.15.18:0/1556329600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d260eeb3a0 0x55d260ee5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.537+0000 7fca761cc740 1 --2- 172.21.15.18:0/1556329600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d260ee1c40 0x55d260ee5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.537+0000 7fca761cc740 1 --2- 172.21.15.18:0/1556329600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d260ee0b00 0x55d260ee5550 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.537+0000 7fca761cc740 1 -- 172.21.15.18:0/1556329600 >> 172.21.15.18:0/1556329600 conn(0x55d260edc750 msgr2=0x55d260ee2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:39.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.537+0000 7fca56000640 0 client.25540 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:52:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.537+0000 7fca761cc740 1 -- 172.21.15.18:0/1556329600 shutdown_connections 2024-09-12T02:52:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.538+0000 7fca761cc740 1 -- 172.21.15.18:0/1556329600 wait complete. 2024-09-12T02:52:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.543+0000 7fca761cc740 20 client.25540 trim_cache size 0 max 16384 2024-09-12T02:52:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:52:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:52:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:52:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:52:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.545+0000 7fca73200640 1 -- 172.21.15.18:0/3494480949 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fca500a2f80 msgr2=0x7fca500a5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.545+0000 7fca73200640 1 --2- 172.21.15.18:0/3494480949 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fca500a2f80 0x7fca500a5440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fca6c11d470 tx=0x7fca5c0090e0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.546+0000 7fca73200640 1 -- 172.21.15.18:0/3494480949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6c11b140 msgr2=0x7fca6c1aba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.546+0000 7fca73200640 1 --2- 172.21.15.18:0/3494480949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6c11b140 0x7fca6c1aba10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fca6400ecd0 tx=0x7fca6400c640 comp rx=0 tx=0).stop 2024-09-12T02:52:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.548+0000 7fca73200640 1 -- 172.21.15.18:0/3494480949 shutdown_connections 2024-09-12T02:52:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.549+0000 7fca73200640 1 --2- 172.21.15.18:0/3494480949 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fca500a2f80 0x7fca500a5440 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.549+0000 7fca73200640 1 --2- 172.21.15.18:0/3494480949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6c11b140 0x7fca6c1aba10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.549+0000 7fca73200640 1 --2- 172.21.15.18:0/3494480949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca6c1095d0 0x7fca6c1a7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.549+0000 7fca73200640 1 --2- 172.21.15.18:0/3494480949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca6c1091f0 0x7fca6c1a7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.549+0000 7fca73200640 1 -- 172.21.15.18:0/3494480949 >> 172.21.15.18:0/3494480949 conn(0x7fca6c06ce00 msgr2=0x7fca6c11b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.549+0000 7fca73200640 1 -- 172.21.15.18:0/3494480949 shutdown_connections 2024-09-12T02:52:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:39.550+0000 7fca73200640 1 -- 172.21.15.18:0/3494480949 wait complete. 2024-09-12T02:52:40.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:39 smithi176 ceph-mon[35713]: pgmap v121: 129 pgs: 129 active+clean; 960 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 763 op/s 2024-09-12T02:52:40.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:39 smithi062 ceph-mon[35527]: pgmap v121: 129 pgs: 129 active+clean; 960 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 763 op/s 2024-09-12T02:52:40.371 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:39 smithi018 ceph-mon[30616]: pgmap v121: 129 pgs: 129 active+clean; 960 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 763 op/s 2024-09-12T02:52:42.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:42 smithi176 ceph-mon[35713]: pgmap v122: 129 pgs: 129 active+clean; 960 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 10 MiB/s wr, 741 op/s 2024-09-12T02:52:42.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:42 smithi062 ceph-mon[35527]: pgmap v122: 129 pgs: 129 active+clean; 960 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 10 MiB/s wr, 741 op/s 2024-09-12T02:52:42.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:42 smithi018 ceph-mon[30616]: pgmap v122: 129 pgs: 129 active+clean; 960 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 10 MiB/s wr, 741 op/s 2024-09-12T02:52:43.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:43 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:52:43.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:43 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:52:43.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:43 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:52:44.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:44 smithi176 ceph-mon[35713]: pgmap v123: 129 pgs: 129 active+clean; 960 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 10 MiB/s wr, 813 op/s 2024-09-12T02:52:44.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:44 smithi062 ceph-mon[35527]: pgmap v123: 129 pgs: 129 active+clean; 960 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 10 MiB/s wr, 813 op/s 2024-09-12T02:52:44.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:44 smithi018 ceph-mon[30616]: pgmap v123: 129 pgs: 129 active+clean; 960 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 10 MiB/s wr, 813 op/s 2024-09-12T02:52:44.904 INFO:tasks.workunit.client.0.smithi018.stdout: 308 600761 1642 391295 1671 76805 540 2024-09-12T02:52:46.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:46 smithi176 ceph-mon[35713]: pgmap v124: 129 pgs: 129 active+clean; 962 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 849 op/s 2024-09-12T02:52:46.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:46 smithi062 ceph-mon[35527]: pgmap v124: 129 pgs: 129 active+clean; 962 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 849 op/s 2024-09-12T02:52:46.610 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:46 smithi018 ceph-mon[30616]: pgmap v124: 129 pgs: 129 active+clean; 962 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 849 op/s 2024-09-12T02:52:48.365 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:48 smithi018 ceph-mon[30616]: pgmap v125: 129 pgs: 129 active+clean; 966 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 586 op/s 2024-09-12T02:52:48.365 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:48 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:52:48.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:48 smithi176 ceph-mon[35713]: pgmap v125: 129 pgs: 129 active+clean; 966 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 586 op/s 2024-09-12T02:52:48.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:48 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:52:48.536 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:48 smithi062 ceph-mon[35527]: pgmap v125: 129 pgs: 129 active+clean; 966 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 586 op/s 2024-09-12T02:52:48.536 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:48 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:52:50.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:50 smithi176 ceph-mon[35713]: pgmap v126: 129 pgs: 129 active+clean; 987 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.3 MiB/s wr, 620 op/s 2024-09-12T02:52:50.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:50 smithi062 ceph-mon[35527]: pgmap v126: 129 pgs: 129 active+clean; 987 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.3 MiB/s wr, 620 op/s 2024-09-12T02:52:50.604 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:50 smithi018 ceph-mon[30616]: pgmap v126: 129 pgs: 129 active+clean; 987 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.3 MiB/s wr, 620 op/s 2024-09-12T02:52:52.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:52 smithi176 ceph-mon[35713]: pgmap v127: 129 pgs: 129 active+clean; 990 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 340 op/s 2024-09-12T02:52:52.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:52 smithi062 ceph-mon[35527]: pgmap v127: 129 pgs: 129 active+clean; 990 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 340 op/s 2024-09-12T02:52:52.606 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:52 smithi018 ceph-mon[30616]: pgmap v127: 129 pgs: 129 active+clean; 990 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 340 op/s 2024-09-12T02:52:54.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:54 smithi062 ceph-mon[35527]: pgmap v128: 129 pgs: 129 active+clean; 997 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 306 op/s 2024-09-12T02:52:54.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:54 smithi018 ceph-mon[30616]: pgmap v128: 129 pgs: 129 active+clean; 997 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 306 op/s 2024-09-12T02:52:54.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:54 smithi176 ceph-mon[35713]: pgmap v128: 129 pgs: 129 active+clean; 997 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 306 op/s 2024-09-12T02:52:54.928 INFO:tasks.workunit.client.0.smithi018.stdout: 327 546851 1073 364357 1147 75888 853 2024-09-12T02:52:56.507 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:56 smithi018 ceph-mon[30616]: pgmap v129: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 10 MiB/s wr, 489 op/s 2024-09-12T02:52:56.530 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:56 smithi176 ceph-mon[35713]: pgmap v129: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 10 MiB/s wr, 489 op/s 2024-09-12T02:52:56.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:56 smithi062 ceph-mon[35527]: pgmap v129: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 10 MiB/s wr, 489 op/s 2024-09-12T02:52:56.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.910+0000 7f88f4800640 1 -- 172.21.15.18:0/4243561620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec1095d0 msgr2=0x7f88ec109a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:56.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.910+0000 7f88f4800640 1 --2- 172.21.15.18:0/4243561620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec1095d0 0x7f88ec109a10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009890 tx=0x7f88dc02a390 comp rx=0 tx=0).stop 2024-09-12T02:52:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.913+0000 7f88f4800640 1 -- 172.21.15.18:0/4243561620 shutdown_connections 2024-09-12T02:52:56.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.913+0000 7f88f4800640 1 --2- 172.21.15.18:0/4243561620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88ec11b140 0x7f88ec11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.913+0000 7f88f4800640 1 --2- 172.21.15.18:0/4243561620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec1095d0 0x7f88ec109a10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.913+0000 7f88f4800640 1 --2- 172.21.15.18:0/4243561620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88ec1091f0 0x7f88ec110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.913+0000 7f88f4800640 1 -- 172.21.15.18:0/4243561620 >> 172.21.15.18:0/4243561620 conn(0x7f88ec06ce00 msgr2=0x7f88ec06d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:56.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.950+0000 7f88f4800640 1 -- 172.21.15.18:0/4243561620 shutdown_connections 2024-09-12T02:52:56.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.952+0000 7f88f4800640 1 -- 172.21.15.18:0/4243561620 wait complete. 2024-09-12T02:52:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.955+0000 7f88f4800640 1 Processor -- start 2024-09-12T02:52:56.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.957+0000 7f88f4800640 1 -- start start 2024-09-12T02:52:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.963+0000 7f88f4800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec1091f0 0x7f88ec11a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.964+0000 7f88f4800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88ec1095d0 0x7f88ec11abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.965+0000 7f88f1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88ec1095d0 0x7f88ec11abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.965+0000 7f88f1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88ec1095d0 0x7f88ec11abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56002/0 (socket says 172.21.15.18:56002) 2024-09-12T02:52:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.966+0000 7f88f1400640 1 -- 172.21.15.18:0/3331678349 learned_addr learned my addr 172.21.15.18:0/3331678349 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:52:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.967+0000 7f88f4800640 1 --2- 172.21.15.18:0/3331678349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88ec11b140 0x7f88ec116920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.969+0000 7f88f4800640 1 -- 172.21.15.18:0/3331678349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec113340 con 0x7f88ec1095d0 2024-09-12T02:52:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.969+0000 7f88f4800640 1 -- 172.21.15.18:0/3331678349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec1131c0 con 0x7f88ec1091f0 2024-09-12T02:52:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.969+0000 7f88f4800640 1 -- 172.21.15.18:0/3331678349 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec1134c0 con 0x7f88ec11b140 2024-09-12T02:52:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.969+0000 7f88f1400640 1 -- 172.21.15.18:0/3331678349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88ec11b140 msgr2=0x7f88ec116920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:52:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.969+0000 7f88f1400640 1 --2- 172.21.15.18:0/3331678349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88ec11b140 0x7f88ec116920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.969+0000 7f88f1400640 1 -- 172.21.15.18:0/3331678349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec1091f0 msgr2=0x7f88ec11a690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:52:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.969+0000 7f88f1400640 1 --2- 172.21.15.18:0/3331678349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec1091f0 0x7f88ec11a690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.969+0000 7f88f1400640 1 -- 172.21.15.18:0/3331678349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ec1171e0 con 0x7f88ec1095d0 2024-09-12T02:52:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.972+0000 7f88f1400640 1 --2- 172.21.15.18:0/3331678349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88ec1095d0 0x7f88ec11abd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f88dc035040 tx=0x7f88dc030fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.973+0000 7f88e6a00640 1 -- 172.21.15.18:0/3331678349 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc037040 con 0x7f88ec1095d0 2024-09-12T02:52:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.973+0000 7f88e6a00640 1 -- 172.21.15.18:0/3331678349 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88dc042070 con 0x7f88ec1095d0 2024-09-12T02:52:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.973+0000 7f88e6a00640 1 -- 172.21.15.18:0/3331678349 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc03d440 con 0x7f88ec1095d0 2024-09-12T02:52:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.974+0000 7f88f4800640 1 -- 172.21.15.18:0/3331678349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ec117470 con 0x7f88ec1095d0 2024-09-12T02:52:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.974+0000 7f88f4800640 1 -- 172.21.15.18:0/3331678349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ec1ab250 con 0x7f88ec1095d0 2024-09-12T02:52:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:56.999+0000 7f88f7810740 1 Processor -- start 2024-09-12T02:52:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.002+0000 7f88e6a00640 1 -- 172.21.15.18:0/3331678349 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f88dc0035f0 con 0x7f88ec1095d0 2024-09-12T02:52:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.004+0000 7f88e6a00640 1 --2- 172.21.15.18:0/3331678349 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f88d40a2f50 0x7f88d40a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.007+0000 7f88f7810740 1 -- start start 2024-09-12T02:52:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.008+0000 7f88f7810740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 0x5559b9e9e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.008+0000 7f88f7810740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9e9eb20 0x5559b9ea8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.008+0000 7f88f7810740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9ea93c0 0x5559b9eab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.008+0000 7f88f7810740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5559b9e04100 con 0x5559b9e9e200 2024-09-12T02:52:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.008+0000 7f88f7810740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5559b9dac1b0 con 0x5559b9e9eb20 2024-09-12T02:52:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.008+0000 7f88f7810740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5559b9e000c0 con 0x5559b9ea93c0 2024-09-12T02:52:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.009+0000 7f88f2800640 1 --2- 172.21.15.18:0/3331678349 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f88d40a2f50 0x7f88d40a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.010+0000 7f88f1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 0x5559b9e9e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.011+0000 7f88f1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 0x5559b9e9e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56016/0 (socket says 172.21.15.18:56016) 2024-09-12T02:52:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.011+0000 7f88f1e00640 1 -- 172.21.15.18:0/2280450992 learned_addr learned my addr 172.21.15.18:0/2280450992 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:52:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.020+0000 7f88e6a00640 1 -- 172.21.15.18:0/3331678349 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f88dc0b9ef0 con 0x7f88ec1095d0 2024-09-12T02:52:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.021+0000 7f88f2800640 1 --2- 172.21.15.18:0/2280450992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9ea93c0 0x5559b9eab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.022+0000 7f88f1e00640 1 -- 172.21.15.18:0/2280450992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9ea93c0 msgr2=0x5559b9eab7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:57.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.022+0000 7f88f1e00640 1 --2- 172.21.15.18:0/2280450992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9ea93c0 0x5559b9eab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.022+0000 7f88f1e00640 1 -- 172.21.15.18:0/2280450992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9e9eb20 msgr2=0x5559b9ea8e80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:52:57.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.022+0000 7f88f1e00640 1 --2- 172.21.15.18:0/2280450992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9e9eb20 0x5559b9ea8e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.022+0000 7f88f1e00640 1 -- 172.21.15.18:0/2280450992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559b9b17210 con 0x5559b9e9e200 2024-09-12T02:52:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.044+0000 7f88f1e00640 1 --2- 172.21.15.18:0/2280450992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 0x5559b9e9e5e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009780 tx=0x7f88e0009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440a99ed97d6538b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.045+0000 7f88f2800640 1 --2- 172.21.15.18:0/3331678349 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f88d40a2f50 0x7f88d40a5410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f88e8005c40 tx=0x7f88e801ae30 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.052+0000 7f88db000640 1 -- 172.21.15.18:0/2280450992 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e0015020 con 0x5559b9e9e200 2024-09-12T02:52:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.052+0000 7f88db000640 1 -- 172.21.15.18:0/2280450992 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88e0011420 con 0x5559b9e9e200 2024-09-12T02:52:57.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.052+0000 7f88db000640 1 -- 172.21.15.18:0/2280450992 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e00105e0 con 0x5559b9e9e200 2024-09-12T02:52:57.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.072+0000 7f88f7810740 1 -- 172.21.15.18:0/2280450992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 msgr2=0x5559b9e9e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:57.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.072+0000 7f88f7810740 1 --2- 172.21.15.18:0/2280450992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 0x5559b9e9e5e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009780 tx=0x7f88e0009c40 comp rx=0 tx=0).stop 2024-09-12T02:52:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.092+0000 7f88f7810740 1 -- 172.21.15.18:0/2280450992 shutdown_connections 2024-09-12T02:52:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.092+0000 7f88f7810740 1 --2- 172.21.15.18:0/2280450992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9ea93c0 0x5559b9eab7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.092+0000 7f88f7810740 1 --2- 172.21.15.18:0/2280450992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9e9eb20 0x5559b9ea8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.092+0000 7f88f7810740 1 --2- 172.21.15.18:0/2280450992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 0x5559b9e9e5e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.092+0000 7f88f7810740 1 -- 172.21.15.18:0/2280450992 >> 172.21.15.18:0/2280450992 conn(0x5559b9e9a770 msgr2=0x5559b9e9ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.103+0000 7f88f7810740 1 -- 172.21.15.18:0/2280450992 shutdown_connections 2024-09-12T02:52:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.106+0000 7f88f7810740 1 -- 172.21.15.18:0/2280450992 wait complete. 2024-09-12T02:52:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.107+0000 7f88f7810740 1 -- start start 2024-09-12T02:52:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.107+0000 7f88f7810740 1 Processor -- start 2024-09-12T02:52:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.117+0000 7f88f7810740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9e200 0x5559b9ea6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.127+0000 7f88f7810740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9e9eb20 0x5559b9ea68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.128+0000 7f88f1e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9e200 0x5559b9ea6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.129+0000 7f88f1e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9e200 0x5559b9ea6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:59286/0 (socket says 172.21.15.18:59286) 2024-09-12T02:52:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.130+0000 7f88f7810740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9ea93c0 0x5559b9ea6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.130+0000 7f88f7810740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5559b9eabf90 con 0x5559b9ea93c0 2024-09-12T02:52:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.130+0000 7f88f7810740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5559b9d8d090 con 0x5559b9e9eb20 2024-09-12T02:52:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.130+0000 7f88f7810740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5559b9eac110 con 0x5559b9e9e200 2024-09-12T02:52:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.131+0000 7f88f7810740 10 client.0 _ll_register_callbacks cb 0x5559b9de1f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.131+0000 7f88f2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9ea93c0 0x5559b9ea6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.133+0000 7f88f1400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9e9eb20 0x5559b9ea68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.133+0000 7f88f1400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9e9eb20 0x5559b9ea68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:39062/0 (socket says 172.21.15.18:39062) 2024-09-12T02:52:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.133+0000 7f88f1400640 1 -- 172.21.15.18:0/2204416042 learned_addr learned my addr 172.21.15.18:0/2204416042 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:52:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.134+0000 7f88f1400640 1 -- 172.21.15.18:0/2204416042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9e200 msgr2=0x5559b9ea6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.134+0000 7f88f1400640 1 --2- 172.21.15.18:0/2204416042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9e200 0x5559b9ea6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.134+0000 7f88f1400640 1 -- 172.21.15.18:0/2204416042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9ea93c0 msgr2=0x5559b9ea6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:57.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.134+0000 7f88f1400640 1 --2- 172.21.15.18:0/2204416042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9ea93c0 0x5559b9ea6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.134+0000 7f88f1400640 1 -- 172.21.15.18:0/2204416042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559b9be3620 con 0x5559b9e9eb20 2024-09-12T02:52:57.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.137+0000 7f88f1e00640 1 --2- 172.21.15.18:0/2204416042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9e200 0x5559b9ea6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-12T02:52:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.142+0000 7f88cf400640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:52:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.142+0000 7f88f1400640 1 --2- 172.21.15.18:0/2204416042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9e9eb20 0x5559b9ea68a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0b92a0 tx=0x7f88dc0c3510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=603aed48787619c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.143+0000 7f88cf400640 1 -- 172.21.15.18:0/2204416042 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0b8880 con 0x5559b9e9eb20 2024-09-12T02:52:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.144+0000 7f88cf400640 1 -- 172.21.15.18:0/2204416042 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f88dc0ed1f0 con 0x5559b9e9eb20 2024-09-12T02:52:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.166+0000 7f88f7810740 1 -- 172.21.15.18:0/2204416042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88e0011420 con 0x5559b9e9eb20 2024-09-12T02:52:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.180+0000 7f88cf400640 1 -- 172.21.15.18:0/2204416042 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f88dc0b8880 con 0x5559b9e9eb20 2024-09-12T02:52:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.182+0000 7f88f7810740 10 client.25538 fetch_fsmap learned FSMap version 43 2024-09-12T02:52:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.182+0000 7f88f7810740 1 -- 172.21.15.18:0/2204416042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5559b9eb7bf0 con 0x5559b9e9eb20 2024-09-12T02:52:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.185+0000 7f88cf400640 1 -- 172.21.15.18:0/2204416042 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88e0011420 con 0x5559b9e9eb20 2024-09-12T02:52:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.185+0000 7f88cf400640 1 -- 172.21.15.18:0/2204416042 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 43) ==== 8418+0+0 (secure 0 0 0) 0x7f88dc03a030 con 0x5559b9e9eb20 2024-09-12T02:52:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.186+0000 7f88f7810740 10 client.25538 fetch_fsmap finished waiting for FSMap version 43 2024-09-12T02:52:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.186+0000 7f88f7810740 10 client.25538 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.186+0000 7f88f7810740 20 client.25538 populate_metadata read hostname 'smithi018' 2024-09-12T02:52:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.187+0000 7f88f7810740 1 --2- 172.21.15.18:0/2204416042 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5559b9eb8fe0 0x5559b9ebb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.187+0000 7f88f7810740 4 client.25538 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:52:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.187+0000 7f88f7810740 1 -- 172.21.15.18:0/2204416042 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559b9e11830 con 0x5559b9eb8fe0 2024-09-12T02:52:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.187+0000 7f88f1e00640 1 --2- 172.21.15.18:0/2204416042 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5559b9eb8fe0 0x5559b9ebb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.192+0000 7f88f1e00640 1 --2- 172.21.15.18:0/2204416042 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5559b9eb8fe0 0x5559b9ebb410 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a077c7c5ae01b07 server_cookie=bd5be30cc1c194f in_seq=0 out_seq=0 2024-09-12T02:52:57.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.204+0000 7f88cf400640 10 client.25538 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:52:57.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.204+0000 7f88cf400640 1 -- 172.21.15.18:0/2204416042 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559b9e11830 con 0x5559b9eb8fe0 2024-09-12T02:52:57.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.204+0000 7f88cf400640 10 client.25538 handle_command_reply: tid=0 2024-09-12T02:52:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.214+0000 7f88f7810740 1 client.25538 shutdown 2024-09-12T02:52:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.216+0000 7f88f7810740 1 -- 172.21.15.18:0/2204416042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9e9eb20 msgr2=0x5559b9ea68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.216+0000 7f88f7810740 1 --2- 172.21.15.18:0/2204416042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9e9eb20 0x5559b9ea68a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0b92a0 tx=0x7f88dc0c3510 comp rx=0 tx=0).stop 2024-09-12T02:52:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.219+0000 7f88f7810740 1 -- 172.21.15.18:0/2204416042 shutdown_connections 2024-09-12T02:52:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.219+0000 7f88f7810740 1 --2- 172.21.15.18:0/2204416042 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5559b9eb8fe0 0x5559b9ebb410 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.219+0000 7f88f7810740 1 --2- 172.21.15.18:0/2204416042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9ea93c0 0x5559b9ea6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.219+0000 7f88cf400640 0 client.25538 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:52:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.219+0000 7f88f7810740 1 --2- 172.21.15.18:0/2204416042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9e9eb20 0x5559b9ea68a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.219+0000 7f88f7810740 1 --2- 172.21.15.18:0/2204416042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9e200 0x5559b9ea6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.219+0000 7f88f7810740 1 -- 172.21.15.18:0/2204416042 >> 172.21.15.18:0/2204416042 conn(0x5559b9e9a770 msgr2=0x5559b9ea04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:57.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.243+0000 7f88f7810740 1 -- 172.21.15.18:0/2204416042 shutdown_connections 2024-09-12T02:52:57.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.252+0000 7f88f7810740 1 -- 172.21.15.18:0/2204416042 wait complete. 2024-09-12T02:52:57.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.254+0000 7f88f7810740 20 client.25538 trim_cache size 0 max 16384 2024-09-12T02:52:57.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.727+0000 7f88f7810740 1 Processor -- start 2024-09-12T02:52:57.749 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.747+0000 7f88f7810740 1 -- start start 2024-09-12T02:52:57.749 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.748+0000 7f88f7810740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 0x5559b9ea82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.748+0000 7f88f7810740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9eb20 0x5559b9ec0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.748+0000 7f88f7810740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9ea93c0 0x5559b9ec1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.748+0000 7f88f7810740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec1b56b0 con 0x5559b9e9e200 2024-09-12T02:52:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.748+0000 7f88f7810740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec1b7370 con 0x5559b9ea93c0 2024-09-12T02:52:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.748+0000 7f88f7810740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec1b5e40 con 0x5559b9e9eb20 2024-09-12T02:52:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.748+0000 7f88f1400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9eb20 0x5559b9ec0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.748+0000 7f88f1400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9eb20 0x5559b9ec0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:59290/0 (socket says 172.21.15.18:59290) 2024-09-12T02:52:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.748+0000 7f88f1400640 1 -- 172.21.15.18:0/2911239130 learned_addr learned my addr 172.21.15.18:0/2911239130 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:52:57.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.751+0000 7f88f2800640 1 --2- 172.21.15.18:0/2911239130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9ea93c0 0x5559b9ec1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.752+0000 7f88f1e00640 1 --2- 172.21.15.18:0/2911239130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 0x5559b9ea82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.762+0000 7f88f1400640 1 -- 172.21.15.18:0/2911239130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9ea93c0 msgr2=0x5559b9ec1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.762+0000 7f88f1400640 1 --2- 172.21.15.18:0/2911239130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9ea93c0 0x5559b9ec1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.762+0000 7f88f1400640 1 -- 172.21.15.18:0/2911239130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 msgr2=0x5559b9ea82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.762+0000 7f88f1400640 1 --2- 172.21.15.18:0/2911239130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 0x5559b9ea82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.762+0000 7f88f1400640 1 -- 172.21.15.18:0/2911239130 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559b9ea52f0 con 0x5559b9e9eb20 2024-09-12T02:52:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.765+0000 7f88f1400640 1 --2- 172.21.15.18:0/2911239130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9eb20 0x5559b9ec0d20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0b90d0 tx=0x7f88dc000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6ebde54f2f67bfb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.766+0000 7f88da600640 1 -- 172.21.15.18:0/2911239130 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0b8a20 con 0x5559b9e9eb20 2024-09-12T02:52:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.766+0000 7f88da600640 1 -- 172.21.15.18:0/2911239130 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88dc0be070 con 0x5559b9e9eb20 2024-09-12T02:52:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.766+0000 7f88da600640 1 -- 172.21.15.18:0/2911239130 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0b8bc0 con 0x5559b9e9eb20 2024-09-12T02:52:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.782+0000 7f88f7810740 1 -- 172.21.15.18:0/2911239130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9eb20 msgr2=0x5559b9ec0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:52:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.782+0000 7f88f7810740 1 --2- 172.21.15.18:0/2911239130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9eb20 0x5559b9ec0d20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0b90d0 tx=0x7f88dc000bc0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.810+0000 7f88f7810740 1 -- 172.21.15.18:0/2911239130 shutdown_connections 2024-09-12T02:52:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.810+0000 7f88f7810740 1 --2- 172.21.15.18:0/2911239130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9ea93c0 0x5559b9ec1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.810+0000 7f88f7810740 1 --2- 172.21.15.18:0/2911239130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9eb20 0x5559b9ec0d20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.810+0000 7f88f7810740 1 --2- 172.21.15.18:0/2911239130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 0x5559b9ea82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.810+0000 7f88f7810740 1 -- 172.21.15.18:0/2911239130 >> 172.21.15.18:0/2911239130 conn(0x5559b9e9a770 msgr2=0x5559b9e9f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:52:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.818+0000 7f88f7810740 1 -- 172.21.15.18:0/2911239130 shutdown_connections 2024-09-12T02:52:57.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.819+0000 7f88f7810740 1 -- 172.21.15.18:0/2911239130 wait complete. 2024-09-12T02:52:57.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.819+0000 7f88f7810740 1 -- start start 2024-09-12T02:52:57.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.820+0000 7f88f7810740 1 Processor -- start 2024-09-12T02:52:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.835+0000 7f88f7810740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 0x5559b9ead730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.835+0000 7f88f1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 0x5559b9ead730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.836+0000 7f88f1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 0x5559b9ead730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56044/0 (socket says 172.21.15.18:56044) 2024-09-12T02:52:57.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.836+0000 7f88f1e00640 1 -- 172.21.15.18:0/1599442412 learned_addr learned my addr 172.21.15.18:0/1599442412 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:52:57.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.848+0000 7f88f7810740 1 --2- 172.21.15.18:0/1599442412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9eb20 0x5559b9eadc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.848+0000 7f88f7810740 1 --2- 172.21.15.18:0/1599442412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9ea93c0 0x5559b9f22cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.848+0000 7f88f7810740 1 -- 172.21.15.18:0/1599442412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec1b6ca0 con 0x5559b9e9e200 2024-09-12T02:52:57.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.848+0000 7f88f7810740 1 -- 172.21.15.18:0/1599442412 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec1b6510 con 0x5559b9ea93c0 2024-09-12T02:52:57.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.848+0000 7f88f7810740 1 -- 172.21.15.18:0/1599442412 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec1b3630 con 0x5559b9e9eb20 2024-09-12T02:52:57.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.848+0000 7f88f7810740 10 client.0 _ll_register_callbacks cb 0x7f88dc044900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:52:57.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.849+0000 7f88f2800640 1 --2- 172.21.15.18:0/1599442412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9ea93c0 0x5559b9f22cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.849+0000 7f88f1400640 1 --2- 172.21.15.18:0/1599442412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9eb20 0x5559b9eadc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.850+0000 7f88f2800640 1 -- 172.21.15.18:0/1599442412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9eb20 msgr2=0x5559b9eadc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:57.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.850+0000 7f88f2800640 1 --2- 172.21.15.18:0/1599442412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9eb20 0x5559b9eadc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.850+0000 7f88f2800640 1 -- 172.21.15.18:0/1599442412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 msgr2=0x5559b9ead730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:52:57.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.850+0000 7f88f2800640 1 --2- 172.21.15.18:0/1599442412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 0x5559b9ead730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:52:57.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.850+0000 7f88f2800640 1 -- 172.21.15.18:0/1599442412 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559b9f23230 con 0x5559b9ea93c0 2024-09-12T02:52:57.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.851+0000 7f88f2800640 1 --2- 172.21.15.18:0/1599442412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9ea93c0 0x5559b9f22cf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x5559b9ea0da0 tx=0x7f88e8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8311fcb81789d61 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:52:57.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.851+0000 7f88cf400640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:52:57.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.855+0000 7f88f1e00640 1 --2- 172.21.15.18:0/1599442412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 0x5559b9ead730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:52:57.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.855+0000 7f88cf400640 1 -- 172.21.15.18:0/1599442412 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e80306c0 con 0x5559b9ea93c0 2024-09-12T02:52:57.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.855+0000 7f88cf400640 1 -- 172.21.15.18:0/1599442412 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f88e8030860 con 0x5559b9ea93c0 2024-09-12T02:52:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.866+0000 7f88f7810740 1 -- 172.21.15.18:0/1599442412 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88dc0be070 con 0x5559b9ea93c0 2024-09-12T02:52:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.870+0000 7f88cf400640 1 -- 172.21.15.18:0/1599442412 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f88e8030a60 con 0x5559b9ea93c0 2024-09-12T02:52:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.870+0000 7f88f7810740 10 client.25544 fetch_fsmap learned FSMap version 43 2024-09-12T02:52:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.870+0000 7f88f7810740 1 -- 172.21.15.18:0/1599442412 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5559b9f24500 con 0x5559b9ea93c0 2024-09-12T02:52:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.871+0000 7f88cf400640 1 -- 172.21.15.18:0/1599442412 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88dc0be070 con 0x5559b9ea93c0 2024-09-12T02:52:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.871+0000 7f88cf400640 1 -- 172.21.15.18:0/1599442412 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 43) ==== 8418+0+0 (secure 0 0 0) 0x7f88e8043420 con 0x5559b9ea93c0 2024-09-12T02:52:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.873+0000 7f88f7810740 10 client.25544 fetch_fsmap finished waiting for FSMap version 43 2024-09-12T02:52:57.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.873+0000 7f88f7810740 10 client.25544 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:52:57.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.874+0000 7f88f7810740 20 client.25544 populate_metadata read hostname 'smithi018' 2024-09-12T02:52:57.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.874+0000 7f88f7810740 1 --2- 172.21.15.18:0/1599442412 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5559b9f24c00 0x5559b9f27020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:52:57.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.874+0000 7f88f7810740 4 client.25544 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:52:57.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.874+0000 7f88f7810740 1 -- 172.21.15.18:0/1599442412 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5559b9e0bb80 con 0x5559b9f24c00 2024-09-12T02:52:57.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.874+0000 7f88f1e00640 1 --2- 172.21.15.18:0/1599442412 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5559b9f24c00 0x5559b9f27020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:52:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.875+0000 7f88f1e00640 1 --2- 172.21.15.18:0/1599442412 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5559b9f24c00 0x5559b9f27020 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ddeac0e946ad039 server_cookie=81ef6dba945e783c in_seq=0 out_seq=0 2024-09-12T02:52:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:52:57.875+0000 7f88cf400640 10 client.25544 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:52:58.258 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:52:58 smithi018 ceph-mon[30616]: pgmap v130: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 510 op/s 2024-09-12T02:52:58.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:52:58 smithi062 ceph-mon[35527]: pgmap v130: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 510 op/s 2024-09-12T02:52:58.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:52:58 smithi176 ceph-mon[35713]: pgmap v130: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 510 op/s 2024-09-12T02:53:00.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:00 smithi062 ceph-mon[35527]: pgmap v131: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 15 MiB/s wr, 845 op/s 2024-09-12T02:53:00.603 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:00 smithi018 ceph-mon[30616]: pgmap v131: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 15 MiB/s wr, 845 op/s 2024-09-12T02:53:00.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:00 smithi176 ceph-mon[35713]: pgmap v131: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 15 MiB/s wr, 845 op/s 2024-09-12T02:53:02.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:02 smithi062 ceph-mon[35527]: pgmap v132: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 14 MiB/s wr, 843 op/s 2024-09-12T02:53:02.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:02 smithi018 ceph-mon[30616]: pgmap v132: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 14 MiB/s wr, 843 op/s 2024-09-12T02:53:02.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:02 smithi176 ceph-mon[35713]: pgmap v132: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 14 MiB/s wr, 843 op/s 2024-09-12T02:53:04.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.065+0000 7f88cf400640 1 -- 172.21.15.18:0/1599442412 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5559b9e0bb80 con 0x5559b9f24c00 2024-09-12T02:53:04.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.065+0000 7f88cf400640 10 client.25544 handle_command_reply: tid=0 2024-09-12T02:53:04.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.065+0000 7f88f7810740 1 client.25544 shutdown 2024-09-12T02:53:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.066+0000 7f88f7810740 1 -- 172.21.15.18:0/1599442412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9ea93c0 msgr2=0x5559b9f22cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.066+0000 7f88f7810740 1 --2- 172.21.15.18:0/1599442412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9ea93c0 0x5559b9f22cf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x5559b9ea0da0 tx=0x7f88e8004a40 comp rx=0 tx=0).stop 2024-09-12T02:53:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.066+0000 7f88f7810740 1 -- 172.21.15.18:0/1599442412 shutdown_connections 2024-09-12T02:53:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.066+0000 7f88f7810740 1 --2- 172.21.15.18:0/1599442412 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5559b9f24c00 0x5559b9f27020 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.066+0000 7f88f7810740 1 --2- 172.21.15.18:0/1599442412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559b9ea93c0 0x5559b9f22cf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.067+0000 7f88f7810740 1 --2- 172.21.15.18:0/1599442412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559b9e9eb20 0x5559b9eadc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.067+0000 7f88f7810740 1 --2- 172.21.15.18:0/1599442412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559b9e9e200 0x5559b9ead730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.067+0000 7f88f7810740 1 -- 172.21.15.18:0/1599442412 >> 172.21.15.18:0/1599442412 conn(0x5559b9e9a770 msgr2=0x5559b9eb4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:04.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.097+0000 7f88cf400640 0 client.25544 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:53:04.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.097+0000 7f88f7810740 1 -- 172.21.15.18:0/1599442412 shutdown_connections 2024-09-12T02:53:04.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:53:04.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:53:04.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:53:04.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:53:04.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.109+0000 7f88f7810740 1 -- 172.21.15.18:0/1599442412 wait complete. 2024-09-12T02:53:04.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.109+0000 7f88f7810740 20 client.25544 trim_cache size 0 max 16384 2024-09-12T02:53:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.131+0000 7f88f4800640 1 -- 172.21.15.18:0/3331678349 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f88d40a2f50 msgr2=0x7f88d40a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.131+0000 7f88f4800640 1 --2- 172.21.15.18:0/3331678349 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f88d40a2f50 0x7f88d40a5410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f88e8005c40 tx=0x7f88e801ae30 comp rx=0 tx=0).stop 2024-09-12T02:53:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.131+0000 7f88f4800640 1 -- 172.21.15.18:0/3331678349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88ec1095d0 msgr2=0x7f88ec11abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.131+0000 7f88f4800640 1 --2- 172.21.15.18:0/3331678349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88ec1095d0 0x7f88ec11abd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f88dc035040 tx=0x7f88dc030fb0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.145+0000 7f88f4800640 1 -- 172.21.15.18:0/3331678349 shutdown_connections 2024-09-12T02:53:04.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.145+0000 7f88f4800640 1 --2- 172.21.15.18:0/3331678349 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f88d40a2f50 0x7f88d40a5410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.145+0000 7f88f4800640 1 --2- 172.21.15.18:0/3331678349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88ec11b140 0x7f88ec116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.145+0000 7f88f4800640 1 --2- 172.21.15.18:0/3331678349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88ec1095d0 0x7f88ec11abd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.145+0000 7f88f4800640 1 --2- 172.21.15.18:0/3331678349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec1091f0 0x7f88ec11a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:04.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.145+0000 7f88f4800640 1 -- 172.21.15.18:0/3331678349 >> 172.21.15.18:0/3331678349 conn(0x7f88ec06ce00 msgr2=0x7f88ec070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:04.175 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.172+0000 7f88f4800640 1 -- 172.21.15.18:0/3331678349 shutdown_connections 2024-09-12T02:53:04.176 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:04.172+0000 7f88f4800640 1 -- 172.21.15.18:0/3331678349 wait complete. 2024-09-12T02:53:04.608 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:04 smithi018 ceph-mon[30616]: pgmap v133: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 15 MiB/s wr, 947 op/s 2024-09-12T02:53:04.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:04 smithi176 ceph-mon[35713]: pgmap v133: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 15 MiB/s wr, 947 op/s 2024-09-12T02:53:04.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:04 smithi062 ceph-mon[35527]: pgmap v133: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 15 MiB/s wr, 947 op/s 2024-09-12T02:53:04.914 INFO:tasks.workunit.client.0.smithi018.stdout: 336 492622 375 329321 423 71523 273 2024-09-12T02:53:06.604 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:06 smithi018 ceph-mon[30616]: pgmap v134: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-12T02:53:06.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:06 smithi176 ceph-mon[35713]: pgmap v134: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-12T02:53:06.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:06 smithi062 ceph-mon[35527]: pgmap v134: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-12T02:53:08.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:08 smithi018 ceph-mon[30616]: pgmap v135: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.4 MiB/s wr, 864 op/s 2024-09-12T02:53:08.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:08 smithi176 ceph-mon[35713]: pgmap v135: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.4 MiB/s wr, 864 op/s 2024-09-12T02:53:08.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:08 smithi062 ceph-mon[35527]: pgmap v135: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.4 MiB/s wr, 864 op/s 2024-09-12T02:53:09.604 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:09 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:53:09.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:09 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:53:09.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:09 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:53:10.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:10 smithi018 ceph-mon[30616]: pgmap v136: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.7 MiB/s wr, 872 op/s 2024-09-12T02:53:10.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:10 smithi176 ceph-mon[35713]: pgmap v136: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.7 MiB/s wr, 872 op/s 2024-09-12T02:53:10.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:10 smithi062 ceph-mon[35527]: pgmap v136: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.7 MiB/s wr, 872 op/s 2024-09-12T02:53:12.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:12 smithi018 ceph-mon[30616]: pgmap v137: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 522 op/s 2024-09-12T02:53:12.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:12 smithi176 ceph-mon[35713]: pgmap v137: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 522 op/s 2024-09-12T02:53:12.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:12 smithi062 ceph-mon[35527]: pgmap v137: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 522 op/s 2024-09-12T02:53:14.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:14 smithi018 ceph-mon[30616]: pgmap v138: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.7 MiB/s wr, 432 op/s 2024-09-12T02:53:14.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:14 smithi176 ceph-mon[35713]: pgmap v138: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.7 MiB/s wr, 432 op/s 2024-09-12T02:53:14.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:14 smithi062 ceph-mon[35527]: pgmap v138: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.7 MiB/s wr, 432 op/s 2024-09-12T02:53:14.917 INFO:tasks.workunit.client.0.smithi018.stdout: 365 596756 1815 396789 1398 87051 701 2024-09-12T02:53:16.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:16 smithi018 ceph-mon[30616]: pgmap v139: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 381 op/s 2024-09-12T02:53:16.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:16 smithi176 ceph-mon[35713]: pgmap v139: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 381 op/s 2024-09-12T02:53:16.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:16 smithi062 ceph-mon[35527]: pgmap v139: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 381 op/s 2024-09-12T02:53:18.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:18 smithi018 ceph-mon[30616]: pgmap v140: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 184 op/s 2024-09-12T02:53:18.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:18 smithi176 ceph-mon[35713]: pgmap v140: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 184 op/s 2024-09-12T02:53:18.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:18 smithi062 ceph-mon[35527]: pgmap v140: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 184 op/s 2024-09-12T02:53:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.258+0000 7f9caba00640 1 -- 172.21.15.18:0/758007728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ca4109b70 msgr2=0x7f9ca407b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.258+0000 7f9caba00640 1 --2- 172.21.15.18:0/758007728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ca4109b70 0x7f9ca407b060 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009ca0 tx=0x7f9c9c02a8f0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.314+0000 7f9caba00640 1 -- 172.21.15.18:0/758007728 shutdown_connections 2024-09-12T02:53:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.314+0000 7f9caba00640 1 --2- 172.21.15.18:0/758007728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ca4109b70 0x7f9ca407b060 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.314+0000 7f9caba00640 1 --2- 172.21.15.18:0/758007728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ca41091f0 0x7f9ca4109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.314+0000 7f9caba00640 1 --2- 172.21.15.18:0/758007728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ca410d610 0x7f9ca410d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.314+0000 7f9caba00640 1 -- 172.21.15.18:0/758007728 >> 172.21.15.18:0/758007728 conn(0x7f9ca406ce00 msgr2=0x7f9ca406d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.342+0000 7f9caba00640 1 -- 172.21.15.18:0/758007728 shutdown_connections 2024-09-12T02:53:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.345+0000 7f9caba00640 1 -- 172.21.15.18:0/758007728 wait complete. 2024-09-12T02:53:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.346+0000 7f9caba00640 1 Processor -- start 2024-09-12T02:53:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.355+0000 7f9caba00640 1 -- start start 2024-09-12T02:53:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.356+0000 7f9caba00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ca41091f0 0x7f9ca407aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.363+0000 7f9ca9000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ca41091f0 0x7f9ca407aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.363+0000 7f9ca9000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ca41091f0 0x7f9ca407aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:50662/0 (socket says 172.21.15.18:50662) 2024-09-12T02:53:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.364+0000 7f9ca9000640 1 -- 172.21.15.18:0/2116800174 learned_addr learned my addr 172.21.15.18:0/2116800174 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:53:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.365+0000 7f9caba00640 1 --2- 172.21.15.18:0/2116800174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ca4109b70 0x7f9ca4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.370+0000 7f9caba00640 1 --2- 172.21.15.18:0/2116800174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ca410d610 0x7f9ca4076470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.373+0000 7f9ca3e00640 1 --2- 172.21.15.18:0/2116800174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ca4109b70 0x7f9ca4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.374+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/2116800174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ca410d610 0x7f9ca4076470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.374+0000 7f9caba00640 1 -- 172.21.15.18:0/2116800174 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca407e770 con 0x7f9ca410d610 2024-09-12T02:53:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.374+0000 7f9caba00640 1 -- 172.21.15.18:0/2116800174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca407e5f0 con 0x7f9ca4109b70 2024-09-12T02:53:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.374+0000 7f9caba00640 1 -- 172.21.15.18:0/2116800174 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca407e8f0 con 0x7f9ca41091f0 2024-09-12T02:53:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.376+0000 7f9ca9a00640 1 -- 172.21.15.18:0/2116800174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ca41091f0 msgr2=0x7f9ca407aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.376+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/2116800174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ca41091f0 0x7f9ca407aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.376+0000 7f9ca9a00640 1 -- 172.21.15.18:0/2116800174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ca4109b70 msgr2=0x7f9ca4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.376+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/2116800174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ca4109b70 0x7f9ca4075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.376+0000 7f9ca9a00640 1 -- 172.21.15.18:0/2116800174 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca4076ce0 con 0x7f9ca410d610 2024-09-12T02:53:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.383+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/2116800174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ca410d610 0x7f9ca4076470 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c02aee0 tx=0x7f9c9c0316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.391+0000 7f9ca1600640 1 -- 172.21.15.18:0/2116800174 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c0319a0 con 0x7f9ca410d610 2024-09-12T02:53:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.392+0000 7f9ca1600640 1 -- 172.21.15.18:0/2116800174 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c9c02d070 con 0x7f9ca410d610 2024-09-12T02:53:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.392+0000 7f9ca1600640 1 -- 172.21.15.18:0/2116800174 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c02fc40 con 0x7f9ca410d610 2024-09-12T02:53:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.397+0000 7f9caba00640 1 -- 172.21.15.18:0/2116800174 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca41c4810 con 0x7f9ca410d610 2024-09-12T02:53:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.407+0000 7f9caba00640 1 -- 172.21.15.18:0/2116800174 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca41c4ce0 con 0x7f9ca410d610 2024-09-12T02:53:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.467+0000 7f9cae869740 1 Processor -- start 2024-09-12T02:53:20.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.478+0000 7f9ca1600640 1 -- 172.21.15.18:0/2116800174 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f9c9c004040 con 0x7f9ca410d610 2024-09-12T02:53:20.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.480+0000 7f9ca1600640 1 --2- 172.21.15.18:0/2116800174 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f9c880a2f30 0x7f9c880a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:20.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.498+0000 7f9cae869740 1 -- start start 2024-09-12T02:53:20.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.498+0000 7f9cae869740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f081e0 0x562570f085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:20.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.498+0000 7f9cae869740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f08b00 0x562570f12e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:20.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.498+0000 7f9cae869740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f133a0 0x562570f15790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.504+0000 7f9ca9000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f081e0 0x562570f085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.504+0000 7f9ca9000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f081e0 0x562570f085c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:50666/0 (socket says 172.21.15.18:50666) 2024-09-12T02:53:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.509+0000 7f9ca9000640 1 -- 172.21.15.18:0/786000181 learned_addr learned my addr 172.21.15.18:0/786000181 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:53:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.509+0000 7f9cae869740 1 -- 172.21.15.18:0/786000181 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562570e6e100 con 0x562570f08b00 2024-09-12T02:53:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.509+0000 7f9cae869740 1 -- 172.21.15.18:0/786000181 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562570e161b0 con 0x562570f133a0 2024-09-12T02:53:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.509+0000 7f9cae869740 1 -- 172.21.15.18:0/786000181 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562570e6a0c0 con 0x562570f081e0 2024-09-12T02:53:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.510+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/786000181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f133a0 0x562570f15790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.511+0000 7f9ca9a00640 1 -- 172.21.15.18:0/786000181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f081e0 msgr2=0x562570f085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.511+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/786000181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f081e0 0x562570f085c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.511+0000 7f9ca9a00640 1 -- 172.21.15.18:0/786000181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f08b00 msgr2=0x562570f12e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:53:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.511+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/786000181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f08b00 0x562570f12e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.511+0000 7f9ca9a00640 1 -- 172.21.15.18:0/786000181 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562570b81210 con 0x562570f133a0 2024-09-12T02:53:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.514+0000 7f9ca1600640 1 -- 172.21.15.18:0/2116800174 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f9c9c0f4060 con 0x7f9ca410d610 2024-09-12T02:53:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.517+0000 7f9ca3e00640 1 --2- 172.21.15.18:0/2116800174 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f9c880a2f30 0x7f9c880a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.521+0000 7f9ca9000640 1 --2- 172.21.15.18:0/786000181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f081e0 0x562570f085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:53:20.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.521+0000 7f9ca3e00640 1 --2- 172.21.15.18:0/2116800174 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f9c880a2f30 0x7f9c880a53f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x562570f055b0 tx=0x7f9c900090e0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:20.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.521+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/786000181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f133a0 0x562570f15790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0ed5e0 tx=0x7f9c9c0f24f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13268fe0c4c60f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.597+0000 7f9c9a000640 1 -- 172.21.15.18:0/786000181 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c0b8650 con 0x562570f133a0 2024-09-12T02:53:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.597+0000 7f9c9a000640 1 -- 172.21.15.18:0/786000181 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c9c036070 con 0x562570f133a0 2024-09-12T02:53:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.597+0000 7f9c9a000640 1 -- 172.21.15.18:0/786000181 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c0bbd10 con 0x562570f133a0 2024-09-12T02:53:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.610+0000 7f9cae869740 1 -- 172.21.15.18:0/786000181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f133a0 msgr2=0x562570f15790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.612+0000 7f9cae869740 1 --2- 172.21.15.18:0/786000181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f133a0 0x562570f15790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0ed5e0 tx=0x7f9c9c0f24f0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.615+0000 7f9cae869740 1 -- 172.21.15.18:0/786000181 shutdown_connections 2024-09-12T02:53:20.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.617+0000 7f9cae869740 1 --2- 172.21.15.18:0/786000181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f133a0 0x562570f15790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.620+0000 7f9cae869740 1 --2- 172.21.15.18:0/786000181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f08b00 0x562570f12e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.620+0000 7f9cae869740 1 --2- 172.21.15.18:0/786000181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f081e0 0x562570f085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.620+0000 7f9cae869740 1 -- 172.21.15.18:0/786000181 >> 172.21.15.18:0/786000181 conn(0x562570f04750 msgr2=0x562570f04b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:20.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.632+0000 7f9cae869740 1 -- 172.21.15.18:0/786000181 shutdown_connections 2024-09-12T02:53:20.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.632+0000 7f9cae869740 1 -- 172.21.15.18:0/786000181 wait complete. 2024-09-12T02:53:20.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.633+0000 7f9cae869740 1 -- start start 2024-09-12T02:53:20.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.633+0000 7f9cae869740 1 Processor -- start 2024-09-12T02:53:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.670+0000 7f9cae869740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f081e0 0x562570f10470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.671+0000 7f9cae869740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f08b00 0x562570f109b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.673+0000 7f9cae869740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f133a0 0x562570f10ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.674+0000 7f9ca9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f133a0 0x562570f10ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.676+0000 7f9ca9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f133a0 0x562570f10ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57604/0 (socket says 172.21.15.18:57604) 2024-09-12T02:53:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.676+0000 7f9ca9a00640 1 -- 172.21.15.18:0/3073875723 learned_addr learned my addr 172.21.15.18:0/3073875723 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:53:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.676+0000 7f9cae869740 1 -- 172.21.15.18:0/3073875723 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562570f15d30 con 0x562570f133a0 2024-09-12T02:53:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.676+0000 7f9cae869740 1 -- 172.21.15.18:0/3073875723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562570df7090 con 0x562570f081e0 2024-09-12T02:53:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.676+0000 7f9cae869740 1 -- 172.21.15.18:0/3073875723 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562570f15eb0 con 0x562570f08b00 2024-09-12T02:53:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.676+0000 7f9cae869740 10 client.0 _ll_register_callbacks cb 0x562570e4bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.677+0000 7f9ca9a00640 1 -- 172.21.15.18:0/3073875723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f08b00 msgr2=0x562570f109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:53:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.677+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/3073875723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f08b00 0x562570f109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.677+0000 7f9ca9a00640 1 -- 172.21.15.18:0/3073875723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f081e0 msgr2=0x562570f10470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:53:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.677+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/3073875723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f081e0 0x562570f10470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.677+0000 7f9ca9a00640 1 -- 172.21.15.18:0/3073875723 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562570c4d620 con 0x562570f133a0 2024-09-12T02:53:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.682+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/3073875723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f133a0 0x562570f10ef0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009ca0 tx=0x7f9c9c004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a20e52ee2c9a90a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.683+0000 7f9c8ea00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:53:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.683+0000 7f9c8ea00640 1 -- 172.21.15.18:0/3073875723 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c0bbef0 con 0x562570f133a0 2024-09-12T02:53:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.683+0000 7f9c8ea00640 1 -- 172.21.15.18:0/3073875723 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f9c9c0ed6c0 con 0x562570f133a0 2024-09-12T02:53:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.695+0000 7f9cae869740 1 -- 172.21.15.18:0/3073875723 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c9c036070 con 0x562570f133a0 2024-09-12T02:53:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.698+0000 7f9c8ea00640 1 -- 172.21.15.18:0/3073875723 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f9c9c0bc180 con 0x562570f133a0 2024-09-12T02:53:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.699+0000 7f9cae869740 10 client.15570 fetch_fsmap learned FSMap version 43 2024-09-12T02:53:20.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.699+0000 7f9cae869740 1 -- 172.21.15.18:0/3073875723 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x562570f15d30 con 0x562570f133a0 2024-09-12T02:53:20.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.705+0000 7f9c8ea00640 1 -- 172.21.15.18:0/3073875723 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c9c036070 con 0x562570f133a0 2024-09-12T02:53:20.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.705+0000 7f9c8ea00640 1 -- 172.21.15.18:0/3073875723 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 43) ==== 8418+0+0 (secure 0 0 0) 0x7f9c9c0f6030 con 0x562570f133a0 2024-09-12T02:53:20.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.712+0000 7f9cae869740 10 client.15570 fetch_fsmap finished waiting for FSMap version 43 2024-09-12T02:53:20.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.712+0000 7f9cae869740 10 client.15570 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:53:20.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.712+0000 7f9cae869740 20 client.15570 populate_metadata read hostname 'smithi018' 2024-09-12T02:53:20.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.712+0000 7f9cae869740 1 --2- 172.21.15.18:0/3073875723 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562570f22b50 0x562570f24fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:20.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.714+0000 7f9cae869740 4 client.15570 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:53:20.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.714+0000 7f9cae869740 1 -- 172.21.15.18:0/3073875723 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562570e7b830 con 0x562570f22b50 2024-09-12T02:53:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.715+0000 7f9ca9000640 1 --2- 172.21.15.18:0/3073875723 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562570f22b50 0x562570f24fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.719+0000 7f9ca9000640 1 --2- 172.21.15.18:0/3073875723 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562570f22b50 0x562570f24fa0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a69f7ff7c8b23c1 server_cookie=e1a036b2b450e0ab in_seq=0 out_seq=0 2024-09-12T02:53:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.719+0000 7f9c8ea00640 10 client.15570 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:53:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.721+0000 7f9c8ea00640 1 -- 172.21.15.18:0/3073875723 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562570e7b830 con 0x562570f22b50 2024-09-12T02:53:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.721+0000 7f9c8ea00640 10 client.15570 handle_command_reply: tid=0 2024-09-12T02:53:20.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:20 smithi176 ceph-mon[35713]: pgmap v141: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.4 MiB/s wr, 284 op/s 2024-09-12T02:53:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.730+0000 7f9cae869740 1 client.15570 shutdown 2024-09-12T02:53:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.742+0000 7f9cae869740 1 -- 172.21.15.18:0/3073875723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f133a0 msgr2=0x562570f10ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.742+0000 7f9cae869740 1 --2- 172.21.15.18:0/3073875723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f133a0 0x562570f10ef0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009ca0 tx=0x7f9c9c004950 comp rx=0 tx=0).stop 2024-09-12T02:53:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.776+0000 7f9cae869740 1 -- 172.21.15.18:0/3073875723 shutdown_connections 2024-09-12T02:53:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.776+0000 7f9cae869740 1 --2- 172.21.15.18:0/3073875723 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562570f22b50 0x562570f24fa0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.776+0000 7f9cae869740 1 --2- 172.21.15.18:0/3073875723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f133a0 0x562570f10ef0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.776+0000 7f9cae869740 1 --2- 172.21.15.18:0/3073875723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f08b00 0x562570f109b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.776+0000 7f9cae869740 1 --2- 172.21.15.18:0/3073875723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f081e0 0x562570f10470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.776+0000 7f9cae869740 1 -- 172.21.15.18:0/3073875723 >> 172.21.15.18:0/3073875723 conn(0x562570f04750 msgr2=0x562570f0a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:20.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:20 smithi062 ceph-mon[35527]: pgmap v141: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.4 MiB/s wr, 284 op/s 2024-09-12T02:53:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.789+0000 7f9c8ea00640 0 client.15570 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:53:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.793+0000 7f9cae869740 1 -- 172.21.15.18:0/3073875723 shutdown_connections 2024-09-12T02:53:20.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.799+0000 7f9cae869740 1 -- 172.21.15.18:0/3073875723 wait complete. 2024-09-12T02:53:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:20.813+0000 7f9cae869740 20 client.15570 trim_cache size 0 max 16384 2024-09-12T02:53:20.910 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:20 smithi018 ceph-mon[30616]: pgmap v141: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.4 MiB/s wr, 284 op/s 2024-09-12T02:53:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.409+0000 7f9cae869740 1 Processor -- start 2024-09-12T02:53:21.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.432+0000 7f9cae869740 1 -- start start 2024-09-12T02:53:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.436+0000 7f9cae869740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f081e0 0x562570f0aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.436+0000 7f9cae869740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f08b00 0x562570f10d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.462+0000 7f9cae869740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f133a0 0x562570f122d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.464+0000 7f9ca3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f08b00 0x562570f10d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.464+0000 7f9ca3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f08b00 0x562570f10d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:48052/0 (socket says 172.21.15.18:48052) 2024-09-12T02:53:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.465+0000 7f9ca9a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f133a0 0x562570f122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.465+0000 7f9ca9a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f133a0 0x562570f122d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:50672/0 (socket says 172.21.15.18:50672) 2024-09-12T02:53:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.466+0000 7f9cae869740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41c6720 con 0x562570f081e0 2024-09-12T02:53:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.466+0000 7f9cae869740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41c83e0 con 0x562570f08b00 2024-09-12T02:53:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.466+0000 7f9cae869740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41c6eb0 con 0x562570f133a0 2024-09-12T02:53:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.467+0000 7f9ca3e00640 1 -- 172.21.15.18:0/3927546628 learned_addr learned my addr 172.21.15.18:0/3927546628 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:53:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.469+0000 7f9ca9a00640 1 -- 172.21.15.18:0/3927546628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f08b00 msgr2=0x562570f10d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.469+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/3927546628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f08b00 0x562570f10d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.469+0000 7f9ca9a00640 1 -- 172.21.15.18:0/3927546628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f081e0 msgr2=0x562570f0aca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:53:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.469+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/3927546628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f081e0 0x562570f0aca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.469+0000 7f9ca9a00640 1 -- 172.21.15.18:0/3927546628 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562570f053e0 con 0x562570f133a0 2024-09-12T02:53:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.470+0000 7f9ca3e00640 1 --2- 172.21.15.18:0/3927546628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f08b00 0x562570f10d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:53:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.471+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/3927546628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f133a0 0x562570f122d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0b8d80 tx=0x7f9c9c0f24f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43b3186fb7476ac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.479+0000 7f9c99600640 1 -- 172.21.15.18:0/3927546628 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c0bbef0 con 0x562570f133a0 2024-09-12T02:53:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.479+0000 7f9c99600640 1 -- 172.21.15.18:0/3927546628 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c9c0f1070 con 0x562570f133a0 2024-09-12T02:53:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.479+0000 7f9c99600640 1 -- 172.21.15.18:0/3927546628 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c0b8650 con 0x562570f133a0 2024-09-12T02:53:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.510+0000 7f9cae869740 1 -- 172.21.15.18:0/3927546628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f133a0 msgr2=0x562570f122d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.510+0000 7f9cae869740 1 --2- 172.21.15.18:0/3927546628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f133a0 0x562570f122d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0b8d80 tx=0x7f9c9c0f24f0 comp rx=0 tx=0).stop 2024-09-12T02:53:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.517+0000 7f9cae869740 1 -- 172.21.15.18:0/3927546628 shutdown_connections 2024-09-12T02:53:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.517+0000 7f9cae869740 1 --2- 172.21.15.18:0/3927546628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f133a0 0x562570f122d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.517+0000 7f9cae869740 1 --2- 172.21.15.18:0/3927546628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f08b00 0x562570f10d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.517+0000 7f9cae869740 1 --2- 172.21.15.18:0/3927546628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f081e0 0x562570f0aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.517+0000 7f9cae869740 1 -- 172.21.15.18:0/3927546628 >> 172.21.15.18:0/3927546628 conn(0x562570f04750 msgr2=0x562570f11bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.530+0000 7f9cae869740 1 -- 172.21.15.18:0/3927546628 shutdown_connections 2024-09-12T02:53:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.530+0000 7f9cae869740 1 -- 172.21.15.18:0/3927546628 wait complete. 2024-09-12T02:53:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.531+0000 7f9cae869740 1 -- start start 2024-09-12T02:53:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.531+0000 7f9cae869740 1 Processor -- start 2024-09-12T02:53:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.536+0000 7f9cae869740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f081e0 0x562570f1b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.536+0000 7f9cae869740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f08b00 0x562570f1b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.536+0000 7f9cae869740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f133a0 0x562570f0cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.536+0000 7f9ca3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f08b00 0x562570f1b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.536+0000 7f9ca3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f08b00 0x562570f1b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:48062/0 (socket says 172.21.15.18:48062) 2024-09-12T02:53:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.536+0000 7f9cae869740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41c7d10 con 0x562570f081e0 2024-09-12T02:53:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.536+0000 7f9ca3e00640 1 -- 172.21.15.18:0/2044139175 learned_addr learned my addr 172.21.15.18:0/2044139175 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:53:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.536+0000 7f9cae869740 1 -- 172.21.15.18:0/2044139175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41c7580 con 0x562570f08b00 2024-09-12T02:53:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.536+0000 7f9cae869740 1 -- 172.21.15.18:0/2044139175 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41bcf10 con 0x562570f133a0 2024-09-12T02:53:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.536+0000 7f9cae869740 10 client.0 _ll_register_callbacks cb 0x7f9c9c0f7df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.537+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/2044139175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f133a0 0x562570f0cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.537+0000 7f9ca9a00640 1 -- 172.21.15.18:0/2044139175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f08b00 msgr2=0x562570f1b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.537+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/2044139175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f08b00 0x562570f1b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.538+0000 7f9ca9a00640 1 -- 172.21.15.18:0/2044139175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f081e0 msgr2=0x562570f1b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.538+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/2044139175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f081e0 0x562570f1b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.538+0000 7f9ca9a00640 1 -- 172.21.15.18:0/2044139175 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562570f096c0 con 0x562570f133a0 2024-09-12T02:53:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.538+0000 7f9ca9a00640 1 --2- 172.21.15.18:0/2044139175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f133a0 0x562570f0cce0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x562570f00290 tx=0x7f9c9c004560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2378d1b7146a072 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.539+0000 7f9c8ea00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:53:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.539+0000 7f9c8ea00640 1 -- 172.21.15.18:0/2044139175 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c0bbd10 con 0x562570f133a0 2024-09-12T02:53:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.539+0000 7f9c8ea00640 1 -- 172.21.15.18:0/2044139175 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f9c9c0c4da0 con 0x562570f133a0 2024-09-12T02:53:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.539+0000 7f9cae869740 1 -- 172.21.15.18:0/2044139175 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c9c0f1070 con 0x562570f133a0 2024-09-12T02:53:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.540+0000 7f9c8ea00640 1 -- 172.21.15.18:0/2044139175 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f9c9c0b8650 con 0x562570f133a0 2024-09-12T02:53:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.540+0000 7f9cae869740 10 client.25555 fetch_fsmap learned FSMap version 43 2024-09-12T02:53:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.540+0000 7f9cae869740 1 -- 172.21.15.18:0/2044139175 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x562570f096c0 con 0x562570f133a0 2024-09-12T02:53:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.541+0000 7f9c8ea00640 1 -- 172.21.15.18:0/2044139175 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c9c0f1070 con 0x562570f133a0 2024-09-12T02:53:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.541+0000 7f9c8ea00640 1 -- 172.21.15.18:0/2044139175 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 43) ==== 8418+0+0 (secure 0 0 0) 0x7f9c9c0f6070 con 0x562570f133a0 2024-09-12T02:53:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.541+0000 7f9cae869740 10 client.25555 fetch_fsmap finished waiting for FSMap version 43 2024-09-12T02:53:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.541+0000 7f9cae869740 10 client.25555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:53:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.541+0000 7f9cae869740 20 client.25555 populate_metadata read hostname 'smithi018' 2024-09-12T02:53:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.541+0000 7f9cae869740 1 --2- 172.21.15.18:0/2044139175 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562570f8d280 0x562570f8f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.541+0000 7f9cae869740 4 client.25555 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:53:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.541+0000 7f9cae869740 1 -- 172.21.15.18:0/2044139175 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562570e75b80 con 0x562570f8d280 2024-09-12T02:53:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.584+0000 7f9ca9000640 1 --2- 172.21.15.18:0/2044139175 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562570f8d280 0x562570f8f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.588+0000 7f9ca9000640 1 --2- 172.21.15.18:0/2044139175 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562570f8d280 0x562570f8f700 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c04abee1554ba5c5 server_cookie=6d95eebbe682eeff in_seq=0 out_seq=0 2024-09-12T02:53:21.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:21.615+0000 7f9c8ea00640 10 client.25555 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:53:22.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:22 smithi176 ceph-mon[35713]: pgmap v142: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.3 MiB/s wr, 244 op/s 2024-09-12T02:53:22.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:22 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:53:22.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:22 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:53:22.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:22 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:53:22.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:22 smithi062 ceph-mon[35527]: pgmap v142: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.3 MiB/s wr, 244 op/s 2024-09-12T02:53:22.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:22 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:53:22.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:22 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:53:22.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:22 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:53:22.811 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:22 smithi018 ceph-mon[30616]: pgmap v142: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.3 MiB/s wr, 244 op/s 2024-09-12T02:53:22.811 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:22 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:53:22.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:22 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:53:22.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:22 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:53:24.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:24 smithi062 ceph-mon[35527]: pgmap v143: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.3 MiB/s wr, 242 op/s 2024-09-12T02:53:24.856 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:24 smithi018 ceph-mon[30616]: pgmap v143: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.3 MiB/s wr, 242 op/s 2024-09-12T02:53:24.925 INFO:tasks.workunit.client.0.smithi018.stdout: 385 501738 1191 331746 748 81964 10 2024-09-12T02:53:24.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:24 smithi176 ceph-mon[35713]: pgmap v143: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.3 MiB/s wr, 242 op/s 2024-09-12T02:53:26.780 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:26 smithi176 ceph-mon[35713]: pgmap v144: 129 pgs: 129 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 14 MiB/s wr, 735 op/s 2024-09-12T02:53:26.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:26 smithi062 ceph-mon[35527]: pgmap v144: 129 pgs: 129 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 14 MiB/s wr, 735 op/s 2024-09-12T02:53:26.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:26 smithi018 ceph-mon[30616]: pgmap v144: 129 pgs: 129 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 14 MiB/s wr, 735 op/s 2024-09-12T02:53:28.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:28 smithi062 ceph-mon[35527]: pgmap v145: 129 pgs: 129 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 760 op/s 2024-09-12T02:53:28.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:28 smithi018 ceph-mon[30616]: pgmap v145: 129 pgs: 129 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 760 op/s 2024-09-12T02:53:28.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:28 smithi176 ceph-mon[35713]: pgmap v145: 129 pgs: 129 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 760 op/s 2024-09-12T02:53:29.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:29.981+0000 7f9c8ea00640 1 -- 172.21.15.18:0/2044139175 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562570e75b80 con 0x562570f8d280 2024-09-12T02:53:29.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:29.981+0000 7f9c8ea00640 10 client.25555 handle_command_reply: tid=0 2024-09-12T02:53:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:29.989+0000 7f9cae869740 1 client.25555 shutdown 2024-09-12T02:53:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.034+0000 7f9cae869740 1 -- 172.21.15.18:0/2044139175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f133a0 msgr2=0x562570f0cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.034+0000 7f9cae869740 1 --2- 172.21.15.18:0/2044139175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f133a0 0x562570f0cce0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x562570f00290 tx=0x7f9c9c004560 comp rx=0 tx=0).stop 2024-09-12T02:53:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.035+0000 7f9cae869740 1 -- 172.21.15.18:0/2044139175 shutdown_connections 2024-09-12T02:53:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.035+0000 7f9cae869740 1 --2- 172.21.15.18:0/2044139175 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562570f8d280 0x562570f8f700 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.035+0000 7f9cae869740 1 --2- 172.21.15.18:0/2044139175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562570f133a0 0x562570f0cce0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.035+0000 7f9cae869740 1 --2- 172.21.15.18:0/2044139175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562570f08b00 0x562570f1b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.035+0000 7f9cae869740 1 --2- 172.21.15.18:0/2044139175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562570f081e0 0x562570f1b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.035+0000 7f9cae869740 1 -- 172.21.15.18:0/2044139175 >> 172.21.15.18:0/2044139175 conn(0x562570f04750 msgr2=0x562570f0e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.035+0000 7f9c8ea00640 0 client.25555 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:53:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.060+0000 7f9cae869740 1 -- 172.21.15.18:0/2044139175 shutdown_connections 2024-09-12T02:53:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.076+0000 7f9cae869740 1 -- 172.21.15.18:0/2044139175 wait complete. 2024-09-12T02:53:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.123+0000 7f9cae869740 20 client.25555 trim_cache size 0 max 16384 2024-09-12T02:53:30.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:53:30.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:53:30.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:53:30.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:53:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.196+0000 7f9caba00640 1 -- 172.21.15.18:0/2116800174 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f9c880a2f30 msgr2=0x7f9c880a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.196+0000 7f9caba00640 1 --2- 172.21.15.18:0/2116800174 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f9c880a2f30 0x7f9c880a53f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x562570f055b0 tx=0x7f9c900090e0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.196+0000 7f9caba00640 1 -- 172.21.15.18:0/2116800174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ca410d610 msgr2=0x7f9ca4076470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.196+0000 7f9caba00640 1 --2- 172.21.15.18:0/2116800174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ca410d610 0x7f9ca4076470 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c02aee0 tx=0x7f9c9c0316b0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.223+0000 7f9caba00640 1 -- 172.21.15.18:0/2116800174 shutdown_connections 2024-09-12T02:53:30.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.223+0000 7f9caba00640 1 --2- 172.21.15.18:0/2116800174 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f9c880a2f30 0x7f9c880a53f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.223+0000 7f9caba00640 1 --2- 172.21.15.18:0/2116800174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ca410d610 0x7f9ca4076470 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.223+0000 7f9caba00640 1 --2- 172.21.15.18:0/2116800174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ca4109b70 0x7f9ca4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.223+0000 7f9caba00640 1 --2- 172.21.15.18:0/2116800174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ca41091f0 0x7f9ca407aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.223+0000 7f9caba00640 1 -- 172.21.15.18:0/2116800174 >> 172.21.15.18:0/2116800174 conn(0x7f9ca406ce00 msgr2=0x7f9ca4072570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.239+0000 7f9caba00640 1 -- 172.21.15.18:0/2116800174 shutdown_connections 2024-09-12T02:53:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:30.239+0000 7f9caba00640 1 -- 172.21.15.18:0/2116800174 wait complete. 2024-09-12T02:53:30.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:30 smithi062 ceph-mon[35527]: pgmap v146: 129 pgs: 129 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 1.04k op/s 2024-09-12T02:53:30.855 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:30 smithi018 ceph-mon[30616]: pgmap v146: 129 pgs: 129 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 1.04k op/s 2024-09-12T02:53:30.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:30 smithi176 ceph-mon[35713]: pgmap v146: 129 pgs: 129 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 1.04k op/s 2024-09-12T02:53:32.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:32 smithi062 ceph-mon[35527]: pgmap v147: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 981 op/s 2024-09-12T02:53:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:32 smithi018 ceph-mon[30616]: pgmap v147: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 981 op/s 2024-09-12T02:53:32.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:32 smithi176 ceph-mon[35713]: pgmap v147: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 981 op/s 2024-09-12T02:53:34.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:34 smithi062 ceph-mon[35527]: pgmap v148: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 934 op/s 2024-09-12T02:53:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:34 smithi018 ceph-mon[30616]: pgmap v148: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 934 op/s 2024-09-12T02:53:34.938 INFO:tasks.workunit.client.0.smithi018.stdout: 404 539587 1158 350258 1003 72724 33 2024-09-12T02:53:34.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:34 smithi176 ceph-mon[35713]: pgmap v148: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 934 op/s 2024-09-12T02:53:36.856 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:36 smithi018 ceph-mon[30616]: pgmap v149: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-09-12T02:53:36.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:36 smithi176 ceph-mon[35713]: pgmap v149: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-09-12T02:53:37.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:36 smithi062 ceph-mon[35527]: pgmap v149: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-09-12T02:53:38.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:38 smithi018 ceph-mon[30616]: pgmap v150: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 537 op/s 2024-09-12T02:53:38.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:38 smithi176 ceph-mon[35713]: pgmap v150: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 537 op/s 2024-09-12T02:53:39.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:38 smithi062 ceph-mon[35527]: pgmap v150: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 537 op/s 2024-09-12T02:53:40.861 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:40 smithi018 ceph-mon[30616]: pgmap v151: 129 pgs: 129 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.9 MiB/s wr, 589 op/s 2024-09-12T02:53:40.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:40 smithi176 ceph-mon[35713]: pgmap v151: 129 pgs: 129 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.9 MiB/s wr, 589 op/s 2024-09-12T02:53:41.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:40 smithi062 ceph-mon[35527]: pgmap v151: 129 pgs: 129 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.9 MiB/s wr, 589 op/s 2024-09-12T02:53:42.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:42 smithi018 ceph-mon[30616]: pgmap v152: 129 pgs: 129 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.2 MiB/s wr, 315 op/s 2024-09-12T02:53:42.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:42 smithi176 ceph-mon[35713]: pgmap v152: 129 pgs: 129 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.2 MiB/s wr, 315 op/s 2024-09-12T02:53:43.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:42 smithi062 ceph-mon[35527]: pgmap v152: 129 pgs: 129 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.2 MiB/s wr, 315 op/s 2024-09-12T02:53:44.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:44 smithi018 ceph-mon[30616]: pgmap v153: 129 pgs: 129 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.5 MiB/s wr, 293 op/s 2024-09-12T02:53:44.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:44 smithi176 ceph-mon[35713]: pgmap v153: 129 pgs: 129 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.5 MiB/s wr, 293 op/s 2024-09-12T02:53:44.992 INFO:tasks.workunit.client.0.smithi018.stdout: 421 530697 951 346707 803 67964 73 2024-09-12T02:53:45.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:44 smithi062 ceph-mon[35527]: pgmap v153: 129 pgs: 129 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.5 MiB/s wr, 293 op/s 2024-09-12T02:53:46.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:46 smithi018 ceph-mon[30616]: pgmap v154: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 537 op/s 2024-09-12T02:53:46.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:46 smithi176 ceph-mon[35713]: pgmap v154: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 537 op/s 2024-09-12T02:53:47.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:46 smithi062 ceph-mon[35527]: pgmap v154: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 537 op/s 2024-09-12T02:53:47.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.583+0000 7f5226200640 1 -- 172.21.15.18:0/2824720971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52201095d0 msgr2=0x7f5220109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.583+0000 7f5226200640 1 --2- 172.21.15.18:0/2824720971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52201095d0 0x7f5220109a30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f520c009860 tx=0x7f520c02a360 comp rx=0 tx=0).stop 2024-09-12T02:53:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.644+0000 7f5226200640 1 -- 172.21.15.18:0/2824720971 shutdown_connections 2024-09-12T02:53:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.644+0000 7f5226200640 1 --2- 172.21.15.18:0/2824720971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f522011b140 0x7f522011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.644+0000 7f5226200640 1 --2- 172.21.15.18:0/2824720971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52201095d0 0x7f5220109a30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.644+0000 7f5226200640 1 --2- 172.21.15.18:0/2824720971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52201091f0 0x7f5220110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.644+0000 7f5226200640 1 -- 172.21.15.18:0/2824720971 >> 172.21.15.18:0/2824720971 conn(0x7f522006cbf0 msgr2=0x7f522006d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.644+0000 7f5226200640 1 -- 172.21.15.18:0/2824720971 shutdown_connections 2024-09-12T02:53:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.647+0000 7f5226200640 1 -- 172.21.15.18:0/2824720971 wait complete. 2024-09-12T02:53:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.648+0000 7f5226200640 1 Processor -- start 2024-09-12T02:53:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.661+0000 7f5226200640 1 -- start start 2024-09-12T02:53:47.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.668+0000 7f5226200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52201091f0 0x7f522011a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.672+0000 7f5226200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52201095d0 0x7f52201168f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.672+0000 7f5226200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f522011b140 0x7f5220116e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.672+0000 7f5226200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5220113300 con 0x7f52201095d0 2024-09-12T02:53:47.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.672+0000 7f5226200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5220113180 con 0x7f52201091f0 2024-09-12T02:53:47.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.672+0000 7f5226200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5220113480 con 0x7f522011b140 2024-09-12T02:53:47.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.674+0000 7f521fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52201095d0 0x7f52201168f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.674+0000 7f521fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52201095d0 0x7f52201168f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37752/0 (socket says 172.21.15.18:37752) 2024-09-12T02:53:47.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.674+0000 7f521fe00640 1 -- 172.21.15.18:0/1916224281 learned_addr learned my addr 172.21.15.18:0/1916224281 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:53:47.676 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.675+0000 7f521fe00640 1 -- 172.21.15.18:0/1916224281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f522011b140 msgr2=0x7f5220116e30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:53:47.676 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.675+0000 7f521fe00640 1 --2- 172.21.15.18:0/1916224281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f522011b140 0x7f5220116e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.676 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.675+0000 7f521fe00640 1 -- 172.21.15.18:0/1916224281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52201091f0 msgr2=0x7f522011a810 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:53:47.676 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.675+0000 7f521fe00640 1 --2- 172.21.15.18:0/1916224281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52201091f0 0x7f522011a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.676 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.675+0000 7f521fe00640 1 -- 172.21.15.18:0/1916224281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5220117530 con 0x7f52201095d0 2024-09-12T02:53:47.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.676+0000 7f521fe00640 1 --2- 172.21.15.18:0/1916224281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52201095d0 0x7f52201168f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f520c02a8d0 tx=0x7f520c033d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:47.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.676+0000 7f521d600640 1 -- 172.21.15.18:0/1916224281 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c037040 con 0x7f52201095d0 2024-09-12T02:53:47.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.677+0000 7f521d600640 1 -- 172.21.15.18:0/1916224281 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f520c030550 con 0x7f52201095d0 2024-09-12T02:53:47.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.677+0000 7f521d600640 1 -- 172.21.15.18:0/1916224281 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c003a80 con 0x7f52201095d0 2024-09-12T02:53:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.681+0000 7f5226200640 1 -- 172.21.15.18:0/1916224281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52201aae90 con 0x7f52201095d0 2024-09-12T02:53:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.681+0000 7f5226200640 1 -- 172.21.15.18:0/1916224281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52201ab240 con 0x7f52201095d0 2024-09-12T02:53:47.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.694+0000 7f522a671740 1 Processor -- start 2024-09-12T02:53:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.694+0000 7f522a671740 1 -- start start 2024-09-12T02:53:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.695+0000 7f522a671740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b53b0 0x5591f79b5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.697+0000 7f522a671740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79b5cd0 0x5591f79c0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.697+0000 7f5225800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b53b0 0x5591f79b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.697+0000 7f5225800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b53b0 0x5591f79b5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:34978/0 (socket says 172.21.15.18:34978) 2024-09-12T02:53:47.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.697+0000 7f522a671740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79c0570 0x5591f79c2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.697+0000 7f5225800640 1 -- 172.21.15.18:0/2677880793 learned_addr learned my addr 172.21.15.18:0/2677880793 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:53:47.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.697+0000 7f522a671740 1 -- 172.21.15.18:0/2677880793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5591f791b100 con 0x5591f79c0570 2024-09-12T02:53:47.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.697+0000 7f522a671740 1 -- 172.21.15.18:0/2677880793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5591f78c31b0 con 0x5591f79b53b0 2024-09-12T02:53:47.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.697+0000 7f522a671740 1 -- 172.21.15.18:0/2677880793 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5591f79170c0 con 0x5591f79b5cd0 2024-09-12T02:53:47.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.697+0000 7f5224e00640 1 --2- 172.21.15.18:0/2677880793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79b5cd0 0x5591f79c0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.698+0000 7f5225800640 1 -- 172.21.15.18:0/2677880793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79b5cd0 msgr2=0x5591f79c0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:47.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.698+0000 7f5225800640 1 --2- 172.21.15.18:0/2677880793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79b5cd0 0x5591f79c0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.698+0000 7f5225800640 1 -- 172.21.15.18:0/2677880793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79c0570 msgr2=0x5591f79c2960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:53:47.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.698+0000 7f5225800640 1 --2- 172.21.15.18:0/2677880793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79c0570 0x5591f79c2960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.698+0000 7f5225800640 1 -- 172.21.15.18:0/2677880793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591f762e210 con 0x5591f79b53b0 2024-09-12T02:53:47.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.699+0000 7f5225800640 1 --2- 172.21.15.18:0/2677880793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b53b0 0x5591f79b5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f521801aec0 tx=0x7f521801f7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f42f4492c5d5000 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:47.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.700+0000 7f521d600640 1 -- 172.21.15.18:0/1916224281 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f520c042070 con 0x7f52201095d0 2024-09-12T02:53:47.707 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.702+0000 7f521d600640 1 --2- 172.21.15.18:0/1916224281 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f52040a2f00 0x7f52040a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.707 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.706+0000 7f521d600640 1 -- 172.21.15.18:0/1916224281 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f520c0eea50 con 0x7f52201095d0 2024-09-12T02:53:47.710 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.707+0000 7f5224e00640 1 --2- 172.21.15.18:0/1916224281 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f52040a2f00 0x7f52040a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.710 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.709+0000 7f5224e00640 1 --2- 172.21.15.18:0/1916224281 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f52040a2f00 0x7f52040a53c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x5591f79b2780 tx=0x7f521000a250 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:47.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.714+0000 7f5216000640 1 -- 172.21.15.18:0/2677880793 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218003970 con 0x5591f79b53b0 2024-09-12T02:53:47.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.714+0000 7f5216000640 1 -- 172.21.15.18:0/2677880793 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5218004020 con 0x5591f79b53b0 2024-09-12T02:53:47.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.714+0000 7f5216000640 1 -- 172.21.15.18:0/2677880793 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521801d930 con 0x5591f79b53b0 2024-09-12T02:53:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.716+0000 7f522a671740 1 -- 172.21.15.18:0/2677880793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b53b0 msgr2=0x5591f79b5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.716+0000 7f522a671740 1 --2- 172.21.15.18:0/2677880793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b53b0 0x5591f79b5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f521801aec0 tx=0x7f521801f7d0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.724+0000 7f522a671740 1 -- 172.21.15.18:0/2677880793 shutdown_connections 2024-09-12T02:53:47.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.724+0000 7f522a671740 1 --2- 172.21.15.18:0/2677880793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79c0570 0x5591f79c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.724+0000 7f522a671740 1 --2- 172.21.15.18:0/2677880793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79b5cd0 0x5591f79c0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.724+0000 7f522a671740 1 --2- 172.21.15.18:0/2677880793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b53b0 0x5591f79b5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.725 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.724+0000 7f522a671740 1 -- 172.21.15.18:0/2677880793 >> 172.21.15.18:0/2677880793 conn(0x5591f79b1920 msgr2=0x5591f79b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:47.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.726+0000 7f522a671740 1 -- 172.21.15.18:0/2677880793 shutdown_connections 2024-09-12T02:53:47.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.726+0000 7f522a671740 1 -- 172.21.15.18:0/2677880793 wait complete. 2024-09-12T02:53:47.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.726+0000 7f522a671740 1 -- start start 2024-09-12T02:53:47.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.727+0000 7f522a671740 1 Processor -- start 2024-09-12T02:53:47.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.731+0000 7f522a671740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79b53b0 0x5591f79bd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.731+0000 7f522a671740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b5cd0 0x5591f79bdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.731+0000 7f522a671740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79c0570 0x5591f79be120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.731+0000 7f522a671740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5591f79c2ff0 con 0x5591f79b53b0 2024-09-12T02:53:47.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.731+0000 7f522a671740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5591f78a4090 con 0x5591f79b5cd0 2024-09-12T02:53:47.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.731+0000 7f522a671740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5591f79c3170 con 0x5591f79c0570 2024-09-12T02:53:47.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.731+0000 7f522a671740 10 client.0 _ll_register_callbacks cb 0x5591f78f8f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:47.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.732+0000 7f521fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b5cd0 0x5591f79bdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.732+0000 7f521fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b5cd0 0x5591f79bdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:34984/0 (socket says 172.21.15.18:34984) 2024-09-12T02:53:47.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.732+0000 7f521fe00640 1 -- 172.21.15.18:0/1800885924 learned_addr learned my addr 172.21.15.18:0/1800885924 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:53:47.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.733+0000 7f5224e00640 1 --2- 172.21.15.18:0/1800885924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79b53b0 0x5591f79bd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.734+0000 7f5224e00640 1 -- 172.21.15.18:0/1800885924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79c0570 msgr2=0x5591f79be120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:53:47.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.734+0000 7f5224e00640 1 --2- 172.21.15.18:0/1800885924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79c0570 0x5591f79be120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.734+0000 7f5224e00640 1 -- 172.21.15.18:0/1800885924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b5cd0 msgr2=0x5591f79bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:47.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.734+0000 7f5224e00640 1 --2- 172.21.15.18:0/1800885924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b5cd0 0x5591f79bdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.734+0000 7f5224e00640 1 -- 172.21.15.18:0/1800885924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591f76fa620 con 0x5591f79b53b0 2024-09-12T02:53:47.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.735+0000 7f5224e00640 1 --2- 172.21.15.18:0/1800885924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79b53b0 0x5591f79bd6a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5210010c70 tx=0x7f5210004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c3a0646fa29336 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:47.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.736+0000 7f520aa00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:53:47.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.736+0000 7f520aa00640 1 -- 172.21.15.18:0/1800885924 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5210016070 con 0x5591f79b53b0 2024-09-12T02:53:47.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.736+0000 7f520aa00640 1 -- 172.21.15.18:0/1800885924 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f5210010ca0 con 0x5591f79b53b0 2024-09-12T02:53:47.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.737+0000 7f522a671740 1 -- 172.21.15.18:0/1800885924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5218004020 con 0x5591f79b53b0 2024-09-12T02:53:47.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.738+0000 7f520aa00640 1 -- 172.21.15.18:0/1800885924 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f5210027480 con 0x5591f79b53b0 2024-09-12T02:53:47.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.738+0000 7f522a671740 10 client.15576 fetch_fsmap learned FSMap version 43 2024-09-12T02:53:47.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.738+0000 7f522a671740 1 -- 172.21.15.18:0/1800885924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5591f79cef80 con 0x5591f79b53b0 2024-09-12T02:53:47.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.739+0000 7f520aa00640 1 -- 172.21.15.18:0/1800885924 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5218004020 con 0x5591f79b53b0 2024-09-12T02:53:47.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.740+0000 7f520aa00640 1 -- 172.21.15.18:0/1800885924 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 43) ==== 8418+0+0 (secure 0 0 0) 0x7f52100316c0 con 0x5591f79b53b0 2024-09-12T02:53:47.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.740+0000 7f522a671740 10 client.15576 fetch_fsmap finished waiting for FSMap version 43 2024-09-12T02:53:47.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.740+0000 7f522a671740 10 client.15576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:53:47.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.740+0000 7f522a671740 20 client.15576 populate_metadata read hostname 'smithi018' 2024-09-12T02:53:47.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.740+0000 7f522a671740 1 --2- 172.21.15.18:0/1800885924 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5591f79d0820 0x5591f79d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:47.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.740+0000 7f522a671740 4 client.15576 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:53:47.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.740+0000 7f522a671740 1 -- 172.21.15.18:0/1800885924 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591f7928830 con 0x5591f79d0820 2024-09-12T02:53:47.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.741+0000 7f521fe00640 1 --2- 172.21.15.18:0/1800885924 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5591f79d0820 0x5591f79d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:47.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.741+0000 7f521fe00640 1 --2- 172.21.15.18:0/1800885924 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5591f79d0820 0x5591f79d2c70 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37b5fdc63b78ab53 server_cookie=cd7a90da1d90d046 in_seq=0 out_seq=0 2024-09-12T02:53:47.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.741+0000 7f520aa00640 10 client.15576 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:53:47.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.742+0000 7f520aa00640 1 -- 172.21.15.18:0/1800885924 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5591f7928830 con 0x5591f79d0820 2024-09-12T02:53:47.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.742+0000 7f520aa00640 10 client.15576 handle_command_reply: tid=0 2024-09-12T02:53:47.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.742+0000 7f522a671740 1 client.15576 shutdown 2024-09-12T02:53:47.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.743+0000 7f522a671740 1 -- 172.21.15.18:0/1800885924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79b53b0 msgr2=0x5591f79bd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:47.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.743+0000 7f522a671740 1 --2- 172.21.15.18:0/1800885924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79b53b0 0x5591f79bd6a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5210010c70 tx=0x7f5210004730 comp rx=0 tx=0).stop 2024-09-12T02:53:47.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.743+0000 7f522a671740 1 -- 172.21.15.18:0/1800885924 shutdown_connections 2024-09-12T02:53:47.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.743+0000 7f522a671740 1 --2- 172.21.15.18:0/1800885924 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5591f79d0820 0x5591f79d2c70 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.743+0000 7f522a671740 1 --2- 172.21.15.18:0/1800885924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79c0570 0x5591f79be120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.743+0000 7f522a671740 1 --2- 172.21.15.18:0/1800885924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b5cd0 0x5591f79bdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:47.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.743+0000 7f522a671740 1 --2- 172.21.15.18:0/1800885924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79b53b0 0x5591f79bd6a0 secure :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5210010c70 tx=0x7f5210004730 comp rx=0 tx=0).stop 2024-09-12T02:53:47.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.743+0000 7f522a671740 1 -- 172.21.15.18:0/1800885924 >> 172.21.15.18:0/1800885924 conn(0x5591f79b1920 msgr2=0x5591f79b7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:47.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.743+0000 7f520aa00640 0 client.15576 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:53:47.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.744+0000 7f522a671740 1 -- 172.21.15.18:0/1800885924 shutdown_connections 2024-09-12T02:53:47.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.744+0000 7f522a671740 1 -- 172.21.15.18:0/1800885924 wait complete. 2024-09-12T02:53:47.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:47.744+0000 7f522a671740 20 client.15576 trim_cache size 0 max 16384 2024-09-12T02:53:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.017+0000 7f522a671740 1 Processor -- start 2024-09-12T02:53:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.033+0000 7f522a671740 1 -- start start 2024-09-12T02:53:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.033+0000 7f522a671740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79b5cd0 0x5591f79bf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.033+0000 7f522a671740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79c0570 0x5591f79d8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.033+0000 7f522a671740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79bc770 0x5591f79d8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.033+0000 7f522a671740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f52201b53d0 con 0x5591f79bc770 2024-09-12T02:53:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.033+0000 7f522a671740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f52201b7090 con 0x5591f79c0570 2024-09-12T02:53:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.033+0000 7f522a671740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f52201b5b60 con 0x5591f79b5cd0 2024-09-12T02:53:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.034+0000 7f5225800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79bc770 0x5591f79d8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.034+0000 7f5225800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79bc770 0x5591f79d8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37760/0 (socket says 172.21.15.18:37760) 2024-09-12T02:53:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.034+0000 7f5225800640 1 -- 172.21.15.18:0/1199170474 learned_addr learned my addr 172.21.15.18:0/1199170474 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:53:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.035+0000 7f5225800640 1 -- 172.21.15.18:0/1199170474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79b5cd0 msgr2=0x5591f79bf500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:53:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.035+0000 7f5225800640 1 --2- 172.21.15.18:0/1199170474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79b5cd0 0x5591f79bf500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.035+0000 7f5225800640 1 -- 172.21.15.18:0/1199170474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79c0570 msgr2=0x5591f79d8580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:53:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.035+0000 7f5225800640 1 --2- 172.21.15.18:0/1199170474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79c0570 0x5591f79d8580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.035+0000 7f5225800640 1 -- 172.21.15.18:0/1199170474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591f79b11d0 con 0x5591f79bc770 2024-09-12T02:53:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.035+0000 7f5225800640 1 --2- 172.21.15.18:0/1199170474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79bc770 0x5591f79d8ac0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5218004c00 tx=0x7f5218004c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a16761d68f08f9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:48.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.065+0000 7f5215600640 1 -- 172.21.15.18:0/1199170474 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218034070 con 0x5591f79bc770 2024-09-12T02:53:48.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.065+0000 7f5215600640 1 -- 172.21.15.18:0/1199170474 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5218004d50 con 0x5591f79bc770 2024-09-12T02:53:48.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.065+0000 7f5215600640 1 -- 172.21.15.18:0/1199170474 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218005200 con 0x5591f79bc770 2024-09-12T02:53:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.073+0000 7f522a671740 1 -- 172.21.15.18:0/1199170474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79bc770 msgr2=0x5591f79d8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.073+0000 7f522a671740 1 --2- 172.21.15.18:0/1199170474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79bc770 0x5591f79d8ac0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5218004c00 tx=0x7f5218004c30 comp rx=0 tx=0).stop 2024-09-12T02:53:48.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.089+0000 7f522a671740 1 -- 172.21.15.18:0/1199170474 shutdown_connections 2024-09-12T02:53:48.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.089+0000 7f522a671740 1 --2- 172.21.15.18:0/1199170474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79bc770 0x5591f79d8ac0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.089+0000 7f522a671740 1 --2- 172.21.15.18:0/1199170474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79c0570 0x5591f79d8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.089+0000 7f522a671740 1 --2- 172.21.15.18:0/1199170474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79b5cd0 0x5591f79bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.089+0000 7f522a671740 1 -- 172.21.15.18:0/1199170474 >> 172.21.15.18:0/1199170474 conn(0x5591f79b1920 msgr2=0x5591f79bedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:48.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.097+0000 7f522a671740 1 -- 172.21.15.18:0/1199170474 shutdown_connections 2024-09-12T02:53:48.099 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.097+0000 7f522a671740 1 -- 172.21.15.18:0/1199170474 wait complete. 2024-09-12T02:53:48.099 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.098+0000 7f522a671740 1 -- start start 2024-09-12T02:53:48.099 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.098+0000 7f522a671740 1 Processor -- start 2024-09-12T02:53:48.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.107+0000 7f522a671740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b5cd0 0x5591f79c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.107+0000 7f522a671740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79bc770 0x5591f79c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.107+0000 7f522a671740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79c0570 0x5591f7a39540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.107+0000 7f522a671740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f52201b69c0 con 0x5591f79c0570 2024-09-12T02:53:48.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.107+0000 7f522a671740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f52201b6230 con 0x5591f79b5cd0 2024-09-12T02:53:48.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.107+0000 7f522a671740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f52201b3460 con 0x5591f79bc770 2024-09-12T02:53:48.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.107+0000 7f522a671740 10 client.0 _ll_register_callbacks cb 0x7f5210010920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:53:48.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.108+0000 7f521fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79bc770 0x5591f79c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:48.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.108+0000 7f521fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79bc770 0x5591f79c3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:33526/0 (socket says 172.21.15.18:33526) 2024-09-12T02:53:48.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.108+0000 7f521fe00640 1 -- 172.21.15.18:0/3330041756 learned_addr learned my addr 172.21.15.18:0/3330041756 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:53:48.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.108+0000 7f5224e00640 1 --2- 172.21.15.18:0/3330041756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b5cd0 0x5591f79c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:48.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.108+0000 7f5225800640 1 --2- 172.21.15.18:0/3330041756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79c0570 0x5591f7a39540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:48.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.111+0000 7f521fe00640 1 -- 172.21.15.18:0/3330041756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b5cd0 msgr2=0x5591f79c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:48.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.111+0000 7f521fe00640 1 --2- 172.21.15.18:0/3330041756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b5cd0 0x5591f79c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.111+0000 7f521fe00640 1 -- 172.21.15.18:0/3330041756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79c0570 msgr2=0x5591f7a39540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:53:48.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.111+0000 7f521fe00640 1 --2- 172.21.15.18:0/3330041756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79c0570 0x5591f7a39540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:48.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.111+0000 7f521fe00640 1 -- 172.21.15.18:0/3330041756 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591f7a39ab0 con 0x5591f79bc770 2024-09-12T02:53:48.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.113+0000 7f521fe00640 1 --2- 172.21.15.18:0/3330041756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79bc770 0x5591f79c3ef0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f520c0babf0 tx=0x7f520c0ee040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5129f21ded06b086 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:53:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.130+0000 7f520aa00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:53:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.130+0000 7f520aa00640 1 -- 172.21.15.18:0/3330041756 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c0d3e60 con 0x5591f79bc770 2024-09-12T02:53:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.130+0000 7f520aa00640 1 -- 172.21.15.18:0/3330041756 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f520c030700 con 0x5591f79bc770 2024-09-12T02:53:48.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.149+0000 7f522a671740 1 -- 172.21.15.18:0/3330041756 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5218004d50 con 0x5591f79bc770 2024-09-12T02:53:48.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.153+0000 7f520aa00640 1 -- 172.21.15.18:0/3330041756 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f520c0bac60 con 0x5591f79bc770 2024-09-12T02:53:48.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.153+0000 7f522a671740 10 client.25564 fetch_fsmap learned FSMap version 43 2024-09-12T02:53:48.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.153+0000 7f522a671740 1 -- 172.21.15.18:0/3330041756 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5591f7a3ada0 con 0x5591f79bc770 2024-09-12T02:53:48.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.157+0000 7f520aa00640 1 -- 172.21.15.18:0/3330041756 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5218004d50 con 0x5591f79bc770 2024-09-12T02:53:48.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.157+0000 7f520aa00640 1 -- 172.21.15.18:0/3330041756 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 43) ==== 8418+0+0 (secure 0 0 0) 0x7f520c03a070 con 0x5591f79bc770 2024-09-12T02:53:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.157+0000 7f522a671740 10 client.25564 fetch_fsmap finished waiting for FSMap version 43 2024-09-12T02:53:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.157+0000 7f522a671740 10 client.25564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:53:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.157+0000 7f522a671740 20 client.25564 populate_metadata read hostname 'smithi018' 2024-09-12T02:53:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.157+0000 7f522a671740 1 --2- 172.21.15.18:0/3330041756 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5591f7a3b550 0x5591f7a3d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:53:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.157+0000 7f522a671740 4 client.25564 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:53:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.157+0000 7f522a671740 1 -- 172.21.15.18:0/3330041756 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5591f7922b80 con 0x5591f7a3b550 2024-09-12T02:53:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.158+0000 7f5224e00640 1 --2- 172.21.15.18:0/3330041756 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5591f7a3b550 0x5591f7a3d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:53:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.166+0000 7f5224e00640 1 --2- 172.21.15.18:0/3330041756 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5591f7a3b550 0x5591f7a3d970 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b49cc3506d57a25 server_cookie=90e6685eca0528a3 in_seq=0 out_seq=0 2024-09-12T02:53:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:48.174+0000 7f520aa00640 10 client.25564 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:53:48.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:48 smithi018 ceph-mon[30616]: pgmap v155: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 11 MiB/s wr, 460 op/s 2024-09-12T02:53:48.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:48 smithi176 ceph-mon[35713]: pgmap v155: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 11 MiB/s wr, 460 op/s 2024-09-12T02:53:49.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:48 smithi062 ceph-mon[35527]: pgmap v155: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 11 MiB/s wr, 460 op/s 2024-09-12T02:53:50.383 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.382+0000 7f520aa00640 1 -- 172.21.15.18:0/3330041756 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5591f7922b80 con 0x5591f7a3b550 2024-09-12T02:53:50.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.382+0000 7f520aa00640 10 client.25564 handle_command_reply: tid=0 2024-09-12T02:53:50.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.382+0000 7f522a671740 1 client.25564 shutdown 2024-09-12T02:53:50.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.384+0000 7f522a671740 1 -- 172.21.15.18:0/3330041756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79bc770 msgr2=0x5591f79c3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:50.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.384+0000 7f522a671740 1 --2- 172.21.15.18:0/3330041756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79bc770 0x5591f79c3ef0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f520c0babf0 tx=0x7f520c0ee040 comp rx=0 tx=0).stop 2024-09-12T02:53:50.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.384+0000 7f522a671740 1 -- 172.21.15.18:0/3330041756 shutdown_connections 2024-09-12T02:53:50.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.384+0000 7f522a671740 1 --2- 172.21.15.18:0/3330041756 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5591f7a3b550 0x5591f7a3d970 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:50.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.384+0000 7f522a671740 1 --2- 172.21.15.18:0/3330041756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f79c0570 0x5591f7a39540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:50.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.384+0000 7f522a671740 1 --2- 172.21.15.18:0/3330041756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5591f79bc770 0x5591f79c3ef0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:50.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.384+0000 7f522a671740 1 --2- 172.21.15.18:0/3330041756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5591f79b5cd0 0x5591f79c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:50.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.384+0000 7f522a671740 1 -- 172.21.15.18:0/3330041756 >> 172.21.15.18:0/3330041756 conn(0x5591f79b1920 msgr2=0x5591f79b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:50.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.384+0000 7f520aa00640 0 client.25564 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:53:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.395+0000 7f522a671740 1 -- 172.21.15.18:0/3330041756 shutdown_connections 2024-09-12T02:53:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.395+0000 7f522a671740 1 -- 172.21.15.18:0/3330041756 wait complete. 2024-09-12T02:53:50.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.405+0000 7f522a671740 20 client.25564 trim_cache size 0 max 16384 2024-09-12T02:53:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:53:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:53:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:53:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:53:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.423+0000 7f5226200640 1 -- 172.21.15.18:0/1916224281 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f52040a2f00 msgr2=0x7f52040a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.423+0000 7f5226200640 1 --2- 172.21.15.18:0/1916224281 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f52040a2f00 0x7f52040a53c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x5591f79b2780 tx=0x7f521000a250 comp rx=0 tx=0).stop 2024-09-12T02:53:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.423+0000 7f5226200640 1 -- 172.21.15.18:0/1916224281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52201095d0 msgr2=0x7f52201168f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:53:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.423+0000 7f5226200640 1 --2- 172.21.15.18:0/1916224281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52201095d0 0x7f52201168f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f520c02a8d0 tx=0x7f520c033d10 comp rx=0 tx=0).stop 2024-09-12T02:53:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.426+0000 7f5226200640 1 -- 172.21.15.18:0/1916224281 shutdown_connections 2024-09-12T02:53:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.426+0000 7f5226200640 1 --2- 172.21.15.18:0/1916224281 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f52040a2f00 0x7f52040a53c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.426+0000 7f5226200640 1 --2- 172.21.15.18:0/1916224281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f522011b140 0x7f5220116e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.426+0000 7f5226200640 1 --2- 172.21.15.18:0/1916224281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52201095d0 0x7f52201168f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.426+0000 7f5226200640 1 --2- 172.21.15.18:0/1916224281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52201091f0 0x7f522011a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:53:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.426+0000 7f5226200640 1 -- 172.21.15.18:0/1916224281 >> 172.21.15.18:0/1916224281 conn(0x7f522006cbf0 msgr2=0x7f52200706e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:53:50.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.438+0000 7f5226200640 1 -- 172.21.15.18:0/1916224281 shutdown_connections 2024-09-12T02:53:50.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:53:50.439+0000 7f5226200640 1 -- 172.21.15.18:0/1916224281 wait complete. 2024-09-12T02:53:50.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:50 smithi018 ceph-mon[30616]: pgmap v156: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 651 op/s 2024-09-12T02:53:50.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:50 smithi176 ceph-mon[35713]: pgmap v156: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 651 op/s 2024-09-12T02:53:51.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:50 smithi062 ceph-mon[35527]: pgmap v156: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 651 op/s 2024-09-12T02:53:52.859 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:52 smithi018 ceph-mon[30616]: pgmap v157: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 9.0 MiB/s wr, 616 op/s 2024-09-12T02:53:52.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:52 smithi176 ceph-mon[35713]: pgmap v157: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 9.0 MiB/s wr, 616 op/s 2024-09-12T02:53:53.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:52 smithi062 ceph-mon[35527]: pgmap v157: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 9.0 MiB/s wr, 616 op/s 2024-09-12T02:53:54.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:54 smithi176 ceph-mon[35713]: pgmap v158: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.4 MiB/s wr, 647 op/s 2024-09-12T02:53:54.992 INFO:tasks.workunit.client.0.smithi018.stdout: 454 589212 1480 386071 1368 77752 1081 2024-09-12T02:53:55.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:54 smithi062 ceph-mon[35527]: pgmap v158: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.4 MiB/s wr, 647 op/s 2024-09-12T02:53:55.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:54 smithi018 ceph-mon[30616]: pgmap v158: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.4 MiB/s wr, 647 op/s 2024-09-12T02:53:56.906 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:56 smithi018 ceph-mon[30616]: pgmap v159: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 9.0 MiB/s wr, 713 op/s 2024-09-12T02:53:56.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:56 smithi176 ceph-mon[35713]: pgmap v159: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 9.0 MiB/s wr, 713 op/s 2024-09-12T02:53:57.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:56 smithi062 ceph-mon[35527]: pgmap v159: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 9.0 MiB/s wr, 713 op/s 2024-09-12T02:53:58.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:53:58 smithi176 ceph-mon[35713]: pgmap v160: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 469 op/s 2024-09-12T02:53:59.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:53:58 smithi062 ceph-mon[35527]: pgmap v160: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 469 op/s 2024-09-12T02:53:59.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:53:58 smithi018 ceph-mon[30616]: pgmap v160: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 469 op/s 2024-09-12T02:54:00.662 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:00 smithi018 ceph-mon[30616]: pgmap v161: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 577 op/s 2024-09-12T02:54:00.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:00 smithi176 ceph-mon[35713]: pgmap v161: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 577 op/s 2024-09-12T02:54:01.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:00 smithi062 ceph-mon[35527]: pgmap v161: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 577 op/s 2024-09-12T02:54:02.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:02 smithi176 ceph-mon[35713]: pgmap v162: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 438 op/s 2024-09-12T02:54:03.013 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:02 smithi018 ceph-mon[30616]: pgmap v162: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 438 op/s 2024-09-12T02:54:03.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:02 smithi062 ceph-mon[35527]: pgmap v162: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 438 op/s 2024-09-12T02:54:04.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:04 smithi176 ceph-mon[35713]: pgmap v163: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.4 MiB/s wr, 352 op/s 2024-09-12T02:54:05.002 INFO:tasks.workunit.client.0.smithi018.stdout: 463 497421 415 324322 589 70694 458 2024-09-12T02:54:05.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:04 smithi062 ceph-mon[35527]: pgmap v163: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.4 MiB/s wr, 352 op/s 2024-09-12T02:54:05.066 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:04 smithi018 ceph-mon[30616]: pgmap v163: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.4 MiB/s wr, 352 op/s 2024-09-12T02:54:06.859 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:06 smithi018 ceph-mon[30616]: pgmap v164: 129 pgs: 129 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 10 MiB/s wr, 497 op/s 2024-09-12T02:54:06.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:06 smithi176 ceph-mon[35713]: pgmap v164: 129 pgs: 129 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 10 MiB/s wr, 497 op/s 2024-09-12T02:54:07.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:06 smithi062 ceph-mon[35527]: pgmap v164: 129 pgs: 129 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 10 MiB/s wr, 497 op/s 2024-09-12T02:54:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.083+0000 7f5a93e00640 1 -- 172.21.15.18:0/3581428780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a8c0a52f0 msgr2=0x7f5a8c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.083+0000 7f5a93e00640 1 --2- 172.21.15.18:0/3581428780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a8c0a52f0 0x7f5a8c0b71b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009890 tx=0x7f5a8002a370 comp rx=0 tx=0).stop 2024-09-12T02:54:08.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.142+0000 7f5a93e00640 1 -- 172.21.15.18:0/3581428780 shutdown_connections 2024-09-12T02:54:08.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.142+0000 7f5a93e00640 1 --2- 172.21.15.18:0/3581428780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a8c0b76f0 0x7f5a8c0b9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.142+0000 7f5a93e00640 1 --2- 172.21.15.18:0/3581428780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a8c0a52f0 0x7f5a8c0b71b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.142+0000 7f5a93e00640 1 --2- 172.21.15.18:0/3581428780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c0a49d0 0x7f5a8c0a4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.142+0000 7f5a93e00640 1 -- 172.21.15.18:0/3581428780 >> 172.21.15.18:0/3581428780 conn(0x7f5a8c01a0d0 msgr2=0x7f5a8c01a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:08.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.143+0000 7f5a93e00640 1 -- 172.21.15.18:0/3581428780 shutdown_connections 2024-09-12T02:54:08.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.143+0000 7f5a93e00640 1 -- 172.21.15.18:0/3581428780 wait complete. 2024-09-12T02:54:08.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.144+0000 7f5a93e00640 1 Processor -- start 2024-09-12T02:54:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.146+0000 7f5a93e00640 1 -- start start 2024-09-12T02:54:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.157+0000 7f5a93e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a8c0a49d0 0x7f5a8c0b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.163+0000 7f5a93e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a8c0a52f0 0x7f5a8c0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.163+0000 7f5a93e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c0b76f0 0x7f5a8c0b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.163+0000 7f5a99800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a8c0a52f0 0x7f5a8c0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.163+0000 7f5a99800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a8c0a52f0 0x7f5a8c0b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:45274/0 (socket says 172.21.15.18:45274) 2024-09-12T02:54:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.165+0000 7f5a92a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c0b76f0 0x7f5a8c0b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.165+0000 7f5a92a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c0b76f0 0x7f5a8c0b3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35830/0 (socket says 172.21.15.18:35830) 2024-09-12T02:54:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.165+0000 7f5a99800640 1 -- 172.21.15.18:0/302321936 learned_addr learned my addr 172.21.15.18:0/302321936 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:54:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.165+0000 7f5a93e00640 1 -- 172.21.15.18:0/302321936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c0af370 con 0x7f5a8c0b76f0 2024-09-12T02:54:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.165+0000 7f5a93e00640 1 -- 172.21.15.18:0/302321936 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c0af1f0 con 0x7f5a8c0a49d0 2024-09-12T02:54:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.165+0000 7f5a93e00640 1 -- 172.21.15.18:0/302321936 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c0af4f0 con 0x7f5a8c0a52f0 2024-09-12T02:54:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.166+0000 7f5a99800640 1 -- 172.21.15.18:0/302321936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a8c0a49d0 msgr2=0x7f5a8c0b6e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:54:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.166+0000 7f5a99800640 1 --2- 172.21.15.18:0/302321936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a8c0a49d0 0x7f5a8c0b6e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.166+0000 7f5a99800640 1 -- 172.21.15.18:0/302321936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c0b76f0 msgr2=0x7f5a8c0b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.166+0000 7f5a99800640 1 --2- 172.21.15.18:0/302321936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c0b76f0 0x7f5a8c0b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.166+0000 7f5a99800640 1 -- 172.21.15.18:0/302321936 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8c0b3b90 con 0x7f5a8c0a52f0 2024-09-12T02:54:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.178+0000 7f5a99800640 1 --2- 172.21.15.18:0/302321936 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a8c0a52f0 0x7f5a8c0b2f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5a8002a8e0 tx=0x7f5a80033d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.197+0000 7f5a8b400640 1 -- 172.21.15.18:0/302321936 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a80037040 con 0x7f5a8c0a52f0 2024-09-12T02:54:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.197+0000 7f5a8b400640 1 -- 172.21.15.18:0/302321936 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a80040070 con 0x7f5a8c0a52f0 2024-09-12T02:54:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.197+0000 7f5a8b400640 1 -- 172.21.15.18:0/302321936 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a80003a50 con 0x7f5a8c0a52f0 2024-09-12T02:54:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.207+0000 7f5a93e00640 1 -- 172.21.15.18:0/302321936 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a8c147490 con 0x7f5a8c0a52f0 2024-09-12T02:54:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.207+0000 7f5a93e00640 1 -- 172.21.15.18:0/302321936 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a8c147840 con 0x7f5a8c0a52f0 2024-09-12T02:54:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.240+0000 7f5a8b400640 1 -- 172.21.15.18:0/302321936 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f5a80003bf0 con 0x7f5a8c0a52f0 2024-09-12T02:54:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.243+0000 7f5a8b400640 1 --2- 172.21.15.18:0/302321936 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f5a780a2f00 0x7f5a780a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.243+0000 7f5a8b400640 1 -- 172.21.15.18:0/302321936 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f5a800ef330 con 0x7f5a8c0a52f0 2024-09-12T02:54:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.244+0000 7f5a92000640 1 --2- 172.21.15.18:0/302321936 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f5a780a2f00 0x7f5a780a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.246+0000 7f5a92000640 1 --2- 172.21.15.18:0/302321936 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f5a780a2f00 0x7f5a780a53c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5a84005fd0 tx=0x7f5a84005c70 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:08.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.252+0000 7f5a9c853740 1 Processor -- start 2024-09-12T02:54:08.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.259+0000 7f5a9c853740 1 -- start start 2024-09-12T02:54:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.270+0000 7f5a9c853740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f693b0 0x562ac3f69790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.270+0000 7f5a9c853740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f69cd0 0x562ac3f74030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.270+0000 7f5a9c853740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 0x562ac3f76960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.271+0000 7f5a99800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f69cd0 0x562ac3f74030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:08.273 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.271+0000 7f5a92a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 0x562ac3f76960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:08.273 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.272+0000 7f5a92a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 0x562ac3f76960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:45286/0 (socket says 172.21.15.18:45286) 2024-09-12T02:54:08.273 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.272+0000 7f5a99800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f69cd0 0x562ac3f74030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35846/0 (socket says 172.21.15.18:35846) 2024-09-12T02:54:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.272+0000 7f5a9c853740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562ac3ecf100 con 0x562ac3f69cd0 2024-09-12T02:54:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.272+0000 7f5a9c853740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562ac3e771b0 con 0x562ac3f693b0 2024-09-12T02:54:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.272+0000 7f5a9c853740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562ac3ecb0c0 con 0x562ac3f74570 2024-09-12T02:54:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.272+0000 7f5a92a00640 1 -- 172.21.15.18:0/3569945472 learned_addr learned my addr 172.21.15.18:0/3569945472 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:54:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.273+0000 7f5a99800640 1 -- 172.21.15.18:0/3569945472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 msgr2=0x562ac3f76960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.273+0000 7f5a99800640 1 --2- 172.21.15.18:0/3569945472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 0x562ac3f76960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.273+0000 7f5a99800640 1 -- 172.21.15.18:0/3569945472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f693b0 msgr2=0x562ac3f69790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:54:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.273+0000 7f5a99800640 1 --2- 172.21.15.18:0/3569945472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f693b0 0x562ac3f69790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.273+0000 7f5a99800640 1 -- 172.21.15.18:0/3569945472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ac3be2210 con 0x562ac3f69cd0 2024-09-12T02:54:08.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.274+0000 7f5a99800640 1 --2- 172.21.15.18:0/3569945472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f69cd0 0x562ac3f74030 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5a800ec770 tx=0x7f5a800bb080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22da2a5436b9df54 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:08.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.275+0000 7f5a7fe00640 1 -- 172.21.15.18:0/3569945472 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a800bb540 con 0x562ac3f69cd0 2024-09-12T02:54:08.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.275+0000 7f5a7fe00640 1 -- 172.21.15.18:0/3569945472 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a800db050 con 0x562ac3f69cd0 2024-09-12T02:54:08.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.275+0000 7f5a7fe00640 1 -- 172.21.15.18:0/3569945472 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a800ec8e0 con 0x562ac3f69cd0 2024-09-12T02:54:08.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.288+0000 7f5a9c853740 1 -- 172.21.15.18:0/3569945472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f69cd0 msgr2=0x562ac3f74030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:08.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.288+0000 7f5a9c853740 1 --2- 172.21.15.18:0/3569945472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f69cd0 0x562ac3f74030 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5a800ec770 tx=0x7f5a800bb080 comp rx=0 tx=0).stop 2024-09-12T02:54:08.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.288+0000 7f5a9c853740 1 -- 172.21.15.18:0/3569945472 shutdown_connections 2024-09-12T02:54:08.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.289+0000 7f5a9c853740 1 --2- 172.21.15.18:0/3569945472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 0x562ac3f76960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.289+0000 7f5a9c853740 1 --2- 172.21.15.18:0/3569945472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f69cd0 0x562ac3f74030 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.289+0000 7f5a9c853740 1 --2- 172.21.15.18:0/3569945472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f693b0 0x562ac3f69790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.289+0000 7f5a9c853740 1 -- 172.21.15.18:0/3569945472 >> 172.21.15.18:0/3569945472 conn(0x562ac3f65920 msgr2=0x562ac3f65d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:08.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.316+0000 7f5a9c853740 1 -- 172.21.15.18:0/3569945472 shutdown_connections 2024-09-12T02:54:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.325+0000 7f5a9c853740 1 -- 172.21.15.18:0/3569945472 wait complete. 2024-09-12T02:54:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.326+0000 7f5a9c853740 1 -- start start 2024-09-12T02:54:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.327+0000 7f5a9c853740 1 Processor -- start 2024-09-12T02:54:08.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.334+0000 7f5a9c853740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f693b0 0x562ac3f71530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.334+0000 7f5a9c853740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f69cd0 0x562ac3f71a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.334+0000 7f5a9c853740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 0x562ac3f71fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.346 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.336+0000 7f5a92000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f693b0 0x562ac3f71530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.339+0000 7f5a99800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f69cd0 0x562ac3f71a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.339+0000 7f5a99800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f69cd0 0x562ac3f71a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:51120/0 (socket says 172.21.15.18:51120) 2024-09-12T02:54:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.342+0000 7f5a92a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 0x562ac3f71fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.342+0000 7f5a92a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 0x562ac3f71fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:45288/0 (socket says 172.21.15.18:45288) 2024-09-12T02:54:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.342+0000 7f5a9c853740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562ac3f76f00 con 0x562ac3f693b0 2024-09-12T02:54:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.342+0000 7f5a9c853740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562ac3e58090 con 0x562ac3f69cd0 2024-09-12T02:54:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.342+0000 7f5a9c853740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562ac3f77080 con 0x562ac3f74570 2024-09-12T02:54:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.342+0000 7f5a9c853740 10 client.0 _ll_register_callbacks cb 0x562ac3eacf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:54:08.348 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.346+0000 7f5a92000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f693b0 0x562ac3f71530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35854/0 (socket says 172.21.15.18:35854) 2024-09-12T02:54:08.348 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.346+0000 7f5a92000640 1 -- 172.21.15.18:0/2266943958 learned_addr learned my addr 172.21.15.18:0/2266943958 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:54:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.352+0000 7f5a92a00640 1 -- 172.21.15.18:0/2266943958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f69cd0 msgr2=0x562ac3f71a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.352+0000 7f5a92a00640 1 --2- 172.21.15.18:0/2266943958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f69cd0 0x562ac3f71a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.352+0000 7f5a92a00640 1 -- 172.21.15.18:0/2266943958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f693b0 msgr2=0x562ac3f71530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.352+0000 7f5a92a00640 1 --2- 172.21.15.18:0/2266943958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f693b0 0x562ac3f71530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.352+0000 7f5a92a00640 1 -- 172.21.15.18:0/2266943958 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ac3cae620 con 0x562ac3f74570 2024-09-12T02:54:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.357+0000 7f5a92a00640 1 --2- 172.21.15.18:0/2266943958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 0x562ac3f71fb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5a94051790 tx=0x7f5a94086a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc49d610d5e5f5f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.364+0000 7f5a7cc00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:54:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.364+0000 7f5a7cc00640 1 -- 172.21.15.18:0/2266943958 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a940857c0 con 0x562ac3f74570 2024-09-12T02:54:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.364+0000 7f5a7cc00640 1 -- 172.21.15.18:0/2266943958 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f5a9407e070 con 0x562ac3f74570 2024-09-12T02:54:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.379+0000 7f5a9c853740 1 -- 172.21.15.18:0/2266943958 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a800db050 con 0x562ac3f74570 2024-09-12T02:54:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.398+0000 7f5a7cc00640 1 -- 172.21.15.18:0/2266943958 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f5a94085960 con 0x562ac3f74570 2024-09-12T02:54:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.398+0000 7f5a9c853740 10 client.25576 fetch_fsmap learned FSMap version 44 2024-09-12T02:54:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.398+0000 7f5a9c853740 1 -- 172.21.15.18:0/2266943958 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x562ac3f82b50 con 0x562ac3f74570 2024-09-12T02:54:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.400+0000 7f5a7cc00640 1 -- 172.21.15.18:0/2266943958 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a800db050 con 0x562ac3f74570 2024-09-12T02:54:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.400+0000 7f5a7cc00640 1 -- 172.21.15.18:0/2266943958 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 44) ==== 8422+0+0 (secure 0 0 0) 0x7f5a94090420 con 0x562ac3f74570 2024-09-12T02:54:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.401+0000 7f5a9c853740 10 client.25576 fetch_fsmap finished waiting for FSMap version 44 2024-09-12T02:54:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.401+0000 7f5a9c853740 10 client.25576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:54:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.401+0000 7f5a9c853740 20 client.25576 populate_metadata read hostname 'smithi018' 2024-09-12T02:54:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.401+0000 7f5a9c853740 1 --2- 172.21.15.18:0/2266943958 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562ac3f84010 0x562ac3f86420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:08.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.401+0000 7f5a9c853740 4 client.25576 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:54:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.401+0000 7f5a9c853740 1 -- 172.21.15.18:0/2266943958 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ac3edc830 con 0x562ac3f84010 2024-09-12T02:54:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.402+0000 7f5a92000640 1 --2- 172.21.15.18:0/2266943958 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562ac3f84010 0x562ac3f86420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.412+0000 7f5a92000640 1 --2- 172.21.15.18:0/2266943958 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562ac3f84010 0x562ac3f86420 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b32d8b3a19886a6 server_cookie=9d56e4d8f23b9ea9 in_seq=0 out_seq=0 2024-09-12T02:54:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.416+0000 7f5a7cc00640 10 client.25576 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:54:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.416+0000 7f5a7cc00640 1 -- 172.21.15.18:0/2266943958 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ac3edc830 con 0x562ac3f84010 2024-09-12T02:54:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.416+0000 7f5a7cc00640 10 client.25576 handle_command_reply: tid=0 2024-09-12T02:54:08.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.424+0000 7f5a9c853740 1 client.25576 shutdown 2024-09-12T02:54:08.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.476+0000 7f5a9c853740 1 -- 172.21.15.18:0/2266943958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 msgr2=0x562ac3f71fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:08.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.476+0000 7f5a9c853740 1 --2- 172.21.15.18:0/2266943958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 0x562ac3f71fb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5a94051790 tx=0x7f5a94086a40 comp rx=0 tx=0).stop 2024-09-12T02:54:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.486+0000 7f5a9c853740 1 -- 172.21.15.18:0/2266943958 shutdown_connections 2024-09-12T02:54:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.486+0000 7f5a9c853740 1 --2- 172.21.15.18:0/2266943958 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562ac3f84010 0x562ac3f86420 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.486+0000 7f5a9c853740 1 --2- 172.21.15.18:0/2266943958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 0x562ac3f71fb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.486+0000 7f5a9c853740 1 --2- 172.21.15.18:0/2266943958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f69cd0 0x562ac3f71a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.486+0000 7f5a9c853740 1 --2- 172.21.15.18:0/2266943958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f693b0 0x562ac3f71530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.486+0000 7f5a9c853740 1 -- 172.21.15.18:0/2266943958 >> 172.21.15.18:0/2266943958 conn(0x562ac3f65920 msgr2=0x562ac3f6b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:08.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.486+0000 7f5a7cc00640 0 client.25576 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:54:08.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.486+0000 7f5a9c853740 1 -- 172.21.15.18:0/2266943958 shutdown_connections 2024-09-12T02:54:08.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.486+0000 7f5a9c853740 1 -- 172.21.15.18:0/2266943958 wait complete. 2024-09-12T02:54:08.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:08.486+0000 7f5a9c853740 20 client.25576 trim_cache size 0 max 16384 2024-09-12T02:54:08.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:08 smithi176 ceph-mon[35713]: pgmap v165: 129 pgs: 129 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 11 MiB/s wr, 496 op/s 2024-09-12T02:54:08.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:08 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:54:09.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.003+0000 7f5a9c853740 1 Processor -- start 2024-09-12T02:54:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.024+0000 7f5a9c853740 1 -- start start 2024-09-12T02:54:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.024+0000 7f5a9c853740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f693b0 0x562ac3f6be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.024+0000 7f5a9c853740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f69cd0 0x562ac3f71de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.024+0000 7f5a9c853740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f74570 0x562ac3f8bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.024+0000 7f5a9c853740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c151a80 con 0x562ac3f69cd0 2024-09-12T02:54:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.024+0000 7f5a9c853740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c153770 con 0x562ac3f74570 2024-09-12T02:54:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.024+0000 7f5a9c853740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c152210 con 0x562ac3f693b0 2024-09-12T02:54:09.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.025+0000 7f5a92a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f74570 0x562ac3f8bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:09.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.025+0000 7f5a92a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f74570 0x562ac3f8bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:51124/0 (socket says 172.21.15.18:51124) 2024-09-12T02:54:09.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.025+0000 7f5a92a00640 1 -- 172.21.15.18:0/1011497720 learned_addr learned my addr 172.21.15.18:0/1011497720 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:54:09.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:08 smithi062 ceph-mon[35527]: pgmap v165: 129 pgs: 129 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 11 MiB/s wr, 496 op/s 2024-09-12T02:54:09.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:08 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:54:09.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.030+0000 7f5a99800640 1 --2- 172.21.15.18:0/1011497720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f69cd0 0x562ac3f71de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:09.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.031+0000 7f5a99800640 1 -- 172.21.15.18:0/1011497720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f693b0 msgr2=0x562ac3f6be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:09.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.031+0000 7f5a99800640 1 --2- 172.21.15.18:0/1011497720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f693b0 0x562ac3f6be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.031+0000 7f5a99800640 1 -- 172.21.15.18:0/1011497720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f74570 msgr2=0x562ac3f8bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:09.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.031+0000 7f5a99800640 1 --2- 172.21.15.18:0/1011497720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f74570 0x562ac3f8bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.031+0000 7f5a99800640 1 -- 172.21.15.18:0/1011497720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ac3f86aa0 con 0x562ac3f69cd0 2024-09-12T02:54:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.053+0000 7f5a99800640 1 --2- 172.21.15.18:0/1011497720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f69cd0 0x562ac3f71de0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x562ac3f66780 tx=0x7f5a80009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264f8b9d47705cfa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:09.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.077+0000 7f5a7f400640 1 -- 172.21.15.18:0/1011497720 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a800d8070 con 0x562ac3f69cd0 2024-09-12T02:54:09.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.077+0000 7f5a7f400640 1 -- 172.21.15.18:0/1011497720 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a800bb540 con 0x562ac3f69cd0 2024-09-12T02:54:09.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.077+0000 7f5a7f400640 1 -- 172.21.15.18:0/1011497720 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a800c3d20 con 0x562ac3f69cd0 2024-09-12T02:54:09.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.095+0000 7f5a9c853740 1 -- 172.21.15.18:0/1011497720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f69cd0 msgr2=0x562ac3f71de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:09.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.095+0000 7f5a9c853740 1 --2- 172.21.15.18:0/1011497720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f69cd0 0x562ac3f71de0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x562ac3f66780 tx=0x7f5a80009490 comp rx=0 tx=0).stop 2024-09-12T02:54:09.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:08 smithi018 ceph-mon[30616]: pgmap v165: 129 pgs: 129 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 11 MiB/s wr, 496 op/s 2024-09-12T02:54:09.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:08 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:54:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.102+0000 7f5a9c853740 1 -- 172.21.15.18:0/1011497720 shutdown_connections 2024-09-12T02:54:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.102+0000 7f5a9c853740 1 --2- 172.21.15.18:0/1011497720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f74570 0x562ac3f8bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.102+0000 7f5a9c853740 1 --2- 172.21.15.18:0/1011497720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f69cd0 0x562ac3f71de0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.102+0000 7f5a9c853740 1 --2- 172.21.15.18:0/1011497720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f693b0 0x562ac3f6be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.102+0000 7f5a9c853740 1 -- 172.21.15.18:0/1011497720 >> 172.21.15.18:0/1011497720 conn(0x562ac3f65920 msgr2=0x562ac3f734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.103+0000 7f5a9c853740 1 -- 172.21.15.18:0/1011497720 shutdown_connections 2024-09-12T02:54:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.103+0000 7f5a9c853740 1 -- 172.21.15.18:0/1011497720 wait complete. 2024-09-12T02:54:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.103+0000 7f5a9c853740 1 -- start start 2024-09-12T02:54:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.104+0000 7f5a9c853740 1 Processor -- start 2024-09-12T02:54:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.108+0000 7f5a9c853740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f693b0 0x562ac3f77e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.108+0000 7f5a9c853740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f69cd0 0x562ac3f783d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.108+0000 7f5a9c853740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 0x562ac3f78910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.108+0000 7f5a9c853740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c153070 con 0x562ac3f693b0 2024-09-12T02:54:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.108+0000 7f5a9c853740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c1528e0 con 0x562ac3f69cd0 2024-09-12T02:54:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.108+0000 7f5a9c853740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c14fa60 con 0x562ac3f74570 2024-09-12T02:54:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.108+0000 7f5a9c853740 10 client.0 _ll_register_callbacks cb 0x7f5a94069e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:54:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.108+0000 7f5a92a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 0x562ac3f78910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.108+0000 7f5a92a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 0x562ac3f78910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:45302/0 (socket says 172.21.15.18:45302) 2024-09-12T02:54:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.108+0000 7f5a92a00640 1 -- 172.21.15.18:0/2333261539 learned_addr learned my addr 172.21.15.18:0/2333261539 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:54:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.108+0000 7f5a99800640 1 --2- 172.21.15.18:0/2333261539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f69cd0 0x562ac3f783d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.109+0000 7f5a92a00640 1 -- 172.21.15.18:0/2333261539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f69cd0 msgr2=0x562ac3f783d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.109+0000 7f5a92a00640 1 --2- 172.21.15.18:0/2333261539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f69cd0 0x562ac3f783d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.109+0000 7f5a92a00640 1 -- 172.21.15.18:0/2333261539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f693b0 msgr2=0x562ac3f77e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.109+0000 7f5a92a00640 1 --2- 172.21.15.18:0/2333261539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f693b0 0x562ac3f77e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.109+0000 7f5a92a00640 1 -- 172.21.15.18:0/2333261539 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ac3f665b0 con 0x562ac3f74570 2024-09-12T02:54:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.110+0000 7f5a92a00640 1 --2- 172.21.15.18:0/2333261539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 0x562ac3f78910 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5a94065240 tx=0x7f5a94067fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a2657b3edf83b92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.110+0000 7f5a7cc00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:54:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.110+0000 7f5a7cc00640 1 -- 172.21.15.18:0/2333261539 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a94090a10 con 0x562ac3f74570 2024-09-12T02:54:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.110+0000 7f5a7cc00640 1 -- 172.21.15.18:0/2333261539 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f5a9407e040 con 0x562ac3f74570 2024-09-12T02:54:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.111+0000 7f5a9c853740 1 -- 172.21.15.18:0/2333261539 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a800bb540 con 0x562ac3f74570 2024-09-12T02:54:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.111+0000 7f5a7cc00640 1 -- 172.21.15.18:0/2333261539 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f5a94090bb0 con 0x562ac3f74570 2024-09-12T02:54:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.111+0000 7f5a9c853740 10 client.25579 fetch_fsmap learned FSMap version 44 2024-09-12T02:54:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.111+0000 7f5a9c853740 1 -- 172.21.15.18:0/2333261539 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x562ac3feee20 con 0x562ac3f74570 2024-09-12T02:54:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.111+0000 7f5a7cc00640 1 -- 172.21.15.18:0/2333261539 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a800bb540 con 0x562ac3f74570 2024-09-12T02:54:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.112+0000 7f5a7cc00640 1 -- 172.21.15.18:0/2333261539 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 44) ==== 8422+0+0 (secure 0 0 0) 0x7f5a9409a420 con 0x562ac3f74570 2024-09-12T02:54:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.112+0000 7f5a9c853740 10 client.25579 fetch_fsmap finished waiting for FSMap version 44 2024-09-12T02:54:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.112+0000 7f5a9c853740 10 client.25579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:54:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.112+0000 7f5a9c853740 20 client.25579 populate_metadata read hostname 'smithi018' 2024-09-12T02:54:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.112+0000 7f5a9c853740 1 --2- 172.21.15.18:0/2333261539 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562ac3fef570 0x562ac3ff19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.112+0000 7f5a9c853740 4 client.25579 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:54:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.112+0000 7f5a9c853740 1 -- 172.21.15.18:0/2333261539 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562ac3ed6b80 con 0x562ac3fef570 2024-09-12T02:54:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.112+0000 7f5a92000640 1 --2- 172.21.15.18:0/2333261539 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562ac3fef570 0x562ac3ff19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.113+0000 7f5a92000640 1 --2- 172.21.15.18:0/2333261539 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562ac3fef570 0x562ac3ff19b0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f40bc468910de5d server_cookie=f7c19ddcb1c38928 in_seq=0 out_seq=0 2024-09-12T02:54:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:09.113+0000 7f5a7cc00640 10 client.25579 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:54:10.712 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:10 smithi018 ceph-mon[30616]: pgmap v166: 129 pgs: 129 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 601 op/s 2024-09-12T02:54:10.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:10 smithi176 ceph-mon[35713]: pgmap v166: 129 pgs: 129 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 601 op/s 2024-09-12T02:54:11.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:10 smithi062 ceph-mon[35527]: pgmap v166: 129 pgs: 129 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 601 op/s 2024-09-12T02:54:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.492+0000 7f5a7cc00640 1 -- 172.21.15.18:0/2333261539 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562ac3ed6b80 con 0x562ac3fef570 2024-09-12T02:54:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.492+0000 7f5a7cc00640 10 client.25579 handle_command_reply: tid=0 2024-09-12T02:54:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.492+0000 7f5a9c853740 1 client.25579 shutdown 2024-09-12T02:54:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.493+0000 7f5a9c853740 1 -- 172.21.15.18:0/2333261539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 msgr2=0x562ac3f78910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.493+0000 7f5a9c853740 1 --2- 172.21.15.18:0/2333261539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 0x562ac3f78910 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5a94065240 tx=0x7f5a94067fc0 comp rx=0 tx=0).stop 2024-09-12T02:54:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.493+0000 7f5a9c853740 1 -- 172.21.15.18:0/2333261539 shutdown_connections 2024-09-12T02:54:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.493+0000 7f5a9c853740 1 --2- 172.21.15.18:0/2333261539 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562ac3fef570 0x562ac3ff19b0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.493+0000 7f5a9c853740 1 --2- 172.21.15.18:0/2333261539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562ac3f74570 0x562ac3f78910 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.493+0000 7f5a9c853740 1 --2- 172.21.15.18:0/2333261539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ac3f69cd0 0x562ac3f783d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.493+0000 7f5a9c853740 1 --2- 172.21.15.18:0/2333261539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562ac3f693b0 0x562ac3f77e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.493+0000 7f5a9c853740 1 -- 172.21.15.18:0/2333261539 >> 172.21.15.18:0/2333261539 conn(0x562ac3f65920 msgr2=0x562ac3f729f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.494+0000 7f5a7cc00640 0 client.25579 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:54:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.494+0000 7f5a9c853740 1 -- 172.21.15.18:0/2333261539 shutdown_connections 2024-09-12T02:54:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.494+0000 7f5a9c853740 1 -- 172.21.15.18:0/2333261539 wait complete. 2024-09-12T02:54:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.495+0000 7f5a9c853740 20 client.25579 trim_cache size 0 max 16384 2024-09-12T02:54:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:54:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:54:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:54:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:54:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.500+0000 7f5a93e00640 1 -- 172.21.15.18:0/302321936 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f5a780a2f00 msgr2=0x7f5a780a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.500+0000 7f5a93e00640 1 --2- 172.21.15.18:0/302321936 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f5a780a2f00 0x7f5a780a53c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5a84005fd0 tx=0x7f5a84005c70 comp rx=0 tx=0).stop 2024-09-12T02:54:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.500+0000 7f5a93e00640 1 -- 172.21.15.18:0/302321936 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a8c0a52f0 msgr2=0x7f5a8c0b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.500+0000 7f5a93e00640 1 --2- 172.21.15.18:0/302321936 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a8c0a52f0 0x7f5a8c0b2f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5a8002a8e0 tx=0x7f5a80033d10 comp rx=0 tx=0).stop 2024-09-12T02:54:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.500+0000 7f5a93e00640 1 -- 172.21.15.18:0/302321936 shutdown_connections 2024-09-12T02:54:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.500+0000 7f5a93e00640 1 --2- 172.21.15.18:0/302321936 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f5a780a2f00 0x7f5a780a53c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.500+0000 7f5a93e00640 1 --2- 172.21.15.18:0/302321936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c0b76f0 0x7f5a8c0b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.500+0000 7f5a93e00640 1 --2- 172.21.15.18:0/302321936 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a8c0a52f0 0x7f5a8c0b2f20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.500+0000 7f5a93e00640 1 --2- 172.21.15.18:0/302321936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a8c0a49d0 0x7f5a8c0b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.500+0000 7f5a93e00640 1 -- 172.21.15.18:0/302321936 >> 172.21.15.18:0/302321936 conn(0x7f5a8c01a0d0 msgr2=0x7f5a8c0b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.506+0000 7f5a93e00640 1 -- 172.21.15.18:0/302321936 shutdown_connections 2024-09-12T02:54:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:11.509+0000 7f5a93e00640 1 -- 172.21.15.18:0/302321936 wait complete. 2024-09-12T02:54:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:12 smithi062 ceph-mon[35527]: pgmap v167: 129 pgs: 129 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 603 op/s 2024-09-12T02:54:13.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:12 smithi018 ceph-mon[30616]: pgmap v167: 129 pgs: 129 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 603 op/s 2024-09-12T02:54:13.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:12 smithi176 ceph-mon[35713]: pgmap v167: 129 pgs: 129 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 603 op/s 2024-09-12T02:54:14.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:13 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:54:14.108 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:13 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:54:14.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:13 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:54:14.994 INFO:tasks.workunit.client.0.smithi018.stdout: 476 512667 667 332388 402 73352 209 2024-09-12T02:54:15.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:14 smithi062 ceph-mon[35527]: pgmap v168: 129 pgs: 129 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 11 MiB/s wr, 594 op/s 2024-09-12T02:54:15.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:14 smithi018 ceph-mon[30616]: pgmap v168: 129 pgs: 129 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 11 MiB/s wr, 594 op/s 2024-09-12T02:54:15.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:14 smithi176 ceph-mon[35713]: pgmap v168: 129 pgs: 129 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 11 MiB/s wr, 594 op/s 2024-09-12T02:54:17.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:16 smithi062 ceph-mon[35527]: pgmap v169: 129 pgs: 129 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 814 op/s 2024-09-12T02:54:17.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:16 smithi018 ceph-mon[30616]: pgmap v169: 129 pgs: 129 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 814 op/s 2024-09-12T02:54:17.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:16 smithi176 ceph-mon[35713]: pgmap v169: 129 pgs: 129 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 814 op/s 2024-09-12T02:54:19.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:18 smithi062 ceph-mon[35527]: pgmap v170: 129 pgs: 129 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.2 MiB/s wr, 640 op/s 2024-09-12T02:54:19.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:18 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:54:19.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:18 smithi018 ceph-mon[30616]: pgmap v170: 129 pgs: 129 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.2 MiB/s wr, 640 op/s 2024-09-12T02:54:19.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:18 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:54:19.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:18 smithi176 ceph-mon[35713]: pgmap v170: 129 pgs: 129 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.2 MiB/s wr, 640 op/s 2024-09-12T02:54:19.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:18 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:54:21.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:20 smithi062 ceph-mon[35527]: pgmap v171: 129 pgs: 129 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.6 MiB/s wr, 586 op/s 2024-09-12T02:54:21.109 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:20 smithi018 ceph-mon[30616]: pgmap v171: 129 pgs: 129 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.6 MiB/s wr, 586 op/s 2024-09-12T02:54:21.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:20 smithi176 ceph-mon[35713]: pgmap v171: 129 pgs: 129 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.6 MiB/s wr, 586 op/s 2024-09-12T02:54:23.108 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:22 smithi018 ceph-mon[30616]: pgmap v172: 129 pgs: 129 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 510 op/s 2024-09-12T02:54:23.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:22 smithi176 ceph-mon[35713]: pgmap v172: 129 pgs: 129 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 510 op/s 2024-09-12T02:54:23.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:22 smithi062 ceph-mon[35527]: pgmap v172: 129 pgs: 129 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 510 op/s 2024-09-12T02:54:24.993 INFO:tasks.workunit.client.0.smithi018.stdout: 490 581765 1014 377506 873 86257 650 2024-09-12T02:54:25.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:24 smithi176 ceph-mon[35713]: pgmap v173: 129 pgs: 129 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 395 op/s 2024-09-12T02:54:25.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:24 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:54:25.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:24 smithi062 ceph-mon[35527]: pgmap v173: 129 pgs: 129 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 395 op/s 2024-09-12T02:54:25.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:24 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:54:25.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:24 smithi018 ceph-mon[30616]: pgmap v173: 129 pgs: 129 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 395 op/s 2024-09-12T02:54:25.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:24 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:54:27.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:26 smithi176 ceph-mon[35713]: pgmap v174: 129 pgs: 129 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.4 MiB/s wr, 446 op/s 2024-09-12T02:54:27.257 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:26 smithi018 ceph-mon[30616]: pgmap v174: 129 pgs: 129 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.4 MiB/s wr, 446 op/s 2024-09-12T02:54:27.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:26 smithi062 ceph-mon[35527]: pgmap v174: 129 pgs: 129 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.4 MiB/s wr, 446 op/s 2024-09-12T02:54:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.030+0000 7f1a4f200640 1 -- 172.21.15.18:0/2620201915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a5011b140 msgr2=0x7f1a5011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.030+0000 7f1a4f200640 1 --2- 172.21.15.18:0/2620201915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a5011b140 0x7f1a5011d530 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1a4001a910 tx=0x7f1a4003b470 comp rx=0 tx=0).stop 2024-09-12T02:54:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.079+0000 7f1a4f200640 1 -- 172.21.15.18:0/2620201915 shutdown_connections 2024-09-12T02:54:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.079+0000 7f1a4f200640 1 --2- 172.21.15.18:0/2620201915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a5011b140 0x7f1a5011d530 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.079+0000 7f1a4f200640 1 --2- 172.21.15.18:0/2620201915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a501095d0 0x7f1a50109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.079+0000 7f1a4f200640 1 --2- 172.21.15.18:0/2620201915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a501091f0 0x7f1a50110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.079+0000 7f1a4f200640 1 -- 172.21.15.18:0/2620201915 >> 172.21.15.18:0/2620201915 conn(0x7f1a5006cbf0 msgr2=0x7f1a5006d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.079+0000 7f1a4f200640 1 -- 172.21.15.18:0/2620201915 shutdown_connections 2024-09-12T02:54:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.079+0000 7f1a4f200640 1 -- 172.21.15.18:0/2620201915 wait complete. 2024-09-12T02:54:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.081+0000 7f1a4f200640 1 Processor -- start 2024-09-12T02:54:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.081+0000 7f1a4f200640 1 -- start start 2024-09-12T02:54:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.082+0000 7f1a4f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a501091f0 0x7f1a5011a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.083+0000 7f1a4de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a501091f0 0x7f1a5011a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.083+0000 7f1a4de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a501091f0 0x7f1a5011a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37338/0 (socket says 172.21.15.18:37338) 2024-09-12T02:54:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.086+0000 7f1a4de00640 1 -- 172.21.15.18:0/4006212851 learned_addr learned my addr 172.21.15.18:0/4006212851 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:54:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.086+0000 7f1a4f200640 1 --2- 172.21.15.18:0/4006212851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a501095d0 0x7f1a501169f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.086+0000 7f1a4f200640 1 --2- 172.21.15.18:0/4006212851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a5011b140 0x7f1a50116f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.086+0000 7f1a4d400640 1 --2- 172.21.15.18:0/4006212851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a501095d0 0x7f1a501169f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.087+0000 7f1a4f200640 1 -- 172.21.15.18:0/4006212851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a50113310 con 0x7f1a501091f0 2024-09-12T02:54:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.087+0000 7f1a4e800640 1 --2- 172.21.15.18:0/4006212851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a5011b140 0x7f1a50116f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:28.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.087+0000 7f1a4f200640 1 -- 172.21.15.18:0/4006212851 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1a50113190 con 0x7f1a5011b140 2024-09-12T02:54:28.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.087+0000 7f1a4f200640 1 -- 172.21.15.18:0/4006212851 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1a50113490 con 0x7f1a501095d0 2024-09-12T02:54:28.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.088+0000 7f1a4de00640 1 -- 172.21.15.18:0/4006212851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a501095d0 msgr2=0x7f1a501169f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:28.092 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.088+0000 7f1a4de00640 1 --2- 172.21.15.18:0/4006212851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a501095d0 0x7f1a501169f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.088+0000 7f1a4de00640 1 -- 172.21.15.18:0/4006212851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a5011b140 msgr2=0x7f1a50116f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.088+0000 7f1a4de00640 1 --2- 172.21.15.18:0/4006212851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a5011b140 0x7f1a50116f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.088+0000 7f1a4de00640 1 -- 172.21.15.18:0/4006212851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a501177f0 con 0x7f1a501091f0 2024-09-12T02:54:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.089+0000 7f1a4de00640 1 --2- 172.21.15.18:0/4006212851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a501091f0 0x7f1a5011a960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00da90 tx=0x7f1a3c00df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.090+0000 7f1a46a00640 1 -- 172.21.15.18:0/4006212851 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c017070 con 0x7f1a501091f0 2024-09-12T02:54:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.090+0000 7f1a46a00640 1 -- 172.21.15.18:0/4006212851 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a3c009c00 con 0x7f1a501091f0 2024-09-12T02:54:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.090+0000 7f1a46a00640 1 -- 172.21.15.18:0/4006212851 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c00f6b0 con 0x7f1a501091f0 2024-09-12T02:54:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.091+0000 7f1a4f200640 1 -- 172.21.15.18:0/4006212851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a501aae90 con 0x7f1a501091f0 2024-09-12T02:54:28.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.096+0000 7f1a4f200640 1 -- 172.21.15.18:0/4006212851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a501ab240 con 0x7f1a501091f0 2024-09-12T02:54:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.116+0000 7f1a57c11740 1 Processor -- start 2024-09-12T02:54:28.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.120+0000 7f1a57c11740 1 -- start start 2024-09-12T02:54:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.121+0000 7f1a57c11740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00ee3b0 0x5617f00ee790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.121+0000 7f1a57c11740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00eecd0 0x5617f00f9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.121+0000 7f1a57c11740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00f9570 0x5617f00fb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.121+0000 7f1a57c11740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5617f0054100 con 0x5617f00f9570 2024-09-12T02:54:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.121+0000 7f1a57c11740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5617efffc1b0 con 0x5617f00ee3b0 2024-09-12T02:54:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.121+0000 7f1a57c11740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5617f00500c0 con 0x5617f00eecd0 2024-09-12T02:54:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.122+0000 7f1a4de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00eecd0 0x5617f00f9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.122+0000 7f1a4de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00eecd0 0x5617f00f9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:47302/0 (socket says 172.21.15.18:47302) 2024-09-12T02:54:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.122+0000 7f1a4de00640 1 -- 172.21.15.18:0/1310700510 learned_addr learned my addr 172.21.15.18:0/1310700510 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:54:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.123+0000 7f1a4d400640 1 --2- 172.21.15.18:0/1310700510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00f9570 0x5617f00fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.123+0000 7f1a4d400640 1 -- 172.21.15.18:0/1310700510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00eecd0 msgr2=0x5617f00f9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.123+0000 7f1a4d400640 1 --2- 172.21.15.18:0/1310700510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00eecd0 0x5617f00f9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.124+0000 7f1a4d400640 1 -- 172.21.15.18:0/1310700510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00ee3b0 msgr2=0x5617f00ee790 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:54:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.124+0000 7f1a4d400640 1 --2- 172.21.15.18:0/1310700510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00ee3b0 0x5617f00ee790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.124+0000 7f1a4d400640 1 -- 172.21.15.18:0/1310700510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617efd67210 con 0x5617f00f9570 2024-09-12T02:54:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.124+0000 7f1a4d400640 1 --2- 172.21.15.18:0/1310700510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00f9570 0x5617f00fb960 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1a50118240 tx=0x7f1a480096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b4472ec68c6829 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.125+0000 7f1a3b400640 1 -- 172.21.15.18:0/1310700510 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4800a9c0 con 0x5617f00f9570 2024-09-12T02:54:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.125+0000 7f1a3b400640 1 -- 172.21.15.18:0/1310700510 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a48019070 con 0x5617f00f9570 2024-09-12T02:54:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.125+0000 7f1a3b400640 1 -- 172.21.15.18:0/1310700510 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a48013380 con 0x5617f00f9570 2024-09-12T02:54:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.126+0000 7f1a57c11740 1 -- 172.21.15.18:0/1310700510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00f9570 msgr2=0x5617f00fb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.126+0000 7f1a57c11740 1 --2- 172.21.15.18:0/1310700510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00f9570 0x5617f00fb960 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1a50118240 tx=0x7f1a480096b0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.127+0000 7f1a46a00640 1 -- 172.21.15.18:0/4006212851 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f1a3c005020 con 0x7f1a501091f0 2024-09-12T02:54:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.129+0000 7f1a46a00640 1 --2- 172.21.15.18:0/4006212851 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1a340a2f00 0x7f1a340a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.129+0000 7f1a46a00640 1 -- 172.21.15.18:0/4006212851 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f1a3c0cf410 con 0x7f1a501091f0 2024-09-12T02:54:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.130+0000 7f1a4e800640 1 --2- 172.21.15.18:0/4006212851 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1a340a2f00 0x7f1a340a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.136+0000 7f1a4e800640 1 --2- 172.21.15.18:0/4006212851 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1a340a2f00 0x7f1a340a53c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1a40005c40 tx=0x7f1a40005b50 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.137+0000 7f1a57c11740 1 -- 172.21.15.18:0/1310700510 shutdown_connections 2024-09-12T02:54:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.137+0000 7f1a57c11740 1 --2- 172.21.15.18:0/1310700510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00f9570 0x5617f00fb960 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.137+0000 7f1a57c11740 1 --2- 172.21.15.18:0/1310700510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00eecd0 0x5617f00f9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.137+0000 7f1a57c11740 1 --2- 172.21.15.18:0/1310700510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00ee3b0 0x5617f00ee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.137+0000 7f1a57c11740 1 -- 172.21.15.18:0/1310700510 >> 172.21.15.18:0/1310700510 conn(0x5617f00ea920 msgr2=0x5617f00ead00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.138+0000 7f1a57c11740 1 -- 172.21.15.18:0/1310700510 shutdown_connections 2024-09-12T02:54:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.138+0000 7f1a57c11740 1 -- 172.21.15.18:0/1310700510 wait complete. 2024-09-12T02:54:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.139+0000 7f1a57c11740 1 -- start start 2024-09-12T02:54:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.139+0000 7f1a57c11740 1 Processor -- start 2024-09-12T02:54:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.142+0000 7f1a57c11740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00ee3b0 0x5617f00f6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.142+0000 7f1a57c11740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00eecd0 0x5617f00f6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.142+0000 7f1a57c11740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00f9570 0x5617f00f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.142+0000 7f1a57c11740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5617f00fc050 con 0x5617f00f9570 2024-09-12T02:54:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.142+0000 7f1a57c11740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5617effdd090 con 0x5617f00eecd0 2024-09-12T02:54:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.142+0000 7f1a57c11740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5617f00fc1d0 con 0x5617f00ee3b0 2024-09-12T02:54:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.143+0000 7f1a57c11740 10 client.0 _ll_register_callbacks cb 0x5617f0031f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:54:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.143+0000 7f1a4de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00ee3b0 0x5617f00f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.143+0000 7f1a4de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00ee3b0 0x5617f00f6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:47306/0 (socket says 172.21.15.18:47306) 2024-09-12T02:54:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.143+0000 7f1a4de00640 1 -- 172.21.15.18:0/1392715574 learned_addr learned my addr 172.21.15.18:0/1392715574 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:54:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.143+0000 7f1a4d400640 1 --2- 172.21.15.18:0/1392715574 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00eecd0 0x5617f00f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.144+0000 7f1a4de00640 1 -- 172.21.15.18:0/1392715574 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00eecd0 msgr2=0x5617f00f6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.144+0000 7f1a4de00640 1 --2- 172.21.15.18:0/1392715574 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00eecd0 0x5617f00f6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.144+0000 7f1a4de00640 1 -- 172.21.15.18:0/1392715574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00f9570 msgr2=0x5617f00f6ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:54:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.144+0000 7f1a4e800640 1 --2- 172.21.15.18:0/1392715574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00f9570 0x5617f00f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.144+0000 7f1a4de00640 1 --2- 172.21.15.18:0/1392715574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00f9570 0x5617f00f6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.144+0000 7f1a4de00640 1 -- 172.21.15.18:0/1392715574 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617efe33620 con 0x5617f00ee3b0 2024-09-12T02:54:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.144+0000 7f1a4e800640 1 --2- 172.21.15.18:0/1392715574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00f9570 0x5617f00f6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:54:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.145+0000 7f1a4de00640 1 --2- 172.21.15.18:0/1392715574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00ee3b0 0x5617f00f6440 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c097f60 tx=0x7f1a3c09b420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d7932c7ca06cec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.145+0000 7f1a2fe00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:54:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.145+0000 7f1a2fe00640 1 -- 172.21.15.18:0/1392715574 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c09b590 con 0x5617f00ee3b0 2024-09-12T02:54:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.145+0000 7f1a2fe00640 1 -- 172.21.15.18:0/1392715574 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f1a3c097c00 con 0x5617f00ee3b0 2024-09-12T02:54:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.146+0000 7f1a57c11740 1 -- 172.21.15.18:0/1392715574 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a48019070 con 0x5617f00ee3b0 2024-09-12T02:54:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.147+0000 7f1a2fe00640 1 -- 172.21.15.18:0/1392715574 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f1a3c09f940 con 0x5617f00ee3b0 2024-09-12T02:54:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.147+0000 7f1a57c11740 10 client.25588 fetch_fsmap learned FSMap version 46 2024-09-12T02:54:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.147+0000 7f1a57c11740 1 -- 172.21.15.18:0/1392715574 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5617f0107e80 con 0x5617f00ee3b0 2024-09-12T02:54:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.147+0000 7f1a2fe00640 1 -- 172.21.15.18:0/1392715574 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a48019070 con 0x5617f00ee3b0 2024-09-12T02:54:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.148+0000 7f1a2fe00640 1 -- 172.21.15.18:0/1392715574 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 46) ==== 8434+0+0 (secure 0 0 0) 0x7f1a3c023060 con 0x5617f00ee3b0 2024-09-12T02:54:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.149+0000 7f1a57c11740 10 client.25588 fetch_fsmap finished waiting for FSMap version 46 2024-09-12T02:54:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.149+0000 7f1a57c11740 10 client.25588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:54:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.149+0000 7f1a57c11740 20 client.25588 populate_metadata read hostname 'smithi018' 2024-09-12T02:54:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.149+0000 7f1a57c11740 1 --2- 172.21.15.18:0/1392715574 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5617f0109340 0x5617f010b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.149+0000 7f1a57c11740 4 client.25588 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:54:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.149+0000 7f1a57c11740 1 -- 172.21.15.18:0/1392715574 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617f0061830 con 0x5617f0109340 2024-09-12T02:54:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.149+0000 7f1a4d400640 1 --2- 172.21.15.18:0/1392715574 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5617f0109340 0x5617f010b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.150+0000 7f1a4d400640 1 --2- 172.21.15.18:0/1392715574 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5617f0109340 0x5617f010b7b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae25b42aa21a939b server_cookie=a1513ec4b49d64f6 in_seq=0 out_seq=0 2024-09-12T02:54:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.150+0000 7f1a2fe00640 10 client.25588 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:54:28.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.152+0000 7f1a2fe00640 1 -- 172.21.15.18:0/1392715574 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5617f0061830 con 0x5617f0109340 2024-09-12T02:54:28.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.152+0000 7f1a2fe00640 10 client.25588 handle_command_reply: tid=0 2024-09-12T02:54:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.152+0000 7f1a57c11740 1 client.25588 shutdown 2024-09-12T02:54:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.153+0000 7f1a57c11740 1 -- 172.21.15.18:0/1392715574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00ee3b0 msgr2=0x5617f00f6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.153+0000 7f1a57c11740 1 --2- 172.21.15.18:0/1392715574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00ee3b0 0x5617f00f6440 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c097f60 tx=0x7f1a3c09b420 comp rx=0 tx=0).stop 2024-09-12T02:54:28.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.153+0000 7f1a57c11740 1 -- 172.21.15.18:0/1392715574 shutdown_connections 2024-09-12T02:54:28.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.153+0000 7f1a57c11740 1 --2- 172.21.15.18:0/1392715574 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5617f0109340 0x5617f010b7b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.153+0000 7f1a2fe00640 0 client.25588 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:54:28.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.154+0000 7f1a57c11740 1 --2- 172.21.15.18:0/1392715574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00f9570 0x5617f00f6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.154+0000 7f1a57c11740 1 --2- 172.21.15.18:0/1392715574 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00eecd0 0x5617f00f6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.154+0000 7f1a57c11740 1 --2- 172.21.15.18:0/1392715574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00ee3b0 0x5617f00f6440 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.154+0000 7f1a57c11740 1 -- 172.21.15.18:0/1392715574 >> 172.21.15.18:0/1392715574 conn(0x5617f00ea920 msgr2=0x5617f00f0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:28.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.156+0000 7f1a57c11740 1 -- 172.21.15.18:0/1392715574 shutdown_connections 2024-09-12T02:54:28.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.156+0000 7f1a57c11740 1 -- 172.21.15.18:0/1392715574 wait complete. 2024-09-12T02:54:28.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.156+0000 7f1a57c11740 20 client.25588 trim_cache size 0 max 16384 2024-09-12T02:54:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.318+0000 7f1a57c11740 1 Processor -- start 2024-09-12T02:54:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.431+0000 7f1a57c11740 1 -- start start 2024-09-12T02:54:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.431+0000 7f1a57c11740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00ee3b0 0x5617f00f8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.431+0000 7f1a57c11740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00eecd0 0x5617f00f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.431+0000 7f1a57c11740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00f9570 0x5617f0111080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.431+0000 7f1a57c11740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5007e260 con 0x5617f00ee3b0 2024-09-12T02:54:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.431+0000 7f1a57c11740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5007ffe0 con 0x5617f00eecd0 2024-09-12T02:54:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.431+0000 7f1a57c11740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5007e9f0 con 0x5617f00f9570 2024-09-12T02:54:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.434+0000 7f1a4e800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00f9570 0x5617f0111080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.434+0000 7f1a4e800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00f9570 0x5617f0111080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:47310/0 (socket says 172.21.15.18:47310) 2024-09-12T02:54:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.434+0000 7f1a4e800640 1 -- 172.21.15.18:0/2711373823 learned_addr learned my addr 172.21.15.18:0/2711373823 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:54:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.443+0000 7f1a4e800640 1 -- 172.21.15.18:0/2711373823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00eecd0 msgr2=0x5617f00f5d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:54:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.443+0000 7f1a4e800640 1 --2- 172.21.15.18:0/2711373823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00eecd0 0x5617f00f5d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.443+0000 7f1a4e800640 1 -- 172.21.15.18:0/2711373823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00ee3b0 msgr2=0x5617f00f8660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:54:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.443+0000 7f1a4e800640 1 --2- 172.21.15.18:0/2711373823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00ee3b0 0x5617f00f8660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.443+0000 7f1a4e800640 1 -- 172.21.15.18:0/2711373823 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617f00e5c40 con 0x5617f00f9570 2024-09-12T02:54:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.443+0000 7f1a4e800640 1 --2- 172.21.15.18:0/2711373823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00f9570 0x5617f0111080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1a40044000 tx=0x7f1a4004e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb4cf5d5660f13b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.451+0000 7f1a3aa00640 1 -- 172.21.15.18:0/2711373823 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40046050 con 0x5617f00f9570 2024-09-12T02:54:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.452+0000 7f1a3aa00640 1 -- 172.21.15.18:0/2711373823 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a400409f0 con 0x5617f00f9570 2024-09-12T02:54:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.452+0000 7f1a3aa00640 1 -- 172.21.15.18:0/2711373823 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4004da00 con 0x5617f00f9570 2024-09-12T02:54:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.460+0000 7f1a57c11740 1 -- 172.21.15.18:0/2711373823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00f9570 msgr2=0x5617f0111080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.460+0000 7f1a57c11740 1 --2- 172.21.15.18:0/2711373823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00f9570 0x5617f0111080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1a40044000 tx=0x7f1a4004e000 comp rx=0 tx=0).stop 2024-09-12T02:54:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.505+0000 7f1a57c11740 1 -- 172.21.15.18:0/2711373823 shutdown_connections 2024-09-12T02:54:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.505+0000 7f1a57c11740 1 --2- 172.21.15.18:0/2711373823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00f9570 0x5617f0111080 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.505+0000 7f1a57c11740 1 --2- 172.21.15.18:0/2711373823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00eecd0 0x5617f00f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.505+0000 7f1a57c11740 1 --2- 172.21.15.18:0/2711373823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00ee3b0 0x5617f00f8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.505+0000 7f1a57c11740 1 -- 172.21.15.18:0/2711373823 >> 172.21.15.18:0/2711373823 conn(0x5617f00ea920 msgr2=0x5617f00f0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.505+0000 7f1a57c11740 1 -- 172.21.15.18:0/2711373823 shutdown_connections 2024-09-12T02:54:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.505+0000 7f1a57c11740 1 -- 172.21.15.18:0/2711373823 wait complete. 2024-09-12T02:54:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.505+0000 7f1a57c11740 1 -- start start 2024-09-12T02:54:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.506+0000 7f1a57c11740 1 Processor -- start 2024-09-12T02:54:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.507+0000 7f1a57c11740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00ee3b0 0x5617f0101950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.507+0000 7f1a57c11740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00eecd0 0x5617f0101e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.507+0000 7f1a57c11740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00f9570 0x5617f00fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.507+0000 7f1a57c11740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5007f850 con 0x5617f00f9570 2024-09-12T02:54:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.507+0000 7f1a57c11740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5007f0c0 con 0x5617f00eecd0 2024-09-12T02:54:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.507+0000 7f1a57c11740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5007c2f0 con 0x5617f00ee3b0 2024-09-12T02:54:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.507+0000 7f1a57c11740 10 client.0 _ll_register_callbacks cb 0x7f1a3c097830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:54:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.507+0000 7f1a4d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00eecd0 0x5617f0101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.507+0000 7f1a4d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00eecd0 0x5617f0101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:37378/0 (socket says 172.21.15.18:37378) 2024-09-12T02:54:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.507+0000 7f1a4d400640 1 -- 172.21.15.18:0/1685805074 learned_addr learned my addr 172.21.15.18:0/1685805074 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:54:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.508+0000 7f1a4e800640 1 --2- 172.21.15.18:0/1685805074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00f9570 0x5617f00fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.508+0000 7f1a4de00640 1 --2- 172.21.15.18:0/1685805074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00ee3b0 0x5617f0101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.509+0000 7f1a4de00640 1 -- 172.21.15.18:0/1685805074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00eecd0 msgr2=0x5617f0101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.509+0000 7f1a4de00640 1 --2- 172.21.15.18:0/1685805074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00eecd0 0x5617f0101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.509+0000 7f1a4de00640 1 -- 172.21.15.18:0/1685805074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00f9570 msgr2=0x5617f00fcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.509+0000 7f1a4de00640 1 --2- 172.21.15.18:0/1685805074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00f9570 0x5617f00fcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.509+0000 7f1a4de00640 1 -- 172.21.15.18:0/1685805074 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617f00fd5e0 con 0x5617f00ee3b0 2024-09-12T02:54:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.511+0000 7f1a4de00640 1 --2- 172.21.15.18:0/1685805074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00ee3b0 0x5617f0101950 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0a3fe0 tx=0x7f1a3c099aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae285a6ffdf43435 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:28.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.519+0000 7f1a2fe00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:54:28.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.519+0000 7f1a2fe00640 1 -- 172.21.15.18:0/1685805074 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c09aef0 con 0x5617f00ee3b0 2024-09-12T02:54:28.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.519+0000 7f1a2fe00640 1 -- 172.21.15.18:0/1685805074 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f1a3c0cfa40 con 0x5617f00ee3b0 2024-09-12T02:54:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.544+0000 7f1a57c11740 1 -- 172.21.15.18:0/1685805074 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a400409f0 con 0x5617f00ee3b0 2024-09-12T02:54:28.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.560+0000 7f1a2fe00640 1 -- 172.21.15.18:0/1685805074 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f1a3c077050 con 0x5617f00ee3b0 2024-09-12T02:54:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.560+0000 7f1a57c11740 10 client.25594 fetch_fsmap learned FSMap version 46 2024-09-12T02:54:28.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.560+0000 7f1a57c11740 1 -- 172.21.15.18:0/1685805074 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5617f00fd5e0 con 0x5617f00ee3b0 2024-09-12T02:54:28.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.561+0000 7f1a2fe00640 1 -- 172.21.15.18:0/1685805074 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a400409f0 con 0x5617f00ee3b0 2024-09-12T02:54:28.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.561+0000 7f1a2fe00640 1 -- 172.21.15.18:0/1685805074 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 46) ==== 8434+0+0 (secure 0 0 0) 0x7f1a3c09a9e0 con 0x5617f00ee3b0 2024-09-12T02:54:28.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.561+0000 7f1a57c11740 10 client.25594 fetch_fsmap finished waiting for FSMap version 46 2024-09-12T02:54:28.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.561+0000 7f1a57c11740 10 client.25594 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:54:28.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.561+0000 7f1a57c11740 20 client.25594 populate_metadata read hostname 'smithi018' 2024-09-12T02:54:28.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.562+0000 7f1a57c11740 1 --2- 172.21.15.18:0/1685805074 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5617f0109340 0x5617f0176090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:28.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.562+0000 7f1a57c11740 4 client.25594 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:54:28.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.562+0000 7f1a57c11740 1 -- 172.21.15.18:0/1685805074 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5617f005bb80 con 0x5617f0109340 2024-09-12T02:54:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.579+0000 7f1a4d400640 1 --2- 172.21.15.18:0/1685805074 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5617f0109340 0x5617f0176090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.588+0000 7f1a2fe00640 10 client.25594 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:54:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:28.588+0000 7f1a4d400640 1 --2- 172.21.15.18:0/1685805074 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5617f0109340 0x5617f0176090 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e1cf02883438c57 server_cookie=9f44d90544f6fb01 in_seq=0 out_seq=0 2024-09-12T02:54:29.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:28 smithi176 ceph-mon[35713]: pgmap v175: 129 pgs: 129 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 247 op/s 2024-09-12T02:54:29.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:28 smithi062 ceph-mon[35527]: pgmap v175: 129 pgs: 129 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 247 op/s 2024-09-12T02:54:29.360 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:28 smithi018 ceph-mon[30616]: pgmap v175: 129 pgs: 129 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 247 op/s 2024-09-12T02:54:31.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:30 smithi176 ceph-mon[35713]: pgmap v176: 129 pgs: 129 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.7 MiB/s wr, 291 op/s 2024-09-12T02:54:31.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:30 smithi062 ceph-mon[35527]: pgmap v176: 129 pgs: 129 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.7 MiB/s wr, 291 op/s 2024-09-12T02:54:31.357 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:30 smithi018 ceph-mon[30616]: pgmap v176: 129 pgs: 129 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.7 MiB/s wr, 291 op/s 2024-09-12T02:54:32.922 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:32 smithi018 ceph-mon[30616]: pgmap v177: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.2 MiB/s wr, 307 op/s 2024-09-12T02:54:33.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:32 smithi176 ceph-mon[35713]: pgmap v177: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.2 MiB/s wr, 307 op/s 2024-09-12T02:54:33.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:32 smithi062 ceph-mon[35527]: pgmap v177: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.2 MiB/s wr, 307 op/s 2024-09-12T02:54:34.993 INFO:tasks.workunit.client.0.smithi018.stdout: 504 461432 782 300973 887 79349 1597 2024-09-12T02:54:35.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:34 smithi176 ceph-mon[35713]: pgmap v178: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 424 op/s 2024-09-12T02:54:35.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:34 smithi062 ceph-mon[35527]: pgmap v178: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 424 op/s 2024-09-12T02:54:35.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:34 smithi018 ceph-mon[30616]: pgmap v178: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 424 op/s 2024-09-12T02:54:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.729+0000 7f1a2fe00640 1 -- 172.21.15.18:0/1685805074 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5617f005bb80 con 0x5617f0109340 2024-09-12T02:54:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.729+0000 7f1a2fe00640 10 client.25594 handle_command_reply: tid=0 2024-09-12T02:54:36.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.729+0000 7f1a57c11740 1 client.25594 shutdown 2024-09-12T02:54:36.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.730+0000 7f1a57c11740 1 -- 172.21.15.18:0/1685805074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00ee3b0 msgr2=0x5617f0101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:36.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.730+0000 7f1a57c11740 1 --2- 172.21.15.18:0/1685805074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00ee3b0 0x5617f0101950 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0a3fe0 tx=0x7f1a3c099aa0 comp rx=0 tx=0).stop 2024-09-12T02:54:36.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.730+0000 7f1a57c11740 1 -- 172.21.15.18:0/1685805074 shutdown_connections 2024-09-12T02:54:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.730+0000 7f1a57c11740 1 --2- 172.21.15.18:0/1685805074 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5617f0109340 0x5617f0176090 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.730+0000 7f1a57c11740 1 --2- 172.21.15.18:0/1685805074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617f00f9570 0x5617f00fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.730+0000 7f1a57c11740 1 --2- 172.21.15.18:0/1685805074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5617f00eecd0 0x5617f0101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.730+0000 7f1a57c11740 1 --2- 172.21.15.18:0/1685805074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5617f00ee3b0 0x5617f0101950 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.730+0000 7f1a57c11740 1 -- 172.21.15.18:0/1685805074 >> 172.21.15.18:0/1685805074 conn(0x5617f00ea920 msgr2=0x5617f0104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.730+0000 7f1a2fe00640 0 client.25594 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:54:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.730+0000 7f1a57c11740 1 -- 172.21.15.18:0/1685805074 shutdown_connections 2024-09-12T02:54:36.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:54:36.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:54:36.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:54:36.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:54:36.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.731+0000 7f1a57c11740 1 -- 172.21.15.18:0/1685805074 wait complete. 2024-09-12T02:54:36.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.731+0000 7f1a57c11740 20 client.25594 trim_cache size 0 max 16384 2024-09-12T02:54:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.756+0000 7f1a4f200640 1 -- 172.21.15.18:0/4006212851 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1a340a2f00 msgr2=0x7f1a340a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.756+0000 7f1a4f200640 1 --2- 172.21.15.18:0/4006212851 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1a340a2f00 0x7f1a340a53c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1a40005c40 tx=0x7f1a40005b50 comp rx=0 tx=0).stop 2024-09-12T02:54:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.756+0000 7f1a4f200640 1 -- 172.21.15.18:0/4006212851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a501091f0 msgr2=0x7f1a5011a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.756+0000 7f1a4f200640 1 --2- 172.21.15.18:0/4006212851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a501091f0 0x7f1a5011a960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00da90 tx=0x7f1a3c00df50 comp rx=0 tx=0).stop 2024-09-12T02:54:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.767+0000 7f1a4f200640 1 -- 172.21.15.18:0/4006212851 shutdown_connections 2024-09-12T02:54:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.767+0000 7f1a4f200640 1 --2- 172.21.15.18:0/4006212851 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1a340a2f00 0x7f1a340a53c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:36.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.767+0000 7f1a4f200640 1 --2- 172.21.15.18:0/4006212851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a5011b140 0x7f1a50116f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:36.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.767+0000 7f1a4f200640 1 --2- 172.21.15.18:0/4006212851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a501095d0 0x7f1a501169f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:36.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.767+0000 7f1a4f200640 1 --2- 172.21.15.18:0/4006212851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a501091f0 0x7f1a5011a960 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:36.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.767+0000 7f1a4f200640 1 -- 172.21.15.18:0/4006212851 >> 172.21.15.18:0/4006212851 conn(0x7f1a5006cbf0 msgr2=0x7f1a50071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.786+0000 7f1a4f200640 1 -- 172.21.15.18:0/4006212851 shutdown_connections 2024-09-12T02:54:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:36.791+0000 7f1a4f200640 1 -- 172.21.15.18:0/4006212851 wait complete. 2024-09-12T02:54:37.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:36 smithi018 ceph-mon[30616]: pgmap v179: 129 pgs: 129 active+clean; 1.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.6 MiB/s wr, 823 op/s 2024-09-12T02:54:37.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:36 smithi176 ceph-mon[35713]: pgmap v179: 129 pgs: 129 active+clean; 1.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.6 MiB/s wr, 823 op/s 2024-09-12T02:54:37.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:36 smithi062 ceph-mon[35527]: pgmap v179: 129 pgs: 129 active+clean; 1.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.6 MiB/s wr, 823 op/s 2024-09-12T02:54:38.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:38 smithi062 ceph-mon[35527]: pgmap v180: 129 pgs: 129 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 9.4 MiB/s wr, 826 op/s 2024-09-12T02:54:38.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:38 smithi018 ceph-mon[30616]: pgmap v180: 129 pgs: 129 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 9.4 MiB/s wr, 826 op/s 2024-09-12T02:54:38.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:38 smithi176 ceph-mon[35713]: pgmap v180: 129 pgs: 129 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 9.4 MiB/s wr, 826 op/s 2024-09-12T02:54:40.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:40 smithi176 ceph-mon[35713]: pgmap v181: 129 pgs: 129 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.3 MiB/s wr, 828 op/s 2024-09-12T02:54:40.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:40 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:54:40.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:40 smithi062 ceph-mon[35527]: pgmap v181: 129 pgs: 129 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.3 MiB/s wr, 828 op/s 2024-09-12T02:54:40.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:40 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:54:40.640 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:40 smithi018 ceph-mon[30616]: pgmap v181: 129 pgs: 129 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.3 MiB/s wr, 828 op/s 2024-09-12T02:54:40.641 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:40 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:54:42.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:42 smithi176 ceph-mon[35713]: pgmap v182: 129 pgs: 129 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.3 MiB/s wr, 776 op/s 2024-09-12T02:54:42.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:42 smithi062 ceph-mon[35527]: pgmap v182: 129 pgs: 129 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.3 MiB/s wr, 776 op/s 2024-09-12T02:54:42.616 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:42 smithi018 ceph-mon[30616]: pgmap v182: 129 pgs: 129 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.3 MiB/s wr, 776 op/s 2024-09-12T02:54:44.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:44 smithi062 ceph-mon[35527]: pgmap v183: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.1 MiB/s wr, 769 op/s 2024-09-12T02:54:44.615 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:44 smithi018 ceph-mon[30616]: pgmap v183: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.1 MiB/s wr, 769 op/s 2024-09-12T02:54:44.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:44 smithi176 ceph-mon[35713]: pgmap v183: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.1 MiB/s wr, 769 op/s 2024-09-12T02:54:45.002 INFO:tasks.workunit.client.0.smithi018.stdout: 520 523425 940 340454 1094 93759 1977 2024-09-12T02:54:45.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:45 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:54:45.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:45 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:54:45.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:45 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:54:45.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:45 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:54:45.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:45 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:54:45.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:45 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:54:45.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:45 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:54:45.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:45 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:54:45.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:45 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:54:46.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:46 smithi176 ceph-mon[35713]: pgmap v184: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.3 MiB/s wr, 690 op/s 2024-09-12T02:54:47.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:46 smithi062 ceph-mon[35527]: pgmap v184: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.3 MiB/s wr, 690 op/s 2024-09-12T02:54:47.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:46 smithi018 ceph-mon[30616]: pgmap v184: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.3 MiB/s wr, 690 op/s 2024-09-12T02:54:49.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:48 smithi062 ceph-mon[35527]: pgmap v185: 129 pgs: 129 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 317 op/s 2024-09-12T02:54:49.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:48 smithi018 ceph-mon[30616]: pgmap v185: 129 pgs: 129 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 317 op/s 2024-09-12T02:54:49.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:48 smithi176 ceph-mon[35713]: pgmap v185: 129 pgs: 129 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 317 op/s 2024-09-12T02:54:51.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:50 smithi062 ceph-mon[35527]: pgmap v186: 129 pgs: 129 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 306 op/s 2024-09-12T02:54:51.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:50 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:54:51.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:50 smithi018 ceph-mon[30616]: pgmap v186: 129 pgs: 129 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 306 op/s 2024-09-12T02:54:51.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:50 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:54:51.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:50 smithi176 ceph-mon[35713]: pgmap v186: 129 pgs: 129 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 306 op/s 2024-09-12T02:54:51.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:50 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:54:52.895 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:52 smithi018 ceph-mon[30616]: pgmap v187: 129 pgs: 129 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.4 MiB/s wr, 310 op/s 2024-09-12T02:54:53.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:52 smithi062 ceph-mon[35527]: pgmap v187: 129 pgs: 129 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.4 MiB/s wr, 310 op/s 2024-09-12T02:54:53.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:52 smithi176 ceph-mon[35713]: pgmap v187: 129 pgs: 129 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.4 MiB/s wr, 310 op/s 2024-09-12T02:54:54.902 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:54 smithi018 ceph-mon[30616]: pgmap v188: 129 pgs: 129 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.3 MiB/s wr, 318 op/s 2024-09-12T02:54:55.043 INFO:tasks.workunit.client.0.smithi018.stdout: 536 478218 877 314445 683 90894 98 2024-09-12T02:54:55.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:54 smithi176 ceph-mon[35713]: pgmap v188: 129 pgs: 129 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.3 MiB/s wr, 318 op/s 2024-09-12T02:54:55.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:54 smithi062 ceph-mon[35527]: pgmap v188: 129 pgs: 129 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.3 MiB/s wr, 318 op/s 2024-09-12T02:54:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.557+0000 7f7e16600640 1 -- 172.21.15.18:0/699426318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e10102480 msgr2=0x7f7e1010e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.557+0000 7f7e16600640 1 --2- 172.21.15.18:0/699426318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e10102480 0x7f7e1010e9b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009cd0 tx=0x7f7e0802a8f0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.576+0000 7f7e16600640 1 -- 172.21.15.18:0/699426318 shutdown_connections 2024-09-12T02:54:55.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.576+0000 7f7e16600640 1 --2- 172.21.15.18:0/699426318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e10102480 0x7f7e1010e9b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.576+0000 7f7e16600640 1 --2- 172.21.15.18:0/699426318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e10101ae0 0x7f7e10101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.576+0000 7f7e16600640 1 --2- 172.21.15.18:0/699426318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e10107b80 0x7f7e10107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.576+0000 7f7e16600640 1 -- 172.21.15.18:0/699426318 >> 172.21.15.18:0/699426318 conn(0x7f7e100fd7e0 msgr2=0x7f7e100ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:55.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.589+0000 7f7e16600640 1 -- 172.21.15.18:0/699426318 shutdown_connections 2024-09-12T02:54:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.589+0000 7f7e16600640 1 -- 172.21.15.18:0/699426318 wait complete. 2024-09-12T02:54:55.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.598+0000 7f7e16600640 1 Processor -- start 2024-09-12T02:54:55.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.608+0000 7f7e16600640 1 -- start start 2024-09-12T02:54:55.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.608+0000 7f7e16600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e10101ae0 0x7f7e101161c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:55.609 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.608+0000 7f7e16600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e10102480 0x7f7e10116700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.617+0000 7f7e16600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e10107b80 0x7f7e1011bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.617+0000 7f7e16600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7e100760e0 con 0x7f7e10101ae0 2024-09-12T02:54:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.617+0000 7f7e16600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7e10075f60 con 0x7f7e10102480 2024-09-12T02:54:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.617+0000 7f7e16600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7e10076260 con 0x7f7e10107b80 2024-09-12T02:54:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.617+0000 7f7e0f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e10101ae0 0x7f7e101161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.617+0000 7f7e0f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e10101ae0 0x7f7e101161c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43834/0 (socket says 172.21.15.18:43834) 2024-09-12T02:54:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.617+0000 7f7e0f400640 1 -- 172.21.15.18:0/1735215207 learned_addr learned my addr 172.21.15.18:0/1735215207 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:54:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.618+0000 7f7e0fe00640 1 --2- 172.21.15.18:0/1735215207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e10107b80 0x7f7e1011bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.621+0000 7f7e0f400640 1 -- 172.21.15.18:0/1735215207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e10107b80 msgr2=0x7f7e1011bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.621+0000 7f7e0f400640 1 --2- 172.21.15.18:0/1735215207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e10107b80 0x7f7e1011bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.621+0000 7f7e0f400640 1 -- 172.21.15.18:0/1735215207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e10102480 msgr2=0x7f7e10116700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:54:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.621+0000 7f7e0f400640 1 --2- 172.21.15.18:0/1735215207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e10102480 0x7f7e10116700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.621+0000 7f7e0f400640 1 -- 172.21.15.18:0/1735215207 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1011c800 con 0x7f7e10101ae0 2024-09-12T02:54:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.628+0000 7f7e0f400640 1 --2- 172.21.15.18:0/1735215207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e10101ae0 0x7f7e101161c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000d950 tx=0x7f7e0000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.630+0000 7f7e0cc00640 1 -- 172.21.15.18:0/1735215207 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e00017070 con 0x7f7e10101ae0 2024-09-12T02:54:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.631+0000 7f7e0cc00640 1 -- 172.21.15.18:0/1735215207 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e00009c30 con 0x7f7e10101ae0 2024-09-12T02:54:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.631+0000 7f7e0cc00640 1 -- 172.21.15.18:0/1735215207 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0000f6b0 con 0x7f7e10101ae0 2024-09-12T02:54:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.632+0000 7f7e16600640 1 -- 172.21.15.18:0/1735215207 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1011caf0 con 0x7f7e10101ae0 2024-09-12T02:54:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.641+0000 7f7e16600640 1 -- 172.21.15.18:0/1735215207 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e10111520 con 0x7f7e10101ae0 2024-09-12T02:54:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.657+0000 7f7e0cc00640 1 -- 172.21.15.18:0/1735215207 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f7e000109d0 con 0x7f7e10101ae0 2024-09-12T02:54:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.661+0000 7f7e193de740 1 Processor -- start 2024-09-12T02:54:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.663+0000 7f7e0cc00640 1 --2- 172.21.15.18:0/1735215207 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f7df40a2ef0 0x7f7df40a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.663+0000 7f7e0cc00640 1 -- 172.21.15.18:0/1735215207 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f7e000d2170 con 0x7f7e10101ae0 2024-09-12T02:54:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.665+0000 7f7e0fe00640 1 --2- 172.21.15.18:0/1735215207 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f7df40a2ef0 0x7f7df40a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.670+0000 7f7e0fe00640 1 --2- 172.21.15.18:0/1735215207 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f7df40a2ef0 0x7f7df40a53b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7e10116e50 tx=0x7f7e08005f80 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.689+0000 7f7e193de740 1 -- start start 2024-09-12T02:54:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.689+0000 7f7e193de740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 0x55c91d5875c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.689+0000 7f7e193de740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d587b00 0x55c91d591e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.689+0000 7f7e193de740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d5923a0 0x55c91d594790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.689+0000 7f7e193de740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c91d4ed100 con 0x55c91d5923a0 2024-09-12T02:54:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.689+0000 7f7e193de740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c91d4951b0 con 0x55c91d5871e0 2024-09-12T02:54:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.689+0000 7f7e193de740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c91d4e90c0 con 0x55c91d587b00 2024-09-12T02:54:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.697+0000 7f7e0f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 0x55c91d5875c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.697+0000 7f7e0fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d5923a0 0x55c91d594790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.697+0000 7f7e0f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 0x55c91d5875c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:41290/0 (socket says 172.21.15.18:41290) 2024-09-12T02:54:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.697+0000 7f7e0f400640 1 -- 172.21.15.18:0/4084382888 learned_addr learned my addr 172.21.15.18:0/4084382888 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:54:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.697+0000 7f7e06a00640 1 --2- 172.21.15.18:0/4084382888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d587b00 0x55c91d591e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.701+0000 7f7e0f400640 1 -- 172.21.15.18:0/4084382888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d587b00 msgr2=0x55c91d591e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.701+0000 7f7e0f400640 1 --2- 172.21.15.18:0/4084382888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d587b00 0x55c91d591e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.701+0000 7f7e0f400640 1 -- 172.21.15.18:0/4084382888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d5923a0 msgr2=0x55c91d594790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.701+0000 7f7e0f400640 1 --2- 172.21.15.18:0/4084382888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d5923a0 0x55c91d594790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.702+0000 7f7e0f400640 1 -- 172.21.15.18:0/4084382888 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c91d200210 con 0x55c91d5871e0 2024-09-12T02:54:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.706+0000 7f7e0f400640 1 --2- 172.21.15.18:0/4084382888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 0x55c91d5875c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7e00096f30 tx=0x7f7e0000bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5ca9954790936d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.707+0000 7f7e04c00640 1 -- 172.21.15.18:0/4084382888 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e000d3060 con 0x55c91d5871e0 2024-09-12T02:54:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.708+0000 7f7e04c00640 1 -- 172.21.15.18:0/4084382888 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e0009aad0 con 0x55c91d5871e0 2024-09-12T02:54:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.708+0000 7f7e04c00640 1 -- 172.21.15.18:0/4084382888 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e000ce0e0 con 0x55c91d5871e0 2024-09-12T02:54:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.709+0000 7f7e193de740 1 -- 172.21.15.18:0/4084382888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 msgr2=0x55c91d5875c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.709+0000 7f7e193de740 1 --2- 172.21.15.18:0/4084382888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 0x55c91d5875c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7e00096f30 tx=0x7f7e0000bf60 comp rx=0 tx=0).stop 2024-09-12T02:54:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.722+0000 7f7e193de740 1 -- 172.21.15.18:0/4084382888 shutdown_connections 2024-09-12T02:54:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.722+0000 7f7e193de740 1 --2- 172.21.15.18:0/4084382888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d5923a0 0x55c91d594790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.722+0000 7f7e193de740 1 --2- 172.21.15.18:0/4084382888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d587b00 0x55c91d591e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.722+0000 7f7e193de740 1 --2- 172.21.15.18:0/4084382888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 0x55c91d5875c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.722+0000 7f7e193de740 1 -- 172.21.15.18:0/4084382888 >> 172.21.15.18:0/4084382888 conn(0x55c91d583750 msgr2=0x55c91d583b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.729+0000 7f7e193de740 1 -- 172.21.15.18:0/4084382888 shutdown_connections 2024-09-12T02:54:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.729+0000 7f7e193de740 1 -- 172.21.15.18:0/4084382888 wait complete. 2024-09-12T02:54:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.730+0000 7f7e193de740 1 -- start start 2024-09-12T02:54:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.730+0000 7f7e193de740 1 Processor -- start 2024-09-12T02:54:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.737+0000 7f7e193de740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 0x55c91d58f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.737+0000 7f7e193de740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d587b00 0x55c91d58f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.738+0000 7f7e0f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 0x55c91d58f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.738+0000 7f7e0f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 0x55c91d58f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:41300/0 (socket says 172.21.15.18:41300) 2024-09-12T02:54:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.738+0000 7f7e193de740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d5923a0 0x55c91d58fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.738+0000 7f7e193de740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c91d5a5f20 con 0x55c91d5923a0 2024-09-12T02:54:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.738+0000 7f7e193de740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c91d476090 con 0x55c91d5871e0 2024-09-12T02:54:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.738+0000 7f7e193de740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c91d5a60a0 con 0x55c91d587b00 2024-09-12T02:54:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.739+0000 7f7e06a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d587b00 0x55c91d58f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.739+0000 7f7e06a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d587b00 0x55c91d58f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:45016/0 (socket says 172.21.15.18:45016) 2024-09-12T02:54:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.739+0000 7f7e06a00640 1 -- 172.21.15.18:0/2963721827 learned_addr learned my addr 172.21.15.18:0/2963721827 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:54:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.739+0000 7f7e0fe00640 1 --2- 172.21.15.18:0/2963721827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d5923a0 0x55c91d58fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.740+0000 7f7e0f400640 1 -- 172.21.15.18:0/2963721827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d587b00 msgr2=0x55c91d58f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.740+0000 7f7e0f400640 1 --2- 172.21.15.18:0/2963721827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d587b00 0x55c91d58f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.740+0000 7f7e0f400640 1 -- 172.21.15.18:0/2963721827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d5923a0 msgr2=0x55c91d58fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.740+0000 7f7e0f400640 1 --2- 172.21.15.18:0/2963721827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d5923a0 0x55c91d58fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.740+0000 7f7e0f400640 1 -- 172.21.15.18:0/2963721827 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c91d2cc620 con 0x55c91d5871e0 2024-09-12T02:54:55.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.740+0000 7f7e0fe00640 1 --2- 172.21.15.18:0/2963721827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d5923a0 0x55c91d58fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:54:55.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.741+0000 7f7e0f400640 1 --2- 172.21.15.18:0/2963721827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 0x55c91d58f3a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7e000974a0 tx=0x7f7e000a3830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddde181e488e0863 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:55.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.741+0000 7f7e193de740 10 client.0 _ll_register_callbacks cb 0x55c91d4caf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:54:55.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.741+0000 7f7e193de740 1 -- 172.21.15.18:0/2963721827 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e0009aad0 con 0x55c91d5871e0 2024-09-12T02:54:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.751+0000 7f7dfd600640 10 client.25601 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:54:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.751+0000 7f7dfd600640 1 -- 172.21.15.18:0/2963721827 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e000b7020 con 0x55c91d5871e0 2024-09-12T02:54:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.751+0000 7f7dfd600640 1 -- 172.21.15.18:0/2963721827 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f7e000cbf80 con 0x55c91d5871e0 2024-09-12T02:54:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.751+0000 7f7dfd600640 1 -- 172.21.15.18:0/2963721827 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f7e000ac050 con 0x55c91d5871e0 2024-09-12T02:54:55.784 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.773+0000 7f7e193de740 10 client.25601 fetch_fsmap learned FSMap version 48 2024-09-12T02:54:55.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.773+0000 7f7e193de740 1 -- 172.21.15.18:0/2963721827 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55c91d5b1820 con 0x55c91d5871e0 2024-09-12T02:54:55.785 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.785+0000 7f7dfd600640 1 -- 172.21.15.18:0/2963721827 <== mon.2 v2:172.21.15.62:3300/0 4 ==== fsmap(e 48) ==== 8426+0+0 (secure 0 0 0) 0x7f7e000b92c0 con 0x55c91d5871e0 2024-09-12T02:54:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.785+0000 7f7e193de740 10 client.25601 fetch_fsmap finished waiting for FSMap version 48 2024-09-12T02:54:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.785+0000 7f7e193de740 10 client.25601 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:54:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.785+0000 7f7e193de740 20 client.25601 populate_metadata read hostname 'smithi018' 2024-09-12T02:54:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.785+0000 7f7e193de740 1 --2- 172.21.15.18:0/2963721827 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c91d5b2bd0 0x55c91d5b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.785+0000 7f7e193de740 4 client.25601 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:54:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.785+0000 7f7e193de740 1 -- 172.21.15.18:0/2963721827 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c91d4fa830 con 0x55c91d5b2bd0 2024-09-12T02:54:55.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.786+0000 7f7e06a00640 1 --2- 172.21.15.18:0/2963721827 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c91d5b2bd0 0x55c91d5b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:55.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.789+0000 7f7e06a00640 1 --2- 172.21.15.18:0/2963721827 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c91d5b2bd0 0x55c91d5b4fc0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9fda4cdeeaacfb3 server_cookie=80f532e53fee3504 in_seq=0 out_seq=0 2024-09-12T02:54:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.790+0000 7f7dfd600640 10 client.25601 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:54:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.790+0000 7f7dfd600640 1 -- 172.21.15.18:0/2963721827 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c91d4fa830 con 0x55c91d5b2bd0 2024-09-12T02:54:55.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.790+0000 7f7dfd600640 10 client.25601 handle_command_reply: tid=0 2024-09-12T02:54:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.791+0000 7f7e193de740 1 client.25601 shutdown 2024-09-12T02:54:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.791+0000 7f7e193de740 1 -- 172.21.15.18:0/2963721827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 msgr2=0x55c91d58f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:55.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.791+0000 7f7e193de740 1 --2- 172.21.15.18:0/2963721827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 0x55c91d58f3a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7e000974a0 tx=0x7f7e000a3830 comp rx=0 tx=0).stop 2024-09-12T02:54:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.811+0000 7f7e193de740 1 -- 172.21.15.18:0/2963721827 shutdown_connections 2024-09-12T02:54:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.811+0000 7f7e193de740 1 --2- 172.21.15.18:0/2963721827 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c91d5b2bd0 0x55c91d5b4fc0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.811+0000 7f7e193de740 1 --2- 172.21.15.18:0/2963721827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d5923a0 0x55c91d58fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.811+0000 7f7e193de740 1 --2- 172.21.15.18:0/2963721827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d587b00 0x55c91d58f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.811+0000 7f7e193de740 1 --2- 172.21.15.18:0/2963721827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 0x55c91d58f3a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.811+0000 7f7e193de740 1 -- 172.21.15.18:0/2963721827 >> 172.21.15.18:0/2963721827 conn(0x55c91d583750 msgr2=0x55c91d589460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.816+0000 7f7dfd600640 0 client.25601 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:54:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.823+0000 7f7e193de740 1 -- 172.21.15.18:0/2963721827 shutdown_connections 2024-09-12T02:54:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.824+0000 7f7e193de740 1 -- 172.21.15.18:0/2963721827 wait complete. 2024-09-12T02:54:55.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:55.842+0000 7f7e193de740 20 client.25601 trim_cache size 0 max 16384 2024-09-12T02:54:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.416+0000 7f7e193de740 1 Processor -- start 2024-09-12T02:54:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.423+0000 7f7e193de740 1 -- start start 2024-09-12T02:54:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.423+0000 7f7e193de740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d5871e0 0x55c91d58fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.423+0000 7f7e193de740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d587b00 0x55c91d5ba750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.423+0000 7f7e193de740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5923a0 0x55c91d5bac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.423+0000 7f7e193de740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7e101b5920 con 0x55c91d5871e0 2024-09-12T02:54:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.423+0000 7f7e193de740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7e101b7640 con 0x55c91d5923a0 2024-09-12T02:54:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.423+0000 7f7e193de740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7e101b6050 con 0x55c91d587b00 2024-09-12T02:54:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.424+0000 7f7e06a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d587b00 0x55c91d5ba750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.424+0000 7f7e06a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d587b00 0x55c91d5ba750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:45026/0 (socket says 172.21.15.18:45026) 2024-09-12T02:54:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.424+0000 7f7e06a00640 1 -- 172.21.15.18:0/1072810364 learned_addr learned my addr 172.21.15.18:0/1072810364 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:54:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.424+0000 7f7e0fe00640 1 --2- 172.21.15.18:0/1072810364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5923a0 0x55c91d5bac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.426+0000 7f7e0fe00640 1 -- 172.21.15.18:0/1072810364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d587b00 msgr2=0x55c91d5ba750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.426+0000 7f7e0fe00640 1 --2- 172.21.15.18:0/1072810364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d587b00 0x55c91d5ba750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.426+0000 7f7e0fe00640 1 -- 172.21.15.18:0/1072810364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d5871e0 msgr2=0x55c91d58fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.426+0000 7f7e0fe00640 1 --2- 172.21.15.18:0/1072810364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d5871e0 0x55c91d58fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.426+0000 7f7e0fe00640 1 -- 172.21.15.18:0/1072810364 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c91d587010 con 0x55c91d5923a0 2024-09-12T02:54:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.427+0000 7f7e0fe00640 1 --2- 172.21.15.18:0/1072810364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5923a0 0x55c91d5bac90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009bf0 tx=0x7f7e0803e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aab66500ae73231 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.458+0000 7f7dffe00640 1 -- 172.21.15.18:0/1072810364 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08030c00 con 0x55c91d5923a0 2024-09-12T02:54:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.458+0000 7f7dffe00640 1 -- 172.21.15.18:0/1072810364 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e08036040 con 0x55c91d5923a0 2024-09-12T02:54:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.458+0000 7f7dffe00640 1 -- 172.21.15.18:0/1072810364 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0804a690 con 0x55c91d5923a0 2024-09-12T02:54:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.468+0000 7f7e193de740 1 -- 172.21.15.18:0/1072810364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5923a0 msgr2=0x55c91d5bac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:54:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.468+0000 7f7e193de740 1 --2- 172.21.15.18:0/1072810364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5923a0 0x55c91d5bac90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009bf0 tx=0x7f7e0803e000 comp rx=0 tx=0).stop 2024-09-12T02:54:56.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.505+0000 7f7e193de740 1 -- 172.21.15.18:0/1072810364 shutdown_connections 2024-09-12T02:54:56.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.505+0000 7f7e193de740 1 --2- 172.21.15.18:0/1072810364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5923a0 0x55c91d5bac90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:56.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.505+0000 7f7e193de740 1 --2- 172.21.15.18:0/1072810364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d587b00 0x55c91d5ba750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:56.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.505+0000 7f7e193de740 1 --2- 172.21.15.18:0/1072810364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d5871e0 0x55c91d58fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:56.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.505+0000 7f7e193de740 1 -- 172.21.15.18:0/1072810364 >> 172.21.15.18:0/1072810364 conn(0x55c91d583750 msgr2=0x55c91d591310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:54:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.512+0000 7f7e193de740 1 -- 172.21.15.18:0/1072810364 shutdown_connections 2024-09-12T02:54:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.514+0000 7f7e193de740 1 -- 172.21.15.18:0/1072810364 wait complete. 2024-09-12T02:54:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.514+0000 7f7e193de740 1 -- start start 2024-09-12T02:54:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.514+0000 7f7e193de740 1 Processor -- start 2024-09-12T02:54:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.531+0000 7f7e193de740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 0x55c91d5ab600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.531+0000 7f7e193de740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d587b00 0x55c91d5abb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.531+0000 7f7e193de740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d5923a0 0x55c91d58bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.531+0000 7f7e193de740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7e101b6eb0 con 0x55c91d587b00 2024-09-12T02:54:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.531+0000 7f7e193de740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7e101b6720 con 0x55c91d5871e0 2024-09-12T02:54:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.531+0000 7f7e193de740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7e101031e0 con 0x55c91d5923a0 2024-09-12T02:54:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.531+0000 7f7e193de740 10 client.0 _ll_register_callbacks cb 0x7f7df8006ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:54:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.534+0000 7f7e0fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d5923a0 0x55c91d58bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.534+0000 7f7e0fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d5923a0 0x55c91d58bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:45038/0 (socket says 172.21.15.18:45038) 2024-09-12T02:54:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.534+0000 7f7e0fe00640 1 -- 172.21.15.18:0/452601395 learned_addr learned my addr 172.21.15.18:0/452601395 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:54:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.538+0000 7f7e06a00640 1 --2- 172.21.15.18:0/452601395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d587b00 0x55c91d5abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.538+0000 7f7e0f400640 1 --2- 172.21.15.18:0/452601395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 0x55c91d5ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.540+0000 7f7e06a00640 1 -- 172.21.15.18:0/452601395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d5923a0 msgr2=0x55c91d58bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.540+0000 7f7e06a00640 1 --2- 172.21.15.18:0/452601395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d5923a0 0x55c91d58bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.540+0000 7f7e06a00640 1 -- 172.21.15.18:0/452601395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 msgr2=0x55c91d5ab600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:54:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.540+0000 7f7e06a00640 1 --2- 172.21.15.18:0/452601395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 0x55c91d5ab600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:54:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.540+0000 7f7e06a00640 1 -- 172.21.15.18:0/452601395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c91d57ed60 con 0x55c91d587b00 2024-09-12T02:54:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.541+0000 7f7e06a00640 1 --2- 172.21.15.18:0/452601395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d587b00 0x55c91d5abb40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55c91d577ff0 tx=0x7f7df8009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb5e41a34504ff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:54:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.553+0000 7f7dfd600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:54:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.553+0000 7f7dfd600640 1 -- 172.21.15.18:0/452601395 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8024410 con 0x55c91d587b00 2024-09-12T02:54:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.553+0000 7f7dfd600640 1 -- 172.21.15.18:0/452601395 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7f7df80245b0 con 0x55c91d587b00 2024-09-12T02:54:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.576+0000 7f7e193de740 1 -- 172.21.15.18:0/452601395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e08036040 con 0x55c91d587b00 2024-09-12T02:54:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.605+0000 7f7dfd600640 1 -- 172.21.15.18:0/452601395 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f7df80247b0 con 0x55c91d587b00 2024-09-12T02:54:56.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.617+0000 7f7e193de740 10 client.15618 fetch_fsmap learned FSMap version 48 2024-09-12T02:54:56.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.617+0000 7f7e193de740 1 -- 172.21.15.18:0/452601395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55c91d61d110 con 0x55c91d587b00 2024-09-12T02:54:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.625+0000 7f7dfd600640 1 -- 172.21.15.18:0/452601395 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e08036040 con 0x55c91d587b00 2024-09-12T02:54:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.625+0000 7f7dfd600640 1 -- 172.21.15.18:0/452601395 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 48) ==== 8426+0+0 (secure 0 0 0) 0x7f7df8016ce0 con 0x55c91d587b00 2024-09-12T02:54:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.625+0000 7f7e193de740 10 client.15618 fetch_fsmap finished waiting for FSMap version 48 2024-09-12T02:54:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.625+0000 7f7e193de740 10 client.15618 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:54:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.625+0000 7f7e193de740 20 client.15618 populate_metadata read hostname 'smithi018' 2024-09-12T02:54:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.625+0000 7f7e193de740 1 --2- 172.21.15.18:0/452601395 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c91d61d820 0x55c91d61fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:54:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.625+0000 7f7e193de740 4 client.15618 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:54:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.625+0000 7f7e193de740 1 -- 172.21.15.18:0/452601395 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c91d4f4b80 con 0x55c91d61d820 2024-09-12T02:54:56.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.629+0000 7f7e0f400640 1 --2- 172.21.15.18:0/452601395 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c91d61d820 0x55c91d61fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:54:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.639+0000 7f7e0f400640 1 --2- 172.21.15.18:0/452601395 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c91d61d820 0x55c91d61fc40 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c27fc14e18dc228b server_cookie=83b0cff20b874494 in_seq=0 out_seq=0 2024-09-12T02:54:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:54:56.639+0000 7f7dfd600640 10 client.15618 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:54:57.070 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:56 smithi018 ceph-mon[30616]: pgmap v189: 129 pgs: 129 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 10 MiB/s wr, 576 op/s 2024-09-12T02:54:57.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:56 smithi176 ceph-mon[35713]: pgmap v189: 129 pgs: 129 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 10 MiB/s wr, 576 op/s 2024-09-12T02:54:57.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:56 smithi062 ceph-mon[35527]: pgmap v189: 129 pgs: 129 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 10 MiB/s wr, 576 op/s 2024-09-12T02:54:59.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:54:58 smithi018 ceph-mon[30616]: pgmap v190: 129 pgs: 129 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.3 MiB/s wr, 508 op/s 2024-09-12T02:54:59.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:54:58 smithi176 ceph-mon[35713]: pgmap v190: 129 pgs: 129 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.3 MiB/s wr, 508 op/s 2024-09-12T02:54:59.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:54:58 smithi062 ceph-mon[35527]: pgmap v190: 129 pgs: 129 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.3 MiB/s wr, 508 op/s 2024-09-12T02:55:01.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:00 smithi018 ceph-mon[30616]: pgmap v191: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 782 op/s 2024-09-12T02:55:01.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:00 smithi176 ceph-mon[35713]: pgmap v191: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 782 op/s 2024-09-12T02:55:01.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:00 smithi062 ceph-mon[35527]: pgmap v191: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 782 op/s 2024-09-12T02:55:03.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:02 smithi018 ceph-mon[30616]: pgmap v192: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 858 op/s 2024-09-12T02:55:03.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:02 smithi176 ceph-mon[35713]: pgmap v192: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 858 op/s 2024-09-12T02:55:03.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:02 smithi062 ceph-mon[35527]: pgmap v192: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 858 op/s 2024-09-12T02:55:05.043 INFO:tasks.workunit.client.0.smithi018.stdout: 541 465492 309 302842 270 88815 164 2024-09-12T02:55:05.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.046+0000 7f7dfd600640 1 -- 172.21.15.18:0/452601395 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c91d4f4b80 con 0x55c91d61d820 2024-09-12T02:55:05.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.046+0000 7f7dfd600640 10 client.15618 handle_command_reply: tid=0 2024-09-12T02:55:05.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.046+0000 7f7e193de740 1 client.15618 shutdown 2024-09-12T02:55:05.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.046+0000 7f7e193de740 1 -- 172.21.15.18:0/452601395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d587b00 msgr2=0x55c91d5abb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:05.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.046+0000 7f7e193de740 1 --2- 172.21.15.18:0/452601395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d587b00 0x55c91d5abb40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55c91d577ff0 tx=0x7f7df8009e70 comp rx=0 tx=0).stop 2024-09-12T02:55:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.048+0000 7f7e193de740 1 -- 172.21.15.18:0/452601395 shutdown_connections 2024-09-12T02:55:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.048+0000 7f7e193de740 1 --2- 172.21.15.18:0/452601395 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c91d61d820 0x55c91d61fc40 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.048+0000 7f7e193de740 1 --2- 172.21.15.18:0/452601395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c91d5923a0 0x55c91d58bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.048+0000 7f7e193de740 1 --2- 172.21.15.18:0/452601395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91d587b00 0x55c91d5abb40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.048+0000 7f7e193de740 1 --2- 172.21.15.18:0/452601395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c91d5871e0 0x55c91d5ab600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.048+0000 7f7e193de740 1 -- 172.21.15.18:0/452601395 >> 172.21.15.18:0/452601395 conn(0x55c91d583750 msgr2=0x55c91d582830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.048+0000 7f7dfd600640 0 client.15618 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:55:05.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.049+0000 7f7e193de740 1 -- 172.21.15.18:0/452601395 shutdown_connections 2024-09-12T02:55:05.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.049+0000 7f7e193de740 1 -- 172.21.15.18:0/452601395 wait complete. 2024-09-12T02:55:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.051+0000 7f7e193de740 20 client.15618 trim_cache size 0 max 16384 2024-09-12T02:55:05.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:55:05.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:55:05.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:55:05.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:55:05.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.059+0000 7f7e16600640 1 -- 172.21.15.18:0/1735215207 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f7df40a2ef0 msgr2=0x7f7df40a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:05.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.060+0000 7f7e16600640 1 --2- 172.21.15.18:0/1735215207 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f7df40a2ef0 0x7f7df40a53b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7e10116e50 tx=0x7f7e08005f80 comp rx=0 tx=0).stop 2024-09-12T02:55:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.060+0000 7f7e16600640 1 -- 172.21.15.18:0/1735215207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e10101ae0 msgr2=0x7f7e101161c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.060+0000 7f7e16600640 1 --2- 172.21.15.18:0/1735215207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e10101ae0 0x7f7e101161c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000d950 tx=0x7f7e0000de10 comp rx=0 tx=0).stop 2024-09-12T02:55:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.061+0000 7f7e16600640 1 -- 172.21.15.18:0/1735215207 shutdown_connections 2024-09-12T02:55:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.061+0000 7f7e16600640 1 --2- 172.21.15.18:0/1735215207 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f7df40a2ef0 0x7f7df40a53b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.061+0000 7f7e16600640 1 --2- 172.21.15.18:0/1735215207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e10107b80 0x7f7e1011bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.061+0000 7f7e16600640 1 --2- 172.21.15.18:0/1735215207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e10102480 0x7f7e10116700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.061+0000 7f7e16600640 1 --2- 172.21.15.18:0/1735215207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e10101ae0 0x7f7e101161c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.061+0000 7f7e16600640 1 -- 172.21.15.18:0/1735215207 >> 172.21.15.18:0/1735215207 conn(0x7f7e100fd7e0 msgr2=0x7f7e100fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.062+0000 7f7e16600640 1 -- 172.21.15.18:0/1735215207 shutdown_connections 2024-09-12T02:55:05.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:05.062+0000 7f7e16600640 1 -- 172.21.15.18:0/1735215207 wait complete. 2024-09-12T02:55:05.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:04 smithi176 ceph-mon[35713]: pgmap v193: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 921 op/s 2024-09-12T02:55:05.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:04 smithi062 ceph-mon[35527]: pgmap v193: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 921 op/s 2024-09-12T02:55:05.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:04 smithi018 ceph-mon[30616]: pgmap v193: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 921 op/s 2024-09-12T02:55:06.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:05 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:55:06.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:05 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:55:06.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:05 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:55:07.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:06 smithi176 ceph-mon[35713]: pgmap v194: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 1.11k op/s 2024-09-12T02:55:07.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:06 smithi062 ceph-mon[35527]: pgmap v194: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 1.11k op/s 2024-09-12T02:55:07.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:06 smithi018 ceph-mon[30616]: pgmap v194: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 1.11k op/s 2024-09-12T02:55:09.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:08 smithi176 ceph-mon[35713]: pgmap v195: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.2 MiB/s wr, 813 op/s 2024-09-12T02:55:09.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:08 smithi062 ceph-mon[35527]: pgmap v195: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.2 MiB/s wr, 813 op/s 2024-09-12T02:55:09.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:08 smithi018 ceph-mon[30616]: pgmap v195: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.2 MiB/s wr, 813 op/s 2024-09-12T02:55:11.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:10 smithi176 ceph-mon[35713]: pgmap v196: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.3 MiB/s wr, 841 op/s 2024-09-12T02:55:11.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:10 smithi062 ceph-mon[35527]: pgmap v196: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.3 MiB/s wr, 841 op/s 2024-09-12T02:55:11.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:10 smithi018 ceph-mon[30616]: pgmap v196: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.3 MiB/s wr, 841 op/s 2024-09-12T02:55:13.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:12 smithi176 ceph-mon[35713]: pgmap v197: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 562 op/s 2024-09-12T02:55:13.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:12 smithi062 ceph-mon[35527]: pgmap v197: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 562 op/s 2024-09-12T02:55:13.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:12 smithi018 ceph-mon[30616]: pgmap v197: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 562 op/s 2024-09-12T02:55:15.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:14 smithi176 ceph-mon[35713]: pgmap v198: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 1.7 MiB/s wr, 394 op/s 2024-09-12T02:55:15.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:14 smithi062 ceph-mon[35527]: pgmap v198: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 1.7 MiB/s wr, 394 op/s 2024-09-12T02:55:15.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:14 smithi018 ceph-mon[30616]: pgmap v198: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 1.7 MiB/s wr, 394 op/s 2024-09-12T02:55:17.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:16 smithi176 ceph-mon[35713]: pgmap v199: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 1.2 MiB/s wr, 284 op/s 2024-09-12T02:55:17.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:16 smithi062 ceph-mon[35527]: pgmap v199: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 1.2 MiB/s wr, 284 op/s 2024-09-12T02:55:17.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:16 smithi018 ceph-mon[30616]: pgmap v199: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 1.2 MiB/s wr, 284 op/s 2024-09-12T02:55:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.192+0000 7fb0ebc00640 1 -- 172.21.15.18:0/2387859560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0e4076720 msgr2=0x7fb0e4076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.192+0000 7fb0ebc00640 1 --2- 172.21.15.18:0/2387859560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0e4076720 0x7fb0e4076b00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8009860 tx=0x7fb0d802a340 comp rx=0 tx=0).stop 2024-09-12T02:55:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.192+0000 7fb0ebc00640 1 -- 172.21.15.18:0/2387859560 shutdown_connections 2024-09-12T02:55:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.192+0000 7fb0ebc00640 1 --2- 172.21.15.18:0/2387859560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0e4112960 0x7fb0e4114d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.192+0000 7fb0ebc00640 1 --2- 172.21.15.18:0/2387859560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0e4077040 0x7fb0e4112420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.192+0000 7fb0ebc00640 1 --2- 172.21.15.18:0/2387859560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0e4076720 0x7fb0e4076b00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.192+0000 7fb0ebc00640 1 -- 172.21.15.18:0/2387859560 >> 172.21.15.18:0/2387859560 conn(0x7fb0e40ff980 msgr2=0x7fb0e4101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.192+0000 7fb0ebc00640 1 -- 172.21.15.18:0/2387859560 shutdown_connections 2024-09-12T02:55:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.192+0000 7fb0ebc00640 1 -- 172.21.15.18:0/2387859560 wait complete. 2024-09-12T02:55:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.193+0000 7fb0ebc00640 1 Processor -- start 2024-09-12T02:55:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.193+0000 7fb0ebc00640 1 -- start start 2024-09-12T02:55:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.194+0000 7fb0ebc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0e4076720 0x7fb0e41a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.194+0000 7fb0ebc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0e4077040 0x7fb0e41a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.194+0000 7fb0ebc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0e4112960 0x7fb0e419e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.194+0000 7fb0ebc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e41184d0 con 0x7fb0e4077040 2024-09-12T02:55:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.194+0000 7fb0ebc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e4118350 con 0x7fb0e4112960 2024-09-12T02:55:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.194+0000 7fb0ebc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e4118650 con 0x7fb0e4076720 2024-09-12T02:55:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.194+0000 7fb0e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0e4077040 0x7fb0e41a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.194+0000 7fb0e9200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0e4076720 0x7fb0e41a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.194+0000 7fb0e9200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0e4076720 0x7fb0e41a4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:45614/0 (socket says 172.21.15.18:45614) 2024-09-12T02:55:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.194+0000 7fb0e9200640 1 -- 172.21.15.18:0/3557646711 learned_addr learned my addr 172.21.15.18:0/3557646711 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.194+0000 7fb0e9c00640 1 --2- 172.21.15.18:0/3557646711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0e4112960 0x7fb0e419e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.194+0000 7fb0e9200640 1 -- 172.21.15.18:0/3557646711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0e4112960 msgr2=0x7fb0e419e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.194+0000 7fb0e9200640 1 --2- 172.21.15.18:0/3557646711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0e4112960 0x7fb0e419e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.194+0000 7fb0e9200640 1 -- 172.21.15.18:0/3557646711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0e4077040 msgr2=0x7fb0e41a4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.194+0000 7fb0e9200640 1 --2- 172.21.15.18:0/3557646711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0e4077040 0x7fb0e41a4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.194+0000 7fb0e9200640 1 -- 172.21.15.18:0/3557646711 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e419ef50 con 0x7fb0e4076720 2024-09-12T02:55:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.195+0000 7fb0e9200640 1 --2- 172.21.15.18:0/3557646711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0e4076720 0x7fb0e41a4610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8035040 tx=0x7fb0d8033b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.195+0000 7fb0e1600640 1 -- 172.21.15.18:0/3557646711 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8037040 con 0x7fb0e4076720 2024-09-12T02:55:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.195+0000 7fb0ebc00640 1 -- 172.21.15.18:0/3557646711 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e419f1e0 con 0x7fb0e4076720 2024-09-12T02:55:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.195+0000 7fb0e1600640 1 -- 172.21.15.18:0/3557646711 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0d8040070 con 0x7fb0e4076720 2024-09-12T02:55:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.195+0000 7fb0e1600640 1 -- 172.21.15.18:0/3557646711 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d80039b0 con 0x7fb0e4076720 2024-09-12T02:55:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.195+0000 7fb0ebc00640 1 -- 172.21.15.18:0/3557646711 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e41ab460 con 0x7fb0e4076720 2024-09-12T02:55:18.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.198+0000 7fb0eec58740 1 Processor -- start 2024-09-12T02:55:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.198+0000 7fb0eec58740 1 -- start start 2024-09-12T02:55:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.198+0000 7fb0e1600640 1 -- 172.21.15.18:0/3557646711 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fb0d80305e0 con 0x7fb0e4076720 2024-09-12T02:55:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.199+0000 7fb0eec58740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277d961e0 0x559277d965c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.199+0000 7fb0eec58740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 0x559277da0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.199+0000 7fb0eec58740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277da13a0 0x559277da3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.199+0000 7fb0eec58740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559277cfc100 con 0x559277d96b00 2024-09-12T02:55:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.199+0000 7fb0eec58740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559277ca41b0 con 0x559277da13a0 2024-09-12T02:55:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.199+0000 7fb0eec58740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x559277cf80c0 con 0x559277d961e0 2024-09-12T02:55:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.199+0000 7fb0e9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 0x559277da0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.199+0000 7fb0e9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 0x559277da0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44942/0 (socket says 172.21.15.18:44942) 2024-09-12T02:55:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.199+0000 7fb0e9200640 1 -- 172.21.15.18:0/2206130276 learned_addr learned my addr 172.21.15.18:0/2206130276 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.199+0000 7fb0e3e00640 1 --2- 172.21.15.18:0/2206130276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277da13a0 0x559277da3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.199+0000 7fb0e9c00640 1 --2- 172.21.15.18:0/2206130276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277d961e0 0x559277d965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.199+0000 7fb0e9200640 1 -- 172.21.15.18:0/2206130276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277d961e0 msgr2=0x559277d965c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.199+0000 7fb0e9200640 1 --2- 172.21.15.18:0/2206130276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277d961e0 0x559277d965c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.199+0000 7fb0e9200640 1 -- 172.21.15.18:0/2206130276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277da13a0 msgr2=0x559277da3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.199+0000 7fb0e9200640 1 --2- 172.21.15.18:0/2206130276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277da13a0 0x559277da3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.199+0000 7fb0e9200640 1 -- 172.21.15.18:0/2206130276 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559277a0f210 con 0x559277d96b00 2024-09-12T02:55:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.199+0000 7fb0e3e00640 1 --2- 172.21.15.18:0/2206130276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277da13a0 0x559277da3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:55:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.200+0000 7fb0e9200640 1 --2- 172.21.15.18:0/2206130276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 0x559277da0e60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb0d80eca20 tx=0x7fb0d80f5b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab91587ef8634f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.200+0000 7fb0e1600640 1 --2- 172.21.15.18:0/3557646711 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fb0cc0a2da0 0x7fb0cc0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.200+0000 7fb0d6000640 1 -- 172.21.15.18:0/2206130276 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d80fe070 con 0x559277d96b00 2024-09-12T02:55:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.200+0000 7fb0d6000640 1 -- 172.21.15.18:0/2206130276 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0d80836c0 con 0x559277d96b00 2024-09-12T02:55:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.200+0000 7fb0d6000640 1 -- 172.21.15.18:0/2206130276 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d80834f0 con 0x559277d96b00 2024-09-12T02:55:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.200+0000 7fb0e1600640 1 -- 172.21.15.18:0/3557646711 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fb0d80ef6a0 con 0x7fb0e4076720 2024-09-12T02:55:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.200+0000 7fb0e9c00640 1 --2- 172.21.15.18:0/3557646711 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fb0cc0a2da0 0x7fb0cc0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.201+0000 7fb0eec58740 1 -- 172.21.15.18:0/2206130276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 msgr2=0x559277da0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.201+0000 7fb0eec58740 1 --2- 172.21.15.18:0/2206130276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 0x559277da0e60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb0d80eca20 tx=0x7fb0d80f5b20 comp rx=0 tx=0).stop 2024-09-12T02:55:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.201+0000 7fb0e9c00640 1 --2- 172.21.15.18:0/3557646711 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fb0cc0a2da0 0x7fb0cc0a5260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb0e406b1e0 tx=0x7fb0dc009500 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.201+0000 7fb0eec58740 1 -- 172.21.15.18:0/2206130276 shutdown_connections 2024-09-12T02:55:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.201+0000 7fb0eec58740 1 --2- 172.21.15.18:0/2206130276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277da13a0 0x559277da3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.201+0000 7fb0eec58740 1 --2- 172.21.15.18:0/2206130276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 0x559277da0e60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.201+0000 7fb0eec58740 1 --2- 172.21.15.18:0/2206130276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277d961e0 0x559277d965c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.201+0000 7fb0eec58740 1 -- 172.21.15.18:0/2206130276 >> 172.21.15.18:0/2206130276 conn(0x559277d92750 msgr2=0x559277d92b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:18.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.201+0000 7fb0eec58740 1 -- 172.21.15.18:0/2206130276 shutdown_connections 2024-09-12T02:55:18.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.201+0000 7fb0eec58740 1 -- 172.21.15.18:0/2206130276 wait complete. 2024-09-12T02:55:18.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.201+0000 7fb0eec58740 1 -- start start 2024-09-12T02:55:18.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.202+0000 7fb0eec58740 1 Processor -- start 2024-09-12T02:55:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.202+0000 7fb0eec58740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277d961e0 0x559277d9e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.202+0000 7fb0eec58740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 0x559277d9e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.202+0000 7fb0eec58740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277da13a0 0x559277d9ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.202+0000 7fb0eec58740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559277da3d30 con 0x559277d96b00 2024-09-12T02:55:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.202+0000 7fb0eec58740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559277c85090 con 0x559277da13a0 2024-09-12T02:55:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.202+0000 7fb0eec58740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x559277da3eb0 con 0x559277d961e0 2024-09-12T02:55:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.202+0000 7fb0eec58740 10 client.0 _ll_register_callbacks cb 0x559277cd9f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:55:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.202+0000 7fb0e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 0x559277d9e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.202+0000 7fb0e9200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277d961e0 0x559277d9e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.202+0000 7fb0e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 0x559277d9e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44944/0 (socket says 172.21.15.18:44944) 2024-09-12T02:55:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.202+0000 7fb0e3e00640 1 -- 172.21.15.18:0/1052238945 learned_addr learned my addr 172.21.15.18:0/1052238945 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.202+0000 7fb0e9200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277d961e0 0x559277d9e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:45638/0 (socket says 172.21.15.18:45638) 2024-09-12T02:55:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.202+0000 7fb0e9c00640 1 --2- 172.21.15.18:0/1052238945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277da13a0 0x559277d9ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.203+0000 7fb0e3e00640 1 -- 172.21.15.18:0/1052238945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277d961e0 msgr2=0x559277d9e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.203+0000 7fb0e3e00640 1 --2- 172.21.15.18:0/1052238945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277d961e0 0x559277d9e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.203+0000 7fb0e3e00640 1 -- 172.21.15.18:0/1052238945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277da13a0 msgr2=0x559277d9ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.203+0000 7fb0e3e00640 1 --2- 172.21.15.18:0/1052238945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277da13a0 0x559277d9ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.203+0000 7fb0e3e00640 1 -- 172.21.15.18:0/1052238945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559277adb620 con 0x559277d96b00 2024-09-12T02:55:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.203+0000 7fb0e3e00640 1 --2- 172.21.15.18:0/1052238945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 0x559277d9e7f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00116f0 tx=0x7fb0d0011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3628291734a3a225 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.203+0000 7fb0caa00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:55:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.203+0000 7fb0caa00640 1 -- 172.21.15.18:0/1052238945 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d001e020 con 0x559277d96b00 2024-09-12T02:55:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.203+0000 7fb0eec58740 1 -- 172.21.15.18:0/1052238945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0d80836c0 con 0x559277d96b00 2024-09-12T02:55:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.203+0000 7fb0caa00640 1 -- 172.21.15.18:0/1052238945 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fb0d000fc70 con 0x559277d96b00 2024-09-12T02:55:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.203+0000 7fb0caa00640 1 -- 172.21.15.18:0/1052238945 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fb0d0026050 con 0x559277d96b00 2024-09-12T02:55:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.204+0000 7fb0eec58740 10 client.15630 fetch_fsmap learned FSMap version 49 2024-09-12T02:55:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.204+0000 7fb0eec58740 1 -- 172.21.15.18:0/1052238945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x559277daf910 con 0x559277d96b00 2024-09-12T02:55:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.204+0000 7fb0caa00640 1 -- 172.21.15.18:0/1052238945 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0d80836c0 con 0x559277d96b00 2024-09-12T02:55:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.204+0000 7fb0caa00640 1 -- 172.21.15.18:0/1052238945 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7fb0d0019070 con 0x559277d96b00 2024-09-12T02:55:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.204+0000 7fb0eec58740 10 client.15630 fetch_fsmap finished waiting for FSMap version 49 2024-09-12T02:55:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.204+0000 7fb0eec58740 10 client.15630 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:55:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.204+0000 7fb0eec58740 20 client.15630 populate_metadata read hostname 'smithi018' 2024-09-12T02:55:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.204+0000 7fb0eec58740 1 --2- 172.21.15.18:0/1052238945 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x559277db0ea0 0x559277db32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.204+0000 7fb0eec58740 4 client.15630 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:55:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.204+0000 7fb0eec58740 1 -- 172.21.15.18:0/1052238945 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559277d09830 con 0x559277db0ea0 2024-09-12T02:55:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.204+0000 7fb0e9200640 1 --2- 172.21.15.18:0/1052238945 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x559277db0ea0 0x559277db32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.205+0000 7fb0e9200640 1 --2- 172.21.15.18:0/1052238945 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x559277db0ea0 0x559277db32c0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a09b0411bffeacd server_cookie=8994dafef11cf59 in_seq=0 out_seq=0 2024-09-12T02:55:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.205+0000 7fb0caa00640 10 client.15630 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:55:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.205+0000 7fb0caa00640 1 -- 172.21.15.18:0/1052238945 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559277d09830 con 0x559277db0ea0 2024-09-12T02:55:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.205+0000 7fb0caa00640 10 client.15630 handle_command_reply: tid=0 2024-09-12T02:55:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.206+0000 7fb0eec58740 1 client.15630 shutdown 2024-09-12T02:55:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.206+0000 7fb0eec58740 1 -- 172.21.15.18:0/1052238945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 msgr2=0x559277d9e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.206+0000 7fb0eec58740 1 --2- 172.21.15.18:0/1052238945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 0x559277d9e7f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00116f0 tx=0x7fb0d0011bb0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.206+0000 7fb0eec58740 1 -- 172.21.15.18:0/1052238945 shutdown_connections 2024-09-12T02:55:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.206+0000 7fb0eec58740 1 --2- 172.21.15.18:0/1052238945 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x559277db0ea0 0x559277db32c0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.206+0000 7fb0eec58740 1 --2- 172.21.15.18:0/1052238945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277da13a0 0x559277d9ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.206+0000 7fb0eec58740 1 --2- 172.21.15.18:0/1052238945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 0x559277d9e7f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.206+0000 7fb0caa00640 0 client.15630 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:55:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.206+0000 7fb0eec58740 1 --2- 172.21.15.18:0/1052238945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277d961e0 0x559277d9e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.206+0000 7fb0eec58740 1 -- 172.21.15.18:0/1052238945 >> 172.21.15.18:0/1052238945 conn(0x559277d92750 msgr2=0x559277d98460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.206+0000 7fb0eec58740 1 -- 172.21.15.18:0/1052238945 shutdown_connections 2024-09-12T02:55:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.206+0000 7fb0eec58740 1 -- 172.21.15.18:0/1052238945 wait complete. 2024-09-12T02:55:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.206+0000 7fb0eec58740 20 client.15630 trim_cache size 0 max 16384 2024-09-12T02:55:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.221+0000 7fb0eec58740 1 Processor -- start 2024-09-12T02:55:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.221+0000 7fb0eec58740 1 -- start start 2024-09-12T02:55:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.221+0000 7fb0eec58740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277d961e0 0x559277d98c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.221+0000 7fb0eec58740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277d96b00 0x559277d8d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.221+0000 7fb0eec58740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277da13a0 0x559277d9eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.221+0000 7fb0eec58740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e41b5650 con 0x559277da13a0 2024-09-12T02:55:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.221+0000 7fb0eec58740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e41b7340 con 0x559277d961e0 2024-09-12T02:55:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.221+0000 7fb0eec58740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e41b5d50 con 0x559277d96b00 2024-09-12T02:55:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.222+0000 7fb0e9c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277da13a0 0x559277d9eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.222+0000 7fb0e9c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277da13a0 0x559277d9eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44956/0 (socket says 172.21.15.18:44956) 2024-09-12T02:55:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.222+0000 7fb0e9c00640 1 -- 172.21.15.18:0/3712584808 learned_addr learned my addr 172.21.15.18:0/3712584808 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.222+0000 7fb0e9200640 1 --2- 172.21.15.18:0/3712584808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277d961e0 0x559277d98c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.222+0000 7fb0e3e00640 1 --2- 172.21.15.18:0/3712584808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277d96b00 0x559277d8d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.222+0000 7fb0e9c00640 1 -- 172.21.15.18:0/3712584808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277d96b00 msgr2=0x559277d8d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.222+0000 7fb0e9c00640 1 --2- 172.21.15.18:0/3712584808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277d96b00 0x559277d8d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.222+0000 7fb0e9c00640 1 -- 172.21.15.18:0/3712584808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277d961e0 msgr2=0x559277d98c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.222+0000 7fb0e9c00640 1 --2- 172.21.15.18:0/3712584808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277d961e0 0x559277d98c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.222+0000 7fb0e9c00640 1 -- 172.21.15.18:0/3712584808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559277d9d240 con 0x559277da13a0 2024-09-12T02:55:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.222+0000 7fb0e3e00640 1 --2- 172.21.15.18:0/3712584808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277d96b00 0x559277d8d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:55:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.222+0000 7fb0e9c00640 1 --2- 172.21.15.18:0/3712584808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277da13a0 0x559277d9eb60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc003f50 tx=0x7fb0dc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1bbc4c775fbbbab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.223+0000 7fb0d5600640 1 -- 172.21.15.18:0/3712584808 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc004b20 con 0x559277da13a0 2024-09-12T02:55:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.223+0000 7fb0d5600640 1 -- 172.21.15.18:0/3712584808 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0dc004cc0 con 0x559277da13a0 2024-09-12T02:55:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.223+0000 7fb0d5600640 1 -- 172.21.15.18:0/3712584808 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc005490 con 0x559277da13a0 2024-09-12T02:55:18.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.223+0000 7fb0eec58740 1 -- 172.21.15.18:0/3712584808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277da13a0 msgr2=0x559277d9eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:18.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.223+0000 7fb0eec58740 1 --2- 172.21.15.18:0/3712584808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277da13a0 0x559277d9eb60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc003f50 tx=0x7fb0dc01a000 comp rx=0 tx=0).stop 2024-09-12T02:55:18.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.223+0000 7fb0eec58740 1 -- 172.21.15.18:0/3712584808 shutdown_connections 2024-09-12T02:55:18.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.223+0000 7fb0eec58740 1 --2- 172.21.15.18:0/3712584808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277da13a0 0x559277d9eb60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.223+0000 7fb0eec58740 1 --2- 172.21.15.18:0/3712584808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277d96b00 0x559277d8d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.223+0000 7fb0eec58740 1 --2- 172.21.15.18:0/3712584808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277d961e0 0x559277d98c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.223+0000 7fb0eec58740 1 -- 172.21.15.18:0/3712584808 >> 172.21.15.18:0/3712584808 conn(0x559277d92750 msgr2=0x559277da0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:18.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.223+0000 7fb0eec58740 1 -- 172.21.15.18:0/3712584808 shutdown_connections 2024-09-12T02:55:18.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.223+0000 7fb0eec58740 1 -- 172.21.15.18:0/3712584808 wait complete. 2024-09-12T02:55:18.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.224+0000 7fb0eec58740 1 -- start start 2024-09-12T02:55:18.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.224+0000 7fb0eec58740 1 Processor -- start 2024-09-12T02:55:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.224+0000 7fb0eec58740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277d961e0 0x559277da4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.224+0000 7fb0eec58740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 0x559277da4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.224+0000 7fb0eec58740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277da13a0 0x559277e13b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.224+0000 7fb0eec58740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e41b6bb0 con 0x559277d96b00 2024-09-12T02:55:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.224+0000 7fb0eec58740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e41b6420 con 0x559277d961e0 2024-09-12T02:55:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.224+0000 7fb0eec58740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e41b3630 con 0x559277da13a0 2024-09-12T02:55:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.225+0000 7fb0eec58740 10 client.0 _ll_register_callbacks cb 0x7fb0d0009da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:55:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.225+0000 7fb0e9200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277d961e0 0x559277da4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.225+0000 7fb0e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 0x559277da4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.225+0000 7fb0e9200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277d961e0 0x559277da4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:37910/0 (socket says 172.21.15.18:37910) 2024-09-12T02:55:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.225+0000 7fb0e9200640 1 -- 172.21.15.18:0/2775134890 learned_addr learned my addr 172.21.15.18:0/2775134890 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.225+0000 7fb0e9c00640 1 --2- 172.21.15.18:0/2775134890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277da13a0 0x559277e13b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.225+0000 7fb0e9200640 1 -- 172.21.15.18:0/2775134890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277da13a0 msgr2=0x559277e13b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.225+0000 7fb0e9200640 1 --2- 172.21.15.18:0/2775134890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277da13a0 0x559277e13b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.225+0000 7fb0e9200640 1 -- 172.21.15.18:0/2775134890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 msgr2=0x559277da4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.225+0000 7fb0e9200640 1 --2- 172.21.15.18:0/2775134890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 0x559277da4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.225+0000 7fb0e9200640 1 -- 172.21.15.18:0/2775134890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559277e14180 con 0x559277d961e0 2024-09-12T02:55:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.225+0000 7fb0e3e00640 1 --2- 172.21.15.18:0/2775134890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 0x559277da4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:55:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.225+0000 7fb0e9200640 1 --2- 172.21.15.18:0/2775134890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277d961e0 0x559277da4590 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8000c00 tx=0x7fb0d8030980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccfffe1dc10befcb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.225+0000 7fb0caa00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:55:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.225+0000 7fb0caa00640 1 -- 172.21.15.18:0/2775134890 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8084f40 con 0x559277d961e0 2024-09-12T02:55:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.226+0000 7fb0caa00640 1 -- 172.21.15.18:0/2775134890 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9474+0+0 (secure 0 0 0) 0x7fb0d80b9bb0 con 0x559277d961e0 2024-09-12T02:55:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.226+0000 7fb0eec58740 1 -- 172.21.15.18:0/2775134890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0dc004cc0 con 0x559277d961e0 2024-09-12T02:55:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.226+0000 7fb0caa00640 1 -- 172.21.15.18:0/2775134890 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fb0d8085690 con 0x559277d961e0 2024-09-12T02:55:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.226+0000 7fb0eec58740 10 client.25625 fetch_fsmap learned FSMap version 49 2024-09-12T02:55:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.226+0000 7fb0eec58740 1 -- 172.21.15.18:0/2775134890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x559277e1b510 con 0x559277d961e0 2024-09-12T02:55:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.226+0000 7fb0caa00640 1 -- 172.21.15.18:0/2775134890 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0dc004cc0 con 0x559277d961e0 2024-09-12T02:55:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.226+0000 7fb0caa00640 1 -- 172.21.15.18:0/2775134890 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7fb0d803a070 con 0x559277d961e0 2024-09-12T02:55:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.226+0000 7fb0eec58740 10 client.25625 fetch_fsmap finished waiting for FSMap version 49 2024-09-12T02:55:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.226+0000 7fb0eec58740 10 client.25625 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:55:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.226+0000 7fb0eec58740 20 client.25625 populate_metadata read hostname 'smithi018' 2024-09-12T02:55:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.226+0000 7fb0eec58740 1 --2- 172.21.15.18:0/2775134890 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x559277e1bbc0 0x559277e1dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.226+0000 7fb0eec58740 4 client.25625 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:55:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.226+0000 7fb0eec58740 1 -- 172.21.15.18:0/2775134890 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559277d03b80 con 0x559277e1bbc0 2024-09-12T02:55:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.226+0000 7fb0e3e00640 1 --2- 172.21.15.18:0/2775134890 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x559277e1bbc0 0x559277e1dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.227+0000 7fb0e3e00640 1 --2- 172.21.15.18:0/2775134890 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x559277e1bbc0 0x559277e1dfb0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d48979d34917dc23 server_cookie=49d041a7e7cd44e0 in_seq=0 out_seq=0 2024-09-12T02:55:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.227+0000 7fb0caa00640 10 client.25625 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:55:18.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.427+0000 7fb0caa00640 1 -- 172.21.15.18:0/2775134890 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559277d03b80 con 0x559277e1bbc0 2024-09-12T02:55:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.427+0000 7fb0caa00640 10 client.25625 handle_command_reply: tid=0 2024-09-12T02:55:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.427+0000 7fb0eec58740 1 client.25625 shutdown 2024-09-12T02:55:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.428+0000 7fb0eec58740 1 -- 172.21.15.18:0/2775134890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277d961e0 msgr2=0x559277da4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.428+0000 7fb0eec58740 1 --2- 172.21.15.18:0/2775134890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277d961e0 0x559277da4590 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8000c00 tx=0x7fb0d8030980 comp rx=0 tx=0).stop 2024-09-12T02:55:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.428+0000 7fb0eec58740 1 -- 172.21.15.18:0/2775134890 shutdown_connections 2024-09-12T02:55:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.428+0000 7fb0eec58740 1 --2- 172.21.15.18:0/2775134890 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x559277e1bbc0 0x559277e1dfb0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.428+0000 7fb0eec58740 1 --2- 172.21.15.18:0/2775134890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559277da13a0 0x559277e13b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.428+0000 7fb0eec58740 1 --2- 172.21.15.18:0/2775134890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559277d96b00 0x559277da4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.428+0000 7fb0caa00640 0 client.25625 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:55:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.428+0000 7fb0eec58740 1 --2- 172.21.15.18:0/2775134890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559277d961e0 0x559277da4590 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.428+0000 7fb0eec58740 1 -- 172.21.15.18:0/2775134890 >> 172.21.15.18:0/2775134890 conn(0x559277d92750 msgr2=0x559277d91010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.428+0000 7fb0eec58740 1 -- 172.21.15.18:0/2775134890 shutdown_connections 2024-09-12T02:55:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.428+0000 7fb0eec58740 1 -- 172.21.15.18:0/2775134890 wait complete. 2024-09-12T02:55:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.428+0000 7fb0eec58740 20 client.25625 trim_cache size 0 max 16384 2024-09-12T02:55:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:55:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:55:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:55:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:55:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.429+0000 7fb0ebc00640 1 -- 172.21.15.18:0/3557646711 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fb0cc0a2da0 msgr2=0x7fb0cc0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.429+0000 7fb0ebc00640 1 --2- 172.21.15.18:0/3557646711 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fb0cc0a2da0 0x7fb0cc0a5260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb0e406b1e0 tx=0x7fb0dc009500 comp rx=0 tx=0).stop 2024-09-12T02:55:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.429+0000 7fb0ebc00640 1 -- 172.21.15.18:0/3557646711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0e4076720 msgr2=0x7fb0e41a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.429+0000 7fb0ebc00640 1 --2- 172.21.15.18:0/3557646711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0e4076720 0x7fb0e41a4610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8035040 tx=0x7fb0d8033b60 comp rx=0 tx=0).stop 2024-09-12T02:55:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.429+0000 7fb0ebc00640 1 -- 172.21.15.18:0/3557646711 shutdown_connections 2024-09-12T02:55:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.429+0000 7fb0ebc00640 1 --2- 172.21.15.18:0/3557646711 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fb0cc0a2da0 0x7fb0cc0a5260 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.429+0000 7fb0ebc00640 1 --2- 172.21.15.18:0/3557646711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0e4112960 0x7fb0e419e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.429+0000 7fb0ebc00640 1 --2- 172.21.15.18:0/3557646711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0e4077040 0x7fb0e41a4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.429+0000 7fb0ebc00640 1 --2- 172.21.15.18:0/3557646711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0e4076720 0x7fb0e41a4610 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.429+0000 7fb0ebc00640 1 -- 172.21.15.18:0/3557646711 >> 172.21.15.18:0/3557646711 conn(0x7fb0e40ff980 msgr2=0x7fb0e4101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.429+0000 7fb0ebc00640 1 -- 172.21.15.18:0/3557646711 shutdown_connections 2024-09-12T02:55:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:18.429+0000 7fb0ebc00640 1 -- 172.21.15.18:0/3557646711 wait complete. 2024-09-12T02:55:19.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:18 smithi176 ceph-mon[35713]: pgmap v200: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 260 KiB/s wr, 65 op/s 2024-09-12T02:55:19.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:18 smithi062 ceph-mon[35527]: pgmap v200: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 260 KiB/s wr, 65 op/s 2024-09-12T02:55:19.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:18 smithi018 ceph-mon[30616]: pgmap v200: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 260 KiB/s wr, 65 op/s 2024-09-12T02:55:21.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:20 smithi176 ceph-mon[35713]: pgmap v201: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 768 KiB/s wr, 116 op/s 2024-09-12T02:55:21.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:20 smithi062 ceph-mon[35527]: pgmap v201: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 768 KiB/s wr, 116 op/s 2024-09-12T02:55:21.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:20 smithi018 ceph-mon[30616]: pgmap v201: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 768 KiB/s wr, 116 op/s 2024-09-12T02:55:23.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:22 smithi176 ceph-mon[35713]: pgmap v202: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2024-09-12T02:55:23.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:22 smithi062 ceph-mon[35527]: pgmap v202: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2024-09-12T02:55:23.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:22 smithi018 ceph-mon[30616]: pgmap v202: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2024-09-12T02:55:24.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:23 smithi176 ceph-mon[35713]: osdmap e100: 12 total, 12 up, 12 in 2024-09-12T02:55:24.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:23 smithi062 ceph-mon[35527]: osdmap e100: 12 total, 12 up, 12 in 2024-09-12T02:55:24.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:23 smithi018 ceph-mon[30616]: osdmap e100: 12 total, 12 up, 12 in 2024-09-12T02:55:25.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:24 smithi176 ceph-mon[35713]: pgmap v204: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-09-12T02:55:25.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:24 smithi062 ceph-mon[35527]: pgmap v204: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-09-12T02:55:25.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:24 smithi018 ceph-mon[30616]: pgmap v204: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-09-12T02:55:27.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:26 smithi176 ceph-mon[35713]: pgmap v205: 129 pgs: 17 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 72 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 4.0 MiB/s wr, 261 op/s 2024-09-12T02:55:27.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:26 smithi062 ceph-mon[35527]: pgmap v205: 129 pgs: 17 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 72 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 4.0 MiB/s wr, 261 op/s 2024-09-12T02:55:27.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:26 smithi018 ceph-mon[30616]: pgmap v205: 129 pgs: 17 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 72 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 4.0 MiB/s wr, 261 op/s 2024-09-12T02:55:29.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:28 smithi176 ceph-mon[35713]: pgmap v206: 129 pgs: 17 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 72 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 4.0 MiB/s wr, 261 op/s 2024-09-12T02:55:29.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:28 smithi062 ceph-mon[35527]: pgmap v206: 129 pgs: 17 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 72 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 4.0 MiB/s wr, 261 op/s 2024-09-12T02:55:29.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:28 smithi018 ceph-mon[30616]: pgmap v206: 129 pgs: 17 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 72 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 4.0 MiB/s wr, 261 op/s 2024-09-12T02:55:31.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:30 smithi176 ceph-mon[35713]: pgmap v207: 129 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 105 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.0 MiB/s wr, 272 op/s 2024-09-12T02:55:31.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:30 smithi062 ceph-mon[35527]: pgmap v207: 129 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 105 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.0 MiB/s wr, 272 op/s 2024-09-12T02:55:31.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:30 smithi018 ceph-mon[30616]: pgmap v207: 129 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 105 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.0 MiB/s wr, 272 op/s 2024-09-12T02:55:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.549+0000 7f5525a00640 1 -- 172.21.15.18:0/43437401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5520103ae0 msgr2=0x7f5520103f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.549+0000 7f5525a00640 1 --2- 172.21.15.18:0/43437401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5520103ae0 0x7f5520103f40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f550c009930 tx=0x7f550c02a420 comp rx=0 tx=0).stop 2024-09-12T02:55:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.549+0000 7f5525a00640 1 -- 172.21.15.18:0/43437401 shutdown_connections 2024-09-12T02:55:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.549+0000 7f5525a00640 1 --2- 172.21.15.18:0/43437401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5520104480 0x7f55201109b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.549+0000 7f5525a00640 1 --2- 172.21.15.18:0/43437401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5520103ae0 0x7f5520103f40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.549+0000 7f5525a00640 1 --2- 172.21.15.18:0/43437401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5520109b80 0x7f5520109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.549+0000 7f5525a00640 1 -- 172.21.15.18:0/43437401 >> 172.21.15.18:0/43437401 conn(0x7f55200ff7c0 msgr2=0x7f5520101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.549+0000 7f5525a00640 1 -- 172.21.15.18:0/43437401 shutdown_connections 2024-09-12T02:55:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.549+0000 7f5525a00640 1 -- 172.21.15.18:0/43437401 wait complete. 2024-09-12T02:55:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.550+0000 7f5525a00640 1 Processor -- start 2024-09-12T02:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.550+0000 7f5525a00640 1 -- start start 2024-09-12T02:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.551+0000 7f5525a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5520103ae0 0x7f552019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.551+0000 7f5525a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5520104480 0x7f552019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.551+0000 7f5525a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5520109b80 0x7f552019ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.551+0000 7f5525a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5520113f40 con 0x7f5520103ae0 2024-09-12T02:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.551+0000 7f5525a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5520113dc0 con 0x7f5520109b80 2024-09-12T02:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.551+0000 7f5525a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f55201140c0 con 0x7f5520104480 2024-09-12T02:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.551+0000 7f551fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5520103ae0 0x7f552019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.551+0000 7f551fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5520103ae0 0x7f552019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59080/0 (socket says 172.21.15.18:59080) 2024-09-12T02:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.551+0000 7f551fe00640 1 -- 172.21.15.18:0/1288260950 learned_addr learned my addr 172.21.15.18:0/1288260950 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.551+0000 7f5525000640 1 --2- 172.21.15.18:0/1288260950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5520109b80 0x7f552019ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.551+0000 7f551f400640 1 --2- 172.21.15.18:0/1288260950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5520104480 0x7f552019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.551+0000 7f551fe00640 1 -- 172.21.15.18:0/1288260950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5520104480 msgr2=0x7f552019a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.551+0000 7f551fe00640 1 --2- 172.21.15.18:0/1288260950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5520104480 0x7f552019a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.551+0000 7f551fe00640 1 -- 172.21.15.18:0/1288260950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5520109b80 msgr2=0x7f552019ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.551+0000 7f551fe00640 1 --2- 172.21.15.18:0/1288260950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5520109b80 0x7f552019ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.551+0000 7f551fe00640 1 -- 172.21.15.18:0/1288260950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552019f4a0 con 0x7f5520103ae0 2024-09-12T02:55:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.551+0000 7f5525000640 1 --2- 172.21.15.18:0/1288260950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5520109b80 0x7f552019ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:55:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.552+0000 7f551fe00640 1 --2- 172.21.15.18:0/1288260950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5520103ae0 0x7f552019a4b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f551000e9f0 tx=0x7f551000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.552+0000 7f551cc00640 1 -- 172.21.15.18:0/1288260950 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551000cd80 con 0x7f5520103ae0 2024-09-12T02:55:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.552+0000 7f551cc00640 1 -- 172.21.15.18:0/1288260950 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5510010910 con 0x7f5520103ae0 2024-09-12T02:55:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.552+0000 7f5525a00640 1 -- 172.21.15.18:0/1288260950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f552019f790 con 0x7f5520103ae0 2024-09-12T02:55:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.552+0000 7f551cc00640 1 -- 172.21.15.18:0/1288260950 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510018990 con 0x7f5520103ae0 2024-09-12T02:55:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.552+0000 7f5525a00640 1 -- 172.21.15.18:0/1288260950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55201a7020 con 0x7f5520103ae0 2024-09-12T02:55:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.555+0000 7f551cc00640 1 -- 172.21.15.18:0/1288260950 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f5510010ac0 con 0x7f5520103ae0 2024-09-12T02:55:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.556+0000 7f5529e12740 1 Processor -- start 2024-09-12T02:55:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.556+0000 7f5529e12740 1 -- start start 2024-09-12T02:55:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.556+0000 7f5529e12740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec44283b0 0x55cec4428790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.556+0000 7f5529e12740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4428cd0 0x55cec4433030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.556+0000 7f5529e12740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4433570 0x55cec4435960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.556+0000 7f5529e12740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cec438e100 con 0x55cec4433570 2024-09-12T02:55:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.556+0000 7f5529e12740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55cec43361b0 con 0x55cec44283b0 2024-09-12T02:55:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.556+0000 7f5529e12740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55cec438a0c0 con 0x55cec4428cd0 2024-09-12T02:55:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.557+0000 7f5525000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec44283b0 0x55cec4428790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.557+0000 7f5525000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec44283b0 0x55cec4428790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:36320/0 (socket says 172.21.15.18:36320) 2024-09-12T02:55:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.557+0000 7f5525000640 1 -- 172.21.15.18:0/1412190043 learned_addr learned my addr 172.21.15.18:0/1412190043 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.557+0000 7f551f400640 1 --2- 172.21.15.18:0/1412190043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4433570 0x55cec4435960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.557+0000 7f551fe00640 1 --2- 172.21.15.18:0/1412190043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4428cd0 0x55cec4433030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.557+0000 7f5525000640 1 -- 172.21.15.18:0/1412190043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4428cd0 msgr2=0x55cec4433030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.557+0000 7f5525000640 1 --2- 172.21.15.18:0/1412190043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4428cd0 0x55cec4433030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.557+0000 7f5525000640 1 -- 172.21.15.18:0/1412190043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4433570 msgr2=0x55cec4435960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.557+0000 7f5525000640 1 --2- 172.21.15.18:0/1412190043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4433570 0x55cec4435960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.557+0000 7f5525000640 1 -- 172.21.15.18:0/1412190043 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec40a1210 con 0x55cec44283b0 2024-09-12T02:55:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.557+0000 7f551cc00640 1 --2- 172.21.15.18:0/1288260950 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f55040a2cf0 0x7f55040a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.557+0000 7f5525000640 1 --2- 172.21.15.18:0/1412190043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec44283b0 0x55cec4428790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f55180117e0 tx=0x7f5518011ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dc522409b84a0fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.557+0000 7f551cc00640 1 -- 172.21.15.18:0/1288260950 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9650+0+0 (secure 0 0 0) 0x7f55100cfba0 con 0x7f5520103ae0 2024-09-12T02:55:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.558+0000 7f551fe00640 1 --2- 172.21.15.18:0/1288260950 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f55040a2cf0 0x7f55040a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.558+0000 7f5515600640 1 -- 172.21.15.18:0/1412190043 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518011310 con 0x55cec44283b0 2024-09-12T02:55:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.558+0000 7f5515600640 1 -- 172.21.15.18:0/1412190043 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5518003e50 con 0x55cec44283b0 2024-09-12T02:55:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.558+0000 7f5515600640 1 -- 172.21.15.18:0/1412190043 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518004620 con 0x55cec44283b0 2024-09-12T02:55:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.558+0000 7f5529e12740 1 -- 172.21.15.18:0/1412190043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec44283b0 msgr2=0x55cec4428790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.558+0000 7f5529e12740 1 --2- 172.21.15.18:0/1412190043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec44283b0 0x55cec4428790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f55180117e0 tx=0x7f5518011ca0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.558+0000 7f551fe00640 1 --2- 172.21.15.18:0/1288260950 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f55040a2cf0 0x7f55040a51b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55cec4425780 tx=0x7f5510018420 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.558+0000 7f5529e12740 1 -- 172.21.15.18:0/1412190043 shutdown_connections 2024-09-12T02:55:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.558+0000 7f5529e12740 1 --2- 172.21.15.18:0/1412190043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4433570 0x55cec4435960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.558+0000 7f5529e12740 1 --2- 172.21.15.18:0/1412190043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4428cd0 0x55cec4433030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.558+0000 7f5529e12740 1 --2- 172.21.15.18:0/1412190043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec44283b0 0x55cec4428790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.558+0000 7f5529e12740 1 -- 172.21.15.18:0/1412190043 >> 172.21.15.18:0/1412190043 conn(0x55cec4424920 msgr2=0x55cec4424d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.559+0000 7f5529e12740 1 -- 172.21.15.18:0/1412190043 shutdown_connections 2024-09-12T02:55:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.559+0000 7f5529e12740 1 -- 172.21.15.18:0/1412190043 wait complete. 2024-09-12T02:55:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.559+0000 7f5529e12740 1 -- start start 2024-09-12T02:55:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.559+0000 7f5529e12740 1 Processor -- start 2024-09-12T02:55:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.560+0000 7f5529e12740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec44283b0 0x55cec4430690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.560+0000 7f5529e12740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4428cd0 0x55cec4430bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.560+0000 7f5529e12740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4433570 0x55cec4431110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.560+0000 7f5529e12740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cec4435f90 con 0x55cec4433570 2024-09-12T02:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.560+0000 7f5529e12740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55cec4317090 con 0x55cec44283b0 2024-09-12T02:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.560+0000 7f5529e12740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55cec4436110 con 0x55cec4428cd0 2024-09-12T02:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.560+0000 7f5529e12740 10 client.0 _ll_register_callbacks cb 0x55cec436bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.560+0000 7f5525000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec44283b0 0x55cec4430690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.560+0000 7f551f400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4428cd0 0x55cec4430bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.560+0000 7f551f400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4428cd0 0x55cec4430bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:38100/0 (socket says 172.21.15.18:38100) 2024-09-12T02:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.560+0000 7f551f400640 1 -- 172.21.15.18:0/3620716510 learned_addr learned my addr 172.21.15.18:0/3620716510 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.560+0000 7f5525000640 1 --2- 172.21.15.18:0/3620716510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4433570 0x55cec4431110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.560+0000 7f551f400640 1 -- 172.21.15.18:0/3620716510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec44283b0 msgr2=0x55cec4430690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.560+0000 7f551f400640 1 --2- 172.21.15.18:0/3620716510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec44283b0 0x55cec4430690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.560+0000 7f551f400640 1 -- 172.21.15.18:0/3620716510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4433570 msgr2=0x55cec4431110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.560+0000 7f551f400640 1 --2- 172.21.15.18:0/3620716510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4433570 0x55cec4431110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.561+0000 7f551f400640 1 -- 172.21.15.18:0/3620716510 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cec416d620 con 0x55cec4428cd0 2024-09-12T02:55:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.561+0000 7f5525000640 1 --2- 172.21.15.18:0/3620716510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4433570 0x55cec4431110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:55:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.561+0000 7f551f400640 1 --2- 172.21.15.18:0/3620716510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4428cd0 0x55cec4430bd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f550c009930 tx=0x7f550c0043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecf832b581b54e2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.561+0000 7f550a000640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:55:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.561+0000 7f550a000640 1 -- 172.21.15.18:0/3620716510 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c035040 con 0x55cec4428cd0 2024-09-12T02:55:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.561+0000 7f550a000640 1 -- 172.21.15.18:0/3620716510 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9650+0+0 (secure 0 0 0) 0x7f550c005450 con 0x55cec4428cd0 2024-09-12T02:55:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.561+0000 7f5529e12740 1 -- 172.21.15.18:0/3620716510 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5518003e50 con 0x55cec4428cd0 2024-09-12T02:55:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.561+0000 7f550a000640 1 -- 172.21.15.18:0/3620716510 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f550c04f050 con 0x55cec4428cd0 2024-09-12T02:55:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.561+0000 7f5529e12740 10 client.25642 fetch_fsmap learned FSMap version 49 2024-09-12T02:55:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.561+0000 7f5529e12740 1 -- 172.21.15.18:0/3620716510 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55cec4441e80 con 0x55cec4428cd0 2024-09-12T02:55:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.562+0000 7f550a000640 1 -- 172.21.15.18:0/3620716510 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5518003e50 con 0x55cec4428cd0 2024-09-12T02:55:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.562+0000 7f550a000640 1 -- 172.21.15.18:0/3620716510 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7f550c003850 con 0x55cec4428cd0 2024-09-12T02:55:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.562+0000 7f5529e12740 10 client.25642 fetch_fsmap finished waiting for FSMap version 49 2024-09-12T02:55:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.562+0000 7f5529e12740 10 client.25642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:55:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.562+0000 7f5529e12740 20 client.25642 populate_metadata read hostname 'smithi018' 2024-09-12T02:55:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.562+0000 7f5529e12740 1 --2- 172.21.15.18:0/3620716510 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55cec4443410 0x55cec4445830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.562+0000 7f5529e12740 4 client.25642 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:55:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.562+0000 7f5529e12740 1 -- 172.21.15.18:0/3620716510 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cec439b830 con 0x55cec4443410 2024-09-12T02:55:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.562+0000 7f5525000640 1 --2- 172.21.15.18:0/3620716510 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55cec4443410 0x55cec4445830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.563+0000 7f5525000640 1 --2- 172.21.15.18:0/3620716510 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55cec4443410 0x55cec4445830 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdf44498e7b9f5db server_cookie=fb8f2cbafb4a733a in_seq=0 out_seq=0 2024-09-12T02:55:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.563+0000 7f550a000640 10 client.25642 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.563+0000 7f550a000640 1 -- 172.21.15.18:0/3620716510 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cec439b830 con 0x55cec4443410 2024-09-12T02:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.563+0000 7f550a000640 10 client.25642 handle_command_reply: tid=0 2024-09-12T02:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.564+0000 7f5529e12740 1 client.25642 shutdown 2024-09-12T02:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.564+0000 7f5529e12740 1 -- 172.21.15.18:0/3620716510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4428cd0 msgr2=0x55cec4430bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.564+0000 7f5529e12740 1 --2- 172.21.15.18:0/3620716510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4428cd0 0x55cec4430bd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f550c009930 tx=0x7f550c0043b0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.564+0000 7f5529e12740 1 -- 172.21.15.18:0/3620716510 shutdown_connections 2024-09-12T02:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.564+0000 7f5529e12740 1 --2- 172.21.15.18:0/3620716510 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55cec4443410 0x55cec4445830 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.564+0000 7f5529e12740 1 --2- 172.21.15.18:0/3620716510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4433570 0x55cec4431110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.564+0000 7f5529e12740 1 --2- 172.21.15.18:0/3620716510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4428cd0 0x55cec4430bd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.564+0000 7f5529e12740 1 --2- 172.21.15.18:0/3620716510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec44283b0 0x55cec4430690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.564+0000 7f550a000640 0 client.25642 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.564+0000 7f5529e12740 1 -- 172.21.15.18:0/3620716510 >> 172.21.15.18:0/3620716510 conn(0x55cec4424920 msgr2=0x55cec442a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.564+0000 7f5529e12740 1 -- 172.21.15.18:0/3620716510 shutdown_connections 2024-09-12T02:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.564+0000 7f5529e12740 1 -- 172.21.15.18:0/3620716510 wait complete. 2024-09-12T02:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.564+0000 7f5529e12740 20 client.25642 trim_cache size 0 max 16384 2024-09-12T02:55:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.579+0000 7f5529e12740 1 Processor -- start 2024-09-12T02:55:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.579+0000 7f5529e12740 1 -- start start 2024-09-12T02:55:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.579+0000 7f5529e12740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec44283b0 0x55cec44324f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.579+0000 7f5529e12740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4428cd0 0x55cec444b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.579+0000 7f5529e12740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec4433570 0x55cec444b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.579+0000 7f5529e12740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f55201b1460 con 0x55cec4428cd0 2024-09-12T02:55:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.579+0000 7f5529e12740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f55201b3150 con 0x55cec4433570 2024-09-12T02:55:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.579+0000 7f5529e12740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f55201b1b60 con 0x55cec44283b0 2024-09-12T02:55:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.580+0000 7f551f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4428cd0 0x55cec444b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.580+0000 7f551f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4428cd0 0x55cec444b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59106/0 (socket says 172.21.15.18:59106) 2024-09-12T02:55:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.580+0000 7f551f400640 1 -- 172.21.15.18:0/3300578720 learned_addr learned my addr 172.21.15.18:0/3300578720 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.580+0000 7f5525000640 1 --2- 172.21.15.18:0/3300578720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec4433570 0x55cec444b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.580+0000 7f5525000640 1 --2- 172.21.15.18:0/3300578720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec44283b0 0x55cec44324f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.580+0000 7f551f400640 1 -- 172.21.15.18:0/3300578720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec44283b0 msgr2=0x55cec44324f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.580+0000 7f551f400640 1 --2- 172.21.15.18:0/3300578720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec44283b0 0x55cec44324f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.580+0000 7f551f400640 1 -- 172.21.15.18:0/3300578720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec4433570 msgr2=0x55cec444b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.580+0000 7f551f400640 1 --2- 172.21.15.18:0/3300578720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec4433570 0x55cec444b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.580+0000 7f551f400640 1 -- 172.21.15.18:0/3300578720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec4445e90 con 0x55cec4428cd0 2024-09-12T02:55:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.580+0000 7f5525000640 1 --2- 172.21.15.18:0/3300578720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec4433570 0x55cec444b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:55:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.580+0000 7f551f400640 1 --2- 172.21.15.18:0/3300578720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4428cd0 0x55cec444b100 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f550c003c20 tx=0x7f550c003fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955fdbd7bb377934 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.580+0000 7f5514c00640 1 -- 172.21.15.18:0/3300578720 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c035030 con 0x55cec4428cd0 2024-09-12T02:55:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.581+0000 7f5514c00640 1 -- 172.21.15.18:0/3300578720 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f550c041070 con 0x55cec4428cd0 2024-09-12T02:55:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.581+0000 7f5514c00640 1 -- 172.21.15.18:0/3300578720 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c0037e0 con 0x55cec4428cd0 2024-09-12T02:55:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.581+0000 7f5529e12740 1 -- 172.21.15.18:0/3300578720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4428cd0 msgr2=0x55cec444b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.581+0000 7f5529e12740 1 --2- 172.21.15.18:0/3300578720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4428cd0 0x55cec444b100 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f550c003c20 tx=0x7f550c003fc0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.581+0000 7f5529e12740 1 -- 172.21.15.18:0/3300578720 shutdown_connections 2024-09-12T02:55:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.581+0000 7f5529e12740 1 --2- 172.21.15.18:0/3300578720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec4433570 0x55cec444b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.581+0000 7f5529e12740 1 --2- 172.21.15.18:0/3300578720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec4428cd0 0x55cec444b100 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.581+0000 7f5529e12740 1 --2- 172.21.15.18:0/3300578720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec44283b0 0x55cec44324f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.581+0000 7f5529e12740 1 -- 172.21.15.18:0/3300578720 >> 172.21.15.18:0/3300578720 conn(0x55cec4424920 msgr2=0x55cec4431de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.581+0000 7f5529e12740 1 -- 172.21.15.18:0/3300578720 shutdown_connections 2024-09-12T02:55:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.581+0000 7f5529e12740 1 -- 172.21.15.18:0/3300578720 wait complete. 2024-09-12T02:55:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.582+0000 7f5529e12740 1 -- start start 2024-09-12T02:55:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.582+0000 7f5529e12740 1 Processor -- start 2024-09-12T02:55:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.582+0000 7f5529e12740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec44283b0 0x55cec442d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.582+0000 7f5529e12740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec4428cd0 0x55cec442dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.582+0000 7f5529e12740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4433570 0x55cec442e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.582+0000 7f5529e12740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f55201b29c0 con 0x55cec44283b0 2024-09-12T02:55:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.582+0000 7f5529e12740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f55201b2230 con 0x55cec4428cd0 2024-09-12T02:55:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.582+0000 7f5529e12740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f55201af460 con 0x55cec4433570 2024-09-12T02:55:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.582+0000 7f5529e12740 10 client.0 _ll_register_callbacks cb 0x7f550c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:55:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.582+0000 7f5525000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec44283b0 0x55cec442d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.582+0000 7f551f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec4428cd0 0x55cec442dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.583+0000 7f551f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec4428cd0 0x55cec442dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:36364/0 (socket says 172.21.15.18:36364) 2024-09-12T02:55:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.583+0000 7f551f400640 1 -- 172.21.15.18:0/1908800283 learned_addr learned my addr 172.21.15.18:0/1908800283 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.583+0000 7f5525000640 1 --2- 172.21.15.18:0/1908800283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4433570 0x55cec442e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.583+0000 7f551f400640 1 -- 172.21.15.18:0/1908800283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4433570 msgr2=0x55cec442e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.583+0000 7f551f400640 1 --2- 172.21.15.18:0/1908800283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4433570 0x55cec442e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.583+0000 7f551f400640 1 -- 172.21.15.18:0/1908800283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec44283b0 msgr2=0x55cec442d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.583+0000 7f551f400640 1 --2- 172.21.15.18:0/1908800283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec44283b0 0x55cec442d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.583+0000 7f551f400640 1 -- 172.21.15.18:0/1908800283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cec44ad2d0 con 0x55cec4428cd0 2024-09-12T02:55:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.583+0000 7f5525000640 1 --2- 172.21.15.18:0/1908800283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4433570 0x55cec442e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:55:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.583+0000 7f551f400640 1 --2- 172.21.15.18:0/1908800283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec4428cd0 0x55cec442dde0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f550c003d10 tx=0x7f550c005480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5df6a6606070e060 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.583+0000 7f550a000640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:55:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.583+0000 7f550a000640 1 -- 172.21.15.18:0/1908800283 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c035030 con 0x55cec4428cd0 2024-09-12T02:55:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.583+0000 7f5529e12740 1 -- 172.21.15.18:0/1908800283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f550c041070 con 0x55cec4428cd0 2024-09-12T02:55:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.583+0000 7f550a000640 1 -- 172.21.15.18:0/1908800283 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9650+0+0 (secure 0 0 0) 0x7f550c059040 con 0x55cec4428cd0 2024-09-12T02:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.584+0000 7f550a000640 1 -- 172.21.15.18:0/1908800283 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f550c065050 con 0x55cec4428cd0 2024-09-12T02:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.584+0000 7f5529e12740 10 client.25643 fetch_fsmap learned FSMap version 49 2024-09-12T02:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.584+0000 7f5529e12740 1 -- 172.21.15.18:0/1908800283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55cec44ae5c0 con 0x55cec4428cd0 2024-09-12T02:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.584+0000 7f550a000640 1 -- 172.21.15.18:0/1908800283 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f550c041070 con 0x55cec4428cd0 2024-09-12T02:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.584+0000 7f550a000640 1 -- 172.21.15.18:0/1908800283 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7f550c003800 con 0x55cec4428cd0 2024-09-12T02:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.584+0000 7f5529e12740 10 client.25643 fetch_fsmap finished waiting for FSMap version 49 2024-09-12T02:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.584+0000 7f5529e12740 10 client.25643 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.584+0000 7f5529e12740 20 client.25643 populate_metadata read hostname 'smithi018' 2024-09-12T02:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.584+0000 7f5529e12740 1 --2- 172.21.15.18:0/1908800283 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55cec44aec80 0x55cec44b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.584+0000 7f5529e12740 4 client.25643 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.584+0000 7f5529e12740 1 -- 172.21.15.18:0/1908800283 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cec4395b80 con 0x55cec44aec80 2024-09-12T02:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.584+0000 7f5525000640 1 --2- 172.21.15.18:0/1908800283 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55cec44aec80 0x55cec44b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.585+0000 7f5525000640 1 --2- 172.21.15.18:0/1908800283 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55cec44aec80 0x55cec44b10a0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52969d58720f2065 server_cookie=5a1e212077aa97ee in_seq=0 out_seq=0 2024-09-12T02:55:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.585+0000 7f550a000640 10 client.25643 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:55:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.786+0000 7f550a000640 1 -- 172.21.15.18:0/1908800283 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cec4395b80 con 0x55cec44aec80 2024-09-12T02:55:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.786+0000 7f550a000640 10 client.25643 handle_command_reply: tid=0 2024-09-12T02:55:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.786+0000 7f5529e12740 1 client.25643 shutdown 2024-09-12T02:55:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.786+0000 7f5529e12740 1 -- 172.21.15.18:0/1908800283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec4428cd0 msgr2=0x55cec442dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.786+0000 7f5529e12740 1 --2- 172.21.15.18:0/1908800283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec4428cd0 0x55cec442dde0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f550c003d10 tx=0x7f550c005480 comp rx=0 tx=0).stop 2024-09-12T02:55:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.786+0000 7f5529e12740 1 -- 172.21.15.18:0/1908800283 shutdown_connections 2024-09-12T02:55:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.786+0000 7f5529e12740 1 --2- 172.21.15.18:0/1908800283 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55cec44aec80 0x55cec44b10a0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.786+0000 7f5529e12740 1 --2- 172.21.15.18:0/1908800283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cec4433570 0x55cec442e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.786+0000 7f5529e12740 1 --2- 172.21.15.18:0/1908800283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cec4428cd0 0x55cec442dde0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.786+0000 7f5529e12740 1 --2- 172.21.15.18:0/1908800283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cec44283b0 0x55cec442d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.786+0000 7f5529e12740 1 -- 172.21.15.18:0/1908800283 >> 172.21.15.18:0/1908800283 conn(0x55cec4424920 msgr2=0x55cec44239c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.786+0000 7f550a000640 0 client.25643 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:55:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.787+0000 7f5529e12740 1 -- 172.21.15.18:0/1908800283 shutdown_connections 2024-09-12T02:55:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.787+0000 7f5529e12740 1 -- 172.21.15.18:0/1908800283 wait complete. 2024-09-12T02:55:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.787+0000 7f5529e12740 20 client.25643 trim_cache size 0 max 16384 2024-09-12T02:55:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:55:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:55:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:55:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:55:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.788+0000 7f5525a00640 1 -- 172.21.15.18:0/1288260950 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f55040a2cf0 msgr2=0x7f55040a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.788+0000 7f5525a00640 1 --2- 172.21.15.18:0/1288260950 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f55040a2cf0 0x7f55040a51b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55cec4425780 tx=0x7f5510018420 comp rx=0 tx=0).stop 2024-09-12T02:55:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.788+0000 7f5525a00640 1 -- 172.21.15.18:0/1288260950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5520103ae0 msgr2=0x7f552019a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.788+0000 7f5525a00640 1 --2- 172.21.15.18:0/1288260950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5520103ae0 0x7f552019a4b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f551000e9f0 tx=0x7f551000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.788+0000 7f5525a00640 1 -- 172.21.15.18:0/1288260950 shutdown_connections 2024-09-12T02:55:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.788+0000 7f5525a00640 1 --2- 172.21.15.18:0/1288260950 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f55040a2cf0 0x7f55040a51b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.788+0000 7f5525a00640 1 --2- 172.21.15.18:0/1288260950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5520109b80 0x7f552019ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.788+0000 7f5525a00640 1 --2- 172.21.15.18:0/1288260950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5520104480 0x7f552019a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.788+0000 7f5525a00640 1 --2- 172.21.15.18:0/1288260950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5520103ae0 0x7f552019a4b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.788+0000 7f5525a00640 1 -- 172.21.15.18:0/1288260950 >> 172.21.15.18:0/1288260950 conn(0x7f55200ff7c0 msgr2=0x7f55201000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.789+0000 7f5525a00640 1 -- 172.21.15.18:0/1288260950 shutdown_connections 2024-09-12T02:55:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:31.789+0000 7f5525a00640 1 -- 172.21.15.18:0/1288260950 wait complete. 2024-09-12T02:55:33.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:32 smithi176 ceph-mon[35713]: pgmap v208: 129 pgs: 6 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 112 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.1 MiB/s wr, 265 op/s 2024-09-12T02:55:33.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:32 smithi062 ceph-mon[35527]: pgmap v208: 129 pgs: 6 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 112 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.1 MiB/s wr, 265 op/s 2024-09-12T02:55:33.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:32 smithi018 ceph-mon[30616]: pgmap v208: 129 pgs: 6 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 112 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.1 MiB/s wr, 265 op/s 2024-09-12T02:55:35.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:34 smithi176 ceph-mon[35713]: pgmap v209: 129 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 113 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.3 MiB/s wr, 280 op/s 2024-09-12T02:55:35.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:34 smithi062 ceph-mon[35527]: pgmap v209: 129 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 113 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.3 MiB/s wr, 280 op/s 2024-09-12T02:55:35.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:34 smithi018 ceph-mon[30616]: pgmap v209: 129 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 113 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.3 MiB/s wr, 280 op/s 2024-09-12T02:55:37.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:36 smithi176 ceph-mon[35713]: pgmap v210: 129 pgs: 129 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.9 MiB/s wr, 299 op/s 2024-09-12T02:55:37.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:36 smithi176 ceph-mon[35713]: osdmap e101: 12 total, 12 up, 12 in 2024-09-12T02:55:37.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:36 smithi062 ceph-mon[35527]: pgmap v210: 129 pgs: 129 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.9 MiB/s wr, 299 op/s 2024-09-12T02:55:37.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:36 smithi062 ceph-mon[35527]: osdmap e101: 12 total, 12 up, 12 in 2024-09-12T02:55:37.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:36 smithi018 ceph-mon[30616]: pgmap v210: 129 pgs: 129 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.9 MiB/s wr, 299 op/s 2024-09-12T02:55:37.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:36 smithi018 ceph-mon[30616]: osdmap e101: 12 total, 12 up, 12 in 2024-09-12T02:55:39.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:38 smithi176 ceph-mon[35713]: pgmap v212: 129 pgs: 129 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 238 op/s 2024-09-12T02:55:39.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:38 smithi062 ceph-mon[35527]: pgmap v212: 129 pgs: 129 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 238 op/s 2024-09-12T02:55:39.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:38 smithi018 ceph-mon[30616]: pgmap v212: 129 pgs: 129 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 238 op/s 2024-09-12T02:55:41.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:40 smithi176 ceph-mon[35713]: pgmap v213: 129 pgs: 129 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 185 op/s 2024-09-12T02:55:41.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:40 smithi062 ceph-mon[35527]: pgmap v213: 129 pgs: 129 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 185 op/s 2024-09-12T02:55:41.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:40 smithi018 ceph-mon[30616]: pgmap v213: 129 pgs: 129 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 185 op/s 2024-09-12T02:55:43.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:42 smithi176 ceph-mon[35713]: pgmap v214: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 152 op/s 2024-09-12T02:55:43.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:42 smithi062 ceph-mon[35527]: pgmap v214: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 152 op/s 2024-09-12T02:55:43.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:42 smithi018 ceph-mon[30616]: pgmap v214: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 152 op/s 2024-09-12T02:55:44.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.924+0000 7f1c66000640 1 -- 172.21.15.18:0/434777309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c60103f30 msgr2=0x7f1c60104310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:44.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.924+0000 7f1c66000640 1 --2- 172.21.15.18:0/434777309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c60103f30 0x7f1c60104310 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1c50009900 tx=0x7f1c5002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.924+0000 7f1c66000640 1 -- 172.21.15.18:0/434777309 shutdown_connections 2024-09-12T02:55:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.924+0000 7f1c66000640 1 --2- 172.21.15.18:0/434777309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c60109080 0x7f1c60110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.924+0000 7f1c66000640 1 --2- 172.21.15.18:0/434777309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c601048e0 0x7f1c60108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.924+0000 7f1c66000640 1 --2- 172.21.15.18:0/434777309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c60103f30 0x7f1c60104310 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.924+0000 7f1c66000640 1 -- 172.21.15.18:0/434777309 >> 172.21.15.18:0/434777309 conn(0x7f1c600ff980 msgr2=0x7f1c60101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.924+0000 7f1c66000640 1 -- 172.21.15.18:0/434777309 shutdown_connections 2024-09-12T02:55:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.924+0000 7f1c66000640 1 -- 172.21.15.18:0/434777309 wait complete. 2024-09-12T02:55:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.925+0000 7f1c66000640 1 Processor -- start 2024-09-12T02:55:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.925+0000 7f1c66000640 1 -- start start 2024-09-12T02:55:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.925+0000 7f1c66000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c60103f30 0x7f1c6019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.925+0000 7f1c66000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c60109080 0x7f1c6019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.926+0000 7f1c66000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c6019ee80 0x7f1c6019f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.926+0000 7f1c66000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1c60114110 con 0x7f1c60109080 2024-09-12T02:55:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.926+0000 7f1c66000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1c60113f90 con 0x7f1c60103f30 2024-09-12T02:55:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.926+0000 7f1c66000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1c60114290 con 0x7f1c6019ee80 2024-09-12T02:55:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.926+0000 7f1c57e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c60109080 0x7f1c6019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.926+0000 7f1c57e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c60109080 0x7f1c6019ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37604/0 (socket says 172.21.15.18:37604) 2024-09-12T02:55:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.926+0000 7f1c57e00640 1 -- 172.21.15.18:0/4020106378 learned_addr learned my addr 172.21.15.18:0/4020106378 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.926+0000 7f1c5f400640 1 --2- 172.21.15.18:0/4020106378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c60103f30 0x7f1c6019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.926+0000 7f1c5fe00640 1 --2- 172.21.15.18:0/4020106378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c6019ee80 0x7f1c6019f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.926+0000 7f1c57e00640 1 -- 172.21.15.18:0/4020106378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c6019ee80 msgr2=0x7f1c6019f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.926+0000 7f1c57e00640 1 --2- 172.21.15.18:0/4020106378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c6019ee80 0x7f1c6019f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.926+0000 7f1c57e00640 1 -- 172.21.15.18:0/4020106378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c60103f30 msgr2=0x7f1c6019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.926+0000 7f1c57e00640 1 --2- 172.21.15.18:0/4020106378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c60103f30 0x7f1c6019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.926+0000 7f1c57e00640 1 -- 172.21.15.18:0/4020106378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6019f970 con 0x7f1c60109080 2024-09-12T02:55:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.926+0000 7f1c5fe00640 1 --2- 172.21.15.18:0/4020106378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c6019ee80 0x7f1c6019f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:55:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.927+0000 7f1c57e00640 1 --2- 172.21.15.18:0/4020106378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c60109080 0x7f1c6019ab00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1c4800e9f0 tx=0x7f1c4800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.927+0000 7f1c5cc00640 1 -- 172.21.15.18:0/4020106378 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4800ccc0 con 0x7f1c60109080 2024-09-12T02:55:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.927+0000 7f1c5cc00640 1 -- 172.21.15.18:0/4020106378 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c48005500 con 0x7f1c60109080 2024-09-12T02:55:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.927+0000 7f1c66000640 1 -- 172.21.15.18:0/4020106378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6019fc60 con 0x7f1c60109080 2024-09-12T02:55:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.927+0000 7f1c5cc00640 1 -- 172.21.15.18:0/4020106378 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48010690 con 0x7f1c60109080 2024-09-12T02:55:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.927+0000 7f1c66000640 1 -- 172.21.15.18:0/4020106378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c601a7450 con 0x7f1c60109080 2024-09-12T02:55:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.930+0000 7f1c68eca740 1 Processor -- start 2024-09-12T02:55:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.930+0000 7f1c5cc00640 1 -- 172.21.15.18:0/4020106378 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f1c480046c0 con 0x7f1c60109080 2024-09-12T02:55:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.930+0000 7f1c68eca740 1 -- start start 2024-09-12T02:55:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.931+0000 7f1c68eca740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f271e0 0x55d615f275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.931+0000 7f1c68eca740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f27b00 0x55d615f31e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.931+0000 7f1c68eca740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f323a0 0x55d615f34790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.931+0000 7f1c68eca740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d615e8d100 con 0x55d615f271e0 2024-09-12T02:55:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.931+0000 7f1c68eca740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d615e351b0 con 0x55d615f27b00 2024-09-12T02:55:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.931+0000 7f1c68eca740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d615e890c0 con 0x55d615f323a0 2024-09-12T02:55:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.931+0000 7f1c5fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f271e0 0x55d615f275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.931+0000 7f1c5fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f271e0 0x55d615f275c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37612/0 (socket says 172.21.15.18:37612) 2024-09-12T02:55:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.931+0000 7f1c5fe00640 1 -- 172.21.15.18:0/56085675 learned_addr learned my addr 172.21.15.18:0/56085675 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.931+0000 7f1c57e00640 1 --2- 172.21.15.18:0/56085675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f323a0 0x55d615f34790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.931+0000 7f1c5f400640 1 --2- 172.21.15.18:0/56085675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f27b00 0x55d615f31e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.931+0000 7f1c5fe00640 1 -- 172.21.15.18:0/56085675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f323a0 msgr2=0x55d615f34790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.931+0000 7f1c5fe00640 1 --2- 172.21.15.18:0/56085675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f323a0 0x55d615f34790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.932+0000 7f1c5fe00640 1 -- 172.21.15.18:0/56085675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f27b00 msgr2=0x55d615f31e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.932+0000 7f1c5fe00640 1 --2- 172.21.15.18:0/56085675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f27b00 0x55d615f31e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.932+0000 7f1c5fe00640 1 -- 172.21.15.18:0/56085675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d615ba0210 con 0x55d615f271e0 2024-09-12T02:55:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.932+0000 7f1c5cc00640 1 --2- 172.21.15.18:0/4020106378 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1c440a2e20 0x7f1c440a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.932+0000 7f1c5fe00640 1 --2- 172.21.15.18:0/56085675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f271e0 0x55d615f275c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1c580107a0 tx=0x7f1c58010c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431ec265245f2ba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.932+0000 7f1c5cc00640 1 -- 172.21.15.18:0/4020106378 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9562+0+0 (secure 0 0 0) 0x7f1c480cfb90 con 0x7f1c60109080 2024-09-12T02:55:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.932+0000 7f1c4fe00640 1 -- 172.21.15.18:0/56085675 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c58003b70 con 0x55d615f271e0 2024-09-12T02:55:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.932+0000 7f1c5f400640 1 --2- 172.21.15.18:0/4020106378 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1c440a2e20 0x7f1c440a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.932+0000 7f1c4fe00640 1 -- 172.21.15.18:0/56085675 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c58010e50 con 0x55d615f271e0 2024-09-12T02:55:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.932+0000 7f1c4fe00640 1 -- 172.21.15.18:0/56085675 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c58004730 con 0x55d615f271e0 2024-09-12T02:55:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.933+0000 7f1c68eca740 1 -- 172.21.15.18:0/56085675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f271e0 msgr2=0x55d615f275c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.933+0000 7f1c68eca740 1 --2- 172.21.15.18:0/56085675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f271e0 0x55d615f275c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1c580107a0 tx=0x7f1c58010c60 comp rx=0 tx=0).stop 2024-09-12T02:55:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.933+0000 7f1c5f400640 1 --2- 172.21.15.18:0/4020106378 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1c440a2e20 0x7f1c440a52e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1c50000c00 tx=0x7f1c50005b50 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.933+0000 7f1c68eca740 1 -- 172.21.15.18:0/56085675 shutdown_connections 2024-09-12T02:55:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.933+0000 7f1c68eca740 1 --2- 172.21.15.18:0/56085675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f323a0 0x55d615f34790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.933+0000 7f1c68eca740 1 --2- 172.21.15.18:0/56085675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f27b00 0x55d615f31e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.933+0000 7f1c68eca740 1 --2- 172.21.15.18:0/56085675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f271e0 0x55d615f275c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.933+0000 7f1c68eca740 1 -- 172.21.15.18:0/56085675 >> 172.21.15.18:0/56085675 conn(0x55d615f23750 msgr2=0x55d615f23b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.933+0000 7f1c68eca740 1 -- 172.21.15.18:0/56085675 shutdown_connections 2024-09-12T02:55:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.933+0000 7f1c68eca740 1 -- 172.21.15.18:0/56085675 wait complete. 2024-09-12T02:55:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.934+0000 7f1c68eca740 1 -- start start 2024-09-12T02:55:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.934+0000 7f1c68eca740 1 Processor -- start 2024-09-12T02:55:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.934+0000 7f1c68eca740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f271e0 0x55d615f2f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.934+0000 7f1c68eca740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f27b00 0x55d615f2f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.934+0000 7f1c68eca740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f323a0 0x55d615f2fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.934+0000 7f1c68eca740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d615f34f70 con 0x55d615f271e0 2024-09-12T02:55:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.934+0000 7f1c68eca740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d615e16090 con 0x55d615f27b00 2024-09-12T02:55:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.934+0000 7f1c68eca740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d615f350f0 con 0x55d615f323a0 2024-09-12T02:55:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.934+0000 7f1c68eca740 10 client.0 _ll_register_callbacks cb 0x55d615e6af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:55:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.935+0000 7f1c5f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f271e0 0x55d615f2f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.935+0000 7f1c5f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f271e0 0x55d615f2f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37628/0 (socket says 172.21.15.18:37628) 2024-09-12T02:55:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.935+0000 7f1c5f400640 1 -- 172.21.15.18:0/4236658186 learned_addr learned my addr 172.21.15.18:0/4236658186 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.935+0000 7f1c57e00640 1 --2- 172.21.15.18:0/4236658186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f27b00 0x55d615f2f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.935+0000 7f1c5fe00640 1 --2- 172.21.15.18:0/4236658186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f323a0 0x55d615f2fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.935+0000 7f1c57e00640 1 -- 172.21.15.18:0/4236658186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f323a0 msgr2=0x55d615f2fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.935+0000 7f1c57e00640 1 --2- 172.21.15.18:0/4236658186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f323a0 0x55d615f2fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.935+0000 7f1c57e00640 1 -- 172.21.15.18:0/4236658186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f271e0 msgr2=0x55d615f2f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.935+0000 7f1c57e00640 1 --2- 172.21.15.18:0/4236658186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f271e0 0x55d615f2f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.935+0000 7f1c57e00640 1 -- 172.21.15.18:0/4236658186 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d615c6c620 con 0x55d615f27b00 2024-09-12T02:55:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.935+0000 7f1c57e00640 1 --2- 172.21.15.18:0/4236658186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f27b00 0x55d615f2f860 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1c480cce70 tx=0x7f1c48009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfb34807a7b1bc24 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.935+0000 7f1c4cc00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:55:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.936+0000 7f1c4cc00640 1 -- 172.21.15.18:0/4236658186 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c480d4040 con 0x55d615f27b00 2024-09-12T02:55:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.936+0000 7f1c4cc00640 1 -- 172.21.15.18:0/4236658186 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9562+0+0 (secure 0 0 0) 0x7f1c480a4620 con 0x55d615f27b00 2024-09-12T02:55:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.936+0000 7f1c68eca740 1 -- 172.21.15.18:0/4236658186 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c58010e50 con 0x55d615f27b00 2024-09-12T02:55:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.936+0000 7f1c4cc00640 1 -- 172.21.15.18:0/4236658186 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f1c4809b5a0 con 0x55d615f27b00 2024-09-12T02:55:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.936+0000 7f1c68eca740 10 client.25655 fetch_fsmap learned FSMap version 49 2024-09-12T02:55:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.936+0000 7f1c68eca740 1 -- 172.21.15.18:0/4236658186 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55d615f40ba0 con 0x55d615f27b00 2024-09-12T02:55:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.936+0000 7f1c4cc00640 1 -- 172.21.15.18:0/4236658186 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c58010e50 con 0x55d615f27b00 2024-09-12T02:55:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.936+0000 7f1c4cc00640 1 -- 172.21.15.18:0/4236658186 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7f1c4809ab00 con 0x55d615f27b00 2024-09-12T02:55:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.937+0000 7f1c68eca740 10 client.25655 fetch_fsmap finished waiting for FSMap version 49 2024-09-12T02:55:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.937+0000 7f1c68eca740 10 client.25655 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:55:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.937+0000 7f1c68eca740 20 client.25655 populate_metadata read hostname 'smithi018' 2024-09-12T02:55:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.937+0000 7f1c68eca740 1 --2- 172.21.15.18:0/4236658186 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d615f420b0 0x55d615f444e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.937+0000 7f1c68eca740 4 client.25655 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:55:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.937+0000 7f1c68eca740 1 -- 172.21.15.18:0/4236658186 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d615e9a830 con 0x55d615f420b0 2024-09-12T02:55:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.937+0000 7f1c5f400640 1 --2- 172.21.15.18:0/4236658186 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d615f420b0 0x55d615f444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.937+0000 7f1c5f400640 1 --2- 172.21.15.18:0/4236658186 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d615f420b0 0x55d615f444e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=496e15398eafe10a server_cookie=458eaddb1e36a040 in_seq=0 out_seq=0 2024-09-12T02:55:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.937+0000 7f1c4cc00640 10 client.25655 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:55:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.938+0000 7f1c4cc00640 1 -- 172.21.15.18:0/4236658186 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d615e9a830 con 0x55d615f420b0 2024-09-12T02:55:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.938+0000 7f1c4cc00640 10 client.25655 handle_command_reply: tid=0 2024-09-12T02:55:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.938+0000 7f1c68eca740 1 client.25655 shutdown 2024-09-12T02:55:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.938+0000 7f1c68eca740 1 -- 172.21.15.18:0/4236658186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f27b00 msgr2=0x55d615f2f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.938+0000 7f1c68eca740 1 --2- 172.21.15.18:0/4236658186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f27b00 0x55d615f2f860 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1c480cce70 tx=0x7f1c48009780 comp rx=0 tx=0).stop 2024-09-12T02:55:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.939+0000 7f1c68eca740 1 -- 172.21.15.18:0/4236658186 shutdown_connections 2024-09-12T02:55:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.939+0000 7f1c68eca740 1 --2- 172.21.15.18:0/4236658186 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d615f420b0 0x55d615f444e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.939+0000 7f1c68eca740 1 --2- 172.21.15.18:0/4236658186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f323a0 0x55d615f2fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.939+0000 7f1c4cc00640 0 client.25655 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:55:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.939+0000 7f1c68eca740 1 --2- 172.21.15.18:0/4236658186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f27b00 0x55d615f2f860 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.939+0000 7f1c68eca740 1 --2- 172.21.15.18:0/4236658186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f271e0 0x55d615f2f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.939+0000 7f1c68eca740 1 -- 172.21.15.18:0/4236658186 >> 172.21.15.18:0/4236658186 conn(0x55d615f23750 msgr2=0x55d615f294b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.939+0000 7f1c68eca740 1 -- 172.21.15.18:0/4236658186 shutdown_connections 2024-09-12T02:55:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.939+0000 7f1c68eca740 1 -- 172.21.15.18:0/4236658186 wait complete. 2024-09-12T02:55:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.939+0000 7f1c68eca740 20 client.25655 trim_cache size 0 max 16384 2024-09-12T02:55:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.954+0000 7f1c68eca740 1 Processor -- start 2024-09-12T02:55:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.954+0000 7f1c68eca740 1 -- start start 2024-09-12T02:55:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.954+0000 7f1c68eca740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f271e0 0x55d615f29ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.955+0000 7f1c68eca740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f27b00 0x55d615f22720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.955+0000 7f1c68eca740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f323a0 0x55d615f49db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.955+0000 7f1c68eca740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1c601b12d0 con 0x55d615f27b00 2024-09-12T02:55:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.955+0000 7f1c68eca740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1c601b2fc0 con 0x55d615f323a0 2024-09-12T02:55:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.955+0000 7f1c68eca740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1c601b19d0 con 0x55d615f271e0 2024-09-12T02:55:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.955+0000 7f1c57e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f27b00 0x55d615f22720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.955+0000 7f1c5f400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f271e0 0x55d615f29ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.955+0000 7f1c57e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f27b00 0x55d615f22720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37634/0 (socket says 172.21.15.18:37634) 2024-09-12T02:55:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.955+0000 7f1c57e00640 1 -- 172.21.15.18:0/1230658144 learned_addr learned my addr 172.21.15.18:0/1230658144 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.955+0000 7f1c5fe00640 1 --2- 172.21.15.18:0/1230658144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f323a0 0x55d615f49db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.955+0000 7f1c57e00640 1 -- 172.21.15.18:0/1230658144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f271e0 msgr2=0x55d615f29ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.955+0000 7f1c57e00640 1 --2- 172.21.15.18:0/1230658144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f271e0 0x55d615f29ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.955+0000 7f1c57e00640 1 -- 172.21.15.18:0/1230658144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f323a0 msgr2=0x55d615f49db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.955+0000 7f1c57e00640 1 --2- 172.21.15.18:0/1230658144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f323a0 0x55d615f49db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.955+0000 7f1c57e00640 1 -- 172.21.15.18:0/1230658144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d615f1ed60 con 0x55d615f27b00 2024-09-12T02:55:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.955+0000 7f1c5f400640 1 --2- 172.21.15.18:0/1230658144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f271e0 0x55d615f29ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:55:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.955+0000 7f1c5fe00640 1 --2- 172.21.15.18:0/1230658144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f323a0 0x55d615f49db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:55:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.956+0000 7f1c57e00640 1 --2- 172.21.15.18:0/1230658144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f27b00 0x55d615f22720 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1c480097f0 tx=0x7f1c48009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99abfd2e6e48641d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.956+0000 7f1c4f400640 1 -- 172.21.15.18:0/1230658144 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c480b9070 con 0x55d615f27b00 2024-09-12T02:55:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.956+0000 7f1c4f400640 1 -- 172.21.15.18:0/1230658144 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c48086050 con 0x55d615f27b00 2024-09-12T02:55:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.956+0000 7f1c4f400640 1 -- 172.21.15.18:0/1230658144 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c480cd300 con 0x55d615f27b00 2024-09-12T02:55:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.956+0000 7f1c68eca740 1 -- 172.21.15.18:0/1230658144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f27b00 msgr2=0x55d615f22720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.956+0000 7f1c68eca740 1 --2- 172.21.15.18:0/1230658144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f27b00 0x55d615f22720 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1c480097f0 tx=0x7f1c48009310 comp rx=0 tx=0).stop 2024-09-12T02:55:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.956+0000 7f1c68eca740 1 -- 172.21.15.18:0/1230658144 shutdown_connections 2024-09-12T02:55:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.956+0000 7f1c68eca740 1 --2- 172.21.15.18:0/1230658144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f323a0 0x55d615f49db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.956+0000 7f1c68eca740 1 --2- 172.21.15.18:0/1230658144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f27b00 0x55d615f22720 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.956+0000 7f1c68eca740 1 --2- 172.21.15.18:0/1230658144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f271e0 0x55d615f29ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.956+0000 7f1c68eca740 1 -- 172.21.15.18:0/1230658144 >> 172.21.15.18:0/1230658144 conn(0x55d615f23750 msgr2=0x55d615f22010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.957+0000 7f1c68eca740 1 -- 172.21.15.18:0/1230658144 shutdown_connections 2024-09-12T02:55:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.957+0000 7f1c68eca740 1 -- 172.21.15.18:0/1230658144 wait complete. 2024-09-12T02:55:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.957+0000 7f1c68eca740 1 -- start start 2024-09-12T02:55:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.957+0000 7f1c68eca740 1 Processor -- start 2024-09-12T02:55:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c68eca740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f271e0 0x55d615f3a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c68eca740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f27b00 0x55d615f35af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c68eca740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f323a0 0x55d615f36030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c68eca740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1c601b2830 con 0x55d615f27b00 2024-09-12T02:55:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c68eca740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1c601b20a0 con 0x55d615f323a0 2024-09-12T02:55:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c68eca740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1c601af2d0 con 0x55d615f271e0 2024-09-12T02:55:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c68eca740 10 client.0 _ll_register_callbacks cb 0x7f1c4800ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:55:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c57e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f27b00 0x55d615f35af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c57e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f27b00 0x55d615f35af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37638/0 (socket says 172.21.15.18:37638) 2024-09-12T02:55:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c57e00640 1 -- 172.21.15.18:0/61562322 learned_addr learned my addr 172.21.15.18:0/61562322 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c5f400640 1 --2- 172.21.15.18:0/61562322 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f271e0 0x55d615f3a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c5fe00640 1 --2- 172.21.15.18:0/61562322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f323a0 0x55d615f36030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c57e00640 1 -- 172.21.15.18:0/61562322 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f271e0 msgr2=0x55d615f3a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c57e00640 1 --2- 172.21.15.18:0/61562322 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f271e0 0x55d615f3a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c57e00640 1 -- 172.21.15.18:0/61562322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f323a0 msgr2=0x55d615f36030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c57e00640 1 --2- 172.21.15.18:0/61562322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f323a0 0x55d615f36030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c57e00640 1 -- 172.21.15.18:0/61562322 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d615f36570 con 0x55d615f27b00 2024-09-12T02:55:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.958+0000 7f1c5fe00640 1 --2- 172.21.15.18:0/61562322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f323a0 0x55d615f36030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:55:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.959+0000 7f1c57e00640 1 --2- 172.21.15.18:0/61562322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f27b00 0x55d615f35af0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1c4809b020 tx=0x7f1c4809c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5abef2adf2feef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.959+0000 7f1c4cc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:55:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.959+0000 7f1c4cc00640 1 -- 172.21.15.18:0/61562322 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c480b9050 con 0x55d615f27b00 2024-09-12T02:55:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.959+0000 7f1c4cc00640 1 -- 172.21.15.18:0/61562322 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9562+0+0 (secure 0 0 0) 0x7f1c480a4620 con 0x55d615f27b00 2024-09-12T02:55:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.959+0000 7f1c68eca740 1 -- 172.21.15.18:0/61562322 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c48086050 con 0x55d615f27b00 2024-09-12T02:55:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.959+0000 7f1c4cc00640 1 -- 172.21.15.18:0/61562322 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f1c480056b0 con 0x55d615f27b00 2024-09-12T02:55:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.959+0000 7f1c68eca740 10 client.15672 fetch_fsmap learned FSMap version 49 2024-09-12T02:55:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.959+0000 7f1c68eca740 1 -- 172.21.15.18:0/61562322 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55d615faca80 con 0x55d615f27b00 2024-09-12T02:55:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.959+0000 7f1c4cc00640 1 -- 172.21.15.18:0/61562322 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c48086050 con 0x55d615f27b00 2024-09-12T02:55:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.959+0000 7f1c4cc00640 1 -- 172.21.15.18:0/61562322 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7f1c480a1180 con 0x55d615f27b00 2024-09-12T02:55:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.960+0000 7f1c68eca740 10 client.15672 fetch_fsmap finished waiting for FSMap version 49 2024-09-12T02:55:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.960+0000 7f1c68eca740 10 client.15672 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:55:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.960+0000 7f1c68eca740 20 client.15672 populate_metadata read hostname 'smithi018' 2024-09-12T02:55:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.960+0000 7f1c68eca740 1 --2- 172.21.15.18:0/61562322 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d615facf90 0x55d615faf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.960+0000 7f1c68eca740 4 client.15672 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:55:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.960+0000 7f1c68eca740 1 -- 172.21.15.18:0/61562322 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d615e94b80 con 0x55d615facf90 2024-09-12T02:55:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.960+0000 7f1c5f400640 1 --2- 172.21.15.18:0/61562322 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d615facf90 0x55d615faf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.962+0000 7f1c5f400640 1 --2- 172.21.15.18:0/61562322 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d615facf90 0x55d615faf3b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c41173699b1db29a server_cookie=ab69fdcbc9853c57 in_seq=0 out_seq=0 2024-09-12T02:55:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:44.962+0000 7f1c4cc00640 10 client.15672 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:55:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.043+0000 7f1c4cc00640 1 -- 172.21.15.18:0/61562322 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d615e94b80 con 0x55d615facf90 2024-09-12T02:55:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.043+0000 7f1c4cc00640 10 client.15672 handle_command_reply: tid=0 2024-09-12T02:55:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.043+0000 7f1c68eca740 1 client.15672 shutdown 2024-09-12T02:55:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.043+0000 7f1c68eca740 1 -- 172.21.15.18:0/61562322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f27b00 msgr2=0x55d615f35af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.043+0000 7f1c68eca740 1 --2- 172.21.15.18:0/61562322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f27b00 0x55d615f35af0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1c4809b020 tx=0x7f1c4809c480 comp rx=0 tx=0).stop 2024-09-12T02:55:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.044+0000 7f1c68eca740 1 -- 172.21.15.18:0/61562322 shutdown_connections 2024-09-12T02:55:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.044+0000 7f1c68eca740 1 --2- 172.21.15.18:0/61562322 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d615facf90 0x55d615faf3b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.044+0000 7f1c68eca740 1 --2- 172.21.15.18:0/61562322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d615f323a0 0x55d615f36030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.044+0000 7f1c68eca740 1 --2- 172.21.15.18:0/61562322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d615f27b00 0x55d615f35af0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.044+0000 7f1c68eca740 1 --2- 172.21.15.18:0/61562322 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d615f271e0 0x55d615f3a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.044+0000 7f1c4cc00640 0 client.15672 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:55:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.044+0000 7f1c68eca740 1 -- 172.21.15.18:0/61562322 >> 172.21.15.18:0/61562322 conn(0x55d615f23750 msgr2=0x55d615f2fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.044+0000 7f1c68eca740 1 -- 172.21.15.18:0/61562322 shutdown_connections 2024-09-12T02:55:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.044+0000 7f1c68eca740 1 -- 172.21.15.18:0/61562322 wait complete. 2024-09-12T02:55:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.044+0000 7f1c68eca740 20 client.15672 trim_cache size 0 max 16384 2024-09-12T02:55:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:55:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:55:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:55:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:55:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.045+0000 7f1c66000640 1 -- 172.21.15.18:0/4020106378 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1c440a2e20 msgr2=0x7f1c440a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.045+0000 7f1c66000640 1 --2- 172.21.15.18:0/4020106378 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1c440a2e20 0x7f1c440a52e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1c50000c00 tx=0x7f1c50005b50 comp rx=0 tx=0).stop 2024-09-12T02:55:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.045+0000 7f1c66000640 1 -- 172.21.15.18:0/4020106378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c60109080 msgr2=0x7f1c6019ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.045+0000 7f1c66000640 1 --2- 172.21.15.18:0/4020106378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c60109080 0x7f1c6019ab00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1c4800e9f0 tx=0x7f1c4800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:55:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.045+0000 7f1c66000640 1 -- 172.21.15.18:0/4020106378 shutdown_connections 2024-09-12T02:55:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.045+0000 7f1c66000640 1 --2- 172.21.15.18:0/4020106378 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1c440a2e20 0x7f1c440a52e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.045+0000 7f1c66000640 1 --2- 172.21.15.18:0/4020106378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c6019ee80 0x7f1c6019f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.045+0000 7f1c66000640 1 --2- 172.21.15.18:0/4020106378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c60109080 0x7f1c6019ab00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.045+0000 7f1c66000640 1 --2- 172.21.15.18:0/4020106378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c60103f30 0x7f1c6019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.045+0000 7f1c66000640 1 -- 172.21.15.18:0/4020106378 >> 172.21.15.18:0/4020106378 conn(0x7f1c600ff980 msgr2=0x7f1c60100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.045+0000 7f1c66000640 1 -- 172.21.15.18:0/4020106378 shutdown_connections 2024-09-12T02:55:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:45.045+0000 7f1c66000640 1 -- 172.21.15.18:0/4020106378 wait complete. 2024-09-12T02:55:45.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:44 smithi176 ceph-mon[35713]: pgmap v215: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.5 MiB/s wr, 122 op/s 2024-09-12T02:55:45.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:44 smithi062 ceph-mon[35527]: pgmap v215: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.5 MiB/s wr, 122 op/s 2024-09-12T02:55:45.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:44 smithi018 ceph-mon[30616]: pgmap v215: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.5 MiB/s wr, 122 op/s 2024-09-12T02:55:46.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:45 smithi176 ceph-mon[35713]: pgmap v216: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 64 op/s 2024-09-12T02:55:46.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:45 smithi062 ceph-mon[35527]: pgmap v216: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 64 op/s 2024-09-12T02:55:46.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:45 smithi018 ceph-mon[30616]: pgmap v216: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 64 op/s 2024-09-12T02:55:47.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:46 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:55:47.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:46 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:55:47.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:46 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:55:47.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:46 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:55:47.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:46 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:55:47.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:46 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:55:47.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:46 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:55:47.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:46 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:55:47.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:46 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:55:47.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:46 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:55:47.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:46 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:55:47.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:46 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:55:48.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:47 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:55:48.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:47 smithi062 ceph-mon[35527]: pgmap v217: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 58 op/s 2024-09-12T02:55:48.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:47 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:55:48.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:47 smithi018 ceph-mon[30616]: pgmap v217: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 58 op/s 2024-09-12T02:55:48.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:47 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:55:48.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:47 smithi176 ceph-mon[35713]: pgmap v217: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 58 op/s 2024-09-12T02:55:50.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:50 smithi062 ceph-mon[35527]: pgmap v218: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 77 op/s 2024-09-12T02:55:50.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:50 smithi018 ceph-mon[30616]: pgmap v218: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 77 op/s 2024-09-12T02:55:50.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:50 smithi176 ceph-mon[35713]: pgmap v218: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 77 op/s 2024-09-12T02:55:52.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:52 smithi062 ceph-mon[35527]: pgmap v219: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 78 op/s 2024-09-12T02:55:52.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:52 smithi018 ceph-mon[30616]: pgmap v219: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 78 op/s 2024-09-12T02:55:52.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:52 smithi176 ceph-mon[35713]: pgmap v219: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 78 op/s 2024-09-12T02:55:54.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:54 smithi062 ceph-mon[35527]: pgmap v220: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 73 op/s 2024-09-12T02:55:54.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:54 smithi018 ceph-mon[30616]: pgmap v220: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 73 op/s 2024-09-12T02:55:54.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:54 smithi176 ceph-mon[35713]: pgmap v220: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 73 op/s 2024-09-12T02:55:56.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:56 smithi062 ceph-mon[35527]: pgmap v221: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 96 op/s 2024-09-12T02:55:56.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:56 smithi018 ceph-mon[30616]: pgmap v221: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 96 op/s 2024-09-12T02:55:56.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:56 smithi176 ceph-mon[35713]: pgmap v221: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 96 op/s 2024-09-12T02:55:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.174+0000 7efc25e00640 1 -- 172.21.15.18:0/3828072864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc20102250 msgr2=0x7efc2010e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.174+0000 7efc25e00640 1 --2- 172.21.15.18:0/3828072864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc20102250 0x7efc2010e780 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efc18009cd0 tx=0x7efc1802a8e0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.174+0000 7efc25e00640 1 -- 172.21.15.18:0/3828072864 shutdown_connections 2024-09-12T02:55:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.174+0000 7efc25e00640 1 --2- 172.21.15.18:0/3828072864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc20102250 0x7efc2010e780 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.174+0000 7efc25e00640 1 --2- 172.21.15.18:0/3828072864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc201018b0 0x7efc20101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.174+0000 7efc25e00640 1 --2- 172.21.15.18:0/3828072864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc201078c0 0x7efc20107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.174+0000 7efc25e00640 1 -- 172.21.15.18:0/3828072864 >> 172.21.15.18:0/3828072864 conn(0x7efc200fd5d0 msgr2=0x7efc200ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.174+0000 7efc25e00640 1 -- 172.21.15.18:0/3828072864 shutdown_connections 2024-09-12T02:55:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.174+0000 7efc25e00640 1 -- 172.21.15.18:0/3828072864 wait complete. 2024-09-12T02:55:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.175+0000 7efc25e00640 1 Processor -- start 2024-09-12T02:55:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.176+0000 7efc25e00640 1 -- start start 2024-09-12T02:55:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.176+0000 7efc25e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc201018b0 0x7efc200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.176+0000 7efc25e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc20102250 0x7efc20074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.176+0000 7efc25e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc201078c0 0x7efc20074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.176+0000 7efc25e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc20111d00 con 0x7efc201018b0 2024-09-12T02:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.176+0000 7efc25e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efc20111b80 con 0x7efc20102250 2024-09-12T02:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.176+0000 7efc25e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efc20111e80 con 0x7efc201078c0 2024-09-12T02:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.176+0000 7efc24a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc201018b0 0x7efc200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.176+0000 7efc24a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc201018b0 0x7efc200744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47060/0 (socket says 172.21.15.18:47060) 2024-09-12T02:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.176+0000 7efc24a00640 1 -- 172.21.15.18:0/87598966 learned_addr learned my addr 172.21.15.18:0/87598966 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.176+0000 7efc25400640 1 --2- 172.21.15.18:0/87598966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc201078c0 0x7efc20074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.176+0000 7efc1fe00640 1 --2- 172.21.15.18:0/87598966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc20102250 0x7efc20074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.177+0000 7efc24a00640 1 -- 172.21.15.18:0/87598966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc201078c0 msgr2=0x7efc20074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.177+0000 7efc24a00640 1 --2- 172.21.15.18:0/87598966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc201078c0 0x7efc20074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.177+0000 7efc24a00640 1 -- 172.21.15.18:0/87598966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc20102250 msgr2=0x7efc20074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.177+0000 7efc24a00640 1 --2- 172.21.15.18:0/87598966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc20102250 0x7efc20074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.177+0000 7efc24a00640 1 -- 172.21.15.18:0/87598966 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc201a6710 con 0x7efc201018b0 2024-09-12T02:55:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.177+0000 7efc25400640 1 --2- 172.21.15.18:0/87598966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc201078c0 0x7efc20074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:55:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.177+0000 7efc24a00640 1 --2- 172.21.15.18:0/87598966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc201018b0 0x7efc200744f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7efc1400e9f0 tx=0x7efc1400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.177+0000 7efc1d600640 1 -- 172.21.15.18:0/87598966 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1400cd80 con 0x7efc201018b0 2024-09-12T02:55:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.177+0000 7efc1d600640 1 -- 172.21.15.18:0/87598966 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc14005500 con 0x7efc201018b0 2024-09-12T02:55:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.177+0000 7efc1d600640 1 -- 172.21.15.18:0/87598966 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14010690 con 0x7efc201018b0 2024-09-12T02:55:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.177+0000 7efc25e00640 1 -- 172.21.15.18:0/87598966 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc201a6a00 con 0x7efc201018b0 2024-09-12T02:55:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.178+0000 7efc25e00640 1 -- 172.21.15.18:0/87598966 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc201a6f00 con 0x7efc201018b0 2024-09-12T02:55:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.181+0000 7efc1d600640 1 -- 172.21.15.18:0/87598966 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7efc140046c0 con 0x7efc201018b0 2024-09-12T02:55:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.181+0000 7efc2a401740 1 Processor -- start 2024-09-12T02:55:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.181+0000 7efc2a401740 1 -- start start 2024-09-12T02:55:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.181+0000 7efc2a401740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc05790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.181+0000 7efc2a401740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc05cd0 0x56124cc10030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.181+0000 7efc2a401740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc10570 0x56124cc12960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.181+0000 7efc2a401740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56124cb6b100 con 0x56124cc053b0 2024-09-12T02:55:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.181+0000 7efc2a401740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56124cb131b0 con 0x56124cc05cd0 2024-09-12T02:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.181+0000 7efc2a401740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56124cb670c0 con 0x56124cc10570 2024-09-12T02:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.181+0000 7efc25400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc05790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.182+0000 7efc25400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc05790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47072/0 (socket says 172.21.15.18:47072) 2024-09-12T02:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.182+0000 7efc25400640 1 -- 172.21.15.18:0/3837954952 learned_addr learned my addr 172.21.15.18:0/3837954952 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.182+0000 7efc1fe00640 1 --2- 172.21.15.18:0/3837954952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc10570 0x56124cc12960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.182+0000 7efc24a00640 1 --2- 172.21.15.18:0/3837954952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc05cd0 0x56124cc10030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.182+0000 7efc25400640 1 -- 172.21.15.18:0/3837954952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc10570 msgr2=0x56124cc12960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.182+0000 7efc25400640 1 --2- 172.21.15.18:0/3837954952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc10570 0x56124cc12960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.182+0000 7efc25400640 1 -- 172.21.15.18:0/3837954952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc05cd0 msgr2=0x56124cc10030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.182+0000 7efc25400640 1 --2- 172.21.15.18:0/3837954952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc05cd0 0x56124cc10030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.182+0000 7efc25400640 1 -- 172.21.15.18:0/3837954952 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56124c87e210 con 0x56124cc053b0 2024-09-12T02:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.182+0000 7efc1d600640 1 --2- 172.21.15.18:0/87598966 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efc080a2cf0 0x7efc080a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.182+0000 7efc25400640 1 --2- 172.21.15.18:0/3837954952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc05790 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efc18009430 tx=0x7efc18009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9f57cfedff96af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.182+0000 7efc1d600640 1 -- 172.21.15.18:0/87598966 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9562+0+0 (secure 0 0 0) 0x7efc140cfd20 con 0x7efc201018b0 2024-09-12T02:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.182+0000 7efc24a00640 1 --2- 172.21.15.18:0/87598966 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efc080a2cf0 0x7efc080a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.183+0000 7efc11c00640 1 -- 172.21.15.18:0/3837954952 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc180318c0 con 0x56124cc053b0 2024-09-12T02:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.183+0000 7efc11c00640 1 -- 172.21.15.18:0/3837954952 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc18036040 con 0x56124cc053b0 2024-09-12T02:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.183+0000 7efc11c00640 1 -- 172.21.15.18:0/3837954952 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18004540 con 0x56124cc053b0 2024-09-12T02:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.183+0000 7efc2a401740 1 -- 172.21.15.18:0/3837954952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 msgr2=0x56124cc05790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.183+0000 7efc24a00640 1 --2- 172.21.15.18:0/87598966 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efc080a2cf0 0x7efc080a51b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x56124cc02780 tx=0x7efc14004a40 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.183+0000 7efc2a401740 1 --2- 172.21.15.18:0/3837954952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc05790 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efc18009430 tx=0x7efc18009a20 comp rx=0 tx=0).stop 2024-09-12T02:55:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.184+0000 7efc2a401740 1 -- 172.21.15.18:0/3837954952 shutdown_connections 2024-09-12T02:55:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.184+0000 7efc2a401740 1 --2- 172.21.15.18:0/3837954952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc10570 0x56124cc12960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.184+0000 7efc2a401740 1 --2- 172.21.15.18:0/3837954952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc05cd0 0x56124cc10030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.184+0000 7efc2a401740 1 --2- 172.21.15.18:0/3837954952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc05790 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.184+0000 7efc2a401740 1 -- 172.21.15.18:0/3837954952 >> 172.21.15.18:0/3837954952 conn(0x56124cc01920 msgr2=0x56124cc01d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.184+0000 7efc2a401740 1 -- 172.21.15.18:0/3837954952 shutdown_connections 2024-09-12T02:55:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.184+0000 7efc2a401740 1 -- 172.21.15.18:0/3837954952 wait complete. 2024-09-12T02:55:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.184+0000 7efc2a401740 1 -- start start 2024-09-12T02:55:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.184+0000 7efc2a401740 1 Processor -- start 2024-09-12T02:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.185+0000 7efc2a401740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc0d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.185+0000 7efc2a401740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc05cd0 0x56124cc0daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.185+0000 7efc2a401740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc10570 0x56124cc0e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.185+0000 7efc2a401740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56124cc130e0 con 0x56124cc053b0 2024-09-12T02:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.185+0000 7efc2a401740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56124caf4090 con 0x56124cc05cd0 2024-09-12T02:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.185+0000 7efc2a401740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56124cc13260 con 0x56124cc10570 2024-09-12T02:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.185+0000 7efc2a401740 10 client.0 _ll_register_callbacks cb 0x56124cb48f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.185+0000 7efc25400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc0d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.185+0000 7efc25400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc0d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47074/0 (socket says 172.21.15.18:47074) 2024-09-12T02:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.185+0000 7efc25400640 1 -- 172.21.15.18:0/66874163 learned_addr learned my addr 172.21.15.18:0/66874163 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.185+0000 7efc1fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc05cd0 0x56124cc0daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.186+0000 7efc25400640 1 --2- 172.21.15.18:0/66874163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc10570 0x56124cc0e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.186+0000 7efc25400640 1 -- 172.21.15.18:0/66874163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc10570 msgr2=0x56124cc0e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.186+0000 7efc25400640 1 --2- 172.21.15.18:0/66874163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc10570 0x56124cc0e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.186+0000 7efc25400640 1 -- 172.21.15.18:0/66874163 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc05cd0 msgr2=0x56124cc0daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.186+0000 7efc25400640 1 --2- 172.21.15.18:0/66874163 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc05cd0 0x56124cc0daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.186+0000 7efc25400640 1 -- 172.21.15.18:0/66874163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56124c94a620 con 0x56124cc053b0 2024-09-12T02:55:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.186+0000 7efc1fe00640 1 --2- 172.21.15.18:0/66874163 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc05cd0 0x56124cc0daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:55:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.186+0000 7efc25400640 1 --2- 172.21.15.18:0/66874163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc0d5b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7efc1802a920 tx=0x7efc18004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a857c8fd978eb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.186+0000 7efc06000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:55:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.186+0000 7efc06000640 1 -- 172.21.15.18:0/66874163 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18004750 con 0x56124cc053b0 2024-09-12T02:55:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.186+0000 7efc06000640 1 -- 172.21.15.18:0/66874163 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9562+0+0 (secure 0 0 0) 0x7efc18003970 con 0x56124cc053b0 2024-09-12T02:55:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.186+0000 7efc2a401740 1 -- 172.21.15.18:0/66874163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc18036040 con 0x56124cc053b0 2024-09-12T02:55:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.187+0000 7efc06000640 1 -- 172.21.15.18:0/66874163 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7efc1805d050 con 0x56124cc053b0 2024-09-12T02:55:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.187+0000 7efc2a401740 10 client.15684 fetch_fsmap learned FSMap version 50 2024-09-12T02:55:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.187+0000 7efc2a401740 1 -- 172.21.15.18:0/66874163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x56124cc1ee50 con 0x56124cc053b0 2024-09-12T02:55:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.187+0000 7efc06000640 1 -- 172.21.15.18:0/66874163 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc18036040 con 0x56124cc053b0 2024-09-12T02:55:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.187+0000 7efc06000640 1 -- 172.21.15.18:0/66874163 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 50) ==== 8418+0+0 (secure 0 0 0) 0x7efc18030070 con 0x56124cc053b0 2024-09-12T02:55:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.187+0000 7efc2a401740 10 client.15684 fetch_fsmap finished waiting for FSMap version 50 2024-09-12T02:55:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.187+0000 7efc2a401740 10 client.15684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:55:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.187+0000 7efc2a401740 20 client.15684 populate_metadata read hostname 'smithi018' 2024-09-12T02:55:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.187+0000 7efc2a401740 1 --2- 172.21.15.18:0/66874163 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56124cc201a0 0x56124cc22590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.187+0000 7efc2a401740 4 client.15684 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:55:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.187+0000 7efc2a401740 1 -- 172.21.15.18:0/66874163 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56124cb78830 con 0x56124cc201a0 2024-09-12T02:55:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.188+0000 7efc1fe00640 1 --2- 172.21.15.18:0/66874163 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56124cc201a0 0x56124cc22590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.188+0000 7efc1fe00640 1 --2- 172.21.15.18:0/66874163 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56124cc201a0 0x56124cc22590 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7697b20a67f6986d server_cookie=8439863da8549973 in_seq=0 out_seq=0 2024-09-12T02:55:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.188+0000 7efc06000640 10 client.15684 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:55:58.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.189+0000 7efc06000640 1 -- 172.21.15.18:0/66874163 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56124cb78830 con 0x56124cc201a0 2024-09-12T02:55:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.189+0000 7efc06000640 10 client.15684 handle_command_reply: tid=0 2024-09-12T02:55:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.189+0000 7efc2a401740 1 client.15684 shutdown 2024-09-12T02:55:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.189+0000 7efc2a401740 1 -- 172.21.15.18:0/66874163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 msgr2=0x56124cc0d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.189+0000 7efc2a401740 1 --2- 172.21.15.18:0/66874163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc0d5b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7efc1802a920 tx=0x7efc18004180 comp rx=0 tx=0).stop 2024-09-12T02:55:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.189+0000 7efc2a401740 1 -- 172.21.15.18:0/66874163 shutdown_connections 2024-09-12T02:55:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.189+0000 7efc2a401740 1 --2- 172.21.15.18:0/66874163 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56124cc201a0 0x56124cc22590 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.189+0000 7efc2a401740 1 --2- 172.21.15.18:0/66874163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc10570 0x56124cc0e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.189+0000 7efc2a401740 1 --2- 172.21.15.18:0/66874163 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc05cd0 0x56124cc0daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.189+0000 7efc2a401740 1 --2- 172.21.15.18:0/66874163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc0d5b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.189+0000 7efc06000640 0 client.15684 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:55:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.189+0000 7efc2a401740 1 -- 172.21.15.18:0/66874163 >> 172.21.15.18:0/66874163 conn(0x56124cc01920 msgr2=0x56124cc07680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.190+0000 7efc2a401740 1 -- 172.21.15.18:0/66874163 shutdown_connections 2024-09-12T02:55:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.190+0000 7efc2a401740 1 -- 172.21.15.18:0/66874163 wait complete. 2024-09-12T02:55:58.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.190+0000 7efc2a401740 20 client.15684 trim_cache size 0 max 16384 2024-09-12T02:55:58.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.205+0000 7efc2a401740 1 Processor -- start 2024-09-12T02:55:58.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.205+0000 7efc2a401740 1 -- start start 2024-09-12T02:55:58.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.205+0000 7efc2a401740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc053b0 0x56124cc0f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.205+0000 7efc2a401740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc05cd0 0x56124cc0de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.205+0000 7efc2a401740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc10570 0x56124cc27bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.205+0000 7efc2a401740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc201b1230 con 0x56124cc05cd0 2024-09-12T02:55:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.205+0000 7efc2a401740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efc201b2f20 con 0x56124cc10570 2024-09-12T02:55:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.205+0000 7efc2a401740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efc201b1930 con 0x56124cc053b0 2024-09-12T02:55:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.206+0000 7efc1fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc05cd0 0x56124cc0de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.206+0000 7efc1fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc05cd0 0x56124cc0de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47090/0 (socket says 172.21.15.18:47090) 2024-09-12T02:55:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.206+0000 7efc1fe00640 1 -- 172.21.15.18:0/1507773105 learned_addr learned my addr 172.21.15.18:0/1507773105 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.206+0000 7efc25400640 1 --2- 172.21.15.18:0/1507773105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc10570 0x56124cc27bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.206+0000 7efc25400640 1 --2- 172.21.15.18:0/1507773105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc053b0 0x56124cc0f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.206+0000 7efc1fe00640 1 -- 172.21.15.18:0/1507773105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc053b0 msgr2=0x56124cc0f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.206+0000 7efc1fe00640 1 --2- 172.21.15.18:0/1507773105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc053b0 0x56124cc0f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.206+0000 7efc1fe00640 1 -- 172.21.15.18:0/1507773105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc10570 msgr2=0x56124cc27bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.206+0000 7efc1fe00640 1 --2- 172.21.15.18:0/1507773105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc10570 0x56124cc27bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.206+0000 7efc1fe00640 1 -- 172.21.15.18:0/1507773105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56124cc025b0 con 0x56124cc05cd0 2024-09-12T02:55:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.206+0000 7efc1fe00640 1 --2- 172.21.15.18:0/1507773105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc05cd0 0x56124cc0de60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x56124cc02ca0 tx=0x7efc0c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e83e2c58f376e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.207+0000 7efc11200640 1 -- 172.21.15.18:0/1507773105 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c004020 con 0x56124cc05cd0 2024-09-12T02:55:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.207+0000 7efc11200640 1 -- 172.21.15.18:0/1507773105 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc0c005500 con 0x56124cc05cd0 2024-09-12T02:55:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.207+0000 7efc11200640 1 -- 172.21.15.18:0/1507773105 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c00fcd0 con 0x56124cc05cd0 2024-09-12T02:55:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.207+0000 7efc2a401740 1 -- 172.21.15.18:0/1507773105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc05cd0 msgr2=0x56124cc0de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.207+0000 7efc2a401740 1 --2- 172.21.15.18:0/1507773105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc05cd0 0x56124cc0de60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x56124cc02ca0 tx=0x7efc0c005f90 comp rx=0 tx=0).stop 2024-09-12T02:55:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.207+0000 7efc2a401740 1 -- 172.21.15.18:0/1507773105 shutdown_connections 2024-09-12T02:55:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.207+0000 7efc2a401740 1 --2- 172.21.15.18:0/1507773105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc10570 0x56124cc27bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.207+0000 7efc2a401740 1 --2- 172.21.15.18:0/1507773105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc05cd0 0x56124cc0de60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.207+0000 7efc2a401740 1 --2- 172.21.15.18:0/1507773105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc053b0 0x56124cc0f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.207+0000 7efc2a401740 1 -- 172.21.15.18:0/1507773105 >> 172.21.15.18:0/1507773105 conn(0x56124cc01920 msgr2=0x56124cc0ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.207+0000 7efc2a401740 1 -- 172.21.15.18:0/1507773105 shutdown_connections 2024-09-12T02:55:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.208+0000 7efc2a401740 1 -- 172.21.15.18:0/1507773105 wait complete. 2024-09-12T02:55:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.208+0000 7efc2a401740 1 -- start start 2024-09-12T02:55:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.208+0000 7efc2a401740 1 Processor -- start 2024-09-12T02:55:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.208+0000 7efc2a401740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc13a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.208+0000 7efc2a401740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc05cd0 0x56124cc13f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.208+0000 7efc2a401740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc10570 0x56124cc88b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.208+0000 7efc2a401740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc201b2790 con 0x56124cc053b0 2024-09-12T02:55:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.208+0000 7efc2a401740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efc201b2000 con 0x56124cc10570 2024-09-12T02:55:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.208+0000 7efc2a401740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efc201af230 con 0x56124cc05cd0 2024-09-12T02:55:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.208+0000 7efc2a401740 10 client.0 _ll_register_callbacks cb 0x7efc0c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:55:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.209+0000 7efc25400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc13a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.209+0000 7efc25400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc13a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47098/0 (socket says 172.21.15.18:47098) 2024-09-12T02:55:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.209+0000 7efc25400640 1 -- 172.21.15.18:0/2624345617 learned_addr learned my addr 172.21.15.18:0/2624345617 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:55:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.209+0000 7efc1fe00640 1 --2- 172.21.15.18:0/2624345617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc05cd0 0x56124cc13f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.209+0000 7efc25400640 1 --2- 172.21.15.18:0/2624345617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc10570 0x56124cc88b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.209+0000 7efc25400640 1 -- 172.21.15.18:0/2624345617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc05cd0 msgr2=0x56124cc13f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.209+0000 7efc25400640 1 --2- 172.21.15.18:0/2624345617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc05cd0 0x56124cc13f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.209+0000 7efc25400640 1 -- 172.21.15.18:0/2624345617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc10570 msgr2=0x56124cc88b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:55:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.209+0000 7efc25400640 1 --2- 172.21.15.18:0/2624345617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc10570 0x56124cc88b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.209+0000 7efc25400640 1 -- 172.21.15.18:0/2624345617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56124cc890c0 con 0x56124cc053b0 2024-09-12T02:55:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.209+0000 7efc25400640 1 --2- 172.21.15.18:0/2624345617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc13a30 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efc18005f90 tx=0x7efc18004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8468299113638a46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:55:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.209+0000 7efc06000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:55:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.210+0000 7efc06000640 1 -- 172.21.15.18:0/2624345617 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18069060 con 0x56124cc053b0 2024-09-12T02:55:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.210+0000 7efc06000640 1 -- 172.21.15.18:0/2624345617 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9562+0+0 (secure 0 0 0) 0x7efc1802e040 con 0x56124cc053b0 2024-09-12T02:55:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.210+0000 7efc2a401740 1 -- 172.21.15.18:0/2624345617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc0c005500 con 0x56124cc053b0 2024-09-12T02:55:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.210+0000 7efc06000640 1 -- 172.21.15.18:0/2624345617 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7efc18070050 con 0x56124cc053b0 2024-09-12T02:55:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.210+0000 7efc2a401740 10 client.15690 fetch_fsmap learned FSMap version 50 2024-09-12T02:55:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.210+0000 7efc2a401740 1 -- 172.21.15.18:0/2624345617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x56124cc8a340 con 0x56124cc053b0 2024-09-12T02:55:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.210+0000 7efc06000640 1 -- 172.21.15.18:0/2624345617 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc0c005500 con 0x56124cc053b0 2024-09-12T02:55:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.210+0000 7efc06000640 1 -- 172.21.15.18:0/2624345617 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 50) ==== 8418+0+0 (secure 0 0 0) 0x7efc18003970 con 0x56124cc053b0 2024-09-12T02:55:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.210+0000 7efc2a401740 10 client.15690 fetch_fsmap finished waiting for FSMap version 50 2024-09-12T02:55:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.210+0000 7efc2a401740 10 client.15690 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:55:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.210+0000 7efc2a401740 20 client.15690 populate_metadata read hostname 'smithi018' 2024-09-12T02:55:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.210+0000 7efc2a401740 1 --2- 172.21.15.18:0/2624345617 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56124cc8aaf0 0x56124cc8cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:55:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.210+0000 7efc2a401740 4 client.15690 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:55:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.210+0000 7efc2a401740 1 -- 172.21.15.18:0/2624345617 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56124cb72b80 con 0x56124cc8aaf0 2024-09-12T02:55:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.211+0000 7efc1fe00640 1 --2- 172.21.15.18:0/2624345617 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56124cc8aaf0 0x56124cc8cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:55:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.211+0000 7efc1fe00640 1 --2- 172.21.15.18:0/2624345617 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56124cc8aaf0 0x56124cc8cf30 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f58db5f0ff14b8ad server_cookie=b7565a902f50e885 in_seq=0 out_seq=0 2024-09-12T02:55:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.211+0000 7efc06000640 10 client.15690 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:55:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.288+0000 7efc06000640 1 -- 172.21.15.18:0/2624345617 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56124cb72b80 con 0x56124cc8aaf0 2024-09-12T02:55:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.288+0000 7efc06000640 10 client.15690 handle_command_reply: tid=0 2024-09-12T02:55:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.288+0000 7efc2a401740 1 client.15690 shutdown 2024-09-12T02:55:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.288+0000 7efc2a401740 1 -- 172.21.15.18:0/2624345617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 msgr2=0x56124cc13a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.288+0000 7efc2a401740 1 --2- 172.21.15.18:0/2624345617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc13a30 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efc18005f90 tx=0x7efc18004180 comp rx=0 tx=0).stop 2024-09-12T02:55:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.288+0000 7efc2a401740 1 -- 172.21.15.18:0/2624345617 shutdown_connections 2024-09-12T02:55:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.288+0000 7efc2a401740 1 --2- 172.21.15.18:0/2624345617 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56124cc8aaf0 0x56124cc8cf30 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.288+0000 7efc2a401740 1 --2- 172.21.15.18:0/2624345617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56124cc10570 0x56124cc88b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.288+0000 7efc2a401740 1 --2- 172.21.15.18:0/2624345617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56124cc05cd0 0x56124cc13f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.288+0000 7efc2a401740 1 --2- 172.21.15.18:0/2624345617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124cc053b0 0x56124cc13a30 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.288+0000 7efc06000640 0 client.15690 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:55:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.288+0000 7efc2a401740 1 -- 172.21.15.18:0/2624345617 >> 172.21.15.18:0/2624345617 conn(0x56124cc01920 msgr2=0x56124cc009c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.288+0000 7efc2a401740 1 -- 172.21.15.18:0/2624345617 shutdown_connections 2024-09-12T02:55:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.288+0000 7efc2a401740 1 -- 172.21.15.18:0/2624345617 wait complete. 2024-09-12T02:55:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.289+0000 7efc2a401740 20 client.15690 trim_cache size 0 max 16384 2024-09-12T02:55:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:55:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:55:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:55:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:55:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.289+0000 7efc25e00640 1 -- 172.21.15.18:0/87598966 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efc080a2cf0 msgr2=0x7efc080a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.289+0000 7efc25e00640 1 --2- 172.21.15.18:0/87598966 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efc080a2cf0 0x7efc080a51b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x56124cc02780 tx=0x7efc14004a40 comp rx=0 tx=0).stop 2024-09-12T02:55:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.289+0000 7efc25e00640 1 -- 172.21.15.18:0/87598966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc201018b0 msgr2=0x7efc200744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:55:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.289+0000 7efc25e00640 1 --2- 172.21.15.18:0/87598966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc201018b0 0x7efc200744f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7efc1400e9f0 tx=0x7efc1400edf0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.289+0000 7efc25e00640 1 -- 172.21.15.18:0/87598966 shutdown_connections 2024-09-12T02:55:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.289+0000 7efc25e00640 1 --2- 172.21.15.18:0/87598966 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efc080a2cf0 0x7efc080a51b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.289+0000 7efc25e00640 1 --2- 172.21.15.18:0/87598966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc201078c0 0x7efc20074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.289+0000 7efc25e00640 1 --2- 172.21.15.18:0/87598966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc20102250 0x7efc20074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.289+0000 7efc25e00640 1 --2- 172.21.15.18:0/87598966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc201018b0 0x7efc200744f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:55:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.289+0000 7efc25e00640 1 -- 172.21.15.18:0/87598966 >> 172.21.15.18:0/87598966 conn(0x7efc200fd5d0 msgr2=0x7efc200fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:55:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.289+0000 7efc25e00640 1 -- 172.21.15.18:0/87598966 shutdown_connections 2024-09-12T02:55:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:55:58.290+0000 7efc25e00640 1 -- 172.21.15.18:0/87598966 wait complete. 2024-09-12T02:55:58.531 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:55:58 smithi176 ceph-mon[35713]: pgmap v222: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 936 KiB/s wr, 70 op/s 2024-09-12T02:55:58.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:55:58 smithi062 ceph-mon[35527]: pgmap v222: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 936 KiB/s wr, 70 op/s 2024-09-12T02:55:58.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:55:58 smithi018 ceph-mon[30616]: pgmap v222: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 936 KiB/s wr, 70 op/s 2024-09-12T02:56:00.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:00 smithi062 ceph-mon[35527]: pgmap v223: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 1.3 MiB/s wr, 88 op/s 2024-09-12T02:56:00.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:00 smithi018 ceph-mon[30616]: pgmap v223: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 1.3 MiB/s wr, 88 op/s 2024-09-12T02:56:00.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:00 smithi176 ceph-mon[35713]: pgmap v223: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 1.3 MiB/s wr, 88 op/s 2024-09-12T02:56:02.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:02 smithi062 ceph-mon[35527]: pgmap v224: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2024-09-12T02:56:02.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:02 smithi018 ceph-mon[30616]: pgmap v224: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2024-09-12T02:56:02.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:02 smithi176 ceph-mon[35713]: pgmap v224: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2024-09-12T02:56:04.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:04 smithi062 ceph-mon[35527]: pgmap v225: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 1.1 MiB/s wr, 57 op/s 2024-09-12T02:56:04.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:04 smithi018 ceph-mon[30616]: pgmap v225: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 1.1 MiB/s wr, 57 op/s 2024-09-12T02:56:04.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:04 smithi176 ceph-mon[35713]: pgmap v225: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 1.1 MiB/s wr, 57 op/s 2024-09-12T02:56:06.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:06 smithi062 ceph-mon[35527]: pgmap v226: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.3 MiB/s wr, 80 op/s 2024-09-12T02:56:06.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:06 smithi018 ceph-mon[30616]: pgmap v226: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.3 MiB/s wr, 80 op/s 2024-09-12T02:56:06.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:06 smithi176 ceph-mon[35713]: pgmap v226: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.3 MiB/s wr, 80 op/s 2024-09-12T02:56:08.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:08 smithi018 ceph-mon[30616]: pgmap v227: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 690 KiB/s wr, 52 op/s 2024-09-12T02:56:08.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:08 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:08.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:08 smithi176 ceph-mon[35713]: pgmap v227: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 690 KiB/s wr, 52 op/s 2024-09-12T02:56:08.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:08 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:08.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:08 smithi062 ceph-mon[35527]: pgmap v227: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 690 KiB/s wr, 52 op/s 2024-09-12T02:56:08.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:08 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:10.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:10 smithi018 ceph-mon[30616]: pgmap v228: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 708 KiB/s wr, 58 op/s 2024-09-12T02:56:10.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:10 smithi176 ceph-mon[35713]: pgmap v228: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 708 KiB/s wr, 58 op/s 2024-09-12T02:56:10.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:10 smithi062 ceph-mon[35527]: pgmap v228: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 708 KiB/s wr, 58 op/s 2024-09-12T02:56:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.418+0000 7f8ef6a00640 1 -- 172.21.15.18:0/1152844310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ef0103af0 msgr2=0x7f8ef0103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.418+0000 7f8ef6a00640 1 --2- 172.21.15.18:0/1152844310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ef0103af0 0x7f8ef0103f50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009890 tx=0x7f8edc02a360 comp rx=0 tx=0).stop 2024-09-12T02:56:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.418+0000 7f8ef6a00640 1 -- 172.21.15.18:0/1152844310 shutdown_connections 2024-09-12T02:56:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.418+0000 7f8ef6a00640 1 --2- 172.21.15.18:0/1152844310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ef0104490 0x7f8ef01109c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.418+0000 7f8ef6a00640 1 --2- 172.21.15.18:0/1152844310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ef0103af0 0x7f8ef0103f50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.418+0000 7f8ef6a00640 1 --2- 172.21.15.18:0/1152844310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ef0109b90 0x7f8ef0109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.418+0000 7f8ef6a00640 1 -- 172.21.15.18:0/1152844310 >> 172.21.15.18:0/1152844310 conn(0x7f8ef00ff7d0 msgr2=0x7f8ef0101bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.418+0000 7f8ef6a00640 1 -- 172.21.15.18:0/1152844310 shutdown_connections 2024-09-12T02:56:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.418+0000 7f8ef6a00640 1 -- 172.21.15.18:0/1152844310 wait complete. 2024-09-12T02:56:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.419+0000 7f8ef6a00640 1 Processor -- start 2024-09-12T02:56:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.419+0000 7f8ef6a00640 1 -- start start 2024-09-12T02:56:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.419+0000 7f8ef6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ef0103af0 0x7f8ef019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.419+0000 7f8ef6a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ef0104490 0x7f8ef019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.420+0000 7f8ef6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ef0109b90 0x7f8ef019ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.420+0000 7f8ef6a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef0113f00 con 0x7f8ef0109b90 2024-09-12T02:56:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.420+0000 7f8ef6a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef0113d80 con 0x7f8ef0104490 2024-09-12T02:56:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.420+0000 7f8ef6a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef0114080 con 0x7f8ef0103af0 2024-09-12T02:56:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.420+0000 7f8ef6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ef0109b90 0x7f8ef019ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.420+0000 7f8ef5600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ef0103af0 0x7f8ef019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.420+0000 7f8ef5600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ef0103af0 0x7f8ef019a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:58968/0 (socket says 172.21.15.18:58968) 2024-09-12T02:56:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.420+0000 7f8ef5600640 1 -- 172.21.15.18:0/1069044992 learned_addr learned my addr 172.21.15.18:0/1069044992 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.420+0000 7f8ef4c00640 1 --2- 172.21.15.18:0/1069044992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ef0104490 0x7f8ef019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.420+0000 7f8ef6000640 1 -- 172.21.15.18:0/1069044992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ef0103af0 msgr2=0x7f8ef019a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.420+0000 7f8ef6000640 1 --2- 172.21.15.18:0/1069044992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ef0103af0 0x7f8ef019a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.420+0000 7f8ef6000640 1 -- 172.21.15.18:0/1069044992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ef0104490 msgr2=0x7f8ef019a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.420+0000 7f8ef6000640 1 --2- 172.21.15.18:0/1069044992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ef0104490 0x7f8ef019a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.420+0000 7f8ef6000640 1 -- 172.21.15.18:0/1069044992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef019f400 con 0x7f8ef0109b90 2024-09-12T02:56:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.421+0000 7f8ef6000640 1 --2- 172.21.15.18:0/1069044992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ef0109b90 0x7f8ef019ecd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009fd0 tx=0x7f8ee800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.421+0000 7f8eee000640 1 -- 172.21.15.18:0/1069044992 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee800ce20 con 0x7f8ef0109b90 2024-09-12T02:56:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.421+0000 7f8eee000640 1 -- 172.21.15.18:0/1069044992 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ee8005020 con 0x7f8ef0109b90 2024-09-12T02:56:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.421+0000 7f8eee000640 1 -- 172.21.15.18:0/1069044992 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8010720 con 0x7f8ef0109b90 2024-09-12T02:56:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.421+0000 7f8ef6a00640 1 -- 172.21.15.18:0/1069044992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef019f6f0 con 0x7f8ef0109b90 2024-09-12T02:56:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.421+0000 7f8ef6a00640 1 -- 172.21.15.18:0/1069044992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef01a6f80 con 0x7f8ef0109b90 2024-09-12T02:56:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.424+0000 7f8eee000640 1 -- 172.21.15.18:0/1069044992 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f8ee8005540 con 0x7f8ef0109b90 2024-09-12T02:56:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.424+0000 7f8efae73740 1 Processor -- start 2024-09-12T02:56:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.424+0000 7f8efae73740 1 -- start start 2024-09-12T02:56:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.425+0000 7f8efae73740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64e03b0 0x5558c64e0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.425+0000 7f8efae73740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e0cd0 0x5558c64eb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.425+0000 7f8efae73740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64eb570 0x5558c64ed960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.425+0000 7f8efae73740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5558c6446100 con 0x5558c64eb570 2024-09-12T02:56:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.425+0000 7f8efae73740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5558c63ee1b0 con 0x5558c64e0cd0 2024-09-12T02:56:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.425+0000 7f8efae73740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5558c64420c0 con 0x5558c64e03b0 2024-09-12T02:56:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.425+0000 7f8ef5600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e0cd0 0x5558c64eb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.425+0000 7f8ef4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64eb570 0x5558c64ed960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.425+0000 7f8ef5600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e0cd0 0x5558c64eb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:33242/0 (socket says 172.21.15.18:33242) 2024-09-12T02:56:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.425+0000 7f8ef5600640 1 -- 172.21.15.18:0/144930867 learned_addr learned my addr 172.21.15.18:0/144930867 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.425+0000 7f8ef4c00640 1 --2- 172.21.15.18:0/144930867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64e03b0 0x5558c64e0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.425+0000 7f8ef5600640 1 -- 172.21.15.18:0/144930867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64e03b0 msgr2=0x5558c64e0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.425+0000 7f8ef5600640 1 --2- 172.21.15.18:0/144930867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64e03b0 0x5558c64e0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.425+0000 7f8ef5600640 1 -- 172.21.15.18:0/144930867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64eb570 msgr2=0x5558c64ed960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.425+0000 7f8ef5600640 1 --2- 172.21.15.18:0/144930867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64eb570 0x5558c64ed960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.425+0000 7f8ef5600640 1 -- 172.21.15.18:0/144930867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558c6159210 con 0x5558c64e0cd0 2024-09-12T02:56:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.426+0000 7f8eee000640 1 --2- 172.21.15.18:0/1069044992 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f8ed80a2cf0 0x7f8ed80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.426+0000 7f8ef5600640 1 --2- 172.21.15.18:0/144930867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e0cd0 0x5558c64eb030 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4009d00 tx=0x7f8ee4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ee1ec05e916a33f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.426+0000 7f8eee000640 1 -- 172.21.15.18:0/1069044992 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9562+0+0 (secure 0 0 0) 0x7f8ee80cffd0 con 0x7f8ef0109b90 2024-09-12T02:56:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.426+0000 7f8ef4c00640 1 --2- 172.21.15.18:0/1069044992 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f8ed80a2cf0 0x7f8ed80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.426+0000 7f8ee2600640 1 -- 172.21.15.18:0/144930867 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4004230 con 0x5558c64e0cd0 2024-09-12T02:56:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.426+0000 7f8ee2600640 1 -- 172.21.15.18:0/144930867 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ee40043d0 con 0x5558c64e0cd0 2024-09-12T02:56:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.426+0000 7f8ee2600640 1 -- 172.21.15.18:0/144930867 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee40198a0 con 0x5558c64e0cd0 2024-09-12T02:56:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.427+0000 7f8efae73740 1 -- 172.21.15.18:0/144930867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e0cd0 msgr2=0x5558c64eb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.427+0000 7f8efae73740 1 --2- 172.21.15.18:0/144930867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e0cd0 0x5558c64eb030 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4009d00 tx=0x7f8ee4011810 comp rx=0 tx=0).stop 2024-09-12T02:56:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.427+0000 7f8ef4c00640 1 --2- 172.21.15.18:0/1069044992 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f8ed80a2cf0 0x7f8ed80a51b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8edc02a950 tx=0x7f8edc000bc0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.427+0000 7f8efae73740 1 -- 172.21.15.18:0/144930867 shutdown_connections 2024-09-12T02:56:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.427+0000 7f8efae73740 1 --2- 172.21.15.18:0/144930867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64eb570 0x5558c64ed960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.427+0000 7f8efae73740 1 --2- 172.21.15.18:0/144930867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e0cd0 0x5558c64eb030 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.427+0000 7f8efae73740 1 --2- 172.21.15.18:0/144930867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64e03b0 0x5558c64e0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.427+0000 7f8efae73740 1 -- 172.21.15.18:0/144930867 >> 172.21.15.18:0/144930867 conn(0x5558c64dc920 msgr2=0x5558c64dcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.427+0000 7f8efae73740 1 -- 172.21.15.18:0/144930867 shutdown_connections 2024-09-12T02:56:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.427+0000 7f8efae73740 1 -- 172.21.15.18:0/144930867 wait complete. 2024-09-12T02:56:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.428+0000 7f8efae73740 1 -- start start 2024-09-12T02:56:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.428+0000 7f8efae73740 1 Processor -- start 2024-09-12T02:56:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.428+0000 7f8efae73740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64e03b0 0x5558c64e8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.428+0000 7f8efae73740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e0cd0 0x5558c64e8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.428+0000 7f8efae73740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64eb570 0x5558c64e9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.428+0000 7f8efae73740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5558c64edf90 con 0x5558c64e03b0 2024-09-12T02:56:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.428+0000 7f8efae73740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5558c63cf090 con 0x5558c64e0cd0 2024-09-12T02:56:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.428+0000 7f8efae73740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5558c64ee110 con 0x5558c64eb570 2024-09-12T02:56:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.428+0000 7f8efae73740 10 client.0 _ll_register_callbacks cb 0x5558c6423f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:56:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.429+0000 7f8ef5600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64e03b0 0x5558c64e8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.429+0000 7f8ef4c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e0cd0 0x5558c64e8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.429+0000 7f8ef4c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e0cd0 0x5558c64e8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:33256/0 (socket says 172.21.15.18:33256) 2024-09-12T02:56:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.429+0000 7f8ef4c00640 1 -- 172.21.15.18:0/766701283 learned_addr learned my addr 172.21.15.18:0/766701283 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.429+0000 7f8ef6000640 1 --2- 172.21.15.18:0/766701283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64eb570 0x5558c64e9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.429+0000 7f8ef4c00640 1 -- 172.21.15.18:0/766701283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64eb570 msgr2=0x5558c64e9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.429+0000 7f8ef4c00640 1 --2- 172.21.15.18:0/766701283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64eb570 0x5558c64e9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.429+0000 7f8ef4c00640 1 -- 172.21.15.18:0/766701283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64e03b0 msgr2=0x5558c64e8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.429+0000 7f8ef4c00640 1 --2- 172.21.15.18:0/766701283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64e03b0 0x5558c64e8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.429+0000 7f8ef4c00640 1 -- 172.21.15.18:0/766701283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558c6225620 con 0x5558c64e0cd0 2024-09-12T02:56:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.429+0000 7f8ef6000640 1 --2- 172.21.15.18:0/766701283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64eb570 0x5558c64e9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.429+0000 7f8ef5600640 1 --2- 172.21.15.18:0/766701283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64e03b0 0x5558c64e8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.429+0000 7f8ef4c00640 1 --2- 172.21.15.18:0/766701283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e0cd0 0x5558c64e8bd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8edc030520 tx=0x7f8edc0056d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b6cebf32a3c39dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.429+0000 7f8ed6a00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:56:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.430+0000 7f8ed6a00640 1 -- 172.21.15.18:0/766701283 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc04c020 con 0x5558c64e0cd0 2024-09-12T02:56:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.430+0000 7f8efae73740 1 -- 172.21.15.18:0/766701283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ee40043d0 con 0x5558c64e0cd0 2024-09-12T02:56:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.430+0000 7f8ed6a00640 1 -- 172.21.15.18:0/766701283 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9562+0+0 (secure 0 0 0) 0x7f8edc0035f0 con 0x5558c64e0cd0 2024-09-12T02:56:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.430+0000 7f8ed6a00640 1 -- 172.21.15.18:0/766701283 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f8edc057050 con 0x5558c64e0cd0 2024-09-12T02:56:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.430+0000 7f8efae73740 10 client.25691 fetch_fsmap learned FSMap version 51 2024-09-12T02:56:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.430+0000 7f8efae73740 1 -- 172.21.15.18:0/766701283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5558c64f9e60 con 0x5558c64e0cd0 2024-09-12T02:56:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.430+0000 7f8ed6a00640 1 -- 172.21.15.18:0/766701283 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ee40043d0 con 0x5558c64e0cd0 2024-09-12T02:56:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.431+0000 7f8ed6a00640 1 -- 172.21.15.18:0/766701283 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 51) ==== 8422+0+0 (secure 0 0 0) 0x7f8edc0328d0 con 0x5558c64e0cd0 2024-09-12T02:56:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.431+0000 7f8efae73740 10 client.25691 fetch_fsmap finished waiting for FSMap version 51 2024-09-12T02:56:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.431+0000 7f8efae73740 10 client.25691 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:56:11.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.431+0000 7f8efae73740 20 client.25691 populate_metadata read hostname 'smithi018' 2024-09-12T02:56:11.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.431+0000 7f8efae73740 1 --2- 172.21.15.18:0/766701283 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5558c64fb340 0x5558c64fd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.431+0000 7f8efae73740 4 client.25691 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:56:11.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.431+0000 7f8efae73740 1 -- 172.21.15.18:0/766701283 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558c6453830 con 0x5558c64fb340 2024-09-12T02:56:11.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.431+0000 7f8ef5600640 1 --2- 172.21.15.18:0/766701283 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5558c64fb340 0x5558c64fd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.432+0000 7f8ef5600640 1 --2- 172.21.15.18:0/766701283 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5558c64fb340 0x5558c64fd7e0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cf4db4b6affc826 server_cookie=27bde6d82a05ee80 in_seq=0 out_seq=0 2024-09-12T02:56:11.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.432+0000 7f8ed6a00640 10 client.25691 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:56:11.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.432+0000 7f8ed6a00640 1 -- 172.21.15.18:0/766701283 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5558c6453830 con 0x5558c64fb340 2024-09-12T02:56:11.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.432+0000 7f8ed6a00640 10 client.25691 handle_command_reply: tid=0 2024-09-12T02:56:11.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.432+0000 7f8efae73740 1 client.25691 shutdown 2024-09-12T02:56:11.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.433+0000 7f8efae73740 1 -- 172.21.15.18:0/766701283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e0cd0 msgr2=0x5558c64e8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.433+0000 7f8efae73740 1 --2- 172.21.15.18:0/766701283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e0cd0 0x5558c64e8bd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8edc030520 tx=0x7f8edc0056d0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.433+0000 7f8efae73740 1 -- 172.21.15.18:0/766701283 shutdown_connections 2024-09-12T02:56:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.433+0000 7f8efae73740 1 --2- 172.21.15.18:0/766701283 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5558c64fb340 0x5558c64fd7e0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.433+0000 7f8efae73740 1 --2- 172.21.15.18:0/766701283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64eb570 0x5558c64e9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.433+0000 7f8efae73740 1 --2- 172.21.15.18:0/766701283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e0cd0 0x5558c64e8bd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.433+0000 7f8ed6a00640 0 client.25691 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:56:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.433+0000 7f8efae73740 1 --2- 172.21.15.18:0/766701283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64e03b0 0x5558c64e8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.433+0000 7f8efae73740 1 -- 172.21.15.18:0/766701283 >> 172.21.15.18:0/766701283 conn(0x5558c64dc920 msgr2=0x5558c64e2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.433+0000 7f8efae73740 1 -- 172.21.15.18:0/766701283 shutdown_connections 2024-09-12T02:56:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.433+0000 7f8efae73740 1 -- 172.21.15.18:0/766701283 wait complete. 2024-09-12T02:56:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.433+0000 7f8efae73740 20 client.25691 trim_cache size 0 max 16384 2024-09-12T02:56:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.448+0000 7f8efae73740 1 Processor -- start 2024-09-12T02:56:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.448+0000 7f8efae73740 1 -- start start 2024-09-12T02:56:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8efae73740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e03b0 0x5558c6503100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8efae73740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64e0cd0 0x5558c6503640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8efae73740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64eb570 0x5558c64e6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8efae73740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef01b1200 con 0x5558c64eb570 2024-09-12T02:56:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8efae73740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef01b2f20 con 0x5558c64e03b0 2024-09-12T02:56:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8efae73740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef01b1900 con 0x5558c64e0cd0 2024-09-12T02:56:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8ef6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64eb570 0x5558c64e6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8ef6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64eb570 0x5558c64e6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42058/0 (socket says 172.21.15.18:42058) 2024-09-12T02:56:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8ef6000640 1 -- 172.21.15.18:0/1859665073 learned_addr learned my addr 172.21.15.18:0/1859665073 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8ef4c00640 1 --2- 172.21.15.18:0/1859665073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64e0cd0 0x5558c6503640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8ef5600640 1 --2- 172.21.15.18:0/1859665073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e03b0 0x5558c6503100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8ef6000640 1 -- 172.21.15.18:0/1859665073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64e0cd0 msgr2=0x5558c6503640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8ef6000640 1 --2- 172.21.15.18:0/1859665073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64e0cd0 0x5558c6503640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8ef6000640 1 -- 172.21.15.18:0/1859665073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e03b0 msgr2=0x5558c6503100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8ef6000640 1 --2- 172.21.15.18:0/1859665073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e03b0 0x5558c6503100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8ef6000640 1 -- 172.21.15.18:0/1859665073 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558c64eb140 con 0x5558c64eb570 2024-09-12T02:56:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8ef5600640 1 --2- 172.21.15.18:0/1859665073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e03b0 0x5558c6503100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.449+0000 7f8ef4c00640 1 --2- 172.21.15.18:0/1859665073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64e0cd0 0x5558c6503640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.450+0000 7f8ef6000640 1 --2- 172.21.15.18:0/1859665073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64eb570 0x5558c64e6f40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8098a50 tx=0x7f8ee8098450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a5ce6b2291cb42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.450+0000 7f8ee1c00640 1 -- 172.21.15.18:0/1859665073 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80bc0b0 con 0x5558c64eb570 2024-09-12T02:56:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.450+0000 7f8ee1c00640 1 -- 172.21.15.18:0/1859665073 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ee809a380 con 0x5558c64eb570 2024-09-12T02:56:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.450+0000 7f8ee1c00640 1 -- 172.21.15.18:0/1859665073 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80a4860 con 0x5558c64eb570 2024-09-12T02:56:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.451+0000 7f8efae73740 1 -- 172.21.15.18:0/1859665073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64eb570 msgr2=0x5558c64e6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.451+0000 7f8efae73740 1 --2- 172.21.15.18:0/1859665073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64eb570 0x5558c64e6f40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8098a50 tx=0x7f8ee8098450 comp rx=0 tx=0).stop 2024-09-12T02:56:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.451+0000 7f8efae73740 1 -- 172.21.15.18:0/1859665073 shutdown_connections 2024-09-12T02:56:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.451+0000 7f8efae73740 1 --2- 172.21.15.18:0/1859665073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64eb570 0x5558c64e6f40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.451+0000 7f8efae73740 1 --2- 172.21.15.18:0/1859665073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64e0cd0 0x5558c6503640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.451+0000 7f8efae73740 1 --2- 172.21.15.18:0/1859665073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e03b0 0x5558c6503100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.451+0000 7f8efae73740 1 -- 172.21.15.18:0/1859665073 >> 172.21.15.18:0/1859665073 conn(0x5558c64dc920 msgr2=0x5558c64e1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.451+0000 7f8efae73740 1 -- 172.21.15.18:0/1859665073 shutdown_connections 2024-09-12T02:56:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.451+0000 7f8efae73740 1 -- 172.21.15.18:0/1859665073 wait complete. 2024-09-12T02:56:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.451+0000 7f8efae73740 1 -- start start 2024-09-12T02:56:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.451+0000 7f8efae73740 1 Processor -- start 2024-09-12T02:56:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8efae73740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e03b0 0x5558c64ee3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8efae73740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64e0cd0 0x5558c64ee900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8efae73740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64eb570 0x5558c64eee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8efae73740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef01b2790 con 0x5558c64e0cd0 2024-09-12T02:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8efae73740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef01b2000 con 0x5558c64e03b0 2024-09-12T02:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8efae73740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef01af200 con 0x5558c64eb570 2024-09-12T02:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8efae73740 10 client.0 _ll_register_callbacks cb 0x7f8ee80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8ef4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64e0cd0 0x5558c64ee900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8ef6000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64eb570 0x5558c64eee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8ef5600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e03b0 0x5558c64ee3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8ef4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64e0cd0 0x5558c64ee900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42074/0 (socket says 172.21.15.18:42074) 2024-09-12T02:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8ef4c00640 1 -- 172.21.15.18:0/794091645 learned_addr learned my addr 172.21.15.18:0/794091645 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8ef6000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64eb570 0x5558c64eee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:59000/0 (socket says 172.21.15.18:59000) 2024-09-12T02:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8ef5600640 1 -- 172.21.15.18:0/794091645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64eb570 msgr2=0x5558c64eee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8ef5600640 1 --2- 172.21.15.18:0/794091645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64eb570 0x5558c64eee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8ef5600640 1 -- 172.21.15.18:0/794091645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64e0cd0 msgr2=0x5558c64ee900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8ef5600640 1 --2- 172.21.15.18:0/794091645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64e0cd0 0x5558c64ee900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8ef5600640 1 -- 172.21.15.18:0/794091645 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558c6564220 con 0x5558c64e03b0 2024-09-12T02:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.452+0000 7f8ef6000640 1 --2- 172.21.15.18:0/794091645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64eb570 0x5558c64eee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.453+0000 7f8ef5600640 1 --2- 172.21.15.18:0/794091645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e03b0 0x5558c64ee3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8ee401b040 tx=0x7f8ee40099a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7c4e727213775bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.453+0000 7f8ed6a00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.453+0000 7f8ed6a00640 1 -- 172.21.15.18:0/794091645 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4005040 con 0x5558c64e03b0 2024-09-12T02:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.453+0000 7f8efae73740 1 -- 172.21.15.18:0/794091645 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ee809a380 con 0x5558c64e03b0 2024-09-12T02:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.453+0000 7f8ed6a00640 1 -- 172.21.15.18:0/794091645 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9562+0+0 (secure 0 0 0) 0x7f8ee40051e0 con 0x5558c64e03b0 2024-09-12T02:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.453+0000 7f8ed6a00640 1 -- 172.21.15.18:0/794091645 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f8ee403d050 con 0x5558c64e03b0 2024-09-12T02:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.453+0000 7f8efae73740 10 client.25697 fetch_fsmap learned FSMap version 51 2024-09-12T02:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.454+0000 7f8efae73740 1 -- 172.21.15.18:0/794091645 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5558c6565510 con 0x5558c64e03b0 2024-09-12T02:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.454+0000 7f8ed6a00640 1 -- 172.21.15.18:0/794091645 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ee809a380 con 0x5558c64e03b0 2024-09-12T02:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.454+0000 7f8ed6a00640 1 -- 172.21.15.18:0/794091645 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 51) ==== 8422+0+0 (secure 0 0 0) 0x7f8ee4004680 con 0x5558c64e03b0 2024-09-12T02:56:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.454+0000 7f8efae73740 10 client.25697 fetch_fsmap finished waiting for FSMap version 51 2024-09-12T02:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.454+0000 7f8efae73740 10 client.25697 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.454+0000 7f8efae73740 20 client.25697 populate_metadata read hostname 'smithi018' 2024-09-12T02:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.454+0000 7f8efae73740 1 --2- 172.21.15.18:0/794091645 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5558c6565bd0 0x5558c6567ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.454+0000 7f8efae73740 4 client.25697 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.454+0000 7f8efae73740 1 -- 172.21.15.18:0/794091645 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5558c644db80 con 0x5558c6565bd0 2024-09-12T02:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.454+0000 7f8ef4c00640 1 --2- 172.21.15.18:0/794091645 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5558c6565bd0 0x5558c6567ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.455+0000 7f8ef4c00640 1 --2- 172.21.15.18:0/794091645 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5558c6565bd0 0x5558c6567ff0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdd935ad074357b server_cookie=9729ab7d04ceefbb in_seq=0 out_seq=0 2024-09-12T02:56:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.455+0000 7f8ed6a00640 10 client.25697 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:56:11.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.472+0000 7f8ed6a00640 1 -- 172.21.15.18:0/794091645 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5558c644db80 con 0x5558c6565bd0 2024-09-12T02:56:11.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.472+0000 7f8ed6a00640 10 client.25697 handle_command_reply: tid=0 2024-09-12T02:56:11.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.472+0000 7f8efae73740 1 client.25697 shutdown 2024-09-12T02:56:11.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.472+0000 7f8efae73740 1 -- 172.21.15.18:0/794091645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e03b0 msgr2=0x5558c64ee3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:11.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.472+0000 7f8efae73740 1 --2- 172.21.15.18:0/794091645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e03b0 0x5558c64ee3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8ee401b040 tx=0x7f8ee40099a0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.472+0000 7f8efae73740 1 -- 172.21.15.18:0/794091645 shutdown_connections 2024-09-12T02:56:11.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.472+0000 7f8efae73740 1 --2- 172.21.15.18:0/794091645 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5558c6565bd0 0x5558c6567ff0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.472+0000 7f8efae73740 1 --2- 172.21.15.18:0/794091645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558c64eb570 0x5558c64eee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.472+0000 7f8efae73740 1 --2- 172.21.15.18:0/794091645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558c64e0cd0 0x5558c64ee900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.472+0000 7f8efae73740 1 --2- 172.21.15.18:0/794091645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5558c64e03b0 0x5558c64ee3c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.472+0000 7f8ed6a00640 0 client.25697 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:56:11.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.472+0000 7f8efae73740 1 -- 172.21.15.18:0/794091645 >> 172.21.15.18:0/794091645 conn(0x5558c64dc920 msgr2=0x5558c64e6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:11.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.472+0000 7f8efae73740 1 -- 172.21.15.18:0/794091645 shutdown_connections 2024-09-12T02:56:11.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.472+0000 7f8efae73740 1 -- 172.21.15.18:0/794091645 wait complete. 2024-09-12T02:56:11.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.472+0000 7f8efae73740 20 client.25697 trim_cache size 0 max 16384 2024-09-12T02:56:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:56:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:56:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:56:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:56:11.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.473+0000 7f8ef6a00640 1 -- 172.21.15.18:0/1069044992 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f8ed80a2cf0 msgr2=0x7f8ed80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:11.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.473+0000 7f8ef6a00640 1 --2- 172.21.15.18:0/1069044992 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f8ed80a2cf0 0x7f8ed80a51b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8edc02a950 tx=0x7f8edc000bc0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.473+0000 7f8ef6a00640 1 -- 172.21.15.18:0/1069044992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ef0109b90 msgr2=0x7f8ef019ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:11.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.473+0000 7f8ef6a00640 1 --2- 172.21.15.18:0/1069044992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ef0109b90 0x7f8ef019ecd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009fd0 tx=0x7f8ee800ef10 comp rx=0 tx=0).stop 2024-09-12T02:56:11.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.473+0000 7f8ef6a00640 1 -- 172.21.15.18:0/1069044992 shutdown_connections 2024-09-12T02:56:11.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.473+0000 7f8ef6a00640 1 --2- 172.21.15.18:0/1069044992 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f8ed80a2cf0 0x7f8ed80a51b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.473+0000 7f8ef6a00640 1 --2- 172.21.15.18:0/1069044992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ef0109b90 0x7f8ef019ecd0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.473+0000 7f8ef6a00640 1 --2- 172.21.15.18:0/1069044992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ef0104490 0x7f8ef019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.473+0000 7f8ef6a00640 1 --2- 172.21.15.18:0/1069044992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ef0103af0 0x7f8ef019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.473+0000 7f8ef6a00640 1 -- 172.21.15.18:0/1069044992 >> 172.21.15.18:0/1069044992 conn(0x7f8ef00ff7d0 msgr2=0x7f8ef01000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.473+0000 7f8ef6a00640 1 -- 172.21.15.18:0/1069044992 shutdown_connections 2024-09-12T02:56:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:11.473+0000 7f8ef6a00640 1 -- 172.21.15.18:0/1069044992 wait complete. 2024-09-12T02:56:12.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:12 smithi018 ceph-mon[30616]: pgmap v229: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 455 KiB/s wr, 48 op/s 2024-09-12T02:56:12.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:12 smithi176 ceph-mon[35713]: pgmap v229: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 455 KiB/s wr, 48 op/s 2024-09-12T02:56:12.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:12 smithi062 ceph-mon[35527]: pgmap v229: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 455 KiB/s wr, 48 op/s 2024-09-12T02:56:14.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:14 smithi018 ceph-mon[30616]: pgmap v230: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 364 KiB/s wr, 42 op/s 2024-09-12T02:56:14.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:14 smithi018 ceph-mon[30616]: osdmap e102: 12 total, 12 up, 12 in 2024-09-12T02:56:14.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:14 smithi176 ceph-mon[35713]: pgmap v230: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 364 KiB/s wr, 42 op/s 2024-09-12T02:56:14.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:14 smithi176 ceph-mon[35713]: osdmap e102: 12 total, 12 up, 12 in 2024-09-12T02:56:14.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:14 smithi062 ceph-mon[35527]: pgmap v230: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 364 KiB/s wr, 42 op/s 2024-09-12T02:56:14.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:14 smithi062 ceph-mon[35527]: osdmap e102: 12 total, 12 up, 12 in 2024-09-12T02:56:16.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:16 smithi018 ceph-mon[30616]: pgmap v232: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 438 KiB/s wr, 50 op/s 2024-09-12T02:56:16.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:16 smithi176 ceph-mon[35713]: pgmap v232: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 438 KiB/s wr, 50 op/s 2024-09-12T02:56:16.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:16 smithi062 ceph-mon[35527]: pgmap v232: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 438 KiB/s wr, 50 op/s 2024-09-12T02:56:18.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:18 smithi018 ceph-mon[30616]: pgmap v233: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 438 KiB/s wr, 50 op/s 2024-09-12T02:56:18.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:18 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:18.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:18 smithi176 ceph-mon[35713]: pgmap v233: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 438 KiB/s wr, 50 op/s 2024-09-12T02:56:18.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:18 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:18.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:18 smithi062 ceph-mon[35527]: pgmap v233: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 438 KiB/s wr, 50 op/s 2024-09-12T02:56:18.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:18 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:20.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:20 smithi018 ceph-mon[30616]: pgmap v234: 129 pgs: 10 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 95 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 485 KiB/s wr, 54 op/s 2024-09-12T02:56:20.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:20 smithi176 ceph-mon[35713]: pgmap v234: 129 pgs: 10 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 95 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 485 KiB/s wr, 54 op/s 2024-09-12T02:56:20.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:20 smithi062 ceph-mon[35527]: pgmap v234: 129 pgs: 10 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 95 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 485 KiB/s wr, 54 op/s 2024-09-12T02:56:22.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:22 smithi018 ceph-mon[30616]: pgmap v235: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 431 KiB/s wr, 54 op/s 2024-09-12T02:56:22.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:22 smithi176 ceph-mon[35713]: pgmap v235: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 431 KiB/s wr, 54 op/s 2024-09-12T02:56:22.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:22 smithi062 ceph-mon[35527]: pgmap v235: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 431 KiB/s wr, 54 op/s 2024-09-12T02:56:24.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:24 smithi018 ceph-mon[30616]: pgmap v236: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 421 KiB/s wr, 53 op/s 2024-09-12T02:56:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.610+0000 7f700e800640 1 -- 172.21.15.18:0/3380929917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7008109ba0 msgr2=0x7f7008109f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.610+0000 7f700e800640 1 --2- 172.21.15.18:0/3380929917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7008109ba0 0x7f7008109f80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc009860 tx=0x7f6ffc02a340 comp rx=0 tx=0).stop 2024-09-12T02:56:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.610+0000 7f700e800640 1 -- 172.21.15.18:0/3380929917 shutdown_connections 2024-09-12T02:56:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.610+0000 7f700e800640 1 --2- 172.21.15.18:0/3380929917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70081044a0 0x7f70081109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.610+0000 7f700e800640 1 --2- 172.21.15.18:0/3380929917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7008103b00 0x7f7008103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.610+0000 7f700e800640 1 --2- 172.21.15.18:0/3380929917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7008109ba0 0x7f7008109f80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.611+0000 7f700e800640 1 -- 172.21.15.18:0/3380929917 >> 172.21.15.18:0/3380929917 conn(0x7f70080ff7c0 msgr2=0x7f7008101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.611+0000 7f700e800640 1 -- 172.21.15.18:0/3380929917 shutdown_connections 2024-09-12T02:56:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.611+0000 7f700e800640 1 -- 172.21.15.18:0/3380929917 wait complete. 2024-09-12T02:56:24.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.612+0000 7f700e800640 1 Processor -- start 2024-09-12T02:56:24.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.612+0000 7f700e800640 1 -- start start 2024-09-12T02:56:24.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.612+0000 7f700e800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7008103b00 0x7f70081a4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.612+0000 7f700e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70081044a0 0x7f70081a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.612+0000 7f700e800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7008109ba0 0x7f700810f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.612+0000 7f700e800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7008077ba0 con 0x7f70081044a0 2024-09-12T02:56:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.612+0000 7f700e800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7008077a20 con 0x7f7008103b00 2024-09-12T02:56:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.612+0000 7f700e800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7008077d20 con 0x7f7008109ba0 2024-09-12T02:56:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.613+0000 7f700d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7008103b00 0x7f70081a4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.613+0000 7f700ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70081044a0 0x7f70081a4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.613+0000 7f700de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7008109ba0 0x7f700810f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.613+0000 7f700d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7008103b00 0x7f70081a4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:47724/0 (socket says 172.21.15.18:47724) 2024-09-12T02:56:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.613+0000 7f700ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70081044a0 0x7f70081a4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59884/0 (socket says 172.21.15.18:59884) 2024-09-12T02:56:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.613+0000 7f700d400640 1 -- 172.21.15.18:0/3725271690 learned_addr learned my addr 172.21.15.18:0/3725271690 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.613+0000 7f700ca00640 1 -- 172.21.15.18:0/3725271690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7008109ba0 msgr2=0x7f700810f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.613+0000 7f700ca00640 1 --2- 172.21.15.18:0/3725271690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7008109ba0 0x7f700810f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.613+0000 7f700ca00640 1 -- 172.21.15.18:0/3725271690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7008103b00 msgr2=0x7f70081a4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.613+0000 7f700ca00640 1 --2- 172.21.15.18:0/3725271690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7008103b00 0x7f70081a4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.613+0000 7f700ca00640 1 -- 172.21.15.18:0/3725271690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700810fe10 con 0x7f70081044a0 2024-09-12T02:56:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.614+0000 7f700ca00640 1 --2- 172.21.15.18:0/3725271690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70081044a0 0x7f70081a4a50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4009fd0 tx=0x7f6ff400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.614+0000 7f7006000640 1 -- 172.21.15.18:0/3725271690 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff400ccc0 con 0x7f70081044a0 2024-09-12T02:56:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.614+0000 7f7006000640 1 -- 172.21.15.18:0/3725271690 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ff400ee70 con 0x7f70081044a0 2024-09-12T02:56:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.614+0000 7f700e800640 1 -- 172.21.15.18:0/3725271690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7008110100 con 0x7f70081044a0 2024-09-12T02:56:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.614+0000 7f7006000640 1 -- 172.21.15.18:0/3725271690 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4004a00 con 0x7f70081044a0 2024-09-12T02:56:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.614+0000 7f700e800640 1 -- 172.21.15.18:0/3725271690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70081ab320 con 0x7f70081044a0 2024-09-12T02:56:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.617+0000 7f7012c40740 1 Processor -- start 2024-09-12T02:56:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.618+0000 7f7012c40740 1 -- start start 2024-09-12T02:56:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.618+0000 7f7012c40740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bb3b0 0x5583118bb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.618+0000 7f7012c40740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bbcd0 0x5583118c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.618+0000 7f7012c40740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118c6570 0x5583118c8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.618+0000 7f7012c40740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558311821100 con 0x5583118c6570 2024-09-12T02:56:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.618+0000 7f7012c40740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5583117c91b0 con 0x5583118bbcd0 2024-09-12T02:56:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.618+0000 7f7012c40740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55831181d0c0 con 0x5583118bb3b0 2024-09-12T02:56:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.618+0000 7f700de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bb3b0 0x5583118bb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.618+0000 7f700d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bbcd0 0x5583118c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.618+0000 7f700d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bbcd0 0x5583118c6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:47738/0 (socket says 172.21.15.18:47738) 2024-09-12T02:56:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.618+0000 7f700d400640 1 -- 172.21.15.18:0/2075718174 learned_addr learned my addr 172.21.15.18:0/2075718174 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.618+0000 7f700de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bb3b0 0x5583118bb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:33148/0 (socket says 172.21.15.18:33148) 2024-09-12T02:56:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.619+0000 7f700d400640 1 -- 172.21.15.18:0/2075718174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bb3b0 msgr2=0x5583118bb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.619+0000 7f700d400640 1 --2- 172.21.15.18:0/2075718174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bb3b0 0x5583118bb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.619+0000 7f700d400640 1 -- 172.21.15.18:0/2075718174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118c6570 msgr2=0x5583118c8960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:56:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.619+0000 7f700d400640 1 --2- 172.21.15.18:0/2075718174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118c6570 0x5583118c8960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.619+0000 7f700d400640 1 -- 172.21.15.18:0/2075718174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558311534210 con 0x5583118bbcd0 2024-09-12T02:56:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.619+0000 7f7006000640 1 -- 172.21.15.18:0/3725271690 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f6ff4004bc0 con 0x7f70081044a0 2024-09-12T02:56:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.619+0000 7f700de00640 1 --2- 172.21.15.18:0/2075718174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bb3b0 0x5583118bb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.619+0000 7f700d400640 1 --2- 172.21.15.18:0/2075718174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bbcd0 0x5583118c6030 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc009980 tx=0x7f6ffc0095a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6562219285c64a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.620+0000 7f6ffa600640 1 -- 172.21.15.18:0/2075718174 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc037040 con 0x5583118bbcd0 2024-09-12T02:56:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.620+0000 7f6ffa600640 1 -- 172.21.15.18:0/2075718174 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ffc030e40 con 0x5583118bbcd0 2024-09-12T02:56:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.620+0000 7f6ffa600640 1 -- 172.21.15.18:0/2075718174 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc003970 con 0x5583118bbcd0 2024-09-12T02:56:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.620+0000 7f7006000640 1 --2- 172.21.15.18:0/3725271690 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6ff00a2d70 0x7f6ff00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.621+0000 7f7006000640 1 -- 172.21.15.18:0/3725271690 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9650+0+0 (secure 0 0 0) 0x7f6ff40cf770 con 0x7f70081044a0 2024-09-12T02:56:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.621+0000 7f7012c40740 1 -- 172.21.15.18:0/2075718174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bbcd0 msgr2=0x5583118c6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.621+0000 7f7012c40740 1 --2- 172.21.15.18:0/2075718174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bbcd0 0x5583118c6030 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc009980 tx=0x7f6ffc0095a0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.621+0000 7f7012c40740 1 -- 172.21.15.18:0/2075718174 shutdown_connections 2024-09-12T02:56:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.621+0000 7f7012c40740 1 --2- 172.21.15.18:0/2075718174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118c6570 0x5583118c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.621+0000 7f7012c40740 1 --2- 172.21.15.18:0/2075718174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bbcd0 0x5583118c6030 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.621+0000 7f7012c40740 1 --2- 172.21.15.18:0/2075718174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bb3b0 0x5583118bb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.621+0000 7f7012c40740 1 -- 172.21.15.18:0/2075718174 >> 172.21.15.18:0/2075718174 conn(0x5583118b7920 msgr2=0x5583118b7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.621+0000 7f700de00640 1 --2- 172.21.15.18:0/3725271690 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6ff00a2d70 0x7f6ff00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.621+0000 7f7012c40740 1 -- 172.21.15.18:0/2075718174 shutdown_connections 2024-09-12T02:56:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.621+0000 7f7012c40740 1 -- 172.21.15.18:0/2075718174 wait complete. 2024-09-12T02:56:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.622+0000 7f7012c40740 1 -- start start 2024-09-12T02:56:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.622+0000 7f700de00640 1 --2- 172.21.15.18:0/3725271690 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6ff00a2d70 0x7f6ff00a5230 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f70081a5210 tx=0x7f7000009500 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.622+0000 7f7012c40740 1 Processor -- start 2024-09-12T02:56:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.622+0000 7f7012c40740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bb3b0 0x5583118c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.622+0000 7f7012c40740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bbcd0 0x5583118c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.623+0000 7f7012c40740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118c6570 0x5583118c4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.623+0000 7f7012c40740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5583118c8ff0 con 0x5583118c6570 2024-09-12T02:56:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.623+0000 7f7012c40740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5583117aa090 con 0x5583118bb3b0 2024-09-12T02:56:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.623+0000 7f7012c40740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5583118c9170 con 0x5583118bbcd0 2024-09-12T02:56:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.623+0000 7f7012c40740 10 client.0 _ll_register_callbacks cb 0x5583117fef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:56:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.623+0000 7f700d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bb3b0 0x5583118c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.623+0000 7f700d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bb3b0 0x5583118c3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:47744/0 (socket says 172.21.15.18:47744) 2024-09-12T02:56:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.623+0000 7f700d400640 1 -- 172.21.15.18:0/2453882122 learned_addr learned my addr 172.21.15.18:0/2453882122 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.623+0000 7f700ca00640 1 --2- 172.21.15.18:0/2453882122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bbcd0 0x5583118c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.623+0000 7f700de00640 1 --2- 172.21.15.18:0/2453882122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118c6570 0x5583118c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.623+0000 7f700d400640 1 -- 172.21.15.18:0/2453882122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bbcd0 msgr2=0x5583118c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.623+0000 7f700d400640 1 --2- 172.21.15.18:0/2453882122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bbcd0 0x5583118c3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.623+0000 7f700d400640 1 -- 172.21.15.18:0/2453882122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118c6570 msgr2=0x5583118c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.623+0000 7f700d400640 1 --2- 172.21.15.18:0/2453882122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118c6570 0x5583118c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.623+0000 7f700d400640 1 -- 172.21.15.18:0/2453882122 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558311600620 con 0x5583118bb3b0 2024-09-12T02:56:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.624+0000 7f700d400640 1 --2- 172.21.15.18:0/2453882122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bb3b0 0x5583118c3590 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc02a930 tx=0x7f6ffc0304e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e17ece0012154570 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.624+0000 7f6feea00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:56:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.624+0000 7f6feea00640 1 -- 172.21.15.18:0/2453882122 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc037040 con 0x5583118bb3b0 2024-09-12T02:56:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.624+0000 7f7012c40740 1 -- 172.21.15.18:0/2453882122 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ffc030e40 con 0x5583118bb3b0 2024-09-12T02:56:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.624+0000 7f6feea00640 1 -- 172.21.15.18:0/2453882122 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9650+0+0 (secure 0 0 0) 0x7f6ffc0309a0 con 0x5583118bb3b0 2024-09-12T02:56:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.624+0000 7f6feea00640 1 -- 172.21.15.18:0/2453882122 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f6ffc056050 con 0x5583118bb3b0 2024-09-12T02:56:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.624+0000 7f7012c40740 10 client.25709 fetch_fsmap learned FSMap version 52 2024-09-12T02:56:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.624+0000 7f7012c40740 1 -- 172.21.15.18:0/2453882122 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5583118d4e60 con 0x5583118bb3b0 2024-09-12T02:56:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.625+0000 7f6feea00640 1 -- 172.21.15.18:0/2453882122 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ffc030e40 con 0x5583118bb3b0 2024-09-12T02:56:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.625+0000 7f6feea00640 1 -- 172.21.15.18:0/2453882122 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 52) ==== 8434+0+0 (secure 0 0 0) 0x7f6ffc03d780 con 0x5583118bb3b0 2024-09-12T02:56:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.625+0000 7f7012c40740 10 client.25709 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T02:56:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.625+0000 7f7012c40740 10 client.25709 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:56:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.625+0000 7f7012c40740 20 client.25709 populate_metadata read hostname 'smithi018' 2024-09-12T02:56:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.625+0000 7f7012c40740 1 --2- 172.21.15.18:0/2453882122 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5583118d61b0 0x5583118d85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.625+0000 7f7012c40740 4 client.25709 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:56:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.625+0000 7f7012c40740 1 -- 172.21.15.18:0/2453882122 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55831182e830 con 0x5583118d61b0 2024-09-12T02:56:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.625+0000 7f700ca00640 1 --2- 172.21.15.18:0/2453882122 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5583118d61b0 0x5583118d85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.626+0000 7f700ca00640 1 --2- 172.21.15.18:0/2453882122 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5583118d61b0 0x5583118d85a0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=317bbdff9fff6069 server_cookie=92e34c83c5de0c5f in_seq=0 out_seq=0 2024-09-12T02:56:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.626+0000 7f6feea00640 10 client.25709 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:56:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.629+0000 7f6feea00640 1 -- 172.21.15.18:0/2453882122 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55831182e830 con 0x5583118d61b0 2024-09-12T02:56:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.629+0000 7f6feea00640 10 client.25709 handle_command_reply: tid=0 2024-09-12T02:56:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.629+0000 7f7012c40740 1 client.25709 shutdown 2024-09-12T02:56:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.629+0000 7f7012c40740 1 -- 172.21.15.18:0/2453882122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bb3b0 msgr2=0x5583118c3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.629+0000 7f7012c40740 1 --2- 172.21.15.18:0/2453882122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bb3b0 0x5583118c3590 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc02a930 tx=0x7f6ffc0304e0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.629+0000 7f7012c40740 1 -- 172.21.15.18:0/2453882122 shutdown_connections 2024-09-12T02:56:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.629+0000 7f7012c40740 1 --2- 172.21.15.18:0/2453882122 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5583118d61b0 0x5583118d85a0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.629+0000 7f7012c40740 1 --2- 172.21.15.18:0/2453882122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118c6570 0x5583118c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.629+0000 7f7012c40740 1 --2- 172.21.15.18:0/2453882122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bbcd0 0x5583118c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.629+0000 7f7012c40740 1 --2- 172.21.15.18:0/2453882122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bb3b0 0x5583118c3590 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.629+0000 7f6feea00640 0 client.25709 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:56:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.629+0000 7f7012c40740 1 -- 172.21.15.18:0/2453882122 >> 172.21.15.18:0/2453882122 conn(0x5583118b7920 msgr2=0x5583118bd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.629+0000 7f7012c40740 1 -- 172.21.15.18:0/2453882122 shutdown_connections 2024-09-12T02:56:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.629+0000 7f7012c40740 1 -- 172.21.15.18:0/2453882122 wait complete. 2024-09-12T02:56:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.630+0000 7f7012c40740 20 client.25709 trim_cache size 0 max 16384 2024-09-12T02:56:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.645+0000 7f7012c40740 1 Processor -- start 2024-09-12T02:56:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.645+0000 7f7012c40740 1 -- start start 2024-09-12T02:56:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.646+0000 7f7012c40740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bb3b0 0x5583118ddb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.646+0000 7f7012c40740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118bbcd0 0x5583118de080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.646+0000 7f7012c40740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118c6570 0x5583118c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.646+0000 7f7012c40740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f70081b5690 con 0x5583118bbcd0 2024-09-12T02:56:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.646+0000 7f7012c40740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f70081b7440 con 0x5583118c6570 2024-09-12T02:56:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.646+0000 7f7012c40740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f70081b5d90 con 0x5583118bb3b0 2024-09-12T02:56:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.646+0000 7f700d400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bb3b0 0x5583118ddb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.646+0000 7f700ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118bbcd0 0x5583118de080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.646+0000 7f700d400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bb3b0 0x5583118ddb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:33160/0 (socket says 172.21.15.18:33160) 2024-09-12T02:56:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.646+0000 7f700d400640 1 -- 172.21.15.18:0/2433538314 learned_addr learned my addr 172.21.15.18:0/2433538314 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.646+0000 7f700de00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118c6570 0x5583118c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.647+0000 7f700d400640 1 -- 172.21.15.18:0/2433538314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118c6570 msgr2=0x5583118c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.647+0000 7f700d400640 1 --2- 172.21.15.18:0/2433538314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118c6570 0x5583118c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.647+0000 7f700d400640 1 -- 172.21.15.18:0/2433538314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118bbcd0 msgr2=0x5583118de080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.647+0000 7f700d400640 1 --2- 172.21.15.18:0/2433538314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118bbcd0 0x5583118de080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.647+0000 7f700d400640 1 -- 172.21.15.18:0/2433538314 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583118bb130 con 0x5583118bb3b0 2024-09-12T02:56:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.647+0000 7f700ca00640 1 --2- 172.21.15.18:0/2433538314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118bbcd0 0x5583118de080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.647+0000 7f700d400640 1 --2- 172.21.15.18:0/2433538314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bb3b0 0x5583118ddb40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc02a380 tx=0x7f6ffc005900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60273bafdee6cdf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.647+0000 7f6ff9c00640 1 -- 172.21.15.18:0/2433538314 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc037040 con 0x5583118bb3b0 2024-09-12T02:56:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.647+0000 7f6ff9c00640 1 -- 172.21.15.18:0/2433538314 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ffc049030 con 0x5583118bb3b0 2024-09-12T02:56:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.647+0000 7f6ff9c00640 1 -- 172.21.15.18:0/2433538314 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc005290 con 0x5583118bb3b0 2024-09-12T02:56:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.648+0000 7f7012c40740 1 -- 172.21.15.18:0/2433538314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bb3b0 msgr2=0x5583118ddb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.648+0000 7f7012c40740 1 --2- 172.21.15.18:0/2433538314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bb3b0 0x5583118ddb40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc02a380 tx=0x7f6ffc005900 comp rx=0 tx=0).stop 2024-09-12T02:56:24.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.648+0000 7f7012c40740 1 -- 172.21.15.18:0/2433538314 shutdown_connections 2024-09-12T02:56:24.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.648+0000 7f7012c40740 1 --2- 172.21.15.18:0/2433538314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118c6570 0x5583118c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.648+0000 7f7012c40740 1 --2- 172.21.15.18:0/2433538314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118bbcd0 0x5583118de080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.648+0000 7f7012c40740 1 --2- 172.21.15.18:0/2433538314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118bb3b0 0x5583118ddb40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.648+0000 7f7012c40740 1 -- 172.21.15.18:0/2433538314 >> 172.21.15.18:0/2433538314 conn(0x5583118b7920 msgr2=0x5583118c2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:24.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.648+0000 7f7012c40740 1 -- 172.21.15.18:0/2433538314 shutdown_connections 2024-09-12T02:56:24.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.648+0000 7f7012c40740 1 -- 172.21.15.18:0/2433538314 wait complete. 2024-09-12T02:56:24.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.649+0000 7f7012c40740 1 -- start start 2024-09-12T02:56:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.649+0000 7f7012c40740 1 Processor -- start 2024-09-12T02:56:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.649+0000 7f7012c40740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118bb3b0 0x5583118c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.649+0000 7f7012c40740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bbcd0 0x5583118ca190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.649+0000 7f7012c40740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118c6570 0x55831193eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.650+0000 7f7012c40740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f70081b6cb0 con 0x5583118bb3b0 2024-09-12T02:56:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.650+0000 7f7012c40740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f70081b6520 con 0x5583118bbcd0 2024-09-12T02:56:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.650+0000 7f7012c40740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f70081b3690 con 0x5583118c6570 2024-09-12T02:56:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.650+0000 7f7012c40740 10 client.0 _ll_register_callbacks cb 0x7f7000009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:56:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.650+0000 7f700ca00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bbcd0 0x5583118ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.650+0000 7f700ca00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bbcd0 0x5583118ca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:47764/0 (socket says 172.21.15.18:47764) 2024-09-12T02:56:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.650+0000 7f700ca00640 1 -- 172.21.15.18:0/2674590873 learned_addr learned my addr 172.21.15.18:0/2674590873 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.650+0000 7f700de00640 1 --2- 172.21.15.18:0/2674590873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118c6570 0x55831193eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.650+0000 7f700d400640 1 --2- 172.21.15.18:0/2674590873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118bb3b0 0x5583118c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.650+0000 7f700ca00640 1 -- 172.21.15.18:0/2674590873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118c6570 msgr2=0x55831193eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.650+0000 7f700ca00640 1 --2- 172.21.15.18:0/2674590873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118c6570 0x55831193eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.650+0000 7f700ca00640 1 -- 172.21.15.18:0/2674590873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118bb3b0 msgr2=0x5583118c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.650+0000 7f700ca00640 1 --2- 172.21.15.18:0/2674590873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118bb3b0 0x5583118c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.650+0000 7f700ca00640 1 -- 172.21.15.18:0/2674590873 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55831193f140 con 0x5583118bbcd0 2024-09-12T02:56:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.650+0000 7f700ca00640 1 --2- 172.21.15.18:0/2674590873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bbcd0 0x5583118ca190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4097c80 tx=0x7f6ff409bfe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e754e5ab5014a3da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.651+0000 7f6feea00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:56:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.651+0000 7f6feea00640 1 -- 172.21.15.18:0/2674590873 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff40b8070 con 0x5583118bbcd0 2024-09-12T02:56:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.651+0000 7f6feea00640 1 -- 172.21.15.18:0/2674590873 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9650+0+0 (secure 0 0 0) 0x7f6ff40860b0 con 0x5583118bbcd0 2024-09-12T02:56:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.651+0000 7f7012c40740 1 -- 172.21.15.18:0/2674590873 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ffc049030 con 0x5583118bbcd0 2024-09-12T02:56:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.651+0000 7f6feea00640 1 -- 172.21.15.18:0/2674590873 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f6ff4081050 con 0x5583118bbcd0 2024-09-12T02:56:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.651+0000 7f7012c40740 10 client.25715 fetch_fsmap learned FSMap version 52 2024-09-12T02:56:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.651+0000 7f7012c40740 1 -- 172.21.15.18:0/2674590873 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x558311940490 con 0x5583118bbcd0 2024-09-12T02:56:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.651+0000 7f6feea00640 1 -- 172.21.15.18:0/2674590873 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ffc049030 con 0x5583118bbcd0 2024-09-12T02:56:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.652+0000 7f6feea00640 1 -- 172.21.15.18:0/2674590873 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 52) ==== 8434+0+0 (secure 0 0 0) 0x7f6ff4097e90 con 0x5583118bbcd0 2024-09-12T02:56:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.652+0000 7f7012c40740 10 client.25715 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T02:56:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.652+0000 7f7012c40740 10 client.25715 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:56:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.652+0000 7f7012c40740 20 client.25715 populate_metadata read hostname 'smithi018' 2024-09-12T02:56:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.652+0000 7f7012c40740 1 --2- 172.21.15.18:0/2674590873 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5583118d61b0 0x558311942cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.652+0000 7f7012c40740 4 client.25715 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:56:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.652+0000 7f7012c40740 1 -- 172.21.15.18:0/2674590873 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558311828b80 con 0x5583118d61b0 2024-09-12T02:56:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.652+0000 7f700d400640 1 --2- 172.21.15.18:0/2674590873 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5583118d61b0 0x558311942cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.652+0000 7f700d400640 1 --2- 172.21.15.18:0/2674590873 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5583118d61b0 0x558311942cc0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd690a54a0a99d1d server_cookie=2df0a9926e57ae45 in_seq=0 out_seq=0 2024-09-12T02:56:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:24.652+0000 7f6feea00640 10 client.25715 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:56:24.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:24 smithi176 ceph-mon[35713]: pgmap v236: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 421 KiB/s wr, 53 op/s 2024-09-12T02:56:24.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:24 smithi062 ceph-mon[35527]: pgmap v236: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 421 KiB/s wr, 53 op/s 2024-09-12T02:56:26.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:26 smithi018 ceph-mon[30616]: pgmap v237: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 820 KiB/s wr, 52 op/s 2024-09-12T02:56:26.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:26 smithi018 ceph-mon[30616]: osdmap e103: 12 total, 12 up, 12 in 2024-09-12T02:56:26.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:26 smithi176 ceph-mon[35713]: pgmap v237: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 820 KiB/s wr, 52 op/s 2024-09-12T02:56:26.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:26 smithi176 ceph-mon[35713]: osdmap e103: 12 total, 12 up, 12 in 2024-09-12T02:56:26.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:26 smithi062 ceph-mon[35527]: pgmap v237: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 820 KiB/s wr, 52 op/s 2024-09-12T02:56:26.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:26 smithi062 ceph-mon[35527]: osdmap e103: 12 total, 12 up, 12 in 2024-09-12T02:56:27.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.076+0000 7f6feea00640 1 -- 172.21.15.18:0/2674590873 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558311828b80 con 0x5583118d61b0 2024-09-12T02:56:27.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.076+0000 7f6feea00640 10 client.25715 handle_command_reply: tid=0 2024-09-12T02:56:27.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.076+0000 7f7012c40740 1 client.25715 shutdown 2024-09-12T02:56:27.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.076+0000 7f7012c40740 1 -- 172.21.15.18:0/2674590873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bbcd0 msgr2=0x5583118ca190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.076+0000 7f7012c40740 1 --2- 172.21.15.18:0/2674590873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bbcd0 0x5583118ca190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4097c80 tx=0x7f6ff409bfe0 comp rx=0 tx=0).stop 2024-09-12T02:56:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.076+0000 7f7012c40740 1 -- 172.21.15.18:0/2674590873 shutdown_connections 2024-09-12T02:56:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.076+0000 7f7012c40740 1 --2- 172.21.15.18:0/2674590873 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5583118d61b0 0x558311942cc0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.076+0000 7f7012c40740 1 --2- 172.21.15.18:0/2674590873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5583118c6570 0x55831193eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.076+0000 7f7012c40740 1 --2- 172.21.15.18:0/2674590873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5583118bbcd0 0x5583118ca190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.076+0000 7f7012c40740 1 --2- 172.21.15.18:0/2674590873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583118bb3b0 0x5583118c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.076+0000 7f7012c40740 1 -- 172.21.15.18:0/2674590873 >> 172.21.15.18:0/2674590873 conn(0x5583118b7920 msgr2=0x5583118bce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.077+0000 7f6feea00640 0 client.25715 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:56:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.077+0000 7f7012c40740 1 -- 172.21.15.18:0/2674590873 shutdown_connections 2024-09-12T02:56:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.077+0000 7f7012c40740 1 -- 172.21.15.18:0/2674590873 wait complete. 2024-09-12T02:56:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.077+0000 7f7012c40740 20 client.25715 trim_cache size 0 max 16384 2024-09-12T02:56:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:56:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:56:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:56:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:56:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.078+0000 7f700e800640 1 -- 172.21.15.18:0/3725271690 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6ff00a2d70 msgr2=0x7f6ff00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.078+0000 7f700e800640 1 --2- 172.21.15.18:0/3725271690 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6ff00a2d70 0x7f6ff00a5230 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f70081a5210 tx=0x7f7000009500 comp rx=0 tx=0).stop 2024-09-12T02:56:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.078+0000 7f700e800640 1 -- 172.21.15.18:0/3725271690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70081044a0 msgr2=0x7f70081a4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.078+0000 7f700e800640 1 --2- 172.21.15.18:0/3725271690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70081044a0 0x7f70081a4a50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4009fd0 tx=0x7f6ff400ec20 comp rx=0 tx=0).stop 2024-09-12T02:56:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.078+0000 7f700e800640 1 -- 172.21.15.18:0/3725271690 shutdown_connections 2024-09-12T02:56:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.078+0000 7f700e800640 1 --2- 172.21.15.18:0/3725271690 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6ff00a2d70 0x7f6ff00a5230 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.078+0000 7f700e800640 1 --2- 172.21.15.18:0/3725271690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7008109ba0 0x7f700810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.078+0000 7f700e800640 1 --2- 172.21.15.18:0/3725271690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70081044a0 0x7f70081a4a50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.078+0000 7f700e800640 1 --2- 172.21.15.18:0/3725271690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7008103b00 0x7f70081a4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.078+0000 7f700e800640 1 -- 172.21.15.18:0/3725271690 >> 172.21.15.18:0/3725271690 conn(0x7f70080ff7c0 msgr2=0x7f7008078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.078+0000 7f700e800640 1 -- 172.21.15.18:0/3725271690 shutdown_connections 2024-09-12T02:56:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:27.078+0000 7f700e800640 1 -- 172.21.15.18:0/3725271690 wait complete. 2024-09-12T02:56:28.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:28 smithi018 ceph-mon[30616]: pgmap v239: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 717 KiB/s wr, 31 op/s 2024-09-12T02:56:28.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:28 smithi176 ceph-mon[35713]: pgmap v239: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 717 KiB/s wr, 31 op/s 2024-09-12T02:56:28.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:28 smithi062 ceph-mon[35527]: pgmap v239: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 717 KiB/s wr, 31 op/s 2024-09-12T02:56:30.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:30 smithi176 ceph-mon[35713]: pgmap v240: 129 pgs: 129 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 7.1 MiB/s wr, 165 op/s 2024-09-12T02:56:30.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:30 smithi062 ceph-mon[35527]: pgmap v240: 129 pgs: 129 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 7.1 MiB/s wr, 165 op/s 2024-09-12T02:56:30.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:30 smithi018 ceph-mon[30616]: pgmap v240: 129 pgs: 129 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 7.1 MiB/s wr, 165 op/s 2024-09-12T02:56:32.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:32 smithi176 ceph-mon[35713]: pgmap v241: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 11 MiB/s wr, 239 op/s 2024-09-12T02:56:32.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:32 smithi062 ceph-mon[35527]: pgmap v241: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 11 MiB/s wr, 239 op/s 2024-09-12T02:56:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:32 smithi018 ceph-mon[30616]: pgmap v241: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 11 MiB/s wr, 239 op/s 2024-09-12T02:56:34.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:34 smithi176 ceph-mon[35713]: pgmap v242: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 13 MiB/s wr, 258 op/s 2024-09-12T02:56:34.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:34 smithi062 ceph-mon[35527]: pgmap v242: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 13 MiB/s wr, 258 op/s 2024-09-12T02:56:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:34 smithi018 ceph-mon[30616]: pgmap v242: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 13 MiB/s wr, 258 op/s 2024-09-12T02:56:36.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:36 smithi176 ceph-mon[35713]: pgmap v243: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 15 MiB/s wr, 340 op/s 2024-09-12T02:56:36.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:36 smithi062 ceph-mon[35527]: pgmap v243: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 15 MiB/s wr, 340 op/s 2024-09-12T02:56:36.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:36 smithi018 ceph-mon[30616]: pgmap v243: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 15 MiB/s wr, 340 op/s 2024-09-12T02:56:38.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:38 smithi176 ceph-mon[35713]: pgmap v244: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 14 MiB/s wr, 311 op/s 2024-09-12T02:56:38.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:38 smithi062 ceph-mon[35527]: pgmap v244: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 14 MiB/s wr, 311 op/s 2024-09-12T02:56:38.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:38 smithi018 ceph-mon[30616]: pgmap v244: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 14 MiB/s wr, 311 op/s 2024-09-12T02:56:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.208+0000 7f2562800640 1 -- 172.21.15.18:0/3405523883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c112780 msgr2=0x7f255c114b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.208+0000 7f2562800640 1 --2- 172.21.15.18:0/3405523883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c112780 0x7f255c114b70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2554009be0 tx=0x7f255402a6d0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.209+0000 7f2562800640 1 -- 172.21.15.18:0/3405523883 shutdown_connections 2024-09-12T02:56:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.209+0000 7f2562800640 1 --2- 172.21.15.18:0/3405523883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c112780 0x7f255c114b70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.209+0000 7f2562800640 1 --2- 172.21.15.18:0/3405523883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255c077040 0x7f255c112240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.209+0000 7f2562800640 1 --2- 172.21.15.18:0/3405523883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f255c076720 0x7f255c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.209+0000 7f2562800640 1 -- 172.21.15.18:0/3405523883 >> 172.21.15.18:0/3405523883 conn(0x7f255c0ff7c0 msgr2=0x7f255c101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.209+0000 7f2562800640 1 -- 172.21.15.18:0/3405523883 shutdown_connections 2024-09-12T02:56:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.209+0000 7f2562800640 1 -- 172.21.15.18:0/3405523883 wait complete. 2024-09-12T02:56:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.209+0000 7f2562800640 1 Processor -- start 2024-09-12T02:56:40.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.210+0000 7f2562800640 1 -- start start 2024-09-12T02:56:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.210+0000 7f2562800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c076720 0x7f255c1a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.210+0000 7f2562800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f255c077040 0x7f255c1a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.210+0000 7f2562800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255c112780 0x7f255c19e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.210+0000 7f2562800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f255c1182d0 con 0x7f255c112780 2024-09-12T02:56:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.210+0000 7f2562800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f255c118150 con 0x7f255c076720 2024-09-12T02:56:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.210+0000 7f2562800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f255c118450 con 0x7f255c077040 2024-09-12T02:56:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.210+0000 7f2560a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f255c077040 0x7f255c1a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.210+0000 7f2560a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f255c077040 0x7f255c1a4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:57578/0 (socket says 172.21.15.18:57578) 2024-09-12T02:56:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.210+0000 7f2560a00640 1 -- 172.21.15.18:0/3637550720 learned_addr learned my addr 172.21.15.18:0/3637550720 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.210+0000 7f2561e00640 1 --2- 172.21.15.18:0/3637550720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255c112780 0x7f255c19e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.210+0000 7f2561400640 1 --2- 172.21.15.18:0/3637550720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c076720 0x7f255c1a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.211+0000 7f2561e00640 1 -- 172.21.15.18:0/3637550720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f255c077040 msgr2=0x7f255c1a4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.211+0000 7f2561e00640 1 --2- 172.21.15.18:0/3637550720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f255c077040 0x7f255c1a4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.211+0000 7f2561e00640 1 -- 172.21.15.18:0/3637550720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c076720 msgr2=0x7f255c1a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.211+0000 7f2561e00640 1 --2- 172.21.15.18:0/3637550720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c076720 0x7f255c1a4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.211+0000 7f2561e00640 1 -- 172.21.15.18:0/3637550720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255c19ef00 con 0x7f255c112780 2024-09-12T02:56:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.211+0000 7f2561400640 1 --2- 172.21.15.18:0/3637550720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c076720 0x7f255c1a4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.211+0000 7f2561e00640 1 --2- 172.21.15.18:0/3637550720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255c112780 0x7f255c19e640 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2554034040 tx=0x7f25540305d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.211+0000 7f255a000640 1 -- 172.21.15.18:0/3637550720 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2554041020 con 0x7f255c112780 2024-09-12T02:56:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.212+0000 7f255a000640 1 -- 172.21.15.18:0/3637550720 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2554003e50 con 0x7f255c112780 2024-09-12T02:56:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.212+0000 7f2562800640 1 -- 172.21.15.18:0/3637550720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f255c19f190 con 0x7f255c112780 2024-09-12T02:56:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.212+0000 7f255a000640 1 -- 172.21.15.18:0/3637550720 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2554036040 con 0x7f255c112780 2024-09-12T02:56:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.212+0000 7f2562800640 1 -- 172.21.15.18:0/3637550720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f255c1ab320 con 0x7f255c112780 2024-09-12T02:56:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.216+0000 7f2566e16740 1 Processor -- start 2024-09-12T02:56:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.216+0000 7f255a000640 1 -- 172.21.15.18:0/3637550720 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f2554044020 con 0x7f255c112780 2024-09-12T02:56:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.216+0000 7f2566e16740 1 -- start start 2024-09-12T02:56:40.219 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.216+0000 7f2566e16740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383fa3b0 0x5598383fa790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.219 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.216+0000 7f2566e16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383facd0 0x559838405030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.216+0000 7f2566e16740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559838405570 0x559838407960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.216+0000 7f2566e16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559838360100 con 0x5598383facd0 2024-09-12T02:56:40.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.216+0000 7f2566e16740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5598383081b0 con 0x5598383fa3b0 2024-09-12T02:56:40.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.216+0000 7f2566e16740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55983835c0c0 con 0x559838405570 2024-09-12T02:56:40.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.217+0000 7f2561400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383facd0 0x559838405030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.217+0000 7f2561400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383facd0 0x559838405030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35214/0 (socket says 172.21.15.18:35214) 2024-09-12T02:56:40.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.217+0000 7f2561400640 1 -- 172.21.15.18:0/2737765587 learned_addr learned my addr 172.21.15.18:0/2737765587 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:40.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.217+0000 7f2560a00640 1 --2- 172.21.15.18:0/2737765587 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559838405570 0x559838407960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.217+0000 7f2560a00640 1 --2- 172.21.15.18:0/2737765587 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383fa3b0 0x5598383fa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.217+0000 7f2561400640 1 -- 172.21.15.18:0/2737765587 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559838405570 msgr2=0x559838407960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:40.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.217+0000 7f2561400640 1 --2- 172.21.15.18:0/2737765587 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559838405570 0x559838407960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.217+0000 7f2561400640 1 -- 172.21.15.18:0/2737765587 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383fa3b0 msgr2=0x5598383fa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:40.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.217+0000 7f2561400640 1 --2- 172.21.15.18:0/2737765587 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383fa3b0 0x5598383fa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.217+0000 7f2561400640 1 -- 172.21.15.18:0/2737765587 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559838073210 con 0x5598383facd0 2024-09-12T02:56:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.217+0000 7f2560a00640 1 --2- 172.21.15.18:0/2737765587 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383fa3b0 0x5598383fa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:56:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.218+0000 7f2561400640 1 --2- 172.21.15.18:0/2737765587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383facd0 0x559838405030 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f25500115c0 tx=0x7f2550011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af3e60f393adcc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.218+0000 7f255a000640 1 --2- 172.21.15.18:0/3637550720 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f25440a2cf0 0x7f25440a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.218+0000 7f254e600640 1 -- 172.21.15.18:0/2737765587 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255000f640 con 0x5598383facd0 2024-09-12T02:56:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.218+0000 7f255a000640 1 -- 172.21.15.18:0/3637550720 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9562+0+0 (secure 0 0 0) 0x7f25540f0400 con 0x7f255c112780 2024-09-12T02:56:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.218+0000 7f254e600640 1 -- 172.21.15.18:0/2737765587 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f255000fcc0 con 0x5598383facd0 2024-09-12T02:56:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.218+0000 7f254e600640 1 -- 172.21.15.18:0/2737765587 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2550019db0 con 0x5598383facd0 2024-09-12T02:56:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.218+0000 7f2560a00640 1 --2- 172.21.15.18:0/3637550720 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f25440a2cf0 0x7f25440a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.219+0000 7f2566e16740 1 -- 172.21.15.18:0/2737765587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383facd0 msgr2=0x559838405030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.219+0000 7f2566e16740 1 --2- 172.21.15.18:0/2737765587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383facd0 0x559838405030 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f25500115c0 tx=0x7f2550011a80 comp rx=0 tx=0).stop 2024-09-12T02:56:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.219+0000 7f2560a00640 1 --2- 172.21.15.18:0/3637550720 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f25440a2cf0 0x7f25440a51b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x5598383f7ca0 tx=0x7f2548009260 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.219+0000 7f2566e16740 1 -- 172.21.15.18:0/2737765587 shutdown_connections 2024-09-12T02:56:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.219+0000 7f2566e16740 1 --2- 172.21.15.18:0/2737765587 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559838405570 0x559838407960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.219+0000 7f2566e16740 1 --2- 172.21.15.18:0/2737765587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383facd0 0x559838405030 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.219+0000 7f2566e16740 1 --2- 172.21.15.18:0/2737765587 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383fa3b0 0x5598383fa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.219+0000 7f2566e16740 1 -- 172.21.15.18:0/2737765587 >> 172.21.15.18:0/2737765587 conn(0x5598383f6920 msgr2=0x5598383f6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.219+0000 7f2566e16740 1 -- 172.21.15.18:0/2737765587 shutdown_connections 2024-09-12T02:56:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.219+0000 7f2566e16740 1 -- 172.21.15.18:0/2737765587 wait complete. 2024-09-12T02:56:40.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.219+0000 7f2566e16740 1 -- start start 2024-09-12T02:56:40.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.220+0000 7f2566e16740 1 Processor -- start 2024-09-12T02:56:40.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.220+0000 7f2566e16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383fa3b0 0x5598384025c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.220+0000 7f2566e16740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598383facd0 0x559838402b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.220+0000 7f2566e16740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559838405570 0x559838403040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.220+0000 7f2566e16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5598384080e0 con 0x5598383fa3b0 2024-09-12T02:56:40.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.220+0000 7f2566e16740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5598382e9090 con 0x559838405570 2024-09-12T02:56:40.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.220+0000 7f2566e16740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x559838408260 con 0x5598383facd0 2024-09-12T02:56:40.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.220+0000 7f2566e16740 10 client.0 _ll_register_callbacks cb 0x55983833df30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:56:40.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.220+0000 7f2561400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383fa3b0 0x5598384025c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.220+0000 7f2561400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383fa3b0 0x5598384025c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35222/0 (socket says 172.21.15.18:35222) 2024-09-12T02:56:40.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.220+0000 7f2561400640 1 -- 172.21.15.18:0/365871130 learned_addr learned my addr 172.21.15.18:0/365871130 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:40.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.220+0000 7f2560a00640 1 --2- 172.21.15.18:0/365871130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598383facd0 0x559838402b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.220+0000 7f2561e00640 1 --2- 172.21.15.18:0/365871130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559838405570 0x559838403040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.221+0000 7f2561400640 1 -- 172.21.15.18:0/365871130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598383facd0 msgr2=0x559838402b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:40.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.221+0000 7f2561400640 1 --2- 172.21.15.18:0/365871130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598383facd0 0x559838402b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.221+0000 7f2561400640 1 -- 172.21.15.18:0/365871130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559838405570 msgr2=0x559838403040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:40.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.221+0000 7f2561400640 1 --2- 172.21.15.18:0/365871130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559838405570 0x559838403040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.221+0000 7f2561400640 1 -- 172.21.15.18:0/365871130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55983813f620 con 0x5598383fa3b0 2024-09-12T02:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.221+0000 7f2561400640 1 --2- 172.21.15.18:0/365871130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383fa3b0 0x5598384025c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2550019d80 tx=0x7f2550019db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e3d037d1684853 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.221+0000 7f2542a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.221+0000 7f2542a00640 1 -- 172.21.15.18:0/365871130 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2550026020 con 0x5598383fa3b0 2024-09-12T02:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.221+0000 7f2566e16740 1 -- 172.21.15.18:0/365871130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f255000fcc0 con 0x5598383fa3b0 2024-09-12T02:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.221+0000 7f2542a00640 1 -- 172.21.15.18:0/365871130 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9562+0+0 (secure 0 0 0) 0x7f2550004250 con 0x5598383fa3b0 2024-09-12T02:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.222+0000 7f2542a00640 1 -- 172.21.15.18:0/365871130 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f2550031050 con 0x5598383fa3b0 2024-09-12T02:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.222+0000 7f2566e16740 10 client.15735 fetch_fsmap learned FSMap version 53 2024-09-12T02:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.222+0000 7f2566e16740 1 -- 172.21.15.18:0/365871130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x559838413e50 con 0x5598383fa3b0 2024-09-12T02:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.222+0000 7f2542a00640 1 -- 172.21.15.18:0/365871130 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f255000fcc0 con 0x5598383fa3b0 2024-09-12T02:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.222+0000 7f2542a00640 1 -- 172.21.15.18:0/365871130 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 53) ==== 8430+0+0 (secure 0 0 0) 0x7f2550003850 con 0x5598383fa3b0 2024-09-12T02:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.222+0000 7f2566e16740 10 client.15735 fetch_fsmap finished waiting for FSMap version 53 2024-09-12T02:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.222+0000 7f2566e16740 10 client.15735 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:56:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.222+0000 7f2566e16740 20 client.15735 populate_metadata read hostname 'smithi018' 2024-09-12T02:56:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.222+0000 7f2566e16740 1 --2- 172.21.15.18:0/365871130 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5598384152b0 0x5598384176a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.222+0000 7f2566e16740 4 client.15735 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:56:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.222+0000 7f2566e16740 1 -- 172.21.15.18:0/365871130 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55983836d830 con 0x5598384152b0 2024-09-12T02:56:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.223+0000 7f2560a00640 1 --2- 172.21.15.18:0/365871130 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5598384152b0 0x5598384176a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.224+0000 7f2560a00640 1 --2- 172.21.15.18:0/365871130 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5598384152b0 0x5598384176a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f21ea6902c1ba01d server_cookie=e15c351b53d7a28 in_seq=0 out_seq=0 2024-09-12T02:56:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.224+0000 7f2542a00640 10 client.15735 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:56:40.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.224+0000 7f2542a00640 1 -- 172.21.15.18:0/365871130 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55983836d830 con 0x5598384152b0 2024-09-12T02:56:40.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.225+0000 7f2542a00640 10 client.15735 handle_command_reply: tid=0 2024-09-12T02:56:40.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.225+0000 7f2566e16740 1 client.15735 shutdown 2024-09-12T02:56:40.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.225+0000 7f2566e16740 1 -- 172.21.15.18:0/365871130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383fa3b0 msgr2=0x5598384025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:40.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.225+0000 7f2566e16740 1 --2- 172.21.15.18:0/365871130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383fa3b0 0x5598384025c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2550019d80 tx=0x7f2550019db0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.225+0000 7f2566e16740 1 -- 172.21.15.18:0/365871130 shutdown_connections 2024-09-12T02:56:40.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.225+0000 7f2566e16740 1 --2- 172.21.15.18:0/365871130 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5598384152b0 0x5598384176a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.225+0000 7f2566e16740 1 --2- 172.21.15.18:0/365871130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559838405570 0x559838403040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.225+0000 7f2566e16740 1 --2- 172.21.15.18:0/365871130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598383facd0 0x559838402b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.225+0000 7f2566e16740 1 --2- 172.21.15.18:0/365871130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383fa3b0 0x5598384025c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.225+0000 7f2566e16740 1 -- 172.21.15.18:0/365871130 >> 172.21.15.18:0/365871130 conn(0x5598383f6920 msgr2=0x5598383fc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:40.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.225+0000 7f2542a00640 0 client.15735 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:56:40.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.225+0000 7f2566e16740 1 -- 172.21.15.18:0/365871130 shutdown_connections 2024-09-12T02:56:40.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.225+0000 7f2566e16740 1 -- 172.21.15.18:0/365871130 wait complete. 2024-09-12T02:56:40.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.225+0000 7f2566e16740 20 client.15735 trim_cache size 0 max 16384 2024-09-12T02:56:40.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.241+0000 7f2566e16740 1 Processor -- start 2024-09-12T02:56:40.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.241+0000 7f2566e16740 1 -- start start 2024-09-12T02:56:40.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.241+0000 7f2566e16740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383fa3b0 0x55983841cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.241+0000 7f2566e16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383facd0 0x55983841d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.241+0000 7f2566e16740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559838405570 0x5598383ff800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.241+0000 7f2566e16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f255c1b5540 con 0x5598383facd0 2024-09-12T02:56:40.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.241+0000 7f2566e16740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f255c1b72c0 con 0x5598383fa3b0 2024-09-12T02:56:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.241+0000 7f2566e16740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f255c1b5c10 con 0x559838405570 2024-09-12T02:56:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.241+0000 7f2561400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383fa3b0 0x55983841cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.241+0000 7f2560a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383facd0 0x55983841d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.241+0000 7f2561400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383fa3b0 0x55983841cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:37752/0 (socket says 172.21.15.18:37752) 2024-09-12T02:56:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.241+0000 7f2561400640 1 -- 172.21.15.18:0/3766369240 learned_addr learned my addr 172.21.15.18:0/3766369240 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.241+0000 7f2561e00640 1 --2- 172.21.15.18:0/3766369240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559838405570 0x5598383ff800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.242+0000 7f2561400640 1 -- 172.21.15.18:0/3766369240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559838405570 msgr2=0x5598383ff800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.242+0000 7f2561400640 1 --2- 172.21.15.18:0/3766369240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559838405570 0x5598383ff800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.242+0000 7f2561400640 1 -- 172.21.15.18:0/3766369240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383facd0 msgr2=0x55983841d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.242+0000 7f2561400640 1 --2- 172.21.15.18:0/3766369240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383facd0 0x55983841d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.242+0000 7f2561400640 1 -- 172.21.15.18:0/3766369240 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559838408020 con 0x5598383fa3b0 2024-09-12T02:56:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.242+0000 7f2560a00640 1 --2- 172.21.15.18:0/3766369240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383facd0 0x55983841d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.242+0000 7f2561400640 1 --2- 172.21.15.18:0/3766369240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383fa3b0 0x55983841cf20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f25500115c0 tx=0x7f25500059b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e15cf095b4222f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.242+0000 7f254dc00640 1 -- 172.21.15.18:0/3766369240 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2550026070 con 0x5598383fa3b0 2024-09-12T02:56:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.242+0000 7f254dc00640 1 -- 172.21.15.18:0/3766369240 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2550019720 con 0x5598383fa3b0 2024-09-12T02:56:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.242+0000 7f254dc00640 1 -- 172.21.15.18:0/3766369240 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2550005520 con 0x5598383fa3b0 2024-09-12T02:56:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.243+0000 7f2566e16740 1 -- 172.21.15.18:0/3766369240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383fa3b0 msgr2=0x55983841cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.243+0000 7f2566e16740 1 --2- 172.21.15.18:0/3766369240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383fa3b0 0x55983841cf20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f25500115c0 tx=0x7f25500059b0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.243+0000 7f2566e16740 1 -- 172.21.15.18:0/3766369240 shutdown_connections 2024-09-12T02:56:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.243+0000 7f2566e16740 1 --2- 172.21.15.18:0/3766369240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559838405570 0x5598383ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.243+0000 7f2566e16740 1 --2- 172.21.15.18:0/3766369240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5598383facd0 0x55983841d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.243+0000 7f2566e16740 1 --2- 172.21.15.18:0/3766369240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383fa3b0 0x55983841cf20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.243+0000 7f2566e16740 1 -- 172.21.15.18:0/3766369240 >> 172.21.15.18:0/3766369240 conn(0x5598383f6920 msgr2=0x559838400e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.243+0000 7f2566e16740 1 -- 172.21.15.18:0/3766369240 shutdown_connections 2024-09-12T02:56:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.243+0000 7f2566e16740 1 -- 172.21.15.18:0/3766369240 wait complete. 2024-09-12T02:56:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.243+0000 7f2566e16740 1 -- start start 2024-09-12T02:56:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.244+0000 7f2566e16740 1 Processor -- start 2024-09-12T02:56:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.244+0000 7f2566e16740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598383fa3b0 0x559838408470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.244+0000 7f2566e16740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383facd0 0x5598384089b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.244+0000 7f2566e16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559838405570 0x559838408ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.244+0000 7f2566e16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f255c1b6b30 con 0x559838405570 2024-09-12T02:56:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.244+0000 7f2566e16740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f255c1b63a0 con 0x5598383facd0 2024-09-12T02:56:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.244+0000 7f2566e16740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f255c1b3540 con 0x5598383fa3b0 2024-09-12T02:56:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.244+0000 7f2566e16740 10 client.0 _ll_register_callbacks cb 0x7f2548009ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:56:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.244+0000 7f2561400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598383fa3b0 0x559838408470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.244+0000 7f2561e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559838405570 0x559838408ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.244+0000 7f2560a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383facd0 0x5598384089b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.244+0000 7f2561400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598383fa3b0 0x559838408470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:57602/0 (socket says 172.21.15.18:57602) 2024-09-12T02:56:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.244+0000 7f2561400640 1 -- 172.21.15.18:0/1110652604 learned_addr learned my addr 172.21.15.18:0/1110652604 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.245+0000 7f2561400640 1 -- 172.21.15.18:0/1110652604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383facd0 msgr2=0x5598384089b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.245+0000 7f2561400640 1 --2- 172.21.15.18:0/1110652604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383facd0 0x5598384089b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.245+0000 7f2561400640 1 -- 172.21.15.18:0/1110652604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559838405570 msgr2=0x559838408ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.245+0000 7f2561400640 1 --2- 172.21.15.18:0/1110652604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559838405570 0x559838408ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.245+0000 7f2561400640 1 -- 172.21.15.18:0/1110652604 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55983847e010 con 0x5598383fa3b0 2024-09-12T02:56:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.245+0000 7f2561e00640 1 --2- 172.21.15.18:0/1110652604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559838405570 0x559838408ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.245+0000 7f2561400640 1 --2- 172.21.15.18:0/1110652604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598383fa3b0 0x559838408470 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f25500038b0 tx=0x7f25500198d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ddd6a5a6f6f7b22 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:40.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.245+0000 7f2542a00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:56:40.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.245+0000 7f2542a00640 1 -- 172.21.15.18:0/1110652604 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2550026070 con 0x5598383fa3b0 2024-09-12T02:56:40.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.245+0000 7f2566e16740 1 -- 172.21.15.18:0/1110652604 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2550019720 con 0x5598383fa3b0 2024-09-12T02:56:40.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.245+0000 7f2542a00640 1 -- 172.21.15.18:0/1110652604 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9562+0+0 (secure 0 0 0) 0x7f255000fcc0 con 0x5598383fa3b0 2024-09-12T02:56:40.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.246+0000 7f2542a00640 1 -- 172.21.15.18:0/1110652604 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f2550048050 con 0x5598383fa3b0 2024-09-12T02:56:40.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.246+0000 7f2566e16740 10 client.25735 fetch_fsmap learned FSMap version 53 2024-09-12T02:56:40.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.246+0000 7f2566e16740 1 -- 172.21.15.18:0/1110652604 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55983847f2e0 con 0x5598383fa3b0 2024-09-12T02:56:40.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.246+0000 7f2542a00640 1 -- 172.21.15.18:0/1110652604 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2550019720 con 0x5598383fa3b0 2024-09-12T02:56:40.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.246+0000 7f2542a00640 1 -- 172.21.15.18:0/1110652604 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 53) ==== 8430+0+0 (secure 0 0 0) 0x7f2550022480 con 0x5598383fa3b0 2024-09-12T02:56:40.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.246+0000 7f2566e16740 10 client.25735 fetch_fsmap finished waiting for FSMap version 53 2024-09-12T02:56:40.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.246+0000 7f2566e16740 10 client.25735 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:56:40.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.246+0000 7f2566e16740 20 client.25735 populate_metadata read hostname 'smithi018' 2024-09-12T02:56:40.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.246+0000 7f2566e16740 1 --2- 172.21.15.18:0/1110652604 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55983847f970 0x559838481d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.246+0000 7f2566e16740 4 client.25735 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:56:40.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.246+0000 7f2566e16740 1 -- 172.21.15.18:0/1110652604 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559838367b80 con 0x55983847f970 2024-09-12T02:56:40.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.247+0000 7f2560a00640 1 --2- 172.21.15.18:0/1110652604 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55983847f970 0x559838481d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.247+0000 7f2560a00640 1 --2- 172.21.15.18:0/1110652604 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55983847f970 0x559838481d90 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c04f266c178db4f8 server_cookie=79f0311e289293a4 in_seq=0 out_seq=0 2024-09-12T02:56:40.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.247+0000 7f2542a00640 10 client.25735 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:56:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.638+0000 7f2542a00640 1 -- 172.21.15.18:0/1110652604 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559838367b80 con 0x55983847f970 2024-09-12T02:56:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.638+0000 7f2542a00640 10 client.25735 handle_command_reply: tid=0 2024-09-12T02:56:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.638+0000 7f2566e16740 1 client.25735 shutdown 2024-09-12T02:56:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.638+0000 7f2566e16740 1 -- 172.21.15.18:0/1110652604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598383fa3b0 msgr2=0x559838408470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.638+0000 7f2566e16740 1 --2- 172.21.15.18:0/1110652604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598383fa3b0 0x559838408470 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f25500038b0 tx=0x7f25500198d0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.638+0000 7f2566e16740 1 -- 172.21.15.18:0/1110652604 shutdown_connections 2024-09-12T02:56:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.638+0000 7f2566e16740 1 --2- 172.21.15.18:0/1110652604 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55983847f970 0x559838481d90 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.638+0000 7f2566e16740 1 --2- 172.21.15.18:0/1110652604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559838405570 0x559838408ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.638+0000 7f2566e16740 1 --2- 172.21.15.18:0/1110652604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5598383facd0 0x5598384089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.638+0000 7f2566e16740 1 --2- 172.21.15.18:0/1110652604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598383fa3b0 0x559838408470 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.638+0000 7f2566e16740 1 -- 172.21.15.18:0/1110652604 >> 172.21.15.18:0/1110652604 conn(0x5598383f6920 msgr2=0x559838403ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.640+0000 7f2542a00640 0 client.25735 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:56:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.641+0000 7f2566e16740 1 -- 172.21.15.18:0/1110652604 shutdown_connections 2024-09-12T02:56:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.641+0000 7f2566e16740 1 -- 172.21.15.18:0/1110652604 wait complete. 2024-09-12T02:56:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.641+0000 7f2566e16740 20 client.25735 trim_cache size 0 max 16384 2024-09-12T02:56:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:56:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:56:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:56:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:56:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.642+0000 7f2562800640 1 -- 172.21.15.18:0/3637550720 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f25440a2cf0 msgr2=0x7f25440a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.642+0000 7f2562800640 1 --2- 172.21.15.18:0/3637550720 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f25440a2cf0 0x7f25440a51b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x5598383f7ca0 tx=0x7f2548009260 comp rx=0 tx=0).stop 2024-09-12T02:56:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.642+0000 7f2562800640 1 -- 172.21.15.18:0/3637550720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255c112780 msgr2=0x7f255c19e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.642+0000 7f2562800640 1 --2- 172.21.15.18:0/3637550720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255c112780 0x7f255c19e640 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2554034040 tx=0x7f25540305d0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.642+0000 7f2562800640 1 -- 172.21.15.18:0/3637550720 shutdown_connections 2024-09-12T02:56:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.642+0000 7f2562800640 1 --2- 172.21.15.18:0/3637550720 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f25440a2cf0 0x7f25440a51b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.642+0000 7f2562800640 1 --2- 172.21.15.18:0/3637550720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255c112780 0x7f255c19e640 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.642+0000 7f2562800640 1 --2- 172.21.15.18:0/3637550720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f255c077040 0x7f255c1a4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.642+0000 7f2562800640 1 --2- 172.21.15.18:0/3637550720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c076720 0x7f255c1a4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.642+0000 7f2562800640 1 -- 172.21.15.18:0/3637550720 >> 172.21.15.18:0/3637550720 conn(0x7f255c0ff7c0 msgr2=0x7f255c101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.642+0000 7f2562800640 1 -- 172.21.15.18:0/3637550720 shutdown_connections 2024-09-12T02:56:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:40.642+0000 7f2562800640 1 -- 172.21.15.18:0/3637550720 wait complete. 2024-09-12T02:56:40.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:40 smithi176 ceph-mon[35713]: pgmap v245: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 13 MiB/s wr, 295 op/s 2024-09-12T02:56:40.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:40 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:40.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:40 smithi062 ceph-mon[35527]: pgmap v245: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 13 MiB/s wr, 295 op/s 2024-09-12T02:56:40.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:40 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:40.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:40 smithi018 ceph-mon[30616]: pgmap v245: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 13 MiB/s wr, 295 op/s 2024-09-12T02:56:40.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:40 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:42.507 INFO:tasks.workunit.client.0.smithi018.stdout: 2024-09-12T02:56:42.508 INFO:tasks.workunit.client.0.smithi018.stdout:Final score for writes: 541 2024-09-12T02:56:42.508 INFO:tasks.workunit.client.0.smithi018.stdout:Final score for reads : 264331 2024-09-12T02:56:42.508 INFO:tasks.workunit.client.0.smithi018.stdout: 2024-09-12T02:56:42.509 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T02:56:42.509 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:56:42.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:42 smithi176 ceph-mon[35713]: pgmap v246: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 7.3 MiB/s wr, 179 op/s 2024-09-12T02:56:42.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:42 smithi062 ceph-mon[35527]: pgmap v246: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 7.3 MiB/s wr, 179 op/s 2024-09-12T02:56:42.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:42 smithi018 ceph-mon[30616]: pgmap v246: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 7.3 MiB/s wr, 179 op/s 2024-09-12T02:56:44.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:44 smithi176 ceph-mon[35713]: pgmap v247: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.8 MiB/s wr, 135 op/s 2024-09-12T02:56:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:44 smithi062 ceph-mon[35527]: pgmap v247: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.8 MiB/s wr, 135 op/s 2024-09-12T02:56:44.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:44 smithi018 ceph-mon[30616]: pgmap v247: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.8 MiB/s wr, 135 op/s 2024-09-12T02:56:45.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:45 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:45.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:45 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:45.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:45 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:46.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:46 smithi176 ceph-mon[35713]: pgmap v248: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.2 MiB/s wr, 274 op/s 2024-09-12T02:56:46.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:46 smithi062 ceph-mon[35527]: pgmap v248: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.2 MiB/s wr, 274 op/s 2024-09-12T02:56:46.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:46 smithi018 ceph-mon[30616]: pgmap v248: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.2 MiB/s wr, 274 op/s 2024-09-12T02:56:47.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:47 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:56:47.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:47 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:56:47.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:47 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:56:48.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:48 smithi176 ceph-mon[35713]: pgmap v249: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 1.6 MiB/s wr, 197 op/s 2024-09-12T02:56:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:48 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:56:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:48 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:56:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:48 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:56:48.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:48 smithi062 ceph-mon[35527]: pgmap v249: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 1.6 MiB/s wr, 197 op/s 2024-09-12T02:56:48.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:48 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:56:48.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:48 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:56:48.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:48 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:56:48.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:48 smithi018 ceph-mon[30616]: pgmap v249: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 1.6 MiB/s wr, 197 op/s 2024-09-12T02:56:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:48 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:56:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:48 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:56:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:48 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:56:50.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:50 smithi176 ceph-mon[35713]: pgmap v250: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 281 op/s 2024-09-12T02:56:50.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:50 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:50.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:50 smithi062 ceph-mon[35527]: pgmap v250: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 281 op/s 2024-09-12T02:56:50.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:50 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:50.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:50 smithi018 ceph-mon[30616]: pgmap v250: 129 pgs: 129 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 281 op/s 2024-09-12T02:56:50.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:50 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:52.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:52 smithi176 ceph-mon[35713]: pgmap v251: 129 pgs: 129 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 337 op/s 2024-09-12T02:56:52.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:52 smithi062 ceph-mon[35527]: pgmap v251: 129 pgs: 129 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 337 op/s 2024-09-12T02:56:52.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:52 smithi018 ceph-mon[30616]: pgmap v251: 129 pgs: 129 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 337 op/s 2024-09-12T02:56:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.760+0000 7fef67600640 1 -- 172.21.15.18:0/3025577558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef60103f50 msgr2=0x7fef60104330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.760+0000 7fef67600640 1 --2- 172.21.15.18:0/3025577558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef60103f50 0x7fef60104330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fef54009900 tx=0x7fef5402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.760+0000 7fef67600640 1 -- 172.21.15.18:0/3025577558 shutdown_connections 2024-09-12T02:56:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.760+0000 7fef67600640 1 --2- 172.21.15.18:0/3025577558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef601090a0 0x7fef60110bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.760+0000 7fef67600640 1 --2- 172.21.15.18:0/3025577558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef60104900 0x7fef60108940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.760+0000 7fef67600640 1 --2- 172.21.15.18:0/3025577558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef60103f50 0x7fef60104330 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.760+0000 7fef67600640 1 -- 172.21.15.18:0/3025577558 >> 172.21.15.18:0/3025577558 conn(0x7fef600ff9e0 msgr2=0x7fef60101e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.760+0000 7fef67600640 1 -- 172.21.15.18:0/3025577558 shutdown_connections 2024-09-12T02:56:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.760+0000 7fef67600640 1 -- 172.21.15.18:0/3025577558 wait complete. 2024-09-12T02:56:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.761+0000 7fef67600640 1 Processor -- start 2024-09-12T02:56:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.761+0000 7fef67600640 1 -- start start 2024-09-12T02:56:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.761+0000 7fef67600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef60103f50 0x7fef6019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.761+0000 7fef67600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef601090a0 0x7fef6019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.761+0000 7fef67600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef6019eea0 0x7fef6019f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.762+0000 7fef67600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fef60114130 con 0x7fef601090a0 2024-09-12T02:56:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.762+0000 7fef67600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fef60113fb0 con 0x7fef6019eea0 2024-09-12T02:56:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.762+0000 7fef67600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fef601142b0 con 0x7fef60103f50 2024-09-12T02:56:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.762+0000 7fef64c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef60103f50 0x7fef6019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.762+0000 7fef64c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef60103f50 0x7fef6019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:36016/0 (socket says 172.21.15.18:36016) 2024-09-12T02:56:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.762+0000 7fef64c00640 1 -- 172.21.15.18:0/4257598099 learned_addr learned my addr 172.21.15.18:0/4257598099 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.762+0000 7fef5fe00640 1 --2- 172.21.15.18:0/4257598099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef601090a0 0x7fef6019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.762+0000 7fef65600640 1 --2- 172.21.15.18:0/4257598099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef6019eea0 0x7fef6019f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.762+0000 7fef64c00640 1 -- 172.21.15.18:0/4257598099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef6019eea0 msgr2=0x7fef6019f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.762+0000 7fef64c00640 1 --2- 172.21.15.18:0/4257598099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef6019eea0 0x7fef6019f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.762+0000 7fef64c00640 1 -- 172.21.15.18:0/4257598099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef601090a0 msgr2=0x7fef6019ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.762+0000 7fef64c00640 1 --2- 172.21.15.18:0/4257598099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef601090a0 0x7fef6019ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.762+0000 7fef64c00640 1 -- 172.21.15.18:0/4257598099 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6019f990 con 0x7fef60103f50 2024-09-12T02:56:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.762+0000 7fef65600640 1 --2- 172.21.15.18:0/4257598099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef6019eea0 0x7fef6019f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:56:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.762+0000 7fef64c00640 1 --2- 172.21.15.18:0/4257598099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef60103f50 0x7fef6019a5e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fef54004770 tx=0x7fef54003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.763+0000 7fef5d600640 1 -- 172.21.15.18:0/4257598099 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5403f070 con 0x7fef60103f50 2024-09-12T02:56:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.763+0000 7fef5d600640 1 -- 172.21.15.18:0/4257598099 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef54031ca0 con 0x7fef60103f50 2024-09-12T02:56:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.763+0000 7fef67600640 1 -- 172.21.15.18:0/4257598099 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef6019fc20 con 0x7fef60103f50 2024-09-12T02:56:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.763+0000 7fef5d600640 1 -- 172.21.15.18:0/4257598099 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54035030 con 0x7fef60103f50 2024-09-12T02:56:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.763+0000 7fef67600640 1 -- 172.21.15.18:0/4257598099 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef601a7440 con 0x7fef60103f50 2024-09-12T02:56:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.766+0000 7fef5d600640 1 -- 172.21.15.18:0/4257598099 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fef54042070 con 0x7fef60103f50 2024-09-12T02:56:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.766+0000 7fef6a5c0740 1 Processor -- start 2024-09-12T02:56:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.766+0000 7fef6a5c0740 1 -- start start 2024-09-12T02:56:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef6a5c0740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5dd1e0 0x55db0a5dd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef6a5c0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5ddb00 0x55db0a5e7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef6a5c0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5e83a0 0x55db0a5ea790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef6a5c0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55db0a543100 con 0x55db0a5e83a0 2024-09-12T02:56:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef6a5c0740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55db0a4eb1b0 con 0x55db0a5dd1e0 2024-09-12T02:56:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef6a5c0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55db0a53f0c0 con 0x55db0a5ddb00 2024-09-12T02:56:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef5fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5e83a0 0x55db0a5ea790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef65600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5dd1e0 0x55db0a5dd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef5fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5e83a0 0x55db0a5ea790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47004/0 (socket says 172.21.15.18:47004) 2024-09-12T02:56:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef5fe00640 1 -- 172.21.15.18:0/2981444027 learned_addr learned my addr 172.21.15.18:0/2981444027 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef65600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5dd1e0 0x55db0a5dd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:40144/0 (socket says 172.21.15.18:40144) 2024-09-12T02:56:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef64c00640 1 --2- 172.21.15.18:0/2981444027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5ddb00 0x55db0a5e7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef5fe00640 1 -- 172.21.15.18:0/2981444027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5ddb00 msgr2=0x55db0a5e7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef5fe00640 1 --2- 172.21.15.18:0/2981444027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5ddb00 0x55db0a5e7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef5fe00640 1 -- 172.21.15.18:0/2981444027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5dd1e0 msgr2=0x55db0a5dd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef5fe00640 1 --2- 172.21.15.18:0/2981444027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5dd1e0 0x55db0a5dd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef5fe00640 1 -- 172.21.15.18:0/2981444027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0a256210 con 0x55db0a5e83a0 2024-09-12T02:56:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.767+0000 7fef65600640 1 --2- 172.21.15.18:0/2981444027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5dd1e0 0x55db0a5dd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.768+0000 7fef5fe00640 1 --2- 172.21.15.18:0/2981444027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5e83a0 0x55db0a5ea790 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009c60 tx=0x7fef4c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f4448aa3b1026e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.768+0000 7fef5d600640 1 --2- 172.21.15.18:0/4257598099 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fef480a2e20 0x7fef480a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.768+0000 7fef5d600640 1 -- 172.21.15.18:0/4257598099 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9562+0+0 (secure 0 0 0) 0x7fef540efe80 con 0x7fef60103f50 2024-09-12T02:56:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.768+0000 7fef65600640 1 --2- 172.21.15.18:0/4257598099 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fef480a2e20 0x7fef480a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.768+0000 7fef51c00640 1 -- 172.21.15.18:0/2981444027 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c004230 con 0x55db0a5e83a0 2024-09-12T02:56:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.768+0000 7fef51c00640 1 -- 172.21.15.18:0/2981444027 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef4c0043d0 con 0x55db0a5e83a0 2024-09-12T02:56:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.768+0000 7fef51c00640 1 -- 172.21.15.18:0/2981444027 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c019840 con 0x55db0a5e83a0 2024-09-12T02:56:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.769+0000 7fef6a5c0740 1 -- 172.21.15.18:0/2981444027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5e83a0 msgr2=0x55db0a5ea790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.769+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/2981444027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5e83a0 0x55db0a5ea790 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009c60 tx=0x7fef4c011810 comp rx=0 tx=0).stop 2024-09-12T02:56:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.769+0000 7fef65600640 1 --2- 172.21.15.18:0/4257598099 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fef480a2e20 0x7fef480a52e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fef58005fd0 tx=0x7fef58009500 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.769+0000 7fef6a5c0740 1 -- 172.21.15.18:0/2981444027 shutdown_connections 2024-09-12T02:56:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.769+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/2981444027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5e83a0 0x55db0a5ea790 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.769+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/2981444027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5ddb00 0x55db0a5e7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.769+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/2981444027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5dd1e0 0x55db0a5dd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.769+0000 7fef6a5c0740 1 -- 172.21.15.18:0/2981444027 >> 172.21.15.18:0/2981444027 conn(0x55db0a5d9750 msgr2=0x55db0a5d9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.769+0000 7fef6a5c0740 1 -- 172.21.15.18:0/2981444027 shutdown_connections 2024-09-12T02:56:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.769+0000 7fef6a5c0740 1 -- 172.21.15.18:0/2981444027 wait complete. 2024-09-12T02:56:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.769+0000 7fef6a5c0740 1 -- start start 2024-09-12T02:56:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.770+0000 7fef6a5c0740 1 Processor -- start 2024-09-12T02:56:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.770+0000 7fef6a5c0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5dd1e0 0x55db0a5e53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.770+0000 7fef6a5c0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5ddb00 0x55db0a5e5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.770+0000 7fef6a5c0740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5e83a0 0x55db0a5e5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.770+0000 7fef6a5c0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55db0a5eaf70 con 0x55db0a5ddb00 2024-09-12T02:56:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.770+0000 7fef6a5c0740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55db0a4cc090 con 0x55db0a5e83a0 2024-09-12T02:56:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.770+0000 7fef6a5c0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55db0a5eb0f0 con 0x55db0a5dd1e0 2024-09-12T02:56:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.770+0000 7fef6a5c0740 10 client.0 _ll_register_callbacks cb 0x55db0a520f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:56:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.770+0000 7fef64c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5dd1e0 0x55db0a5e53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.770+0000 7fef64c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5dd1e0 0x55db0a5e53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:36032/0 (socket says 172.21.15.18:36032) 2024-09-12T02:56:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.770+0000 7fef64c00640 1 -- 172.21.15.18:0/2349691604 learned_addr learned my addr 172.21.15.18:0/2349691604 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.770+0000 7fef5fe00640 1 --2- 172.21.15.18:0/2349691604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5ddb00 0x55db0a5e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.771+0000 7fef65600640 1 --2- 172.21.15.18:0/2349691604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5e83a0 0x55db0a5e5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.771+0000 7fef64c00640 1 -- 172.21.15.18:0/2349691604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5e83a0 msgr2=0x55db0a5e5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.771+0000 7fef64c00640 1 --2- 172.21.15.18:0/2349691604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5e83a0 0x55db0a5e5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.771+0000 7fef64c00640 1 -- 172.21.15.18:0/2349691604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5ddb00 msgr2=0x55db0a5e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.771+0000 7fef64c00640 1 --2- 172.21.15.18:0/2349691604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5ddb00 0x55db0a5e5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.771+0000 7fef64c00640 1 -- 172.21.15.18:0/2349691604 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db0a322620 con 0x55db0a5dd1e0 2024-09-12T02:56:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.771+0000 7fef64c00640 1 --2- 172.21.15.18:0/2349691604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5dd1e0 0x55db0a5e53c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fef54031550 tx=0x7fef54005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33716b9ae8da23df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.771+0000 7fef46000640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:56:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.771+0000 7fef46000640 1 -- 172.21.15.18:0/2349691604 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54049070 con 0x55db0a5dd1e0 2024-09-12T02:56:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.771+0000 7fef46000640 1 -- 172.21.15.18:0/2349691604 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9562+0+0 (secure 0 0 0) 0x7fef5403b4f0 con 0x55db0a5dd1e0 2024-09-12T02:56:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.771+0000 7fef6a5c0740 1 -- 172.21.15.18:0/2349691604 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef4c0043d0 con 0x55db0a5dd1e0 2024-09-12T02:56:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.772+0000 7fef46000640 1 -- 172.21.15.18:0/2349691604 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fef540bbb30 con 0x55db0a5dd1e0 2024-09-12T02:56:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.772+0000 7fef6a5c0740 10 client.25747 fetch_fsmap learned FSMap version 55 2024-09-12T02:56:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.772+0000 7fef6a5c0740 1 -- 172.21.15.18:0/2349691604 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55db0a5eafd0 con 0x55db0a5dd1e0 2024-09-12T02:56:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.772+0000 7fef46000640 1 -- 172.21.15.18:0/2349691604 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef4c0043d0 con 0x55db0a5dd1e0 2024-09-12T02:56:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.772+0000 7fef46000640 1 -- 172.21.15.18:0/2349691604 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 55) ==== 8442+0+0 (secure 0 0 0) 0x7fef540ed3e0 con 0x55db0a5dd1e0 2024-09-12T02:56:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.772+0000 7fef6a5c0740 10 client.25747 fetch_fsmap finished waiting for FSMap version 55 2024-09-12T02:56:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.772+0000 7fef6a5c0740 10 client.25747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:56:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.772+0000 7fef6a5c0740 20 client.25747 populate_metadata read hostname 'smithi018' 2024-09-12T02:56:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.772+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/2349691604 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55db0a5f8150 0x55db0a5fa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.772+0000 7fef6a5c0740 4 client.25747 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:56:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.772+0000 7fef6a5c0740 1 -- 172.21.15.18:0/2349691604 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db0a550830 con 0x55db0a5f8150 2024-09-12T02:56:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.772+0000 7fef5fe00640 1 --2- 172.21.15.18:0/2349691604 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55db0a5f8150 0x55db0a5fa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.773+0000 7fef5fe00640 1 --2- 172.21.15.18:0/2349691604 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55db0a5f8150 0x55db0a5fa5d0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=235f3e427664ae4e server_cookie=d855efdb82981658 in_seq=0 out_seq=0 2024-09-12T02:56:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.773+0000 7fef46000640 10 client.25747 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:56:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.774+0000 7fef46000640 1 -- 172.21.15.18:0/2349691604 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db0a550830 con 0x55db0a5f8150 2024-09-12T02:56:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.774+0000 7fef46000640 10 client.25747 handle_command_reply: tid=0 2024-09-12T02:56:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.774+0000 7fef6a5c0740 1 client.25747 shutdown 2024-09-12T02:56:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.774+0000 7fef6a5c0740 1 -- 172.21.15.18:0/2349691604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5dd1e0 msgr2=0x55db0a5e53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.774+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/2349691604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5dd1e0 0x55db0a5e53c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fef54031550 tx=0x7fef54005c00 comp rx=0 tx=0).stop 2024-09-12T02:56:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.774+0000 7fef6a5c0740 1 -- 172.21.15.18:0/2349691604 shutdown_connections 2024-09-12T02:56:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.774+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/2349691604 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55db0a5f8150 0x55db0a5fa5d0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.774+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/2349691604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5e83a0 0x55db0a5e5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.774+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/2349691604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5ddb00 0x55db0a5e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.774+0000 7fef46000640 0 client.25747 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:56:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.774+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/2349691604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5dd1e0 0x55db0a5e53c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.774+0000 7fef6a5c0740 1 -- 172.21.15.18:0/2349691604 >> 172.21.15.18:0/2349691604 conn(0x55db0a5d9750 msgr2=0x55db0a5df460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.774+0000 7fef6a5c0740 1 -- 172.21.15.18:0/2349691604 shutdown_connections 2024-09-12T02:56:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.774+0000 7fef6a5c0740 1 -- 172.21.15.18:0/2349691604 wait complete. 2024-09-12T02:56:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.774+0000 7fef6a5c0740 20 client.25747 trim_cache size 0 max 16384 2024-09-12T02:56:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.789+0000 7fef6a5c0740 1 Processor -- start 2024-09-12T02:56:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.789+0000 7fef6a5c0740 1 -- start start 2024-09-12T02:56:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.790+0000 7fef6a5c0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5dd1e0 0x55db0a5d8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.790+0000 7fef6a5c0740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5ddb00 0x55db0a5ffea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.790+0000 7fef6a5c0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5e83a0 0x55db0a6003e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.790+0000 7fef6a5c0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fef601b12d0 con 0x55db0a5dd1e0 2024-09-12T02:56:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.790+0000 7fef6a5c0740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fef601b30e0 con 0x55db0a5ddb00 2024-09-12T02:56:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.790+0000 7fef6a5c0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fef601b1a30 con 0x55db0a5e83a0 2024-09-12T02:56:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.790+0000 7fef64c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5dd1e0 0x55db0a5d8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.790+0000 7fef64c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5dd1e0 0x55db0a5d8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47028/0 (socket says 172.21.15.18:47028) 2024-09-12T02:56:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.790+0000 7fef64c00640 1 -- 172.21.15.18:0/375610754 learned_addr learned my addr 172.21.15.18:0/375610754 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.790+0000 7fef65600640 1 --2- 172.21.15.18:0/375610754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5e83a0 0x55db0a6003e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.790+0000 7fef5fe00640 1 --2- 172.21.15.18:0/375610754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5ddb00 0x55db0a5ffea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.790+0000 7fef64c00640 1 -- 172.21.15.18:0/375610754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5e83a0 msgr2=0x55db0a6003e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.790+0000 7fef64c00640 1 --2- 172.21.15.18:0/375610754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5e83a0 0x55db0a6003e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.790+0000 7fef64c00640 1 -- 172.21.15.18:0/375610754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5ddb00 msgr2=0x55db0a5ffea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.790+0000 7fef64c00640 1 --2- 172.21.15.18:0/375610754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5ddb00 0x55db0a5ffea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.790+0000 7fef64c00640 1 -- 172.21.15.18:0/375610754 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0a5d4d60 con 0x55db0a5dd1e0 2024-09-12T02:56:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.791+0000 7fef64c00640 1 --2- 172.21.15.18:0/375610754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5dd1e0 0x55db0a5d8720 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fef540ba2a0 tx=0x7fef540ba500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672a7aa58f0bd668 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.791+0000 7fef51200640 1 -- 172.21.15.18:0/375610754 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54049050 con 0x55db0a5dd1e0 2024-09-12T02:56:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.791+0000 7fef51200640 1 -- 172.21.15.18:0/375610754 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef540bbff0 con 0x55db0a5dd1e0 2024-09-12T02:56:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.791+0000 7fef51200640 1 -- 172.21.15.18:0/375610754 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54005d50 con 0x55db0a5dd1e0 2024-09-12T02:56:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.791+0000 7fef6a5c0740 1 -- 172.21.15.18:0/375610754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5dd1e0 msgr2=0x55db0a5d8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.792+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/375610754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5dd1e0 0x55db0a5d8720 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fef540ba2a0 tx=0x7fef540ba500 comp rx=0 tx=0).stop 2024-09-12T02:56:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.792+0000 7fef6a5c0740 1 -- 172.21.15.18:0/375610754 shutdown_connections 2024-09-12T02:56:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.792+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/375610754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5e83a0 0x55db0a6003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.792+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/375610754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5ddb00 0x55db0a5ffea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.792+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/375610754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5dd1e0 0x55db0a5d8720 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.792+0000 7fef6a5c0740 1 -- 172.21.15.18:0/375610754 >> 172.21.15.18:0/375610754 conn(0x55db0a5d9750 msgr2=0x55db0a5d8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.792+0000 7fef6a5c0740 1 -- 172.21.15.18:0/375610754 shutdown_connections 2024-09-12T02:56:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.792+0000 7fef6a5c0740 1 -- 172.21.15.18:0/375610754 wait complete. 2024-09-12T02:56:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.792+0000 7fef6a5c0740 1 -- start start 2024-09-12T02:56:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.792+0000 7fef6a5c0740 1 Processor -- start 2024-09-12T02:56:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef6a5c0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5dd1e0 0x55db0a5ec270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef6a5c0740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5ddb00 0x55db0a5ec7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef6a5c0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5e83a0 0x55db0a5eccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef6a5c0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fef601b2950 con 0x55db0a5dd1e0 2024-09-12T02:56:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef6a5c0740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fef601b21c0 con 0x55db0a5ddb00 2024-09-12T02:56:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef6a5c0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fef601af2d0 con 0x55db0a5e83a0 2024-09-12T02:56:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef6a5c0740 10 client.0 _ll_register_callbacks cb 0x7fef540f3620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:56:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef64c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5dd1e0 0x55db0a5ec270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef65600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5e83a0 0x55db0a5eccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef64c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5dd1e0 0x55db0a5ec270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47044/0 (socket says 172.21.15.18:47044) 2024-09-12T02:56:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef64c00640 1 -- 172.21.15.18:0/4237458065 learned_addr learned my addr 172.21.15.18:0/4237458065 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:56:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef5fe00640 1 --2- 172.21.15.18:0/4237458065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5ddb00 0x55db0a5ec7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef64c00640 1 -- 172.21.15.18:0/4237458065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5e83a0 msgr2=0x55db0a5eccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef64c00640 1 --2- 172.21.15.18:0/4237458065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5e83a0 0x55db0a5eccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef64c00640 1 -- 172.21.15.18:0/4237458065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5ddb00 msgr2=0x55db0a5ec7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef64c00640 1 --2- 172.21.15.18:0/4237458065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5ddb00 0x55db0a5ec7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef64c00640 1 -- 172.21.15.18:0/4237458065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db0a662010 con 0x55db0a5dd1e0 2024-09-12T02:56:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef5fe00640 1 --2- 172.21.15.18:0/4237458065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5ddb00 0x55db0a5ec7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.793+0000 7fef65600640 1 --2- 172.21.15.18:0/4237458065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5e83a0 0x55db0a5eccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.794+0000 7fef64c00640 1 --2- 172.21.15.18:0/4237458065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5dd1e0 0x55db0a5ec270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fef540b8450 tx=0x7fef540b8870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c29b4657b5f7af9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.794+0000 7fef46000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:56:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.794+0000 7fef46000640 1 -- 172.21.15.18:0/4237458065 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54049070 con 0x55db0a5dd1e0 2024-09-12T02:56:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.794+0000 7fef46000640 1 -- 172.21.15.18:0/4237458065 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9562+0+0 (secure 0 0 0) 0x7fef540ed3e0 con 0x55db0a5dd1e0 2024-09-12T02:56:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.794+0000 7fef6a5c0740 1 -- 172.21.15.18:0/4237458065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef540bbff0 con 0x55db0a5dd1e0 2024-09-12T02:56:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.794+0000 7fef46000640 1 -- 172.21.15.18:0/4237458065 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fef540cc050 con 0x55db0a5dd1e0 2024-09-12T02:56:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.794+0000 7fef6a5c0740 10 client.15759 fetch_fsmap learned FSMap version 55 2024-09-12T02:56:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.794+0000 7fef6a5c0740 1 -- 172.21.15.18:0/4237458065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55db0a662010 con 0x55db0a5dd1e0 2024-09-12T02:56:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.794+0000 7fef46000640 1 -- 172.21.15.18:0/4237458065 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef540bbff0 con 0x55db0a5dd1e0 2024-09-12T02:56:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.795+0000 7fef46000640 1 -- 172.21.15.18:0/4237458065 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 55) ==== 8442+0+0 (secure 0 0 0) 0x7fef540dac50 con 0x55db0a5dd1e0 2024-09-12T02:56:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.795+0000 7fef6a5c0740 10 client.15759 fetch_fsmap finished waiting for FSMap version 55 2024-09-12T02:56:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.795+0000 7fef6a5c0740 10 client.15759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:56:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.795+0000 7fef6a5c0740 20 client.15759 populate_metadata read hostname 'smithi018' 2024-09-12T02:56:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.795+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/4237458065 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55db0a6635e0 0x55db0a665a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.795+0000 7fef6a5c0740 4 client.15759 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:56:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.795+0000 7fef6a5c0740 1 -- 172.21.15.18:0/4237458065 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55db0a54ab80 con 0x55db0a6635e0 2024-09-12T02:56:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.795+0000 7fef5fe00640 1 --2- 172.21.15.18:0/4237458065 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55db0a6635e0 0x55db0a665a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.796+0000 7fef5fe00640 1 --2- 172.21.15.18:0/4237458065 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55db0a6635e0 0x55db0a665a00 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=856ca7642b12e34f server_cookie=2af58e3412c06665 in_seq=0 out_seq=0 2024-09-12T02:56:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.796+0000 7fef46000640 10 client.15759 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:56:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.818+0000 7fef46000640 1 -- 172.21.15.18:0/4237458065 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55db0a54ab80 con 0x55db0a6635e0 2024-09-12T02:56:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.818+0000 7fef46000640 10 client.15759 handle_command_reply: tid=0 2024-09-12T02:56:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.818+0000 7fef6a5c0740 1 client.15759 shutdown 2024-09-12T02:56:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.818+0000 7fef6a5c0740 1 -- 172.21.15.18:0/4237458065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5dd1e0 msgr2=0x55db0a5ec270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.818+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/4237458065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5dd1e0 0x55db0a5ec270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fef540b8450 tx=0x7fef540b8870 comp rx=0 tx=0).stop 2024-09-12T02:56:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.818+0000 7fef6a5c0740 1 -- 172.21.15.18:0/4237458065 shutdown_connections 2024-09-12T02:56:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.818+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/4237458065 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55db0a6635e0 0x55db0a665a00 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.818+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/4237458065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55db0a5e83a0 0x55db0a5eccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.818+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/4237458065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db0a5ddb00 0x55db0a5ec7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.818+0000 7fef6a5c0740 1 --2- 172.21.15.18:0/4237458065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db0a5dd1e0 0x55db0a5ec270 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.818+0000 7fef6a5c0740 1 -- 172.21.15.18:0/4237458065 >> 172.21.15.18:0/4237458065 conn(0x55db0a5d9750 msgr2=0x55db0a5f39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.818+0000 7fef46000640 0 client.15759 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:56:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.819+0000 7fef6a5c0740 1 -- 172.21.15.18:0/4237458065 shutdown_connections 2024-09-12T02:56:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.819+0000 7fef6a5c0740 1 -- 172.21.15.18:0/4237458065 wait complete. 2024-09-12T02:56:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.819+0000 7fef6a5c0740 20 client.15759 trim_cache size 0 max 16384 2024-09-12T02:56:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:56:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:56:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:56:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:56:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.820+0000 7fef67600640 1 -- 172.21.15.18:0/4257598099 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fef480a2e20 msgr2=0x7fef480a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.820+0000 7fef67600640 1 --2- 172.21.15.18:0/4257598099 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fef480a2e20 0x7fef480a52e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fef58005fd0 tx=0x7fef58009500 comp rx=0 tx=0).stop 2024-09-12T02:56:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.820+0000 7fef67600640 1 -- 172.21.15.18:0/4257598099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef60103f50 msgr2=0x7fef6019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.820+0000 7fef67600640 1 --2- 172.21.15.18:0/4257598099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef60103f50 0x7fef6019a5e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fef54004770 tx=0x7fef54003c10 comp rx=0 tx=0).stop 2024-09-12T02:56:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.820+0000 7fef67600640 1 -- 172.21.15.18:0/4257598099 shutdown_connections 2024-09-12T02:56:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.820+0000 7fef67600640 1 --2- 172.21.15.18:0/4257598099 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fef480a2e20 0x7fef480a52e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.820+0000 7fef67600640 1 --2- 172.21.15.18:0/4257598099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef6019eea0 0x7fef6019f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.820+0000 7fef67600640 1 --2- 172.21.15.18:0/4257598099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef601090a0 0x7fef6019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.820+0000 7fef67600640 1 --2- 172.21.15.18:0/4257598099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef60103f50 0x7fef6019a5e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.820+0000 7fef67600640 1 -- 172.21.15.18:0/4257598099 >> 172.21.15.18:0/4257598099 conn(0x7fef600ff9e0 msgr2=0x7fef60100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.820+0000 7fef67600640 1 -- 172.21.15.18:0/4257598099 shutdown_connections 2024-09-12T02:56:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:56:53.820+0000 7fef67600640 1 -- 172.21.15.18:0/4257598099 wait complete. 2024-09-12T02:56:54.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:54 smithi176 ceph-mon[35713]: pgmap v252: 129 pgs: 129 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 356 op/s 2024-09-12T02:56:54.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:54 smithi062 ceph-mon[35527]: pgmap v252: 129 pgs: 129 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 356 op/s 2024-09-12T02:56:54.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:54 smithi018 ceph-mon[30616]: pgmap v252: 129 pgs: 129 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 356 op/s 2024-09-12T02:56:55.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:55 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:55.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:55 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:55 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:56.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:56 smithi062 ceph-mon[35527]: pgmap v253: 129 pgs: 129 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 456 op/s 2024-09-12T02:56:56.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:56 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:56 smithi018 ceph-mon[30616]: pgmap v253: 129 pgs: 129 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 456 op/s 2024-09-12T02:56:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:56 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:56.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:56 smithi176 ceph-mon[35713]: pgmap v253: 129 pgs: 129 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 456 op/s 2024-09-12T02:56:56.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:56 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:56:58.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:56:58 smithi018 ceph-mon[30616]: pgmap v254: 129 pgs: 129 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 300 op/s 2024-09-12T02:56:58.781 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:56:58 smithi176 ceph-mon[35713]: pgmap v254: 129 pgs: 129 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 300 op/s 2024-09-12T02:56:58.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:56:58 smithi062 ceph-mon[35527]: pgmap v254: 129 pgs: 129 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 300 op/s 2024-09-12T02:57:00.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:00 smithi062 ceph-mon[35527]: pgmap v255: 129 pgs: 129 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 380 op/s 2024-09-12T02:57:00.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:00 smithi018 ceph-mon[30616]: pgmap v255: 129 pgs: 129 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 380 op/s 2024-09-12T02:57:00.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:00 smithi176 ceph-mon[35713]: pgmap v255: 129 pgs: 129 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 380 op/s 2024-09-12T02:57:01.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:01 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:57:01.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:01 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:57:01.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:01 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:57:02.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:02 smithi062 ceph-mon[35527]: pgmap v256: 129 pgs: 129 active+clean; 2.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 353 op/s 2024-09-12T02:57:02.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:02 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:57:02.830 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:02 smithi018 ceph-mon[30616]: pgmap v256: 129 pgs: 129 active+clean; 2.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 353 op/s 2024-09-12T02:57:02.830 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:02 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:57:02.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:02 smithi176 ceph-mon[35713]: pgmap v256: 129 pgs: 129 active+clean; 2.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 353 op/s 2024-09-12T02:57:02.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:02 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:57:04.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:04 smithi062 ceph-mon[35527]: pgmap v257: 129 pgs: 129 active+clean; 2.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 300 op/s 2024-09-12T02:57:04.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:04 smithi018 ceph-mon[30616]: pgmap v257: 129 pgs: 129 active+clean; 2.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 300 op/s 2024-09-12T02:57:04.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:04 smithi176 ceph-mon[35713]: pgmap v257: 129 pgs: 129 active+clean; 2.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 300 op/s 2024-09-12T02:57:06.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:06 smithi062 ceph-mon[35527]: pgmap v258: 129 pgs: 129 active+clean; 2.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 384 op/s 2024-09-12T02:57:06.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:06 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:57:06.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:06 smithi018 ceph-mon[30616]: pgmap v258: 129 pgs: 129 active+clean; 2.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 384 op/s 2024-09-12T02:57:06.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:06 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:57:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.938+0000 7f515b400640 1 -- 172.21.15.18:0/3570615729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5154103f50 msgr2=0x7f5154104330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.938+0000 7f515b400640 1 --2- 172.21.15.18:0/3570615729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5154103f50 0x7f5154104330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5148009900 tx=0x7f514802a400 comp rx=0 tx=0).stop 2024-09-12T02:57:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.939+0000 7f515b400640 1 -- 172.21.15.18:0/3570615729 shutdown_connections 2024-09-12T02:57:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.939+0000 7f515b400640 1 --2- 172.21.15.18:0/3570615729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51541090a0 0x7f5154110bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.939+0000 7f515b400640 1 --2- 172.21.15.18:0/3570615729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5154104900 0x7f5154108940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.939+0000 7f515b400640 1 --2- 172.21.15.18:0/3570615729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5154103f50 0x7f5154104330 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.939+0000 7f515b400640 1 -- 172.21.15.18:0/3570615729 >> 172.21.15.18:0/3570615729 conn(0x7f51540ff9e0 msgr2=0x7f5154101e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.939+0000 7f515b400640 1 -- 172.21.15.18:0/3570615729 shutdown_connections 2024-09-12T02:57:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.939+0000 7f515b400640 1 -- 172.21.15.18:0/3570615729 wait complete. 2024-09-12T02:57:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.940+0000 7f515b400640 1 Processor -- start 2024-09-12T02:57:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.940+0000 7f515b400640 1 -- start start 2024-09-12T02:57:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.940+0000 7f515b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5154103f50 0x7f515419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.940+0000 7f515b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51541090a0 0x7f515419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.940+0000 7f515b400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f515419ee80 0x7f515419f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.940+0000 7f515b400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f51541140f0 con 0x7f51541090a0 2024-09-12T02:57:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.940+0000 7f515b400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5154113f70 con 0x7f5154103f50 2024-09-12T02:57:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.940+0000 7f515b400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5154114270 con 0x7f515419ee80 2024-09-12T02:57:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.940+0000 7f5153e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51541090a0 0x7f515419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.940+0000 7f5158a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5154103f50 0x7f515419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.940+0000 7f5153e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51541090a0 0x7f515419ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45458/0 (socket says 172.21.15.18:45458) 2024-09-12T02:57:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.940+0000 7f5159400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f515419ee80 0x7f515419f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.940+0000 7f5153e00640 1 -- 172.21.15.18:0/220593432 learned_addr learned my addr 172.21.15.18:0/220593432 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.940+0000 7f5158a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5154103f50 0x7f515419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:39958/0 (socket says 172.21.15.18:39958) 2024-09-12T02:57:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.941+0000 7f5153e00640 1 -- 172.21.15.18:0/220593432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f515419ee80 msgr2=0x7f515419f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.941+0000 7f5153e00640 1 --2- 172.21.15.18:0/220593432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f515419ee80 0x7f515419f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.941+0000 7f5153e00640 1 -- 172.21.15.18:0/220593432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5154103f50 msgr2=0x7f515419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.941+0000 7f5153e00640 1 --2- 172.21.15.18:0/220593432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5154103f50 0x7f515419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.941+0000 7f5153e00640 1 -- 172.21.15.18:0/220593432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515419f970 con 0x7f51541090a0 2024-09-12T02:57:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.941+0000 7f5159400640 1 --2- 172.21.15.18:0/220593432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f515419ee80 0x7f515419f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.941+0000 7f5153e00640 1 --2- 172.21.15.18:0/220593432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51541090a0 0x7f515419ab00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f514000d770 tx=0x7f514000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.941+0000 7f5151600640 1 -- 172.21.15.18:0/220593432 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140017070 con 0x7f51541090a0 2024-09-12T02:57:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.941+0000 7f5151600640 1 -- 172.21.15.18:0/220593432 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5140009c30 con 0x7f51541090a0 2024-09-12T02:57:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.941+0000 7f515b400640 1 -- 172.21.15.18:0/220593432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f515419fc60 con 0x7f51541090a0 2024-09-12T02:57:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.941+0000 7f515b400640 1 -- 172.21.15.18:0/220593432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51541a7450 con 0x7f51541090a0 2024-09-12T02:57:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.941+0000 7f5151600640 1 -- 172.21.15.18:0/220593432 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140021060 con 0x7f51541090a0 2024-09-12T02:57:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.945+0000 7f5151600640 1 -- 172.21.15.18:0/220593432 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f514001a070 con 0x7f51541090a0 2024-09-12T02:57:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.945+0000 7f515e24c740 1 Processor -- start 2024-09-12T02:57:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.945+0000 7f515e24c740 1 -- start start 2024-09-12T02:57:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.945+0000 7f515e24c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546c1e0 0x56128546c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.945+0000 7f515e24c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x561285476e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.945+0000 7f515e24c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5612854773a0 0x561285479790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.945+0000 7f515e24c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5612853d2100 con 0x56128546c1e0 2024-09-12T02:57:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.945+0000 7f515e24c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56128537a1b0 con 0x5612854773a0 2024-09-12T02:57:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.945+0000 7f515e24c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5612853ce0c0 con 0x56128546cb00 2024-09-12T02:57:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.945+0000 7f5159400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546c1e0 0x56128546c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.945+0000 7f5153e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5612854773a0 0x561285479790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.945+0000 7f5158a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x561285476e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.946+0000 7f5153e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5612854773a0 0x561285479790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:39968/0 (socket says 172.21.15.18:39968) 2024-09-12T02:57:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.946+0000 7f5159400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546c1e0 0x56128546c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45466/0 (socket says 172.21.15.18:45466) 2024-09-12T02:57:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.946+0000 7f5158a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x561285476e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:50090/0 (socket says 172.21.15.18:50090) 2024-09-12T02:57:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.946+0000 7f5159400640 1 -- 172.21.15.18:0/237130484 learned_addr learned my addr 172.21.15.18:0/237130484 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.946+0000 7f5158a00640 1 -- 172.21.15.18:0/237130484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5612854773a0 msgr2=0x561285479790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.946+0000 7f5158a00640 1 --2- 172.21.15.18:0/237130484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5612854773a0 0x561285479790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.946+0000 7f5158a00640 1 -- 172.21.15.18:0/237130484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546c1e0 msgr2=0x56128546c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.946+0000 7f5158a00640 1 --2- 172.21.15.18:0/237130484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546c1e0 0x56128546c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.946+0000 7f5158a00640 1 -- 172.21.15.18:0/237130484 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612850e5210 con 0x56128546cb00 2024-09-12T02:57:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.946+0000 7f5159400640 1 --2- 172.21.15.18:0/237130484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546c1e0 0x56128546c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.946+0000 7f5158a00640 1 --2- 172.21.15.18:0/237130484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x561285476e60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5148005940 tx=0x7f5148005e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1429ff4f51c9d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.946+0000 7f5151600640 1 --2- 172.21.15.18:0/220593432 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f513c0a2da0 0x7f513c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.947+0000 7f5145c00640 1 -- 172.21.15.18:0/237130484 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148040070 con 0x56128546cb00 2024-09-12T02:57:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.947+0000 7f5151600640 1 -- 172.21.15.18:0/220593432 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9562+0+0 (secure 0 0 0) 0x7f51400cf360 con 0x7f51541090a0 2024-09-12T02:57:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.947+0000 7f5145c00640 1 -- 172.21.15.18:0/237130484 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51480318f0 con 0x56128546cb00 2024-09-12T02:57:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.947+0000 7f5145c00640 1 -- 172.21.15.18:0/237130484 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148035040 con 0x56128546cb00 2024-09-12T02:57:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.947+0000 7f5159400640 1 --2- 172.21.15.18:0/220593432 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f513c0a2da0 0x7f513c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.947+0000 7f515e24c740 1 -- 172.21.15.18:0/237130484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 msgr2=0x561285476e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.947+0000 7f515e24c740 1 --2- 172.21.15.18:0/237130484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x561285476e60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5148005940 tx=0x7f5148005e00 comp rx=0 tx=0).stop 2024-09-12T02:57:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.947+0000 7f5159400640 1 --2- 172.21.15.18:0/220593432 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f513c0a2da0 0x7f513c0a5260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f514c009fd0 tx=0x7f514c009500 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.947+0000 7f515e24c740 1 -- 172.21.15.18:0/237130484 shutdown_connections 2024-09-12T02:57:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.947+0000 7f515e24c740 1 --2- 172.21.15.18:0/237130484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5612854773a0 0x561285479790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.947+0000 7f515e24c740 1 --2- 172.21.15.18:0/237130484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x561285476e60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.947+0000 7f515e24c740 1 --2- 172.21.15.18:0/237130484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546c1e0 0x56128546c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.947+0000 7f515e24c740 1 -- 172.21.15.18:0/237130484 >> 172.21.15.18:0/237130484 conn(0x561285468750 msgr2=0x561285468b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.948+0000 7f515e24c740 1 -- 172.21.15.18:0/237130484 shutdown_connections 2024-09-12T02:57:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.948+0000 7f515e24c740 1 -- 172.21.15.18:0/237130484 wait complete. 2024-09-12T02:57:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.948+0000 7f515e24c740 1 -- start start 2024-09-12T02:57:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.948+0000 7f515e24c740 1 Processor -- start 2024-09-12T02:57:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.949+0000 7f515e24c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56128546c1e0 0x561285474370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.949+0000 7f515e24c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x5612854748b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.949+0000 7f515e24c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5612854773a0 0x561285474df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.949+0000 7f515e24c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561285479f70 con 0x5612854773a0 2024-09-12T02:57:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.949+0000 7f515e24c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56128535b090 con 0x56128546c1e0 2024-09-12T02:57:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.949+0000 7f515e24c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56128547a0f0 con 0x56128546cb00 2024-09-12T02:57:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.949+0000 7f515e24c740 10 client.0 _ll_register_callbacks cb 0x5612853aff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:57:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.949+0000 7f5153e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x5612854748b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.949+0000 7f5153e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x5612854748b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:50106/0 (socket says 172.21.15.18:50106) 2024-09-12T02:57:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.949+0000 7f5153e00640 1 -- 172.21.15.18:0/1157962325 learned_addr learned my addr 172.21.15.18:0/1157962325 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.949+0000 7f5158a00640 1 --2- 172.21.15.18:0/1157962325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56128546c1e0 0x561285474370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.949+0000 7f5159400640 1 --2- 172.21.15.18:0/1157962325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5612854773a0 0x561285474df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.949+0000 7f5153e00640 1 -- 172.21.15.18:0/1157962325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56128546c1e0 msgr2=0x561285474370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.949+0000 7f5153e00640 1 --2- 172.21.15.18:0/1157962325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56128546c1e0 0x561285474370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.949+0000 7f5153e00640 1 -- 172.21.15.18:0/1157962325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5612854773a0 msgr2=0x561285474df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.949+0000 7f5153e00640 1 --2- 172.21.15.18:0/1157962325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5612854773a0 0x561285474df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.949+0000 7f5153e00640 1 -- 172.21.15.18:0/1157962325 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612851b1620 con 0x56128546cb00 2024-09-12T02:57:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.950+0000 7f5153e00640 1 --2- 172.21.15.18:0/1157962325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x5612854748b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f514009b1c0 tx=0x7f5140097160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f2419e519b16571 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.950+0000 7f513a000640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:57:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.950+0000 7f513a000640 1 -- 172.21.15.18:0/1157962325 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140014050 con 0x56128546cb00 2024-09-12T02:57:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.950+0000 7f515e24c740 1 -- 172.21.15.18:0/1157962325 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51480318f0 con 0x56128546cb00 2024-09-12T02:57:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.950+0000 7f513a000640 1 -- 172.21.15.18:0/1157962325 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9562+0+0 (secure 0 0 0) 0x7f514009a910 con 0x56128546cb00 2024-09-12T02:57:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.950+0000 7f513a000640 1 -- 172.21.15.18:0/1157962325 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f514009ae20 con 0x56128546cb00 2024-09-12T02:57:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.950+0000 7f515e24c740 10 client.25765 fetch_fsmap learned FSMap version 60 2024-09-12T02:57:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.950+0000 7f515e24c740 1 -- 172.21.15.18:0/1157962325 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x561285485bb0 con 0x56128546cb00 2024-09-12T02:57:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.950+0000 7f513a000640 1 -- 172.21.15.18:0/1157962325 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51480318f0 con 0x56128546cb00 2024-09-12T02:57:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.950+0000 7f513a000640 1 -- 172.21.15.18:0/1157962325 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 60) ==== 8434+0+0 (secure 0 0 0) 0x7f514009a380 con 0x56128546cb00 2024-09-12T02:57:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.951+0000 7f515e24c740 10 client.25765 fetch_fsmap finished waiting for FSMap version 60 2024-09-12T02:57:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.951+0000 7f515e24c740 10 client.25765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:57:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.951+0000 7f515e24c740 20 client.25765 populate_metadata read hostname 'smithi018' 2024-09-12T02:57:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.951+0000 7f515e24c740 1 --2- 172.21.15.18:0/1157962325 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561285487160 0x5612854895c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.951+0000 7f515e24c740 4 client.25765 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:57:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.951+0000 7f515e24c740 1 -- 172.21.15.18:0/1157962325 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612853df830 con 0x561285487160 2024-09-12T02:57:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.951+0000 7f5158a00640 1 --2- 172.21.15.18:0/1157962325 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561285487160 0x5612854895c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.951+0000 7f5158a00640 1 --2- 172.21.15.18:0/1157962325 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561285487160 0x5612854895c0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcbe56d47576a5b8 server_cookie=e09f6a8a819d642 in_seq=0 out_seq=0 2024-09-12T02:57:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.951+0000 7f513a000640 10 client.25765 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:57:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.952+0000 7f513a000640 1 -- 172.21.15.18:0/1157962325 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5612853df830 con 0x561285487160 2024-09-12T02:57:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.952+0000 7f513a000640 10 client.25765 handle_command_reply: tid=0 2024-09-12T02:57:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.953+0000 7f515e24c740 1 client.25765 shutdown 2024-09-12T02:57:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.953+0000 7f515e24c740 1 -- 172.21.15.18:0/1157962325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 msgr2=0x5612854748b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.953+0000 7f515e24c740 1 --2- 172.21.15.18:0/1157962325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x5612854748b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f514009b1c0 tx=0x7f5140097160 comp rx=0 tx=0).stop 2024-09-12T02:57:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.953+0000 7f515e24c740 1 -- 172.21.15.18:0/1157962325 shutdown_connections 2024-09-12T02:57:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.953+0000 7f515e24c740 1 --2- 172.21.15.18:0/1157962325 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x561285487160 0x5612854895c0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.953+0000 7f515e24c740 1 --2- 172.21.15.18:0/1157962325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5612854773a0 0x561285474df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.953+0000 7f515e24c740 1 --2- 172.21.15.18:0/1157962325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x5612854748b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.953+0000 7f515e24c740 1 --2- 172.21.15.18:0/1157962325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56128546c1e0 0x561285474370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.953+0000 7f515e24c740 1 -- 172.21.15.18:0/1157962325 >> 172.21.15.18:0/1157962325 conn(0x561285468750 msgr2=0x56128546e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:06.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.953+0000 7f513a000640 0 client.25765 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:57:06.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.953+0000 7f515e24c740 1 -- 172.21.15.18:0/1157962325 shutdown_connections 2024-09-12T02:57:06.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.953+0000 7f515e24c740 1 -- 172.21.15.18:0/1157962325 wait complete. 2024-09-12T02:57:06.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.953+0000 7f515e24c740 20 client.25765 trim_cache size 0 max 16384 2024-09-12T02:57:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.968+0000 7f515e24c740 1 Processor -- start 2024-09-12T02:57:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.968+0000 7f515e24c740 1 -- start start 2024-09-12T02:57:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f515e24c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546c1e0 0x56128546ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f515e24c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x56128548ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f515e24c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5612854773a0 0x56128548f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f515e24c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f51541b12d0 con 0x56128546c1e0 2024-09-12T02:57:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f515e24c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f51541b3050 con 0x5612854773a0 2024-09-12T02:57:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f515e24c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f51541b1a60 con 0x56128546cb00 2024-09-12T02:57:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f5158a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546c1e0 0x56128546ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f5153e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x56128548ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f5158a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546c1e0 0x56128546ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45488/0 (socket says 172.21.15.18:45488) 2024-09-12T02:57:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f5153e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x56128548ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:50114/0 (socket says 172.21.15.18:50114) 2024-09-12T02:57:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f5158a00640 1 -- 172.21.15.18:0/199415917 learned_addr learned my addr 172.21.15.18:0/199415917 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f5159400640 1 --2- 172.21.15.18:0/199415917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5612854773a0 0x56128548f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f5153e00640 1 -- 172.21.15.18:0/199415917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5612854773a0 msgr2=0x56128548f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f5153e00640 1 --2- 172.21.15.18:0/199415917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5612854773a0 0x56128548f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f5153e00640 1 -- 172.21.15.18:0/199415917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546c1e0 msgr2=0x56128546ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f5153e00640 1 --2- 172.21.15.18:0/199415917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546c1e0 0x56128546ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f5153e00640 1 -- 172.21.15.18:0/199415917 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56128546c010 con 0x56128546cb00 2024-09-12T02:57:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.969+0000 7f5153e00640 1 --2- 172.21.15.18:0/199415917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x56128548ee90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5140010fd0 tx=0x7f51400cf5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74377dc1fd682b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.970+0000 7f5145200640 1 -- 172.21.15.18:0/199415917 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140014030 con 0x56128546cb00 2024-09-12T02:57:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.970+0000 7f5145200640 1 -- 172.21.15.18:0/199415917 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5140009de0 con 0x56128546cb00 2024-09-12T02:57:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.970+0000 7f5145200640 1 -- 172.21.15.18:0/199415917 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514009a910 con 0x56128546cb00 2024-09-12T02:57:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.970+0000 7f515e24c740 1 -- 172.21.15.18:0/199415917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 msgr2=0x56128548ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.970+0000 7f515e24c740 1 --2- 172.21.15.18:0/199415917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x56128548ee90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5140010fd0 tx=0x7f51400cf5e0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.970+0000 7f515e24c740 1 -- 172.21.15.18:0/199415917 shutdown_connections 2024-09-12T02:57:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.970+0000 7f515e24c740 1 --2- 172.21.15.18:0/199415917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5612854773a0 0x56128548f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.970+0000 7f515e24c740 1 --2- 172.21.15.18:0/199415917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546cb00 0x56128548ee90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.970+0000 7f515e24c740 1 --2- 172.21.15.18:0/199415917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546c1e0 0x56128546ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.970+0000 7f515e24c740 1 -- 172.21.15.18:0/199415917 >> 172.21.15.18:0/199415917 conn(0x561285468750 msgr2=0x5612854762e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.970+0000 7f515e24c740 1 -- 172.21.15.18:0/199415917 shutdown_connections 2024-09-12T02:57:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.970+0000 7f515e24c740 1 -- 172.21.15.18:0/199415917 wait complete. 2024-09-12T02:57:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.971+0000 7f515e24c740 1 -- start start 2024-09-12T02:57:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.971+0000 7f515e24c740 1 Processor -- start 2024-09-12T02:57:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.971+0000 7f515e24c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546c1e0 0x56128547f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.971+0000 7f515e24c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546cb00 0x56128547f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.971+0000 7f515e24c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5612854773a0 0x56128547c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.971+0000 7f515e24c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f51541b28c0 con 0x56128546cb00 2024-09-12T02:57:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.971+0000 7f515e24c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f51541b21f0 con 0x5612854773a0 2024-09-12T02:57:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.971+0000 7f515e24c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f51541af2d0 con 0x56128546c1e0 2024-09-12T02:57:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.971+0000 7f515e24c740 10 client.0 _ll_register_callbacks cb 0x7f51400d2b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:57:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.972+0000 7f5158a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546c1e0 0x56128547f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.972+0000 7f5158a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546c1e0 0x56128547f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:50118/0 (socket says 172.21.15.18:50118) 2024-09-12T02:57:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.972+0000 7f5158a00640 1 -- 172.21.15.18:0/891538811 learned_addr learned my addr 172.21.15.18:0/891538811 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.972+0000 7f5153e00640 1 --2- 172.21.15.18:0/891538811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546cb00 0x56128547f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.972+0000 7f5159400640 1 --2- 172.21.15.18:0/891538811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5612854773a0 0x56128547c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.972+0000 7f5158a00640 1 -- 172.21.15.18:0/891538811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5612854773a0 msgr2=0x56128547c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.972+0000 7f5158a00640 1 --2- 172.21.15.18:0/891538811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5612854773a0 0x56128547c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.972+0000 7f5158a00640 1 -- 172.21.15.18:0/891538811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546cb00 msgr2=0x56128547f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.972+0000 7f5158a00640 1 --2- 172.21.15.18:0/891538811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546cb00 0x56128547f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.972+0000 7f5158a00640 1 -- 172.21.15.18:0/891538811 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561285463d60 con 0x56128546c1e0 2024-09-12T02:57:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.972+0000 7f5153e00640 1 --2- 172.21.15.18:0/891538811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546cb00 0x56128547f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.972+0000 7f5158a00640 1 --2- 172.21.15.18:0/891538811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546c1e0 0x56128547f4a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5148000c00 tx=0x7f5148005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=827a73896086d1fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.972+0000 7f513a000640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:57:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.972+0000 7f513a000640 1 -- 172.21.15.18:0/891538811 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148040040 con 0x56128546c1e0 2024-09-12T02:57:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.972+0000 7f515e24c740 1 -- 172.21.15.18:0/891538811 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5140009de0 con 0x56128546c1e0 2024-09-12T02:57:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.972+0000 7f513a000640 1 -- 172.21.15.18:0/891538811 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9562+0+0 (secure 0 0 0) 0x7f5148004230 con 0x56128546c1e0 2024-09-12T02:57:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.973+0000 7f513a000640 1 -- 172.21.15.18:0/891538811 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f5148062050 con 0x56128546c1e0 2024-09-12T02:57:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.973+0000 7f515e24c740 10 client.25771 fetch_fsmap learned FSMap version 60 2024-09-12T02:57:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.973+0000 7f515e24c740 1 -- 172.21.15.18:0/891538811 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x5612854f27e0 con 0x56128546c1e0 2024-09-12T02:57:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.973+0000 7f513a000640 1 -- 172.21.15.18:0/891538811 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5140009de0 con 0x56128546c1e0 2024-09-12T02:57:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.973+0000 7f513a000640 1 -- 172.21.15.18:0/891538811 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 60) ==== 8434+0+0 (secure 0 0 0) 0x7f5148050480 con 0x56128546c1e0 2024-09-12T02:57:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.973+0000 7f515e24c740 10 client.25771 fetch_fsmap finished waiting for FSMap version 60 2024-09-12T02:57:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.973+0000 7f515e24c740 10 client.25771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:57:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.973+0000 7f515e24c740 20 client.25771 populate_metadata read hostname 'smithi018' 2024-09-12T02:57:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.973+0000 7f515e24c740 1 --2- 172.21.15.18:0/891538811 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5612854f2be0 0x5612854f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.973+0000 7f515e24c740 4 client.25771 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:57:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.973+0000 7f515e24c740 1 -- 172.21.15.18:0/891538811 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5612853d9b80 con 0x5612854f2be0 2024-09-12T02:57:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.974+0000 7f5153e00640 1 --2- 172.21.15.18:0/891538811 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5612854f2be0 0x5612854f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:06 smithi176 ceph-mon[35713]: pgmap v258: 129 pgs: 129 active+clean; 2.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 384 op/s 2024-09-12T02:57:06.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:06 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:57:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.974+0000 7f5153e00640 1 --2- 172.21.15.18:0/891538811 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5612854f2be0 0x5612854f4fd0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0d5460d208198ec server_cookie=11471736df6e2e46 in_seq=0 out_seq=0 2024-09-12T02:57:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:06.974+0000 7f513a000640 10 client.25771 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:57:07.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.248+0000 7f513a000640 1 -- 172.21.15.18:0/891538811 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5612853d9b80 con 0x5612854f2be0 2024-09-12T02:57:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.248+0000 7f513a000640 10 client.25771 handle_command_reply: tid=0 2024-09-12T02:57:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.248+0000 7f515e24c740 1 client.25771 shutdown 2024-09-12T02:57:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.248+0000 7f515e24c740 1 -- 172.21.15.18:0/891538811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546c1e0 msgr2=0x56128547f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.248+0000 7f515e24c740 1 --2- 172.21.15.18:0/891538811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546c1e0 0x56128547f4a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5148000c00 tx=0x7f5148005a20 comp rx=0 tx=0).stop 2024-09-12T02:57:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.248+0000 7f515e24c740 1 -- 172.21.15.18:0/891538811 shutdown_connections 2024-09-12T02:57:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.248+0000 7f515e24c740 1 --2- 172.21.15.18:0/891538811 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5612854f2be0 0x5612854f4fd0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.248+0000 7f515e24c740 1 --2- 172.21.15.18:0/891538811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5612854773a0 0x56128547c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.248+0000 7f515e24c740 1 --2- 172.21.15.18:0/891538811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56128546cb00 0x56128547f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.248+0000 7f513a000640 0 client.25771 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:57:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.248+0000 7f515e24c740 1 --2- 172.21.15.18:0/891538811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56128546c1e0 0x56128547f4a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.248+0000 7f515e24c740 1 -- 172.21.15.18:0/891538811 >> 172.21.15.18:0/891538811 conn(0x561285468750 msgr2=0x561285467010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.248+0000 7f515e24c740 1 -- 172.21.15.18:0/891538811 shutdown_connections 2024-09-12T02:57:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.248+0000 7f515e24c740 1 -- 172.21.15.18:0/891538811 wait complete. 2024-09-12T02:57:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.249+0000 7f515e24c740 20 client.25771 trim_cache size 0 max 16384 2024-09-12T02:57:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:57:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:57:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:57:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:57:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.249+0000 7f515b400640 1 -- 172.21.15.18:0/220593432 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f513c0a2da0 msgr2=0x7f513c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.249+0000 7f515b400640 1 --2- 172.21.15.18:0/220593432 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f513c0a2da0 0x7f513c0a5260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f514c009fd0 tx=0x7f514c009500 comp rx=0 tx=0).stop 2024-09-12T02:57:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.249+0000 7f515b400640 1 -- 172.21.15.18:0/220593432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51541090a0 msgr2=0x7f515419ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.249+0000 7f515b400640 1 --2- 172.21.15.18:0/220593432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51541090a0 0x7f515419ab00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f514000d770 tx=0x7f514000dc30 comp rx=0 tx=0).stop 2024-09-12T02:57:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.249+0000 7f515b400640 1 -- 172.21.15.18:0/220593432 shutdown_connections 2024-09-12T02:57:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.249+0000 7f515b400640 1 --2- 172.21.15.18:0/220593432 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f513c0a2da0 0x7f513c0a5260 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.249+0000 7f515b400640 1 --2- 172.21.15.18:0/220593432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f515419ee80 0x7f515419f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.249+0000 7f515b400640 1 --2- 172.21.15.18:0/220593432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51541090a0 0x7f515419ab00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.249+0000 7f515b400640 1 --2- 172.21.15.18:0/220593432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5154103f50 0x7f515419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.249+0000 7f515b400640 1 -- 172.21.15.18:0/220593432 >> 172.21.15.18:0/220593432 conn(0x7f51540ff9e0 msgr2=0x7f5154100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.250+0000 7f515b400640 1 -- 172.21.15.18:0/220593432 shutdown_connections 2024-09-12T02:57:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:07.250+0000 7f515b400640 1 -- 172.21.15.18:0/220593432 wait complete. 2024-09-12T02:57:08.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:08 smithi018 ceph-mon[30616]: pgmap v259: 129 pgs: 129 active+clean; 2.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 259 op/s 2024-09-12T02:57:08.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:08 smithi018 ceph-mon[30616]: osdmap e104: 12 total, 12 up, 12 in 2024-09-12T02:57:08.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:08 smithi176 ceph-mon[35713]: pgmap v259: 129 pgs: 129 active+clean; 2.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 259 op/s 2024-09-12T02:57:08.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:08 smithi176 ceph-mon[35713]: osdmap e104: 12 total, 12 up, 12 in 2024-09-12T02:57:09.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:08 smithi062 ceph-mon[35527]: pgmap v259: 129 pgs: 129 active+clean; 2.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 259 op/s 2024-09-12T02:57:09.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:08 smithi062 ceph-mon[35527]: osdmap e104: 12 total, 12 up, 12 in 2024-09-12T02:57:10.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:10 smithi018 ceph-mon[30616]: pgmap v261: 129 pgs: 13 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 79 active+clean; 2.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 314 op/s 2024-09-12T02:57:10.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:10 smithi176 ceph-mon[35713]: pgmap v261: 129 pgs: 13 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 79 active+clean; 2.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 314 op/s 2024-09-12T02:57:11.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:10 smithi062 ceph-mon[35527]: pgmap v261: 129 pgs: 13 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 79 active+clean; 2.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 314 op/s 2024-09-12T02:57:12.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:12 smithi018 ceph-mon[30616]: pgmap v262: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 2.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 314 op/s 2024-09-12T02:57:12.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:12 smithi176 ceph-mon[35713]: pgmap v262: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 2.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 314 op/s 2024-09-12T02:57:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:12 smithi062 ceph-mon[35527]: pgmap v262: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 2.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 314 op/s 2024-09-12T02:57:14.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:14 smithi018 ceph-mon[30616]: pgmap v263: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 2.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 302 op/s 2024-09-12T02:57:14.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:14 smithi176 ceph-mon[35713]: pgmap v263: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 2.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 302 op/s 2024-09-12T02:57:15.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:14 smithi062 ceph-mon[35527]: pgmap v263: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 2.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 302 op/s 2024-09-12T02:57:16.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:16 smithi018 ceph-mon[30616]: pgmap v264: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 260 op/s 2024-09-12T02:57:16.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:16 smithi176 ceph-mon[35713]: pgmap v264: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 260 op/s 2024-09-12T02:57:17.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:16 smithi062 ceph-mon[35527]: pgmap v264: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 260 op/s 2024-09-12T02:57:18.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:18 smithi018 ceph-mon[30616]: pgmap v265: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 260 op/s 2024-09-12T02:57:18.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:18 smithi176 ceph-mon[35713]: pgmap v265: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 260 op/s 2024-09-12T02:57:19.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:18 smithi062 ceph-mon[35527]: pgmap v265: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 260 op/s 2024-09-12T02:57:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.440+0000 7f50b8c00640 1 -- 172.21.15.18:0/912919401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50b40745c0 msgr2=0x7f50b40749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.440+0000 7f50b8c00640 1 --2- 172.21.15.18:0/912919401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50b40745c0 0x7f50b40749a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009900 tx=0x7f50a402a4a0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.440+0000 7f50b8c00640 1 -- 172.21.15.18:0/912919401 shutdown_connections 2024-09-12T02:57:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.440+0000 7f50b8c00640 1 --2- 172.21.15.18:0/912919401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b410e150 0x7f50b4110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.440+0000 7f50b8c00640 1 --2- 172.21.15.18:0/912919401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50b4074ee0 0x7f50b410dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.440+0000 7f50b8c00640 1 --2- 172.21.15.18:0/912919401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50b40745c0 0x7f50b40749a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.440+0000 7f50b8c00640 1 -- 172.21.15.18:0/912919401 >> 172.21.15.18:0/912919401 conn(0x7f50b40fd5d0 msgr2=0x7f50b40ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.441+0000 7f50b8c00640 1 -- 172.21.15.18:0/912919401 shutdown_connections 2024-09-12T02:57:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.441+0000 7f50b8c00640 1 -- 172.21.15.18:0/912919401 wait complete. 2024-09-12T02:57:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.442+0000 7f50b8c00640 1 Processor -- start 2024-09-12T02:57:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.442+0000 7f50b8c00640 1 -- start start 2024-09-12T02:57:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.442+0000 7f50b8c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50b40745c0 0x7f50b410d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.442+0000 7f50b8c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50b4074ee0 0x7f50b410da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.442+0000 7f50b8c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b410e150 0x7f50b4107600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.442+0000 7f50b8c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f50b406c1e0 con 0x7f50b410e150 2024-09-12T02:57:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.442+0000 7f50b8c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f50b406c060 con 0x7f50b4074ee0 2024-09-12T02:57:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.442+0000 7f50b8c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f50b406c360 con 0x7f50b40745c0 2024-09-12T02:57:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.443+0000 7f50b2a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50b4074ee0 0x7f50b410da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.443+0000 7f50b2a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50b4074ee0 0x7f50b410da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:36344/0 (socket says 172.21.15.18:36344) 2024-09-12T02:57:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.443+0000 7f50b2a00640 1 -- 172.21.15.18:0/3954514867 learned_addr learned my addr 172.21.15.18:0/3954514867 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.443+0000 7f50b3400640 1 --2- 172.21.15.18:0/3954514867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50b40745c0 0x7f50b410d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.443+0000 7f50b3e00640 1 --2- 172.21.15.18:0/3954514867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b410e150 0x7f50b4107600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.443+0000 7f50b2a00640 1 -- 172.21.15.18:0/3954514867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50b40745c0 msgr2=0x7f50b410d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.443+0000 7f50b2a00640 1 --2- 172.21.15.18:0/3954514867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50b40745c0 0x7f50b410d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.443+0000 7f50b2a00640 1 -- 172.21.15.18:0/3954514867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b410e150 msgr2=0x7f50b4107600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.443+0000 7f50b2a00640 1 --2- 172.21.15.18:0/3954514867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b410e150 0x7f50b4107600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.443+0000 7f50b2a00640 1 -- 172.21.15.18:0/3954514867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b4107ec0 con 0x7f50b4074ee0 2024-09-12T02:57:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.444+0000 7f50b3e00640 1 --2- 172.21.15.18:0/3954514867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b410e150 0x7f50b4107600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.444+0000 7f50b2a00640 1 --2- 172.21.15.18:0/3954514867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50b4074ee0 0x7f50b410da90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f50a000d950 tx=0x7f50a000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.444+0000 7f50abe00640 1 -- 172.21.15.18:0/3954514867 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a0017030 con 0x7f50b4074ee0 2024-09-12T02:57:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.444+0000 7f50b8c00640 1 -- 172.21.15.18:0/3954514867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50b41081b0 con 0x7f50b4074ee0 2024-09-12T02:57:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.444+0000 7f50abe00640 1 -- 172.21.15.18:0/3954514867 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50a0004020 con 0x7f50b4074ee0 2024-09-12T02:57:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.444+0000 7f50abe00640 1 -- 172.21.15.18:0/3954514867 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a00047a0 con 0x7f50b4074ee0 2024-09-12T02:57:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.445+0000 7f50b8c00640 1 -- 172.21.15.18:0/3954514867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b41af870 con 0x7f50b4074ee0 2024-09-12T02:57:20.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.449+0000 7f50bd25a740 1 Processor -- start 2024-09-12T02:57:20.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.449+0000 7f50bd25a740 1 -- start start 2024-09-12T02:57:20.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.449+0000 7f50bd25a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b5161bbc0 0x562b5161bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.449+0000 7f50bd25a740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161c4e0 0x562b51626840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.449+0000 7f50bd25a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b51626d80 0x562b51629170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.449+0000 7f50bd25a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562b51579100 con 0x562b5161bbc0 2024-09-12T02:57:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.449+0000 7f50bd25a740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562b515211b0 con 0x562b5161c4e0 2024-09-12T02:57:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.449+0000 7f50bd25a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562b515750c0 con 0x562b51626d80 2024-09-12T02:57:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.450+0000 7f50abe00640 1 -- 172.21.15.18:0/3954514867 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f50a0004940 con 0x7f50b4074ee0 2024-09-12T02:57:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.450+0000 7f50b3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b5161bbc0 0x562b5161bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.450+0000 7f50b3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b5161bbc0 0x562b5161bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59762/0 (socket says 172.21.15.18:59762) 2024-09-12T02:57:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.450+0000 7f50b3e00640 1 -- 172.21.15.18:0/3681459174 learned_addr learned my addr 172.21.15.18:0/3681459174 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.450+0000 7f50b2a00640 1 --2- 172.21.15.18:0/3681459174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b51626d80 0x562b51629170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.451+0000 7f50b3400640 1 --2- 172.21.15.18:0/3681459174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161c4e0 0x562b51626840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.451+0000 7f50b3e00640 1 -- 172.21.15.18:0/3681459174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b51626d80 msgr2=0x562b51629170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.451+0000 7f50b3e00640 1 --2- 172.21.15.18:0/3681459174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b51626d80 0x562b51629170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.451+0000 7f50b3e00640 1 -- 172.21.15.18:0/3681459174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161c4e0 msgr2=0x562b51626840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.451+0000 7f50b3e00640 1 --2- 172.21.15.18:0/3681459174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161c4e0 0x562b51626840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.451+0000 7f50b3e00640 1 -- 172.21.15.18:0/3681459174 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b5128c210 con 0x562b5161bbc0 2024-09-12T02:57:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.451+0000 7f50b3400640 1 --2- 172.21.15.18:0/3681459174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161c4e0 0x562b51626840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.451+0000 7f50b3e00640 1 --2- 172.21.15.18:0/3681459174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b5161bbc0 0x562b5161bfa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f50ac009f80 tx=0x7f50ac010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26935f4a9091e7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.452+0000 7f509fe00640 1 -- 172.21.15.18:0/3681459174 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac011700 con 0x562b5161bbc0 2024-09-12T02:57:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.452+0000 7f509fe00640 1 -- 172.21.15.18:0/3681459174 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50ac011d80 con 0x562b5161bbc0 2024-09-12T02:57:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.452+0000 7f50abe00640 1 --2- 172.21.15.18:0/3954514867 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f50980a2dc0 0x7f50980a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.452+0000 7f50abe00640 1 -- 172.21.15.18:0/3954514867 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9650+0+0 (secure 0 0 0) 0x7f50a00cf120 con 0x7f50b4074ee0 2024-09-12T02:57:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.453+0000 7f509fe00640 1 -- 172.21.15.18:0/3681459174 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac011700 con 0x562b5161bbc0 2024-09-12T02:57:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.453+0000 7f50bd25a740 1 -- 172.21.15.18:0/3681459174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b5161bbc0 msgr2=0x562b5161bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.453+0000 7f50bd25a740 1 --2- 172.21.15.18:0/3681459174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b5161bbc0 0x562b5161bfa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f50ac009f80 tx=0x7f50ac010860 comp rx=0 tx=0).stop 2024-09-12T02:57:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.453+0000 7f50bd25a740 1 -- 172.21.15.18:0/3681459174 shutdown_connections 2024-09-12T02:57:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.453+0000 7f50bd25a740 1 --2- 172.21.15.18:0/3681459174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b51626d80 0x562b51629170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.453+0000 7f50bd25a740 1 --2- 172.21.15.18:0/3681459174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161c4e0 0x562b51626840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.453+0000 7f50bd25a740 1 --2- 172.21.15.18:0/3681459174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b5161bbc0 0x562b5161bfa0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.453+0000 7f50bd25a740 1 -- 172.21.15.18:0/3681459174 >> 172.21.15.18:0/3681459174 conn(0x562b51618130 msgr2=0x562b51618510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:20.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.454+0000 7f50b3400640 1 --2- 172.21.15.18:0/3954514867 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f50980a2dc0 0x7f50980a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.454+0000 7f50bd25a740 1 -- 172.21.15.18:0/3681459174 shutdown_connections 2024-09-12T02:57:20.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.454+0000 7f50bd25a740 1 -- 172.21.15.18:0/3681459174 wait complete. 2024-09-12T02:57:20.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.454+0000 7f50bd25a740 1 -- start start 2024-09-12T02:57:20.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.455+0000 7f50bd25a740 1 Processor -- start 2024-09-12T02:57:20.456 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.455+0000 7f50b3400640 1 --2- 172.21.15.18:0/3954514867 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f50980a2dc0 0x7f50980a5280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f50a4005ab0 tx=0x7f50a402a9a0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.456+0000 7f50bd25a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b5161bbc0 0x562b51626800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.456+0000 7f50bd25a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 0x562b51623b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.456+0000 7f50bd25a740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b51626d80 0x562b51624280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.456+0000 7f50bd25a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562b516299a0 con 0x562b5161bbc0 2024-09-12T02:57:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.456+0000 7f50bd25a740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562b51502090 con 0x562b51626d80 2024-09-12T02:57:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.456+0000 7f50bd25a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562b51629b20 con 0x562b5161c4e0 2024-09-12T02:57:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.456+0000 7f50bd25a740 10 client.0 _ll_register_callbacks cb 0x562b51556f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:57:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.456+0000 7f50b2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 0x562b51623b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.456+0000 7f50b2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 0x562b51623b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:37948/0 (socket says 172.21.15.18:37948) 2024-09-12T02:57:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.456+0000 7f50b2a00640 1 -- 172.21.15.18:0/2113233559 learned_addr learned my addr 172.21.15.18:0/2113233559 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.456+0000 7f50b3400640 1 --2- 172.21.15.18:0/2113233559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b5161bbc0 0x562b51626800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.456+0000 7f50b3e00640 1 --2- 172.21.15.18:0/2113233559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b51626d80 0x562b51624280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.457+0000 7f50b2a00640 1 -- 172.21.15.18:0/2113233559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b51626d80 msgr2=0x562b51624280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.457+0000 7f50b2a00640 1 --2- 172.21.15.18:0/2113233559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b51626d80 0x562b51624280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.457+0000 7f50b2a00640 1 -- 172.21.15.18:0/2113233559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b5161bbc0 msgr2=0x562b51626800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.457+0000 7f50b2a00640 1 --2- 172.21.15.18:0/2113233559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b5161bbc0 0x562b51626800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.457+0000 7f50b2a00640 1 -- 172.21.15.18:0/2113233559 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b51358620 con 0x562b5161c4e0 2024-09-12T02:57:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.457+0000 7f50b2a00640 1 --2- 172.21.15.18:0/2113233559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 0x562b51623b40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009610 tx=0x7f50a0097570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9379164f978fe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.457+0000 7f509cc00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:57:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.457+0000 7f509cc00640 1 -- 172.21.15.18:0/2113233559 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a00cc880 con 0x562b5161c4e0 2024-09-12T02:57:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.457+0000 7f509cc00640 1 -- 172.21.15.18:0/2113233559 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9650+0+0 (secure 0 0 0) 0x7f50a00a39b0 con 0x562b5161c4e0 2024-09-12T02:57:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.457+0000 7f50bd25a740 1 -- 172.21.15.18:0/2113233559 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50ac011d80 con 0x562b5161c4e0 2024-09-12T02:57:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.458+0000 7f509cc00640 1 -- 172.21.15.18:0/2113233559 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f50a009b8d0 con 0x562b5161c4e0 2024-09-12T02:57:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.458+0000 7f50bd25a740 10 client.25783 fetch_fsmap learned FSMap version 60 2024-09-12T02:57:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.459+0000 7f50bd25a740 1 -- 172.21.15.18:0/2113233559 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x562b5160f2f0 con 0x562b5161c4e0 2024-09-12T02:57:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.459+0000 7f509cc00640 1 -- 172.21.15.18:0/2113233559 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50ac011d80 con 0x562b5161c4e0 2024-09-12T02:57:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.460+0000 7f509cc00640 1 -- 172.21.15.18:0/2113233559 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 60) ==== 8434+0+0 (secure 0 0 0) 0x7f50a009f190 con 0x562b5161c4e0 2024-09-12T02:57:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.460+0000 7f50bd25a740 10 client.25783 fetch_fsmap finished waiting for FSMap version 60 2024-09-12T02:57:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.460+0000 7f50bd25a740 10 client.25783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:57:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.460+0000 7f50bd25a740 20 client.25783 populate_metadata read hostname 'smithi018' 2024-09-12T02:57:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.460+0000 7f50bd25a740 1 --2- 172.21.15.18:0/2113233559 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562b516108f0 0x562b51612d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.460+0000 7f50bd25a740 4 client.25783 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:57:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.460+0000 7f50bd25a740 1 -- 172.21.15.18:0/2113233559 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b51586830 con 0x562b516108f0 2024-09-12T02:57:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.461+0000 7f50b3400640 1 --2- 172.21.15.18:0/2113233559 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562b516108f0 0x562b51612d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.462+0000 7f50b3400640 1 --2- 172.21.15.18:0/2113233559 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562b516108f0 0x562b51612d10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9812760667bdd8e9 server_cookie=1e96946c657acde4 in_seq=0 out_seq=0 2024-09-12T02:57:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.462+0000 7f509cc00640 10 client.25783 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:57:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.464+0000 7f509cc00640 1 -- 172.21.15.18:0/2113233559 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b51586830 con 0x562b516108f0 2024-09-12T02:57:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.464+0000 7f509cc00640 10 client.25783 handle_command_reply: tid=0 2024-09-12T02:57:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.464+0000 7f50bd25a740 1 client.25783 shutdown 2024-09-12T02:57:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.464+0000 7f50bd25a740 1 -- 172.21.15.18:0/2113233559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 msgr2=0x562b51623b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.464+0000 7f50bd25a740 1 --2- 172.21.15.18:0/2113233559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 0x562b51623b40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009610 tx=0x7f50a0097570 comp rx=0 tx=0).stop 2024-09-12T02:57:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.465+0000 7f50bd25a740 1 -- 172.21.15.18:0/2113233559 shutdown_connections 2024-09-12T02:57:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.465+0000 7f50bd25a740 1 --2- 172.21.15.18:0/2113233559 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562b516108f0 0x562b51612d10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.465+0000 7f50bd25a740 1 --2- 172.21.15.18:0/2113233559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b51626d80 0x562b51624280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.465+0000 7f50bd25a740 1 --2- 172.21.15.18:0/2113233559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 0x562b51623b40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.465+0000 7f50bd25a740 1 --2- 172.21.15.18:0/2113233559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b5161bbc0 0x562b51626800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.465+0000 7f50bd25a740 1 -- 172.21.15.18:0/2113233559 >> 172.21.15.18:0/2113233559 conn(0x562b51618130 msgr2=0x562b5161de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.465+0000 7f509cc00640 0 client.25783 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:57:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.465+0000 7f50bd25a740 1 -- 172.21.15.18:0/2113233559 shutdown_connections 2024-09-12T02:57:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.465+0000 7f50bd25a740 1 -- 172.21.15.18:0/2113233559 wait complete. 2024-09-12T02:57:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.466+0000 7f50bd25a740 20 client.25783 trim_cache size 0 max 16384 2024-09-12T02:57:20.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.495+0000 7f50bd25a740 1 Processor -- start 2024-09-12T02:57:20.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.495+0000 7f50bd25a740 1 -- start start 2024-09-12T02:57:20.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.495+0000 7f50bd25a740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161bbc0 0x562b5161e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.495+0000 7f50bd25a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 0x562b51632e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.495+0000 7f50bd25a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b51626d80 0x562b51626410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.495+0000 7f50bd25a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5094010160 con 0x562b51626d80 2024-09-12T02:57:20.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.495+0000 7f50bd25a740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5094011ee0 con 0x562b5161bbc0 2024-09-12T02:57:20.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.495+0000 7f50bd25a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f50940108f0 con 0x562b5161c4e0 2024-09-12T02:57:20.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.496+0000 7f50b3400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161bbc0 0x562b5161e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.496+0000 7f50b3400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161bbc0 0x562b5161e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:36364/0 (socket says 172.21.15.18:36364) 2024-09-12T02:57:20.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.496+0000 7f50b3400640 1 -- 172.21.15.18:0/3515032589 learned_addr learned my addr 172.21.15.18:0/3515032589 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:20.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.496+0000 7f50b2a00640 1 --2- 172.21.15.18:0/3515032589 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 0x562b51632e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.496+0000 7f50b3e00640 1 --2- 172.21.15.18:0/3515032589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b51626d80 0x562b51626410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.496+0000 7f50b3400640 1 -- 172.21.15.18:0/3515032589 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 msgr2=0x562b51632e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:20.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.496+0000 7f50b3400640 1 --2- 172.21.15.18:0/3515032589 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 0x562b51632e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.496+0000 7f50b3400640 1 -- 172.21.15.18:0/3515032589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b51626d80 msgr2=0x562b51626410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:20.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.496+0000 7f50b3400640 1 --2- 172.21.15.18:0/3515032589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b51626d80 0x562b51626410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.496+0000 7f50b3400640 1 -- 172.21.15.18:0/3515032589 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b51617f60 con 0x562b5161bbc0 2024-09-12T02:57:20.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.496+0000 7f50b2a00640 1 --2- 172.21.15.18:0/3515032589 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 0x562b51632e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:20.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.497+0000 7f50b3400640 1 --2- 172.21.15.18:0/3515032589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161bbc0 0x562b5161e680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f50a4000c00 tx=0x7f50a403e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2a5fc1cf40029c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:20.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.498+0000 7f509f400640 1 -- 172.21.15.18:0/3515032589 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a4056070 con 0x562b5161bbc0 2024-09-12T02:57:20.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.498+0000 7f509f400640 1 -- 172.21.15.18:0/3515032589 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50a4003c00 con 0x562b5161bbc0 2024-09-12T02:57:20.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.498+0000 7f509f400640 1 -- 172.21.15.18:0/3515032589 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a4056070 con 0x562b5161bbc0 2024-09-12T02:57:20.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.499+0000 7f50bd25a740 1 -- 172.21.15.18:0/3515032589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161bbc0 msgr2=0x562b5161e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:20.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.499+0000 7f50bd25a740 1 --2- 172.21.15.18:0/3515032589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161bbc0 0x562b5161e680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f50a4000c00 tx=0x7f50a403e000 comp rx=0 tx=0).stop 2024-09-12T02:57:20.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.500+0000 7f50bd25a740 1 -- 172.21.15.18:0/3515032589 shutdown_connections 2024-09-12T02:57:20.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.501+0000 7f50bd25a740 1 --2- 172.21.15.18:0/3515032589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b51626d80 0x562b51626410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.501+0000 7f50bd25a740 1 --2- 172.21.15.18:0/3515032589 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 0x562b51632e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.501+0000 7f50bd25a740 1 --2- 172.21.15.18:0/3515032589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161bbc0 0x562b5161e680 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.501+0000 7f50bd25a740 1 -- 172.21.15.18:0/3515032589 >> 172.21.15.18:0/3515032589 conn(0x562b51618130 msgr2=0x562b51625ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:20.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.501+0000 7f50bd25a740 1 -- 172.21.15.18:0/3515032589 shutdown_connections 2024-09-12T02:57:20.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.501+0000 7f50bd25a740 1 -- 172.21.15.18:0/3515032589 wait complete. 2024-09-12T02:57:20.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.502+0000 7f50bd25a740 1 -- start start 2024-09-12T02:57:20.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.502+0000 7f50bd25a740 1 Processor -- start 2024-09-12T02:57:20.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.503+0000 7f50bd25a740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161bbc0 0x562b5163ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.504+0000 7f50bd25a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 0x562b51637e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.504+0000 7f50bd25a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b51626d80 0x562b51638390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.504+0000 7f50bd25a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5094011750 con 0x562b51626d80 2024-09-12T02:57:20.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.504+0000 7f50bd25a740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5094011080 con 0x562b5161bbc0 2024-09-12T02:57:20.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.504+0000 7f50bd25a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f509400e160 con 0x562b5161c4e0 2024-09-12T02:57:20.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.504+0000 7f50bd25a740 10 client.0 _ll_register_callbacks cb 0x7f50a0005cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:57:20.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.504+0000 7f50b3400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161bbc0 0x562b5163ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.504+0000 7f50b3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b51626d80 0x562b51638390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.504+0000 7f50b3400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161bbc0 0x562b5163ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:36370/0 (socket says 172.21.15.18:36370) 2024-09-12T02:57:20.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.504+0000 7f50b3400640 1 -- 172.21.15.18:0/1440039928 learned_addr learned my addr 172.21.15.18:0/1440039928 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:20.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.504+0000 7f50b2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 0x562b51637e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.505+0000 7f50b3400640 1 -- 172.21.15.18:0/1440039928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 msgr2=0x562b51637e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:20.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.505+0000 7f50b3400640 1 --2- 172.21.15.18:0/1440039928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 0x562b51637e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.505+0000 7f50b3400640 1 -- 172.21.15.18:0/1440039928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b51626d80 msgr2=0x562b51638390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:20.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.505+0000 7f50b3400640 1 --2- 172.21.15.18:0/1440039928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b51626d80 0x562b51638390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.505+0000 7f50b3400640 1 -- 172.21.15.18:0/1440039928 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b51638a30 con 0x562b5161bbc0 2024-09-12T02:57:20.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.505+0000 7f50b3e00640 1 --2- 172.21.15.18:0/1440039928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b51626d80 0x562b51638390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:20.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.506+0000 7f50b3400640 1 --2- 172.21.15.18:0/1440039928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161bbc0 0x562b5163ab10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009900 tx=0x7f50a4009230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=190a5bcc89f889f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:20.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.506+0000 7f509cc00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:57:20.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.507+0000 7f509cc00640 1 -- 172.21.15.18:0/1440039928 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a405f060 con 0x562b5161bbc0 2024-09-12T02:57:20.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.507+0000 7f50bd25a740 1 -- 172.21.15.18:0/1440039928 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50a4003c00 con 0x562b5161bbc0 2024-09-12T02:57:20.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.507+0000 7f509cc00640 1 -- 172.21.15.18:0/1440039928 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9650+0+0 (secure 0 0 0) 0x7f50a4003db0 con 0x562b5161bbc0 2024-09-12T02:57:20.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.508+0000 7f509cc00640 1 -- 172.21.15.18:0/1440039928 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f50a4056040 con 0x562b5161bbc0 2024-09-12T02:57:20.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.508+0000 7f50bd25a740 10 client.25787 fetch_fsmap learned FSMap version 60 2024-09-12T02:57:20.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.508+0000 7f50bd25a740 1 -- 172.21.15.18:0/1440039928 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x562b516993b0 con 0x562b5161bbc0 2024-09-12T02:57:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.510+0000 7f509cc00640 1 -- 172.21.15.18:0/1440039928 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50a4003c00 con 0x562b5161bbc0 2024-09-12T02:57:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.510+0000 7f509cc00640 1 -- 172.21.15.18:0/1440039928 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 60) ==== 8434+0+0 (secure 0 0 0) 0x7f50a4050840 con 0x562b5161bbc0 2024-09-12T02:57:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.510+0000 7f50bd25a740 10 client.25787 fetch_fsmap finished waiting for FSMap version 60 2024-09-12T02:57:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.510+0000 7f50bd25a740 10 client.25787 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:57:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.510+0000 7f50bd25a740 20 client.25787 populate_metadata read hostname 'smithi018' 2024-09-12T02:57:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.510+0000 7f50bd25a740 1 --2- 172.21.15.18:0/1440039928 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562b51699a90 0x562b5169beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.510+0000 7f50bd25a740 4 client.25787 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:57:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.510+0000 7f50bd25a740 1 -- 172.21.15.18:0/1440039928 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562b51580b80 con 0x562b51699a90 2024-09-12T02:57:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.511+0000 7f50b2a00640 1 --2- 172.21.15.18:0/1440039928 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562b51699a90 0x562b5169beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.515+0000 7f50b2a00640 1 --2- 172.21.15.18:0/1440039928 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562b51699a90 0x562b5169beb0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bfbb5a964baab0a server_cookie=6a64e049dff068c5 in_seq=0 out_seq=0 2024-09-12T02:57:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.515+0000 7f509cc00640 10 client.25787 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:57:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.643+0000 7f509cc00640 1 -- 172.21.15.18:0/1440039928 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562b51580b80 con 0x562b51699a90 2024-09-12T02:57:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.643+0000 7f509cc00640 10 client.25787 handle_command_reply: tid=0 2024-09-12T02:57:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.643+0000 7f50bd25a740 1 client.25787 shutdown 2024-09-12T02:57:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.643+0000 7f50bd25a740 1 -- 172.21.15.18:0/1440039928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161bbc0 msgr2=0x562b5163ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.643+0000 7f50bd25a740 1 --2- 172.21.15.18:0/1440039928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161bbc0 0x562b5163ab10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009900 tx=0x7f50a4009230 comp rx=0 tx=0).stop 2024-09-12T02:57:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.643+0000 7f50bd25a740 1 -- 172.21.15.18:0/1440039928 shutdown_connections 2024-09-12T02:57:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.643+0000 7f50bd25a740 1 --2- 172.21.15.18:0/1440039928 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562b51699a90 0x562b5169beb0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.643+0000 7f50bd25a740 1 --2- 172.21.15.18:0/1440039928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b51626d80 0x562b51638390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.643+0000 7f50bd25a740 1 --2- 172.21.15.18:0/1440039928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562b5161c4e0 0x562b51637e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.643+0000 7f50bd25a740 1 --2- 172.21.15.18:0/1440039928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b5161bbc0 0x562b5163ab10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.643+0000 7f50bd25a740 1 -- 172.21.15.18:0/1440039928 >> 172.21.15.18:0/1440039928 conn(0x562b51618130 msgr2=0x562b5160e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:20.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.643+0000 7f509cc00640 0 client.25787 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:57:20.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.644+0000 7f50bd25a740 1 -- 172.21.15.18:0/1440039928 shutdown_connections 2024-09-12T02:57:20.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.644+0000 7f50bd25a740 1 -- 172.21.15.18:0/1440039928 wait complete. 2024-09-12T02:57:20.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.645+0000 7f50bd25a740 20 client.25787 trim_cache size 0 max 16384 2024-09-12T02:57:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:57:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:57:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:57:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:57:20.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.646+0000 7f50b8c00640 1 -- 172.21.15.18:0/3954514867 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f50980a2dc0 msgr2=0x7f50980a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:20.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.646+0000 7f50b8c00640 1 --2- 172.21.15.18:0/3954514867 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f50980a2dc0 0x7f50980a5280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f50a4005ab0 tx=0x7f50a402a9a0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.646+0000 7f50b8c00640 1 -- 172.21.15.18:0/3954514867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50b4074ee0 msgr2=0x7f50b410da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:20.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.646+0000 7f50b8c00640 1 --2- 172.21.15.18:0/3954514867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50b4074ee0 0x7f50b410da90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f50a000d950 tx=0x7f50a000de10 comp rx=0 tx=0).stop 2024-09-12T02:57:20.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.646+0000 7f50b8c00640 1 -- 172.21.15.18:0/3954514867 shutdown_connections 2024-09-12T02:57:20.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.646+0000 7f50b8c00640 1 --2- 172.21.15.18:0/3954514867 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f50980a2dc0 0x7f50980a5280 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f50a4005ab0 tx=0x7f50a402a9a0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.646+0000 7f50b8c00640 1 --2- 172.21.15.18:0/3954514867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b410e150 0x7f50b4107600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.646+0000 7f50b8c00640 1 --2- 172.21.15.18:0/3954514867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50b4074ee0 0x7f50b410da90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.646+0000 7f50b8c00640 1 --2- 172.21.15.18:0/3954514867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50b40745c0 0x7f50b410d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:20.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.646+0000 7f50b8c00640 1 -- 172.21.15.18:0/3954514867 >> 172.21.15.18:0/3954514867 conn(0x7f50b40fd5d0 msgr2=0x7f50b40fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:20.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.647+0000 7f50b8c00640 1 -- 172.21.15.18:0/3954514867 shutdown_connections 2024-09-12T02:57:20.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:20.647+0000 7f50b8c00640 1 -- 172.21.15.18:0/3954514867 wait complete. 2024-09-12T02:57:20.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:20 smithi018 ceph-mon[30616]: pgmap v266: 129 pgs: 7 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 103 active+clean; 2.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 276 op/s 2024-09-12T02:57:20.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:20 smithi176 ceph-mon[35713]: pgmap v266: 129 pgs: 7 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 103 active+clean; 2.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 276 op/s 2024-09-12T02:57:21.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:20 smithi062 ceph-mon[35527]: pgmap v266: 129 pgs: 7 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 103 active+clean; 2.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 276 op/s 2024-09-12T02:57:22.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:22 smithi018 ceph-mon[30616]: pgmap v267: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 2.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 226 op/s 2024-09-12T02:57:22.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:22 smithi176 ceph-mon[35713]: pgmap v267: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 2.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 226 op/s 2024-09-12T02:57:23.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:22 smithi062 ceph-mon[35527]: pgmap v267: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 2.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 226 op/s 2024-09-12T02:57:24.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:24 smithi018 ceph-mon[30616]: pgmap v268: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 2.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 177 op/s 2024-09-12T02:57:24.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:24 smithi176 ceph-mon[35713]: pgmap v268: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 2.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 177 op/s 2024-09-12T02:57:25.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:24 smithi062 ceph-mon[35527]: pgmap v268: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 2.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 177 op/s 2024-09-12T02:57:26.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:26 smithi176 ceph-mon[35713]: pgmap v269: 129 pgs: 129 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 306 op/s 2024-09-12T02:57:26.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:26 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:57:26.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:26 smithi176 ceph-mon[35713]: osdmap e105: 12 total, 12 up, 12 in 2024-09-12T02:57:27.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:26 smithi062 ceph-mon[35527]: pgmap v269: 129 pgs: 129 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 306 op/s 2024-09-12T02:57:27.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:26 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:57:27.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:26 smithi062 ceph-mon[35527]: osdmap e105: 12 total, 12 up, 12 in 2024-09-12T02:57:27.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:26 smithi018 ceph-mon[30616]: pgmap v269: 129 pgs: 129 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 306 op/s 2024-09-12T02:57:27.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:26 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:57:27.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:26 smithi018 ceph-mon[30616]: osdmap e105: 12 total, 12 up, 12 in 2024-09-12T02:57:28.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:28 smithi176 ceph-mon[35713]: pgmap v271: 129 pgs: 129 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 280 op/s 2024-09-12T02:57:29.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:28 smithi062 ceph-mon[35527]: pgmap v271: 129 pgs: 129 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 280 op/s 2024-09-12T02:57:29.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:28 smithi018 ceph-mon[30616]: pgmap v271: 129 pgs: 129 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 280 op/s 2024-09-12T02:57:30.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:30 smithi176 ceph-mon[35713]: pgmap v272: 129 pgs: 129 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 401 op/s 2024-09-12T02:57:31.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:30 smithi062 ceph-mon[35527]: pgmap v272: 129 pgs: 129 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 401 op/s 2024-09-12T02:57:31.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:30 smithi018 ceph-mon[30616]: pgmap v272: 129 pgs: 129 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 401 op/s 2024-09-12T02:57:32.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:32 smithi176 ceph-mon[35713]: pgmap v273: 129 pgs: 129 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 441 op/s 2024-09-12T02:57:33.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:32 smithi062 ceph-mon[35527]: pgmap v273: 129 pgs: 129 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 441 op/s 2024-09-12T02:57:33.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:32 smithi018 ceph-mon[30616]: pgmap v273: 129 pgs: 129 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 441 op/s 2024-09-12T02:57:33.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.786+0000 7f5645200640 1 -- 172.21.15.18:0/947802217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56401048e0 msgr2=0x7f5640108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.786+0000 7f5645200640 1 --2- 172.21.15.18:0/947802217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56401048e0 0x7f5640108920 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f562c009900 tx=0x7f562c02a410 comp rx=0 tx=0).stop 2024-09-12T02:57:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.786+0000 7f5645200640 1 -- 172.21.15.18:0/947802217 shutdown_connections 2024-09-12T02:57:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.786+0000 7f5645200640 1 --2- 172.21.15.18:0/947802217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5640109080 0x7f5640110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.786+0000 7f5645200640 1 --2- 172.21.15.18:0/947802217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56401048e0 0x7f5640108920 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.786+0000 7f5645200640 1 --2- 172.21.15.18:0/947802217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5640103f30 0x7f5640104310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.786+0000 7f5645200640 1 -- 172.21.15.18:0/947802217 >> 172.21.15.18:0/947802217 conn(0x7f56400ff980 msgr2=0x7f5640101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.786+0000 7f5645200640 1 -- 172.21.15.18:0/947802217 shutdown_connections 2024-09-12T02:57:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.786+0000 7f5645200640 1 -- 172.21.15.18:0/947802217 wait complete. 2024-09-12T02:57:33.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.787+0000 7f5645200640 1 Processor -- start 2024-09-12T02:57:33.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.787+0000 7f5645200640 1 -- start start 2024-09-12T02:57:33.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.787+0000 7f5645200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5640103f30 0x7f564019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.787+0000 7f5645200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5640109080 0x7f564019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.787+0000 7f5645200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f564019ee40 0x7f564019f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.787+0000 7f5645200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f56401140f0 con 0x7f564019ee40 2024-09-12T02:57:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.787+0000 7f5645200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5640113f70 con 0x7f5640109080 2024-09-12T02:57:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.787+0000 7f5645200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5640114270 con 0x7f5640103f30 2024-09-12T02:57:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.788+0000 7f563de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5640103f30 0x7f564019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.788+0000 7f563de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5640103f30 0x7f564019a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:53788/0 (socket says 172.21.15.18:53788) 2024-09-12T02:57:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.788+0000 7f563de00640 1 -- 172.21.15.18:0/2190046488 learned_addr learned my addr 172.21.15.18:0/2190046488 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.788+0000 7f563e800640 1 --2- 172.21.15.18:0/2190046488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f564019ee40 0x7f564019f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.788+0000 7f563d400640 1 --2- 172.21.15.18:0/2190046488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5640109080 0x7f564019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.788+0000 7f563de00640 1 -- 172.21.15.18:0/2190046488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5640109080 msgr2=0x7f564019aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.788+0000 7f563de00640 1 --2- 172.21.15.18:0/2190046488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5640109080 0x7f564019aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.788+0000 7f563de00640 1 -- 172.21.15.18:0/2190046488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f564019ee40 msgr2=0x7f564019f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.788+0000 7f563de00640 1 --2- 172.21.15.18:0/2190046488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f564019ee40 0x7f564019f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.788+0000 7f563de00640 1 -- 172.21.15.18:0/2190046488 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564019f930 con 0x7f5640103f30 2024-09-12T02:57:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.788+0000 7f563d400640 1 --2- 172.21.15.18:0/2190046488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5640109080 0x7f564019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.788+0000 7f563de00640 1 --2- 172.21.15.18:0/2190046488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5640103f30 0x7f564019a580 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f563000e9f0 tx=0x7f563000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.789+0000 7f5636a00640 1 -- 172.21.15.18:0/2190046488 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563000cd80 con 0x7f5640103f30 2024-09-12T02:57:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.789+0000 7f5645200640 1 -- 172.21.15.18:0/2190046488 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f564019fc20 con 0x7f5640103f30 2024-09-12T02:57:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.789+0000 7f5636a00640 1 -- 172.21.15.18:0/2190046488 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5630010910 con 0x7f5640103f30 2024-09-12T02:57:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.789+0000 7f5636a00640 1 -- 172.21.15.18:0/2190046488 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630018990 con 0x7f5640103f30 2024-09-12T02:57:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.789+0000 7f5645200640 1 -- 172.21.15.18:0/2190046488 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56401a7430 con 0x7f5640103f30 2024-09-12T02:57:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.792+0000 7f5648253740 1 Processor -- start 2024-09-12T02:57:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.792+0000 7f5636a00640 1 -- 172.21.15.18:0/2190046488 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f5630010ac0 con 0x7f5640103f30 2024-09-12T02:57:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.792+0000 7f5648253740 1 -- start start 2024-09-12T02:57:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.792+0000 7f5648253740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7367641e0 0x55a7367645c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.792+0000 7f5648253740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a736764b00 0x55a73676ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.792+0000 7f5648253740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a73676f3a0 0x55a736771790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.792+0000 7f5648253740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a7366ca100 con 0x55a7367641e0 2024-09-12T02:57:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.792+0000 7f5648253740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a7366721b0 con 0x55a73676f3a0 2024-09-12T02:57:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.792+0000 7f5648253740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55a7366c60c0 con 0x55a736764b00 2024-09-12T02:57:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.793+0000 7f563de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a736764b00 0x55a73676ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.793+0000 7f563de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a736764b00 0x55a73676ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:53802/0 (socket says 172.21.15.18:53802) 2024-09-12T02:57:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.793+0000 7f563de00640 1 -- 172.21.15.18:0/2474974395 learned_addr learned my addr 172.21.15.18:0/2474974395 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.793+0000 7f563e800640 1 --2- 172.21.15.18:0/2474974395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7367641e0 0x55a7367645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.793+0000 7f563d400640 1 --2- 172.21.15.18:0/2474974395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a73676f3a0 0x55a736771790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.793+0000 7f563de00640 1 -- 172.21.15.18:0/2474974395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a73676f3a0 msgr2=0x55a736771790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.793+0000 7f563de00640 1 --2- 172.21.15.18:0/2474974395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a73676f3a0 0x55a736771790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.793+0000 7f563de00640 1 -- 172.21.15.18:0/2474974395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7367641e0 msgr2=0x55a7367645c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.793+0000 7f563de00640 1 --2- 172.21.15.18:0/2474974395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7367641e0 0x55a7367645c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.793+0000 7f563de00640 1 -- 172.21.15.18:0/2474974395 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7363dd210 con 0x55a736764b00 2024-09-12T02:57:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.793+0000 7f563de00640 1 --2- 172.21.15.18:0/2474974395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a736764b00 0x55a73676ee60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f56300cce00 tx=0x7f56300d86a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdec80f8ec5f82fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.794+0000 7f5636a00640 1 --2- 172.21.15.18:0/2190046488 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f56240a2e20 0x7f56240a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.794+0000 7f562b400640 1 -- 172.21.15.18:0/2474974395 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56300df020 con 0x55a736764b00 2024-09-12T02:57:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.794+0000 7f562b400640 1 -- 172.21.15.18:0/2474974395 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56300851d0 con 0x55a736764b00 2024-09-12T02:57:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.794+0000 7f562b400640 1 -- 172.21.15.18:0/2474974395 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630089200 con 0x55a736764b00 2024-09-12T02:57:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.794+0000 7f5636a00640 1 -- 172.21.15.18:0/2190046488 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9562+0+0 (secure 0 0 0) 0x7f56300cfbe0 con 0x7f5640103f30 2024-09-12T02:57:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.794+0000 7f563e800640 1 --2- 172.21.15.18:0/2190046488 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f56240a2e20 0x7f56240a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.794+0000 7f5648253740 1 -- 172.21.15.18:0/2474974395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a736764b00 msgr2=0x55a73676ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.794+0000 7f5648253740 1 --2- 172.21.15.18:0/2474974395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a736764b00 0x55a73676ee60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f56300cce00 tx=0x7f56300d86a0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.795+0000 7f5648253740 1 -- 172.21.15.18:0/2474974395 shutdown_connections 2024-09-12T02:57:33.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.795+0000 7f5648253740 1 --2- 172.21.15.18:0/2474974395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a73676f3a0 0x55a736771790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.795+0000 7f5648253740 1 --2- 172.21.15.18:0/2474974395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a736764b00 0x55a73676ee60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.795+0000 7f5648253740 1 --2- 172.21.15.18:0/2474974395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7367641e0 0x55a7367645c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.795+0000 7f5648253740 1 -- 172.21.15.18:0/2474974395 >> 172.21.15.18:0/2474974395 conn(0x55a736760750 msgr2=0x55a736760b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:33.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.795+0000 7f563e800640 1 --2- 172.21.15.18:0/2190046488 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f56240a2e20 0x7f56240a52e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5638005fd0 tx=0x7f5638009500 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:33.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.795+0000 7f5648253740 1 -- 172.21.15.18:0/2474974395 shutdown_connections 2024-09-12T02:57:33.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.795+0000 7f5648253740 1 -- 172.21.15.18:0/2474974395 wait complete. 2024-09-12T02:57:33.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.795+0000 7f5648253740 1 -- start start 2024-09-12T02:57:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.795+0000 7f5648253740 1 Processor -- start 2024-09-12T02:57:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f5648253740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7367641e0 0x55a73676c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f5648253740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a736764b00 0x55a73676c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f5648253740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a73676f3a0 0x55a73676cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f5648253740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a736771f70 con 0x55a73676f3a0 2024-09-12T02:57:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f5648253740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a736653090 con 0x55a736764b00 2024-09-12T02:57:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f5648253740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55a7367720f0 con 0x55a7367641e0 2024-09-12T02:57:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f5648253740 10 client.0 _ll_register_callbacks cb 0x55a7366a7f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:57:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f563de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7367641e0 0x55a73676c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f563de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7367641e0 0x55a73676c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:53816/0 (socket says 172.21.15.18:53816) 2024-09-12T02:57:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f563de00640 1 -- 172.21.15.18:0/1341748859 learned_addr learned my addr 172.21.15.18:0/1341748859 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f563e800640 1 --2- 172.21.15.18:0/1341748859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a73676f3a0 0x55a73676cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f563d400640 1 --2- 172.21.15.18:0/1341748859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a736764b00 0x55a73676c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f563de00640 1 -- 172.21.15.18:0/1341748859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a736764b00 msgr2=0x55a73676c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f563de00640 1 --2- 172.21.15.18:0/1341748859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a736764b00 0x55a73676c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f563de00640 1 -- 172.21.15.18:0/1341748859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a73676f3a0 msgr2=0x55a73676cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f563de00640 1 --2- 172.21.15.18:0/1341748859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a73676f3a0 0x55a73676cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f563de00640 1 -- 172.21.15.18:0/1341748859 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7364a9620 con 0x55a7367641e0 2024-09-12T02:57:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f563e800640 1 --2- 172.21.15.18:0/1341748859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a73676f3a0 0x55a73676cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.796+0000 7f563de00640 1 --2- 172.21.15.18:0/1341748859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7367641e0 0x55a73676c2d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f563009bc20 tx=0x7f56300cfe60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22201f944d728315 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.797+0000 7f561fe00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:57:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.797+0000 7f561fe00640 1 -- 172.21.15.18:0/1341748859 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630016330 con 0x55a7367641e0 2024-09-12T02:57:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.797+0000 7f561fe00640 1 -- 172.21.15.18:0/1341748859 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9562+0+0 (secure 0 0 0) 0x7f5630010430 con 0x55a7367641e0 2024-09-12T02:57:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.797+0000 7f5648253740 1 -- 172.21.15.18:0/1341748859 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56300851d0 con 0x55a7367641e0 2024-09-12T02:57:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.797+0000 7f561fe00640 1 -- 172.21.15.18:0/1341748859 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f5630016510 con 0x55a7367641e0 2024-09-12T02:57:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.797+0000 7f5648253740 10 client.25801 fetch_fsmap learned FSMap version 61 2024-09-12T02:57:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.797+0000 7f5648253740 1 -- 172.21.15.18:0/1341748859 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55a736771f70 con 0x55a7367641e0 2024-09-12T02:57:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.797+0000 7f561fe00640 1 -- 172.21.15.18:0/1341748859 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56300851d0 con 0x55a7367641e0 2024-09-12T02:57:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.797+0000 7f561fe00640 1 -- 172.21.15.18:0/1341748859 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 61) ==== 8438+0+0 (secure 0 0 0) 0x7f56300cd140 con 0x55a7367641e0 2024-09-12T02:57:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.797+0000 7f5648253740 10 client.25801 fetch_fsmap finished waiting for FSMap version 61 2024-09-12T02:57:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.797+0000 7f5648253740 10 client.25801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:57:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.797+0000 7f5648253740 20 client.25801 populate_metadata read hostname 'smithi018' 2024-09-12T02:57:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.797+0000 7f5648253740 1 --2- 172.21.15.18:0/1341748859 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a73677ec40 0x55a736781030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.797+0000 7f5648253740 4 client.25801 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:57:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.797+0000 7f5648253740 1 -- 172.21.15.18:0/1341748859 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7366d7830 con 0x55a73677ec40 2024-09-12T02:57:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.798+0000 7f563d400640 1 --2- 172.21.15.18:0/1341748859 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a73677ec40 0x55a736781030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.798+0000 7f563d400640 1 --2- 172.21.15.18:0/1341748859 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a73677ec40 0x55a736781030 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78ce6aa78c404f14 server_cookie=8d495af260c0be11 in_seq=0 out_seq=0 2024-09-12T02:57:33.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.798+0000 7f561fe00640 10 client.25801 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:57:33.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.799+0000 7f561fe00640 1 -- 172.21.15.18:0/1341748859 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7366d7830 con 0x55a73677ec40 2024-09-12T02:57:33.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.799+0000 7f561fe00640 10 client.25801 handle_command_reply: tid=0 2024-09-12T02:57:33.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.799+0000 7f5648253740 1 client.25801 shutdown 2024-09-12T02:57:33.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.799+0000 7f5648253740 1 -- 172.21.15.18:0/1341748859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7367641e0 msgr2=0x55a73676c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.799+0000 7f5648253740 1 --2- 172.21.15.18:0/1341748859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7367641e0 0x55a73676c2d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f563009bc20 tx=0x7f56300cfe60 comp rx=0 tx=0).stop 2024-09-12T02:57:33.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.799+0000 7f5648253740 1 -- 172.21.15.18:0/1341748859 shutdown_connections 2024-09-12T02:57:33.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.799+0000 7f5648253740 1 --2- 172.21.15.18:0/1341748859 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a73677ec40 0x55a736781030 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.799+0000 7f5648253740 1 --2- 172.21.15.18:0/1341748859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a73676f3a0 0x55a73676cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.799+0000 7f561fe00640 0 client.25801 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:57:33.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.799+0000 7f5648253740 1 --2- 172.21.15.18:0/1341748859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a736764b00 0x55a73676c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.799+0000 7f5648253740 1 --2- 172.21.15.18:0/1341748859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7367641e0 0x55a73676c2d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.799+0000 7f5648253740 1 -- 172.21.15.18:0/1341748859 >> 172.21.15.18:0/1341748859 conn(0x55a736760750 msgr2=0x55a7367664b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:33.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.799+0000 7f5648253740 1 -- 172.21.15.18:0/1341748859 shutdown_connections 2024-09-12T02:57:33.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.799+0000 7f5648253740 1 -- 172.21.15.18:0/1341748859 wait complete. 2024-09-12T02:57:33.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.800+0000 7f5648253740 20 client.25801 trim_cache size 0 max 16384 2024-09-12T02:57:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.817+0000 7f5648253740 1 Processor -- start 2024-09-12T02:57:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.817+0000 7f5648253740 1 -- start start 2024-09-12T02:57:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.817+0000 7f5648253740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7367641e0 0x55a73676bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.817+0000 7f5648253740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a736764b00 0x55a73675f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.817+0000 7f5648253740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a73676f3a0 0x55a736786810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.817+0000 7f5648253740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f56401b1400 con 0x55a73676f3a0 2024-09-12T02:57:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.817+0000 7f5648253740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f56401b31b0 con 0x55a736764b00 2024-09-12T02:57:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.817+0000 7f5648253740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f56401b1b90 con 0x55a7367641e0 2024-09-12T02:57:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.818+0000 7f563de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7367641e0 0x55a73676bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.818+0000 7f563de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7367641e0 0x55a73676bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:53832/0 (socket says 172.21.15.18:53832) 2024-09-12T02:57:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.818+0000 7f563de00640 1 -- 172.21.15.18:0/3002831891 learned_addr learned my addr 172.21.15.18:0/3002831891 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.818+0000 7f563d400640 1 --2- 172.21.15.18:0/3002831891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a736764b00 0x55a73675f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.818+0000 7f563e800640 1 --2- 172.21.15.18:0/3002831891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a73676f3a0 0x55a736786810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.818+0000 7f563de00640 1 -- 172.21.15.18:0/3002831891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a736764b00 msgr2=0x55a73675f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.818+0000 7f563de00640 1 --2- 172.21.15.18:0/3002831891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a736764b00 0x55a73675f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.818+0000 7f563de00640 1 -- 172.21.15.18:0/3002831891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a73676f3a0 msgr2=0x55a736786810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.818+0000 7f563de00640 1 --2- 172.21.15.18:0/3002831891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a73676f3a0 0x55a736786810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.818+0000 7f563de00640 1 -- 172.21.15.18:0/3002831891 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a736763f60 con 0x55a7367641e0 2024-09-12T02:57:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.818+0000 7f563e800640 1 --2- 172.21.15.18:0/3002831891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a73676f3a0 0x55a736786810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.818+0000 7f563de00640 1 --2- 172.21.15.18:0/3002831891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7367641e0 0x55a73676bb90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f563000e9c0 tx=0x7f5630000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3f717f156aff40a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.818+0000 7f562aa00640 1 -- 172.21.15.18:0/3002831891 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56300df070 con 0x55a7367641e0 2024-09-12T02:57:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.819+0000 7f562aa00640 1 -- 172.21.15.18:0/3002831891 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56300851d0 con 0x55a7367641e0 2024-09-12T02:57:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.819+0000 7f562aa00640 1 -- 172.21.15.18:0/3002831891 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56300166f0 con 0x55a7367641e0 2024-09-12T02:57:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.819+0000 7f5648253740 1 -- 172.21.15.18:0/3002831891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7367641e0 msgr2=0x55a73676bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.819+0000 7f5648253740 1 --2- 172.21.15.18:0/3002831891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7367641e0 0x55a73676bb90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f563000e9c0 tx=0x7f5630000bc0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.819+0000 7f5648253740 1 -- 172.21.15.18:0/3002831891 shutdown_connections 2024-09-12T02:57:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.819+0000 7f5648253740 1 --2- 172.21.15.18:0/3002831891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a73676f3a0 0x55a736786810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.819+0000 7f5648253740 1 --2- 172.21.15.18:0/3002831891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a736764b00 0x55a73675f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.819+0000 7f5648253740 1 --2- 172.21.15.18:0/3002831891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7367641e0 0x55a73676bb90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.819+0000 7f5648253740 1 -- 172.21.15.18:0/3002831891 >> 172.21.15.18:0/3002831891 conn(0x55a736760750 msgr2=0x55a73676e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.819+0000 7f5648253740 1 -- 172.21.15.18:0/3002831891 shutdown_connections 2024-09-12T02:57:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.819+0000 7f5648253740 1 -- 172.21.15.18:0/3002831891 wait complete. 2024-09-12T02:57:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.820+0000 7f5648253740 1 -- start start 2024-09-12T02:57:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.820+0000 7f5648253740 1 Processor -- start 2024-09-12T02:57:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.820+0000 7f5648253740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7367641e0 0x55a736777a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.820+0000 7f5648253740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a736764b00 0x55a736769020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.820+0000 7f5648253740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a73676f3a0 0x55a736769560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.820+0000 7f5648253740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f56401b2a20 con 0x55a73676f3a0 2024-09-12T02:57:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.820+0000 7f5648253740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f56401b2320 con 0x55a7367641e0 2024-09-12T02:57:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.820+0000 7f5648253740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f56401af400 con 0x55a736764b00 2024-09-12T02:57:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.820+0000 7f5648253740 10 client.0 _ll_register_callbacks cb 0x7f5638009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:57:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.821+0000 7f563de00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7367641e0 0x55a736777a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.821+0000 7f563d400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a736764b00 0x55a736769020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.821+0000 7f563de00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7367641e0 0x55a736777a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:39646/0 (socket says 172.21.15.18:39646) 2024-09-12T02:57:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.821+0000 7f563de00640 1 -- 172.21.15.18:0/4113924922 learned_addr learned my addr 172.21.15.18:0/4113924922 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.821+0000 7f563e800640 1 --2- 172.21.15.18:0/4113924922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a73676f3a0 0x55a736769560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.821+0000 7f563de00640 1 -- 172.21.15.18:0/4113924922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a736764b00 msgr2=0x55a736769020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.821+0000 7f563de00640 1 --2- 172.21.15.18:0/4113924922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a736764b00 0x55a736769020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.821+0000 7f563de00640 1 -- 172.21.15.18:0/4113924922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a73676f3a0 msgr2=0x55a736769560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.821+0000 7f563de00640 1 --2- 172.21.15.18:0/4113924922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a73676f3a0 0x55a736769560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.821+0000 7f563de00640 1 -- 172.21.15.18:0/4113924922 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a736769d90 con 0x55a7367641e0 2024-09-12T02:57:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.821+0000 7f563de00640 1 --2- 172.21.15.18:0/4113924922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7367641e0 0x55a736777a30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f56300d4010 tx=0x7f56300d86a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3162e75be32e710 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.821+0000 7f561fe00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:57:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.821+0000 7f561fe00640 1 -- 172.21.15.18:0/4113924922 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56300df070 con 0x55a7367641e0 2024-09-12T02:57:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.821+0000 7f561fe00640 1 -- 172.21.15.18:0/4113924922 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9562+0+0 (secure 0 0 0) 0x7f56300a4680 con 0x55a7367641e0 2024-09-12T02:57:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.821+0000 7f5648253740 1 -- 172.21.15.18:0/4113924922 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56300851d0 con 0x55a7367641e0 2024-09-12T02:57:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.822+0000 7f561fe00640 1 -- 172.21.15.18:0/4113924922 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f5630016900 con 0x55a7367641e0 2024-09-12T02:57:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.822+0000 7f5648253740 10 client.25805 fetch_fsmap learned FSMap version 61 2024-09-12T02:57:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.822+0000 7f5648253740 1 -- 172.21.15.18:0/4113924922 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55a7367e97c0 con 0x55a7367641e0 2024-09-12T02:57:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.822+0000 7f561fe00640 1 -- 172.21.15.18:0/4113924922 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56300851d0 con 0x55a7367641e0 2024-09-12T02:57:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.822+0000 7f561fe00640 1 -- 172.21.15.18:0/4113924922 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 61) ==== 8438+0+0 (secure 0 0 0) 0x7f563009bef0 con 0x55a7367641e0 2024-09-12T02:57:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.822+0000 7f5648253740 10 client.25805 fetch_fsmap finished waiting for FSMap version 61 2024-09-12T02:57:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.822+0000 7f5648253740 10 client.25805 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:57:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.822+0000 7f5648253740 20 client.25805 populate_metadata read hostname 'smithi018' 2024-09-12T02:57:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.822+0000 7f5648253740 1 --2- 172.21.15.18:0/4113924922 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a7367e9d70 0x55a7367ec190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.822+0000 7f5648253740 4 client.25805 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:57:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.822+0000 7f5648253740 1 -- 172.21.15.18:0/4113924922 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a7367670f0 con 0x55a7367e9d70 2024-09-12T02:57:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.822+0000 7f563d400640 1 --2- 172.21.15.18:0/4113924922 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a7367e9d70 0x55a7367ec190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.823+0000 7f563d400640 1 --2- 172.21.15.18:0/4113924922 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a7367e9d70 0x55a7367ec190 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acd49d3f41ef6fae server_cookie=bce72463e2727fdd in_seq=0 out_seq=0 2024-09-12T02:57:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:33.823+0000 7f561fe00640 10 client.25805 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:57:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.030+0000 7f561fe00640 1 -- 172.21.15.18:0/4113924922 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a7367670f0 con 0x55a7367e9d70 2024-09-12T02:57:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.030+0000 7f561fe00640 10 client.25805 handle_command_reply: tid=0 2024-09-12T02:57:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.030+0000 7f5648253740 1 client.25805 shutdown 2024-09-12T02:57:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.030+0000 7f5648253740 1 -- 172.21.15.18:0/4113924922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7367641e0 msgr2=0x55a736777a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.030+0000 7f5648253740 1 --2- 172.21.15.18:0/4113924922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7367641e0 0x55a736777a30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f56300d4010 tx=0x7f56300d86a0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.030+0000 7f5648253740 1 -- 172.21.15.18:0/4113924922 shutdown_connections 2024-09-12T02:57:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.030+0000 7f5648253740 1 --2- 172.21.15.18:0/4113924922 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a7367e9d70 0x55a7367ec190 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.030+0000 7f5648253740 1 --2- 172.21.15.18:0/4113924922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a73676f3a0 0x55a736769560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.030+0000 7f5648253740 1 --2- 172.21.15.18:0/4113924922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a736764b00 0x55a736769020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.030+0000 7f5648253740 1 --2- 172.21.15.18:0/4113924922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7367641e0 0x55a736777a30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:57:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:57:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:57:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:57:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.030+0000 7f5648253740 1 -- 172.21.15.18:0/4113924922 >> 172.21.15.18:0/4113924922 conn(0x55a736760750 msgr2=0x55a73676d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.030+0000 7f561fe00640 0 client.25805 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:57:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.031+0000 7f5648253740 1 -- 172.21.15.18:0/4113924922 shutdown_connections 2024-09-12T02:57:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.031+0000 7f5648253740 1 -- 172.21.15.18:0/4113924922 wait complete. 2024-09-12T02:57:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.031+0000 7f5648253740 20 client.25805 trim_cache size 0 max 16384 2024-09-12T02:57:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.032+0000 7f5645200640 1 -- 172.21.15.18:0/2190046488 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f56240a2e20 msgr2=0x7f56240a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.032+0000 7f5645200640 1 --2- 172.21.15.18:0/2190046488 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f56240a2e20 0x7f56240a52e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5638005fd0 tx=0x7f5638009500 comp rx=0 tx=0).stop 2024-09-12T02:57:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.032+0000 7f5645200640 1 -- 172.21.15.18:0/2190046488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5640103f30 msgr2=0x7f564019a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.032+0000 7f5645200640 1 --2- 172.21.15.18:0/2190046488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5640103f30 0x7f564019a580 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f563000e9f0 tx=0x7f563000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.032+0000 7f5645200640 1 -- 172.21.15.18:0/2190046488 shutdown_connections 2024-09-12T02:57:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.032+0000 7f5645200640 1 --2- 172.21.15.18:0/2190046488 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f56240a2e20 0x7f56240a52e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.032+0000 7f5645200640 1 --2- 172.21.15.18:0/2190046488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f564019ee40 0x7f564019f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.032+0000 7f5645200640 1 --2- 172.21.15.18:0/2190046488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5640109080 0x7f564019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.032+0000 7f5645200640 1 --2- 172.21.15.18:0/2190046488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5640103f30 0x7f564019a580 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.032+0000 7f5645200640 1 -- 172.21.15.18:0/2190046488 >> 172.21.15.18:0/2190046488 conn(0x7f56400ff980 msgr2=0x7f5640100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.032+0000 7f5645200640 1 -- 172.21.15.18:0/2190046488 shutdown_connections 2024-09-12T02:57:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:34.032+0000 7f5645200640 1 -- 172.21.15.18:0/2190046488 wait complete. 2024-09-12T02:57:34.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:34 smithi176 ceph-mon[35713]: pgmap v274: 129 pgs: 129 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 457 op/s 2024-09-12T02:57:35.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:34 smithi062 ceph-mon[35527]: pgmap v274: 129 pgs: 129 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 457 op/s 2024-09-12T02:57:35.088 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:34 smithi018 ceph-mon[30616]: pgmap v274: 129 pgs: 129 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 457 op/s 2024-09-12T02:57:36.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:36 smithi176 ceph-mon[35713]: pgmap v275: 129 pgs: 129 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 600 op/s 2024-09-12T02:57:37.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:36 smithi062 ceph-mon[35527]: pgmap v275: 129 pgs: 129 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 600 op/s 2024-09-12T02:57:37.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:36 smithi018 ceph-mon[30616]: pgmap v275: 129 pgs: 129 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 600 op/s 2024-09-12T02:57:38.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:38 smithi176 ceph-mon[35713]: pgmap v276: 129 pgs: 129 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 548 op/s 2024-09-12T02:57:39.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:38 smithi062 ceph-mon[35527]: pgmap v276: 129 pgs: 129 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 548 op/s 2024-09-12T02:57:39.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:38 smithi018 ceph-mon[30616]: pgmap v276: 129 pgs: 129 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 548 op/s 2024-09-12T02:57:40.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:40 smithi176 ceph-mon[35713]: pgmap v277: 129 pgs: 129 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 683 op/s 2024-09-12T02:57:41.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:40 smithi062 ceph-mon[35527]: pgmap v277: 129 pgs: 129 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 683 op/s 2024-09-12T02:57:41.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:40 smithi018 ceph-mon[30616]: pgmap v277: 129 pgs: 129 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 683 op/s 2024-09-12T02:57:42.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:42 smithi176 ceph-mon[35713]: pgmap v278: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 606 op/s 2024-09-12T02:57:43.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:42 smithi062 ceph-mon[35527]: pgmap v278: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 606 op/s 2024-09-12T02:57:43.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:42 smithi018 ceph-mon[30616]: pgmap v278: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 606 op/s 2024-09-12T02:57:44.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:44 smithi176 ceph-mon[35713]: pgmap v279: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 556 op/s 2024-09-12T02:57:45.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:44 smithi062 ceph-mon[35527]: pgmap v279: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 556 op/s 2024-09-12T02:57:45.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:44 smithi018 ceph-mon[30616]: pgmap v279: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 556 op/s 2024-09-12T02:57:46.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:46 smithi176 ceph-mon[35713]: pgmap v280: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 732 op/s 2024-09-12T02:57:47.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:46 smithi062 ceph-mon[35527]: pgmap v280: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 732 op/s 2024-09-12T02:57:47.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:46 smithi018 ceph-mon[30616]: pgmap v280: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 732 op/s 2024-09-12T02:57:47.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.159+0000 7f0a6fc00640 1 -- 172.21.15.18:0/2227020262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a681048e0 msgr2=0x7f0a68108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.159+0000 7f0a6fc00640 1 --2- 172.21.15.18:0/2227020262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a681048e0 0x7f0a68108920 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009900 tx=0x7f0a5402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.160+0000 7f0a6fc00640 1 -- 172.21.15.18:0/2227020262 shutdown_connections 2024-09-12T02:57:47.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.160+0000 7f0a6fc00640 1 --2- 172.21.15.18:0/2227020262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a68109080 0x7f0a68110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.160+0000 7f0a6fc00640 1 --2- 172.21.15.18:0/2227020262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a681048e0 0x7f0a68108920 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.160+0000 7f0a6fc00640 1 --2- 172.21.15.18:0/2227020262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a68103f30 0x7f0a68104310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.160+0000 7f0a6fc00640 1 -- 172.21.15.18:0/2227020262 >> 172.21.15.18:0/2227020262 conn(0x7f0a680ff980 msgr2=0x7f0a68101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:47.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.160+0000 7f0a6fc00640 1 -- 172.21.15.18:0/2227020262 shutdown_connections 2024-09-12T02:57:47.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.160+0000 7f0a6fc00640 1 -- 172.21.15.18:0/2227020262 wait complete. 2024-09-12T02:57:47.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.161+0000 7f0a6fc00640 1 Processor -- start 2024-09-12T02:57:47.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.161+0000 7f0a6fc00640 1 -- start start 2024-09-12T02:57:47.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.161+0000 7f0a6fc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a68103f30 0x7f0a6819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.161+0000 7f0a6fc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a68109080 0x7f0a6819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.161+0000 7f0a6fc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a6819ee10 0x7f0a6819f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.161+0000 7f0a6fc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0a68114080 con 0x7f0a68109080 2024-09-12T02:57:47.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.161+0000 7f0a6fc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0a68113f00 con 0x7f0a6819ee10 2024-09-12T02:57:47.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.161+0000 7f0a6fc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0a68114200 con 0x7f0a68103f30 2024-09-12T02:57:47.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.161+0000 7f0a67e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a68109080 0x7f0a6819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.161+0000 7f0a67e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a68109080 0x7f0a6819aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44874/0 (socket says 172.21.15.18:44874) 2024-09-12T02:57:47.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.161+0000 7f0a67e00640 1 -- 172.21.15.18:0/2345410070 learned_addr learned my addr 172.21.15.18:0/2345410070 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:47.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.161+0000 7f0a6d200640 1 --2- 172.21.15.18:0/2345410070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a68103f30 0x7f0a6819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.162+0000 7f0a6dc00640 1 --2- 172.21.15.18:0/2345410070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a6819ee10 0x7f0a6819f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.162+0000 7f0a67e00640 1 -- 172.21.15.18:0/2345410070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a68103f30 msgr2=0x7f0a6819a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.162+0000 7f0a67e00640 1 --2- 172.21.15.18:0/2345410070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a68103f30 0x7f0a6819a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.162+0000 7f0a67e00640 1 -- 172.21.15.18:0/2345410070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a6819ee10 msgr2=0x7f0a6819f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.162+0000 7f0a67e00640 1 --2- 172.21.15.18:0/2345410070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a6819ee10 0x7f0a6819f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.162+0000 7f0a67e00640 1 -- 172.21.15.18:0/2345410070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6819f900 con 0x7f0a68109080 2024-09-12T02:57:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.162+0000 7f0a67e00640 1 --2- 172.21.15.18:0/2345410070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a68109080 0x7f0a6819aa90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0a54005940 tx=0x7f0a540040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.163+0000 7f0a65600640 1 -- 172.21.15.18:0/2345410070 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5403f030 con 0x7f0a68109080 2024-09-12T02:57:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.163+0000 7f0a65600640 1 -- 172.21.15.18:0/2345410070 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a540044c0 con 0x7f0a68109080 2024-09-12T02:57:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.163+0000 7f0a6fc00640 1 -- 172.21.15.18:0/2345410070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a6819fb90 con 0x7f0a68109080 2024-09-12T02:57:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.163+0000 7f0a65600640 1 -- 172.21.15.18:0/2345410070 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54035070 con 0x7f0a68109080 2024-09-12T02:57:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.163+0000 7f0a6fc00640 1 -- 172.21.15.18:0/2345410070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a681a7350 con 0x7f0a68109080 2024-09-12T02:57:47.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.166+0000 7f0a65600640 1 -- 172.21.15.18:0/2345410070 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f0a54042030 con 0x7f0a68109080 2024-09-12T02:57:47.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.166+0000 7f0a72c58740 1 Processor -- start 2024-09-12T02:57:47.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.166+0000 7f0a72c58740 1 -- start start 2024-09-12T02:57:47.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.166+0000 7f0a72c58740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556a1e0 0x55bf0556a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.167+0000 7f0a72c58740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556ab00 0x55bf05574e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.167+0000 7f0a72c58740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf055753a0 0x55bf05577790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.167+0000 7f0a72c58740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bf054d0100 con 0x55bf0556a1e0 2024-09-12T02:57:47.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.167+0000 7f0a72c58740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bf054781b0 con 0x55bf055753a0 2024-09-12T02:57:47.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.167+0000 7f0a72c58740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55bf054cc0c0 con 0x55bf0556ab00 2024-09-12T02:57:47.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.167+0000 7f0a6dc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556a1e0 0x55bf0556a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.167+0000 7f0a6dc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556a1e0 0x55bf0556a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44878/0 (socket says 172.21.15.18:44878) 2024-09-12T02:57:47.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.167+0000 7f0a6dc00640 1 -- 172.21.15.18:0/3896341491 learned_addr learned my addr 172.21.15.18:0/3896341491 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:47.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.167+0000 7f0a67e00640 1 --2- 172.21.15.18:0/3896341491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf055753a0 0x55bf05577790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.167+0000 7f0a6d200640 1 --2- 172.21.15.18:0/3896341491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556ab00 0x55bf05574e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.167+0000 7f0a6dc00640 1 -- 172.21.15.18:0/3896341491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556ab00 msgr2=0x55bf05574e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:47.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.167+0000 7f0a6dc00640 1 --2- 172.21.15.18:0/3896341491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556ab00 0x55bf05574e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.167+0000 7f0a6dc00640 1 -- 172.21.15.18:0/3896341491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf055753a0 msgr2=0x55bf05577790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:47.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.167+0000 7f0a6dc00640 1 --2- 172.21.15.18:0/3896341491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf055753a0 0x55bf05577790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.167+0000 7f0a6dc00640 1 -- 172.21.15.18:0/3896341491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf051e3210 con 0x55bf0556a1e0 2024-09-12T02:57:47.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.167+0000 7f0a6d200640 1 --2- 172.21.15.18:0/3896341491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556ab00 0x55bf05574e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:47.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.168+0000 7f0a65600640 1 --2- 172.21.15.18:0/2345410070 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f0a500a2da0 0x7f0a500a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.168+0000 7f0a65600640 1 -- 172.21.15.18:0/2345410070 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9562+0+0 (secure 0 0 0) 0x7f0a540efc40 con 0x7f0a68109080 2024-09-12T02:57:47.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.168+0000 7f0a6dc00640 1 --2- 172.21.15.18:0/3896341491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556a1e0 0x55bf0556a5c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009f50 tx=0x7f0a600118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d074149f281eb945 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.168+0000 7f0a6d200640 1 --2- 172.21.15.18:0/2345410070 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f0a500a2da0 0x7f0a500a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.168+0000 7f0a5a000640 1 -- 172.21.15.18:0/3896341491 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a60004d20 con 0x55bf0556a1e0 2024-09-12T02:57:47.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.168+0000 7f0a5a000640 1 -- 172.21.15.18:0/3896341491 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a60004050 con 0x55bf0556a1e0 2024-09-12T02:57:47.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.168+0000 7f0a5a000640 1 -- 172.21.15.18:0/3896341491 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a60005280 con 0x55bf0556a1e0 2024-09-12T02:57:47.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.169+0000 7f0a72c58740 1 -- 172.21.15.18:0/3896341491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556a1e0 msgr2=0x55bf0556a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.169+0000 7f0a6d200640 1 --2- 172.21.15.18:0/2345410070 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f0a500a2da0 0x7f0a500a5260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55bf055675b0 tx=0x7f0a5c005f90 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.169+0000 7f0a72c58740 1 --2- 172.21.15.18:0/3896341491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556a1e0 0x55bf0556a5c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009f50 tx=0x7f0a600118d0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.169+0000 7f0a72c58740 1 -- 172.21.15.18:0/3896341491 shutdown_connections 2024-09-12T02:57:47.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.169+0000 7f0a72c58740 1 --2- 172.21.15.18:0/3896341491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf055753a0 0x55bf05577790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.169+0000 7f0a72c58740 1 --2- 172.21.15.18:0/3896341491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556ab00 0x55bf05574e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.169+0000 7f0a72c58740 1 --2- 172.21.15.18:0/3896341491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556a1e0 0x55bf0556a5c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.169+0000 7f0a72c58740 1 -- 172.21.15.18:0/3896341491 >> 172.21.15.18:0/3896341491 conn(0x55bf05566750 msgr2=0x55bf05566b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:47.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.169+0000 7f0a72c58740 1 -- 172.21.15.18:0/3896341491 shutdown_connections 2024-09-12T02:57:47.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.169+0000 7f0a72c58740 1 -- 172.21.15.18:0/3896341491 wait complete. 2024-09-12T02:57:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.170+0000 7f0a72c58740 1 -- start start 2024-09-12T02:57:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.170+0000 7f0a72c58740 1 Processor -- start 2024-09-12T02:57:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.170+0000 7f0a72c58740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556a1e0 0x55bf05572350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.170+0000 7f0a72c58740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556ab00 0x55bf05572890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.170+0000 7f0a72c58740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf055753a0 0x55bf05572dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.170+0000 7f0a72c58740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bf05577f70 con 0x55bf0556a1e0 2024-09-12T02:57:47.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.170+0000 7f0a72c58740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bf05459090 con 0x55bf055753a0 2024-09-12T02:57:47.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.170+0000 7f0a72c58740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55bf055780f0 con 0x55bf0556ab00 2024-09-12T02:57:47.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.170+0000 7f0a72c58740 10 client.0 _ll_register_callbacks cb 0x55bf054adf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:57:47.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.171+0000 7f0a6d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556a1e0 0x55bf05572350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.171+0000 7f0a6d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556a1e0 0x55bf05572350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44888/0 (socket says 172.21.15.18:44888) 2024-09-12T02:57:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.171+0000 7f0a6d200640 1 -- 172.21.15.18:0/810186773 learned_addr learned my addr 172.21.15.18:0/810186773 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.171+0000 7f0a6dc00640 1 --2- 172.21.15.18:0/810186773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf055753a0 0x55bf05572dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.171+0000 7f0a6d200640 1 -- 172.21.15.18:0/810186773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556ab00 msgr2=0x55bf05572890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:47.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.171+0000 7f0a6d200640 1 --2- 172.21.15.18:0/810186773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556ab00 0x55bf05572890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.171+0000 7f0a6d200640 1 -- 172.21.15.18:0/810186773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf055753a0 msgr2=0x55bf05572dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:47.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.171+0000 7f0a6d200640 1 --2- 172.21.15.18:0/810186773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf055753a0 0x55bf05572dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.171+0000 7f0a6d200640 1 -- 172.21.15.18:0/810186773 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf052af620 con 0x55bf0556a1e0 2024-09-12T02:57:47.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.171+0000 7f0a6dc00640 1 --2- 172.21.15.18:0/810186773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf055753a0 0x55bf05572dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.171+0000 7f0a6d200640 1 --2- 172.21.15.18:0/810186773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556a1e0 0x55bf05572350 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c0097c0 tx=0x7f0a5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d519d574d1b5fde6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.171+0000 7f0a4ea00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:57:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.172+0000 7f0a4ea00640 1 -- 172.21.15.18:0/810186773 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c02e060 con 0x55bf0556a1e0 2024-09-12T02:57:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.172+0000 7f0a4ea00640 1 -- 172.21.15.18:0/810186773 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9562+0+0 (secure 0 0 0) 0x7f0a5c018030 con 0x55bf0556a1e0 2024-09-12T02:57:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.172+0000 7f0a72c58740 1 -- 172.21.15.18:0/810186773 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a60004050 con 0x55bf0556a1e0 2024-09-12T02:57:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.172+0000 7f0a4ea00640 1 -- 172.21.15.18:0/810186773 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f0a5c035050 con 0x55bf0556a1e0 2024-09-12T02:57:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.172+0000 7f0a72c58740 10 client.15819 fetch_fsmap learned FSMap version 61 2024-09-12T02:57:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.172+0000 7f0a72c58740 1 -- 172.21.15.18:0/810186773 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55bf05583c30 con 0x55bf0556a1e0 2024-09-12T02:57:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.172+0000 7f0a4ea00640 1 -- 172.21.15.18:0/810186773 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a60004050 con 0x55bf0556a1e0 2024-09-12T02:57:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.173+0000 7f0a4ea00640 1 -- 172.21.15.18:0/810186773 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 61) ==== 8438+0+0 (secure 0 0 0) 0x7f0a5c01c4c0 con 0x55bf0556a1e0 2024-09-12T02:57:47.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.173+0000 7f0a72c58740 10 client.15819 fetch_fsmap finished waiting for FSMap version 61 2024-09-12T02:57:47.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.173+0000 7f0a72c58740 10 client.15819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:57:47.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.173+0000 7f0a72c58740 20 client.15819 populate_metadata read hostname 'smithi018' 2024-09-12T02:57:47.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.173+0000 7f0a72c58740 1 --2- 172.21.15.18:0/810186773 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bf05585140 0x55bf055875c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.193 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.173+0000 7f0a72c58740 4 client.15819 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:57:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.173+0000 7f0a72c58740 1 -- 172.21.15.18:0/810186773 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf054dd830 con 0x55bf05585140 2024-09-12T02:57:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.173+0000 7f0a67e00640 1 --2- 172.21.15.18:0/810186773 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bf05585140 0x55bf055875c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.174+0000 7f0a67e00640 1 --2- 172.21.15.18:0/810186773 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bf05585140 0x55bf055875c0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76fb1c84e430517 server_cookie=48237148fd386ab2 in_seq=0 out_seq=0 2024-09-12T02:57:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.174+0000 7f0a4ea00640 10 client.15819 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:57:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.174+0000 7f0a4ea00640 1 -- 172.21.15.18:0/810186773 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bf054dd830 con 0x55bf05585140 2024-09-12T02:57:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.174+0000 7f0a4ea00640 10 client.15819 handle_command_reply: tid=0 2024-09-12T02:57:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.174+0000 7f0a72c58740 1 client.15819 shutdown 2024-09-12T02:57:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.175+0000 7f0a72c58740 1 -- 172.21.15.18:0/810186773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556a1e0 msgr2=0x55bf05572350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.175+0000 7f0a72c58740 1 --2- 172.21.15.18:0/810186773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556a1e0 0x55bf05572350 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c0097c0 tx=0x7f0a5c004730 comp rx=0 tx=0).stop 2024-09-12T02:57:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.175+0000 7f0a72c58740 1 -- 172.21.15.18:0/810186773 shutdown_connections 2024-09-12T02:57:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.175+0000 7f0a72c58740 1 --2- 172.21.15.18:0/810186773 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bf05585140 0x55bf055875c0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.175+0000 7f0a72c58740 1 --2- 172.21.15.18:0/810186773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf055753a0 0x55bf05572dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.175+0000 7f0a72c58740 1 --2- 172.21.15.18:0/810186773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556ab00 0x55bf05572890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.175+0000 7f0a72c58740 1 --2- 172.21.15.18:0/810186773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556a1e0 0x55bf05572350 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.175+0000 7f0a72c58740 1 -- 172.21.15.18:0/810186773 >> 172.21.15.18:0/810186773 conn(0x55bf05566750 msgr2=0x55bf0556c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:47.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.175+0000 7f0a4ea00640 0 client.15819 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:57:47.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.175+0000 7f0a72c58740 1 -- 172.21.15.18:0/810186773 shutdown_connections 2024-09-12T02:57:47.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.175+0000 7f0a72c58740 1 -- 172.21.15.18:0/810186773 wait complete. 2024-09-12T02:57:47.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.175+0000 7f0a72c58740 20 client.15819 trim_cache size 0 max 16384 2024-09-12T02:57:47.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.190+0000 7f0a72c58740 1 Processor -- start 2024-09-12T02:57:47.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.191+0000 7f0a72c58740 1 -- start start 2024-09-12T02:57:47.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.191+0000 7f0a72c58740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556a1e0 0x55bf05571420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.191+0000 7f0a72c58740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf0556ab00 0x55bf0558ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.191+0000 7f0a72c58740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf055753a0 0x55bf0558d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.191+0000 7f0a72c58740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681b12f0 con 0x55bf055753a0 2024-09-12T02:57:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.191+0000 7f0a72c58740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681b30a0 con 0x55bf0556ab00 2024-09-12T02:57:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.191+0000 7f0a72c58740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681b1a80 con 0x55bf0556a1e0 2024-09-12T02:57:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.191+0000 7f0a6dc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf055753a0 0x55bf0558d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.191+0000 7f0a6dc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf055753a0 0x55bf0558d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44900/0 (socket says 172.21.15.18:44900) 2024-09-12T02:57:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.191+0000 7f0a6dc00640 1 -- 172.21.15.18:0/3527213618 learned_addr learned my addr 172.21.15.18:0/3527213618 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.191+0000 7f0a6d200640 1 --2- 172.21.15.18:0/3527213618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556a1e0 0x55bf05571420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.191+0000 7f0a67e00640 1 --2- 172.21.15.18:0/3527213618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf0556ab00 0x55bf0558ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.191+0000 7f0a6dc00640 1 -- 172.21.15.18:0/3527213618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556a1e0 msgr2=0x55bf05571420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.191+0000 7f0a6dc00640 1 --2- 172.21.15.18:0/3527213618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556a1e0 0x55bf05571420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.191+0000 7f0a6dc00640 1 -- 172.21.15.18:0/3527213618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf0556ab00 msgr2=0x55bf0558ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.191+0000 7f0a6dc00640 1 --2- 172.21.15.18:0/3527213618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf0556ab00 0x55bf0558ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.192+0000 7f0a6dc00640 1 -- 172.21.15.18:0/3527213618 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf05567290 con 0x55bf055753a0 2024-09-12T02:57:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.192+0000 7f0a6dc00640 1 --2- 172.21.15.18:0/3527213618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf055753a0 0x55bf0558d410 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009f50 tx=0x7f0a60005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b718a2188816ffc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.192+0000 7f0a59600640 1 -- 172.21.15.18:0/3527213618 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a60027070 con 0x55bf055753a0 2024-09-12T02:57:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.192+0000 7f0a59600640 1 -- 172.21.15.18:0/3527213618 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a60009bb0 con 0x55bf055753a0 2024-09-12T02:57:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.192+0000 7f0a59600640 1 -- 172.21.15.18:0/3527213618 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a60005470 con 0x55bf055753a0 2024-09-12T02:57:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.193+0000 7f0a72c58740 1 -- 172.21.15.18:0/3527213618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf055753a0 msgr2=0x55bf0558d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.193+0000 7f0a72c58740 1 --2- 172.21.15.18:0/3527213618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf055753a0 0x55bf0558d410 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009f50 tx=0x7f0a60005bd0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.193+0000 7f0a72c58740 1 -- 172.21.15.18:0/3527213618 shutdown_connections 2024-09-12T02:57:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.193+0000 7f0a72c58740 1 --2- 172.21.15.18:0/3527213618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf055753a0 0x55bf0558d410 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.193+0000 7f0a72c58740 1 --2- 172.21.15.18:0/3527213618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf0556ab00 0x55bf0558ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.193+0000 7f0a72c58740 1 --2- 172.21.15.18:0/3527213618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556a1e0 0x55bf05571420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.193+0000 7f0a72c58740 1 -- 172.21.15.18:0/3527213618 >> 172.21.15.18:0/3527213618 conn(0x55bf05566750 msgr2=0x55bf0556b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.193+0000 7f0a72c58740 1 -- 172.21.15.18:0/3527213618 shutdown_connections 2024-09-12T02:57:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.193+0000 7f0a72c58740 1 -- 172.21.15.18:0/3527213618 wait complete. 2024-09-12T02:57:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.193+0000 7f0a72c58740 1 -- start start 2024-09-12T02:57:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.193+0000 7f0a72c58740 1 Processor -- start 2024-09-12T02:57:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a72c58740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556a1e0 0x55bf05578a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a72c58740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556ab00 0x55bf05578fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a72c58740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf055753a0 0x55bf0557d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a72c58740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681b2910 con 0x55bf0556ab00 2024-09-12T02:57:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a72c58740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681b2210 con 0x55bf055753a0 2024-09-12T02:57:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a72c58740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681af2f0 con 0x55bf0556a1e0 2024-09-12T02:57:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a72c58740 10 client.0 _ll_register_callbacks cb 0x7f0a5c009390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:57:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a67e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556ab00 0x55bf05578fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a67e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556ab00 0x55bf05578fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44906/0 (socket says 172.21.15.18:44906) 2024-09-12T02:57:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a67e00640 1 -- 172.21.15.18:0/456566227 learned_addr learned my addr 172.21.15.18:0/456566227 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:57:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a6d200640 1 --2- 172.21.15.18:0/456566227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556a1e0 0x55bf05578a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a6dc00640 1 --2- 172.21.15.18:0/456566227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf055753a0 0x55bf0557d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a67e00640 1 -- 172.21.15.18:0/456566227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556a1e0 msgr2=0x55bf05578a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a67e00640 1 --2- 172.21.15.18:0/456566227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556a1e0 0x55bf05578a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a67e00640 1 -- 172.21.15.18:0/456566227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf055753a0 msgr2=0x55bf0557d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a67e00640 1 --2- 172.21.15.18:0/456566227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf055753a0 0x55bf0557d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a67e00640 1 -- 172.21.15.18:0/456566227 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf0557d7d0 con 0x55bf0556ab00 2024-09-12T02:57:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.194+0000 7f0a6d200640 1 --2- 172.21.15.18:0/456566227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556a1e0 0x55bf05578a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.195+0000 7f0a67e00640 1 --2- 172.21.15.18:0/456566227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556ab00 0x55bf05578fb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0a540b8770 tx=0x7f0a540bbc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a675ad25d5a0f546 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.195+0000 7f0a4ea00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:57:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.195+0000 7f0a4ea00640 1 -- 172.21.15.18:0/456566227 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54049040 con 0x55bf0556ab00 2024-09-12T02:57:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.195+0000 7f0a4ea00640 1 -- 172.21.15.18:0/456566227 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9562+0+0 (secure 0 0 0) 0x7f0a540b8410 con 0x55bf0556ab00 2024-09-12T02:57:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.195+0000 7f0a72c58740 1 -- 172.21.15.18:0/456566227 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a60009bb0 con 0x55bf0556ab00 2024-09-12T02:57:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.195+0000 7f0a4ea00640 1 -- 172.21.15.18:0/456566227 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f0a540d9050 con 0x55bf0556ab00 2024-09-12T02:57:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.195+0000 7f0a72c58740 10 client.15825 fetch_fsmap learned FSMap version 61 2024-09-12T02:57:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.195+0000 7f0a72c58740 1 -- 172.21.15.18:0/456566227 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55bf055efa60 con 0x55bf0556ab00 2024-09-12T02:57:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.195+0000 7f0a4ea00640 1 -- 172.21.15.18:0/456566227 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a60009bb0 con 0x55bf0556ab00 2024-09-12T02:57:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.196+0000 7f0a4ea00640 1 -- 172.21.15.18:0/456566227 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 61) ==== 8438+0+0 (secure 0 0 0) 0x7f0a540d3030 con 0x55bf0556ab00 2024-09-12T02:57:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.196+0000 7f0a72c58740 10 client.15825 fetch_fsmap finished waiting for FSMap version 61 2024-09-12T02:57:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.196+0000 7f0a72c58740 10 client.15825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:57:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.196+0000 7f0a72c58740 20 client.15825 populate_metadata read hostname 'smithi018' 2024-09-12T02:57:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.196+0000 7f0a72c58740 1 --2- 172.21.15.18:0/456566227 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bf055f01d0 0x55bf055f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.196+0000 7f0a72c58740 4 client.15825 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:57:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.196+0000 7f0a72c58740 1 -- 172.21.15.18:0/456566227 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bf05561d80 con 0x55bf055f01d0 2024-09-12T02:57:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.196+0000 7f0a6d200640 1 --2- 172.21.15.18:0/456566227 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bf055f01d0 0x55bf055f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.197+0000 7f0a6d200640 1 --2- 172.21.15.18:0/456566227 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bf055f01d0 0x55bf055f25f0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3847e1230d26c88 server_cookie=8948859d4b584ebe in_seq=0 out_seq=0 2024-09-12T02:57:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.197+0000 7f0a4ea00640 10 client.15825 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:57:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.507+0000 7f0a4ea00640 1 -- 172.21.15.18:0/456566227 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bf05561d80 con 0x55bf055f01d0 2024-09-12T02:57:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.508+0000 7f0a4ea00640 10 client.15825 handle_command_reply: tid=0 2024-09-12T02:57:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.508+0000 7f0a72c58740 1 client.15825 shutdown 2024-09-12T02:57:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.508+0000 7f0a72c58740 1 -- 172.21.15.18:0/456566227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556ab00 msgr2=0x55bf05578fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.508+0000 7f0a72c58740 1 --2- 172.21.15.18:0/456566227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556ab00 0x55bf05578fb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0a540b8770 tx=0x7f0a540bbc30 comp rx=0 tx=0).stop 2024-09-12T02:57:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.508+0000 7f0a72c58740 1 -- 172.21.15.18:0/456566227 shutdown_connections 2024-09-12T02:57:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.508+0000 7f0a72c58740 1 --2- 172.21.15.18:0/456566227 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bf055f01d0 0x55bf055f25f0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.508+0000 7f0a72c58740 1 --2- 172.21.15.18:0/456566227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bf055753a0 0x55bf0557d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.508+0000 7f0a72c58740 1 --2- 172.21.15.18:0/456566227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf0556ab00 0x55bf05578fb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.508+0000 7f0a72c58740 1 --2- 172.21.15.18:0/456566227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf0556a1e0 0x55bf05578a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.508+0000 7f0a72c58740 1 -- 172.21.15.18:0/456566227 >> 172.21.15.18:0/456566227 conn(0x55bf05566750 msgr2=0x55bf05571420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.508+0000 7f0a4ea00640 0 client.15825 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:57:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.508+0000 7f0a72c58740 1 -- 172.21.15.18:0/456566227 shutdown_connections 2024-09-12T02:57:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.508+0000 7f0a72c58740 1 -- 172.21.15.18:0/456566227 wait complete. 2024-09-12T02:57:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.509+0000 7f0a72c58740 20 client.15825 trim_cache size 0 max 16384 2024-09-12T02:57:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:57:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:57:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:57:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:57:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.510+0000 7f0a6fc00640 1 -- 172.21.15.18:0/2345410070 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f0a500a2da0 msgr2=0x7f0a500a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.510+0000 7f0a6fc00640 1 --2- 172.21.15.18:0/2345410070 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f0a500a2da0 0x7f0a500a5260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55bf055675b0 tx=0x7f0a5c005f90 comp rx=0 tx=0).stop 2024-09-12T02:57:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.510+0000 7f0a6fc00640 1 -- 172.21.15.18:0/2345410070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a68109080 msgr2=0x7f0a6819aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.510+0000 7f0a6fc00640 1 --2- 172.21.15.18:0/2345410070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a68109080 0x7f0a6819aa90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0a54005940 tx=0x7f0a540040c0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.510+0000 7f0a6fc00640 1 -- 172.21.15.18:0/2345410070 shutdown_connections 2024-09-12T02:57:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.510+0000 7f0a6fc00640 1 --2- 172.21.15.18:0/2345410070 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f0a500a2da0 0x7f0a500a5260 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.510+0000 7f0a6fc00640 1 --2- 172.21.15.18:0/2345410070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a6819ee10 0x7f0a6819f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.510+0000 7f0a6fc00640 1 --2- 172.21.15.18:0/2345410070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a68109080 0x7f0a6819aa90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.510+0000 7f0a6fc00640 1 --2- 172.21.15.18:0/2345410070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a68103f30 0x7f0a6819a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.510+0000 7f0a6fc00640 1 -- 172.21.15.18:0/2345410070 >> 172.21.15.18:0/2345410070 conn(0x7f0a680ff980 msgr2=0x7f0a68100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.510+0000 7f0a6fc00640 1 -- 172.21.15.18:0/2345410070 shutdown_connections 2024-09-12T02:57:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:57:47.510+0000 7f0a6fc00640 1 -- 172.21.15.18:0/2345410070 wait complete. 2024-09-12T02:57:48.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:48 smithi176 ceph-mon[35713]: pgmap v281: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 479 op/s 2024-09-12T02:57:48.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:48 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:57:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:48 smithi062 ceph-mon[35527]: pgmap v281: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 479 op/s 2024-09-12T02:57:49.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:48 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:57:49.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:48 smithi018 ceph-mon[30616]: pgmap v281: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 479 op/s 2024-09-12T02:57:49.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:48 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:57:50.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:50 smithi176 ceph-mon[35713]: pgmap v282: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 567 op/s 2024-09-12T02:57:50.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:50 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:57:50.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:50 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:57:50.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:50 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:57:51.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:50 smithi062 ceph-mon[35527]: pgmap v282: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 567 op/s 2024-09-12T02:57:51.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:50 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:57:51.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:50 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:57:51.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:50 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:57:51.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:50 smithi018 ceph-mon[30616]: pgmap v282: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 567 op/s 2024-09-12T02:57:51.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:50 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:57:51.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:50 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:57:51.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:50 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:57:52.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:52 smithi018 ceph-mon[30616]: pgmap v283: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 435 op/s 2024-09-12T02:57:52.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:52 smithi176 ceph-mon[35713]: pgmap v283: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 435 op/s 2024-09-12T02:57:53.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:52 smithi062 ceph-mon[35527]: pgmap v283: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 435 op/s 2024-09-12T02:57:54.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:54 smithi176 ceph-mon[35713]: pgmap v284: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 378 op/s 2024-09-12T02:57:55.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:54 smithi062 ceph-mon[35527]: pgmap v284: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 378 op/s 2024-09-12T02:57:55.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:54 smithi018 ceph-mon[30616]: pgmap v284: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 378 op/s 2024-09-12T02:57:56.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:56 smithi176 ceph-mon[35713]: pgmap v285: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 552 op/s 2024-09-12T02:57:57.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:56 smithi062 ceph-mon[35527]: pgmap v285: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 552 op/s 2024-09-12T02:57:57.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:56 smithi018 ceph-mon[30616]: pgmap v285: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 552 op/s 2024-09-12T02:57:58.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:57:58 smithi176 ceph-mon[35713]: pgmap v286: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 356 op/s 2024-09-12T02:57:59.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:57:58 smithi062 ceph-mon[35527]: pgmap v286: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 356 op/s 2024-09-12T02:57:59.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:57:58 smithi018 ceph-mon[30616]: pgmap v286: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 356 op/s 2024-09-12T02:58:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.711+0000 7fc0fb000640 1 -- 172.21.15.18:0/432811661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f41011f0 msgr2=0x7fc0f41056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.711+0000 7fc0fb000640 1 --2- 172.21.15.18:0/432811661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f41011f0 0x7fc0f41056b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009890 tx=0x7fc0e002a400 comp rx=0 tx=0).stop 2024-09-12T02:58:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.711+0000 7fc0fb000640 1 -- 172.21.15.18:0/432811661 shutdown_connections 2024-09-12T02:58:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.711+0000 7fc0fb000640 1 --2- 172.21.15.18:0/432811661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0f4105cd0 0x7fc0f4106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.711+0000 7fc0fb000640 1 --2- 172.21.15.18:0/432811661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f41011f0 0x7fc0f41056b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.711+0000 7fc0fb000640 1 --2- 172.21.15.18:0/432811661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0f41008d0 0x7fc0f4100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.711+0000 7fc0fb000640 1 -- 172.21.15.18:0/432811661 >> 172.21.15.18:0/432811661 conn(0x7fc0f40777c0 msgr2=0x7fc0f40feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.712+0000 7fc0fb000640 1 -- 172.21.15.18:0/432811661 shutdown_connections 2024-09-12T02:58:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.712+0000 7fc0fb000640 1 -- 172.21.15.18:0/432811661 wait complete. 2024-09-12T02:58:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.713+0000 7fc0fb000640 1 Processor -- start 2024-09-12T02:58:00.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.714+0000 7fc0fb000640 1 -- start start 2024-09-12T02:58:00.715 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.714+0000 7fc0fb000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0f41008d0 0x7fc0f4073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.714+0000 7fc0fb000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0f41011f0 0x7fc0f406cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.714+0000 7fc0fb000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f4105cd0 0x7fc0f406d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.714+0000 7fc0fb000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f41182a0 con 0x7fc0f41008d0 2024-09-12T02:58:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.714+0000 7fc0fb000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f4118120 con 0x7fc0f41011f0 2024-09-12T02:58:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.714+0000 7fc0fb000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f4118420 con 0x7fc0f4105cd0 2024-09-12T02:58:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.715+0000 7fc0fa600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f4105cd0 0x7fc0f406d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.715+0000 7fc0f9c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0f41008d0 0x7fc0f4073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.715+0000 7fc0fa600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f4105cd0 0x7fc0f406d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:36124/0 (socket says 172.21.15.18:36124) 2024-09-12T02:58:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.715+0000 7fc0fa600640 1 -- 172.21.15.18:0/616126191 learned_addr learned my addr 172.21.15.18:0/616126191 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.715+0000 7fc0f9200640 1 --2- 172.21.15.18:0/616126191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0f41011f0 0x7fc0f406cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.716+0000 7fc0fa600640 1 -- 172.21.15.18:0/616126191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0f41011f0 msgr2=0x7fc0f406cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.716+0000 7fc0fa600640 1 --2- 172.21.15.18:0/616126191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0f41011f0 0x7fc0f406cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.716+0000 7fc0fa600640 1 -- 172.21.15.18:0/616126191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0f41008d0 msgr2=0x7fc0f4073ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.716+0000 7fc0fa600640 1 --2- 172.21.15.18:0/616126191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0f41008d0 0x7fc0f4073ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.716+0000 7fc0fa600640 1 -- 172.21.15.18:0/616126191 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f406d740 con 0x7fc0f4105cd0 2024-09-12T02:58:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.716+0000 7fc0fa600640 1 --2- 172.21.15.18:0/616126191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f4105cd0 0x7fc0f406d0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec009fd0 tx=0x7fc0ec00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.717+0000 7fc0f2000640 1 -- 172.21.15.18:0/616126191 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec004b20 con 0x7fc0f4105cd0 2024-09-12T02:58:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.717+0000 7fc0f2000640 1 -- 172.21.15.18:0/616126191 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0ec003e50 con 0x7fc0f4105cd0 2024-09-12T02:58:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.717+0000 7fc0f2000640 1 -- 172.21.15.18:0/616126191 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec00b630 con 0x7fc0f4105cd0 2024-09-12T02:58:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.717+0000 7fc0fb000640 1 -- 172.21.15.18:0/616126191 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f4071600 con 0x7fc0f4105cd0 2024-09-12T02:58:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.717+0000 7fc0fb000640 1 -- 172.21.15.18:0/616126191 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f4071ad0 con 0x7fc0f4105cd0 2024-09-12T02:58:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.723+0000 7fc0ff5bc740 1 Processor -- start 2024-09-12T02:58:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.726+0000 7fc0f2000640 1 -- 172.21.15.18:0/616126191 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fc0ec01d020 con 0x7fc0f4105cd0 2024-09-12T02:58:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.728+0000 7fc0ff5bc740 1 -- start start 2024-09-12T02:58:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.729+0000 7fc0ff5bc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6c3b0 0x55c113b6c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.729+0000 7fc0ff5bc740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6ccd0 0x55c113b77030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.729+0000 7fc0ff5bc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b77570 0x55c113b79960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.729+0000 7fc0ff5bc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c113ad2100 con 0x55c113b77570 2024-09-12T02:58:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.729+0000 7fc0ff5bc740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c113a7a1b0 con 0x55c113b6ccd0 2024-09-12T02:58:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.729+0000 7fc0ff5bc740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c113ace0c0 con 0x55c113b6c3b0 2024-09-12T02:58:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.729+0000 7fc0f2000640 1 --2- 172.21.15.18:0/616126191 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc0dc0a2d70 0x7fc0dc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.729+0000 7fc0f9200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6c3b0 0x55c113b6c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.729+0000 7fc0f9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b77570 0x55c113b79960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.730+0000 7fc0f9200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6c3b0 0x55c113b6c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:36126/0 (socket says 172.21.15.18:36126) 2024-09-12T02:58:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.730+0000 7fc0f9200640 1 -- 172.21.15.18:0/1223195898 learned_addr learned my addr 172.21.15.18:0/1223195898 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.730+0000 7fc0f9c00640 1 --2- 172.21.15.18:0/1223195898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6ccd0 0x55c113b77030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.730+0000 7fc0f2000640 1 -- 172.21.15.18:0/616126191 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9562+0+0 (secure 0 0 0) 0x7fc0ec0cf730 con 0x7fc0f4105cd0 2024-09-12T02:58:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.730+0000 7fc0f9200640 1 -- 172.21.15.18:0/1223195898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6ccd0 msgr2=0x55c113b77030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.730+0000 7fc0f9200640 1 --2- 172.21.15.18:0/1223195898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6ccd0 0x55c113b77030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.730+0000 7fc0f9200640 1 -- 172.21.15.18:0/1223195898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b77570 msgr2=0x55c113b79960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.730+0000 7fc0f9200640 1 --2- 172.21.15.18:0/1223195898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b77570 0x55c113b79960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.730+0000 7fc0f9200640 1 -- 172.21.15.18:0/1223195898 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1137e5210 con 0x55c113b6c3b0 2024-09-12T02:58:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.731+0000 7fc0f9200640 1 --2- 172.21.15.18:0/1223195898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6c3b0 0x55c113b6c790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0005e00 tx=0x7fc0e0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af84ca83b00695bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.731+0000 7fc0e6a00640 1 -- 172.21.15.18:0/1223195898 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0037040 con 0x55c113b6c3b0 2024-09-12T02:58:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.731+0000 7fc0e6a00640 1 -- 172.21.15.18:0/1223195898 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0e0045070 con 0x55c113b6c3b0 2024-09-12T02:58:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.731+0000 7fc0e6a00640 1 -- 172.21.15.18:0/1223195898 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0030810 con 0x55c113b6c3b0 2024-09-12T02:58:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.733+0000 7fc0fa600640 1 --2- 172.21.15.18:0/616126191 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc0dc0a2d70 0x7fc0dc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.736+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/1223195898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6c3b0 msgr2=0x55c113b6c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.736+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/1223195898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6c3b0 0x55c113b6c790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0005e00 tx=0x7fc0e0000bc0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.739+0000 7fc0fa600640 1 --2- 172.21.15.18:0/616126191 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc0dc0a2d70 0x7fc0dc0a5230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec097ca0 tx=0x7fc0ec004170 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.742+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/1223195898 shutdown_connections 2024-09-12T02:58:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.742+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/1223195898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b77570 0x55c113b79960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.742+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/1223195898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6ccd0 0x55c113b77030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.742+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/1223195898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6c3b0 0x55c113b6c790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.742+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/1223195898 >> 172.21.15.18:0/1223195898 conn(0x55c113b68920 msgr2=0x55c113b68d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.746+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/1223195898 shutdown_connections 2024-09-12T02:58:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.746+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/1223195898 wait complete. 2024-09-12T02:58:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.747+0000 7fc0ff5bc740 1 -- start start 2024-09-12T02:58:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.747+0000 7fc0ff5bc740 1 Processor -- start 2024-09-12T02:58:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.748+0000 7fc0ff5bc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6c3b0 0x55c113b74620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.748+0000 7fc0ff5bc740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6ccd0 0x55c113b74b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.748+0000 7fc0ff5bc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b77570 0x55c113b750a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.748+0000 7fc0ff5bc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c113b79ff0 con 0x55c113b77570 2024-09-12T02:58:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.748+0000 7fc0ff5bc740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c113a5b090 con 0x55c113b6ccd0 2024-09-12T02:58:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.748+0000 7fc0ff5bc740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c113b7a170 con 0x55c113b6c3b0 2024-09-12T02:58:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.748+0000 7fc0ff5bc740 10 client.0 _ll_register_callbacks cb 0x55c113aaff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:58:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.749+0000 7fc0f9c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6ccd0 0x55c113b74b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.749+0000 7fc0f9c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6ccd0 0x55c113b74b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:44472/0 (socket says 172.21.15.18:44472) 2024-09-12T02:58:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.749+0000 7fc0f9c00640 1 -- 172.21.15.18:0/2002778046 learned_addr learned my addr 172.21.15.18:0/2002778046 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.749+0000 7fc0f9200640 1 --2- 172.21.15.18:0/2002778046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6c3b0 0x55c113b74620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.749+0000 7fc0f9200640 1 --2- 172.21.15.18:0/2002778046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b77570 0x55c113b750a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.750+0000 7fc0f9c00640 1 -- 172.21.15.18:0/2002778046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6c3b0 msgr2=0x55c113b74620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.750+0000 7fc0f9c00640 1 --2- 172.21.15.18:0/2002778046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6c3b0 0x55c113b74620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.750+0000 7fc0f9c00640 1 -- 172.21.15.18:0/2002778046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b77570 msgr2=0x55c113b750a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.750+0000 7fc0f9c00640 1 --2- 172.21.15.18:0/2002778046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b77570 0x55c113b750a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.750+0000 7fc0f9c00640 1 -- 172.21.15.18:0/2002778046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1138b1620 con 0x55c113b6ccd0 2024-09-12T02:58:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.750+0000 7fc0f9c00640 1 --2- 172.21.15.18:0/2002778046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6ccd0 0x55c113b74b60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800ba20 tx=0x7fc0e800bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dc651e2f74a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.750+0000 7fc0db400640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:58:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.751+0000 7fc0db400640 1 -- 172.21.15.18:0/2002778046 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e801b640 con 0x55c113b6ccd0 2024-09-12T02:58:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.751+0000 7fc0db400640 1 -- 172.21.15.18:0/2002778046 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9562+0+0 (secure 0 0 0) 0x7fc0e801b7e0 con 0x55c113b6ccd0 2024-09-12T02:58:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.751+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/2002778046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0e0045070 con 0x55c113b6ccd0 2024-09-12T02:58:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.751+0000 7fc0db400640 1 -- 172.21.15.18:0/2002778046 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fc0e801b9e0 con 0x55c113b6ccd0 2024-09-12T02:58:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.751+0000 7fc0ff5bc740 10 client.25835 fetch_fsmap learned FSMap version 61 2024-09-12T02:58:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.751+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/2002778046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55c113b85ec0 con 0x55c113b6ccd0 2024-09-12T02:58:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.752+0000 7fc0db400640 1 -- 172.21.15.18:0/2002778046 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0e0045070 con 0x55c113b6ccd0 2024-09-12T02:58:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.752+0000 7fc0db400640 1 -- 172.21.15.18:0/2002778046 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 61) ==== 8438+0+0 (secure 0 0 0) 0x7fc0e8019020 con 0x55c113b6ccd0 2024-09-12T02:58:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.752+0000 7fc0ff5bc740 10 client.25835 fetch_fsmap finished waiting for FSMap version 61 2024-09-12T02:58:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.752+0000 7fc0ff5bc740 10 client.25835 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:58:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.752+0000 7fc0ff5bc740 20 client.25835 populate_metadata read hostname 'smithi018' 2024-09-12T02:58:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.752+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/2002778046 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c113b873f0 0x55c113b89810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.752+0000 7fc0ff5bc740 4 client.25835 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:58:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.752+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/2002778046 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c113adf830 con 0x55c113b873f0 2024-09-12T02:58:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.753+0000 7fc0f9200640 1 --2- 172.21.15.18:0/2002778046 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c113b873f0 0x55c113b89810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.754+0000 7fc0f9200640 1 --2- 172.21.15.18:0/2002778046 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c113b873f0 0x55c113b89810 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebd10f5ca54e8a43 server_cookie=d35f0926bb2d10d in_seq=0 out_seq=0 2024-09-12T02:58:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.755+0000 7fc0db400640 10 client.25835 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.756+0000 7fc0db400640 1 -- 172.21.15.18:0/2002778046 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c113adf830 con 0x55c113b873f0 2024-09-12T02:58:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.756+0000 7fc0db400640 10 client.25835 handle_command_reply: tid=0 2024-09-12T02:58:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.757+0000 7fc0ff5bc740 1 client.25835 shutdown 2024-09-12T02:58:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.757+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/2002778046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6ccd0 msgr2=0x55c113b74b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.757+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/2002778046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6ccd0 0x55c113b74b60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800ba20 tx=0x7fc0e800bee0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.757+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/2002778046 shutdown_connections 2024-09-12T02:58:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.757+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/2002778046 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c113b873f0 0x55c113b89810 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.757+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/2002778046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b77570 0x55c113b750a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.757+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/2002778046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6ccd0 0x55c113b74b60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.757+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/2002778046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6c3b0 0x55c113b74620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.757+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/2002778046 >> 172.21.15.18:0/2002778046 conn(0x55c113b68920 msgr2=0x55c113b6e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.757+0000 7fc0db400640 0 client.25835 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.758+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/2002778046 shutdown_connections 2024-09-12T02:58:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.758+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/2002778046 wait complete. 2024-09-12T02:58:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.758+0000 7fc0ff5bc740 20 client.25835 trim_cache size 0 max 16384 2024-09-12T02:58:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.786+0000 7fc0ff5bc740 1 Processor -- start 2024-09-12T02:58:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.786+0000 7fc0ff5bc740 1 -- start start 2024-09-12T02:58:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.787+0000 7fc0ff5bc740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6c3b0 0x55c113b6e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.787+0000 7fc0ff5bc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6ccd0 0x55c113b8f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.787+0000 7fc0ff5bc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b77570 0x55c113b8f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.787+0000 7fc0ff5bc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f41bded0 con 0x55c113b77570 2024-09-12T02:58:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.787+0000 7fc0ff5bc740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f41bfc80 con 0x55c113b6c3b0 2024-09-12T02:58:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.787+0000 7fc0ff5bc740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f41be660 con 0x55c113b6ccd0 2024-09-12T02:58:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.787+0000 7fc0f9200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6c3b0 0x55c113b6e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.787+0000 7fc0f9200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6c3b0 0x55c113b6e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:44476/0 (socket says 172.21.15.18:44476) 2024-09-12T02:58:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.787+0000 7fc0f9200640 1 -- 172.21.15.18:0/3148539837 learned_addr learned my addr 172.21.15.18:0/3148539837 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.787+0000 7fc0f9200640 1 --2- 172.21.15.18:0/3148539837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b77570 0x55c113b8f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.788+0000 7fc0f9c00640 1 --2- 172.21.15.18:0/3148539837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6ccd0 0x55c113b8f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.788+0000 7fc0f9c00640 1 -- 172.21.15.18:0/3148539837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6c3b0 msgr2=0x55c113b6e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.788+0000 7fc0f9c00640 1 --2- 172.21.15.18:0/3148539837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6c3b0 0x55c113b6e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.788+0000 7fc0f9c00640 1 -- 172.21.15.18:0/3148539837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b77570 msgr2=0x55c113b8f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.788+0000 7fc0f9c00640 1 --2- 172.21.15.18:0/3148539837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b77570 0x55c113b8f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.788+0000 7fc0f9c00640 1 -- 172.21.15.18:0/3148539837 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c113b83330 con 0x55c113b6ccd0 2024-09-12T02:58:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.788+0000 7fc0f9200640 1 --2- 172.21.15.18:0/3148539837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b77570 0x55c113b8f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.789+0000 7fc0f9c00640 1 --2- 172.21.15.18:0/3148539837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6ccd0 0x55c113b8f0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55c113b75bd0 tx=0x7fc0e8011e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcb273be5cd3c5e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.789+0000 7fc0e6000640 1 -- 172.21.15.18:0/3148539837 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8025420 con 0x55c113b6ccd0 2024-09-12T02:58:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.789+0000 7fc0e6000640 1 -- 172.21.15.18:0/3148539837 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0e8004380 con 0x55c113b6ccd0 2024-09-12T02:58:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.789+0000 7fc0e6000640 1 -- 172.21.15.18:0/3148539837 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8005490 con 0x55c113b6ccd0 2024-09-12T02:58:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.790+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/3148539837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6ccd0 msgr2=0x55c113b8f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.790+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/3148539837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6ccd0 0x55c113b8f0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55c113b75bd0 tx=0x7fc0e8011e50 comp rx=0 tx=0).stop 2024-09-12T02:58:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.791+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/3148539837 shutdown_connections 2024-09-12T02:58:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.791+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/3148539837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b77570 0x55c113b8f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.791+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/3148539837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6ccd0 0x55c113b8f0a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.791+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/3148539837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b6c3b0 0x55c113b6e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.791+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/3148539837 >> 172.21.15.18:0/3148539837 conn(0x55c113b68920 msgr2=0x55c113b6de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.791+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/3148539837 shutdown_connections 2024-09-12T02:58:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.791+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/3148539837 wait complete. 2024-09-12T02:58:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.791+0000 7fc0ff5bc740 1 -- start start 2024-09-12T02:58:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.792+0000 7fc0ff5bc740 1 Processor -- start 2024-09-12T02:58:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.792+0000 7fc0ff5bc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b6c3b0 0x55c113bea130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.792+0000 7fc0ff5bc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6ccd0 0x55c113bea670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.792+0000 7fc0ff5bc740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b77570 0x55c113beabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.792+0000 7fc0ff5bc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f41bf4f0 con 0x55c113b6c3b0 2024-09-12T02:58:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.792+0000 7fc0ff5bc740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f41bedf0 con 0x55c113b77570 2024-09-12T02:58:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.792+0000 7fc0ff5bc740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f41bbed0 con 0x55c113b6ccd0 2024-09-12T02:58:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.792+0000 7fc0ff5bc740 10 client.0 _ll_register_callbacks cb 0x7fc0e80040e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:58:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.793+0000 7fc0f9c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6ccd0 0x55c113bea670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.793+0000 7fc0f9c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6ccd0 0x55c113bea670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:36168/0 (socket says 172.21.15.18:36168) 2024-09-12T02:58:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.793+0000 7fc0f9c00640 1 -- 172.21.15.18:0/1484008153 learned_addr learned my addr 172.21.15.18:0/1484008153 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.793+0000 7fc0f9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b6c3b0 0x55c113bea130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.793+0000 7fc0f9200640 1 --2- 172.21.15.18:0/1484008153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b77570 0x55c113beabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.793+0000 7fc0f9c00640 1 -- 172.21.15.18:0/1484008153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b77570 msgr2=0x55c113beabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.793+0000 7fc0f9c00640 1 --2- 172.21.15.18:0/1484008153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b77570 0x55c113beabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.793+0000 7fc0f9c00640 1 -- 172.21.15.18:0/1484008153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b6c3b0 msgr2=0x55c113bea130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.793+0000 7fc0f9c00640 1 --2- 172.21.15.18:0/1484008153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b6c3b0 0x55c113bea130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.793+0000 7fc0f9c00640 1 -- 172.21.15.18:0/1484008153 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c113b7e730 con 0x55c113b6ccd0 2024-09-12T02:58:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.794+0000 7fc0f9c00640 1 --2- 172.21.15.18:0/1484008153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6ccd0 0x55c113bea670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc0e801b6a0 tx=0x7fc0e801b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5100d13b554f4763 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.794+0000 7fc0db400640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:58:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.794+0000 7fc0db400640 1 -- 172.21.15.18:0/1484008153 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8025420 con 0x55c113b6ccd0 2024-09-12T02:58:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.794+0000 7fc0db400640 1 -- 172.21.15.18:0/1484008153 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9562+0+0 (secure 0 0 0) 0x7fc0e8005320 con 0x55c113b6ccd0 2024-09-12T02:58:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.794+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/1484008153 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0e8004380 con 0x55c113b6ccd0 2024-09-12T02:58:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.795+0000 7fc0db400640 1 -- 172.21.15.18:0/1484008153 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fc0e803e050 con 0x55c113b6ccd0 2024-09-12T02:58:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.795+0000 7fc0ff5bc740 10 client.25840 fetch_fsmap learned FSMap version 61 2024-09-12T02:58:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.795+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/1484008153 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55c113b7fa40 con 0x55c113b6ccd0 2024-09-12T02:58:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.795+0000 7fc0db400640 1 -- 172.21.15.18:0/1484008153 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0e8004380 con 0x55c113b6ccd0 2024-09-12T02:58:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.796+0000 7fc0db400640 1 -- 172.21.15.18:0/1484008153 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 61) ==== 8438+0+0 (secure 0 0 0) 0x7fc0e8019040 con 0x55c113b6ccd0 2024-09-12T02:58:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.796+0000 7fc0ff5bc740 10 client.25840 fetch_fsmap finished waiting for FSMap version 61 2024-09-12T02:58:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.796+0000 7fc0ff5bc740 10 client.25840 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:58:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.796+0000 7fc0ff5bc740 20 client.25840 populate_metadata read hostname 'smithi018' 2024-09-12T02:58:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.796+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/1484008153 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c113c03080 0x55c113c05470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.796+0000 7fc0ff5bc740 4 client.25840 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:58:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.796+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/1484008153 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c113ad9b80 con 0x55c113c03080 2024-09-12T02:58:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.797+0000 7fc0f9200640 1 --2- 172.21.15.18:0/1484008153 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c113c03080 0x55c113c05470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.801+0000 7fc0f9200640 1 --2- 172.21.15.18:0/1484008153 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c113c03080 0x55c113c05470 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47d4573fec0848c7 server_cookie=a38a0905e8872107 in_seq=0 out_seq=0 2024-09-12T02:58:00.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:00.801+0000 7fc0db400640 10 client.25840 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:00.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:00 smithi176 ceph-mon[35713]: pgmap v287: 129 pgs: 129 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 518 op/s 2024-09-12T02:58:01.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:00 smithi062 ceph-mon[35527]: pgmap v287: 129 pgs: 129 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 518 op/s 2024-09-12T02:58:01.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:00 smithi018 ceph-mon[30616]: pgmap v287: 129 pgs: 129 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 518 op/s 2024-09-12T02:58:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.110+0000 7fc0db400640 1 -- 172.21.15.18:0/1484008153 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c113ad9b80 con 0x55c113c03080 2024-09-12T02:58:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.110+0000 7fc0db400640 10 client.25840 handle_command_reply: tid=0 2024-09-12T02:58:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.110+0000 7fc0ff5bc740 1 client.25840 shutdown 2024-09-12T02:58:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.110+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/1484008153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6ccd0 msgr2=0x55c113bea670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.110+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/1484008153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6ccd0 0x55c113bea670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc0e801b6a0 tx=0x7fc0e801b6d0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.110+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/1484008153 shutdown_connections 2024-09-12T02:58:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.110+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/1484008153 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c113c03080 0x55c113c05470 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.110+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/1484008153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c113b77570 0x55c113beabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.110+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/1484008153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c113b6ccd0 0x55c113bea670 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.110+0000 7fc0ff5bc740 1 --2- 172.21.15.18:0/1484008153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c113b6c3b0 0x55c113bea130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.110+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/1484008153 >> 172.21.15.18:0/1484008153 conn(0x55c113b68920 msgr2=0x55c113b6e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:01.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.111+0000 7fc0db400640 0 client.25840 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:01.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.111+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/1484008153 shutdown_connections 2024-09-12T02:58:01.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.111+0000 7fc0ff5bc740 1 -- 172.21.15.18:0/1484008153 wait complete. 2024-09-12T02:58:01.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.111+0000 7fc0ff5bc740 20 client.25840 trim_cache size 0 max 16384 2024-09-12T02:58:01.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:58:01.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:58:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:58:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:58:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.112+0000 7fc0fb000640 1 -- 172.21.15.18:0/616126191 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc0dc0a2d70 msgr2=0x7fc0dc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.112+0000 7fc0fb000640 1 --2- 172.21.15.18:0/616126191 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc0dc0a2d70 0x7fc0dc0a5230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec097ca0 tx=0x7fc0ec004170 comp rx=0 tx=0).stop 2024-09-12T02:58:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.112+0000 7fc0fb000640 1 -- 172.21.15.18:0/616126191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f4105cd0 msgr2=0x7fc0f406d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.112+0000 7fc0fb000640 1 --2- 172.21.15.18:0/616126191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f4105cd0 0x7fc0f406d0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec009fd0 tx=0x7fc0ec00c800 comp rx=0 tx=0).stop 2024-09-12T02:58:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.112+0000 7fc0fb000640 1 -- 172.21.15.18:0/616126191 shutdown_connections 2024-09-12T02:58:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.112+0000 7fc0fb000640 1 --2- 172.21.15.18:0/616126191 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc0dc0a2d70 0x7fc0dc0a5230 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.112+0000 7fc0fb000640 1 --2- 172.21.15.18:0/616126191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f4105cd0 0x7fc0f406d0a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.112+0000 7fc0fb000640 1 --2- 172.21.15.18:0/616126191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0f41011f0 0x7fc0f406cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.112+0000 7fc0fb000640 1 --2- 172.21.15.18:0/616126191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0f41008d0 0x7fc0f4073ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.112+0000 7fc0fb000640 1 -- 172.21.15.18:0/616126191 >> 172.21.15.18:0/616126191 conn(0x7fc0f40777c0 msgr2=0x7fc0f40fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.113+0000 7fc0fb000640 1 -- 172.21.15.18:0/616126191 shutdown_connections 2024-09-12T02:58:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:01.113+0000 7fc0fb000640 1 -- 172.21.15.18:0/616126191 wait complete. 2024-09-12T02:58:02.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:02 smithi176 ceph-mon[35713]: pgmap v288: 129 pgs: 129 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 496 op/s 2024-09-12T02:58:03.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:02 smithi062 ceph-mon[35527]: pgmap v288: 129 pgs: 129 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 496 op/s 2024-09-12T02:58:03.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:02 smithi018 ceph-mon[30616]: pgmap v288: 129 pgs: 129 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 496 op/s 2024-09-12T02:58:03.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:03 smithi176 ceph-mon[35713]: osdmap e106: 12 total, 12 up, 12 in 2024-09-12T02:58:04.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:03 smithi062 ceph-mon[35527]: osdmap e106: 12 total, 12 up, 12 in 2024-09-12T02:58:04.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:03 smithi018 ceph-mon[30616]: osdmap e106: 12 total, 12 up, 12 in 2024-09-12T02:58:05.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:04 smithi062 ceph-mon[35527]: pgmap v290: 129 pgs: 2 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 119 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 541 op/s 2024-09-12T02:58:05.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:04 smithi018 ceph-mon[30616]: pgmap v290: 129 pgs: 2 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 119 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 541 op/s 2024-09-12T02:58:05.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:04 smithi176 ceph-mon[35713]: pgmap v290: 129 pgs: 2 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 119 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 541 op/s 2024-09-12T02:58:07.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:06 smithi062 ceph-mon[35527]: pgmap v291: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 636 op/s 2024-09-12T02:58:07.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:06 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:58:07.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:06 smithi018 ceph-mon[30616]: pgmap v291: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 636 op/s 2024-09-12T02:58:07.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:06 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:58:07.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:06 smithi176 ceph-mon[35713]: pgmap v291: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 636 op/s 2024-09-12T02:58:07.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:06 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:58:09.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:08 smithi062 ceph-mon[35527]: pgmap v292: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 636 op/s 2024-09-12T02:58:09.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:08 smithi018 ceph-mon[30616]: pgmap v292: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 636 op/s 2024-09-12T02:58:09.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:08 smithi176 ceph-mon[35713]: pgmap v292: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 636 op/s 2024-09-12T02:58:11.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:10 smithi062 ceph-mon[35527]: pgmap v293: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 510 op/s 2024-09-12T02:58:11.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:10 smithi018 ceph-mon[30616]: pgmap v293: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 510 op/s 2024-09-12T02:58:11.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:10 smithi176 ceph-mon[35713]: pgmap v293: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 510 op/s 2024-09-12T02:58:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:12 smithi062 ceph-mon[35527]: pgmap v294: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 467 op/s 2024-09-12T02:58:13.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:12 smithi018 ceph-mon[30616]: pgmap v294: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 467 op/s 2024-09-12T02:58:13.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:12 smithi176 ceph-mon[35713]: pgmap v294: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 467 op/s 2024-09-12T02:58:14.306 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.304+0000 7febe5400640 1 -- 172.21.15.18:0/3693640904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0076720 msgr2=0x7febe0076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:14.306 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.304+0000 7febe5400640 1 --2- 172.21.15.18:0/3693640904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0076720 0x7febe0076b00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7febd0009860 tx=0x7febd002a340 comp rx=0 tx=0).stop 2024-09-12T02:58:14.306 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.304+0000 7febe5400640 1 -- 172.21.15.18:0/3693640904 shutdown_connections 2024-09-12T02:58:14.306 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.304+0000 7febe5400640 1 --2- 172.21.15.18:0/3693640904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febe0112960 0x7febe0114d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.306 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.304+0000 7febe5400640 1 --2- 172.21.15.18:0/3693640904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febe0077040 0x7febe0112420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.306 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.304+0000 7febe5400640 1 --2- 172.21.15.18:0/3693640904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0076720 0x7febe0076b00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.306 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.304+0000 7febe5400640 1 -- 172.21.15.18:0/3693640904 >> 172.21.15.18:0/3693640904 conn(0x7febe00ff980 msgr2=0x7febe0101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:14.307 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.305+0000 7febe5400640 1 -- 172.21.15.18:0/3693640904 shutdown_connections 2024-09-12T02:58:14.307 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.305+0000 7febe5400640 1 -- 172.21.15.18:0/3693640904 wait complete. 2024-09-12T02:58:14.308 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.306+0000 7febe5400640 1 Processor -- start 2024-09-12T02:58:14.308 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.306+0000 7febe5400640 1 -- start start 2024-09-12T02:58:14.308 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.307+0000 7febe5400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febe0076720 0x7febe01a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.308 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.307+0000 7febe5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0077040 0x7febe01a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.309 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.307+0000 7febde800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febe0076720 0x7febe01a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.309 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.307+0000 7febdde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0077040 0x7febe01a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.309 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.307+0000 7febdde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0077040 0x7febe01a4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38394/0 (socket says 172.21.15.18:38394) 2024-09-12T02:58:14.309 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.307+0000 7febe5400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febe0112960 0x7febe019e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.309 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.308+0000 7febe5400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7febe01184c0 con 0x7febe0077040 2024-09-12T02:58:14.309 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.308+0000 7febe5400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7febe0118340 con 0x7febe0076720 2024-09-12T02:58:14.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.308+0000 7febe5400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7febe0118640 con 0x7febe0112960 2024-09-12T02:58:14.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.308+0000 7febde800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febe0076720 0x7febe01a4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:54676/0 (socket says 172.21.15.18:54676) 2024-09-12T02:58:14.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.308+0000 7febde800640 1 -- 172.21.15.18:0/584995865 learned_addr learned my addr 172.21.15.18:0/584995865 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:14.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.308+0000 7febdf200640 1 --2- 172.21.15.18:0/584995865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febe0112960 0x7febe019e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.308+0000 7febde800640 1 -- 172.21.15.18:0/584995865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febe0112960 msgr2=0x7febe019e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:14.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.308+0000 7febde800640 1 --2- 172.21.15.18:0/584995865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febe0112960 0x7febe019e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.308+0000 7febde800640 1 -- 172.21.15.18:0/584995865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0077040 msgr2=0x7febe01a4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:14.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.308+0000 7febde800640 1 --2- 172.21.15.18:0/584995865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0077040 0x7febe01a4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.308+0000 7febde800640 1 -- 172.21.15.18:0/584995865 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe019ef50 con 0x7febe0076720 2024-09-12T02:58:14.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.309+0000 7febde800640 1 --2- 172.21.15.18:0/584995865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febe0076720 0x7febe01a4610 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7febd0035040 tx=0x7febd0033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:14.313 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.312+0000 7febd7400640 1 -- 172.21.15.18:0/584995865 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd0037040 con 0x7febe0076720 2024-09-12T02:58:14.313 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.312+0000 7febd7400640 1 -- 172.21.15.18:0/584995865 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febd0040070 con 0x7febe0076720 2024-09-12T02:58:14.313 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.312+0000 7febe5400640 1 -- 172.21.15.18:0/584995865 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febe019f1e0 con 0x7febe0076720 2024-09-12T02:58:14.313 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.312+0000 7febe5400640 1 -- 172.21.15.18:0/584995865 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febe01ab460 con 0x7febe0076720 2024-09-12T02:58:14.313 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.312+0000 7febd7400640 1 -- 172.21.15.18:0/584995865 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd0003a50 con 0x7febe0076720 2024-09-12T02:58:14.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.318+0000 7febd7400640 1 -- 172.21.15.18:0/584995865 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7febd0003bf0 con 0x7febe0076720 2024-09-12T02:58:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.320+0000 7febd7400640 1 --2- 172.21.15.18:0/584995865 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7febc40a2ea0 0x7febc40a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.321+0000 7febdde00640 1 --2- 172.21.15.18:0/584995865 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7febc40a2ea0 0x7febc40a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.324+0000 7febd7400640 1 -- 172.21.15.18:0/584995865 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9650+0+0 (secure 0 0 0) 0x7febd00f0c10 con 0x7febe0076720 2024-09-12T02:58:14.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.324+0000 7febdde00640 1 --2- 172.21.15.18:0/584995865 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7febc40a2ea0 0x7febc40a5360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7febe0079220 tx=0x7febcc009260 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:14.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.324+0000 7febe83d2740 1 Processor -- start 2024-09-12T02:58:14.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.325+0000 7febe83d2740 1 -- start start 2024-09-12T02:58:14.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.325+0000 7febe83d2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd421e0 0x55803bd425c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.325+0000 7febe83d2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd42b00 0x55803bd4ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.325+0000 7febe83d2740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd4d3a0 0x55803bd4f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.325+0000 7febe83d2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55803bca8100 con 0x55803bd42b00 2024-09-12T02:58:14.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.325+0000 7febe83d2740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55803bc501b0 con 0x55803bd4d3a0 2024-09-12T02:58:14.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.325+0000 7febe83d2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55803bca40c0 con 0x55803bd421e0 2024-09-12T02:58:14.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.326+0000 7febdf200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd4d3a0 0x55803bd4f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.326+0000 7febdf200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd4d3a0 0x55803bd4f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:54692/0 (socket says 172.21.15.18:54692) 2024-09-12T02:58:14.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.326+0000 7febdf200640 1 -- 172.21.15.18:0/2729401807 learned_addr learned my addr 172.21.15.18:0/2729401807 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:14.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.326+0000 7febde800640 1 --2- 172.21.15.18:0/2729401807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd421e0 0x55803bd425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.326+0000 7febdf200640 1 -- 172.21.15.18:0/2729401807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd421e0 msgr2=0x55803bd425c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:14.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.326+0000 7febdf200640 1 --2- 172.21.15.18:0/2729401807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd421e0 0x55803bd425c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.326+0000 7febdf200640 1 -- 172.21.15.18:0/2729401807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd42b00 msgr2=0x55803bd4ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.326+0000 7febdf200640 1 --2- 172.21.15.18:0/2729401807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd42b00 0x55803bd4ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.326+0000 7febdf200640 1 -- 172.21.15.18:0/2729401807 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55803b9bb210 con 0x55803bd4d3a0 2024-09-12T02:58:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.327+0000 7febdf200640 1 --2- 172.21.15.18:0/2729401807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd4d3a0 0x55803bd4f790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7febd8009ef0 tx=0x7febd800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71b0803f2ea70c12 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.327+0000 7febcb400640 1 -- 172.21.15.18:0/2729401807 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd8015070 con 0x55803bd4d3a0 2024-09-12T02:58:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.327+0000 7febcb400640 1 -- 172.21.15.18:0/2729401807 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febd8011920 con 0x55803bd4d3a0 2024-09-12T02:58:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.328+0000 7febe83d2740 1 -- 172.21.15.18:0/2729401807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd4d3a0 msgr2=0x55803bd4f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.328+0000 7febe83d2740 1 --2- 172.21.15.18:0/2729401807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd4d3a0 0x55803bd4f790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7febd8009ef0 tx=0x7febd800f730 comp rx=0 tx=0).stop 2024-09-12T02:58:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.329+0000 7febe83d2740 1 -- 172.21.15.18:0/2729401807 shutdown_connections 2024-09-12T02:58:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.329+0000 7febe83d2740 1 --2- 172.21.15.18:0/2729401807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd4d3a0 0x55803bd4f790 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.329+0000 7febe83d2740 1 --2- 172.21.15.18:0/2729401807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd42b00 0x55803bd4ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.329+0000 7febe83d2740 1 --2- 172.21.15.18:0/2729401807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd421e0 0x55803bd425c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.329+0000 7febe83d2740 1 -- 172.21.15.18:0/2729401807 >> 172.21.15.18:0/2729401807 conn(0x55803bd3e750 msgr2=0x55803bd3eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.329+0000 7febe83d2740 1 -- 172.21.15.18:0/2729401807 shutdown_connections 2024-09-12T02:58:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.329+0000 7febe83d2740 1 -- 172.21.15.18:0/2729401807 wait complete. 2024-09-12T02:58:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.330+0000 7febe83d2740 1 -- start start 2024-09-12T02:58:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.330+0000 7febe83d2740 1 Processor -- start 2024-09-12T02:58:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.332+0000 7febe83d2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd421e0 0x55803bd4a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.332+0000 7febe83d2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd42b00 0x55803bd4a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.332+0000 7febe83d2740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd4d3a0 0x55803bd4ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.332+0000 7febe83d2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55803bd4ffc0 con 0x55803bd421e0 2024-09-12T02:58:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.332+0000 7febe83d2740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55803bc31090 con 0x55803bd4d3a0 2024-09-12T02:58:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.332+0000 7febe83d2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55803bd50140 con 0x55803bd42b00 2024-09-12T02:58:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.332+0000 7febe83d2740 10 client.0 _ll_register_callbacks cb 0x55803bc85f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:58:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.332+0000 7febdf200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd4d3a0 0x55803bd4ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.332+0000 7febdf200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd4d3a0 0x55803bd4ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:54706/0 (socket says 172.21.15.18:54706) 2024-09-12T02:58:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.332+0000 7febdf200640 1 -- 172.21.15.18:0/428350812 learned_addr learned my addr 172.21.15.18:0/428350812 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.332+0000 7febde800640 1 --2- 172.21.15.18:0/428350812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd421e0 0x55803bd4a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.333+0000 7febdde00640 1 --2- 172.21.15.18:0/428350812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd42b00 0x55803bd4a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.333+0000 7febdf200640 1 -- 172.21.15.18:0/428350812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd42b00 msgr2=0x55803bd4a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.333+0000 7febdf200640 1 --2- 172.21.15.18:0/428350812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd42b00 0x55803bd4a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.333+0000 7febdf200640 1 -- 172.21.15.18:0/428350812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd421e0 msgr2=0x55803bd4a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.333+0000 7febdf200640 1 --2- 172.21.15.18:0/428350812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd421e0 0x55803bd4a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.333+0000 7febdf200640 1 -- 172.21.15.18:0/428350812 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55803ba87620 con 0x55803bd4d3a0 2024-09-12T02:58:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.334+0000 7febdf200640 1 --2- 172.21.15.18:0/428350812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd4d3a0 0x55803bd4ad40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7febd8009ec0 tx=0x7febd8010470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6389accfb93bd0d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.334+0000 7febbfe00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:58:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.334+0000 7febbfe00640 1 -- 172.21.15.18:0/428350812 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd8015040 con 0x55803bd4d3a0 2024-09-12T02:58:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.334+0000 7febbfe00640 1 -- 172.21.15.18:0/428350812 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9650+0+0 (secure 0 0 0) 0x7febd8011440 con 0x55803bd4d3a0 2024-09-12T02:58:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.335+0000 7febe83d2740 1 -- 172.21.15.18:0/428350812 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febd8011920 con 0x55803bd4d3a0 2024-09-12T02:58:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.335+0000 7febbfe00640 1 -- 172.21.15.18:0/428350812 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7febd8011640 con 0x55803bd4d3a0 2024-09-12T02:58:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.335+0000 7febe83d2740 10 client.25853 fetch_fsmap learned FSMap version 62 2024-09-12T02:58:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.335+0000 7febe83d2740 1 -- 172.21.15.18:0/428350812 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55803bd5bc10 con 0x55803bd4d3a0 2024-09-12T02:58:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.335+0000 7febbfe00640 1 -- 172.21.15.18:0/428350812 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febd8011920 con 0x55803bd4d3a0 2024-09-12T02:58:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.336+0000 7febbfe00640 1 -- 172.21.15.18:0/428350812 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 62) ==== 8446+0+0 (secure 0 0 0) 0x7febd8005160 con 0x55803bd4d3a0 2024-09-12T02:58:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.336+0000 7febe83d2740 10 client.25853 fetch_fsmap finished waiting for FSMap version 62 2024-09-12T02:58:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.336+0000 7febe83d2740 10 client.25853 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:58:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.336+0000 7febe83d2740 20 client.25853 populate_metadata read hostname 'smithi018' 2024-09-12T02:58:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.336+0000 7febe83d2740 1 --2- 172.21.15.18:0/428350812 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55803bd5d080 0x55803bd5f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.336+0000 7febe83d2740 4 client.25853 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:58:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.336+0000 7febe83d2740 1 -- 172.21.15.18:0/428350812 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55803bcb5830 con 0x55803bd5d080 2024-09-12T02:58:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.337+0000 7febde800640 1 --2- 172.21.15.18:0/428350812 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55803bd5d080 0x55803bd5f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.338+0000 7febde800640 1 --2- 172.21.15.18:0/428350812 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55803bd5d080 0x55803bd5f470 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a1b8a6ec3cd3dee server_cookie=9080bb69251f471e in_seq=0 out_seq=0 2024-09-12T02:58:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.338+0000 7febbfe00640 10 client.25853 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:14.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.339+0000 7febbfe00640 1 -- 172.21.15.18:0/428350812 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55803bcb5830 con 0x55803bd5d080 2024-09-12T02:58:14.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.340+0000 7febbfe00640 10 client.25853 handle_command_reply: tid=0 2024-09-12T02:58:14.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.340+0000 7febe83d2740 1 client.25853 shutdown 2024-09-12T02:58:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.343+0000 7febe83d2740 1 -- 172.21.15.18:0/428350812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd4d3a0 msgr2=0x55803bd4ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.343+0000 7febe83d2740 1 --2- 172.21.15.18:0/428350812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd4d3a0 0x55803bd4ad40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7febd8009ec0 tx=0x7febd8010470 comp rx=0 tx=0).stop 2024-09-12T02:58:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.343+0000 7febe83d2740 1 -- 172.21.15.18:0/428350812 shutdown_connections 2024-09-12T02:58:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.343+0000 7febe83d2740 1 --2- 172.21.15.18:0/428350812 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55803bd5d080 0x55803bd5f470 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.343+0000 7febe83d2740 1 --2- 172.21.15.18:0/428350812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd4d3a0 0x55803bd4ad40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.343+0000 7febe83d2740 1 --2- 172.21.15.18:0/428350812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd42b00 0x55803bd4a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.343+0000 7febe83d2740 1 --2- 172.21.15.18:0/428350812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd421e0 0x55803bd4a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.343+0000 7febe83d2740 1 -- 172.21.15.18:0/428350812 >> 172.21.15.18:0/428350812 conn(0x55803bd3e750 msgr2=0x55803bd444b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.343+0000 7febbfe00640 0 client.25853 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.343+0000 7febe83d2740 1 -- 172.21.15.18:0/428350812 shutdown_connections 2024-09-12T02:58:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.343+0000 7febe83d2740 1 -- 172.21.15.18:0/428350812 wait complete. 2024-09-12T02:58:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.344+0000 7febe83d2740 20 client.25853 trim_cache size 0 max 16384 2024-09-12T02:58:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.375+0000 7febe83d2740 1 Processor -- start 2024-09-12T02:58:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.376+0000 7febe83d2740 1 -- start start 2024-09-12T02:58:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.376+0000 7febe83d2740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd421e0 0x55803bd398d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.377+0000 7febe83d2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd42b00 0x55803bd4ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.377+0000 7febe83d2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd4d3a0 0x55803bd44350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.377+0000 7febe83d2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7febe01acfa0 con 0x55803bd42b00 2024-09-12T02:58:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.377+0000 7febe83d2740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7febe01aedb0 con 0x55803bd421e0 2024-09-12T02:58:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.377+0000 7febe83d2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7febe01ad730 con 0x55803bd4d3a0 2024-09-12T02:58:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.377+0000 7febdf200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd4d3a0 0x55803bd44350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.377+0000 7febdde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd42b00 0x55803bd4ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.377+0000 7febdf200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd4d3a0 0x55803bd44350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:51608/0 (socket says 172.21.15.18:51608) 2024-09-12T02:58:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.377+0000 7febdf200640 1 -- 172.21.15.18:0/912309242 learned_addr learned my addr 172.21.15.18:0/912309242 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.378+0000 7febde800640 1 --2- 172.21.15.18:0/912309242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd421e0 0x55803bd398d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.378+0000 7febdf200640 1 -- 172.21.15.18:0/912309242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd421e0 msgr2=0x55803bd398d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:14.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.378+0000 7febdf200640 1 --2- 172.21.15.18:0/912309242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd421e0 0x55803bd398d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.378+0000 7febdf200640 1 -- 172.21.15.18:0/912309242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd42b00 msgr2=0x55803bd4ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:14.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.378+0000 7febdf200640 1 --2- 172.21.15.18:0/912309242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd42b00 0x55803bd4ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.378+0000 7febdf200640 1 -- 172.21.15.18:0/912309242 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55803bd3e580 con 0x55803bd4d3a0 2024-09-12T02:58:14.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.380+0000 7febdf200640 1 --2- 172.21.15.18:0/912309242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd4d3a0 0x55803bd44350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7febd8010680 tx=0x7febd8009d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b714a7367d8fdb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:14.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.380+0000 7febcaa00640 1 -- 172.21.15.18:0/912309242 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd8015040 con 0x55803bd4d3a0 2024-09-12T02:58:14.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.380+0000 7febcaa00640 1 -- 172.21.15.18:0/912309242 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febd8044020 con 0x55803bd4d3a0 2024-09-12T02:58:14.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.380+0000 7febcaa00640 1 -- 172.21.15.18:0/912309242 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd80050d0 con 0x55803bd4d3a0 2024-09-12T02:58:14.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.382+0000 7febe83d2740 1 -- 172.21.15.18:0/912309242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd4d3a0 msgr2=0x55803bd44350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:14.383 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.382+0000 7febe83d2740 1 --2- 172.21.15.18:0/912309242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd4d3a0 0x55803bd44350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7febd8010680 tx=0x7febd8009d40 comp rx=0 tx=0).stop 2024-09-12T02:58:14.383 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.382+0000 7febe83d2740 1 -- 172.21.15.18:0/912309242 shutdown_connections 2024-09-12T02:58:14.383 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.382+0000 7febe83d2740 1 --2- 172.21.15.18:0/912309242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd4d3a0 0x55803bd44350 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.383 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.382+0000 7febe83d2740 1 --2- 172.21.15.18:0/912309242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd42b00 0x55803bd4ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.383 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.382+0000 7febe83d2740 1 --2- 172.21.15.18:0/912309242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd421e0 0x55803bd398d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.383 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.382+0000 7febe83d2740 1 -- 172.21.15.18:0/912309242 >> 172.21.15.18:0/912309242 conn(0x55803bd3e750 msgr2=0x55803bd43c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.385+0000 7febe83d2740 1 -- 172.21.15.18:0/912309242 shutdown_connections 2024-09-12T02:58:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.385+0000 7febe83d2740 1 -- 172.21.15.18:0/912309242 wait complete. 2024-09-12T02:58:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.386+0000 7febe83d2740 1 -- start start 2024-09-12T02:58:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.386+0000 7febe83d2740 1 Processor -- start 2024-09-12T02:58:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.387+0000 7febe83d2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd421e0 0x55803bd47ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.388+0000 7febe83d2740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd42b00 0x55803bd553e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.388+0000 7febe83d2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd4d3a0 0x55803bd559d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.388+0000 7febe83d2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7febe01ae620 con 0x55803bd421e0 2024-09-12T02:58:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.388+0000 7febe83d2740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7febe01adec0 con 0x55803bd42b00 2024-09-12T02:58:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.388+0000 7febe83d2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7febe0073d30 con 0x55803bd4d3a0 2024-09-12T02:58:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.388+0000 7febe83d2740 10 client.0 _ll_register_callbacks cb 0x7febd0003ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:58:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.388+0000 7febdf200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd4d3a0 0x55803bd559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.388+0000 7febdf200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd4d3a0 0x55803bd559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:51616/0 (socket says 172.21.15.18:51616) 2024-09-12T02:58:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.388+0000 7febdf200640 1 -- 172.21.15.18:0/1288395836 learned_addr learned my addr 172.21.15.18:0/1288395836 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.389+0000 7febde800640 1 --2- 172.21.15.18:0/1288395836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd421e0 0x55803bd47ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.389+0000 7febdde00640 1 --2- 172.21.15.18:0/1288395836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd42b00 0x55803bd553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.389+0000 7febdf200640 1 -- 172.21.15.18:0/1288395836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd42b00 msgr2=0x55803bd553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.389+0000 7febdf200640 1 --2- 172.21.15.18:0/1288395836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd42b00 0x55803bd553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.389+0000 7febdf200640 1 -- 172.21.15.18:0/1288395836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd421e0 msgr2=0x55803bd47ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.389+0000 7febdf200640 1 --2- 172.21.15.18:0/1288395836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd421e0 0x55803bd47ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.389+0000 7febdf200640 1 -- 172.21.15.18:0/1288395836 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55803bd45030 con 0x55803bd4d3a0 2024-09-12T02:58:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.391+0000 7febdf200640 1 --2- 172.21.15.18:0/1288395836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd4d3a0 0x55803bd559d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7febd800fe10 tx=0x7febd8009990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ea3331fde568854 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.391+0000 7febbfe00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:58:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.392+0000 7febbfe00640 1 -- 172.21.15.18:0/1288395836 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd8015070 con 0x55803bd4d3a0 2024-09-12T02:58:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.392+0000 7febbfe00640 1 -- 172.21.15.18:0/1288395836 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9650+0+0 (secure 0 0 0) 0x7febd8031040 con 0x55803bd4d3a0 2024-09-12T02:58:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.392+0000 7febe83d2740 1 -- 172.21.15.18:0/1288395836 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febd8044020 con 0x55803bd4d3a0 2024-09-12T02:58:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.392+0000 7febbfe00640 1 -- 172.21.15.18:0/1288395836 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7febd8011440 con 0x55803bd4d3a0 2024-09-12T02:58:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.392+0000 7febe83d2740 10 client.25858 fetch_fsmap learned FSMap version 62 2024-09-12T02:58:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.392+0000 7febe83d2740 1 -- 172.21.15.18:0/1288395836 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55803bdc6de0 con 0x55803bd4d3a0 2024-09-12T02:58:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.393+0000 7febbfe00640 1 -- 172.21.15.18:0/1288395836 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febd8044020 con 0x55803bd4d3a0 2024-09-12T02:58:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.393+0000 7febbfe00640 1 -- 172.21.15.18:0/1288395836 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 62) ==== 8446+0+0 (secure 0 0 0) 0x7febd8011a40 con 0x55803bd4d3a0 2024-09-12T02:58:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.393+0000 7febe83d2740 10 client.25858 fetch_fsmap finished waiting for FSMap version 62 2024-09-12T02:58:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.393+0000 7febe83d2740 10 client.25858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:58:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.393+0000 7febe83d2740 20 client.25858 populate_metadata read hostname 'smithi018' 2024-09-12T02:58:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.393+0000 7febe83d2740 1 --2- 172.21.15.18:0/1288395836 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55803bdc7530 0x55803bdc9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.393+0000 7febe83d2740 4 client.25858 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:58:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.393+0000 7febe83d2740 1 -- 172.21.15.18:0/1288395836 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55803bcafb80 con 0x55803bdc7530 2024-09-12T02:58:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.394+0000 7febde800640 1 --2- 172.21.15.18:0/1288395836 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55803bdc7530 0x55803bdc9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.395+0000 7febde800640 1 --2- 172.21.15.18:0/1288395836 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55803bdc7530 0x55803bdc9950 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=133c61a6f56d04a8 server_cookie=661ac09ab44c6d23 in_seq=0 out_seq=0 2024-09-12T02:58:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.395+0000 7febbfe00640 10 client.25858 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:14.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.521+0000 7febbfe00640 1 -- 172.21.15.18:0/1288395836 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55803bcafb80 con 0x55803bdc7530 2024-09-12T02:58:14.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.521+0000 7febbfe00640 10 client.25858 handle_command_reply: tid=0 2024-09-12T02:58:14.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.522+0000 7febe83d2740 1 client.25858 shutdown 2024-09-12T02:58:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.523+0000 7febe83d2740 1 -- 172.21.15.18:0/1288395836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd4d3a0 msgr2=0x55803bd559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.523+0000 7febe83d2740 1 --2- 172.21.15.18:0/1288395836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd4d3a0 0x55803bd559d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7febd800fe10 tx=0x7febd8009990 comp rx=0 tx=0).stop 2024-09-12T02:58:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.524+0000 7febe83d2740 1 -- 172.21.15.18:0/1288395836 shutdown_connections 2024-09-12T02:58:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.524+0000 7febe83d2740 1 --2- 172.21.15.18:0/1288395836 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55803bdc7530 0x55803bdc9950 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.524+0000 7febe83d2740 1 --2- 172.21.15.18:0/1288395836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55803bd4d3a0 0x55803bd559d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.524+0000 7febe83d2740 1 --2- 172.21.15.18:0/1288395836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55803bd42b00 0x55803bd553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.524+0000 7febe83d2740 1 --2- 172.21.15.18:0/1288395836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803bd421e0 0x55803bd47ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.525+0000 7febe83d2740 1 -- 172.21.15.18:0/1288395836 >> 172.21.15.18:0/1288395836 conn(0x55803bd3e750 msgr2=0x55803bd58a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.525+0000 7febbfe00640 0 client.25858 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.525+0000 7febe83d2740 1 -- 172.21.15.18:0/1288395836 shutdown_connections 2024-09-12T02:58:14.527 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.525+0000 7febe83d2740 1 -- 172.21.15.18:0/1288395836 wait complete. 2024-09-12T02:58:14.527 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.525+0000 7febe83d2740 20 client.25858 trim_cache size 0 max 16384 2024-09-12T02:58:14.527 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:58:14.527 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:58:14.527 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:58:14.527 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:58:14.528 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.526+0000 7febe5400640 1 -- 172.21.15.18:0/584995865 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7febc40a2ea0 msgr2=0x7febc40a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:14.528 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.526+0000 7febe5400640 1 --2- 172.21.15.18:0/584995865 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7febc40a2ea0 0x7febc40a5360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7febe0079220 tx=0x7febcc009260 comp rx=0 tx=0).stop 2024-09-12T02:58:14.528 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.526+0000 7febe5400640 1 -- 172.21.15.18:0/584995865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febe0076720 msgr2=0x7febe01a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:14.528 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.526+0000 7febe5400640 1 --2- 172.21.15.18:0/584995865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febe0076720 0x7febe01a4610 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7febd0035040 tx=0x7febd0033d90 comp rx=0 tx=0).stop 2024-09-12T02:58:14.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.527+0000 7febe5400640 1 -- 172.21.15.18:0/584995865 shutdown_connections 2024-09-12T02:58:14.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.527+0000 7febe5400640 1 --2- 172.21.15.18:0/584995865 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7febc40a2ea0 0x7febc40a5360 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.527+0000 7febe5400640 1 --2- 172.21.15.18:0/584995865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febe0112960 0x7febe019e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.527+0000 7febe5400640 1 --2- 172.21.15.18:0/584995865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febe0077040 0x7febe01a4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.527+0000 7febe5400640 1 --2- 172.21.15.18:0/584995865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febe0076720 0x7febe01a4610 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.527+0000 7febe5400640 1 -- 172.21.15.18:0/584995865 >> 172.21.15.18:0/584995865 conn(0x7febe00ff980 msgr2=0x7febe0101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:14.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.527+0000 7febe5400640 1 -- 172.21.15.18:0/584995865 shutdown_connections 2024-09-12T02:58:14.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:14.527+0000 7febe5400640 1 -- 172.21.15.18:0/584995865 wait complete. 2024-09-12T02:58:15.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:14 smithi062 ceph-mon[35527]: pgmap v295: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 444 op/s 2024-09-12T02:58:15.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:14 smithi018 ceph-mon[30616]: pgmap v295: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 444 op/s 2024-09-12T02:58:15.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:14 smithi176 ceph-mon[35713]: pgmap v295: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 444 op/s 2024-09-12T02:58:17.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:16 smithi062 ceph-mon[35527]: pgmap v296: 129 pgs: 17 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 56 active+clean; 2.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 439 op/s 2024-09-12T02:58:17.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:16 smithi018 ceph-mon[30616]: pgmap v296: 129 pgs: 17 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 56 active+clean; 2.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 439 op/s 2024-09-12T02:58:17.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:16 smithi176 ceph-mon[35713]: pgmap v296: 129 pgs: 17 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 56 active+clean; 2.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 439 op/s 2024-09-12T02:58:19.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:18 smithi062 ceph-mon[35527]: pgmap v297: 129 pgs: 17 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 56 active+clean; 2.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 161 op/s 2024-09-12T02:58:19.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:18 smithi018 ceph-mon[30616]: pgmap v297: 129 pgs: 17 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 56 active+clean; 2.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 161 op/s 2024-09-12T02:58:19.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:18 smithi176 ceph-mon[35713]: pgmap v297: 129 pgs: 17 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 56 active+clean; 2.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 161 op/s 2024-09-12T02:58:21.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:20 smithi018 ceph-mon[30616]: pgmap v298: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 222 op/s 2024-09-12T02:58:21.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:20 smithi176 ceph-mon[35713]: pgmap v298: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 222 op/s 2024-09-12T02:58:21.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:20 smithi062 ceph-mon[35527]: pgmap v298: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 222 op/s 2024-09-12T02:58:23.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:22 smithi018 ceph-mon[30616]: pgmap v299: 129 pgs: 11 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 84 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 200 op/s 2024-09-12T02:58:23.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:22 smithi176 ceph-mon[35713]: pgmap v299: 129 pgs: 11 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 84 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 200 op/s 2024-09-12T02:58:23.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:22 smithi062 ceph-mon[35527]: pgmap v299: 129 pgs: 11 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 84 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 200 op/s 2024-09-12T02:58:25.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:24 smithi018 ceph-mon[30616]: pgmap v300: 129 pgs: 11 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 84 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 170 op/s 2024-09-12T02:58:25.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:24 smithi176 ceph-mon[35713]: pgmap v300: 129 pgs: 11 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 84 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 170 op/s 2024-09-12T02:58:25.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:24 smithi062 ceph-mon[35527]: pgmap v300: 129 pgs: 11 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 84 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 170 op/s 2024-09-12T02:58:27.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:26 smithi018 ceph-mon[30616]: pgmap v301: 129 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 110 active+clean; 2.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 275 op/s 2024-09-12T02:58:27.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:26 smithi176 ceph-mon[35713]: pgmap v301: 129 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 110 active+clean; 2.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 275 op/s 2024-09-12T02:58:27.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:26 smithi062 ceph-mon[35527]: pgmap v301: 129 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 110 active+clean; 2.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 275 op/s 2024-09-12T02:58:27.726 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.723+0000 7f0947800640 1 -- 172.21.15.18:0/1924448306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0940103f30 msgr2=0x7f0940104310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.723+0000 7f0947800640 1 --2- 172.21.15.18:0/1924448306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0940103f30 0x7f0940104310 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0934009860 tx=0x7f093402a340 comp rx=0 tx=0).stop 2024-09-12T02:58:27.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.724+0000 7f0947800640 1 -- 172.21.15.18:0/1924448306 shutdown_connections 2024-09-12T02:58:27.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.724+0000 7f0947800640 1 --2- 172.21.15.18:0/1924448306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0940109080 0x7f0940110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.724+0000 7f0947800640 1 --2- 172.21.15.18:0/1924448306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09401048e0 0x7f0940108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.727 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.725+0000 7f0947800640 1 --2- 172.21.15.18:0/1924448306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0940103f30 0x7f0940104310 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.725+0000 7f0947800640 1 -- 172.21.15.18:0/1924448306 >> 172.21.15.18:0/1924448306 conn(0x7f09400ff980 msgr2=0x7f0940101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:27.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.727+0000 7f0947800640 1 -- 172.21.15.18:0/1924448306 shutdown_connections 2024-09-12T02:58:27.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.727+0000 7f0947800640 1 -- 172.21.15.18:0/1924448306 wait complete. 2024-09-12T02:58:27.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.728+0000 7f0947800640 1 Processor -- start 2024-09-12T02:58:27.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.729+0000 7f0947800640 1 -- start start 2024-09-12T02:58:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.729+0000 7f0947800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0940103f30 0x7f0940073940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.729+0000 7f0947800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0940109080 0x7f0940073e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.729+0000 7f0947800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094006cad0 0x7f094006cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.729+0000 7f0947800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f09401140b0 con 0x7f0940103f30 2024-09-12T02:58:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.729+0000 7f0947800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0940113f30 con 0x7f094006cad0 2024-09-12T02:58:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.729+0000 7f0947800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0940114230 con 0x7f0940109080 2024-09-12T02:58:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.730+0000 7f0944e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0940103f30 0x7f0940073940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.730+0000 7f093fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0940109080 0x7f0940073e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.730+0000 7f093fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0940109080 0x7f0940073e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:34402/0 (socket says 172.21.15.18:34402) 2024-09-12T02:58:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.730+0000 7f093fe00640 1 -- 172.21.15.18:0/3847442995 learned_addr learned my addr 172.21.15.18:0/3847442995 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.730+0000 7f0944e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0940103f30 0x7f0940073940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49228/0 (socket says 172.21.15.18:49228) 2024-09-12T02:58:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.730+0000 7f0945800640 1 --2- 172.21.15.18:0/3847442995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094006cad0 0x7f094006cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.731+0000 7f093fe00640 1 -- 172.21.15.18:0/3847442995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094006cad0 msgr2=0x7f094006cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.731+0000 7f093fe00640 1 --2- 172.21.15.18:0/3847442995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094006cad0 0x7f094006cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.731+0000 7f093fe00640 1 -- 172.21.15.18:0/3847442995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0940103f30 msgr2=0x7f0940073940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.731+0000 7f093fe00640 1 --2- 172.21.15.18:0/3847442995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0940103f30 0x7f0940073940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.731+0000 7f093fe00640 1 -- 172.21.15.18:0/3847442995 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0940071460 con 0x7f0940109080 2024-09-12T02:58:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.732+0000 7f093fe00640 1 --2- 172.21.15.18:0/3847442995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0940109080 0x7f0940073e80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f092c00e9f0 tx=0x7f092c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.733+0000 7f093d600640 1 -- 172.21.15.18:0/3847442995 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c00ccc0 con 0x7f0940109080 2024-09-12T02:58:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.733+0000 7f093d600640 1 -- 172.21.15.18:0/3847442995 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f092c010910 con 0x7f0940109080 2024-09-12T02:58:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.733+0000 7f093d600640 1 -- 172.21.15.18:0/3847442995 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c018960 con 0x7f0940109080 2024-09-12T02:58:27.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.733+0000 7f0947800640 1 -- 172.21.15.18:0/3847442995 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09400716f0 con 0x7f0940109080 2024-09-12T02:58:27.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.734+0000 7f0947800640 1 -- 172.21.15.18:0/3847442995 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0940071bf0 con 0x7f0940109080 2024-09-12T02:58:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.738+0000 7f094a66f740 1 Processor -- start 2024-09-12T02:58:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.739+0000 7f093d600640 1 -- 172.21.15.18:0/3847442995 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f092c018b00 con 0x7f0940109080 2024-09-12T02:58:27.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.740+0000 7f094a66f740 1 -- start start 2024-09-12T02:58:27.744 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.740+0000 7f094a66f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f30d1e0 0x55780f30d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.744 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.740+0000 7f094a66f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f30db00 0x55780f317e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.744 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.740+0000 7f094a66f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f3183a0 0x55780f31a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.740+0000 7f094a66f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55780f273100 con 0x55780f3183a0 2024-09-12T02:58:27.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.740+0000 7f094a66f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55780f21b1b0 con 0x55780f30d1e0 2024-09-12T02:58:27.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.740+0000 7f094a66f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55780f26f0c0 con 0x55780f30db00 2024-09-12T02:58:27.745 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.741+0000 7f0944e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f30db00 0x55780f317e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.741+0000 7f0944e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f30db00 0x55780f317e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:34418/0 (socket says 172.21.15.18:34418) 2024-09-12T02:58:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.741+0000 7f0944e00640 1 -- 172.21.15.18:0/3025989295 learned_addr learned my addr 172.21.15.18:0/3025989295 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.741+0000 7f0945800640 1 --2- 172.21.15.18:0/3025989295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f30d1e0 0x55780f30d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.741+0000 7f093fe00640 1 --2- 172.21.15.18:0/3025989295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f3183a0 0x55780f31a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.741+0000 7f0945800640 1 -- 172.21.15.18:0/3025989295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f30db00 msgr2=0x55780f317e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.741+0000 7f0945800640 1 --2- 172.21.15.18:0/3025989295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f30db00 0x55780f317e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.741+0000 7f0945800640 1 -- 172.21.15.18:0/3025989295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f3183a0 msgr2=0x55780f31a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.742+0000 7f0945800640 1 --2- 172.21.15.18:0/3025989295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f3183a0 0x55780f31a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.742+0000 7f0945800640 1 -- 172.21.15.18:0/3025989295 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55780ef86210 con 0x55780f30d1e0 2024-09-12T02:58:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.741+0000 7f093d600640 1 --2- 172.21.15.18:0/3847442995 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f09280a2f00 0x7f09280a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.743+0000 7f093d600640 1 -- 172.21.15.18:0/3847442995 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9650+0+0 (secure 0 0 0) 0x7f092c0cfb30 con 0x7f0940109080 2024-09-12T02:58:27.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.745+0000 7f0945800640 1 --2- 172.21.15.18:0/3847442995 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f09280a2f00 0x7f09280a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.746+0000 7f0945800640 1 --2- 172.21.15.18:0/3025989295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f30d1e0 0x55780f30d5c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0938009eb0 tx=0x7f0938010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59c78b76100d14cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:27.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.746+0000 7f0932000640 1 -- 172.21.15.18:0/3025989295 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938022070 con 0x55780f30d1e0 2024-09-12T02:58:27.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.747+0000 7f0932000640 1 -- 172.21.15.18:0/3025989295 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f093801c410 con 0x55780f30d1e0 2024-09-12T02:58:27.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.747+0000 7f0932000640 1 -- 172.21.15.18:0/3025989295 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938016070 con 0x55780f30d1e0 2024-09-12T02:58:27.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.748+0000 7f094a66f740 1 -- 172.21.15.18:0/3025989295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f30d1e0 msgr2=0x55780f30d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.748+0000 7f094a66f740 1 --2- 172.21.15.18:0/3025989295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f30d1e0 0x55780f30d5c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0938009eb0 tx=0x7f0938010740 comp rx=0 tx=0).stop 2024-09-12T02:58:27.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.748+0000 7f0945800640 1 --2- 172.21.15.18:0/3847442995 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f09280a2f00 0x7f09280a53c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0938011010 tx=0x7f0938011c70 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:27.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.748+0000 7f094a66f740 1 -- 172.21.15.18:0/3025989295 shutdown_connections 2024-09-12T02:58:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.748+0000 7f094a66f740 1 --2- 172.21.15.18:0/3025989295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f3183a0 0x55780f31a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.748+0000 7f094a66f740 1 --2- 172.21.15.18:0/3025989295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f30db00 0x55780f317e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.748+0000 7f094a66f740 1 --2- 172.21.15.18:0/3025989295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f30d1e0 0x55780f30d5c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.748+0000 7f094a66f740 1 -- 172.21.15.18:0/3025989295 >> 172.21.15.18:0/3025989295 conn(0x55780f309750 msgr2=0x55780f309b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.749+0000 7f094a66f740 1 -- 172.21.15.18:0/3025989295 shutdown_connections 2024-09-12T02:58:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.749+0000 7f094a66f740 1 -- 172.21.15.18:0/3025989295 wait complete. 2024-09-12T02:58:27.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.750+0000 7f094a66f740 1 -- start start 2024-09-12T02:58:27.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.750+0000 7f094a66f740 1 Processor -- start 2024-09-12T02:58:27.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.751+0000 7f094a66f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f30d1e0 0x55780f3152c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.751+0000 7f094a66f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f30db00 0x55780f315800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.751+0000 7f094a66f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f3183a0 0x55780f315d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.751+0000 7f094a66f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55780f31af70 con 0x55780f30d1e0 2024-09-12T02:58:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.751+0000 7f094a66f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55780f1fc090 con 0x55780f30db00 2024-09-12T02:58:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.751+0000 7f094a66f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55780f31b0f0 con 0x55780f3183a0 2024-09-12T02:58:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.751+0000 7f0944e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f30d1e0 0x55780f3152c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.752+0000 7f093fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f30db00 0x55780f315800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.752+0000 7f093fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f30db00 0x55780f315800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:45624/0 (socket says 172.21.15.18:45624) 2024-09-12T02:58:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.752+0000 7f093fe00640 1 -- 172.21.15.18:0/4118786016 learned_addr learned my addr 172.21.15.18:0/4118786016 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.752+0000 7f094a66f740 10 client.0 _ll_register_callbacks cb 0x55780f250f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:58:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.752+0000 7f0945800640 1 --2- 172.21.15.18:0/4118786016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f3183a0 0x55780f315d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.753+0000 7f0945800640 1 -- 172.21.15.18:0/4118786016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f30db00 msgr2=0x55780f315800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:27.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.753+0000 7f0945800640 1 --2- 172.21.15.18:0/4118786016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f30db00 0x55780f315800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.753+0000 7f0945800640 1 -- 172.21.15.18:0/4118786016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f30d1e0 msgr2=0x55780f3152c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:27.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.753+0000 7f0945800640 1 --2- 172.21.15.18:0/4118786016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f30d1e0 0x55780f3152c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.753+0000 7f0945800640 1 -- 172.21.15.18:0/4118786016 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55780f052620 con 0x55780f3183a0 2024-09-12T02:58:27.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.753+0000 7f093fe00640 1 --2- 172.21.15.18:0/4118786016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f30db00 0x55780f315800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:27.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.754+0000 7f0945800640 1 --2- 172.21.15.18:0/4118786016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f3183a0 0x55780f315d40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0938006010 tx=0x7f0938015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53fd616e701b1231 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:27.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.755+0000 7f0926a00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:58:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.755+0000 7f0926a00640 1 -- 172.21.15.18:0/4118786016 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938036060 con 0x55780f3183a0 2024-09-12T02:58:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.755+0000 7f0926a00640 1 -- 172.21.15.18:0/4118786016 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9650+0+0 (secure 0 0 0) 0x7f093801c5c0 con 0x55780f3183a0 2024-09-12T02:58:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.755+0000 7f094a66f740 1 -- 172.21.15.18:0/4118786016 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f093801c410 con 0x55780f3183a0 2024-09-12T02:58:27.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.756+0000 7f0926a00640 1 -- 172.21.15.18:0/4118786016 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f0938022040 con 0x55780f3183a0 2024-09-12T02:58:27.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.756+0000 7f094a66f740 10 client.25870 fetch_fsmap learned FSMap version 62 2024-09-12T02:58:27.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.756+0000 7f094a66f740 1 -- 172.21.15.18:0/4118786016 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55780f32f340 con 0x55780f3183a0 2024-09-12T02:58:27.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.757+0000 7f0926a00640 1 -- 172.21.15.18:0/4118786016 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f093801c410 con 0x55780f3183a0 2024-09-12T02:58:27.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.757+0000 7f0926a00640 1 -- 172.21.15.18:0/4118786016 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 62) ==== 8446+0+0 (secure 0 0 0) 0x7f093800f040 con 0x55780f3183a0 2024-09-12T02:58:27.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.757+0000 7f094a66f740 10 client.25870 fetch_fsmap finished waiting for FSMap version 62 2024-09-12T02:58:27.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.757+0000 7f094a66f740 10 client.25870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:58:27.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.757+0000 7f094a66f740 20 client.25870 populate_metadata read hostname 'smithi018' 2024-09-12T02:58:27.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.758+0000 7f094a66f740 1 --2- 172.21.15.18:0/4118786016 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55780f3307b0 0x55780f332ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.758+0000 7f094a66f740 4 client.25870 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:58:27.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.758+0000 7f094a66f740 1 -- 172.21.15.18:0/4118786016 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55780f280830 con 0x55780f3307b0 2024-09-12T02:58:27.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.759+0000 7f0944e00640 1 --2- 172.21.15.18:0/4118786016 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55780f3307b0 0x55780f332ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.760+0000 7f0944e00640 1 --2- 172.21.15.18:0/4118786016 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55780f3307b0 0x55780f332ba0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97a48c5689633b98 server_cookie=637855a8d49faa7b in_seq=0 out_seq=0 2024-09-12T02:58:27.768 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.760+0000 7f0926a00640 10 client.25870 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:27.768 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.761+0000 7f0926a00640 1 -- 172.21.15.18:0/4118786016 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55780f280830 con 0x55780f3307b0 2024-09-12T02:58:27.768 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.761+0000 7f0926a00640 10 client.25870 handle_command_reply: tid=0 2024-09-12T02:58:27.768 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.761+0000 7f094a66f740 1 client.25870 shutdown 2024-09-12T02:58:27.768 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.762+0000 7f094a66f740 1 -- 172.21.15.18:0/4118786016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f3183a0 msgr2=0x55780f315d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.768 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.762+0000 7f094a66f740 1 --2- 172.21.15.18:0/4118786016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f3183a0 0x55780f315d40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0938006010 tx=0x7f0938015000 comp rx=0 tx=0).stop 2024-09-12T02:58:27.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.765+0000 7f094a66f740 1 -- 172.21.15.18:0/4118786016 shutdown_connections 2024-09-12T02:58:27.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.765+0000 7f094a66f740 1 --2- 172.21.15.18:0/4118786016 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55780f3307b0 0x55780f332ba0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.765+0000 7f094a66f740 1 --2- 172.21.15.18:0/4118786016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f3183a0 0x55780f315d40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.765+0000 7f094a66f740 1 --2- 172.21.15.18:0/4118786016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f30db00 0x55780f315800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.765+0000 7f094a66f740 1 --2- 172.21.15.18:0/4118786016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f30d1e0 0x55780f3152c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.765+0000 7f0926a00640 0 client.25870 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.765+0000 7f094a66f740 1 -- 172.21.15.18:0/4118786016 >> 172.21.15.18:0/4118786016 conn(0x55780f309750 msgr2=0x55780f30f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.768+0000 7f094a66f740 1 -- 172.21.15.18:0/4118786016 shutdown_connections 2024-09-12T02:58:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.768+0000 7f094a66f740 1 -- 172.21.15.18:0/4118786016 wait complete. 2024-09-12T02:58:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.768+0000 7f094a66f740 20 client.25870 trim_cache size 0 max 16384 2024-09-12T02:58:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.804+0000 7f094a66f740 1 Processor -- start 2024-09-12T02:58:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.804+0000 7f094a66f740 1 -- start start 2024-09-12T02:58:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.805+0000 7f094a66f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f30d1e0 0x55780f3382e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.805+0000 7f094a66f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f30db00 0x55780f338820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.805+0000 7f094a66f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f3183a0 0x55780f30ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.805+0000 7f094a66f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f09401b58b0 con 0x55780f30db00 2024-09-12T02:58:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.805+0000 7f094a66f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f09401b76c0 con 0x55780f3183a0 2024-09-12T02:58:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.805+0000 7f094a66f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f09401b6040 con 0x55780f30d1e0 2024-09-12T02:58:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.805+0000 7f0944e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f30d1e0 0x55780f3382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.805+0000 7f0944e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f30d1e0 0x55780f3382e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:34444/0 (socket says 172.21.15.18:34444) 2024-09-12T02:58:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.805+0000 7f0945800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f3183a0 0x55780f30ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.805+0000 7f0944e00640 1 -- 172.21.15.18:0/2873327649 learned_addr learned my addr 172.21.15.18:0/2873327649 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.806+0000 7f093fe00640 1 --2- 172.21.15.18:0/2873327649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f30db00 0x55780f338820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.806+0000 7f0944e00640 1 -- 172.21.15.18:0/2873327649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f3183a0 msgr2=0x55780f30ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.806+0000 7f0944e00640 1 --2- 172.21.15.18:0/2873327649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f3183a0 0x55780f30ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.806+0000 7f0944e00640 1 -- 172.21.15.18:0/2873327649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f30db00 msgr2=0x55780f338820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.806+0000 7f0944e00640 1 --2- 172.21.15.18:0/2873327649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f30db00 0x55780f338820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.806+0000 7f0944e00640 1 -- 172.21.15.18:0/2873327649 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55780f30cf60 con 0x55780f30d1e0 2024-09-12T02:58:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.807+0000 7f0944e00640 1 --2- 172.21.15.18:0/2873327649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f30d1e0 0x55780f3382e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0934009830 tx=0x7f0934005ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6da651cf4df28d33 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.808+0000 7f0931600640 1 -- 172.21.15.18:0/2873327649 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0934037040 con 0x55780f30d1e0 2024-09-12T02:58:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.808+0000 7f0931600640 1 -- 172.21.15.18:0/2873327649 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0934004250 con 0x55780f30d1e0 2024-09-12T02:58:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.808+0000 7f0931600640 1 -- 172.21.15.18:0/2873327649 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09340046c0 con 0x55780f30d1e0 2024-09-12T02:58:27.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.809+0000 7f094a66f740 1 -- 172.21.15.18:0/2873327649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f30d1e0 msgr2=0x55780f3382e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.809+0000 7f094a66f740 1 --2- 172.21.15.18:0/2873327649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f30d1e0 0x55780f3382e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0934009830 tx=0x7f0934005ad0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.810+0000 7f094a66f740 1 -- 172.21.15.18:0/2873327649 shutdown_connections 2024-09-12T02:58:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.810+0000 7f094a66f740 1 --2- 172.21.15.18:0/2873327649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f3183a0 0x55780f30ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.810+0000 7f094a66f740 1 --2- 172.21.15.18:0/2873327649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f30db00 0x55780f338820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.810+0000 7f094a66f740 1 --2- 172.21.15.18:0/2873327649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f30d1e0 0x55780f3382e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.810+0000 7f094a66f740 1 -- 172.21.15.18:0/2873327649 >> 172.21.15.18:0/2873327649 conn(0x55780f309750 msgr2=0x55780f3143d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.810+0000 7f094a66f740 1 -- 172.21.15.18:0/2873327649 shutdown_connections 2024-09-12T02:58:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.810+0000 7f094a66f740 1 -- 172.21.15.18:0/2873327649 wait complete. 2024-09-12T02:58:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.811+0000 7f094a66f740 1 -- start start 2024-09-12T02:58:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.811+0000 7f094a66f740 1 Processor -- start 2024-09-12T02:58:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.813+0000 7f094a66f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f30d1e0 0x55780f328fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.814+0000 7f094a66f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f30db00 0x55780f311d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.814+0000 7f094a66f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f3183a0 0x55780f3122c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.814+0000 7f094a66f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f09401b6f30 con 0x55780f3183a0 2024-09-12T02:58:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.814+0000 7f094a66f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f09401b67d0 con 0x55780f30d1e0 2024-09-12T02:58:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.814+0000 7f094a66f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f09401b3910 con 0x55780f30db00 2024-09-12T02:58:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.814+0000 7f094a66f740 10 client.0 _ll_register_callbacks cb 0x7f0938020070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:58:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.815+0000 7f0945800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f3183a0 0x55780f3122c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.815+0000 7f0945800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f3183a0 0x55780f3122c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49266/0 (socket says 172.21.15.18:49266) 2024-09-12T02:58:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.815+0000 7f0945800640 1 -- 172.21.15.18:0/3089131872 learned_addr learned my addr 172.21.15.18:0/3089131872 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.815+0000 7f0945800640 1 -- 172.21.15.18:0/3089131872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f30db00 msgr2=0x55780f311d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:58:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.815+0000 7f0945800640 1 --2- 172.21.15.18:0/3089131872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f30db00 0x55780f311d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.815+0000 7f0945800640 1 -- 172.21.15.18:0/3089131872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f30d1e0 msgr2=0x55780f328fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:58:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.815+0000 7f0945800640 1 --2- 172.21.15.18:0/3089131872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f30d1e0 0x55780f328fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.815+0000 7f0945800640 1 -- 172.21.15.18:0/3089131872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55780f312800 con 0x55780f3183a0 2024-09-12T02:58:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.816+0000 7f0945800640 1 --2- 172.21.15.18:0/3089131872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f3183a0 0x55780f3122c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f093801b740 tx=0x7f0938009b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80149977907ed1f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.816+0000 7f0926a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T02:58:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.816+0000 7f0926a00640 1 -- 172.21.15.18:0/3089131872 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938016040 con 0x55780f3183a0 2024-09-12T02:58:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.816+0000 7f0926a00640 1 -- 172.21.15.18:0/3089131872 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9650+0+0 (secure 0 0 0) 0x7f0938009600 con 0x55780f3183a0 2024-09-12T02:58:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.816+0000 7f094a66f740 1 -- 172.21.15.18:0/3089131872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0934004250 con 0x55780f3183a0 2024-09-12T02:58:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.817+0000 7f0926a00640 1 -- 172.21.15.18:0/3089131872 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f0938036040 con 0x55780f3183a0 2024-09-12T02:58:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.817+0000 7f094a66f740 10 client.15873 fetch_fsmap learned FSMap version 62 2024-09-12T02:58:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.817+0000 7f094a66f740 1 -- 172.21.15.18:0/3089131872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55780f31b300 con 0x55780f3183a0 2024-09-12T02:58:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.818+0000 7f0926a00640 1 -- 172.21.15.18:0/3089131872 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0934004250 con 0x55780f3183a0 2024-09-12T02:58:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.818+0000 7f0926a00640 1 -- 172.21.15.18:0/3089131872 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 62) ==== 8446+0+0 (secure 0 0 0) 0x7f0938003a00 con 0x55780f3183a0 2024-09-12T02:58:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.818+0000 7f094a66f740 10 client.15873 fetch_fsmap finished waiting for FSMap version 62 2024-09-12T02:58:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.818+0000 7f094a66f740 10 client.15873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:58:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.818+0000 7f094a66f740 20 client.15873 populate_metadata read hostname 'smithi018' 2024-09-12T02:58:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.818+0000 7f094a66f740 1 --2- 172.21.15.18:0/3089131872 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55780f31bac0 0x55780f31df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.818+0000 7f094a66f740 4 client.15873 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:58:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.818+0000 7f094a66f740 1 -- 172.21.15.18:0/3089131872 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55780f27ab80 con 0x55780f31bac0 2024-09-12T02:58:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.818+0000 7f0944e00640 1 --2- 172.21.15.18:0/3089131872 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55780f31bac0 0x55780f31df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.819+0000 7f0926a00640 10 client.15873 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.821+0000 7f0944e00640 1 --2- 172.21.15.18:0/3089131872 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55780f31bac0 0x55780f31df40 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe8f9cf292d78e7f server_cookie=12f57e901aba9ab9 in_seq=0 out_seq=0 2024-09-12T02:58:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.841+0000 7f0926a00640 1 -- 172.21.15.18:0/3089131872 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55780f27ab80 con 0x55780f31bac0 2024-09-12T02:58:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.841+0000 7f0926a00640 10 client.15873 handle_command_reply: tid=0 2024-09-12T02:58:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.842+0000 7f094a66f740 1 client.15873 shutdown 2024-09-12T02:58:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.842+0000 7f094a66f740 1 -- 172.21.15.18:0/3089131872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f3183a0 msgr2=0x55780f3122c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.842+0000 7f094a66f740 1 --2- 172.21.15.18:0/3089131872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f3183a0 0x55780f3122c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f093801b740 tx=0x7f0938009b10 comp rx=0 tx=0).stop 2024-09-12T02:58:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.842+0000 7f094a66f740 1 -- 172.21.15.18:0/3089131872 shutdown_connections 2024-09-12T02:58:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.842+0000 7f094a66f740 1 --2- 172.21.15.18:0/3089131872 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55780f31bac0 0x55780f31df40 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.842+0000 7f094a66f740 1 --2- 172.21.15.18:0/3089131872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55780f3183a0 0x55780f3122c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.842+0000 7f094a66f740 1 --2- 172.21.15.18:0/3089131872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55780f30db00 0x55780f311d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.842+0000 7f094a66f740 1 --2- 172.21.15.18:0/3089131872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55780f30d1e0 0x55780f328fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.842+0000 7f094a66f740 1 -- 172.21.15.18:0/3089131872 >> 172.21.15.18:0/3089131872 conn(0x55780f309750 msgr2=0x55780f315280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.843+0000 7f0926a00640 0 client.15873 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.843+0000 7f094a66f740 1 -- 172.21.15.18:0/3089131872 shutdown_connections 2024-09-12T02:58:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.843+0000 7f094a66f740 1 -- 172.21.15.18:0/3089131872 wait complete. 2024-09-12T02:58:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.844+0000 7f094a66f740 20 client.15873 trim_cache size 0 max 16384 2024-09-12T02:58:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:58:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:58:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:58:27.846 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:58:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.845+0000 7f0947800640 1 -- 172.21.15.18:0/3847442995 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f09280a2f00 msgr2=0x7f09280a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.845+0000 7f0947800640 1 --2- 172.21.15.18:0/3847442995 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f09280a2f00 0x7f09280a53c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0938011010 tx=0x7f0938011c70 comp rx=0 tx=0).stop 2024-09-12T02:58:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.845+0000 7f0947800640 1 -- 172.21.15.18:0/3847442995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0940109080 msgr2=0x7f0940073e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.845+0000 7f0947800640 1 --2- 172.21.15.18:0/3847442995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0940109080 0x7f0940073e80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f092c00e9f0 tx=0x7f092c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.845+0000 7f0947800640 1 -- 172.21.15.18:0/3847442995 shutdown_connections 2024-09-12T02:58:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.845+0000 7f0947800640 1 --2- 172.21.15.18:0/3847442995 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f09280a2f00 0x7f09280a53c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.845+0000 7f0947800640 1 --2- 172.21.15.18:0/3847442995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094006cad0 0x7f094006cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.845+0000 7f0947800640 1 --2- 172.21.15.18:0/3847442995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0940109080 0x7f0940073e80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.845+0000 7f0947800640 1 --2- 172.21.15.18:0/3847442995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0940103f30 0x7f0940073940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.845+0000 7f0947800640 1 -- 172.21.15.18:0/3847442995 >> 172.21.15.18:0/3847442995 conn(0x7f09400ff980 msgr2=0x7f0940100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.846+0000 7f0947800640 1 -- 172.21.15.18:0/3847442995 shutdown_connections 2024-09-12T02:58:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:27.847+0000 7f0947800640 1 -- 172.21.15.18:0/3847442995 wait complete. 2024-09-12T02:58:29.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:28 smithi018 ceph-mon[30616]: pgmap v302: 129 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 110 active+clean; 2.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 214 op/s 2024-09-12T02:58:29.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:28 smithi176 ceph-mon[35713]: pgmap v302: 129 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 110 active+clean; 2.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 214 op/s 2024-09-12T02:58:29.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:28 smithi062 ceph-mon[35527]: pgmap v302: 129 pgs: 6 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 110 active+clean; 2.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 214 op/s 2024-09-12T02:58:31.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:30 smithi018 ceph-mon[30616]: pgmap v303: 129 pgs: 5 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 111 active+clean; 2.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 323 op/s 2024-09-12T02:58:31.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:30 smithi176 ceph-mon[35713]: pgmap v303: 129 pgs: 5 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 111 active+clean; 2.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 323 op/s 2024-09-12T02:58:31.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:30 smithi062 ceph-mon[35527]: pgmap v303: 129 pgs: 5 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 111 active+clean; 2.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 323 op/s 2024-09-12T02:58:33.085 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:32 smithi062 ceph-mon[35527]: pgmap v304: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 346 op/s 2024-09-12T02:58:33.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:32 smithi018 ceph-mon[30616]: pgmap v304: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 346 op/s 2024-09-12T02:58:33.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:32 smithi176 ceph-mon[35713]: pgmap v304: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 346 op/s 2024-09-12T02:58:35.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:34 smithi018 ceph-mon[30616]: pgmap v305: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 311 op/s 2024-09-12T02:58:35.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:34 smithi176 ceph-mon[35713]: pgmap v305: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 311 op/s 2024-09-12T02:58:35.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:34 smithi062 ceph-mon[35527]: pgmap v305: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 311 op/s 2024-09-12T02:58:37.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:36 smithi018 ceph-mon[30616]: pgmap v306: 129 pgs: 129 active+clean; 2.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 438 op/s 2024-09-12T02:58:37.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:36 smithi018 ceph-mon[30616]: osdmap e107: 12 total, 12 up, 12 in 2024-09-12T02:58:37.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:36 smithi176 ceph-mon[35713]: pgmap v306: 129 pgs: 129 active+clean; 2.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 438 op/s 2024-09-12T02:58:37.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:36 smithi176 ceph-mon[35713]: osdmap e107: 12 total, 12 up, 12 in 2024-09-12T02:58:37.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:36 smithi062 ceph-mon[35527]: pgmap v306: 129 pgs: 129 active+clean; 2.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 438 op/s 2024-09-12T02:58:37.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:36 smithi062 ceph-mon[35527]: osdmap e107: 12 total, 12 up, 12 in 2024-09-12T02:58:39.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:38 smithi018 ceph-mon[30616]: pgmap v308: 129 pgs: 129 active+clean; 2.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 400 op/s 2024-09-12T02:58:39.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:38 smithi176 ceph-mon[35713]: pgmap v308: 129 pgs: 129 active+clean; 2.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 400 op/s 2024-09-12T02:58:39.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:38 smithi062 ceph-mon[35527]: pgmap v308: 129 pgs: 129 active+clean; 2.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 400 op/s 2024-09-12T02:58:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.982+0000 7fb1d3e00640 1 -- 172.21.15.18:0/2654019558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1d4109b10 msgr2=0x7fb1d4114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.982+0000 7fb1d3e00640 1 --2- 172.21.15.18:0/2654019558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1d4109b10 0x7fb1d4114570 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009890 tx=0x7fb1c002a360 comp rx=0 tx=0).stop 2024-09-12T02:58:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.983+0000 7fb1d3e00640 1 -- 172.21.15.18:0/2654019558 shutdown_connections 2024-09-12T02:58:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.983+0000 7fb1d3e00640 1 --2- 172.21.15.18:0/2654019558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1d4114ab0 0x7fb1d4116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.983+0000 7fb1d3e00640 1 --2- 172.21.15.18:0/2654019558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1d4109b10 0x7fb1d4114570 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.983+0000 7fb1d3e00640 1 --2- 172.21.15.18:0/2654019558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1d41091f0 0x7fb1d41095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.983+0000 7fb1d3e00640 1 -- 172.21.15.18:0/2654019558 >> 172.21.15.18:0/2654019558 conn(0x7fb1d406cbf0 msgr2=0x7fb1d406d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.985+0000 7fb1d3e00640 1 -- 172.21.15.18:0/2654019558 shutdown_connections 2024-09-12T02:58:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.987+0000 7fb1d3e00640 1 -- 172.21.15.18:0/2654019558 wait complete. 2024-09-12T02:58:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.989+0000 7fb1d3e00640 1 Processor -- start 2024-09-12T02:58:40.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.990+0000 7fb1d3e00640 1 -- start start 2024-09-12T02:58:40.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.991+0000 7fb1d3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1d41091f0 0x7fb1d41a6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:40.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.991+0000 7fb1d3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1d4109b10 0x7fb1d41a6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:40.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.991+0000 7fb1d3e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1d4114ab0 0x7fb1d41a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:40.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.991+0000 7fb1d3e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d411a4e0 con 0x7fb1d41091f0 2024-09-12T02:58:40.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.991+0000 7fb1d3e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d411a360 con 0x7fb1d4109b10 2024-09-12T02:58:40.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.991+0000 7fb1d3e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d411a660 con 0x7fb1d4114ab0 2024-09-12T02:58:40.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.991+0000 7fb1d2000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1d4109b10 0x7fb1d41a6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:40.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.991+0000 7fb1d2000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1d4109b10 0x7fb1d41a6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:36270/0 (socket says 172.21.15.18:36270) 2024-09-12T02:58:40.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.991+0000 7fb1d2000640 1 -- 172.21.15.18:0/2065917620 learned_addr learned my addr 172.21.15.18:0/2065917620 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:40.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.991+0000 7fb1d2a00640 1 --2- 172.21.15.18:0/2065917620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1d41091f0 0x7fb1d41a6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:40.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.992+0000 7fb1d2000640 1 -- 172.21.15.18:0/2065917620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1d4114ab0 msgr2=0x7fb1d41a08b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:58:40.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.992+0000 7fb1d2000640 1 --2- 172.21.15.18:0/2065917620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1d4114ab0 0x7fb1d41a08b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:40.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.992+0000 7fb1d2000640 1 -- 172.21.15.18:0/2065917620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1d41091f0 msgr2=0x7fb1d41a6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:40.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.992+0000 7fb1d2000640 1 --2- 172.21.15.18:0/2065917620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1d41091f0 0x7fb1d41a6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:40.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.992+0000 7fb1d2000640 1 -- 172.21.15.18:0/2065917620 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d41a1030 con 0x7fb1d4109b10 2024-09-12T02:58:40.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.992+0000 7fb1d2a00640 1 --2- 172.21.15.18:0/2065917620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1d41091f0 0x7fb1d41a6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:40.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.992+0000 7fb1d2000640 1 --2- 172.21.15.18:0/2065917620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1d4109b10 0x7fb1d41a6c40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb1c002a8d0 tx=0x7fb1c0033d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.993+0000 7fb1cb400640 1 -- 172.21.15.18:0/2065917620 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0037040 con 0x7fb1d4109b10 2024-09-12T02:58:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.996+0000 7fb1cb400640 1 -- 172.21.15.18:0/2065917620 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1c0040070 con 0x7fb1d4109b10 2024-09-12T02:58:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.996+0000 7fb1d3e00640 1 -- 172.21.15.18:0/2065917620 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d41a12c0 con 0x7fb1d4109b10 2024-09-12T02:58:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.996+0000 7fb1cb400640 1 -- 172.21.15.18:0/2065917620 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0003970 con 0x7fb1d4109b10 2024-09-12T02:58:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:40.996+0000 7fb1d3e00640 1 -- 172.21.15.18:0/2065917620 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d41ad5c0 con 0x7fb1d4109b10 2024-09-12T02:58:41.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.002+0000 7fb1dca7f740 1 Processor -- start 2024-09-12T02:58:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.003+0000 7fb1dca7f740 1 -- start start 2024-09-12T02:58:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.004+0000 7fb1cb400640 1 -- 172.21.15.18:0/2065917620 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fb1c0003b10 con 0x7fb1d4109b10 2024-09-12T02:58:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.004+0000 7fb1dca7f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4f580 0x555c58e4f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.004+0000 7fb1dca7f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4af20 0x555c58e4b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.004+0000 7fb1dca7f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4b8c0 0x555c58e57280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.004+0000 7fb1dca7f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555c58da7100 con 0x555c58e4f580 2024-09-12T02:58:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.004+0000 7fb1dca7f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x555c58d4f1b0 con 0x555c58e4af20 2024-09-12T02:58:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.004+0000 7fb1dca7f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x555c58da30c0 con 0x555c58e4b8c0 2024-09-12T02:58:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.005+0000 7fb1d2a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4af20 0x555c58e4b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.005+0000 7fb1d2a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4af20 0x555c58e4b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:36284/0 (socket says 172.21.15.18:36284) 2024-09-12T02:58:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.005+0000 7fb1d2a00640 1 -- 172.21.15.18:0/3016859441 learned_addr learned my addr 172.21.15.18:0/3016859441 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.005+0000 7fb1d2a00640 1 -- 172.21.15.18:0/3016859441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4b8c0 msgr2=0x555c58e57280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:58:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.005+0000 7fb1d2a00640 1 --2- 172.21.15.18:0/3016859441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4b8c0 0x555c58e57280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.005+0000 7fb1d2a00640 1 -- 172.21.15.18:0/3016859441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4f580 msgr2=0x555c58e4f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.005+0000 7fb1d2a00640 1 --2- 172.21.15.18:0/3016859441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4f580 0x555c58e4f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.005+0000 7fb1d2a00640 1 -- 172.21.15.18:0/3016859441 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c58aba210 con 0x555c58e4af20 2024-09-12T02:58:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.006+0000 7fb1d2a00640 1 --2- 172.21.15.18:0/3016859441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4af20 0x555c58e4b380 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009ce0 tx=0x7fb1c40117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7940e0e33fd730e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.006+0000 7fb1cb400640 1 --2- 172.21.15.18:0/2065917620 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fb1b80a2e40 0x7fb1b80a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.006+0000 7fb1bfe00640 1 -- 172.21.15.18:0/3016859441 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4012450 con 0x555c58e4af20 2024-09-12T02:58:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.008+0000 7fb1cb400640 1 -- 172.21.15.18:0/2065917620 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9562+0+0 (secure 0 0 0) 0x7fb1c00ef810 con 0x7fb1d4109b10 2024-09-12T02:58:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.008+0000 7fb1bfe00640 1 -- 172.21.15.18:0/3016859441 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1c4012ad0 con 0x555c58e4af20 2024-09-12T02:58:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.008+0000 7fb1bfe00640 1 -- 172.21.15.18:0/3016859441 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c400fc60 con 0x555c58e4af20 2024-09-12T02:58:41.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.008+0000 7fb1d3400640 1 --2- 172.21.15.18:0/2065917620 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fb1b80a2e40 0x7fb1b80a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:41.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.008+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3016859441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4af20 msgr2=0x555c58e4b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:41.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.008+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/3016859441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4af20 0x555c58e4b380 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009ce0 tx=0x7fb1c40117b0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.009+0000 7fb1d3400640 1 --2- 172.21.15.18:0/2065917620 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fb1b80a2e40 0x7fb1b80a5300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc005c40 tx=0x7fb1cc005bd0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.009+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3016859441 shutdown_connections 2024-09-12T02:58:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.009+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/3016859441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4b8c0 0x555c58e57280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.009+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/3016859441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4af20 0x555c58e4b380 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.009+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/3016859441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4f580 0x555c58e4f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.009+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3016859441 >> 172.21.15.18:0/3016859441 conn(0x555c58e3d3d0 msgr2=0x555c58e3d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.010+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3016859441 shutdown_connections 2024-09-12T02:58:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.010+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3016859441 wait complete. 2024-09-12T02:58:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.011+0000 7fb1dca7f740 1 -- start start 2024-09-12T02:58:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.011+0000 7fb1dca7f740 1 Processor -- start 2024-09-12T02:58:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.012+0000 7fb1dca7f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4af20 0x555c58e54760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.012+0000 7fb1dca7f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4b8c0 0x555c58e54ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.012+0000 7fb1dca7f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4f580 0x555c58e551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.012+0000 7fb1d2000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4b8c0 0x555c58e54ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.012+0000 7fb1dca7f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555c58e57970 con 0x555c58e4af20 2024-09-12T02:58:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.012+0000 7fb1dca7f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x555c58d30090 con 0x555c58e4b8c0 2024-09-12T02:58:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.012+0000 7fb1dca7f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x555c58e57af0 con 0x555c58e4f580 2024-09-12T02:58:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.012+0000 7fb1d2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4af20 0x555c58e54760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.012+0000 7fb1d2000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4b8c0 0x555c58e54ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:36290/0 (socket says 172.21.15.18:36290) 2024-09-12T02:58:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.012+0000 7fb1d2000640 1 -- 172.21.15.18:0/1253378405 learned_addr learned my addr 172.21.15.18:0/1253378405 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.012+0000 7fb1dca7f740 10 client.0 _ll_register_callbacks cb 0x555c58d84f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:58:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.012+0000 7fb1d2000640 1 -- 172.21.15.18:0/1253378405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4f580 msgr2=0x555c58e551e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:58:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.012+0000 7fb1d2000640 1 --2- 172.21.15.18:0/1253378405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4f580 0x555c58e551e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.012+0000 7fb1d2000640 1 -- 172.21.15.18:0/1253378405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4af20 msgr2=0x555c58e54760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.012+0000 7fb1d2000640 1 --2- 172.21.15.18:0/1253378405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4af20 0x555c58e54760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.012+0000 7fb1d2000640 1 -- 172.21.15.18:0/1253378405 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c58b86620 con 0x555c58e4b8c0 2024-09-12T02:58:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.013+0000 7fb1d2000640 1 --2- 172.21.15.18:0/1253378405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4b8c0 0x555c58e54ca0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00bb960 tx=0x7fb1c00bb860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=448134e9eb6e14dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.013+0000 7fb1bcc00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:58:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.013+0000 7fb1bcc00640 1 -- 172.21.15.18:0/1253378405 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00bb9d0 con 0x555c58e4b8c0 2024-09-12T02:58:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.013+0000 7fb1bcc00640 1 -- 172.21.15.18:0/1253378405 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9562+0+0 (secure 0 0 0) 0x7fb1c00b9cd0 con 0x555c58e4b8c0 2024-09-12T02:58:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.013+0000 7fb1dca7f740 1 -- 172.21.15.18:0/1253378405 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1c4012ad0 con 0x555c58e4b8c0 2024-09-12T02:58:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.014+0000 7fb1bcc00640 1 -- 172.21.15.18:0/1253378405 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fb1c00bfd80 con 0x555c58e4b8c0 2024-09-12T02:58:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.014+0000 7fb1dca7f740 10 client.25886 fetch_fsmap learned FSMap version 62 2024-09-12T02:58:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.014+0000 7fb1dca7f740 1 -- 172.21.15.18:0/1253378405 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x555c58e636a0 con 0x555c58e4b8c0 2024-09-12T02:58:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.014+0000 7fb1bcc00640 1 -- 172.21.15.18:0/1253378405 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1c4012ad0 con 0x555c58e4b8c0 2024-09-12T02:58:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.014+0000 7fb1bcc00640 1 -- 172.21.15.18:0/1253378405 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 62) ==== 8446+0+0 (secure 0 0 0) 0x7fb1c003a070 con 0x555c58e4b8c0 2024-09-12T02:58:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.014+0000 7fb1dca7f740 10 client.25886 fetch_fsmap finished waiting for FSMap version 62 2024-09-12T02:58:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.014+0000 7fb1dca7f740 10 client.25886 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:58:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.014+0000 7fb1dca7f740 20 client.25886 populate_metadata read hostname 'smithi018' 2024-09-12T02:58:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.014+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/1253378405 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x555c58e64c00 0x555c58e67080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.014+0000 7fb1dca7f740 4 client.25886 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:58:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.014+0000 7fb1dca7f740 1 -- 172.21.15.18:0/1253378405 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c58db4830 con 0x555c58e64c00 2024-09-12T02:58:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.017+0000 7fb1d2a00640 1 --2- 172.21.15.18:0/1253378405 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x555c58e64c00 0x555c58e67080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.018+0000 7fb1d2a00640 1 --2- 172.21.15.18:0/1253378405 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x555c58e64c00 0x555c58e67080 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f21d21f8e4de14f server_cookie=7ac031fa55236811 in_seq=0 out_seq=0 2024-09-12T02:58:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.018+0000 7fb1bcc00640 10 client.25886 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.018+0000 7fb1bcc00640 1 -- 172.21.15.18:0/1253378405 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c58db4830 con 0x555c58e64c00 2024-09-12T02:58:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.018+0000 7fb1bcc00640 10 client.25886 handle_command_reply: tid=0 2024-09-12T02:58:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.018+0000 7fb1dca7f740 1 client.25886 shutdown 2024-09-12T02:58:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.018+0000 7fb1dca7f740 1 -- 172.21.15.18:0/1253378405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4b8c0 msgr2=0x555c58e54ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.018+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/1253378405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4b8c0 0x555c58e54ca0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00bb960 tx=0x7fb1c00bb860 comp rx=0 tx=0).stop 2024-09-12T02:58:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.022+0000 7fb1dca7f740 1 -- 172.21.15.18:0/1253378405 shutdown_connections 2024-09-12T02:58:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.022+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/1253378405 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x555c58e64c00 0x555c58e67080 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.022+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/1253378405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4f580 0x555c58e551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.022+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/1253378405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4b8c0 0x555c58e54ca0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.022+0000 7fb1bcc00640 0 client.25886 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.022+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/1253378405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4af20 0x555c58e54760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.022+0000 7fb1dca7f740 1 -- 172.21.15.18:0/1253378405 >> 172.21.15.18:0/1253378405 conn(0x555c58e3d3d0 msgr2=0x555c58e4a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.023+0000 7fb1dca7f740 1 -- 172.21.15.18:0/1253378405 shutdown_connections 2024-09-12T02:58:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.023+0000 7fb1dca7f740 1 -- 172.21.15.18:0/1253378405 wait complete. 2024-09-12T02:58:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.023+0000 7fb1dca7f740 20 client.25886 trim_cache size 0 max 16384 2024-09-12T02:58:41.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.055+0000 7fb1dca7f740 1 Processor -- start 2024-09-12T02:58:41.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.055+0000 7fb1dca7f740 1 -- start start 2024-09-12T02:58:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.055+0000 7fb1dca7f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4af20 0x555c58e55010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.055+0000 7fb1dca7f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4b8c0 0x555c58e565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.055+0000 7fb1dca7f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4f580 0x555c58e6c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.055+0000 7fb1dca7f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d41b5680 con 0x555c58e4f580 2024-09-12T02:58:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.055+0000 7fb1dca7f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d41b7490 con 0x555c58e4b8c0 2024-09-12T02:58:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.055+0000 7fb1dca7f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d41b5e10 con 0x555c58e4af20 2024-09-12T02:58:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.055+0000 7fb1d2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4af20 0x555c58e55010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.055+0000 7fb1d2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4af20 0x555c58e55010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:53184/0 (socket says 172.21.15.18:53184) 2024-09-12T02:58:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.055+0000 7fb1d3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4f580 0x555c58e6c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.055+0000 7fb1d2a00640 1 -- 172.21.15.18:0/3740645828 learned_addr learned my addr 172.21.15.18:0/3740645828 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.056+0000 7fb1d2a00640 1 -- 172.21.15.18:0/3740645828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4b8c0 msgr2=0x555c58e565c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:58:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.056+0000 7fb1d2a00640 1 --2- 172.21.15.18:0/3740645828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4b8c0 0x555c58e565c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.056+0000 7fb1d2a00640 1 -- 172.21.15.18:0/3740645828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4f580 msgr2=0x555c58e6c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.056+0000 7fb1d2a00640 1 --2- 172.21.15.18:0/3740645828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4f580 0x555c58e6c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.056+0000 7fb1d2a00640 1 -- 172.21.15.18:0/3740645828 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c58e40c10 con 0x555c58e4af20 2024-09-12T02:58:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.056+0000 7fb1d2a00640 1 --2- 172.21.15.18:0/3740645828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4af20 0x555c58e55010 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4000c00 tx=0x7fb1c40058f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5f50b37fd95ae05 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.056+0000 7fb1bf400640 1 -- 172.21.15.18:0/3740645828 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c400f930 con 0x555c58e4af20 2024-09-12T02:58:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.056+0000 7fb1bf400640 1 -- 172.21.15.18:0/3740645828 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1c4012450 con 0x555c58e4af20 2024-09-12T02:58:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.056+0000 7fb1bf400640 1 -- 172.21.15.18:0/3740645828 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c40052a0 con 0x555c58e4af20 2024-09-12T02:58:41.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.058+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3740645828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4af20 msgr2=0x555c58e55010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:41.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.058+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/3740645828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4af20 0x555c58e55010 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4000c00 tx=0x7fb1c40058f0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.058+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3740645828 shutdown_connections 2024-09-12T02:58:41.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.058+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/3740645828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4f580 0x555c58e6c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.058+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/3740645828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4b8c0 0x555c58e565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.058+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/3740645828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4af20 0x555c58e55010 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.058+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3740645828 >> 172.21.15.18:0/3740645828 conn(0x555c58e3d3d0 msgr2=0x555c58e55eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.058+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3740645828 shutdown_connections 2024-09-12T02:58:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.060+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3740645828 wait complete. 2024-09-12T02:58:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.060+0000 7fb1dca7f740 1 -- start start 2024-09-12T02:58:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.060+0000 7fb1dca7f740 1 Processor -- start 2024-09-12T02:58:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.060+0000 7fb1dca7f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4af20 0x555c58e5d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.060+0000 7fb1dca7f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4b8c0 0x555c58e51290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.060+0000 7fb1dca7f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4f580 0x555c58e517d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.060+0000 7fb1dca7f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d41b6d00 con 0x555c58e4af20 2024-09-12T02:58:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.060+0000 7fb1dca7f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d41b65a0 con 0x555c58e4b8c0 2024-09-12T02:58:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.060+0000 7fb1dca7f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d41b3680 con 0x555c58e4f580 2024-09-12T02:58:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.061+0000 7fb1dca7f740 10 client.0 _ll_register_callbacks cb 0x7fb1c00057a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:58:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.061+0000 7fb1d3400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4f580 0x555c58e517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.061+0000 7fb1d3400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4f580 0x555c58e517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:53194/0 (socket says 172.21.15.18:53194) 2024-09-12T02:58:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.061+0000 7fb1d3400640 1 -- 172.21.15.18:0/3756737064 learned_addr learned my addr 172.21.15.18:0/3756737064 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.061+0000 7fb1d2a00640 1 --2- 172.21.15.18:0/3756737064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4af20 0x555c58e5d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.061+0000 7fb1d2000640 1 --2- 172.21.15.18:0/3756737064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4b8c0 0x555c58e51290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:41.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.062+0000 7fb1d3400640 1 -- 172.21.15.18:0/3756737064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4b8c0 msgr2=0x555c58e51290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:41.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.062+0000 7fb1d3400640 1 --2- 172.21.15.18:0/3756737064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4b8c0 0x555c58e51290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.062+0000 7fb1d3400640 1 -- 172.21.15.18:0/3756737064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4af20 msgr2=0x555c58e5d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:41.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.062+0000 7fb1d3400640 1 --2- 172.21.15.18:0/3756737064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4af20 0x555c58e5d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.062+0000 7fb1d3400640 1 -- 172.21.15.18:0/3756737064 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c58e51e10 con 0x555c58e4f580 2024-09-12T02:58:41.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.062+0000 7fb1bcc00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:58:41.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.062+0000 7fb1d3400640 1 --2- 172.21.15.18:0/3756737064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4f580 0x555c58e517d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0055f0 tx=0x7fb1cc0095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=322cd798734a1259 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:41.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.063+0000 7fb1bcc00640 1 -- 172.21.15.18:0/3756737064 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc01acc0 con 0x555c58e4f580 2024-09-12T02:58:41.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.063+0000 7fb1bcc00640 1 -- 172.21.15.18:0/3756737064 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9562+0+0 (secure 0 0 0) 0x7fb1cc01aac0 con 0x555c58e4f580 2024-09-12T02:58:41.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.063+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3756737064 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1c4012450 con 0x555c58e4f580 2024-09-12T02:58:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.065+0000 7fb1bcc00640 1 -- 172.21.15.18:0/3756737064 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fb1cc01acc0 con 0x555c58e4f580 2024-09-12T02:58:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.067+0000 7fb1dca7f740 10 client.25882 fetch_fsmap learned FSMap version 62 2024-09-12T02:58:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.067+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3756737064 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x555c58ecf7c0 con 0x555c58e4f580 2024-09-12T02:58:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.067+0000 7fb1bcc00640 1 -- 172.21.15.18:0/3756737064 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1cc01ae60 con 0x555c58e4f580 2024-09-12T02:58:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.067+0000 7fb1bcc00640 1 -- 172.21.15.18:0/3756737064 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 62) ==== 8446+0+0 (secure 0 0 0) 0x7fb1cc00b040 con 0x555c58e4f580 2024-09-12T02:58:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.067+0000 7fb1dca7f740 10 client.25882 fetch_fsmap finished waiting for FSMap version 62 2024-09-12T02:58:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.067+0000 7fb1dca7f740 10 client.25882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:58:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.067+0000 7fb1dca7f740 20 client.25882 populate_metadata read hostname 'smithi018' 2024-09-12T02:58:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.067+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/3756737064 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x555c58ed0080 0x555c58ed24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.067+0000 7fb1dca7f740 4 client.25882 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:58:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.068+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3756737064 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fb1c4012450 con 0x555c58ed0080 2024-09-12T02:58:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.068+0000 7fb1d2a00640 1 --2- 172.21.15.18:0/3756737064 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x555c58ed0080 0x555c58ed24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:41.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.068+0000 7fb1d2a00640 1 --2- 172.21.15.18:0/3756737064 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x555c58ed0080 0x555c58ed24a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31a3b854a0a73c24 server_cookie=271ba57bf3acf542 in_seq=0 out_seq=0 2024-09-12T02:58:41.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.068+0000 7fb1bcc00640 10 client.25882 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.092+0000 7fb1bcc00640 1 -- 172.21.15.18:0/3756737064 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fb1c4012450 con 0x555c58ed0080 2024-09-12T02:58:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.094+0000 7fb1bcc00640 10 client.25882 handle_command_reply: tid=0 2024-09-12T02:58:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.094+0000 7fb1dca7f740 1 client.25882 shutdown 2024-09-12T02:58:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.094+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3756737064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4f580 msgr2=0x555c58e517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.094+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/3756737064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4f580 0x555c58e517d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0055f0 tx=0x7fb1cc0095c0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.094+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3756737064 shutdown_connections 2024-09-12T02:58:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.094+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/3756737064 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x555c58ed0080 0x555c58ed24a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.094+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/3756737064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555c58e4f580 0x555c58e517d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.094+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/3756737064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555c58e4b8c0 0x555c58e51290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.094+0000 7fb1dca7f740 1 --2- 172.21.15.18:0/3756737064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c58e4af20 0x555c58e5d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.094+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3756737064 >> 172.21.15.18:0/3756737064 conn(0x555c58e3d3d0 msgr2=0x555c58e4a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.094+0000 7fb1bcc00640 0 client.25882 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.094+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3756737064 shutdown_connections 2024-09-12T02:58:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.094+0000 7fb1dca7f740 1 -- 172.21.15.18:0/3756737064 wait complete. 2024-09-12T02:58:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.095+0000 7fb1dca7f740 20 client.25882 trim_cache size 0 max 16384 2024-09-12T02:58:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:58:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:58:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:58:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:58:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.096+0000 7fb1d3e00640 1 -- 172.21.15.18:0/2065917620 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fb1b80a2e40 msgr2=0x7fb1b80a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.096+0000 7fb1d3e00640 1 --2- 172.21.15.18:0/2065917620 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fb1b80a2e40 0x7fb1b80a5300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc005c40 tx=0x7fb1cc005bd0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.096+0000 7fb1d3e00640 1 -- 172.21.15.18:0/2065917620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1d4109b10 msgr2=0x7fb1d41a6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.096+0000 7fb1d3e00640 1 --2- 172.21.15.18:0/2065917620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1d4109b10 0x7fb1d41a6c40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb1c002a8d0 tx=0x7fb1c0033d10 comp rx=0 tx=0).stop 2024-09-12T02:58:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.096+0000 7fb1d3e00640 1 -- 172.21.15.18:0/2065917620 shutdown_connections 2024-09-12T02:58:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.096+0000 7fb1d3e00640 1 --2- 172.21.15.18:0/2065917620 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fb1b80a2e40 0x7fb1b80a5300 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.096+0000 7fb1d3e00640 1 --2- 172.21.15.18:0/2065917620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1d4114ab0 0x7fb1d41a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.096+0000 7fb1d3e00640 1 --2- 172.21.15.18:0/2065917620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1d4109b10 0x7fb1d41a6c40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.096+0000 7fb1d3e00640 1 --2- 172.21.15.18:0/2065917620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1d41091f0 0x7fb1d41a6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.096+0000 7fb1d3e00640 1 -- 172.21.15.18:0/2065917620 >> 172.21.15.18:0/2065917620 conn(0x7fb1d406cbf0 msgr2=0x7fb1d4070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.096+0000 7fb1d3e00640 1 -- 172.21.15.18:0/2065917620 shutdown_connections 2024-09-12T02:58:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:41.096+0000 7fb1d3e00640 1 -- 172.21.15.18:0/2065917620 wait complete. 2024-09-12T02:58:41.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:40 smithi018 ceph-mon[30616]: pgmap v309: 129 pgs: 129 active+clean; 2.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 359 op/s 2024-09-12T02:58:41.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:40 smithi176 ceph-mon[35713]: pgmap v309: 129 pgs: 129 active+clean; 2.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 359 op/s 2024-09-12T02:58:41.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:40 smithi062 ceph-mon[35527]: pgmap v309: 129 pgs: 129 active+clean; 2.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 359 op/s 2024-09-12T02:58:43.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:42 smithi018 ceph-mon[30616]: pgmap v310: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 335 op/s 2024-09-12T02:58:43.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:42 smithi176 ceph-mon[35713]: pgmap v310: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 335 op/s 2024-09-12T02:58:43.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:42 smithi062 ceph-mon[35527]: pgmap v310: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 335 op/s 2024-09-12T02:58:45.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:44 smithi018 ceph-mon[30616]: pgmap v311: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 335 op/s 2024-09-12T02:58:45.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:44 smithi176 ceph-mon[35713]: pgmap v311: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 335 op/s 2024-09-12T02:58:45.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:44 smithi062 ceph-mon[35527]: pgmap v311: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 335 op/s 2024-09-12T02:58:47.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:46 smithi018 ceph-mon[30616]: pgmap v312: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 376 op/s 2024-09-12T02:58:47.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:46 smithi176 ceph-mon[35713]: pgmap v312: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 376 op/s 2024-09-12T02:58:47.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:46 smithi062 ceph-mon[35527]: pgmap v312: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 376 op/s 2024-09-12T02:58:49.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:48 smithi018 ceph-mon[30616]: pgmap v313: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 351 op/s 2024-09-12T02:58:49.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:48 smithi176 ceph-mon[35713]: pgmap v313: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 351 op/s 2024-09-12T02:58:49.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:48 smithi062 ceph-mon[35527]: pgmap v313: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 351 op/s 2024-09-12T02:58:51.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:50 smithi018 ceph-mon[30616]: pgmap v314: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 471 op/s 2024-09-12T02:58:51.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:50 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:58:51.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:50 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:51.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:50 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:51.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:50 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:51.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:50 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:51.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:50 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:51.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:50 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:51.167 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:50 smithi176 ceph-mon[35713]: pgmap v314: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 471 op/s 2024-09-12T02:58:51.168 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:50 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:58:51.168 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:50 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:51.168 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:50 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:51.168 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:50 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:51.168 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:50 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:51.168 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:50 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:51.168 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:50 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:51.230 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:50 smithi062 ceph-mon[35527]: pgmap v314: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 471 op/s 2024-09-12T02:58:51.230 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:50 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:58:51.230 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:50 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:51.230 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:50 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:51.230 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:50 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:51.230 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:50 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:51.231 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:50 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:51.231 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:50 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:53.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:52 smithi062 ceph-mon[35527]: pgmap v315: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 499 op/s 2024-09-12T02:58:53.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:52 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:53.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:52 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:53.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:52 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:52 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:52 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:52 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:52 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:52 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:52 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:52 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:52 smithi018 ceph-mon[30616]: pgmap v315: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 499 op/s 2024-09-12T02:58:53.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:52 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:53.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:52 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:53.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:52 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:52 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:52 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:52 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:52 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:52 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:52 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:52 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:52 smithi176 ceph-mon[35713]: pgmap v315: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 499 op/s 2024-09-12T02:58:53.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:52 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:53.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:52 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:53.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:52 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:52 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:52 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:52 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:52 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:52 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:52 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:53.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:52 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.229+0000 7fe3c5600640 1 -- 172.21.15.18:0/3174549482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c0109ba0 msgr2=0x7fe3c0109f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.229+0000 7fe3c5600640 1 --2- 172.21.15.18:0/3174549482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c0109ba0 0x7fe3c0109f80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0009860 tx=0x7fe3b002a340 comp rx=0 tx=0).stop 2024-09-12T02:58:54.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.229+0000 7fe3c5600640 1 -- 172.21.15.18:0/3174549482 shutdown_connections 2024-09-12T02:58:54.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.229+0000 7fe3c5600640 1 --2- 172.21.15.18:0/3174549482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3c01044a0 0x7fe3c01109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.229+0000 7fe3c5600640 1 --2- 172.21.15.18:0/3174549482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3c0103b00 0x7fe3c0103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.229+0000 7fe3c5600640 1 --2- 172.21.15.18:0/3174549482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c0109ba0 0x7fe3c0109f80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.229+0000 7fe3c5600640 1 -- 172.21.15.18:0/3174549482 >> 172.21.15.18:0/3174549482 conn(0x7fe3c00ff7c0 msgr2=0x7fe3c0101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:54.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.230+0000 7fe3c5600640 1 -- 172.21.15.18:0/3174549482 shutdown_connections 2024-09-12T02:58:54.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.230+0000 7fe3c5600640 1 -- 172.21.15.18:0/3174549482 wait complete. 2024-09-12T02:58:54.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.231+0000 7fe3c5600640 1 Processor -- start 2024-09-12T02:58:54.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.231+0000 7fe3c5600640 1 -- start start 2024-09-12T02:58:54.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.231+0000 7fe3c5600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3c0103b00 0x7fe3c019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.231+0000 7fe3c5600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c01044a0 0x7fe3c019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.232+0000 7fe3c5600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3c0109ba0 0x7fe3c019ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.232+0000 7fe3c5600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c0113f50 con 0x7fe3c0109ba0 2024-09-12T02:58:54.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.232+0000 7fe3c5600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c0113dd0 con 0x7fe3c01044a0 2024-09-12T02:58:54.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.232+0000 7fe3c5600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c01140d0 con 0x7fe3c0103b00 2024-09-12T02:58:54.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.232+0000 7fe3bfe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3c0103b00 0x7fe3c019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.232+0000 7fe3bfe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3c0103b00 0x7fe3c019a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:50656/0 (socket says 172.21.15.18:50656) 2024-09-12T02:58:54.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.232+0000 7fe3bfe00640 1 -- 172.21.15.18:0/3467397133 learned_addr learned my addr 172.21.15.18:0/3467397133 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:54.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.232+0000 7fe3c4c00640 1 --2- 172.21.15.18:0/3467397133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3c0109ba0 0x7fe3c019ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.232+0000 7fe3bfe00640 1 -- 172.21.15.18:0/3467397133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c01044a0 msgr2=0x7fe3c019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:54.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.232+0000 7fe3bfe00640 1 --2- 172.21.15.18:0/3467397133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c01044a0 0x7fe3c019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.232+0000 7fe3bfe00640 1 -- 172.21.15.18:0/3467397133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3c0109ba0 msgr2=0x7fe3c019ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:54.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.232+0000 7fe3bfe00640 1 --2- 172.21.15.18:0/3467397133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3c0109ba0 0x7fe3c019ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.232+0000 7fe3bfe00640 1 -- 172.21.15.18:0/3467397133 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c019f430 con 0x7fe3c0103b00 2024-09-12T02:58:54.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.233+0000 7fe3bfe00640 1 --2- 172.21.15.18:0/3467397133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3c0103b00 0x7fe3c019a440 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0035040 tx=0x7fe3b0033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:54.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.233+0000 7fe3bd600640 1 -- 172.21.15.18:0/3467397133 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b003f020 con 0x7fe3c0103b00 2024-09-12T02:58:54.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.233+0000 7fe3bd600640 1 -- 172.21.15.18:0/3467397133 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3b0030780 con 0x7fe3c0103b00 2024-09-12T02:58:54.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.233+0000 7fe3bd600640 1 -- 172.21.15.18:0/3467397133 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b0037040 con 0x7fe3c0103b00 2024-09-12T02:58:54.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.233+0000 7fe3c5600640 1 -- 172.21.15.18:0/3467397133 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3c019f6c0 con 0x7fe3c0103b00 2024-09-12T02:58:54.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.233+0000 7fe3c5600640 1 -- 172.21.15.18:0/3467397133 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3c01a6fb0 con 0x7fe3c0103b00 2024-09-12T02:58:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.237+0000 7fe3c9a70740 1 Processor -- start 2024-09-12T02:58:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.238+0000 7fe3c9a70740 1 -- start start 2024-09-12T02:58:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.238+0000 7fe3bd600640 1 -- 172.21.15.18:0/3467397133 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fe3b0042020 con 0x7fe3c0103b00 2024-09-12T02:58:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.238+0000 7fe3c9a70740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f003b0 0x5585c9f00790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.238+0000 7fe3c9a70740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 0x5585c9f0b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.238+0000 7fe3c9a70740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f0b570 0x5585c9f0d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.238+0000 7fe3c9a70740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5585c9e66100 con 0x5585c9f00cd0 2024-09-12T02:58:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.238+0000 7fe3c9a70740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5585c9e0e1b0 con 0x5585c9f0b570 2024-09-12T02:58:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.238+0000 7fe3c9a70740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5585c9e620c0 con 0x5585c9f003b0 2024-09-12T02:58:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.238+0000 7fe3c4c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f003b0 0x5585c9f00790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.238+0000 7fe3c4c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f003b0 0x5585c9f00790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:50658/0 (socket says 172.21.15.18:50658) 2024-09-12T02:58:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.238+0000 7fe3c4c00640 1 -- 172.21.15.18:0/4033384844 learned_addr learned my addr 172.21.15.18:0/4033384844 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.238+0000 7fe3b7e00640 1 --2- 172.21.15.18:0/4033384844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f0b570 0x5585c9f0d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.239+0000 7fe3bfe00640 1 --2- 172.21.15.18:0/4033384844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 0x5585c9f0b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.239+0000 7fe3c4c00640 1 -- 172.21.15.18:0/4033384844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f0b570 msgr2=0x5585c9f0d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.239+0000 7fe3c4c00640 1 --2- 172.21.15.18:0/4033384844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f0b570 0x5585c9f0d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.239+0000 7fe3c4c00640 1 -- 172.21.15.18:0/4033384844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 msgr2=0x5585c9f0b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.239+0000 7fe3c4c00640 1 --2- 172.21.15.18:0/4033384844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 0x5585c9f0b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.239+0000 7fe3c4c00640 1 -- 172.21.15.18:0/4033384844 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585c9b79210 con 0x5585c9f003b0 2024-09-12T02:58:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.239+0000 7fe3b7e00640 1 --2- 172.21.15.18:0/4033384844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f0b570 0x5585c9f0d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.239+0000 7fe3c4c00640 1 --2- 172.21.15.18:0/4033384844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f003b0 0x5585c9f00790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009e60 tx=0x7fe3b8010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cdd9fc140d1984a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:54.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.239+0000 7fe3b5200640 1 -- 172.21.15.18:0/4033384844 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8016070 con 0x5585c9f003b0 2024-09-12T02:58:54.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.239+0000 7fe3b5200640 1 -- 172.21.15.18:0/4033384844 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3b8010e50 con 0x5585c9f003b0 2024-09-12T02:58:54.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.240+0000 7fe3b5200640 1 -- 172.21.15.18:0/4033384844 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8012720 con 0x5585c9f003b0 2024-09-12T02:58:54.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.240+0000 7fe3bd600640 1 --2- 172.21.15.18:0/3467397133 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fe3a40a2d70 0x7fe3a40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.240+0000 7fe3bd600640 1 -- 172.21.15.18:0/3467397133 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9562+0+0 (secure 0 0 0) 0x7fe3b00efa50 con 0x7fe3c0103b00 2024-09-12T02:58:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.240+0000 7fe3bfe00640 1 --2- 172.21.15.18:0/3467397133 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fe3a40a2d70 0x7fe3a40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.240+0000 7fe3c9a70740 1 -- 172.21.15.18:0/4033384844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f003b0 msgr2=0x5585c9f00790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.240+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/4033384844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f003b0 0x5585c9f00790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009e60 tx=0x7fe3b8010740 comp rx=0 tx=0).stop 2024-09-12T02:58:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.240+0000 7fe3c9a70740 1 -- 172.21.15.18:0/4033384844 shutdown_connections 2024-09-12T02:58:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.240+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/4033384844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f0b570 0x5585c9f0d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.240+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/4033384844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 0x5585c9f0b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.240+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/4033384844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f003b0 0x5585c9f00790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.240+0000 7fe3c9a70740 1 -- 172.21.15.18:0/4033384844 >> 172.21.15.18:0/4033384844 conn(0x5585c9efc920 msgr2=0x5585c9efcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.241+0000 7fe3c9a70740 1 -- 172.21.15.18:0/4033384844 shutdown_connections 2024-09-12T02:58:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.241+0000 7fe3c9a70740 1 -- 172.21.15.18:0/4033384844 wait complete. 2024-09-12T02:58:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.241+0000 7fe3bfe00640 1 --2- 172.21.15.18:0/3467397133 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fe3a40a2d70 0x7fe3a40a5230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe3b00ecf50 tx=0x7fe3b0005dc0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.241+0000 7fe3c9a70740 1 -- start start 2024-09-12T02:58:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.242+0000 7fe3c9a70740 1 Processor -- start 2024-09-12T02:58:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.242+0000 7fe3c9a70740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f003b0 0x5585c9f08640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.242+0000 7fe3c9a70740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 0x5585c9f08b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.242+0000 7fe3c9a70740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f0b570 0x5585c9f090c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.242+0000 7fe3c9a70740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5585c9f0dff0 con 0x5585c9f00cd0 2024-09-12T02:58:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.242+0000 7fe3c9a70740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5585c9def090 con 0x5585c9f0b570 2024-09-12T02:58:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.242+0000 7fe3c9a70740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5585c9f0e170 con 0x5585c9f003b0 2024-09-12T02:58:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.243+0000 7fe3c9a70740 10 client.0 _ll_register_callbacks cb 0x5585c9e43f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:58:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.243+0000 7fe3c4c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f003b0 0x5585c9f08640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.243+0000 7fe3c4c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f003b0 0x5585c9f08640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:50672/0 (socket says 172.21.15.18:50672) 2024-09-12T02:58:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.243+0000 7fe3c4c00640 1 -- 172.21.15.18:0/3493793044 learned_addr learned my addr 172.21.15.18:0/3493793044 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.243+0000 7fe3c4c00640 1 --2- 172.21.15.18:0/3493793044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f0b570 0x5585c9f090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.243+0000 7fe3b7e00640 1 --2- 172.21.15.18:0/3493793044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 0x5585c9f08b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.243+0000 7fe3c4c00640 1 -- 172.21.15.18:0/3493793044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f0b570 msgr2=0x5585c9f090c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.243+0000 7fe3c4c00640 1 --2- 172.21.15.18:0/3493793044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f0b570 0x5585c9f090c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.243+0000 7fe3c4c00640 1 -- 172.21.15.18:0/3493793044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 msgr2=0x5585c9f08b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.243+0000 7fe3c4c00640 1 --2- 172.21.15.18:0/3493793044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 0x5585c9f08b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.243+0000 7fe3c4c00640 1 -- 172.21.15.18:0/3493793044 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585c9c45620 con 0x5585c9f003b0 2024-09-12T02:58:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.243+0000 7fe3b7e00640 1 --2- 172.21.15.18:0/3493793044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 0x5585c9f08b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.244+0000 7fe3c4c00640 1 --2- 172.21.15.18:0/3493793044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f003b0 0x5585c9f08640 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8005b20 tx=0x7fe3b8005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=289facb1f387ae6c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.244+0000 7fe3ad600640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:58:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.244+0000 7fe3ad600640 1 -- 172.21.15.18:0/3493793044 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b801e020 con 0x5585c9f003b0 2024-09-12T02:58:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.244+0000 7fe3ad600640 1 -- 172.21.15.18:0/3493793044 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9562+0+0 (secure 0 0 0) 0x7fe3b801a410 con 0x5585c9f003b0 2024-09-12T02:58:54.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.244+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3493793044 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3b8010e50 con 0x5585c9f003b0 2024-09-12T02:58:54.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.244+0000 7fe3ad600640 1 -- 172.21.15.18:0/3493793044 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fe3b8031050 con 0x5585c9f003b0 2024-09-12T02:58:54.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.244+0000 7fe3c9a70740 10 client.25894 fetch_fsmap learned FSMap version 62 2024-09-12T02:58:54.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.244+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3493793044 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x5585c9f19e70 con 0x5585c9f003b0 2024-09-12T02:58:54.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.244+0000 7fe3ad600640 1 -- 172.21.15.18:0/3493793044 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3b8010e50 con 0x5585c9f003b0 2024-09-12T02:58:54.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.245+0000 7fe3ad600640 1 -- 172.21.15.18:0/3493793044 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 62) ==== 8446+0+0 (secure 0 0 0) 0x7fe3b800f040 con 0x5585c9f003b0 2024-09-12T02:58:54.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.245+0000 7fe3c9a70740 10 client.25894 fetch_fsmap finished waiting for FSMap version 62 2024-09-12T02:58:54.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.245+0000 7fe3c9a70740 10 client.25894 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:58:54.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.245+0000 7fe3c9a70740 20 client.25894 populate_metadata read hostname 'smithi018' 2024-09-12T02:58:54.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.245+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/3493793044 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5585c9f1b2e0 0x5585c9f1d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.245+0000 7fe3c9a70740 4 client.25894 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:58:54.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.245+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3493793044 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585c9e73830 con 0x5585c9f1b2e0 2024-09-12T02:58:54.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.245+0000 7fe3b7e00640 1 --2- 172.21.15.18:0/3493793044 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5585c9f1b2e0 0x5585c9f1d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.246+0000 7fe3b7e00640 1 --2- 172.21.15.18:0/3493793044 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5585c9f1b2e0 0x5585c9f1d6d0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d3a90398abbced0 server_cookie=3871d68a91b3efa in_seq=0 out_seq=0 2024-09-12T02:58:54.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.246+0000 7fe3ad600640 10 client.25894 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:54.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.247+0000 7fe3ad600640 1 -- 172.21.15.18:0/3493793044 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5585c9e73830 con 0x5585c9f1b2e0 2024-09-12T02:58:54.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.247+0000 7fe3ad600640 10 client.25894 handle_command_reply: tid=0 2024-09-12T02:58:54.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.247+0000 7fe3c9a70740 1 client.25894 shutdown 2024-09-12T02:58:54.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.247+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3493793044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f003b0 msgr2=0x5585c9f08640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:54.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.247+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/3493793044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f003b0 0x5585c9f08640 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8005b20 tx=0x7fe3b8005a20 comp rx=0 tx=0).stop 2024-09-12T02:58:54.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.247+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3493793044 shutdown_connections 2024-09-12T02:58:54.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.247+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/3493793044 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5585c9f1b2e0 0x5585c9f1d6d0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.247+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/3493793044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f0b570 0x5585c9f090c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.247+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/3493793044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 0x5585c9f08b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.247+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/3493793044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f003b0 0x5585c9f08640 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.247+0000 7fe3ad600640 0 client.25894 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:54.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.247+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3493793044 >> 172.21.15.18:0/3493793044 conn(0x5585c9efc920 msgr2=0x5585c9f02680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:54.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.247+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3493793044 shutdown_connections 2024-09-12T02:58:54.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.247+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3493793044 wait complete. 2024-09-12T02:58:54.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.247+0000 7fe3c9a70740 20 client.25894 trim_cache size 0 max 16384 2024-09-12T02:58:54.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.266+0000 7fe3c9a70740 1 Processor -- start 2024-09-12T02:58:54.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.266+0000 7fe3c9a70740 1 -- start start 2024-09-12T02:58:54.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.267+0000 7fe3c9a70740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f003b0 0x5585c9f08ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.267+0000 7fe3c9a70740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 0x5585c9f22d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.267+0000 7fe3c9a70740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f0b570 0x5585c9f23270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.267+0000 7fe3c9a70740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c01b1250 con 0x5585c9f00cd0 2024-09-12T02:58:54.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.267+0000 7fe3c9a70740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c01b3060 con 0x5585c9f003b0 2024-09-12T02:58:54.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.267+0000 7fe3c9a70740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c01b19e0 con 0x5585c9f0b570 2024-09-12T02:58:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.267+0000 7fe3b7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 0x5585c9f22d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.267+0000 7fe3c4c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f003b0 0x5585c9f08ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.267+0000 7fe3b7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 0x5585c9f22d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34182/0 (socket says 172.21.15.18:34182) 2024-09-12T02:58:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.267+0000 7fe3b7e00640 1 -- 172.21.15.18:0/3065683090 learned_addr learned my addr 172.21.15.18:0/3065683090 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.267+0000 7fe3c4c00640 1 --2- 172.21.15.18:0/3065683090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f0b570 0x5585c9f23270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.268+0000 7fe3c4c00640 1 -- 172.21.15.18:0/3065683090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f0b570 msgr2=0x5585c9f23270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:54.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.268+0000 7fe3c4c00640 1 --2- 172.21.15.18:0/3065683090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f0b570 0x5585c9f23270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.268+0000 7fe3c4c00640 1 -- 172.21.15.18:0/3065683090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 msgr2=0x5585c9f22d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:54.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.268+0000 7fe3c4c00640 1 --2- 172.21.15.18:0/3065683090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 0x5585c9f22d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.268+0000 7fe3c4c00640 1 -- 172.21.15.18:0/3065683090 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585c9f06b70 con 0x5585c9f003b0 2024-09-12T02:58:54.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.268+0000 7fe3b7e00640 1 --2- 172.21.15.18:0/3065683090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 0x5585c9f22d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:54.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.268+0000 7fe3c4c00640 1 --2- 172.21.15.18:0/3065683090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f003b0 0x5585c9f08ef0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8005950 tx=0x7fe3b8010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e3fcccd843f0ea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:54.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.268+0000 7fe3afe00640 1 -- 172.21.15.18:0/3065683090 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b801e070 con 0x5585c9f003b0 2024-09-12T02:58:54.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.269+0000 7fe3afe00640 1 -- 172.21.15.18:0/3065683090 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3b8021030 con 0x5585c9f003b0 2024-09-12T02:58:54.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.269+0000 7fe3afe00640 1 -- 172.21.15.18:0/3065683090 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8023070 con 0x5585c9f003b0 2024-09-12T02:58:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.269+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3065683090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f003b0 msgr2=0x5585c9f08ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.269+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/3065683090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f003b0 0x5585c9f08ef0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8005950 tx=0x7fe3b8010740 comp rx=0 tx=0).stop 2024-09-12T02:58:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.269+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3065683090 shutdown_connections 2024-09-12T02:58:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.269+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/3065683090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f0b570 0x5585c9f23270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.269+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/3065683090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f00cd0 0x5585c9f22d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.269+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/3065683090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f003b0 0x5585c9f08ef0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.269+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3065683090 >> 172.21.15.18:0/3065683090 conn(0x5585c9efc920 msgr2=0x5585c9f06ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.270+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3065683090 shutdown_connections 2024-09-12T02:58:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.270+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3065683090 wait complete. 2024-09-12T02:58:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.270+0000 7fe3c9a70740 1 -- start start 2024-09-12T02:58:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.270+0000 7fe3c9a70740 1 Processor -- start 2024-09-12T02:58:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.271+0000 7fe3c9a70740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f003b0 0x5585c9f06230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.271+0000 7fe3c9a70740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f00cd0 0x5585c9f13450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.271+0000 7fe3c9a70740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f0b570 0x5585c9f13ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.271+0000 7fe3c9a70740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c01b28d0 con 0x5585c9f0b570 2024-09-12T02:58:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.271+0000 7fe3c9a70740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c01b2170 con 0x5585c9f003b0 2024-09-12T02:58:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.271+0000 7fe3c9a70740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c01af250 con 0x5585c9f00cd0 2024-09-12T02:58:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.271+0000 7fe3c9a70740 10 client.0 _ll_register_callbacks cb 0x7fe3b8009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:58:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.271+0000 7fe3b7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f00cd0 0x5585c9f13450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.271+0000 7fe3c4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f0b570 0x5585c9f13ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.271+0000 7fe3b7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f00cd0 0x5585c9f13450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:50692/0 (socket says 172.21.15.18:50692) 2024-09-12T02:58:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.271+0000 7fe3b7e00640 1 -- 172.21.15.18:0/3126960403 learned_addr learned my addr 172.21.15.18:0/3126960403 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:58:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.272+0000 7fe3c4c00640 1 --2- 172.21.15.18:0/3126960403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f003b0 0x5585c9f06230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.272+0000 7fe3b7e00640 1 -- 172.21.15.18:0/3126960403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f003b0 msgr2=0x5585c9f06230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.272+0000 7fe3b7e00640 1 --2- 172.21.15.18:0/3126960403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f003b0 0x5585c9f06230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.272+0000 7fe3b7e00640 1 -- 172.21.15.18:0/3126960403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f0b570 msgr2=0x5585c9f13ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.272+0000 7fe3b7e00640 1 --2- 172.21.15.18:0/3126960403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f0b570 0x5585c9f13ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.272+0000 7fe3b7e00640 1 -- 172.21.15.18:0/3126960403 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585c9f048c0 con 0x5585c9f00cd0 2024-09-12T02:58:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.272+0000 7fe3c4c00640 1 --2- 172.21.15.18:0/3126960403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f003b0 0x5585c9f06230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.272+0000 7fe3b7e00640 1 --2- 172.21.15.18:0/3126960403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f00cd0 0x5585c9f13450 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5585c9f02f50 tx=0x7fe3a8012610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=947c5ede9084bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.272+0000 7fe3ad600640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:58:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.273+0000 7fe3ad600640 1 -- 172.21.15.18:0/3126960403 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80037f0 con 0x5585c9f00cd0 2024-09-12T02:58:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.273+0000 7fe3ad600640 1 -- 172.21.15.18:0/3126960403 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9562+0+0 (secure 0 0 0) 0x7fe3a8003990 con 0x5585c9f00cd0 2024-09-12T02:58:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.273+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3126960403 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3b8021030 con 0x5585c9f00cd0 2024-09-12T02:58:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.274+0000 7fe3ad600640 1 -- 172.21.15.18:0/3126960403 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fe3a802f050 con 0x5585c9f00cd0 2024-09-12T02:58:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.274+0000 7fe3c9a70740 10 client.25900 fetch_fsmap learned FSMap version 62 2024-09-12T02:58:54.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.274+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3126960403 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x5585c9f850e0 con 0x5585c9f00cd0 2024-09-12T02:58:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.274+0000 7fe3ad600640 1 -- 172.21.15.18:0/3126960403 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3b8021030 con 0x5585c9f00cd0 2024-09-12T02:58:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.275+0000 7fe3ad600640 1 -- 172.21.15.18:0/3126960403 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 62) ==== 8446+0+0 (secure 0 0 0) 0x7fe3a8026070 con 0x5585c9f00cd0 2024-09-12T02:58:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.275+0000 7fe3c9a70740 10 client.25900 fetch_fsmap finished waiting for FSMap version 62 2024-09-12T02:58:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.275+0000 7fe3c9a70740 10 client.25900 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:58:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.275+0000 7fe3c9a70740 20 client.25900 populate_metadata read hostname 'smithi018' 2024-09-12T02:58:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.275+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/3126960403 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5585c9f85900 0x5585c9f87d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.275+0000 7fe3c9a70740 4 client.25900 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:58:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.275+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3126960403 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5585c9e6db80 con 0x5585c9f85900 2024-09-12T02:58:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.275+0000 7fe3c4c00640 1 --2- 172.21.15.18:0/3126960403 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5585c9f85900 0x5585c9f87d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.276+0000 7fe3c4c00640 1 --2- 172.21.15.18:0/3126960403 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5585c9f85900 0x5585c9f87d20 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=149e96be1cfb23b9 server_cookie=6e03dffbc8be6bf0 in_seq=0 out_seq=0 2024-09-12T02:58:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.276+0000 7fe3ad600640 10 client.25900 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:54.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:53 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi176 to 176.0M 2024-09-12T02:58:54.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:53 smithi062 ceph-mon[35527]: Unable to set osd_memory_target on smithi176 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-12T02:58:54.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:53 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:54.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:53 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:54.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.283+0000 7fe3ad600640 1 -- 172.21.15.18:0/3126960403 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5585c9e6db80 con 0x5585c9f85900 2024-09-12T02:58:54.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.283+0000 7fe3ad600640 10 client.25900 handle_command_reply: tid=0 2024-09-12T02:58:54.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.283+0000 7fe3c9a70740 1 client.25900 shutdown 2024-09-12T02:58:54.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.283+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3126960403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f00cd0 msgr2=0x5585c9f13450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:54.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.283+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/3126960403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f00cd0 0x5585c9f13450 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5585c9f02f50 tx=0x7fe3a8012610 comp rx=0 tx=0).stop 2024-09-12T02:58:54.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.283+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3126960403 shutdown_connections 2024-09-12T02:58:54.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.283+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/3126960403 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5585c9f85900 0x5585c9f87d20 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.283+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/3126960403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585c9f0b570 0x5585c9f13ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.283+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/3126960403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585c9f00cd0 0x5585c9f13450 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.283+0000 7fe3c9a70740 1 --2- 172.21.15.18:0/3126960403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5585c9f003b0 0x5585c9f06230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.283+0000 7fe3ad600640 0 client.25900 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:58:54.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.283+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3126960403 >> 172.21.15.18:0/3126960403 conn(0x5585c9efc920 msgr2=0x5585c9f01e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:54.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.283+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3126960403 shutdown_connections 2024-09-12T02:58:54.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.284+0000 7fe3c9a70740 1 -- 172.21.15.18:0/3126960403 wait complete. 2024-09-12T02:58:54.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.284+0000 7fe3c9a70740 20 client.25900 trim_cache size 0 max 16384 2024-09-12T02:58:54.286 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:58:54.286 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:58:54.286 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:58:54.286 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:58:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.284+0000 7fe3c5600640 1 -- 172.21.15.18:0/3467397133 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fe3a40a2d70 msgr2=0x7fe3a40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.284+0000 7fe3c5600640 1 --2- 172.21.15.18:0/3467397133 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fe3a40a2d70 0x7fe3a40a5230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe3b00ecf50 tx=0x7fe3b0005dc0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.284+0000 7fe3c5600640 1 -- 172.21.15.18:0/3467397133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3c0103b00 msgr2=0x7fe3c019a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.284+0000 7fe3c5600640 1 --2- 172.21.15.18:0/3467397133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3c0103b00 0x7fe3c019a440 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0035040 tx=0x7fe3b0033d90 comp rx=0 tx=0).stop 2024-09-12T02:58:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.284+0000 7fe3c5600640 1 -- 172.21.15.18:0/3467397133 shutdown_connections 2024-09-12T02:58:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.284+0000 7fe3c5600640 1 --2- 172.21.15.18:0/3467397133 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fe3a40a2d70 0x7fe3a40a5230 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.284+0000 7fe3c5600640 1 --2- 172.21.15.18:0/3467397133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3c0109ba0 0x7fe3c019ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.284+0000 7fe3c5600640 1 --2- 172.21.15.18:0/3467397133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c01044a0 0x7fe3c019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.284+0000 7fe3c5600640 1 --2- 172.21.15.18:0/3467397133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3c0103b00 0x7fe3c019a440 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.284+0000 7fe3c5600640 1 -- 172.21.15.18:0/3467397133 >> 172.21.15.18:0/3467397133 conn(0x7fe3c00ff7c0 msgr2=0x7fe3c0100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.285+0000 7fe3c5600640 1 -- 172.21.15.18:0/3467397133 shutdown_connections 2024-09-12T02:58:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:58:54.285+0000 7fe3c5600640 1 -- 172.21.15.18:0/3467397133 wait complete. 2024-09-12T02:58:54.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:53 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi176 to 176.0M 2024-09-12T02:58:54.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:53 smithi018 ceph-mon[30616]: Unable to set osd_memory_target on smithi176 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-12T02:58:54.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:53 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:54.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:53 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:54.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:53 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi176 to 176.0M 2024-09-12T02:58:54.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:53 smithi176 ceph-mon[35713]: Unable to set osd_memory_target on smithi176 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-12T02:58:54.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:53 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:54.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:53 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:55.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:54 smithi062 ceph-mon[35527]: pgmap v316: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 435 op/s 2024-09-12T02:58:55.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:54 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:55.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:54 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:55.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:54 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:54 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:54 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.286 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:54 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.286 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:54 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.286 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:54 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.286 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:54 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.286 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:54 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.286 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:54 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.286 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:54 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.286 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:54 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.286 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:54 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:54 smithi018 ceph-mon[30616]: pgmap v316: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 435 op/s 2024-09-12T02:58:55.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:54 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:55.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:54 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:55.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:54 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:54 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:54 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:54 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:54 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:54 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:54 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:54 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:54 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:54 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:54 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:54 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:54 smithi176 ceph-mon[35713]: pgmap v316: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 435 op/s 2024-09-12T02:58:55.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:54 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:55.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:54 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:55.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:54 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:54 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:54 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:54 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:54 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:54 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:54 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:54 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:54 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:54 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:54 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:55.480 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:54 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:56.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:55 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi062 to 176.0M 2024-09-12T02:58:56.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:55 smithi062 ceph-mon[35527]: Unable to set osd_memory_target on smithi062 to 184597504: error parsing value: Value '184597504' is below minimum 939524096 2024-09-12T02:58:56.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:55 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:56.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:55 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:56.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:55 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:56.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:55 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:56.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:55 smithi062 ceph-mon[35527]: Adjusting osd_memory_target on smithi018 to 177.5M 2024-09-12T02:58:56.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:55 smithi062 ceph-mon[35527]: Unable to set osd_memory_target on smithi018 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-12T02:58:56.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:55 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:58:56.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:55 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:58:56.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:55 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:56.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:55 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi062 to 176.0M 2024-09-12T02:58:56.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:55 smithi018 ceph-mon[30616]: Unable to set osd_memory_target on smithi062 to 184597504: error parsing value: Value '184597504' is below minimum 939524096 2024-09-12T02:58:56.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:55 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:56.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:55 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:56.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:55 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:56.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:55 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:56.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:55 smithi018 ceph-mon[30616]: Adjusting osd_memory_target on smithi018 to 177.5M 2024-09-12T02:58:56.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:55 smithi018 ceph-mon[30616]: Unable to set osd_memory_target on smithi018 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-12T02:58:56.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:55 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:58:56.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:55 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:58:56.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:55 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:56.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:55 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi062 to 176.0M 2024-09-12T02:58:56.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:55 smithi176 ceph-mon[35713]: Unable to set osd_memory_target on smithi062 to 184597504: error parsing value: Value '184597504' is below minimum 939524096 2024-09-12T02:58:56.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:55 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:56.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:55 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:56.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:55 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:56.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:55 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:58:56.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:55 smithi176 ceph-mon[35713]: Adjusting osd_memory_target on smithi018 to 177.5M 2024-09-12T02:58:56.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:55 smithi176 ceph-mon[35713]: Unable to set osd_memory_target on smithi018 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-12T02:58:56.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:55 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:58:56.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:55 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:58:56.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:55 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:58:57.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:57 smithi062 ceph-mon[35527]: pgmap v317: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 642 op/s 2024-09-12T02:58:57.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:57 smithi018 ceph-mon[30616]: pgmap v317: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 642 op/s 2024-09-12T02:58:57.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:57 smithi176 ceph-mon[35713]: pgmap v317: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 642 op/s 2024-09-12T02:58:58.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:58:58 smithi018 ceph-mon[30616]: pgmap v318: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 502 op/s 2024-09-12T02:58:58.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:58:58 smithi176 ceph-mon[35713]: pgmap v318: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 502 op/s 2024-09-12T02:58:58.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:58:58 smithi062 ceph-mon[35527]: pgmap v318: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 502 op/s 2024-09-12T02:59:00.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:00 smithi018 ceph-mon[30616]: pgmap v319: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.8 MiB/s wr, 626 op/s 2024-09-12T02:59:00.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:00 smithi176 ceph-mon[35713]: pgmap v319: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.8 MiB/s wr, 626 op/s 2024-09-12T02:59:00.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:00 smithi062 ceph-mon[35527]: pgmap v319: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.8 MiB/s wr, 626 op/s 2024-09-12T02:59:02.605 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:02 smithi018 ceph-mon[30616]: pgmap v320: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 579 op/s 2024-09-12T02:59:02.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:02 smithi176 ceph-mon[35713]: pgmap v320: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 579 op/s 2024-09-12T02:59:02.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:02 smithi062 ceph-mon[35527]: pgmap v320: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 579 op/s 2024-09-12T02:59:04.585 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:04 smithi062 ceph-mon[35527]: pgmap v321: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 476 op/s 2024-09-12T02:59:04.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:04 smithi018 ceph-mon[30616]: pgmap v321: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 476 op/s 2024-09-12T02:59:04.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:04 smithi176 ceph-mon[35713]: pgmap v321: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 476 op/s 2024-09-12T02:59:06.602 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:06 smithi018 ceph-mon[30616]: pgmap v322: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 728 op/s 2024-09-12T02:59:06.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:06 smithi176 ceph-mon[35713]: pgmap v322: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 728 op/s 2024-09-12T02:59:06.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:06 smithi062 ceph-mon[35527]: pgmap v322: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 728 op/s 2024-09-12T02:59:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.469+0000 7fd638e00640 1 -- 172.21.15.18:0/1041472817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd634102ae0 msgr2=0x7fd634102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.469+0000 7fd638e00640 1 --2- 172.21.15.18:0/1041472817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd634102ae0 0x7fd634102ec0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd624009900 tx=0x7fd62402a490 comp rx=0 tx=0).stop 2024-09-12T02:59:07.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.470+0000 7fd638e00640 1 -- 172.21.15.18:0/1041472817 shutdown_connections 2024-09-12T02:59:07.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.470+0000 7fd638e00640 1 --2- 172.21.15.18:0/1041472817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd63410bf00 0x7fd63410e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.470+0000 7fd638e00640 1 --2- 172.21.15.18:0/1041472817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd634103400 0x7fd63410b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.470+0000 7fd638e00640 1 --2- 172.21.15.18:0/1041472817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd634102ae0 0x7fd634102ec0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.470+0000 7fd638e00640 1 -- 172.21.15.18:0/1041472817 >> 172.21.15.18:0/1041472817 conn(0x7fd6340777c0 msgr2=0x7fd6340feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.470+0000 7fd638e00640 1 -- 172.21.15.18:0/1041472817 shutdown_connections 2024-09-12T02:59:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.470+0000 7fd638e00640 1 -- 172.21.15.18:0/1041472817 wait complete. 2024-09-12T02:59:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.471+0000 7fd638e00640 1 Processor -- start 2024-09-12T02:59:07.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.472+0000 7fd638e00640 1 -- start start 2024-09-12T02:59:07.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.472+0000 7fd638e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd634102ae0 0x7fd634100730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.472+0000 7fd638e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd634103400 0x7fd634100c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.472+0000 7fd638e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd63410bf00 0x7fd6341011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.472+0000 7fd638e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd634111d20 con 0x7fd634103400 2024-09-12T02:59:07.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.472+0000 7fd638e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd634111ba0 con 0x7fd63410bf00 2024-09-12T02:59:07.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.472+0000 7fd638e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd634111ea0 con 0x7fd634102ae0 2024-09-12T02:59:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.473+0000 7fd633400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd634102ae0 0x7fd634100730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.473+0000 7fd633e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd63410bf00 0x7fd6341011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.473+0000 7fd633400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd634102ae0 0x7fd634100730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:46276/0 (socket says 172.21.15.18:46276) 2024-09-12T02:59:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.473+0000 7fd633400640 1 -- 172.21.15.18:0/4060034007 learned_addr learned my addr 172.21.15.18:0/4060034007 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.473+0000 7fd632a00640 1 --2- 172.21.15.18:0/4060034007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd634103400 0x7fd634100c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.473+0000 7fd633400640 1 -- 172.21.15.18:0/4060034007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd63410bf00 msgr2=0x7fd6341011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.473+0000 7fd633400640 1 --2- 172.21.15.18:0/4060034007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd63410bf00 0x7fd6341011b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.473+0000 7fd633400640 1 -- 172.21.15.18:0/4060034007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd634103400 msgr2=0x7fd634100c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.473+0000 7fd633400640 1 --2- 172.21.15.18:0/4060034007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd634103400 0x7fd634100c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.473+0000 7fd633400640 1 -- 172.21.15.18:0/4060034007 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6341a66c0 con 0x7fd634102ae0 2024-09-12T02:59:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.473+0000 7fd633400640 1 --2- 172.21.15.18:0/4060034007 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd634102ae0 0x7fd634100730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd624004770 tx=0x7fd624003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:07.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.474+0000 7fd62be00640 1 -- 172.21.15.18:0/4060034007 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62403f070 con 0x7fd634102ae0 2024-09-12T02:59:07.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.474+0000 7fd638e00640 1 -- 172.21.15.18:0/4060034007 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd634197f10 con 0x7fd634102ae0 2024-09-12T02:59:07.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.474+0000 7fd62be00640 1 -- 172.21.15.18:0/4060034007 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd624031ca0 con 0x7fd634102ae0 2024-09-12T02:59:07.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.474+0000 7fd62be00640 1 -- 172.21.15.18:0/4060034007 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624035030 con 0x7fd634102ae0 2024-09-12T02:59:07.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.474+0000 7fd638e00640 1 -- 172.21.15.18:0/4060034007 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd634198450 con 0x7fd634102ae0 2024-09-12T02:59:07.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.477+0000 7fd62be00640 1 -- 172.21.15.18:0/4060034007 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fd624042070 con 0x7fd634102ae0 2024-09-12T02:59:07.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.477+0000 7fd63d47e740 1 Processor -- start 2024-09-12T02:59:07.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.477+0000 7fd63d47e740 1 -- start start 2024-09-12T02:59:07.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.478+0000 7fd63d47e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c9993b0 0x56366c999790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.478+0000 7fd63d47e740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c999cd0 0x56366c9a4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.478+0000 7fd63d47e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9a4570 0x56366c9a6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.478+0000 7fd63d47e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56366c8ff100 con 0x56366c9993b0 2024-09-12T02:59:07.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.478+0000 7fd63d47e740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56366c8a71b0 con 0x56366c999cd0 2024-09-12T02:59:07.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.478+0000 7fd63d47e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56366c8fb0c0 con 0x56366c9a4570 2024-09-12T02:59:07.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.478+0000 7fd633400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c999cd0 0x56366c9a4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.478+0000 7fd632a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9a4570 0x56366c9a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.478+0000 7fd633400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c999cd0 0x56366c9a4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:60690/0 (socket says 172.21.15.18:60690) 2024-09-12T02:59:07.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.478+0000 7fd633400640 1 -- 172.21.15.18:0/3209132125 learned_addr learned my addr 172.21.15.18:0/3209132125 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:07.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.479+0000 7fd633e00640 1 --2- 172.21.15.18:0/3209132125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c9993b0 0x56366c999790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.479+0000 7fd632a00640 1 -- 172.21.15.18:0/3209132125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c999cd0 msgr2=0x56366c9a4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:07.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.479+0000 7fd632a00640 1 --2- 172.21.15.18:0/3209132125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c999cd0 0x56366c9a4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.479+0000 7fd632a00640 1 -- 172.21.15.18:0/3209132125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c9993b0 msgr2=0x56366c999790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:07.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.479+0000 7fd632a00640 1 --2- 172.21.15.18:0/3209132125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c9993b0 0x56366c999790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.479+0000 7fd632a00640 1 -- 172.21.15.18:0/3209132125 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56366c612210 con 0x56366c9a4570 2024-09-12T02:59:07.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.479+0000 7fd633e00640 1 --2- 172.21.15.18:0/3209132125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c9993b0 0x56366c999790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:07.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.479+0000 7fd632a00640 1 --2- 172.21.15.18:0/3209132125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9a4570 0x56366c9a6960 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd620014ed0 tx=0x7fd620009a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db573a750a274a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:07.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.479+0000 7fd62be00640 1 --2- 172.21.15.18:0/4060034007 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd6180a2d70 0x7fd6180a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.480+0000 7fd628c00640 1 -- 172.21.15.18:0/3209132125 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd620024070 con 0x56366c9a4570 2024-09-12T02:59:07.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.480+0000 7fd62be00640 1 -- 172.21.15.18:0/4060034007 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9562+0+0 (secure 0 0 0) 0x7fd6240effb0 con 0x7fd634102ae0 2024-09-12T02:59:07.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.480+0000 7fd628c00640 1 -- 172.21.15.18:0/3209132125 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd62000bca0 con 0x56366c9a4570 2024-09-12T02:59:07.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.480+0000 7fd628c00640 1 -- 172.21.15.18:0/3209132125 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62001fe30 con 0x56366c9a4570 2024-09-12T02:59:07.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.480+0000 7fd633e00640 1 --2- 172.21.15.18:0/4060034007 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd6180a2d70 0x7fd6180a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.481+0000 7fd63d47e740 1 -- 172.21.15.18:0/3209132125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9a4570 msgr2=0x56366c9a6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:07.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.481+0000 7fd63d47e740 1 --2- 172.21.15.18:0/3209132125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9a4570 0x56366c9a6960 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd620014ed0 tx=0x7fd620009a90 comp rx=0 tx=0).stop 2024-09-12T02:59:07.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.481+0000 7fd63d47e740 1 -- 172.21.15.18:0/3209132125 shutdown_connections 2024-09-12T02:59:07.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.481+0000 7fd63d47e740 1 --2- 172.21.15.18:0/3209132125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9a4570 0x56366c9a6960 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.481+0000 7fd63d47e740 1 --2- 172.21.15.18:0/3209132125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c999cd0 0x56366c9a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.481+0000 7fd63d47e740 1 --2- 172.21.15.18:0/3209132125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c9993b0 0x56366c999790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.481+0000 7fd63d47e740 1 -- 172.21.15.18:0/3209132125 >> 172.21.15.18:0/3209132125 conn(0x56366c995920 msgr2=0x56366c995d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:07.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.481+0000 7fd63d47e740 1 -- 172.21.15.18:0/3209132125 shutdown_connections 2024-09-12T02:59:07.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.481+0000 7fd63d47e740 1 -- 172.21.15.18:0/3209132125 wait complete. 2024-09-12T02:59:07.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.481+0000 7fd633e00640 1 --2- 172.21.15.18:0/4060034007 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd6180a2d70 0x7fd6180a5230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd62c007f10 tx=0x7fd62c007520 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:07.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.482+0000 7fd63d47e740 1 -- start start 2024-09-12T02:59:07.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.482+0000 7fd63d47e740 1 Processor -- start 2024-09-12T02:59:07.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.482+0000 7fd63d47e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9993b0 0x56366c9a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.482+0000 7fd63d47e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c999cd0 0x56366c9a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.482+0000 7fd63d47e740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c9a4570 0x56366c9a2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.482+0000 7fd63d47e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56366c9a6ff0 con 0x56366c999cd0 2024-09-12T02:59:07.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.482+0000 7fd63d47e740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56366c888090 con 0x56366c9a4570 2024-09-12T02:59:07.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.482+0000 7fd63d47e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56366c9a7170 con 0x56366c9993b0 2024-09-12T02:59:07.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.482+0000 7fd63d47e740 10 client.0 _ll_register_callbacks cb 0x56366c8dcf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:59:07.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.483+0000 7fd633400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9993b0 0x56366c9a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.483+0000 7fd633e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c9a4570 0x56366c9a2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.483+0000 7fd633e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c9a4570 0x56366c9a2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:60702/0 (socket says 172.21.15.18:60702) 2024-09-12T02:59:07.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.483+0000 7fd633400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9993b0 0x56366c9a15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:46290/0 (socket says 172.21.15.18:46290) 2024-09-12T02:59:07.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.483+0000 7fd633e00640 1 -- 172.21.15.18:0/450526562 learned_addr learned my addr 172.21.15.18:0/450526562 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:07.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.483+0000 7fd632a00640 1 --2- 172.21.15.18:0/450526562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c999cd0 0x56366c9a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.483+0000 7fd633e00640 1 -- 172.21.15.18:0/450526562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9993b0 msgr2=0x56366c9a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:07.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.483+0000 7fd633e00640 1 --2- 172.21.15.18:0/450526562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9993b0 0x56366c9a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.483+0000 7fd633e00640 1 -- 172.21.15.18:0/450526562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c999cd0 msgr2=0x56366c9a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:07.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.483+0000 7fd633e00640 1 --2- 172.21.15.18:0/450526562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c999cd0 0x56366c9a1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.483+0000 7fd633e00640 1 -- 172.21.15.18:0/450526562 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56366c6de620 con 0x56366c9a4570 2024-09-12T02:59:07.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.483+0000 7fd633400640 1 --2- 172.21.15.18:0/450526562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9993b0 0x56366c9a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:59:07.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.483+0000 7fd633e00640 1 --2- 172.21.15.18:0/450526562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c9a4570 0x56366c9a2050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00fe30 tx=0x7fd62c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47a518a7b1582701 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:07.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.483+0000 7fd61d600640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:59:07.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.484+0000 7fd61d600640 1 -- 172.21.15.18:0/450526562 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00eb30 con 0x56366c9a4570 2024-09-12T02:59:07.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.484+0000 7fd63d47e740 1 -- 172.21.15.18:0/450526562 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd62000bca0 con 0x56366c9a4570 2024-09-12T02:59:07.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.484+0000 7fd61d600640 1 -- 172.21.15.18:0/450526562 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9562+0+0 (secure 0 0 0) 0x7fd62c00ecd0 con 0x56366c9a4570 2024-09-12T02:59:07.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.484+0000 7fd61d600640 1 -- 172.21.15.18:0/450526562 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fd62c026430 con 0x56366c9a4570 2024-09-12T02:59:07.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.484+0000 7fd63d47e740 10 client.25916 fetch_fsmap learned FSMap version 62 2024-09-12T02:59:07.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.484+0000 7fd63d47e740 1 -- 172.21.15.18:0/450526562 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x56366c9b2f60 con 0x56366c9a4570 2024-09-12T02:59:07.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.484+0000 7fd61d600640 1 -- 172.21.15.18:0/450526562 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd62000bca0 con 0x56366c9a4570 2024-09-12T02:59:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.484+0000 7fd61d600640 1 -- 172.21.15.18:0/450526562 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 62) ==== 8446+0+0 (secure 0 0 0) 0x7fd62c01c740 con 0x56366c9a4570 2024-09-12T02:59:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.484+0000 7fd63d47e740 10 client.25916 fetch_fsmap finished waiting for FSMap version 62 2024-09-12T02:59:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.484+0000 7fd63d47e740 10 client.25916 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:59:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.485+0000 7fd63d47e740 20 client.25916 populate_metadata read hostname 'smithi018' 2024-09-12T02:59:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.485+0000 7fd63d47e740 1 --2- 172.21.15.18:0/450526562 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56366c9b4490 0x56366c9b6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.485+0000 7fd63d47e740 4 client.25916 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:59:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.485+0000 7fd63d47e740 1 -- 172.21.15.18:0/450526562 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56366c90c830 con 0x56366c9b4490 2024-09-12T02:59:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.485+0000 7fd633400640 1 --2- 172.21.15.18:0/450526562 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56366c9b4490 0x56366c9b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.485+0000 7fd633400640 1 --2- 172.21.15.18:0/450526562 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56366c9b4490 0x56366c9b6900 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1f3c2cc6d27979 server_cookie=fdd622cc73b88b1f in_seq=0 out_seq=0 2024-09-12T02:59:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.485+0000 7fd61d600640 10 client.25916 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:59:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.486+0000 7fd61d600640 1 -- 172.21.15.18:0/450526562 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56366c90c830 con 0x56366c9b4490 2024-09-12T02:59:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.486+0000 7fd61d600640 10 client.25916 handle_command_reply: tid=0 2024-09-12T02:59:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.486+0000 7fd63d47e740 1 client.25916 shutdown 2024-09-12T02:59:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.486+0000 7fd63d47e740 1 -- 172.21.15.18:0/450526562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c9a4570 msgr2=0x56366c9a2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.486+0000 7fd63d47e740 1 --2- 172.21.15.18:0/450526562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c9a4570 0x56366c9a2050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00fe30 tx=0x7fd62c004a40 comp rx=0 tx=0).stop 2024-09-12T02:59:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.486+0000 7fd63d47e740 1 -- 172.21.15.18:0/450526562 shutdown_connections 2024-09-12T02:59:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.486+0000 7fd63d47e740 1 --2- 172.21.15.18:0/450526562 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56366c9b4490 0x56366c9b6900 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.487+0000 7fd61d600640 0 client.25916 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:59:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.487+0000 7fd63d47e740 1 --2- 172.21.15.18:0/450526562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c9a4570 0x56366c9a2050 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.487+0000 7fd63d47e740 1 --2- 172.21.15.18:0/450526562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c999cd0 0x56366c9a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.487+0000 7fd63d47e740 1 --2- 172.21.15.18:0/450526562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9993b0 0x56366c9a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.487+0000 7fd63d47e740 1 -- 172.21.15.18:0/450526562 >> 172.21.15.18:0/450526562 conn(0x56366c995920 msgr2=0x56366c99b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:07.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.487+0000 7fd63d47e740 1 -- 172.21.15.18:0/450526562 shutdown_connections 2024-09-12T02:59:07.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.487+0000 7fd63d47e740 1 -- 172.21.15.18:0/450526562 wait complete. 2024-09-12T02:59:07.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.487+0000 7fd63d47e740 20 client.25916 trim_cache size 0 max 16384 2024-09-12T02:59:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.502+0000 7fd63d47e740 1 Processor -- start 2024-09-12T02:59:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.503+0000 7fd63d47e740 1 -- start start 2024-09-12T02:59:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.503+0000 7fd63d47e740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c9993b0 0x56366c9bc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.503+0000 7fd63d47e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c999cd0 0x56366c9bc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.503+0000 7fd63d47e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9a4570 0x56366c99e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.503+0000 7fd63d47e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd6341acd30 con 0x56366c999cd0 2024-09-12T02:59:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.503+0000 7fd63d47e740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd6341aeb40 con 0x56366c9993b0 2024-09-12T02:59:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.503+0000 7fd63d47e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd6341ad4c0 con 0x56366c9a4570 2024-09-12T02:59:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.503+0000 7fd633400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c9993b0 0x56366c9bc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.503+0000 7fd632a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c999cd0 0x56366c9bc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.503+0000 7fd633400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c9993b0 0x56366c9bc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:60714/0 (socket says 172.21.15.18:60714) 2024-09-12T02:59:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.503+0000 7fd633400640 1 -- 172.21.15.18:0/2752698859 learned_addr learned my addr 172.21.15.18:0/2752698859 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.503+0000 7fd633e00640 1 --2- 172.21.15.18:0/2752698859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9a4570 0x56366c99e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.504+0000 7fd633400640 1 -- 172.21.15.18:0/2752698859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9a4570 msgr2=0x56366c99e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.504+0000 7fd633400640 1 --2- 172.21.15.18:0/2752698859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9a4570 0x56366c99e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.504+0000 7fd633400640 1 -- 172.21.15.18:0/2752698859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c999cd0 msgr2=0x56366c9bc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.504+0000 7fd633400640 1 --2- 172.21.15.18:0/2752698859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c999cd0 0x56366c9bc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.504+0000 7fd633400640 1 -- 172.21.15.18:0/2752698859 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56366c9b2d70 con 0x56366c9993b0 2024-09-12T02:59:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.504+0000 7fd633400640 1 --2- 172.21.15.18:0/2752698859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c9993b0 0x56366c9bc210 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd6240b8a30 tx=0x7fd62402a490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9944c0f77ca0d6cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.504+0000 7fd61fe00640 1 -- 172.21.15.18:0/2752698859 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624049040 con 0x56366c9993b0 2024-09-12T02:59:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.504+0000 7fd61fe00640 1 -- 172.21.15.18:0/2752698859 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6240bc760 con 0x56366c9993b0 2024-09-12T02:59:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.504+0000 7fd61fe00640 1 -- 172.21.15.18:0/2752698859 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6240dc070 con 0x56366c9993b0 2024-09-12T02:59:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.505+0000 7fd63d47e740 1 -- 172.21.15.18:0/2752698859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c9993b0 msgr2=0x56366c9bc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.505+0000 7fd63d47e740 1 --2- 172.21.15.18:0/2752698859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c9993b0 0x56366c9bc210 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd6240b8a30 tx=0x7fd62402a490 comp rx=0 tx=0).stop 2024-09-12T02:59:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.505+0000 7fd63d47e740 1 -- 172.21.15.18:0/2752698859 shutdown_connections 2024-09-12T02:59:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.505+0000 7fd63d47e740 1 --2- 172.21.15.18:0/2752698859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9a4570 0x56366c99e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.505+0000 7fd63d47e740 1 --2- 172.21.15.18:0/2752698859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c999cd0 0x56366c9bc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.505+0000 7fd63d47e740 1 --2- 172.21.15.18:0/2752698859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c9993b0 0x56366c9bc210 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.505+0000 7fd63d47e740 1 -- 172.21.15.18:0/2752698859 >> 172.21.15.18:0/2752698859 conn(0x56366c995920 msgr2=0x56366c99ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.505+0000 7fd63d47e740 1 -- 172.21.15.18:0/2752698859 shutdown_connections 2024-09-12T02:59:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.505+0000 7fd63d47e740 1 -- 172.21.15.18:0/2752698859 wait complete. 2024-09-12T02:59:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.506+0000 7fd63d47e740 1 -- start start 2024-09-12T02:59:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.506+0000 7fd63d47e740 1 Processor -- start 2024-09-12T02:59:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.506+0000 7fd63d47e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c9993b0 0x56366c9ac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.506+0000 7fd63d47e740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c999cd0 0x56366c9acc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.506+0000 7fd63d47e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9a4570 0x56366c99deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.506+0000 7fd63d47e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd6341ae3b0 con 0x56366c9993b0 2024-09-12T02:59:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.506+0000 7fd63d47e740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd6341adc50 con 0x56366c999cd0 2024-09-12T02:59:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.506+0000 7fd63d47e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd6341aad30 con 0x56366c9a4570 2024-09-12T02:59:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.506+0000 7fd63d47e740 10 client.0 _ll_register_callbacks cb 0x7fd62c007b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:59:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.506+0000 7fd632a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c999cd0 0x56366c9acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.506+0000 7fd633400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c9993b0 0x56366c9ac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.507+0000 7fd632a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c999cd0 0x56366c9acc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:60726/0 (socket says 172.21.15.18:60726) 2024-09-12T02:59:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.507+0000 7fd632a00640 1 -- 172.21.15.18:0/2610809179 learned_addr learned my addr 172.21.15.18:0/2610809179 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.507+0000 7fd633e00640 1 --2- 172.21.15.18:0/2610809179 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9a4570 0x56366c99deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.507+0000 7fd632a00640 1 -- 172.21.15.18:0/2610809179 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9a4570 msgr2=0x56366c99deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.507+0000 7fd632a00640 1 --2- 172.21.15.18:0/2610809179 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9a4570 0x56366c99deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.507+0000 7fd632a00640 1 -- 172.21.15.18:0/2610809179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c9993b0 msgr2=0x56366c9ac6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.507+0000 7fd632a00640 1 --2- 172.21.15.18:0/2610809179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c9993b0 0x56366c9ac6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.507+0000 7fd632a00640 1 -- 172.21.15.18:0/2610809179 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56366c99e6e0 con 0x56366c999cd0 2024-09-12T02:59:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.507+0000 7fd632a00640 1 --2- 172.21.15.18:0/2610809179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c999cd0 0x56366c9acc30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x56366c99bf50 tx=0x7fd620005540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf7a268ddb0ca0a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.507+0000 7fd61d600640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:59:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.507+0000 7fd61d600640 1 -- 172.21.15.18:0/2610809179 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd620024040 con 0x56366c999cd0 2024-09-12T02:59:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.508+0000 7fd61d600640 1 -- 172.21.15.18:0/2610809179 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9562+0+0 (secure 0 0 0) 0x7fd620004a90 con 0x56366c999cd0 2024-09-12T02:59:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.508+0000 7fd63d47e740 1 -- 172.21.15.18:0/2610809179 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6240bc760 con 0x56366c999cd0 2024-09-12T02:59:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.508+0000 7fd61d600640 1 -- 172.21.15.18:0/2610809179 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fd62003a050 con 0x56366c999cd0 2024-09-12T02:59:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.508+0000 7fd63d47e740 10 client.25922 fetch_fsmap learned FSMap version 62 2024-09-12T02:59:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.508+0000 7fd63d47e740 1 -- 172.21.15.18:0/2610809179 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x56366ca1ecb0 con 0x56366c999cd0 2024-09-12T02:59:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.508+0000 7fd61d600640 1 -- 172.21.15.18:0/2610809179 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6240bc760 con 0x56366c999cd0 2024-09-12T02:59:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.508+0000 7fd61d600640 1 -- 172.21.15.18:0/2610809179 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 62) ==== 8446+0+0 (secure 0 0 0) 0x7fd62002a440 con 0x56366c999cd0 2024-09-12T02:59:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.508+0000 7fd63d47e740 10 client.25922 fetch_fsmap finished waiting for FSMap version 62 2024-09-12T02:59:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.509+0000 7fd63d47e740 10 client.25922 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:59:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.509+0000 7fd63d47e740 20 client.25922 populate_metadata read hostname 'smithi018' 2024-09-12T02:59:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.509+0000 7fd63d47e740 1 --2- 172.21.15.18:0/2610809179 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56366c9b4490 0x56366ca213b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.509+0000 7fd63d47e740 4 client.25922 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:59:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.509+0000 7fd63d47e740 1 -- 172.21.15.18:0/2610809179 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56366c906b80 con 0x56366c9b4490 2024-09-12T02:59:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.509+0000 7fd633400640 1 --2- 172.21.15.18:0/2610809179 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56366c9b4490 0x56366ca213b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.509+0000 7fd633400640 1 --2- 172.21.15.18:0/2610809179 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56366c9b4490 0x56366ca213b0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89c04822b680da50 server_cookie=6dd3750974056a25 in_seq=0 out_seq=0 2024-09-12T02:59:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.509+0000 7fd61d600640 10 client.25922 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:59:07.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.619+0000 7fd61d600640 1 -- 172.21.15.18:0/2610809179 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56366c906b80 con 0x56366c9b4490 2024-09-12T02:59:07.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.619+0000 7fd61d600640 10 client.25922 handle_command_reply: tid=0 2024-09-12T02:59:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.620+0000 7fd63d47e740 1 client.25922 shutdown 2024-09-12T02:59:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.623+0000 7fd63d47e740 1 -- 172.21.15.18:0/2610809179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c999cd0 msgr2=0x56366c9acc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.623+0000 7fd63d47e740 1 --2- 172.21.15.18:0/2610809179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c999cd0 0x56366c9acc30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x56366c99bf50 tx=0x7fd620005540 comp rx=0 tx=0).stop 2024-09-12T02:59:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.624+0000 7fd63d47e740 1 -- 172.21.15.18:0/2610809179 shutdown_connections 2024-09-12T02:59:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.624+0000 7fd63d47e740 1 --2- 172.21.15.18:0/2610809179 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56366c9b4490 0x56366ca213b0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.624+0000 7fd61d600640 0 client.25922 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:59:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.624+0000 7fd63d47e740 1 --2- 172.21.15.18:0/2610809179 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56366c9a4570 0x56366c99deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.624+0000 7fd63d47e740 1 --2- 172.21.15.18:0/2610809179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56366c999cd0 0x56366c9acc30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.624+0000 7fd63d47e740 1 --2- 172.21.15.18:0/2610809179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56366c9993b0 0x56366c9ac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.624+0000 7fd63d47e740 1 -- 172.21.15.18:0/2610809179 >> 172.21.15.18:0/2610809179 conn(0x56366c995920 msgr2=0x56366c9941a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.624+0000 7fd63d47e740 1 -- 172.21.15.18:0/2610809179 shutdown_connections 2024-09-12T02:59:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.624+0000 7fd63d47e740 1 -- 172.21.15.18:0/2610809179 wait complete. 2024-09-12T02:59:07.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.624+0000 7fd63d47e740 20 client.25922 trim_cache size 0 max 16384 2024-09-12T02:59:07.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:59:07.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:59:07.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:59:07.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:59:07.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.626+0000 7fd638e00640 1 -- 172.21.15.18:0/4060034007 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd6180a2d70 msgr2=0x7fd6180a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:07.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.626+0000 7fd638e00640 1 --2- 172.21.15.18:0/4060034007 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd6180a2d70 0x7fd6180a5230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd62c007f10 tx=0x7fd62c007520 comp rx=0 tx=0).stop 2024-09-12T02:59:07.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.626+0000 7fd638e00640 1 -- 172.21.15.18:0/4060034007 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd634102ae0 msgr2=0x7fd634100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:07.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.626+0000 7fd638e00640 1 --2- 172.21.15.18:0/4060034007 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd634102ae0 0x7fd634100730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd624004770 tx=0x7fd624003c10 comp rx=0 tx=0).stop 2024-09-12T02:59:07.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.626+0000 7fd638e00640 1 -- 172.21.15.18:0/4060034007 shutdown_connections 2024-09-12T02:59:07.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.626+0000 7fd638e00640 1 --2- 172.21.15.18:0/4060034007 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd6180a2d70 0x7fd6180a5230 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.626+0000 7fd638e00640 1 --2- 172.21.15.18:0/4060034007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd63410bf00 0x7fd6341011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.626+0000 7fd638e00640 1 --2- 172.21.15.18:0/4060034007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd634103400 0x7fd634100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.626+0000 7fd638e00640 1 --2- 172.21.15.18:0/4060034007 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd634102ae0 0x7fd634100730 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.626+0000 7fd638e00640 1 -- 172.21.15.18:0/4060034007 >> 172.21.15.18:0/4060034007 conn(0x7fd6340777c0 msgr2=0x7fd6340fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.626+0000 7fd638e00640 1 -- 172.21.15.18:0/4060034007 shutdown_connections 2024-09-12T02:59:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:07.626+0000 7fd638e00640 1 -- 172.21.15.18:0/4060034007 wait complete. 2024-09-12T02:59:08.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:08 smithi018 ceph-mon[30616]: pgmap v323: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 561 op/s 2024-09-12T02:59:08.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:08 smithi176 ceph-mon[35713]: pgmap v323: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 561 op/s 2024-09-12T02:59:08.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:08 smithi062 ceph-mon[35527]: pgmap v323: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 561 op/s 2024-09-12T02:59:09.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:09 smithi018 ceph-mon[30616]: osdmap e108: 12 total, 12 up, 12 in 2024-09-12T02:59:09.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:09 smithi176 ceph-mon[35713]: osdmap e108: 12 total, 12 up, 12 in 2024-09-12T02:59:09.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:09 smithi062 ceph-mon[35527]: osdmap e108: 12 total, 12 up, 12 in 2024-09-12T02:59:10.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:10 smithi018 ceph-mon[30616]: pgmap v325: 129 pgs: 45 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 68 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 657 op/s 2024-09-12T02:59:10.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:10 smithi176 ceph-mon[35713]: pgmap v325: 129 pgs: 45 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 68 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 657 op/s 2024-09-12T02:59:10.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:10 smithi062 ceph-mon[35527]: pgmap v325: 129 pgs: 45 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 68 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 657 op/s 2024-09-12T02:59:12.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:12 smithi176 ceph-mon[35713]: pgmap v326: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 641 op/s 2024-09-12T02:59:12.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:12 smithi062 ceph-mon[35527]: pgmap v326: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 641 op/s 2024-09-12T02:59:12.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:12 smithi018 ceph-mon[30616]: pgmap v326: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 641 op/s 2024-09-12T02:59:14.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:14 smithi176 ceph-mon[35713]: pgmap v327: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 641 op/s 2024-09-12T02:59:14.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:14 smithi062 ceph-mon[35527]: pgmap v327: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 641 op/s 2024-09-12T02:59:14.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:14 smithi018 ceph-mon[30616]: pgmap v327: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 641 op/s 2024-09-12T02:59:16.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:16 smithi176 ceph-mon[35713]: pgmap v328: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 393 op/s 2024-09-12T02:59:16.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:16 smithi062 ceph-mon[35527]: pgmap v328: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 393 op/s 2024-09-12T02:59:16.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:16 smithi018 ceph-mon[30616]: pgmap v328: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 393 op/s 2024-09-12T02:59:17.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:17 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:59:17.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:17 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:59:17.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:17 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:59:18.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:18 smithi176 ceph-mon[35713]: pgmap v329: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 350 op/s 2024-09-12T02:59:18.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:18 smithi062 ceph-mon[35527]: pgmap v329: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 350 op/s 2024-09-12T02:59:18.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:18 smithi018 ceph-mon[30616]: pgmap v329: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 350 op/s 2024-09-12T02:59:20.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:20 smithi176 ceph-mon[35713]: pgmap v330: 129 pgs: 63 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 46 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 353 op/s 2024-09-12T02:59:20.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:20 smithi062 ceph-mon[35527]: pgmap v330: 129 pgs: 63 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 46 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 353 op/s 2024-09-12T02:59:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.834+0000 7ff9af400640 1 -- 172.21.15.18:0/2129847150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a810e380 msgr2=0x7ff9a8110790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.834+0000 7ff9af400640 1 --2- 172.21.15.18:0/2129847150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a810e380 0x7ff9a8110790 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff998009860 tx=0x7ff99802a3d0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.835+0000 7ff9af400640 1 -- 172.21.15.18:0/2129847150 shutdown_connections 2024-09-12T02:59:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.835+0000 7ff9af400640 1 --2- 172.21.15.18:0/2129847150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a810e380 0x7ff9a8110790 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.835+0000 7ff9af400640 1 --2- 172.21.15.18:0/2129847150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9a8074ee0 0x7ff9a810de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.835+0000 7ff9af400640 1 --2- 172.21.15.18:0/2129847150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a80745c0 0x7ff9a80749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.835+0000 7ff9af400640 1 -- 172.21.15.18:0/2129847150 >> 172.21.15.18:0/2129847150 conn(0x7ff9a80fd7e0 msgr2=0x7ff9a80ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:20.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.837+0000 7ff9af400640 1 -- 172.21.15.18:0/2129847150 shutdown_connections 2024-09-12T02:59:20.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.837+0000 7ff9af400640 1 -- 172.21.15.18:0/2129847150 wait complete. 2024-09-12T02:59:20.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.838+0000 7ff9af400640 1 Processor -- start 2024-09-12T02:59:20.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.838+0000 7ff9af400640 1 -- start start 2024-09-12T02:59:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.839+0000 7ff9af400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a80745c0 0x7ff9a8107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.839+0000 7ff9af400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9a8074ee0 0x7ff9a8107990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.839+0000 7ff9af400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a810e380 0x7ff9a8102560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.839+0000 7ff9aca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a80745c0 0x7ff9a8107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.840+0000 7ff9aca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a80745c0 0x7ff9a8107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:47120/0 (socket says 172.21.15.18:47120) 2024-09-12T02:59:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.840+0000 7ff9a7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9a8074ee0 0x7ff9a8107990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.840+0000 7ff9aca00640 1 -- 172.21.15.18:0/1434182860 learned_addr learned my addr 172.21.15.18:0/1434182860 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:20.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.840+0000 7ff9af400640 1 -- 172.21.15.18:0/1434182860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a81140b0 con 0x7ff9a810e380 2024-09-12T02:59:20.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.840+0000 7ff9af400640 1 -- 172.21.15.18:0/1434182860 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a8113f30 con 0x7ff9a8074ee0 2024-09-12T02:59:20.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.840+0000 7ff9af400640 1 -- 172.21.15.18:0/1434182860 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a8114230 con 0x7ff9a80745c0 2024-09-12T02:59:20.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.840+0000 7ff9ad400640 1 --2- 172.21.15.18:0/1434182860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a810e380 0x7ff9a8102560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.841+0000 7ff9aca00640 1 -- 172.21.15.18:0/1434182860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9a8074ee0 msgr2=0x7ff9a8107990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.841+0000 7ff9aca00640 1 --2- 172.21.15.18:0/1434182860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9a8074ee0 0x7ff9a8107990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.841+0000 7ff9aca00640 1 -- 172.21.15.18:0/1434182860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a810e380 msgr2=0x7ff9a8102560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.841+0000 7ff9aca00640 1 --2- 172.21.15.18:0/1434182860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a810e380 0x7ff9a8102560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.841+0000 7ff9aca00640 1 -- 172.21.15.18:0/1434182860 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a8102e20 con 0x7ff9a80745c0 2024-09-12T02:59:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.841+0000 7ff9aca00640 1 --2- 172.21.15.18:0/1434182860 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a80745c0 0x7ff9a8107450 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000c420 tx=0x7ff9a0009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.841+0000 7ff9a5600640 1 -- 172.21.15.18:0/1434182860 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0003970 con 0x7ff9a80745c0 2024-09-12T02:59:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.842+0000 7ff9a5600640 1 -- 172.21.15.18:0/1434182860 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9a0004020 con 0x7ff9a80745c0 2024-09-12T02:59:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.842+0000 7ff9a5600640 1 -- 172.21.15.18:0/1434182860 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000ba10 con 0x7ff9a80745c0 2024-09-12T02:59:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.842+0000 7ff9af400640 1 -- 172.21.15.18:0/1434182860 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a8103110 con 0x7ff9a80745c0 2024-09-12T02:59:20.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.842+0000 7ff9af400640 1 -- 172.21.15.18:0/1434182860 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a810d340 con 0x7ff9a80745c0 2024-09-12T02:59:20.846 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.846+0000 7ff9b220c740 1 Processor -- start 2024-09-12T02:59:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.847+0000 7ff9b220c740 1 -- start start 2024-09-12T02:59:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.847+0000 7ff9b220c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f641e0 0x562938f645c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.847+0000 7ff9b220c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f64b00 0x562938f6ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.847+0000 7ff9b220c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f6f3a0 0x562938f71790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.847+0000 7ff9b220c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562938eca100 con 0x562938f64b00 2024-09-12T02:59:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.847+0000 7ff9b220c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562938e721b0 con 0x562938f641e0 2024-09-12T02:59:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.847+0000 7ff9b220c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562938ec60c0 con 0x562938f6f3a0 2024-09-12T02:59:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.850+0000 7ff9a5600640 1 -- 172.21.15.18:0/1434182860 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7ff9a001d020 con 0x7ff9a80745c0 2024-09-12T02:59:20.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:20 smithi018 ceph-mon[30616]: pgmap v330: 129 pgs: 63 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 46 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 353 op/s 2024-09-12T02:59:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.851+0000 7ff9ad400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f641e0 0x562938f645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.851+0000 7ff9ad400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f641e0 0x562938f645c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:53972/0 (socket says 172.21.15.18:53972) 2024-09-12T02:59:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.851+0000 7ff9ad400640 1 -- 172.21.15.18:0/1395321546 learned_addr learned my addr 172.21.15.18:0/1395321546 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.851+0000 7ff9a7e00640 1 --2- 172.21.15.18:0/1395321546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f6f3a0 0x562938f71790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.852+0000 7ff9ad400640 1 -- 172.21.15.18:0/1395321546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f6f3a0 msgr2=0x562938f71790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.852+0000 7ff9ad400640 1 --2- 172.21.15.18:0/1395321546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f6f3a0 0x562938f71790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.852+0000 7ff9ad400640 1 -- 172.21.15.18:0/1395321546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f64b00 msgr2=0x562938f6ee60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:59:20.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.852+0000 7ff9a5600640 1 --2- 172.21.15.18:0/1434182860 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff98c0a2e70 0x7ff98c0a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.852+0000 7ff9a5600640 1 -- 172.21.15.18:0/1434182860 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9650+0+0 (secure 0 0 0) 0x7ff9a00cf640 con 0x7ff9a80745c0 2024-09-12T02:59:20.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.853+0000 7ff9a7e00640 1 --2- 172.21.15.18:0/1434182860 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff98c0a2e70 0x7ff98c0a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.852+0000 7ff9aca00640 1 --2- 172.21.15.18:0/1395321546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f64b00 0x562938f6ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.854+0000 7ff9ad400640 1 --2- 172.21.15.18:0/1395321546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f64b00 0x562938f6ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.854+0000 7ff9ad400640 1 -- 172.21.15.18:0/1395321546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562938bdd210 con 0x562938f641e0 2024-09-12T02:59:20.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.854+0000 7ff9aca00640 1 --2- 172.21.15.18:0/1395321546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f64b00 0x562938f6ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:59:20.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.854+0000 7ff9ad400640 1 --2- 172.21.15.18:0/1395321546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f641e0 0x562938f645c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff998009860 tx=0x7ff998030ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f581bc885b20009 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:20.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.855+0000 7ff99dc00640 1 -- 172.21.15.18:0/1395321546 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9980303a0 con 0x562938f641e0 2024-09-12T02:59:20.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.855+0000 7ff9a7e00640 1 --2- 172.21.15.18:0/1434182860 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff98c0a2e70 0x7ff98c0a5330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x562938f61ad0 tx=0x7ff994005f90 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:20.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.855+0000 7ff99dc00640 1 -- 172.21.15.18:0/1395321546 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff998041070 con 0x562938f641e0 2024-09-12T02:59:20.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.855+0000 7ff99dc00640 1 -- 172.21.15.18:0/1395321546 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9980048e0 con 0x562938f641e0 2024-09-12T02:59:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.856+0000 7ff9b220c740 1 -- 172.21.15.18:0/1395321546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f641e0 msgr2=0x562938f645c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.856+0000 7ff9b220c740 1 --2- 172.21.15.18:0/1395321546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f641e0 0x562938f645c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff998009860 tx=0x7ff998030ab0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.857+0000 7ff9b220c740 1 -- 172.21.15.18:0/1395321546 shutdown_connections 2024-09-12T02:59:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.857+0000 7ff9b220c740 1 --2- 172.21.15.18:0/1395321546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f6f3a0 0x562938f71790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.857+0000 7ff9b220c740 1 --2- 172.21.15.18:0/1395321546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f64b00 0x562938f6ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.857+0000 7ff9b220c740 1 --2- 172.21.15.18:0/1395321546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f641e0 0x562938f645c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.858+0000 7ff9b220c740 1 -- 172.21.15.18:0/1395321546 >> 172.21.15.18:0/1395321546 conn(0x562938f60750 msgr2=0x562938f60b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.859+0000 7ff9b220c740 1 -- 172.21.15.18:0/1395321546 shutdown_connections 2024-09-12T02:59:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.859+0000 7ff9b220c740 1 -- 172.21.15.18:0/1395321546 wait complete. 2024-09-12T02:59:20.860 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.859+0000 7ff9b220c740 1 -- start start 2024-09-12T02:59:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.862+0000 7ff9b220c740 1 Processor -- start 2024-09-12T02:59:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.862+0000 7ff9b220c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f641e0 0x562938f6c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.862+0000 7ff9b220c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f64b00 0x562938f6c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.863+0000 7ff9b220c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f6f3a0 0x562938f6cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.863+0000 7ff9b220c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562938f71f70 con 0x562938f6f3a0 2024-09-12T02:59:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.863+0000 7ff9b220c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562938e53090 con 0x562938f64b00 2024-09-12T02:59:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.863+0000 7ff9b220c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562938f720f0 con 0x562938f641e0 2024-09-12T02:59:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.863+0000 7ff9a7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f64b00 0x562938f6c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.863+0000 7ff9a7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f64b00 0x562938f6c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:53986/0 (socket says 172.21.15.18:53986) 2024-09-12T02:59:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.863+0000 7ff9a7e00640 1 -- 172.21.15.18:0/3811673220 learned_addr learned my addr 172.21.15.18:0/3811673220 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.863+0000 7ff9b220c740 10 client.0 _ll_register_callbacks cb 0x562938ea7f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:59:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.864+0000 7ff9a7e00640 1 -- 172.21.15.18:0/3811673220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f641e0 msgr2=0x562938f6c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.864+0000 7ff9a7e00640 1 --2- 172.21.15.18:0/3811673220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f641e0 0x562938f6c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.864+0000 7ff9a7e00640 1 -- 172.21.15.18:0/3811673220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f6f3a0 msgr2=0x562938f6cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.864+0000 7ff9a7e00640 1 --2- 172.21.15.18:0/3811673220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f6f3a0 0x562938f6cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.864+0000 7ff9a7e00640 1 -- 172.21.15.18:0/3811673220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562938ca9620 con 0x562938f64b00 2024-09-12T02:59:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.864+0000 7ff992000640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:59:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.864+0000 7ff9a7e00640 1 --2- 172.21.15.18:0/3811673220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f64b00 0x562938f6c8a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff99401e9d0 tx=0x7ff994004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e43e3c88d2fb1536 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.865+0000 7ff992000640 1 -- 172.21.15.18:0/3811673220 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99402e060 con 0x562938f64b00 2024-09-12T02:59:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.865+0000 7ff9b220c740 1 -- 172.21.15.18:0/3811673220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff998041070 con 0x562938f64b00 2024-09-12T02:59:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.865+0000 7ff992000640 1 -- 172.21.15.18:0/3811673220 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9650+0+0 (secure 0 0 0) 0x7ff994024030 con 0x562938f64b00 2024-09-12T02:59:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.865+0000 7ff992000640 1 -- 172.21.15.18:0/3811673220 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7ff99402e060 con 0x562938f64b00 2024-09-12T02:59:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.866+0000 7ff9b220c740 10 client.25934 fetch_fsmap learned FSMap version 63 2024-09-12T02:59:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.866+0000 7ff9b220c740 1 -- 172.21.15.18:0/3811673220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x562938f7dbf0 con 0x562938f64b00 2024-09-12T02:59:20.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.868+0000 7ff992000640 1 -- 172.21.15.18:0/3811673220 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff998041070 con 0x562938f64b00 2024-09-12T02:59:20.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.868+0000 7ff992000640 1 -- 172.21.15.18:0/3811673220 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7ff99401c430 con 0x562938f64b00 2024-09-12T02:59:20.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.868+0000 7ff9b220c740 10 client.25934 fetch_fsmap finished waiting for FSMap version 63 2024-09-12T02:59:20.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.868+0000 7ff9b220c740 10 client.25934 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:59:20.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.868+0000 7ff9b220c740 20 client.25934 populate_metadata read hostname 'smithi018' 2024-09-12T02:59:20.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.868+0000 7ff9b220c740 1 --2- 172.21.15.18:0/3811673220 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562938f7f600 0x562938f81ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.869+0000 7ff9b220c740 4 client.25934 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:59:20.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.869+0000 7ff9b220c740 1 -- 172.21.15.18:0/3811673220 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562938ed7830 con 0x562938f7f600 2024-09-12T02:59:20.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.869+0000 7ff9aca00640 1 --2- 172.21.15.18:0/3811673220 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562938f7f600 0x562938f81ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.873+0000 7ff9aca00640 1 --2- 172.21.15.18:0/3811673220 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562938f7f600 0x562938f81ac0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc6b98d446525d83 server_cookie=e972778e0e47faa4 in_seq=0 out_seq=0 2024-09-12T02:59:20.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.873+0000 7ff992000640 10 client.25934 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:59:20.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.874+0000 7ff992000640 1 -- 172.21.15.18:0/3811673220 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562938ed7830 con 0x562938f7f600 2024-09-12T02:59:20.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.874+0000 7ff992000640 10 client.25934 handle_command_reply: tid=0 2024-09-12T02:59:20.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.874+0000 7ff9b220c740 1 client.25934 shutdown 2024-09-12T02:59:20.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.876+0000 7ff9b220c740 1 -- 172.21.15.18:0/3811673220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f64b00 msgr2=0x562938f6c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.876+0000 7ff9b220c740 1 --2- 172.21.15.18:0/3811673220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f64b00 0x562938f6c8a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff99401e9d0 tx=0x7ff994004730 comp rx=0 tx=0).stop 2024-09-12T02:59:20.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.876+0000 7ff9b220c740 1 -- 172.21.15.18:0/3811673220 shutdown_connections 2024-09-12T02:59:20.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.876+0000 7ff9b220c740 1 --2- 172.21.15.18:0/3811673220 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562938f7f600 0x562938f81ac0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.876+0000 7ff9b220c740 1 --2- 172.21.15.18:0/3811673220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f6f3a0 0x562938f6cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.876+0000 7ff992000640 0 client.25934 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:59:20.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.876+0000 7ff9b220c740 1 --2- 172.21.15.18:0/3811673220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f64b00 0x562938f6c8a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.876+0000 7ff9b220c740 1 --2- 172.21.15.18:0/3811673220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f641e0 0x562938f6c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.876+0000 7ff9b220c740 1 -- 172.21.15.18:0/3811673220 >> 172.21.15.18:0/3811673220 conn(0x562938f60750 msgr2=0x562938f664b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:20.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.876+0000 7ff9b220c740 1 -- 172.21.15.18:0/3811673220 shutdown_connections 2024-09-12T02:59:20.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.878+0000 7ff9b220c740 1 -- 172.21.15.18:0/3811673220 wait complete. 2024-09-12T02:59:20.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.878+0000 7ff9b220c740 20 client.25934 trim_cache size 0 max 16384 2024-09-12T02:59:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.922+0000 7ff9b220c740 1 Processor -- start 2024-09-12T02:59:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.923+0000 7ff9b220c740 1 -- start start 2024-09-12T02:59:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.923+0000 7ff9b220c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f641e0 0x562938f66ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.923+0000 7ff9b220c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f64b00 0x562938f6e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.923+0000 7ff9b220c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f6f3a0 0x562938f87390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.923+0000 7ff9b220c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a81be2f0 con 0x562938f64b00 2024-09-12T02:59:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.923+0000 7ff9b220c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a81c0130 con 0x562938f641e0 2024-09-12T02:59:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.923+0000 7ff9b220c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a81bea80 con 0x562938f6f3a0 2024-09-12T02:59:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.923+0000 7ff9aca00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f641e0 0x562938f66ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.924+0000 7ff9aca00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f641e0 0x562938f66ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:53996/0 (socket says 172.21.15.18:53996) 2024-09-12T02:59:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.923+0000 7ff9a7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f64b00 0x562938f6e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.924+0000 7ff9aca00640 1 -- 172.21.15.18:0/2552544645 learned_addr learned my addr 172.21.15.18:0/2552544645 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.924+0000 7ff9ad400640 1 --2- 172.21.15.18:0/2552544645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f6f3a0 0x562938f87390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.924+0000 7ff9aca00640 1 -- 172.21.15.18:0/2552544645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f6f3a0 msgr2=0x562938f87390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.924+0000 7ff9aca00640 1 --2- 172.21.15.18:0/2552544645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f6f3a0 0x562938f87390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.924+0000 7ff9aca00640 1 -- 172.21.15.18:0/2552544645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f64b00 msgr2=0x562938f6e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.924+0000 7ff9aca00640 1 --2- 172.21.15.18:0/2552544645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f64b00 0x562938f6e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.924+0000 7ff9aca00640 1 -- 172.21.15.18:0/2552544645 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562938f5bd60 con 0x562938f641e0 2024-09-12T02:59:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.925+0000 7ff9aca00640 1 --2- 172.21.15.18:0/2552544645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f641e0 0x562938f66ca0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000cd70 tx=0x7ff9a0050040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6394f823840b9327 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.925+0000 7ff99d200640 1 -- 172.21.15.18:0/2552544645 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a00b3020 con 0x562938f641e0 2024-09-12T02:59:20.927 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.926+0000 7ff99d200640 1 -- 172.21.15.18:0/2552544645 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9a009b6f0 con 0x562938f641e0 2024-09-12T02:59:20.927 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.926+0000 7ff99d200640 1 -- 172.21.15.18:0/2552544645 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0097d60 con 0x562938f641e0 2024-09-12T02:59:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.930+0000 7ff9b220c740 1 -- 172.21.15.18:0/2552544645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f641e0 msgr2=0x562938f66ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.930+0000 7ff9b220c740 1 --2- 172.21.15.18:0/2552544645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f641e0 0x562938f66ca0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000cd70 tx=0x7ff9a0050040 comp rx=0 tx=0).stop 2024-09-12T02:59:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.930+0000 7ff9b220c740 1 -- 172.21.15.18:0/2552544645 shutdown_connections 2024-09-12T02:59:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.930+0000 7ff9b220c740 1 --2- 172.21.15.18:0/2552544645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f6f3a0 0x562938f87390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.930+0000 7ff9b220c740 1 --2- 172.21.15.18:0/2552544645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f64b00 0x562938f6e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.930+0000 7ff9b220c740 1 --2- 172.21.15.18:0/2552544645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f641e0 0x562938f66ca0 secure :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000cd70 tx=0x7ff9a0050040 comp rx=0 tx=0).stop 2024-09-12T02:59:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.930+0000 7ff9b220c740 1 -- 172.21.15.18:0/2552544645 >> 172.21.15.18:0/2552544645 conn(0x562938f60750 msgr2=0x562938f6dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.930+0000 7ff9b220c740 1 -- 172.21.15.18:0/2552544645 shutdown_connections 2024-09-12T02:59:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.931+0000 7ff9b220c740 1 -- 172.21.15.18:0/2552544645 wait complete. 2024-09-12T02:59:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.931+0000 7ff9b220c740 1 -- start start 2024-09-12T02:59:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.931+0000 7ff9b220c740 1 Processor -- start 2024-09-12T02:59:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.932+0000 7ff9b220c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f64b00 0x562938f77be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.932+0000 7ff9b220c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f6f3a0 0x562938f72e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.932+0000 7ff9b220c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f73550 0x562938fe9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.933+0000 7ff9a7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f6f3a0 0x562938f72e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.933+0000 7ff9aca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f64b00 0x562938f77be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.933+0000 7ff9aca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f64b00 0x562938f77be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:47140/0 (socket says 172.21.15.18:47140) 2024-09-12T02:59:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.933+0000 7ff9aca00640 1 -- 172.21.15.18:0/3913449074 learned_addr learned my addr 172.21.15.18:0/3913449074 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.933+0000 7ff9ad400640 1 --2- 172.21.15.18:0/3913449074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f73550 0x562938fe9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.933+0000 7ff9b220c740 1 -- 172.21.15.18:0/3913449074 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a81bf9a0 con 0x562938f6f3a0 2024-09-12T02:59:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.934+0000 7ff9b220c740 1 -- 172.21.15.18:0/3913449074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a81bf210 con 0x562938f73550 2024-09-12T02:59:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.934+0000 7ff9b220c740 1 -- 172.21.15.18:0/3913449074 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a81bc270 con 0x562938f64b00 2024-09-12T02:59:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.934+0000 7ff9b220c740 10 client.0 _ll_register_callbacks cb 0x7ff994009a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:59:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.935+0000 7ff9aca00640 1 -- 172.21.15.18:0/3913449074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f73550 msgr2=0x562938fe9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.935+0000 7ff9aca00640 1 --2- 172.21.15.18:0/3913449074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f73550 0x562938fe9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.935+0000 7ff9aca00640 1 -- 172.21.15.18:0/3913449074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f6f3a0 msgr2=0x562938f72e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.935+0000 7ff9aca00640 1 --2- 172.21.15.18:0/3913449074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f6f3a0 0x562938f72e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.935+0000 7ff9aca00640 1 -- 172.21.15.18:0/3913449074 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562938f6c130 con 0x562938f64b00 2024-09-12T02:59:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.935+0000 7ff9a7e00640 1 --2- 172.21.15.18:0/3913449074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f6f3a0 0x562938f72e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:59:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.936+0000 7ff9aca00640 1 --2- 172.21.15.18:0/3913449074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f64b00 0x562938f77be0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff9a009b3f0 tx=0x7ff9a009b0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6642523f7f6f0af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.936+0000 7ff992000640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:59:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.936+0000 7ff992000640 1 -- 172.21.15.18:0/3913449074 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a00b3040 con 0x562938f64b00 2024-09-12T02:59:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.936+0000 7ff992000640 1 -- 172.21.15.18:0/3913449074 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9650+0+0 (secure 0 0 0) 0x7ff9a00ccba0 con 0x562938f64b00 2024-09-12T02:59:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.936+0000 7ff9b220c740 1 -- 172.21.15.18:0/3913449074 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9a009b6f0 con 0x562938f64b00 2024-09-12T02:59:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.937+0000 7ff992000640 1 -- 172.21.15.18:0/3913449074 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7ff9a009faa0 con 0x562938f64b00 2024-09-12T02:59:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.937+0000 7ff9b220c740 10 client.25933 fetch_fsmap learned FSMap version 63 2024-09-12T02:59:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.937+0000 7ff9b220c740 1 -- 172.21.15.18:0/3913449074 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x562938fea6f0 con 0x562938f64b00 2024-09-12T02:59:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.937+0000 7ff992000640 1 -- 172.21.15.18:0/3913449074 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9a009b6f0 con 0x562938f64b00 2024-09-12T02:59:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.937+0000 7ff992000640 1 -- 172.21.15.18:0/3913449074 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7ff9a000b040 con 0x562938f64b00 2024-09-12T02:59:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.938+0000 7ff9b220c740 10 client.25933 fetch_fsmap finished waiting for FSMap version 63 2024-09-12T02:59:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.938+0000 7ff9b220c740 10 client.25933 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:59:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.938+0000 7ff9b220c740 20 client.25933 populate_metadata read hostname 'smithi018' 2024-09-12T02:59:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.938+0000 7ff9b220c740 1 --2- 172.21.15.18:0/3913449074 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562938feae40 0x562938fed260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.938+0000 7ff9b220c740 4 client.25933 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:59:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.938+0000 7ff9b220c740 1 -- 172.21.15.18:0/3913449074 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562938ed1b80 con 0x562938feae40 2024-09-12T02:59:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.939+0000 7ff9a7e00640 1 --2- 172.21.15.18:0/3913449074 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562938feae40 0x562938fed260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.940+0000 7ff9a7e00640 1 --2- 172.21.15.18:0/3913449074 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562938feae40 0x562938fed260 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b33d5e4236fc0bc5 server_cookie=2d36256dc6ce8bd3 in_seq=0 out_seq=0 2024-09-12T02:59:20.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:20.940+0000 7ff992000640 10 client.25933 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:59:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.026+0000 7ff992000640 1 -- 172.21.15.18:0/3913449074 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562938ed1b80 con 0x562938feae40 2024-09-12T02:59:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.026+0000 7ff992000640 10 client.25933 handle_command_reply: tid=0 2024-09-12T02:59:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.027+0000 7ff9b220c740 1 client.25933 shutdown 2024-09-12T02:59:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.027+0000 7ff9b220c740 1 -- 172.21.15.18:0/3913449074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f64b00 msgr2=0x562938f77be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.027+0000 7ff9b220c740 1 --2- 172.21.15.18:0/3913449074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f64b00 0x562938f77be0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff9a009b3f0 tx=0x7ff9a009b0d0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.027+0000 7ff9b220c740 1 -- 172.21.15.18:0/3913449074 shutdown_connections 2024-09-12T02:59:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.027+0000 7ff9b220c740 1 --2- 172.21.15.18:0/3913449074 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x562938feae40 0x562938fed260 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.028+0000 7ff9b220c740 1 --2- 172.21.15.18:0/3913449074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562938f73550 0x562938fe9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.028+0000 7ff992000640 0 client.25933 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:59:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.028+0000 7ff9b220c740 1 --2- 172.21.15.18:0/3913449074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562938f6f3a0 0x562938f72e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.028+0000 7ff9b220c740 1 --2- 172.21.15.18:0/3913449074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562938f64b00 0x562938f77be0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.028+0000 7ff9b220c740 1 -- 172.21.15.18:0/3913449074 >> 172.21.15.18:0/3913449074 conn(0x562938f60750 msgr2=0x562938f7a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.028+0000 7ff9b220c740 1 -- 172.21.15.18:0/3913449074 shutdown_connections 2024-09-12T02:59:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.028+0000 7ff9b220c740 1 -- 172.21.15.18:0/3913449074 wait complete. 2024-09-12T02:59:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.029+0000 7ff9b220c740 20 client.25933 trim_cache size 0 max 16384 2024-09-12T02:59:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:59:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:59:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:59:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:59:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.030+0000 7ff9af400640 1 -- 172.21.15.18:0/1434182860 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff98c0a2e70 msgr2=0x7ff98c0a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.030+0000 7ff9af400640 1 --2- 172.21.15.18:0/1434182860 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff98c0a2e70 0x7ff98c0a5330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x562938f61ad0 tx=0x7ff994005f90 comp rx=0 tx=0).stop 2024-09-12T02:59:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.030+0000 7ff9af400640 1 -- 172.21.15.18:0/1434182860 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a80745c0 msgr2=0x7ff9a8107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.030+0000 7ff9af400640 1 --2- 172.21.15.18:0/1434182860 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a80745c0 0x7ff9a8107450 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000c420 tx=0x7ff9a0009f90 comp rx=0 tx=0).stop 2024-09-12T02:59:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.030+0000 7ff9af400640 1 -- 172.21.15.18:0/1434182860 shutdown_connections 2024-09-12T02:59:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.030+0000 7ff9af400640 1 --2- 172.21.15.18:0/1434182860 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff98c0a2e70 0x7ff98c0a5330 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.030+0000 7ff9af400640 1 --2- 172.21.15.18:0/1434182860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a810e380 0x7ff9a8102560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.030+0000 7ff9af400640 1 --2- 172.21.15.18:0/1434182860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9a8074ee0 0x7ff9a8107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.030+0000 7ff9af400640 1 --2- 172.21.15.18:0/1434182860 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a80745c0 0x7ff9a8107450 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.030+0000 7ff9af400640 1 -- 172.21.15.18:0/1434182860 >> 172.21.15.18:0/1434182860 conn(0x7ff9a80fd7e0 msgr2=0x7ff9a80fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.032+0000 7ff9af400640 1 -- 172.21.15.18:0/1434182860 shutdown_connections 2024-09-12T02:59:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:21.032+0000 7ff9af400640 1 -- 172.21.15.18:0/1434182860 wait complete. 2024-09-12T02:59:22.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:22 smithi176 ceph-mon[35713]: pgmap v331: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 192 op/s 2024-09-12T02:59:22.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:22 smithi062 ceph-mon[35527]: pgmap v331: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 192 op/s 2024-09-12T02:59:22.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:22 smithi018 ceph-mon[30616]: pgmap v331: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 192 op/s 2024-09-12T02:59:24.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:24 smithi176 ceph-mon[35713]: pgmap v332: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 101 op/s 2024-09-12T02:59:24.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:24 smithi062 ceph-mon[35527]: pgmap v332: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 101 op/s 2024-09-12T02:59:24.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:24 smithi018 ceph-mon[30616]: pgmap v332: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 101 op/s 2024-09-12T02:59:26.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:26 smithi176 ceph-mon[35713]: pgmap v333: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 143 op/s 2024-09-12T02:59:26.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:26 smithi062 ceph-mon[35527]: pgmap v333: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 143 op/s 2024-09-12T02:59:26.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:26 smithi018 ceph-mon[30616]: pgmap v333: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 143 op/s 2024-09-12T02:59:28.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:28 smithi176 ceph-mon[35713]: pgmap v334: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 104 op/s 2024-09-12T02:59:28.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:28 smithi062 ceph-mon[35527]: pgmap v334: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 104 op/s 2024-09-12T02:59:28.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:28 smithi018 ceph-mon[30616]: pgmap v334: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 104 op/s 2024-09-12T02:59:30.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:30 smithi176 ceph-mon[35713]: pgmap v335: 129 pgs: 56 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 118 op/s 2024-09-12T02:59:30.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:30 smithi062 ceph-mon[35527]: pgmap v335: 129 pgs: 56 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 118 op/s 2024-09-12T02:59:30.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:30 smithi018 ceph-mon[30616]: pgmap v335: 129 pgs: 56 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 118 op/s 2024-09-12T02:59:32.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:32 smithi176 ceph-mon[35713]: pgmap v336: 129 pgs: 56 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 115 op/s 2024-09-12T02:59:32.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:32 smithi062 ceph-mon[35527]: pgmap v336: 129 pgs: 56 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 115 op/s 2024-09-12T02:59:32.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:32 smithi018 ceph-mon[30616]: pgmap v336: 129 pgs: 56 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 115 op/s 2024-09-12T02:59:34.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.378+0000 7f84e6800640 1 -- 172.21.15.18:0/3464139013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84e010bf00 msgr2=0x7f84e010e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:34.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.378+0000 7f84e6800640 1 --2- 172.21.15.18:0/3464139013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84e010bf00 0x7f84e010e370 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f84d8009900 tx=0x7f84d802a480 comp rx=0 tx=0).stop 2024-09-12T02:59:34.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.378+0000 7f84e6800640 1 -- 172.21.15.18:0/3464139013 shutdown_connections 2024-09-12T02:59:34.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.378+0000 7f84e6800640 1 --2- 172.21.15.18:0/3464139013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84e010bf00 0x7f84e010e370 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.378+0000 7f84e6800640 1 --2- 172.21.15.18:0/3464139013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84e0103400 0x7f84e010b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.378+0000 7f84e6800640 1 --2- 172.21.15.18:0/3464139013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e0102ae0 0x7f84e0102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.378+0000 7f84e6800640 1 -- 172.21.15.18:0/3464139013 >> 172.21.15.18:0/3464139013 conn(0x7f84e00777c0 msgr2=0x7f84e00feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:34.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.379+0000 7f84e6800640 1 -- 172.21.15.18:0/3464139013 shutdown_connections 2024-09-12T02:59:34.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.379+0000 7f84e6800640 1 -- 172.21.15.18:0/3464139013 wait complete. 2024-09-12T02:59:34.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.381+0000 7f84e6800640 1 Processor -- start 2024-09-12T02:59:34.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.381+0000 7f84e6800640 1 -- start start 2024-09-12T02:59:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.382+0000 7f84e6800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e0102ae0 0x7f84e0198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.382+0000 7f84e6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84e0103400 0x7f84e0198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.382+0000 7f84e6800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84e010bf00 0x7f84e019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.382+0000 7f84e6800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f84e0111d60 con 0x7f84e0103400 2024-09-12T02:59:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.382+0000 7f84e6800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f84e0111be0 con 0x7f84e0102ae0 2024-09-12T02:59:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.382+0000 7f84e6800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84e0111ee0 con 0x7f84e010bf00 2024-09-12T02:59:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.382+0000 7f84e5400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e0102ae0 0x7f84e0198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.383+0000 7f84e5e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84e010bf00 0x7f84e019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.383+0000 7f84e5400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e0102ae0 0x7f84e0198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:46828/0 (socket says 172.21.15.18:46828) 2024-09-12T02:59:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.383+0000 7f84e5400640 1 -- 172.21.15.18:0/51170482 learned_addr learned my addr 172.21.15.18:0/51170482 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.383+0000 7f84e4a00640 1 --2- 172.21.15.18:0/51170482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84e0103400 0x7f84e0198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:34.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.383+0000 7f84e5e00640 1 -- 172.21.15.18:0/51170482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e0102ae0 msgr2=0x7f84e0198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:34.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.383+0000 7f84e5e00640 1 --2- 172.21.15.18:0/51170482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e0102ae0 0x7f84e0198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.383+0000 7f84e5e00640 1 -- 172.21.15.18:0/51170482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84e0103400 msgr2=0x7f84e0198790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:34.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.383+0000 7f84e5e00640 1 --2- 172.21.15.18:0/51170482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84e0103400 0x7f84e0198790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.383+0000 7f84e5e00640 1 -- 172.21.15.18:0/51170482 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e019d240 con 0x7f84e010bf00 2024-09-12T02:59:34.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.383+0000 7f84e4a00640 1 --2- 172.21.15.18:0/51170482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84e0103400 0x7f84e0198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:34.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.384+0000 7f84e5e00640 1 --2- 172.21.15.18:0/51170482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84e010bf00 0x7f84e019cb10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f84d8009230 tx=0x7f84d8003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.386+0000 7f84de000640 1 -- 172.21.15.18:0/51170482 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d803f070 con 0x7f84e010bf00 2024-09-12T02:59:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.386+0000 7f84de000640 1 -- 172.21.15.18:0/51170482 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84d8031c90 con 0x7f84e010bf00 2024-09-12T02:59:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.386+0000 7f84e6800640 1 -- 172.21.15.18:0/51170482 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e019d4d0 con 0x7f84e010bf00 2024-09-12T02:59:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.387+0000 7f84de000640 1 -- 172.21.15.18:0/51170482 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8035030 con 0x7f84e010bf00 2024-09-12T02:59:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.387+0000 7f84e6800640 1 -- 172.21.15.18:0/51170482 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e01a4dc0 con 0x7f84e010bf00 2024-09-12T02:59:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.398+0000 7f84eac15740 1 Processor -- start 2024-09-12T02:59:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.399+0000 7f84de000640 1 -- 172.21.15.18:0/51170482 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f84d8042070 con 0x7f84e010bf00 2024-09-12T02:59:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.399+0000 7f84eac15740 1 -- start start 2024-09-12T02:59:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.402+0000 7f84eac15740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a553b0 0x5607f6a55790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.402+0000 7f84eac15740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a55cd0 0x5607f6a60030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.402+0000 7f84eac15740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a60570 0x5607f6a62960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.402+0000 7f84eac15740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5607f69bb100 con 0x5607f6a60570 2024-09-12T02:59:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.402+0000 7f84eac15740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5607f69631b0 con 0x5607f6a553b0 2024-09-12T02:59:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.402+0000 7f84eac15740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5607f69b70c0 con 0x5607f6a55cd0 2024-09-12T02:59:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.403+0000 7f84e5400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a55cd0 0x5607f6a60030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.403+0000 7f84e4a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a60570 0x5607f6a62960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.403+0000 7f84de000640 1 --2- 172.21.15.18:0/51170482 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f84c80a2d70 0x7f84c80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.403+0000 7f84e4a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a60570 0x5607f6a62960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34406/0 (socket says 172.21.15.18:34406) 2024-09-12T02:59:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.403+0000 7f84e4a00640 1 -- 172.21.15.18:0/3763227348 learned_addr learned my addr 172.21.15.18:0/3763227348 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:34.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.403+0000 7f84e5400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a55cd0 0x5607f6a60030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:60096/0 (socket says 172.21.15.18:60096) 2024-09-12T02:59:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.403+0000 7f84de000640 1 -- 172.21.15.18:0/51170482 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9650+0+0 (secure 0 0 0) 0x7f84d80efff0 con 0x7f84e010bf00 2024-09-12T02:59:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.403+0000 7f84e4a00640 1 --2- 172.21.15.18:0/3763227348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a553b0 0x5607f6a55790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.404+0000 7f84e5e00640 1 --2- 172.21.15.18:0/51170482 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f84c80a2d70 0x7f84c80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.404+0000 7f84e5e00640 1 --2- 172.21.15.18:0/51170482 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f84c80a2d70 0x7f84c80a5230 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f84d80b8500 tx=0x7f84d8034000 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.405+0000 7f84e5400640 1 -- 172.21.15.18:0/3763227348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a553b0 msgr2=0x5607f6a55790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.405+0000 7f84e5400640 1 --2- 172.21.15.18:0/3763227348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a553b0 0x5607f6a55790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.405+0000 7f84e5400640 1 -- 172.21.15.18:0/3763227348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a60570 msgr2=0x5607f6a62960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.406+0000 7f84e5400640 1 --2- 172.21.15.18:0/3763227348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a60570 0x5607f6a62960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.407+0000 7f84e5400640 1 -- 172.21.15.18:0/3763227348 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f66ce210 con 0x5607f6a55cd0 2024-09-12T02:59:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.407+0000 7f84e5400640 1 --2- 172.21.15.18:0/3763227348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a55cd0 0x5607f6a60030 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f84d4007f90 tx=0x7f84d400f850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fd885f90126cf89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.408+0000 7f84d2600640 1 -- 172.21.15.18:0/3763227348 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4004d20 con 0x5607f6a55cd0 2024-09-12T02:59:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.408+0000 7f84d2600640 1 -- 172.21.15.18:0/3763227348 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84d4010be0 con 0x5607f6a55cd0 2024-09-12T02:59:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.408+0000 7f84d2600640 1 -- 172.21.15.18:0/3763227348 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d40057e0 con 0x5607f6a55cd0 2024-09-12T02:59:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.409+0000 7f84eac15740 1 -- 172.21.15.18:0/3763227348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a55cd0 msgr2=0x5607f6a60030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.409+0000 7f84eac15740 1 --2- 172.21.15.18:0/3763227348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a55cd0 0x5607f6a60030 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f84d4007f90 tx=0x7f84d400f850 comp rx=0 tx=0).stop 2024-09-12T02:59:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.409+0000 7f84eac15740 1 -- 172.21.15.18:0/3763227348 shutdown_connections 2024-09-12T02:59:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.409+0000 7f84eac15740 1 --2- 172.21.15.18:0/3763227348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a60570 0x5607f6a62960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.409+0000 7f84eac15740 1 --2- 172.21.15.18:0/3763227348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a55cd0 0x5607f6a60030 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.409+0000 7f84eac15740 1 --2- 172.21.15.18:0/3763227348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a553b0 0x5607f6a55790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.409+0000 7f84eac15740 1 -- 172.21.15.18:0/3763227348 >> 172.21.15.18:0/3763227348 conn(0x5607f6a51920 msgr2=0x5607f6a51d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:34.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.410+0000 7f84eac15740 1 -- 172.21.15.18:0/3763227348 shutdown_connections 2024-09-12T02:59:34.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.410+0000 7f84eac15740 1 -- 172.21.15.18:0/3763227348 wait complete. 2024-09-12T02:59:34.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.411+0000 7f84eac15740 1 -- start start 2024-09-12T02:59:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.411+0000 7f84eac15740 1 Processor -- start 2024-09-12T02:59:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.412+0000 7f84eac15740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a553b0 0x5607f6a5d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.413+0000 7f84eac15740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a55cd0 0x5607f6a5db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.413+0000 7f84eac15740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a60570 0x5607f6a5e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.413+0000 7f84eac15740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5607f6a62ff0 con 0x5607f6a553b0 2024-09-12T02:59:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.413+0000 7f84eac15740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5607f6944090 con 0x5607f6a55cd0 2024-09-12T02:59:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.413+0000 7f84eac15740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5607f6a63170 con 0x5607f6a60570 2024-09-12T02:59:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.413+0000 7f84eac15740 10 client.0 _ll_register_callbacks cb 0x5607f6998f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:59:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.413+0000 7f84e5400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a55cd0 0x5607f6a5db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.413+0000 7f84e5400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a55cd0 0x5607f6a5db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:46846/0 (socket says 172.21.15.18:46846) 2024-09-12T02:59:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.413+0000 7f84e5400640 1 -- 172.21.15.18:0/3102299120 learned_addr learned my addr 172.21.15.18:0/3102299120 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.414+0000 7f84e4a00640 1 --2- 172.21.15.18:0/3102299120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a553b0 0x5607f6a5d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.415+0000 7f84e5400640 1 -- 172.21.15.18:0/3102299120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a60570 msgr2=0x5607f6a5e040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:59:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.415+0000 7f84e5400640 1 --2- 172.21.15.18:0/3102299120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a60570 0x5607f6a5e040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.415+0000 7f84e5400640 1 -- 172.21.15.18:0/3102299120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a553b0 msgr2=0x5607f6a5d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.415+0000 7f84e5400640 1 --2- 172.21.15.18:0/3102299120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a553b0 0x5607f6a5d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.415+0000 7f84e5400640 1 -- 172.21.15.18:0/3102299120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607f679a620 con 0x5607f6a55cd0 2024-09-12T02:59:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.416+0000 7f84e5400640 1 --2- 172.21.15.18:0/3102299120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a55cd0 0x5607f6a5db00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f84d4000f80 tx=0x7f84d40051a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be2256be08535eca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.416+0000 7f84c6a00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:59:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.417+0000 7f84c6a00640 1 -- 172.21.15.18:0/3102299120 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4026020 con 0x5607f6a55cd0 2024-09-12T02:59:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.417+0000 7f84c6a00640 1 -- 172.21.15.18:0/3102299120 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9650+0+0 (secure 0 0 0) 0x7f84d4005780 con 0x5607f6a55cd0 2024-09-12T02:59:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.418+0000 7f84eac15740 1 -- 172.21.15.18:0/3102299120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84d4010be0 con 0x5607f6a55cd0 2024-09-12T02:59:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.419+0000 7f84c6a00640 1 -- 172.21.15.18:0/3102299120 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f84d4031050 con 0x5607f6a55cd0 2024-09-12T02:59:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.419+0000 7f84eac15740 10 client.25949 fetch_fsmap learned FSMap version 63 2024-09-12T02:59:34.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.419+0000 7f84eac15740 1 -- 172.21.15.18:0/3102299120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x5607f6a77600 con 0x5607f6a55cd0 2024-09-12T02:59:34.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.420+0000 7f84c6a00640 1 -- 172.21.15.18:0/3102299120 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84d4010be0 con 0x5607f6a55cd0 2024-09-12T02:59:34.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.420+0000 7f84c6a00640 1 -- 172.21.15.18:0/3102299120 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f84d4022890 con 0x5607f6a55cd0 2024-09-12T02:59:34.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.421+0000 7f84eac15740 10 client.25949 fetch_fsmap finished waiting for FSMap version 63 2024-09-12T02:59:34.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.421+0000 7f84eac15740 10 client.25949 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:59:34.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.421+0000 7f84eac15740 20 client.25949 populate_metadata read hostname 'smithi018' 2024-09-12T02:59:34.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.421+0000 7f84eac15740 1 --2- 172.21.15.18:0/3102299120 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5607f6a78ac0 0x5607f6a7aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.421+0000 7f84eac15740 4 client.25949 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:59:34.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.421+0000 7f84eac15740 1 -- 172.21.15.18:0/3102299120 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607f69c8830 con 0x5607f6a78ac0 2024-09-12T02:59:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.421+0000 7f84e4a00640 1 --2- 172.21.15.18:0/3102299120 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5607f6a78ac0 0x5607f6a7aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.422+0000 7f84e4a00640 1 --2- 172.21.15.18:0/3102299120 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5607f6a78ac0 0x5607f6a7aeb0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7459a58b81d43f9 server_cookie=832f533f234c718 in_seq=0 out_seq=0 2024-09-12T02:59:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.422+0000 7f84c6a00640 10 client.25949 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:59:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.423+0000 7f84c6a00640 1 -- 172.21.15.18:0/3102299120 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5607f69c8830 con 0x5607f6a78ac0 2024-09-12T02:59:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.423+0000 7f84c6a00640 10 client.25949 handle_command_reply: tid=0 2024-09-12T02:59:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.424+0000 7f84eac15740 1 client.25949 shutdown 2024-09-12T02:59:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.424+0000 7f84eac15740 1 -- 172.21.15.18:0/3102299120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a55cd0 msgr2=0x5607f6a5db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.424+0000 7f84eac15740 1 --2- 172.21.15.18:0/3102299120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a55cd0 0x5607f6a5db00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f84d4000f80 tx=0x7f84d40051a0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.424+0000 7f84eac15740 1 -- 172.21.15.18:0/3102299120 shutdown_connections 2024-09-12T02:59:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.424+0000 7f84eac15740 1 --2- 172.21.15.18:0/3102299120 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5607f6a78ac0 0x5607f6a7aeb0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.424+0000 7f84eac15740 1 --2- 172.21.15.18:0/3102299120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a60570 0x5607f6a5e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.424+0000 7f84eac15740 1 --2- 172.21.15.18:0/3102299120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a55cd0 0x5607f6a5db00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.424+0000 7f84eac15740 1 --2- 172.21.15.18:0/3102299120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a553b0 0x5607f6a5d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.424+0000 7f84c6a00640 0 client.25949 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:59:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.424+0000 7f84eac15740 1 -- 172.21.15.18:0/3102299120 >> 172.21.15.18:0/3102299120 conn(0x5607f6a51920 msgr2=0x5607f6a57630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.425+0000 7f84eac15740 1 -- 172.21.15.18:0/3102299120 shutdown_connections 2024-09-12T02:59:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.425+0000 7f84eac15740 1 -- 172.21.15.18:0/3102299120 wait complete. 2024-09-12T02:59:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.425+0000 7f84eac15740 20 client.25949 trim_cache size 0 max 16384 2024-09-12T02:59:34.469 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.468+0000 7f84eac15740 1 Processor -- start 2024-09-12T02:59:34.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.468+0000 7f84eac15740 1 -- start start 2024-09-12T02:59:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.469+0000 7f84eac15740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a553b0 0x5607f6a805d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.469+0000 7f84eac15740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a55cd0 0x5607f6a80b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.469+0000 7f84eac15740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a60570 0x5607f6a56e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.469+0000 7f84eac15740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f84e01ace50 con 0x5607f6a60570 2024-09-12T02:59:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.469+0000 7f84eac15740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f84e01aec90 con 0x5607f6a553b0 2024-09-12T02:59:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.469+0000 7f84eac15740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84e01ad5e0 con 0x5607f6a55cd0 2024-09-12T02:59:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.469+0000 7f84e4a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a553b0 0x5607f6a805d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.469+0000 7f84e4a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a553b0 0x5607f6a805d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:46858/0 (socket says 172.21.15.18:46858) 2024-09-12T02:59:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.469+0000 7f84e4a00640 1 -- 172.21.15.18:0/3868282713 learned_addr learned my addr 172.21.15.18:0/3868282713 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.470+0000 7f84e5400640 1 --2- 172.21.15.18:0/3868282713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a55cd0 0x5607f6a80b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.470+0000 7f84e4a00640 1 --2- 172.21.15.18:0/3868282713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a60570 0x5607f6a56e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.471+0000 7f84e5400640 1 -- 172.21.15.18:0/3868282713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a553b0 msgr2=0x5607f6a805d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.471+0000 7f84e5400640 1 --2- 172.21.15.18:0/3868282713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a553b0 0x5607f6a805d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.471+0000 7f84e5400640 1 -- 172.21.15.18:0/3868282713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a60570 msgr2=0x5607f6a56e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.471+0000 7f84e5400640 1 --2- 172.21.15.18:0/3868282713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a60570 0x5607f6a56e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.472+0000 7f84e5400640 1 -- 172.21.15.18:0/3868282713 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f6a4bc20 con 0x5607f6a55cd0 2024-09-12T02:59:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.472+0000 7f84e4a00640 1 --2- 172.21.15.18:0/3868282713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a60570 0x5607f6a56e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:59:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.473+0000 7f84e5400640 1 --2- 172.21.15.18:0/3868282713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a55cd0 0x5607f6a80b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f84d4022e50 tx=0x7f84d4007440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e61a8602167f4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:34.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.474+0000 7f84d1c00640 1 -- 172.21.15.18:0/3868282713 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d403a070 con 0x5607f6a55cd0 2024-09-12T02:59:34.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.474+0000 7f84d1c00640 1 -- 172.21.15.18:0/3868282713 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84d400fd50 con 0x5607f6a55cd0 2024-09-12T02:59:34.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.474+0000 7f84d1c00640 1 -- 172.21.15.18:0/3868282713 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4026070 con 0x5607f6a55cd0 2024-09-12T02:59:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.475+0000 7f84eac15740 1 -- 172.21.15.18:0/3868282713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a55cd0 msgr2=0x5607f6a80b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.475+0000 7f84eac15740 1 --2- 172.21.15.18:0/3868282713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a55cd0 0x5607f6a80b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f84d4022e50 tx=0x7f84d4007440 comp rx=0 tx=0).stop 2024-09-12T02:59:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.476+0000 7f84eac15740 1 -- 172.21.15.18:0/3868282713 shutdown_connections 2024-09-12T02:59:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.476+0000 7f84eac15740 1 --2- 172.21.15.18:0/3868282713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a60570 0x5607f6a56e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.476+0000 7f84eac15740 1 --2- 172.21.15.18:0/3868282713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a55cd0 0x5607f6a80b10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.476+0000 7f84eac15740 1 --2- 172.21.15.18:0/3868282713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a553b0 0x5607f6a805d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.476+0000 7f84eac15740 1 -- 172.21.15.18:0/3868282713 >> 172.21.15.18:0/3868282713 conn(0x5607f6a51920 msgr2=0x5607f6a5c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.476+0000 7f84eac15740 1 -- 172.21.15.18:0/3868282713 shutdown_connections 2024-09-12T02:59:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.476+0000 7f84eac15740 1 -- 172.21.15.18:0/3868282713 wait complete. 2024-09-12T02:59:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.477+0000 7f84eac15740 1 -- start start 2024-09-12T02:59:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.477+0000 7f84eac15740 1 Processor -- start 2024-09-12T02:59:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.478+0000 7f84eac15740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a553b0 0x5607f6a70ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.478+0000 7f84eac15740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a55cd0 0x5607f6a71220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.478+0000 7f84eac15740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a60570 0x5607f6a599f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.478+0000 7f84eac15740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f84e01ae500 con 0x5607f6a55cd0 2024-09-12T02:59:34.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.478+0000 7f84eac15740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f84e01add70 con 0x5607f6a60570 2024-09-12T02:59:34.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.478+0000 7f84eac15740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84e01aae50 con 0x5607f6a553b0 2024-09-12T02:59:34.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.478+0000 7f84eac15740 10 client.0 _ll_register_callbacks cb 0x7f84cc00fb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:59:34.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.478+0000 7f84e4a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a553b0 0x5607f6a70ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:34.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.478+0000 7f84e4a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a553b0 0x5607f6a70ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:60128/0 (socket says 172.21.15.18:60128) 2024-09-12T02:59:34.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.478+0000 7f84e4a00640 1 -- 172.21.15.18:0/3549789761 learned_addr learned my addr 172.21.15.18:0/3549789761 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:34.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.478+0000 7f84e4a00640 1 --2- 172.21.15.18:0/3549789761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a60570 0x5607f6a599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:34.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.479+0000 7f84e4a00640 1 -- 172.21.15.18:0/3549789761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a60570 msgr2=0x5607f6a599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:34.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.479+0000 7f84e4a00640 1 --2- 172.21.15.18:0/3549789761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a60570 0x5607f6a599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.479+0000 7f84e4a00640 1 -- 172.21.15.18:0/3549789761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a55cd0 msgr2=0x5607f6a71220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:34.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.479+0000 7f84e4a00640 1 --2- 172.21.15.18:0/3549789761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a55cd0 0x5607f6a71220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.479+0000 7f84e4a00640 1 -- 172.21.15.18:0/3549789761 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607f6a59f30 con 0x5607f6a553b0 2024-09-12T02:59:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.480+0000 7f84e4a00640 1 --2- 172.21.15.18:0/3549789761 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a553b0 0x5607f6a70ce0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f84cc01faf0 tx=0x7f84cc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b76550be5b9d9be0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.480+0000 7f84c6a00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:59:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.480+0000 7f84c6a00640 1 -- 172.21.15.18:0/3549789761 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc018040 con 0x5607f6a553b0 2024-09-12T02:59:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.480+0000 7f84c6a00640 1 -- 172.21.15.18:0/3549789761 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9650+0+0 (secure 0 0 0) 0x7f84cc02a410 con 0x5607f6a553b0 2024-09-12T02:59:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.481+0000 7f84eac15740 1 -- 172.21.15.18:0/3549789761 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84d400fd50 con 0x5607f6a553b0 2024-09-12T02:59:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.481+0000 7f84c6a00640 1 -- 172.21.15.18:0/3549789761 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f84cc01fca0 con 0x5607f6a553b0 2024-09-12T02:59:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.481+0000 7f84eac15740 10 client.25948 fetch_fsmap learned FSMap version 63 2024-09-12T02:59:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.481+0000 7f84eac15740 1 -- 172.21.15.18:0/3549789761 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x5607f6af3d00 con 0x5607f6a553b0 2024-09-12T02:59:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.482+0000 7f84c6a00640 1 -- 172.21.15.18:0/3549789761 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84d400fd50 con 0x5607f6a553b0 2024-09-12T02:59:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.483+0000 7f84c6a00640 1 -- 172.21.15.18:0/3549789761 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f84cc01e040 con 0x5607f6a553b0 2024-09-12T02:59:34.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.485+0000 7f84eac15740 10 client.25948 fetch_fsmap finished waiting for FSMap version 63 2024-09-12T02:59:34.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.485+0000 7f84eac15740 10 client.25948 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:59:34.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.485+0000 7f84eac15740 20 client.25948 populate_metadata read hostname 'smithi018' 2024-09-12T02:59:34.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.485+0000 7f84eac15740 1 --2- 172.21.15.18:0/3549789761 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5607f6af44e0 0x5607f6af6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:34.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.485+0000 7f84eac15740 4 client.25948 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:59:34.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.485+0000 7f84eac15740 1 -- 172.21.15.18:0/3549789761 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5607f69c2b80 con 0x5607f6af44e0 2024-09-12T02:59:34.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.486+0000 7f84e5400640 1 --2- 172.21.15.18:0/3549789761 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5607f6af44e0 0x5607f6af6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:34.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.487+0000 7f84e5400640 1 --2- 172.21.15.18:0/3549789761 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5607f6af44e0 0x5607f6af6940 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43b23815c43882c0 server_cookie=2eaa9b534acd53ce in_seq=0 out_seq=0 2024-09-12T02:59:34.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.487+0000 7f84c6a00640 10 client.25948 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:59:34.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.594+0000 7f84c6a00640 1 -- 172.21.15.18:0/3549789761 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5607f69c2b80 con 0x5607f6af44e0 2024-09-12T02:59:34.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.595+0000 7f84c6a00640 10 client.25948 handle_command_reply: tid=0 2024-09-12T02:59:34.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.595+0000 7f84eac15740 1 client.25948 shutdown 2024-09-12T02:59:34.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.595+0000 7f84eac15740 1 -- 172.21.15.18:0/3549789761 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a553b0 msgr2=0x5607f6a70ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:34.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.595+0000 7f84eac15740 1 --2- 172.21.15.18:0/3549789761 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a553b0 0x5607f6a70ce0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f84cc01faf0 tx=0x7f84cc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.595+0000 7f84eac15740 1 -- 172.21.15.18:0/3549789761 shutdown_connections 2024-09-12T02:59:34.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.595+0000 7f84eac15740 1 --2- 172.21.15.18:0/3549789761 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5607f6af44e0 0x5607f6af6940 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.595+0000 7f84eac15740 1 --2- 172.21.15.18:0/3549789761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607f6a60570 0x5607f6a599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.595+0000 7f84eac15740 1 --2- 172.21.15.18:0/3549789761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607f6a55cd0 0x5607f6a71220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.595+0000 7f84c6a00640 0 client.25948 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:59:34.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.595+0000 7f84eac15740 1 --2- 172.21.15.18:0/3549789761 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5607f6a553b0 0x5607f6a70ce0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.595+0000 7f84eac15740 1 -- 172.21.15.18:0/3549789761 >> 172.21.15.18:0/3549789761 conn(0x5607f6a51920 msgr2=0x5607f6a56e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.596+0000 7f84eac15740 1 -- 172.21.15.18:0/3549789761 shutdown_connections 2024-09-12T02:59:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.596+0000 7f84eac15740 1 -- 172.21.15.18:0/3549789761 wait complete. 2024-09-12T02:59:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.596+0000 7f84eac15740 20 client.25948 trim_cache size 0 max 16384 2024-09-12T02:59:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:59:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:59:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:59:34.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:59:34.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.597+0000 7f84e6800640 1 -- 172.21.15.18:0/51170482 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f84c80a2d70 msgr2=0x7f84c80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:34.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.597+0000 7f84e6800640 1 --2- 172.21.15.18:0/51170482 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f84c80a2d70 0x7f84c80a5230 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f84d80b8500 tx=0x7f84d8034000 comp rx=0 tx=0).stop 2024-09-12T02:59:34.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.597+0000 7f84e6800640 1 -- 172.21.15.18:0/51170482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84e010bf00 msgr2=0x7f84e019cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:34.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.598+0000 7f84e6800640 1 --2- 172.21.15.18:0/51170482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84e010bf00 0x7f84e019cb10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f84d8009230 tx=0x7f84d8003b90 comp rx=0 tx=0).stop 2024-09-12T02:59:34.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.598+0000 7f84e6800640 1 -- 172.21.15.18:0/51170482 shutdown_connections 2024-09-12T02:59:34.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.598+0000 7f84e6800640 1 --2- 172.21.15.18:0/51170482 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f84c80a2d70 0x7f84c80a5230 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.598+0000 7f84e6800640 1 --2- 172.21.15.18:0/51170482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84e010bf00 0x7f84e019cb10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.598+0000 7f84e6800640 1 --2- 172.21.15.18:0/51170482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84e0103400 0x7f84e0198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.598+0000 7f84e6800640 1 --2- 172.21.15.18:0/51170482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e0102ae0 0x7f84e0198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:34.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.598+0000 7f84e6800640 1 -- 172.21.15.18:0/51170482 >> 172.21.15.18:0/51170482 conn(0x7f84e00777c0 msgr2=0x7f84e00fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:34.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.598+0000 7f84e6800640 1 -- 172.21.15.18:0/51170482 shutdown_connections 2024-09-12T02:59:34.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:34.598+0000 7f84e6800640 1 -- 172.21.15.18:0/51170482 wait complete. 2024-09-12T02:59:34.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:34 smithi176 ceph-mon[35713]: pgmap v337: 129 pgs: 56 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 93 op/s 2024-09-12T02:59:34.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:34 smithi062 ceph-mon[35527]: pgmap v337: 129 pgs: 56 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 93 op/s 2024-09-12T02:59:35.088 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:34 smithi018 ceph-mon[30616]: pgmap v337: 129 pgs: 56 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 93 op/s 2024-09-12T02:59:36.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:36 smithi176 ceph-mon[35713]: pgmap v338: 129 pgs: 56 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 135 op/s 2024-09-12T02:59:36.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:36 smithi062 ceph-mon[35527]: pgmap v338: 129 pgs: 56 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 135 op/s 2024-09-12T02:59:37.484 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:36 smithi018 ceph-mon[30616]: pgmap v338: 129 pgs: 56 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 135 op/s 2024-09-12T02:59:38.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:38 smithi176 ceph-mon[35713]: pgmap v339: 129 pgs: 56 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 101 op/s 2024-09-12T02:59:38.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:38 smithi062 ceph-mon[35527]: pgmap v339: 129 pgs: 56 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 101 op/s 2024-09-12T02:59:38.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:38 smithi018 ceph-mon[30616]: pgmap v339: 129 pgs: 56 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 101 op/s 2024-09-12T02:59:40.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:40 smithi062 ceph-mon[35527]: pgmap v340: 129 pgs: 56 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 57 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 110 op/s 2024-09-12T02:59:40.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:40 smithi018 ceph-mon[30616]: pgmap v340: 129 pgs: 56 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 57 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 110 op/s 2024-09-12T02:59:40.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:40 smithi176 ceph-mon[35713]: pgmap v340: 129 pgs: 56 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 57 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 110 op/s 2024-09-12T02:59:42.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:42 smithi062 ceph-mon[35527]: pgmap v341: 129 pgs: 42 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 73 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 859 KiB/s wr, 121 op/s 2024-09-12T02:59:42.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:42 smithi018 ceph-mon[30616]: pgmap v341: 129 pgs: 42 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 73 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 859 KiB/s wr, 121 op/s 2024-09-12T02:59:42.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:42 smithi176 ceph-mon[35713]: pgmap v341: 129 pgs: 42 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 73 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 859 KiB/s wr, 121 op/s 2024-09-12T02:59:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:44 smithi062 ceph-mon[35527]: pgmap v342: 129 pgs: 42 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 73 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 102 op/s 2024-09-12T02:59:44.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:44 smithi018 ceph-mon[30616]: pgmap v342: 129 pgs: 42 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 73 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 102 op/s 2024-09-12T02:59:44.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:44 smithi176 ceph-mon[35713]: pgmap v342: 129 pgs: 42 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 73 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 102 op/s 2024-09-12T02:59:46.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:46 smithi062 ceph-mon[35527]: pgmap v343: 129 pgs: 34 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 82 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 137 op/s 2024-09-12T02:59:46.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:46 smithi018 ceph-mon[30616]: pgmap v343: 129 pgs: 34 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 82 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 137 op/s 2024-09-12T02:59:46.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:46 smithi176 ceph-mon[35713]: pgmap v343: 129 pgs: 34 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 82 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 137 op/s 2024-09-12T02:59:48.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.547+0000 7f3943800640 1 -- 172.21.15.18:0/2623292926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f393c1090b0 msgr2=0x7f393c110c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:48.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.547+0000 7f3943800640 1 --2- 172.21.15.18:0/2623292926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f393c1090b0 0x7f393c110c00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3934009ca0 tx=0x7f393402a8f0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.548+0000 7f3943800640 1 -- 172.21.15.18:0/2623292926 shutdown_connections 2024-09-12T02:59:48.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.548+0000 7f3943800640 1 --2- 172.21.15.18:0/2623292926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f393c1090b0 0x7f393c110c00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.548+0000 7f3943800640 1 --2- 172.21.15.18:0/2623292926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f393c104910 0x7f393c108950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.548+0000 7f3943800640 1 --2- 172.21.15.18:0/2623292926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f393c103f60 0x7f393c104340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.548+0000 7f3943800640 1 -- 172.21.15.18:0/2623292926 >> 172.21.15.18:0/2623292926 conn(0x7f393c0ff970 msgr2=0x7f393c101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:48.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.549+0000 7f3943800640 1 -- 172.21.15.18:0/2623292926 shutdown_connections 2024-09-12T02:59:48.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.549+0000 7f3943800640 1 -- 172.21.15.18:0/2623292926 wait complete. 2024-09-12T02:59:48.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.550+0000 7f3943800640 1 Processor -- start 2024-09-12T02:59:48.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.550+0000 7f3943800640 1 -- start start 2024-09-12T02:59:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.553+0000 7f3943800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f393c103f60 0x7f393c10f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.554+0000 7f3943800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f393c1090b0 0x7f393c10fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.554+0000 7f3943800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f393c110210 0x7f393c114e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.554+0000 7f3943800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f393c077990 con 0x7f393c1090b0 2024-09-12T02:59:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.554+0000 7f3943800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f393c077810 con 0x7f393c110210 2024-09-12T02:59:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.554+0000 7f3940e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f393c103f60 0x7f393c10f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.554+0000 7f3940e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f393c103f60 0x7f393c10f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:58844/0 (socket says 172.21.15.18:58844) 2024-09-12T02:59:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.554+0000 7f3940e00640 1 -- 172.21.15.18:0/2160643934 learned_addr learned my addr 172.21.15.18:0/2160643934 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.554+0000 7f3943800640 1 -- 172.21.15.18:0/2160643934 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f393c077b10 con 0x7f393c103f60 2024-09-12T02:59:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.554+0000 7f3941800640 1 --2- 172.21.15.18:0/2160643934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f393c110210 0x7f393c114e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.554+0000 7f393be00640 1 --2- 172.21.15.18:0/2160643934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f393c1090b0 0x7f393c10fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.555+0000 7f3941800640 1 -- 172.21.15.18:0/2160643934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f393c103f60 msgr2=0x7f393c10f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.555+0000 7f3941800640 1 --2- 172.21.15.18:0/2160643934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f393c103f60 0x7f393c10f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.555+0000 7f3941800640 1 -- 172.21.15.18:0/2160643934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f393c1090b0 msgr2=0x7f393c10fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.555+0000 7f3941800640 1 --2- 172.21.15.18:0/2160643934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f393c1090b0 0x7f393c10fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.555+0000 7f3941800640 1 -- 172.21.15.18:0/2160643934 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f393c115550 con 0x7f393c110210 2024-09-12T02:59:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.555+0000 7f3940e00640 1 --2- 172.21.15.18:0/2160643934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f393c103f60 0x7f393c10f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:59:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.555+0000 7f3941800640 1 --2- 172.21.15.18:0/2160643934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f393c110210 0x7f393c114e20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f393402aee0 tx=0x7f39340316b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.555+0000 7f3939600640 1 -- 172.21.15.18:0/2160643934 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39340319a0 con 0x7f393c110210 2024-09-12T02:59:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.556+0000 7f3943800640 1 -- 172.21.15.18:0/2160643934 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f393c1157e0 con 0x7f393c110210 2024-09-12T02:59:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.556+0000 7f3943800640 1 -- 172.21.15.18:0/2160643934 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f393c115d80 con 0x7f393c110210 2024-09-12T02:59:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.557+0000 7f3939600640 1 -- 172.21.15.18:0/2160643934 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f393402d070 con 0x7f393c110210 2024-09-12T02:59:48.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.557+0000 7f3939600640 1 -- 172.21.15.18:0/2160643934 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393402fc40 con 0x7f393c110210 2024-09-12T02:59:48.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.565+0000 7f3939600640 1 -- 172.21.15.18:0/2160643934 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f39340305f0 con 0x7f393c110210 2024-09-12T02:59:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.567+0000 7f3939600640 1 --2- 172.21.15.18:0/2160643934 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f39240a2ef0 0x7f39240a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.567+0000 7f3939600640 1 -- 172.21.15.18:0/2160643934 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9650+0+0 (secure 0 0 0) 0x7f39340f1d80 con 0x7f393c110210 2024-09-12T02:59:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.568+0000 7f3940e00640 1 --2- 172.21.15.18:0/2160643934 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f39240a2ef0 0x7f39240a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.579+0000 7f3940e00640 1 --2- 172.21.15.18:0/2160643934 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f39240a2ef0 0x7f39240a53b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f393000a8f0 tx=0x7f3930008040 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.581+0000 7f394665c740 1 Processor -- start 2024-09-12T02:59:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.581+0000 7f394665c740 1 -- start start 2024-09-12T02:59:48.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.582+0000 7f394665c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d241e0 0x55ae23d245c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.583+0000 7f394665c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d24b00 0x55ae23d2ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.583+0000 7f394665c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d2f3a0 0x55ae23d31790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.583+0000 7f394665c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ae23c8a100 con 0x55ae23d2f3a0 2024-09-12T02:59:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.583+0000 7f394665c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ae23c321b0 con 0x55ae23d241e0 2024-09-12T02:59:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.583+0000 7f394665c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ae23c860c0 con 0x55ae23d24b00 2024-09-12T02:59:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.583+0000 7f3940e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d241e0 0x55ae23d245c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.583+0000 7f3940e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d241e0 0x55ae23d245c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:53450/0 (socket says 172.21.15.18:53450) 2024-09-12T02:59:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.583+0000 7f3940e00640 1 -- 172.21.15.18:0/2481585671 learned_addr learned my addr 172.21.15.18:0/2481585671 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.584+0000 7f393be00640 1 --2- 172.21.15.18:0/2481585671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d24b00 0x55ae23d2ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.584+0000 7f3941800640 1 --2- 172.21.15.18:0/2481585671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d2f3a0 0x55ae23d31790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.585+0000 7f3940e00640 1 -- 172.21.15.18:0/2481585671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d24b00 msgr2=0x55ae23d2ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:48.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.585+0000 7f3940e00640 1 --2- 172.21.15.18:0/2481585671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d24b00 0x55ae23d2ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.585+0000 7f3940e00640 1 -- 172.21.15.18:0/2481585671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d2f3a0 msgr2=0x55ae23d31790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:48.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.585+0000 7f3940e00640 1 --2- 172.21.15.18:0/2481585671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d2f3a0 0x55ae23d31790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.585+0000 7f3940e00640 1 -- 172.21.15.18:0/2481585671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae2399d210 con 0x55ae23d241e0 2024-09-12T02:59:48.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.585+0000 7f3941800640 1 --2- 172.21.15.18:0/2481585671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d2f3a0 0x55ae23d31790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:59:48.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.586+0000 7f3940e00640 1 --2- 172.21.15.18:0/2481585671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d241e0 0x55ae23d245c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f393000cb00 tx=0x7f393000f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4a46a7fda090f7c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:48.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.588+0000 7f392e000640 1 -- 172.21.15.18:0/2481585671 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3930023070 con 0x55ae23d241e0 2024-09-12T02:59:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.588+0000 7f392e000640 1 -- 172.21.15.18:0/2481585671 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f393001e8e0 con 0x55ae23d241e0 2024-09-12T02:59:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.588+0000 7f392e000640 1 -- 172.21.15.18:0/2481585671 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3930011970 con 0x55ae23d241e0 2024-09-12T02:59:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.589+0000 7f394665c740 1 -- 172.21.15.18:0/2481585671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d241e0 msgr2=0x55ae23d245c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.589+0000 7f394665c740 1 --2- 172.21.15.18:0/2481585671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d241e0 0x55ae23d245c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f393000cb00 tx=0x7f393000f000 comp rx=0 tx=0).stop 2024-09-12T02:59:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.589+0000 7f394665c740 1 -- 172.21.15.18:0/2481585671 shutdown_connections 2024-09-12T02:59:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.589+0000 7f394665c740 1 --2- 172.21.15.18:0/2481585671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d2f3a0 0x55ae23d31790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.589+0000 7f394665c740 1 --2- 172.21.15.18:0/2481585671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d24b00 0x55ae23d2ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.589+0000 7f394665c740 1 --2- 172.21.15.18:0/2481585671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d241e0 0x55ae23d245c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.589+0000 7f394665c740 1 -- 172.21.15.18:0/2481585671 >> 172.21.15.18:0/2481585671 conn(0x55ae23d20750 msgr2=0x55ae23d20b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.590+0000 7f394665c740 1 -- 172.21.15.18:0/2481585671 shutdown_connections 2024-09-12T02:59:48.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.590+0000 7f394665c740 1 -- 172.21.15.18:0/2481585671 wait complete. 2024-09-12T02:59:48.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.590+0000 7f394665c740 1 -- start start 2024-09-12T02:59:48.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.591+0000 7f394665c740 1 Processor -- start 2024-09-12T02:59:48.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.593+0000 7f394665c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d241e0 0x55ae23d2c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.593+0000 7f394665c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d24b00 0x55ae23d2c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.594+0000 7f394665c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d2f3a0 0x55ae23d2ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.594+0000 7f393be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d24b00 0x55ae23d2c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.594+0000 7f393be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d24b00 0x55ae23d2c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:53460/0 (socket says 172.21.15.18:53460) 2024-09-12T02:59:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.594+0000 7f393be00640 1 -- 172.21.15.18:0/1311948449 learned_addr learned my addr 172.21.15.18:0/1311948449 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.594+0000 7f394665c740 1 -- 172.21.15.18:0/1311948449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ae23d31f70 con 0x55ae23d241e0 2024-09-12T02:59:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.594+0000 7f394665c740 1 -- 172.21.15.18:0/1311948449 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ae23c13090 con 0x55ae23d24b00 2024-09-12T02:59:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.594+0000 7f394665c740 1 -- 172.21.15.18:0/1311948449 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ae23d320f0 con 0x55ae23d2f3a0 2024-09-12T02:59:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.595+0000 7f394665c740 10 client.0 _ll_register_callbacks cb 0x55ae23c67f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:59:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.594+0000 7f3941800640 1 --2- 172.21.15.18:0/1311948449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d2f3a0 0x55ae23d2ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.595+0000 7f3941800640 1 -- 172.21.15.18:0/1311948449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d24b00 msgr2=0x55ae23d2c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.595+0000 7f3941800640 1 --2- 172.21.15.18:0/1311948449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d24b00 0x55ae23d2c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.595+0000 7f3941800640 1 -- 172.21.15.18:0/1311948449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d241e0 msgr2=0x55ae23d2c3b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:59:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.595+0000 7f3940e00640 1 --2- 172.21.15.18:0/1311948449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d241e0 0x55ae23d2c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.596+0000 7f3941800640 1 --2- 172.21.15.18:0/1311948449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d241e0 0x55ae23d2c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.596+0000 7f3941800640 1 -- 172.21.15.18:0/1311948449 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae23a69620 con 0x55ae23d2f3a0 2024-09-12T02:59:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.596+0000 7f3941800640 1 --2- 172.21.15.18:0/1311948449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d2f3a0 0x55ae23d2ce30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f39340ef110 tx=0x7f39340bd900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c6d80dec09bc976 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:48.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.596+0000 7f3922a00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T02:59:48.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.597+0000 7f3922a00640 1 -- 172.21.15.18:0/1311948449 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39340c2290 con 0x55ae23d2f3a0 2024-09-12T02:59:48.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.597+0000 7f3922a00640 1 -- 172.21.15.18:0/1311948449 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9650+0+0 (secure 0 0 0) 0x7f39340ba550 con 0x55ae23d2f3a0 2024-09-12T02:59:48.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.597+0000 7f394665c740 1 -- 172.21.15.18:0/1311948449 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f393001e8e0 con 0x55ae23d2f3a0 2024-09-12T02:59:48.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.598+0000 7f3922a00640 1 -- 172.21.15.18:0/1311948449 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f39340d9020 con 0x55ae23d2f3a0 2024-09-12T02:59:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.599+0000 7f394665c740 10 client.25957 fetch_fsmap learned FSMap version 63 2024-09-12T02:59:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.599+0000 7f394665c740 1 -- 172.21.15.18:0/1311948449 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55ae23d31fd0 con 0x55ae23d2f3a0 2024-09-12T02:59:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.600+0000 7f3922a00640 1 -- 172.21.15.18:0/1311948449 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f393001e8e0 con 0x55ae23d2f3a0 2024-09-12T02:59:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.600+0000 7f3922a00640 1 -- 172.21.15.18:0/1311948449 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f39340be140 con 0x55ae23d2f3a0 2024-09-12T02:59:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.600+0000 7f394665c740 10 client.25957 fetch_fsmap finished waiting for FSMap version 63 2024-09-12T02:59:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.600+0000 7f394665c740 10 client.25957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:59:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.600+0000 7f394665c740 20 client.25957 populate_metadata read hostname 'smithi018' 2024-09-12T02:59:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.600+0000 7f394665c740 1 --2- 172.21.15.18:0/1311948449 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55ae23d3f200 0x55ae23d41660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.600+0000 7f394665c740 4 client.25957 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:59:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.600+0000 7f394665c740 1 -- 172.21.15.18:0/1311948449 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae23c97830 con 0x55ae23d3f200 2024-09-12T02:59:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.601+0000 7f3940e00640 1 --2- 172.21.15.18:0/1311948449 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55ae23d3f200 0x55ae23d41660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.601+0000 7f3940e00640 1 --2- 172.21.15.18:0/1311948449 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55ae23d3f200 0x55ae23d41660 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3c980c13525541b server_cookie=c7f4744b642f9deb in_seq=0 out_seq=0 2024-09-12T02:59:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.601+0000 7f3922a00640 10 client.25957 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:59:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.602+0000 7f3922a00640 1 -- 172.21.15.18:0/1311948449 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae23c97830 con 0x55ae23d3f200 2024-09-12T02:59:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.602+0000 7f3922a00640 10 client.25957 handle_command_reply: tid=0 2024-09-12T02:59:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.602+0000 7f394665c740 1 client.25957 shutdown 2024-09-12T02:59:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.603+0000 7f394665c740 1 -- 172.21.15.18:0/1311948449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d2f3a0 msgr2=0x55ae23d2ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.603+0000 7f394665c740 1 --2- 172.21.15.18:0/1311948449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d2f3a0 0x55ae23d2ce30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f39340ef110 tx=0x7f39340bd900 comp rx=0 tx=0).stop 2024-09-12T02:59:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.606+0000 7f394665c740 1 -- 172.21.15.18:0/1311948449 shutdown_connections 2024-09-12T02:59:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.606+0000 7f394665c740 1 --2- 172.21.15.18:0/1311948449 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55ae23d3f200 0x55ae23d41660 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.606+0000 7f394665c740 1 --2- 172.21.15.18:0/1311948449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d2f3a0 0x55ae23d2ce30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.606+0000 7f394665c740 1 --2- 172.21.15.18:0/1311948449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d24b00 0x55ae23d2c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.606+0000 7f394665c740 1 --2- 172.21.15.18:0/1311948449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d241e0 0x55ae23d2c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.606+0000 7f3922a00640 0 client.25957 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:59:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.606+0000 7f394665c740 1 -- 172.21.15.18:0/1311948449 >> 172.21.15.18:0/1311948449 conn(0x55ae23d20750 msgr2=0x55ae23d26460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.607+0000 7f394665c740 1 -- 172.21.15.18:0/1311948449 shutdown_connections 2024-09-12T02:59:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.607+0000 7f394665c740 1 -- 172.21.15.18:0/1311948449 wait complete. 2024-09-12T02:59:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.607+0000 7f394665c740 20 client.25957 trim_cache size 0 max 16384 2024-09-12T02:59:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.636+0000 7f394665c740 1 Processor -- start 2024-09-12T02:59:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.636+0000 7f394665c740 1 -- start start 2024-09-12T02:59:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.637+0000 7f394665c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d241e0 0x55ae23d26c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.637+0000 7f394665c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d24b00 0x55ae23d46f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.637+0000 7f394665c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d2f3a0 0x55ae23d47470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.637+0000 7f394665c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f391c010230 con 0x55ae23d24b00 2024-09-12T02:59:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.637+0000 7f394665c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f391c012070 con 0x55ae23d2f3a0 2024-09-12T02:59:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.637+0000 7f394665c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f391c0109c0 con 0x55ae23d241e0 2024-09-12T02:59:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.638+0000 7f3940e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d241e0 0x55ae23d26c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.638+0000 7f3941800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d2f3a0 0x55ae23d47470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.638+0000 7f3940e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d241e0 0x55ae23d26c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:58870/0 (socket says 172.21.15.18:58870) 2024-09-12T02:59:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.638+0000 7f3941800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d2f3a0 0x55ae23d47470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:53470/0 (socket says 172.21.15.18:53470) 2024-09-12T02:59:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.638+0000 7f3940e00640 1 -- 172.21.15.18:0/377611990 learned_addr learned my addr 172.21.15.18:0/377611990 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.638+0000 7f3941800640 1 -- 172.21.15.18:0/377611990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d241e0 msgr2=0x55ae23d26c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.638+0000 7f3941800640 1 --2- 172.21.15.18:0/377611990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d241e0 0x55ae23d26c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.638+0000 7f3941800640 1 -- 172.21.15.18:0/377611990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d24b00 msgr2=0x55ae23d46f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.638+0000 7f393be00640 1 --2- 172.21.15.18:0/377611990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d24b00 0x55ae23d46f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.639+0000 7f3941800640 1 --2- 172.21.15.18:0/377611990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d24b00 0x55ae23d46f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.639+0000 7f3941800640 1 -- 172.21.15.18:0/377611990 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae23d1bd60 con 0x55ae23d2f3a0 2024-09-12T02:59:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.639+0000 7f393be00640 1 --2- 172.21.15.18:0/377611990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d24b00 0x55ae23d46f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:59:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.640+0000 7f3941800640 1 --2- 172.21.15.18:0/377611990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d2f3a0 0x55ae23d47470 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3934031b60 tx=0x7f39340be060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2dce6a19de2036e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.643+0000 7f392d600640 1 -- 172.21.15.18:0/377611990 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39340c2290 con 0x55ae23d2f3a0 2024-09-12T02:59:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.643+0000 7f392d600640 1 -- 172.21.15.18:0/377611990 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3934036040 con 0x55ae23d2f3a0 2024-09-12T02:59:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.643+0000 7f392d600640 1 -- 172.21.15.18:0/377611990 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39340bda20 con 0x55ae23d2f3a0 2024-09-12T02:59:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.644+0000 7f394665c740 1 -- 172.21.15.18:0/377611990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d2f3a0 msgr2=0x55ae23d47470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.644+0000 7f394665c740 1 --2- 172.21.15.18:0/377611990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d2f3a0 0x55ae23d47470 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3934031b60 tx=0x7f39340be060 comp rx=0 tx=0).stop 2024-09-12T02:59:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.644+0000 7f394665c740 1 -- 172.21.15.18:0/377611990 shutdown_connections 2024-09-12T02:59:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.644+0000 7f394665c740 1 --2- 172.21.15.18:0/377611990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d2f3a0 0x55ae23d47470 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.644+0000 7f394665c740 1 --2- 172.21.15.18:0/377611990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d24b00 0x55ae23d46f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.644+0000 7f394665c740 1 --2- 172.21.15.18:0/377611990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d241e0 0x55ae23d26c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.644+0000 7f394665c740 1 -- 172.21.15.18:0/377611990 >> 172.21.15.18:0/377611990 conn(0x55ae23d20750 msgr2=0x55ae23d2b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.645+0000 7f394665c740 1 -- 172.21.15.18:0/377611990 shutdown_connections 2024-09-12T02:59:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.646+0000 7f394665c740 1 -- 172.21.15.18:0/377611990 wait complete. 2024-09-12T02:59:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.646+0000 7f394665c740 1 -- start start 2024-09-12T02:59:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.646+0000 7f394665c740 1 Processor -- start 2024-09-12T02:59:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.647+0000 7f394665c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d241e0 0x55ae23d37340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.647+0000 7f394665c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d24b00 0x55ae23d37880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.647+0000 7f394665c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d2f3a0 0x55ae23d289d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.648+0000 7f3940e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d241e0 0x55ae23d37340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.648+0000 7f394665c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f391c0118e0 con 0x55ae23d2f3a0 2024-09-12T02:59:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.648+0000 7f394665c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f391c011150 con 0x55ae23d24b00 2024-09-12T02:59:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.648+0000 7f394665c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f391c00e230 con 0x55ae23d241e0 2024-09-12T02:59:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.649+0000 7f394665c740 10 client.0 _ll_register_callbacks cb 0x7f39340bdd80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:59:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.649+0000 7f3941800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d2f3a0 0x55ae23d289d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.650+0000 7f393be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d24b00 0x55ae23d37880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.650+0000 7f393be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d24b00 0x55ae23d37880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:53484/0 (socket says 172.21.15.18:53484) 2024-09-12T02:59:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.650+0000 7f393be00640 1 -- 172.21.15.18:0/3464003532 learned_addr learned my addr 172.21.15.18:0/3464003532 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T02:59:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.650+0000 7f393be00640 1 -- 172.21.15.18:0/3464003532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d241e0 msgr2=0x55ae23d37340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.650+0000 7f393be00640 1 --2- 172.21.15.18:0/3464003532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d241e0 0x55ae23d37340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.650+0000 7f393be00640 1 -- 172.21.15.18:0/3464003532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d2f3a0 msgr2=0x55ae23d289d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.650+0000 7f393be00640 1 --2- 172.21.15.18:0/3464003532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d2f3a0 0x55ae23d289d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.650+0000 7f393be00640 1 -- 172.21.15.18:0/3464003532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae23d29010 con 0x55ae23d24b00 2024-09-12T02:59:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.651+0000 7f393be00640 1 --2- 172.21.15.18:0/3464003532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d24b00 0x55ae23d37880 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f39280143a0 tx=0x7f3928014860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfe327a534f5f85c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.651+0000 7f3922a00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T02:59:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.651+0000 7f3922a00640 1 -- 172.21.15.18:0/3464003532 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928016900 con 0x55ae23d24b00 2024-09-12T02:59:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.652+0000 7f3922a00640 1 -- 172.21.15.18:0/3464003532 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9650+0+0 (secure 0 0 0) 0x7f3928016aa0 con 0x55ae23d24b00 2024-09-12T02:59:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.652+0000 7f394665c740 1 -- 172.21.15.18:0/3464003532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3934036040 con 0x55ae23d24b00 2024-09-12T02:59:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.652+0000 7f3922a00640 1 -- 172.21.15.18:0/3464003532 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f3928028050 con 0x55ae23d24b00 2024-09-12T02:59:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.653+0000 7f394665c740 10 client.25970 fetch_fsmap learned FSMap version 63 2024-09-12T02:59:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.653+0000 7f394665c740 1 -- 172.21.15.18:0/3464003532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55ae23da9850 con 0x55ae23d24b00 2024-09-12T02:59:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.653+0000 7f3922a00640 1 -- 172.21.15.18:0/3464003532 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3934036040 con 0x55ae23d24b00 2024-09-12T02:59:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.654+0000 7f3922a00640 1 -- 172.21.15.18:0/3464003532 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f39280153c0 con 0x55ae23d24b00 2024-09-12T02:59:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.654+0000 7f394665c740 10 client.25970 fetch_fsmap finished waiting for FSMap version 63 2024-09-12T02:59:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.654+0000 7f394665c740 10 client.25970 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:59:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.654+0000 7f394665c740 20 client.25970 populate_metadata read hostname 'smithi018' 2024-09-12T02:59:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.654+0000 7f394665c740 1 --2- 172.21.15.18:0/3464003532 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55ae23daa0c0 0x55ae23dac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.654+0000 7f394665c740 4 client.25970 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:59:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.654+0000 7f394665c740 1 -- 172.21.15.18:0/3464003532 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ae23c91b80 con 0x55ae23daa0c0 2024-09-12T02:59:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.655+0000 7f3940e00640 1 --2- 172.21.15.18:0/3464003532 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55ae23daa0c0 0x55ae23dac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.656+0000 7f3940e00640 1 --2- 172.21.15.18:0/3464003532 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55ae23daa0c0 0x55ae23dac4e0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4152692a8da46f63 server_cookie=5938a468c682a378 in_seq=0 out_seq=0 2024-09-12T02:59:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.656+0000 7f3922a00640 10 client.25970 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T02:59:48.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:48 smithi062 ceph-mon[35527]: pgmap v344: 129 pgs: 34 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 82 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 101 op/s 2024-09-12T02:59:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:48 smithi018 ceph-mon[30616]: pgmap v344: 129 pgs: 34 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 82 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 101 op/s 2024-09-12T02:59:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.862+0000 7f3922a00640 1 -- 172.21.15.18:0/3464003532 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ae23c91b80 con 0x55ae23daa0c0 2024-09-12T02:59:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.862+0000 7f3922a00640 10 client.25970 handle_command_reply: tid=0 2024-09-12T02:59:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.862+0000 7f394665c740 1 client.25970 shutdown 2024-09-12T02:59:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.862+0000 7f394665c740 1 -- 172.21.15.18:0/3464003532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d24b00 msgr2=0x55ae23d37880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.862+0000 7f394665c740 1 --2- 172.21.15.18:0/3464003532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d24b00 0x55ae23d37880 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f39280143a0 tx=0x7f3928014860 comp rx=0 tx=0).stop 2024-09-12T02:59:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.862+0000 7f394665c740 1 -- 172.21.15.18:0/3464003532 shutdown_connections 2024-09-12T02:59:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.862+0000 7f394665c740 1 --2- 172.21.15.18:0/3464003532 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55ae23daa0c0 0x55ae23dac4e0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.862+0000 7f394665c740 1 --2- 172.21.15.18:0/3464003532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae23d2f3a0 0x55ae23d289d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.862+0000 7f394665c740 1 --2- 172.21.15.18:0/3464003532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae23d24b00 0x55ae23d37880 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.862+0000 7f394665c740 1 --2- 172.21.15.18:0/3464003532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae23d241e0 0x55ae23d37340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.862+0000 7f394665c740 1 -- 172.21.15.18:0/3464003532 >> 172.21.15.18:0/3464003532 conn(0x55ae23d20750 msgr2=0x55ae23d1f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.862+0000 7f3922a00640 0 client.25970 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T02:59:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.863+0000 7f394665c740 1 -- 172.21.15.18:0/3464003532 shutdown_connections 2024-09-12T02:59:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.863+0000 7f394665c740 1 -- 172.21.15.18:0/3464003532 wait complete. 2024-09-12T02:59:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.863+0000 7f394665c740 20 client.25970 trim_cache size 0 max 16384 2024-09-12T02:59:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T02:59:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T02:59:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T02:59:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T02:59:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.866+0000 7f3943800640 1 -- 172.21.15.18:0/2160643934 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f39240a2ef0 msgr2=0x7f39240a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.866+0000 7f3943800640 1 --2- 172.21.15.18:0/2160643934 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f39240a2ef0 0x7f39240a53b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f393000a8f0 tx=0x7f3930008040 comp rx=0 tx=0).stop 2024-09-12T02:59:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.866+0000 7f3943800640 1 -- 172.21.15.18:0/2160643934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f393c110210 msgr2=0x7f393c114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.866+0000 7f3943800640 1 --2- 172.21.15.18:0/2160643934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f393c110210 0x7f393c114e20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f393402aee0 tx=0x7f39340316b0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.867+0000 7f3943800640 1 -- 172.21.15.18:0/2160643934 shutdown_connections 2024-09-12T02:59:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.867+0000 7f3943800640 1 --2- 172.21.15.18:0/2160643934 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f39240a2ef0 0x7f39240a53b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.867+0000 7f3943800640 1 --2- 172.21.15.18:0/2160643934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f393c110210 0x7f393c114e20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.867+0000 7f3943800640 1 --2- 172.21.15.18:0/2160643934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f393c1090b0 0x7f393c10fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.867+0000 7f3943800640 1 --2- 172.21.15.18:0/2160643934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f393c103f60 0x7f393c10f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.867+0000 7f3943800640 1 -- 172.21.15.18:0/2160643934 >> 172.21.15.18:0/2160643934 conn(0x7f393c0ff970 msgr2=0x7f393c100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.867+0000 7f3943800640 1 -- 172.21.15.18:0/2160643934 shutdown_connections 2024-09-12T02:59:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T02:59:48.867+0000 7f3943800640 1 -- 172.21.15.18:0/2160643934 wait complete. 2024-09-12T02:59:48.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:48 smithi176 ceph-mon[35713]: pgmap v344: 129 pgs: 34 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 82 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 101 op/s 2024-09-12T02:59:50.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:50 smithi062 ceph-mon[35527]: pgmap v345: 129 pgs: 34 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 82 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 116 op/s 2024-09-12T02:59:50.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:50 smithi018 ceph-mon[30616]: pgmap v345: 129 pgs: 34 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 82 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 116 op/s 2024-09-12T02:59:50.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:50 smithi176 ceph-mon[35713]: pgmap v345: 129 pgs: 34 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 82 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 116 op/s 2024-09-12T02:59:52.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:52 smithi062 ceph-mon[35527]: pgmap v346: 129 pgs: 34 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 83 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 135 op/s 2024-09-12T02:59:52.808 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:52 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:59:52.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:52 smithi018 ceph-mon[30616]: pgmap v346: 129 pgs: 34 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 83 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 135 op/s 2024-09-12T02:59:52.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:52 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:59:52.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:52 smithi176 ceph-mon[35713]: pgmap v346: 129 pgs: 34 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 83 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 135 op/s 2024-09-12T02:59:52.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:52 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:59:54.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:54 smithi062 ceph-mon[35527]: pgmap v347: 129 pgs: 34 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 83 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 115 op/s 2024-09-12T02:59:54.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:54 smithi018 ceph-mon[30616]: pgmap v347: 129 pgs: 34 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 83 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 115 op/s 2024-09-12T02:59:54.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:54 smithi176 ceph-mon[35713]: pgmap v347: 129 pgs: 34 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 83 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 115 op/s 2024-09-12T02:59:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:55 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:59:55.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:55 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:59:56.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:55 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:59:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:56 smithi018 ceph-mon[30616]: pgmap v348: 129 pgs: 20 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 101 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 159 op/s 2024-09-12T02:59:56.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:56 smithi176 ceph-mon[35713]: pgmap v348: 129 pgs: 20 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 101 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 159 op/s 2024-09-12T02:59:57.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:56 smithi062 ceph-mon[35527]: pgmap v348: 129 pgs: 20 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 101 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 159 op/s 2024-09-12T02:59:57.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:57 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:59:57.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:57 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:59:57.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:57 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:59:57.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:57 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:59:57.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:57 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:59:57.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:57 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:59:57.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:57 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:59:57.980 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:57 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:59:58.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:57 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:59:58.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:57 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:59:58.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:57 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:59:58.034 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:57 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T02:59:58.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 02:59:58 smithi018 ceph-mon[30616]: pgmap v349: 129 pgs: 20 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 101 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 134 op/s 2024-09-12T02:59:58.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 02:59:58 smithi176 ceph-mon[35713]: pgmap v349: 129 pgs: 20 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 101 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 134 op/s 2024-09-12T02:59:59.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 02:59:58 smithi062 ceph-mon[35527]: pgmap v349: 129 pgs: 20 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 101 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 134 op/s 2024-09-12T03:00:00.854 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:00 smithi018 ceph-mon[30616]: pgmap v350: 129 pgs: 20 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 102 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 151 op/s 2024-09-12T03:00:00.854 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:00 smithi018 ceph-mon[30616]: overall HEALTH_OK 2024-09-12T03:00:00.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:00 smithi176 ceph-mon[35713]: pgmap v350: 129 pgs: 20 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 102 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 151 op/s 2024-09-12T03:00:00.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:00 smithi176 ceph-mon[35713]: overall HEALTH_OK 2024-09-12T03:00:01.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:00 smithi062 ceph-mon[35527]: pgmap v350: 129 pgs: 20 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 102 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 151 op/s 2024-09-12T03:00:01.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:00 smithi062 ceph-mon[35527]: overall HEALTH_OK 2024-09-12T03:00:02.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.130+0000 7f38efe00640 1 -- 172.21.15.18:0/2140504853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38f01091f0 msgr2=0x7f38f0110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:02.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.130+0000 7f38efe00640 1 --2- 172.21.15.18:0/2140504853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38f01091f0 0x7f38f0110250 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f38e0009900 tx=0x7f38e002a410 comp rx=0 tx=0).stop 2024-09-12T03:00:02.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.131+0000 7f38efe00640 1 -- 172.21.15.18:0/2140504853 shutdown_connections 2024-09-12T03:00:02.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.132+0000 7f38efe00640 1 --2- 172.21.15.18:0/2140504853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38f011b140 0x7f38f011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.132+0000 7f38efe00640 1 --2- 172.21.15.18:0/2140504853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38f01095d0 0x7f38f0109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.132+0000 7f38efe00640 1 --2- 172.21.15.18:0/2140504853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38f01091f0 0x7f38f0110250 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.132+0000 7f38efe00640 1 -- 172.21.15.18:0/2140504853 >> 172.21.15.18:0/2140504853 conn(0x7f38f006cbf0 msgr2=0x7f38f006d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:02.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.132+0000 7f38efe00640 1 -- 172.21.15.18:0/2140504853 shutdown_connections 2024-09-12T03:00:02.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.133+0000 7f38efe00640 1 -- 172.21.15.18:0/2140504853 wait complete. 2024-09-12T03:00:02.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.134+0000 7f38efe00640 1 Processor -- start 2024-09-12T03:00:02.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.134+0000 7f38efe00640 1 -- start start 2024-09-12T03:00:02.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.135+0000 7f38efe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38f01091f0 0x7f38f01a7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.135+0000 7f38efe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38f01095d0 0x7f38f01a7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.135+0000 7f38efe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38f011b140 0x7f38f01ab900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.135+0000 7f38efe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38f0120b50 con 0x7f38f01095d0 2024-09-12T03:00:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.135+0000 7f38efe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f38f01209d0 con 0x7f38f01091f0 2024-09-12T03:00:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.135+0000 7f38efe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f38f0120cd0 con 0x7f38f011b140 2024-09-12T03:00:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.135+0000 7f38eea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38f01091f0 0x7f38f01a7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.135+0000 7f38eea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38f01091f0 0x7f38f01a7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:51870/0 (socket says 172.21.15.18:51870) 2024-09-12T03:00:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.135+0000 7f38ef400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38f011b140 0x7f38f01ab900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.135+0000 7f38eea00640 1 -- 172.21.15.18:0/1010993895 learned_addr learned my addr 172.21.15.18:0/1010993895 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.135+0000 7f38ee000640 1 --2- 172.21.15.18:0/1010993895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38f01095d0 0x7f38f01a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.136+0000 7f38ef400640 1 -- 172.21.15.18:0/1010993895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38f01091f0 msgr2=0x7f38f01a7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.136+0000 7f38ef400640 1 --2- 172.21.15.18:0/1010993895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38f01091f0 0x7f38f01a7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.136+0000 7f38ef400640 1 -- 172.21.15.18:0/1010993895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38f01095d0 msgr2=0x7f38f01a7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.136+0000 7f38ef400640 1 --2- 172.21.15.18:0/1010993895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38f01095d0 0x7f38f01a7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.136+0000 7f38ef400640 1 -- 172.21.15.18:0/1010993895 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38f01ac030 con 0x7f38f011b140 2024-09-12T03:00:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.136+0000 7f38ef400640 1 --2- 172.21.15.18:0/1010993895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38f011b140 0x7f38f01ab900 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f38e800be20 tx=0x7f38e800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.137+0000 7f38f4a00640 1 -- 172.21.15.18:0/1010993895 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e8019070 con 0x7f38f011b140 2024-09-12T03:00:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.137+0000 7f38f4a00640 1 -- 172.21.15.18:0/1010993895 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38e8014920 con 0x7f38f011b140 2024-09-12T03:00:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.137+0000 7f38efe00640 1 -- 172.21.15.18:0/1010993895 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38f01ac320 con 0x7f38f011b140 2024-09-12T03:00:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.137+0000 7f38efe00640 1 -- 172.21.15.18:0/1010993895 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38f01b3bb0 con 0x7f38f011b140 2024-09-12T03:00:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.137+0000 7f38f4a00640 1 -- 172.21.15.18:0/1010993895 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e8012920 con 0x7f38f011b140 2024-09-12T03:00:02.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.142+0000 7f38f8c8d740 1 Processor -- start 2024-09-12T03:00:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.143+0000 7f38f4a00640 1 -- 172.21.15.18:0/1010993895 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f38e801c070 con 0x7f38f011b140 2024-09-12T03:00:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.145+0000 7f38f4a00640 1 --2- 172.21.15.18:0/1010993895 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f38d40a2d70 0x7f38d40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.146+0000 7f38f4a00640 1 -- 172.21.15.18:0/1010993895 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9650+0+0 (secure 0 0 0) 0x7f38e80cef50 con 0x7f38f011b140 2024-09-12T03:00:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.146+0000 7f38ee000640 1 --2- 172.21.15.18:0/1010993895 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f38d40a2d70 0x7f38d40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.147+0000 7f38f8c8d740 1 -- start start 2024-09-12T03:00:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.147+0000 7f38f8c8d740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a27642d3b0 0x55a27642d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.147+0000 7f38f8c8d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642dcd0 0x55a276438030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.147+0000 7f38f8c8d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a276438570 0x55a27643a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.147+0000 7f38f8c8d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a276393100 con 0x55a27642dcd0 2024-09-12T03:00:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.147+0000 7f38f8c8d740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a27633b1b0 con 0x55a27642d3b0 2024-09-12T03:00:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.147+0000 7f38f8c8d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55a27638f0c0 con 0x55a276438570 2024-09-12T03:00:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.148+0000 7f38eea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a27642d3b0 0x55a27642d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.148+0000 7f38eea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a27642d3b0 0x55a27642d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:51872/0 (socket says 172.21.15.18:51872) 2024-09-12T03:00:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.148+0000 7f38eea00640 1 -- 172.21.15.18:0/4193199350 learned_addr learned my addr 172.21.15.18:0/4193199350 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.148+0000 7f38ef400640 1 --2- 172.21.15.18:0/4193199350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a276438570 0x55a27643a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:02.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.148+0000 7f38eea00640 1 -- 172.21.15.18:0/4193199350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a276438570 msgr2=0x55a27643a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:02.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.148+0000 7f38eea00640 1 --2- 172.21.15.18:0/4193199350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a276438570 0x55a27643a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.148+0000 7f38ee000640 1 --2- 172.21.15.18:0/4193199350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642dcd0 0x55a276438030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:02.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.148+0000 7f38eea00640 1 -- 172.21.15.18:0/4193199350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642dcd0 msgr2=0x55a276438030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.148+0000 7f38eea00640 1 --2- 172.21.15.18:0/4193199350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642dcd0 0x55a276438030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.148+0000 7f38eea00640 1 -- 172.21.15.18:0/4193199350 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2760a6210 con 0x55a27642d3b0 2024-09-12T03:00:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.148+0000 7f38ee000640 1 --2- 172.21.15.18:0/4193199350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642dcd0 0x55a276438030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:00:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.149+0000 7f38eea00640 1 --2- 172.21.15.18:0/4193199350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a27642d3b0 0x55a27642d790 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f38e0004c30 tx=0x7f38e0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5898860d28b109e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.149+0000 7f38ee000640 1 --2- 172.21.15.18:0/1010993895 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f38d40a2d70 0x7f38d40a5230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f38f011d4d0 tx=0x7f38dc00a580 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.151+0000 7f38dbe00640 1 -- 172.21.15.18:0/4193199350 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e00048c0 con 0x55a27642d3b0 2024-09-12T03:00:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.151+0000 7f38dbe00640 1 -- 172.21.15.18:0/4193199350 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38e00054e0 con 0x55a27642d3b0 2024-09-12T03:00:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.151+0000 7f38dbe00640 1 -- 172.21.15.18:0/4193199350 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e0031bd0 con 0x55a27642d3b0 2024-09-12T03:00:02.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.152+0000 7f38f8c8d740 1 -- 172.21.15.18:0/4193199350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a27642d3b0 msgr2=0x55a27642d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:02.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.152+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/4193199350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a27642d3b0 0x55a27642d790 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f38e0004c30 tx=0x7f38e0000bc0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.152+0000 7f38f8c8d740 1 -- 172.21.15.18:0/4193199350 shutdown_connections 2024-09-12T03:00:02.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.152+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/4193199350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a276438570 0x55a27643a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.152+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/4193199350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642dcd0 0x55a276438030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.152+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/4193199350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a27642d3b0 0x55a27642d790 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.152+0000 7f38f8c8d740 1 -- 172.21.15.18:0/4193199350 >> 172.21.15.18:0/4193199350 conn(0x55a276429920 msgr2=0x55a276429d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.153+0000 7f38f8c8d740 1 -- 172.21.15.18:0/4193199350 shutdown_connections 2024-09-12T03:00:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.153+0000 7f38f8c8d740 1 -- 172.21.15.18:0/4193199350 wait complete. 2024-09-12T03:00:02.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.154+0000 7f38f8c8d740 1 -- start start 2024-09-12T03:00:02.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.158+0000 7f38f8c8d740 1 Processor -- start 2024-09-12T03:00:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.159+0000 7f38f8c8d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642d3b0 0x55a2764353f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.159+0000 7f38f8c8d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642dcd0 0x55a276435930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.159+0000 7f38f8c8d740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a276438570 0x55a276435e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.159+0000 7f38f8c8d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a27643aff0 con 0x55a27642dcd0 2024-09-12T03:00:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.159+0000 7f38f8c8d740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a27631c090 con 0x55a276438570 2024-09-12T03:00:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.159+0000 7f38f8c8d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55a27643b170 con 0x55a27642d3b0 2024-09-12T03:00:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.159+0000 7f38f8c8d740 10 client.0 _ll_register_callbacks cb 0x55a276370f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:00:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.159+0000 7f38ef400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a276438570 0x55a276435e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.159+0000 7f38ef400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a276438570 0x55a276435e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:51880/0 (socket says 172.21.15.18:51880) 2024-09-12T03:00:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.159+0000 7f38ef400640 1 -- 172.21.15.18:0/3474495268 learned_addr learned my addr 172.21.15.18:0/3474495268 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.160+0000 7f38eea00640 1 --2- 172.21.15.18:0/3474495268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642d3b0 0x55a2764353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:02.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.160+0000 7f38ef400640 1 -- 172.21.15.18:0/3474495268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642d3b0 msgr2=0x55a2764353f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.160+0000 7f38ee000640 1 --2- 172.21.15.18:0/3474495268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642dcd0 0x55a276435930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.160+0000 7f38ef400640 1 --2- 172.21.15.18:0/3474495268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642d3b0 0x55a2764353f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.160+0000 7f38ef400640 1 -- 172.21.15.18:0/3474495268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642dcd0 msgr2=0x55a276435930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.160+0000 7f38ef400640 1 --2- 172.21.15.18:0/3474495268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642dcd0 0x55a276435930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.160+0000 7f38ef400640 1 -- 172.21.15.18:0/3474495268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a276172620 con 0x55a276438570 2024-09-12T03:00:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.160+0000 7f38eea00640 1 --2- 172.21.15.18:0/3474495268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642d3b0 0x55a2764353f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:00:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.161+0000 7f38ef400640 1 --2- 172.21.15.18:0/3474495268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a276438570 0x55a276435e70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f38e800cf70 tx=0x7f38e809ab80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53cea954fa64ce22 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.161+0000 7f38d8c00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T03:00:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.161+0000 7f38d8c00640 1 -- 172.21.15.18:0/3474495268 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e80a3d20 con 0x55a276438570 2024-09-12T03:00:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.161+0000 7f38d8c00640 1 -- 172.21.15.18:0/3474495268 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9650+0+0 (secure 0 0 0) 0x7f38e80977d0 con 0x55a276438570 2024-09-12T03:00:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.161+0000 7f38f8c8d740 1 -- 172.21.15.18:0/3474495268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38e00054e0 con 0x55a276438570 2024-09-12T03:00:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.161+0000 7f38d8c00640 1 -- 172.21.15.18:0/3474495268 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f38e80cc450 con 0x55a276438570 2024-09-12T03:00:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.161+0000 7f38f8c8d740 10 client.25982 fetch_fsmap learned FSMap version 65 2024-09-12T03:00:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.161+0000 7f38f8c8d740 1 -- 172.21.15.18:0/3474495268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x55a276446d30 con 0x55a276438570 2024-09-12T03:00:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.162+0000 7f38d8c00640 1 -- 172.21.15.18:0/3474495268 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38e00054e0 con 0x55a276438570 2024-09-12T03:00:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.162+0000 7f38d8c00640 1 -- 172.21.15.18:0/3474495268 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 65) ==== 8442+0+0 (secure 0 0 0) 0x7f38e8012ba0 con 0x55a276438570 2024-09-12T03:00:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.162+0000 7f38f8c8d740 10 client.25982 fetch_fsmap finished waiting for FSMap version 65 2024-09-12T03:00:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.162+0000 7f38f8c8d740 10 client.25982 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:00:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.162+0000 7f38f8c8d740 20 client.25982 populate_metadata read hostname 'smithi018' 2024-09-12T03:00:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.162+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/3474495268 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a276448300 0x55a27644a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.162+0000 7f38f8c8d740 4 client.25982 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:00:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.162+0000 7f38f8c8d740 1 -- 172.21.15.18:0/3474495268 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2763a0830 con 0x55a276448300 2024-09-12T03:00:02.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.163+0000 7f38eea00640 1 --2- 172.21.15.18:0/3474495268 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a276448300 0x55a27644a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:02.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.163+0000 7f38d8c00640 10 client.25982 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:00:02.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.165+0000 7f38eea00640 1 --2- 172.21.15.18:0/3474495268 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a276448300 0x55a27644a770 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b621360da44fd40 server_cookie=1b62c579759a9f5d in_seq=0 out_seq=0 2024-09-12T03:00:02.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.166+0000 7f38d8c00640 1 -- 172.21.15.18:0/3474495268 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a2763a0830 con 0x55a276448300 2024-09-12T03:00:02.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.166+0000 7f38d8c00640 10 client.25982 handle_command_reply: tid=0 2024-09-12T03:00:02.167 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.166+0000 7f38f8c8d740 1 client.25982 shutdown 2024-09-12T03:00:02.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.167+0000 7f38f8c8d740 1 -- 172.21.15.18:0/3474495268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a276438570 msgr2=0x55a276435e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:02.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.167+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/3474495268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a276438570 0x55a276435e70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f38e800cf70 tx=0x7f38e809ab80 comp rx=0 tx=0).stop 2024-09-12T03:00:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.168+0000 7f38f8c8d740 1 -- 172.21.15.18:0/3474495268 shutdown_connections 2024-09-12T03:00:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.168+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/3474495268 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a276448300 0x55a27644a770 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.168+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/3474495268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a276438570 0x55a276435e70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.168+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/3474495268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642dcd0 0x55a276435930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.168+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/3474495268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642d3b0 0x55a2764353f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.168+0000 7f38d8c00640 0 client.25982 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:00:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.168+0000 7f38f8c8d740 1 -- 172.21.15.18:0/3474495268 >> 172.21.15.18:0/3474495268 conn(0x55a276429920 msgr2=0x55a27642f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.168+0000 7f38f8c8d740 1 -- 172.21.15.18:0/3474495268 shutdown_connections 2024-09-12T03:00:02.170 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.168+0000 7f38f8c8d740 1 -- 172.21.15.18:0/3474495268 wait complete. 2024-09-12T03:00:02.170 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.168+0000 7f38f8c8d740 20 client.25982 trim_cache size 0 max 16384 2024-09-12T03:00:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.208+0000 7f38f8c8d740 1 Processor -- start 2024-09-12T03:00:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.208+0000 7f38f8c8d740 1 -- start start 2024-09-12T03:00:02.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.208+0000 7f38f8c8d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642d3b0 0x55a27642f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.208+0000 7f38f8c8d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642dcd0 0x55a276450080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.208+0000 7f38f8c8d740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a276438570 0x55a2764505c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.208+0000 7f38f8c8d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38d00101b0 con 0x55a27642d3b0 2024-09-12T03:00:02.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.208+0000 7f38f8c8d740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f38d0011ff0 con 0x55a276438570 2024-09-12T03:00:02.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.208+0000 7f38f8c8d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f38d0010940 con 0x55a27642dcd0 2024-09-12T03:00:02.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.209+0000 7f38eea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642d3b0 0x55a27642f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:02.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.209+0000 7f38ee000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642dcd0 0x55a276450080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:02.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.209+0000 7f38ee000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642dcd0 0x55a276450080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:48862/0 (socket says 172.21.15.18:48862) 2024-09-12T03:00:02.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.209+0000 7f38ee000640 1 -- 172.21.15.18:0/2427944547 learned_addr learned my addr 172.21.15.18:0/2427944547 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:02.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.209+0000 7f38ef400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a276438570 0x55a2764505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:02.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.209+0000 7f38eea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642d3b0 0x55a27642f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56358/0 (socket says 172.21.15.18:56358) 2024-09-12T03:00:02.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.210+0000 7f38ee000640 1 -- 172.21.15.18:0/2427944547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a276438570 msgr2=0x55a2764505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:02.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.210+0000 7f38ee000640 1 --2- 172.21.15.18:0/2427944547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a276438570 0x55a2764505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.210+0000 7f38ee000640 1 -- 172.21.15.18:0/2427944547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642d3b0 msgr2=0x55a27642f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.210+0000 7f38ee000640 1 --2- 172.21.15.18:0/2427944547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642d3b0 0x55a27642f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.210+0000 7f38ee000640 1 -- 172.21.15.18:0/2427944547 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a276429750 con 0x55a27642dcd0 2024-09-12T03:00:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.211+0000 7f38eea00640 1 --2- 172.21.15.18:0/2427944547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642d3b0 0x55a27642f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:00:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.211+0000 7f38ee000640 1 --2- 172.21.15.18:0/2427944547 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642dcd0 0x55a276450080 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f38dc010e10 tx=0x7f38dc00a480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1cf37fdaf904f7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.212+0000 7f38db400640 1 -- 172.21.15.18:0/2427944547 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc023070 con 0x55a27642dcd0 2024-09-12T03:00:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.212+0000 7f38db400640 1 -- 172.21.15.18:0/2427944547 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38dc0047a0 con 0x55a27642dcd0 2024-09-12T03:00:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.212+0000 7f38db400640 1 -- 172.21.15.18:0/2427944547 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc01f820 con 0x55a27642dcd0 2024-09-12T03:00:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.213+0000 7f38f8c8d740 1 -- 172.21.15.18:0/2427944547 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642dcd0 msgr2=0x55a276450080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.213+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/2427944547 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642dcd0 0x55a276450080 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f38dc010e10 tx=0x7f38dc00a480 comp rx=0 tx=0).stop 2024-09-12T03:00:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.213+0000 7f38f8c8d740 1 -- 172.21.15.18:0/2427944547 shutdown_connections 2024-09-12T03:00:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.213+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/2427944547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a276438570 0x55a2764505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.213+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/2427944547 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642dcd0 0x55a276450080 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.213+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/2427944547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a27642d3b0 0x55a27642f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.213+0000 7f38f8c8d740 1 -- 172.21.15.18:0/2427944547 >> 172.21.15.18:0/2427944547 conn(0x55a276429920 msgr2=0x55a27642ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:02.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.214+0000 7f38f8c8d740 1 -- 172.21.15.18:0/2427944547 shutdown_connections 2024-09-12T03:00:02.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.214+0000 7f38f8c8d740 1 -- 172.21.15.18:0/2427944547 wait complete. 2024-09-12T03:00:02.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.214+0000 7f38f8c8d740 1 -- start start 2024-09-12T03:00:02.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.215+0000 7f38f8c8d740 1 Processor -- start 2024-09-12T03:00:02.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.215+0000 7f38f8c8d740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a27642d3b0 0x55a276440630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.215+0000 7f38f8c8d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642dcd0 0x55a276440b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.215+0000 7f38f8c8d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a276438570 0x55a27643bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.215+0000 7f38f8c8d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38d0011860 con 0x55a276438570 2024-09-12T03:00:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.215+0000 7f38f8c8d740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f38d00110d0 con 0x55a27642d3b0 2024-09-12T03:00:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.215+0000 7f38f8c8d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f38d000e1b0 con 0x55a27642dcd0 2024-09-12T03:00:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.215+0000 7f38f8c8d740 10 client.0 _ll_register_callbacks cb 0x7f38e8097400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:00:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.216+0000 7f38ee000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642dcd0 0x55a276440b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.216+0000 7f38eea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a27642d3b0 0x55a276440630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.216+0000 7f38ee000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642dcd0 0x55a276440b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:48874/0 (socket says 172.21.15.18:48874) 2024-09-12T03:00:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.216+0000 7f38ee000640 1 -- 172.21.15.18:0/802147776 learned_addr learned my addr 172.21.15.18:0/802147776 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.216+0000 7f38ee000640 1 -- 172.21.15.18:0/802147776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a27642d3b0 msgr2=0x55a276440630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.216+0000 7f38ee000640 1 --2- 172.21.15.18:0/802147776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a27642d3b0 0x55a276440630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.216+0000 7f38ee000640 1 -- 172.21.15.18:0/802147776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a276438570 msgr2=0x55a27643bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.216+0000 7f38ee000640 1 --2- 172.21.15.18:0/802147776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a276438570 0x55a27643bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.216+0000 7f38ee000640 1 -- 172.21.15.18:0/802147776 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a27642a5b0 con 0x55a27642dcd0 2024-09-12T03:00:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.216+0000 7f38eea00640 1 --2- 172.21.15.18:0/802147776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a27642d3b0 0x55a276440630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:00:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.217+0000 7f38ee000640 1 --2- 172.21.15.18:0/802147776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642dcd0 0x55a276440b70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f38dc0058c0 tx=0x7f38dc005210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f43ccfb137dfaa79 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:02.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.219+0000 7f38d8c00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T03:00:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.219+0000 7f38d8c00640 1 -- 172.21.15.18:0/802147776 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc023040 con 0x55a27642dcd0 2024-09-12T03:00:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.219+0000 7f38d8c00640 1 -- 172.21.15.18:0/802147776 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9650+0+0 (secure 0 0 0) 0x7f38dc02f030 con 0x55a27642dcd0 2024-09-12T03:00:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.219+0000 7f38f8c8d740 1 -- 172.21.15.18:0/802147776 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38dc0047a0 con 0x55a27642dcd0 2024-09-12T03:00:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.220+0000 7f38d8c00640 1 -- 172.21.15.18:0/802147776 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f38dc023040 con 0x55a27642dcd0 2024-09-12T03:00:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.220+0000 7f38f8c8d740 10 client.25978 fetch_fsmap learned FSMap version 65 2024-09-12T03:00:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.220+0000 7f38f8c8d740 1 -- 172.21.15.18:0/802147776 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x55a2764b2900 con 0x55a27642dcd0 2024-09-12T03:00:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.220+0000 7f38d8c00640 1 -- 172.21.15.18:0/802147776 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38dc01fa80 con 0x55a27642dcd0 2024-09-12T03:00:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.220+0000 7f38d8c00640 1 -- 172.21.15.18:0/802147776 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 65) ==== 8442+0+0 (secure 0 0 0) 0x7f38dc03d660 con 0x55a27642dcd0 2024-09-12T03:00:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.221+0000 7f38f8c8d740 10 client.25978 fetch_fsmap finished waiting for FSMap version 65 2024-09-12T03:00:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.221+0000 7f38f8c8d740 10 client.25978 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:00:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.221+0000 7f38f8c8d740 20 client.25978 populate_metadata read hostname 'smithi018' 2024-09-12T03:00:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.221+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/802147776 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a2764b3140 0x55a2764b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.221+0000 7f38f8c8d740 4 client.25978 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T03:00:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.221+0000 7f38f8c8d740 1 -- 172.21.15.18:0/802147776 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f38dc0047a0 con 0x55a2764b3140 2024-09-12T03:00:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.221+0000 7f38eea00640 1 --2- 172.21.15.18:0/802147776 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a2764b3140 0x55a2764b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.222+0000 7f38eea00640 1 --2- 172.21.15.18:0/802147776 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a2764b3140 0x55a2764b5560 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40efb93ff118540f server_cookie=924ebcb2955444b7 in_seq=0 out_seq=0 2024-09-12T03:00:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.222+0000 7f38d8c00640 10 client.25978 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:00:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.493+0000 7f38d8c00640 1 -- 172.21.15.18:0/802147776 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f38dc0047a0 con 0x55a2764b3140 2024-09-12T03:00:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.493+0000 7f38d8c00640 10 client.25978 handle_command_reply: tid=0 2024-09-12T03:00:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.493+0000 7f38f8c8d740 1 client.25978 shutdown 2024-09-12T03:00:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.493+0000 7f38f8c8d740 1 -- 172.21.15.18:0/802147776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642dcd0 msgr2=0x55a276440b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.493+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/802147776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642dcd0 0x55a276440b70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f38dc0058c0 tx=0x7f38dc005210 comp rx=0 tx=0).stop 2024-09-12T03:00:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.494+0000 7f38f8c8d740 1 -- 172.21.15.18:0/802147776 shutdown_connections 2024-09-12T03:00:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.494+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/802147776 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a2764b3140 0x55a2764b5560 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.494+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/802147776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a276438570 0x55a27643bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.494+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/802147776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a27642dcd0 0x55a276440b70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.494+0000 7f38f8c8d740 1 --2- 172.21.15.18:0/802147776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a27642d3b0 0x55a276440630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.494+0000 7f38f8c8d740 1 -- 172.21.15.18:0/802147776 >> 172.21.15.18:0/802147776 conn(0x55a276429920 msgr2=0x55a2764289c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.494+0000 7f38d8c00640 0 client.25978 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:00:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.495+0000 7f38f8c8d740 1 -- 172.21.15.18:0/802147776 shutdown_connections 2024-09-12T03:00:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.495+0000 7f38f8c8d740 1 -- 172.21.15.18:0/802147776 wait complete. 2024-09-12T03:00:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.495+0000 7f38f8c8d740 20 client.25978 trim_cache size 0 max 16384 2024-09-12T03:00:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T03:00:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T03:00:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T03:00:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T03:00:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.496+0000 7f38efe00640 1 -- 172.21.15.18:0/1010993895 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f38d40a2d70 msgr2=0x7f38d40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.496+0000 7f38efe00640 1 --2- 172.21.15.18:0/1010993895 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f38d40a2d70 0x7f38d40a5230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f38f011d4d0 tx=0x7f38dc00a580 comp rx=0 tx=0).stop 2024-09-12T03:00:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.496+0000 7f38efe00640 1 -- 172.21.15.18:0/1010993895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38f011b140 msgr2=0x7f38f01ab900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.496+0000 7f38efe00640 1 --2- 172.21.15.18:0/1010993895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38f011b140 0x7f38f01ab900 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f38e800be20 tx=0x7f38e800bf10 comp rx=0 tx=0).stop 2024-09-12T03:00:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.496+0000 7f38efe00640 1 -- 172.21.15.18:0/1010993895 shutdown_connections 2024-09-12T03:00:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.496+0000 7f38efe00640 1 --2- 172.21.15.18:0/1010993895 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f38d40a2d70 0x7f38d40a5230 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.496+0000 7f38efe00640 1 --2- 172.21.15.18:0/1010993895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38f011b140 0x7f38f01ab900 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.496+0000 7f38efe00640 1 --2- 172.21.15.18:0/1010993895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38f01095d0 0x7f38f01a7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.496+0000 7f38efe00640 1 --2- 172.21.15.18:0/1010993895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38f01091f0 0x7f38f01a7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.496+0000 7f38efe00640 1 -- 172.21.15.18:0/1010993895 >> 172.21.15.18:0/1010993895 conn(0x7f38f006cbf0 msgr2=0x7f38f011b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.496+0000 7f38efe00640 1 -- 172.21.15.18:0/1010993895 shutdown_connections 2024-09-12T03:00:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:02.497+0000 7f38efe00640 1 -- 172.21.15.18:0/1010993895 wait complete. 2024-09-12T03:00:02.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:02 smithi018 ceph-mon[30616]: pgmap v351: 129 pgs: 13 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 110 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 168 op/s 2024-09-12T03:00:02.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:02 smithi176 ceph-mon[35713]: pgmap v351: 129 pgs: 13 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 110 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 168 op/s 2024-09-12T03:00:03.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:02 smithi062 ceph-mon[35527]: pgmap v351: 129 pgs: 13 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 110 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 168 op/s 2024-09-12T03:00:03.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:03 smithi176 ceph-mon[35713]: osdmap e109: 12 total, 12 up, 12 in 2024-09-12T03:00:04.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:03 smithi062 ceph-mon[35527]: osdmap e109: 12 total, 12 up, 12 in 2024-09-12T03:00:04.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:03 smithi018 ceph-mon[30616]: osdmap e109: 12 total, 12 up, 12 in 2024-09-12T03:00:04.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:04 smithi062 ceph-mon[35527]: pgmap v353: 129 pgs: 7 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 117 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 181 op/s 2024-09-12T03:00:04.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:04 smithi176 ceph-mon[35713]: pgmap v353: 129 pgs: 7 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 117 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 181 op/s 2024-09-12T03:00:05.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:04 smithi018 ceph-mon[30616]: pgmap v353: 129 pgs: 7 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 117 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 181 op/s 2024-09-12T03:00:06.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:06 smithi176 ceph-mon[35713]: pgmap v354: 129 pgs: 66 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 40 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 198 op/s 2024-09-12T03:00:07.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:06 smithi062 ceph-mon[35527]: pgmap v354: 129 pgs: 66 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 40 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 198 op/s 2024-09-12T03:00:07.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:06 smithi018 ceph-mon[30616]: pgmap v354: 129 pgs: 66 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 40 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 198 op/s 2024-09-12T03:00:08.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:08 smithi176 ceph-mon[35713]: pgmap v355: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 197 op/s 2024-09-12T03:00:09.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:08 smithi062 ceph-mon[35527]: pgmap v355: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 197 op/s 2024-09-12T03:00:09.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:08 smithi018 ceph-mon[30616]: pgmap v355: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 197 op/s 2024-09-12T03:00:10.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:10 smithi176 ceph-mon[35713]: pgmap v356: 129 pgs: 70 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 36 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 186 op/s 2024-09-12T03:00:11.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:10 smithi062 ceph-mon[35527]: pgmap v356: 129 pgs: 70 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 36 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 186 op/s 2024-09-12T03:00:11.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:10 smithi018 ceph-mon[30616]: pgmap v356: 129 pgs: 70 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 36 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 186 op/s 2024-09-12T03:00:12.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:12 smithi176 ceph-mon[35713]: pgmap v357: 129 pgs: 70 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 36 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 171 op/s 2024-09-12T03:00:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:12 smithi062 ceph-mon[35527]: pgmap v357: 129 pgs: 70 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 36 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 171 op/s 2024-09-12T03:00:13.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:12 smithi018 ceph-mon[30616]: pgmap v357: 129 pgs: 70 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 36 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 171 op/s 2024-09-12T03:00:14.854 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:14 smithi018 ceph-mon[30616]: pgmap v358: 129 pgs: 70 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 36 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 137 op/s 2024-09-12T03:00:14.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:14 smithi176 ceph-mon[35713]: pgmap v358: 129 pgs: 70 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 36 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 137 op/s 2024-09-12T03:00:15.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:14 smithi062 ceph-mon[35527]: pgmap v358: 129 pgs: 70 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 36 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 137 op/s 2024-09-12T03:00:16.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:16 smithi176 ceph-mon[35713]: pgmap v359: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 181 op/s 2024-09-12T03:00:17.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:16 smithi062 ceph-mon[35527]: pgmap v359: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 181 op/s 2024-09-12T03:00:17.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:16 smithi018 ceph-mon[30616]: pgmap v359: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 181 op/s 2024-09-12T03:00:18.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:18 smithi176 ceph-mon[35713]: pgmap v360: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 116 op/s 2024-09-12T03:00:19.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:18 smithi062 ceph-mon[35527]: pgmap v360: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 116 op/s 2024-09-12T03:00:19.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:18 smithi018 ceph-mon[30616]: pgmap v360: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 116 op/s 2024-09-12T03:00:20.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.882+0000 7fe8f0c00640 1 -- 172.21.15.18:0/3526017423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8ec106b10 msgr2=0x7fe8ec106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:20.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.882+0000 7fe8f0c00640 1 --2- 172.21.15.18:0/3526017423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8ec106b10 0x7fe8ec106ef0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009930 tx=0x7fe8dc02a420 comp rx=0 tx=0).stop 2024-09-12T03:00:20.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.882+0000 7fe8f0c00640 1 -- 172.21.15.18:0/3526017423 shutdown_connections 2024-09-12T03:00:20.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.882+0000 7fe8f0c00640 1 --2- 172.21.15.18:0/3526017423 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8ec100480 0x7fe8ec10e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.882+0000 7fe8f0c00640 1 --2- 172.21.15.18:0/3526017423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8ec0ffae0 0x7fe8ec0fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.882+0000 7fe8f0c00640 1 --2- 172.21.15.18:0/3526017423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8ec106b10 0x7fe8ec106ef0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.882+0000 7fe8f0c00640 1 -- 172.21.15.18:0/3526017423 >> 172.21.15.18:0/3526017423 conn(0x7fe8ec0fba30 msgr2=0x7fe8ec0fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:20.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.882+0000 7fe8f0c00640 1 -- 172.21.15.18:0/3526017423 shutdown_connections 2024-09-12T03:00:20.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.883+0000 7fe8f0c00640 1 -- 172.21.15.18:0/3526017423 wait complete. 2024-09-12T03:00:20.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.885+0000 7fe8f0c00640 1 Processor -- start 2024-09-12T03:00:20.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.885+0000 7fe8f0c00640 1 -- start start 2024-09-12T03:00:20.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.885+0000 7fe8f0c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8ec0ffae0 0x7fe8ec19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.885+0000 7fe8f0c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8ec100480 0x7fe8ec19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.885+0000 7fe8f0c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8ec106b10 0x7fe8ec19ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.885+0000 7fe8f0c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec111f20 con 0x7fe8ec106b10 2024-09-12T03:00:20.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.885+0000 7fe8f0c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec111da0 con 0x7fe8ec100480 2024-09-12T03:00:20.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.885+0000 7fe8f0c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec1120a0 con 0x7fe8ec0ffae0 2024-09-12T03:00:20.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.886+0000 7fe8e9e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8ec0ffae0 0x7fe8ec19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:20.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.886+0000 7fe8e9400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8ec100480 0x7fe8ec19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:20.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.886+0000 7fe8e9e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8ec0ffae0 0x7fe8ec19a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:54948/0 (socket says 172.21.15.18:54948) 2024-09-12T03:00:20.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.886+0000 7fe8e9e00640 1 -- 172.21.15.18:0/1416388352 learned_addr learned my addr 172.21.15.18:0/1416388352 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.886+0000 7fe8e9e00640 1 -- 172.21.15.18:0/1416388352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8ec100480 msgr2=0x7fe8ec19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.886+0000 7fe8e9e00640 1 --2- 172.21.15.18:0/1416388352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8ec100480 0x7fe8ec19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.886+0000 7fe8e9e00640 1 -- 172.21.15.18:0/1416388352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8ec106b10 msgr2=0x7fe8ec19ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.886+0000 7fe8e9e00640 1 --2- 172.21.15.18:0/1416388352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8ec106b10 0x7fe8ec19ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.886+0000 7fe8e9e00640 1 -- 172.21.15.18:0/1416388352 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ec19f480 con 0x7fe8ec0ffae0 2024-09-12T03:00:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.887+0000 7fe8e9e00640 1 --2- 172.21.15.18:0/1416388352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8ec0ffae0 0x7fe8ec19a490 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009230 tx=0x7fe8dc004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.887+0000 7fe8e2a00640 1 -- 172.21.15.18:0/1416388352 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc03f030 con 0x7fe8ec0ffae0 2024-09-12T03:00:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.887+0000 7fe8e2a00640 1 -- 172.21.15.18:0/1416388352 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8dc003ad0 con 0x7fe8ec0ffae0 2024-09-12T03:00:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.887+0000 7fe8e2a00640 1 -- 172.21.15.18:0/1416388352 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc035070 con 0x7fe8ec0ffae0 2024-09-12T03:00:20.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.889+0000 7fe8f0c00640 1 -- 172.21.15.18:0/1416388352 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8ec19f710 con 0x7fe8ec0ffae0 2024-09-12T03:00:20.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.889+0000 7fe8f0c00640 1 -- 172.21.15.18:0/1416388352 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8ec1a7000 con 0x7fe8ec0ffae0 2024-09-12T03:00:20.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.895+0000 7fe8f3aa5740 1 Processor -- start 2024-09-12T03:00:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.895+0000 7fe8e2a00640 1 -- 172.21.15.18:0/1416388352 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fe8dc042030 con 0x7fe8ec0ffae0 2024-09-12T03:00:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.896+0000 7fe8f3aa5740 1 -- start start 2024-09-12T03:00:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.897+0000 7fe8f3aa5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f2d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.898+0000 7fe8e2a00640 1 --2- 172.21.15.18:0/1416388352 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fe8d00a2da0 0x7fe8d00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.898+0000 7fe8ea800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f2d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.898+0000 7fe8f3aa5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2db00 0x55a7b3f37e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.898+0000 7fe8ea800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f2d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:40526/0 (socket says 172.21.15.18:40526) 2024-09-12T03:00:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.898+0000 7fe8f3aa5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f383a0 0x55a7b3f3a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.898+0000 7fe8f3aa5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a7b3e93100 con 0x55a7b3f383a0 2024-09-12T03:00:20.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.898+0000 7fe8f3aa5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a7b3e3b1b0 con 0x55a7b3f2d1e0 2024-09-12T03:00:20.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.898+0000 7fe8f3aa5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55a7b3e8f0c0 con 0x55a7b3f2db00 2024-09-12T03:00:20.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.898+0000 7fe8ea800640 1 -- 172.21.15.18:0/519680287 learned_addr learned my addr 172.21.15.18:0/519680287 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:20.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.898+0000 7fe8e9e00640 1 --2- 172.21.15.18:0/1416388352 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fe8d00a2da0 0x7fe8d00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:20.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.899+0000 7fe8ea800640 1 -- 172.21.15.18:0/519680287 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2db00 msgr2=0x55a7b3f37e60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T03:00:20.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.899+0000 7fe8ea800640 1 --2- 172.21.15.18:0/519680287 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2db00 0x55a7b3f37e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.899+0000 7fe8ea800640 1 -- 172.21.15.18:0/519680287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f383a0 msgr2=0x55a7b3f3a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:20.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.899+0000 7fe8ea800640 1 --2- 172.21.15.18:0/519680287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f383a0 0x55a7b3f3a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.899+0000 7fe8ea800640 1 -- 172.21.15.18:0/519680287 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7b3ba6210 con 0x55a7b3f2d1e0 2024-09-12T03:00:20.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.899+0000 7fe8ea800640 1 --2- 172.21.15.18:0/519680287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f2d5c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009fc0 tx=0x7fe8e4021810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44969ec9e6cc4fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:20.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.900+0000 7fe8d7000640 1 -- 172.21.15.18:0/519680287 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4004d20 con 0x55a7b3f2d1e0 2024-09-12T03:00:20.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.900+0000 7fe8d7000640 1 -- 172.21.15.18:0/519680287 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8e4005500 con 0x55a7b3f2d1e0 2024-09-12T03:00:20.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.900+0000 7fe8d7000640 1 -- 172.21.15.18:0/519680287 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e40229a0 con 0x55a7b3f2d1e0 2024-09-12T03:00:20.902 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.901+0000 7fe8e2a00640 1 -- 172.21.15.18:0/1416388352 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9682+0+0 (secure 0 0 0) 0x7fe8dc0efc00 con 0x7fe8ec0ffae0 2024-09-12T03:00:20.903 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.901+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/519680287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f2d1e0 msgr2=0x55a7b3f2d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:20.903 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.901+0000 7fe8e9e00640 1 --2- 172.21.15.18:0/1416388352 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fe8d00a2da0 0x7fe8d00a5260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0ed4c0 tx=0x7fe8dc0b7800 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:20.903 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.901+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/519680287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f2d5c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009fc0 tx=0x7fe8e4021810 comp rx=0 tx=0).stop 2024-09-12T03:00:20.903 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.902+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/519680287 shutdown_connections 2024-09-12T03:00:20.903 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.902+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/519680287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f383a0 0x55a7b3f3a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.903 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.902+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/519680287 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2db00 0x55a7b3f37e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.904 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.902+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/519680287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f2d5c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.904 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.902+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/519680287 >> 172.21.15.18:0/519680287 conn(0x55a7b3f29750 msgr2=0x55a7b3f29b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:20.905 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.905+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/519680287 shutdown_connections 2024-09-12T03:00:20.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.906+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/519680287 wait complete. 2024-09-12T03:00:20.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.906+0000 7fe8f3aa5740 1 -- start start 2024-09-12T03:00:20.908 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.907+0000 7fe8f3aa5740 1 Processor -- start 2024-09-12T03:00:20.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.909+0000 7fe8f3aa5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f353c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.909+0000 7fe8f3aa5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f2db00 0x55a7b3f35900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.909+0000 7fe8f3aa5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f383a0 0x55a7b3f35e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.910+0000 7fe8e9400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f2db00 0x55a7b3f35900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.910+0000 7fe8e9400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f2db00 0x55a7b3f35900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:40528/0 (socket says 172.21.15.18:40528) 2024-09-12T03:00:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.910+0000 7fe8e9400640 1 -- 172.21.15.18:0/2546554184 learned_addr learned my addr 172.21.15.18:0/2546554184 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.910+0000 7fe8ea800640 1 --2- 172.21.15.18:0/2546554184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f383a0 0x55a7b3f35e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.910+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/2546554184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a7b3f3af70 con 0x55a7b3f383a0 2024-09-12T03:00:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.910+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/2546554184 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a7b3e1c090 con 0x55a7b3f2db00 2024-09-12T03:00:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.910+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/2546554184 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55a7b3f3b0f0 con 0x55a7b3f2d1e0 2024-09-12T03:00:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.910+0000 7fe8f3aa5740 10 client.0 _ll_register_callbacks cb 0x55a7b3e70f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:00:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.911+0000 7fe8e9400640 1 -- 172.21.15.18:0/2546554184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2d1e0 msgr2=0x55a7b3f353c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.911+0000 7fe8e9400640 1 --2- 172.21.15.18:0/2546554184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f353c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.911+0000 7fe8e9400640 1 -- 172.21.15.18:0/2546554184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f383a0 msgr2=0x55a7b3f35e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.911+0000 7fe8e9400640 1 --2- 172.21.15.18:0/2546554184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f383a0 0x55a7b3f35e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.911+0000 7fe8e9400640 1 -- 172.21.15.18:0/2546554184 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7b3c72620 con 0x55a7b3f2db00 2024-09-12T03:00:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.912+0000 7fe8e9400640 1 --2- 172.21.15.18:0/2546554184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f2db00 0x55a7b3f35900 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800bd90 tx=0x7fe8d800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecf2702e0d7fbc7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.912+0000 7fe8cb400640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T03:00:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.912+0000 7fe8cb400640 1 -- 172.21.15.18:0/2546554184 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8015070 con 0x55a7b3f2db00 2024-09-12T03:00:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.912+0000 7fe8cb400640 1 -- 172.21.15.18:0/2546554184 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9682+0+0 (secure 0 0 0) 0x7fe8d8004030 con 0x55a7b3f2db00 2024-09-12T03:00:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.913+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/2546554184 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8e4005500 con 0x55a7b3f2db00 2024-09-12T03:00:20.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.915+0000 7fe8cb400640 1 -- 172.21.15.18:0/2546554184 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7fe8d8004230 con 0x55a7b3f2db00 2024-09-12T03:00:20.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.915+0000 7fe8f3aa5740 10 client.26000 fetch_fsmap learned FSMap version 65 2024-09-12T03:00:20.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.915+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/2546554184 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x55a7b3f4f4b0 con 0x55a7b3f2db00 2024-09-12T03:00:20.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.915+0000 7fe8cb400640 1 -- 172.21.15.18:0/2546554184 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8e4005500 con 0x55a7b3f2db00 2024-09-12T03:00:20.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.917+0000 7fe8cb400640 1 -- 172.21.15.18:0/2546554184 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 65) ==== 8442+0+0 (secure 0 0 0) 0x7fe8d8011650 con 0x55a7b3f2db00 2024-09-12T03:00:20.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.917+0000 7fe8f3aa5740 10 client.26000 fetch_fsmap finished waiting for FSMap version 65 2024-09-12T03:00:20.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.917+0000 7fe8f3aa5740 10 client.26000 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:00:20.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.917+0000 7fe8f3aa5740 20 client.26000 populate_metadata read hostname 'smithi018' 2024-09-12T03:00:20.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.917+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/2546554184 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a7b3f50a30 0x55a7b3f52e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.917+0000 7fe8f3aa5740 4 client.26000 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:00:20.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.917+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/2546554184 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7b3ea0830 con 0x55a7b3f50a30 2024-09-12T03:00:20.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.918+0000 7fe8ea800640 1 --2- 172.21.15.18:0/2546554184 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a7b3f50a30 0x55a7b3f52e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.920+0000 7fe8ea800640 1 --2- 172.21.15.18:0/2546554184 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a7b3f50a30 0x55a7b3f52e20 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62aef9009000e91d server_cookie=2f3df2ba5b4170 in_seq=0 out_seq=0 2024-09-12T03:00:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.920+0000 7fe8cb400640 10 client.26000 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:00:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.921+0000 7fe8cb400640 1 -- 172.21.15.18:0/2546554184 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7b3ea0830 con 0x55a7b3f50a30 2024-09-12T03:00:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.921+0000 7fe8cb400640 10 client.26000 handle_command_reply: tid=0 2024-09-12T03:00:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.921+0000 7fe8f3aa5740 1 client.26000 shutdown 2024-09-12T03:00:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.922+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/2546554184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f2db00 msgr2=0x55a7b3f35900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.922+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/2546554184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f2db00 0x55a7b3f35900 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800bd90 tx=0x7fe8d800f730 comp rx=0 tx=0).stop 2024-09-12T03:00:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.922+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/2546554184 shutdown_connections 2024-09-12T03:00:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.922+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/2546554184 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a7b3f50a30 0x55a7b3f52e20 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.922+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/2546554184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f383a0 0x55a7b3f35e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.922+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/2546554184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f2db00 0x55a7b3f35900 secure :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800bd90 tx=0x7fe8d800f730 comp rx=0 tx=0).stop 2024-09-12T03:00:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.922+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/2546554184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f353c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.922+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/2546554184 >> 172.21.15.18:0/2546554184 conn(0x55a7b3f29750 msgr2=0x55a7b3f2f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.922+0000 7fe8cb400640 0 client.26000 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:00:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.922+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/2546554184 shutdown_connections 2024-09-12T03:00:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.923+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/2546554184 wait complete. 2024-09-12T03:00:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.923+0000 7fe8f3aa5740 20 client.26000 trim_cache size 0 max 16384 2024-09-12T03:00:20.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.963+0000 7fe8f3aa5740 1 Processor -- start 2024-09-12T03:00:20.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.964+0000 7fe8f3aa5740 1 -- start start 2024-09-12T03:00:20.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.964+0000 7fe8f3aa5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.964+0000 7fe8f3aa5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f383a0 0x55a7b3f58c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.964+0000 7fe8ea800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.965+0000 7fe8ea800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f586f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:54984/0 (socket says 172.21.15.18:54984) 2024-09-12T03:00:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.965+0000 7fe8ea800640 1 -- 172.21.15.18:0/1156575220 learned_addr learned my addr 172.21.15.18:0/1156575220 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.965+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/1156575220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f2a1a0 0x55a7b3f35380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.965+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1156575220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec071a10 con 0x55a7b3f2a1a0 2024-09-12T03:00:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.965+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1156575220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec073850 con 0x55a7b3f383a0 2024-09-12T03:00:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.965+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1156575220 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec0721a0 con 0x55a7b3f2d1e0 2024-09-12T03:00:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.966+0000 7fe8e9400640 1 --2- 172.21.15.18:0/1156575220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f383a0 0x55a7b3f58c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.966+0000 7fe8ea800640 1 --2- 172.21.15.18:0/1156575220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f2a1a0 0x55a7b3f35380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.966+0000 7fe8ea800640 1 -- 172.21.15.18:0/1156575220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f383a0 msgr2=0x55a7b3f58c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.966+0000 7fe8ea800640 1 --2- 172.21.15.18:0/1156575220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f383a0 0x55a7b3f58c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.966+0000 7fe8ea800640 1 -- 172.21.15.18:0/1156575220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f2a1a0 msgr2=0x55a7b3f35380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.966+0000 7fe8ea800640 1 --2- 172.21.15.18:0/1156575220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f2a1a0 0x55a7b3f35380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.966+0000 7fe8ea800640 1 -- 172.21.15.18:0/1156575220 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7b3f23c20 con 0x55a7b3f2d1e0 2024-09-12T03:00:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.967+0000 7fe8e9400640 1 --2- 172.21.15.18:0/1156575220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f383a0 0x55a7b3f58c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:00:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.967+0000 7fe8ea800640 1 --2- 172.21.15.18:0/1156575220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f586f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4022610 tx=0x7fe8e402d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=986ca7aba937e39d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.968+0000 7fe8d6600640 1 -- 172.21.15.18:0/1156575220 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e403e070 con 0x55a7b3f2d1e0 2024-09-12T03:00:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.968+0000 7fe8d6600640 1 -- 172.21.15.18:0/1156575220 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8e403c020 con 0x55a7b3f2d1e0 2024-09-12T03:00:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.968+0000 7fe8d6600640 1 -- 172.21.15.18:0/1156575220 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4039850 con 0x55a7b3f2d1e0 2024-09-12T03:00:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.969+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1156575220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2d1e0 msgr2=0x55a7b3f586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.969+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/1156575220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f586f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4022610 tx=0x7fe8e402d040 comp rx=0 tx=0).stop 2024-09-12T03:00:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.970+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1156575220 shutdown_connections 2024-09-12T03:00:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.970+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/1156575220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f2a1a0 0x55a7b3f35380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.970+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/1156575220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f383a0 0x55a7b3f58c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.970+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/1156575220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f586f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.971+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1156575220 >> 172.21.15.18:0/1156575220 conn(0x55a7b3f29750 msgr2=0x55a7b3f344b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.971+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1156575220 shutdown_connections 2024-09-12T03:00:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.971+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1156575220 wait complete. 2024-09-12T03:00:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.972+0000 7fe8f3aa5740 1 -- start start 2024-09-12T03:00:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.972+0000 7fe8f3aa5740 1 Processor -- start 2024-09-12T03:00:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.974+0000 7fe8f3aa5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2a1a0 0x55a7b3f491f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.974+0000 7fe8ea800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2a1a0 0x55a7b3f491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.975+0000 7fe8ea800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2a1a0 0x55a7b3f491f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:54998/0 (socket says 172.21.15.18:54998) 2024-09-12T03:00:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.975+0000 7fe8ea800640 1 -- 172.21.15.18:0/1992912607 learned_addr learned my addr 172.21.15.18:0/1992912607 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.975+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/1992912607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f32090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.975+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/1992912607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f383a0 0x55a7b3f325d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.975+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1992912607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec0730c0 con 0x55a7b3f2d1e0 2024-09-12T03:00:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.975+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1992912607 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec072930 con 0x55a7b3f383a0 2024-09-12T03:00:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.975+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1992912607 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec06fa70 con 0x55a7b3f2a1a0 2024-09-12T03:00:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.975+0000 7fe8f3aa5740 10 client.0 _ll_register_callbacks cb 0x7fe8d800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:00:20.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.975+0000 7fe8ea800640 1 --2- 172.21.15.18:0/1992912607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f383a0 0x55a7b3f325d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:20.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.976+0000 7fe8e9400640 1 --2- 172.21.15.18:0/1992912607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f32090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:20.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.976+0000 7fe8ea800640 1 -- 172.21.15.18:0/1992912607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f383a0 msgr2=0x55a7b3f325d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:20.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.976+0000 7fe8ea800640 1 --2- 172.21.15.18:0/1992912607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f383a0 0x55a7b3f325d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.976+0000 7fe8ea800640 1 -- 172.21.15.18:0/1992912607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f2d1e0 msgr2=0x55a7b3f32090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:20.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.976+0000 7fe8ea800640 1 --2- 172.21.15.18:0/1992912607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f32090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:20.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.976+0000 7fe8ea800640 1 -- 172.21.15.18:0/1992912607 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7b3f32e00 con 0x55a7b3f2a1a0 2024-09-12T03:00:20.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.977+0000 7fe8ea800640 1 --2- 172.21.15.18:0/1992912607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2a1a0 0x55a7b3f491f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009f90 tx=0x7fe8e4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d2b6264a1e68cf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:20.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.977+0000 7fe8cb400640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T03:00:20.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.977+0000 7fe8cb400640 1 -- 172.21.15.18:0/1992912607 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e403e070 con 0x55a7b3f2a1a0 2024-09-12T03:00:20.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.978+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1992912607 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8e403c020 con 0x55a7b3f2a1a0 2024-09-12T03:00:20.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:20 smithi176 ceph-mon[35713]: pgmap v361: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 136 op/s 2024-09-12T03:00:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.981+0000 7fe8cb400640 1 -- 172.21.15.18:0/1992912607 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9682+0+0 (secure 0 0 0) 0x7fe8e4022ac0 con 0x55a7b3f2a1a0 2024-09-12T03:00:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.981+0000 7fe8cb400640 1 -- 172.21.15.18:0/1992912607 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7fe8e4022cc0 con 0x55a7b3f2a1a0 2024-09-12T03:00:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.981+0000 7fe8f3aa5740 10 client.25990 fetch_fsmap learned FSMap version 65 2024-09-12T03:00:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.981+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1992912607 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x55a7b3fbb640 con 0x55a7b3f2a1a0 2024-09-12T03:00:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.982+0000 7fe8cb400640 1 -- 172.21.15.18:0/1992912607 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8e403c020 con 0x55a7b3f2a1a0 2024-09-12T03:00:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.983+0000 7fe8cb400640 1 -- 172.21.15.18:0/1992912607 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 65) ==== 8442+0+0 (secure 0 0 0) 0x7fe8e4028030 con 0x55a7b3f2a1a0 2024-09-12T03:00:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.983+0000 7fe8f3aa5740 10 client.25990 fetch_fsmap finished waiting for FSMap version 65 2024-09-12T03:00:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.983+0000 7fe8f3aa5740 10 client.25990 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:00:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.983+0000 7fe8f3aa5740 20 client.25990 populate_metadata read hostname 'smithi018' 2024-09-12T03:00:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.983+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/1992912607 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a7b3fbba90 0x55a7b3fbdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.983+0000 7fe8f3aa5740 4 client.25990 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T03:00:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.983+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1992912607 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a7b3e9ab80 con 0x55a7b3fbba90 2024-09-12T03:00:20.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.984+0000 7fe8e9400640 1 --2- 172.21.15.18:0/1992912607 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a7b3fbba90 0x55a7b3fbdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:20.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.984+0000 7fe8e9400640 1 --2- 172.21.15.18:0/1992912607 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a7b3fbba90 0x55a7b3fbdeb0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80a3c238fbbd6a9 server_cookie=8e837936f90a8ca0 in_seq=0 out_seq=0 2024-09-12T03:00:20.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:20.984+0000 7fe8cb400640 10 client.25990 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:00:21.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:20 smithi062 ceph-mon[35527]: pgmap v361: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 136 op/s 2024-09-12T03:00:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.066+0000 7fe8cb400640 1 -- 172.21.15.18:0/1992912607 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a7b3e9ab80 con 0x55a7b3fbba90 2024-09-12T03:00:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.066+0000 7fe8cb400640 10 client.25990 handle_command_reply: tid=0 2024-09-12T03:00:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.066+0000 7fe8f3aa5740 1 client.25990 shutdown 2024-09-12T03:00:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.066+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1992912607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2a1a0 msgr2=0x55a7b3f491f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.066+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/1992912607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2a1a0 0x55a7b3f491f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009f90 tx=0x7fe8e4004a40 comp rx=0 tx=0).stop 2024-09-12T03:00:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.067+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1992912607 shutdown_connections 2024-09-12T03:00:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.067+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/1992912607 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a7b3fbba90 0x55a7b3fbdeb0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.067+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/1992912607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a7b3f383a0 0x55a7b3f325d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.067+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/1992912607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7b3f2d1e0 0x55a7b3f32090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.067+0000 7fe8f3aa5740 1 --2- 172.21.15.18:0/1992912607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a7b3f2a1a0 0x55a7b3f491f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.067+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1992912607 >> 172.21.15.18:0/1992912607 conn(0x55a7b3f29750 msgr2=0x55a7b3f2ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.067+0000 7fe8cb400640 0 client.25990 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:00:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.069+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1992912607 shutdown_connections 2024-09-12T03:00:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.069+0000 7fe8f3aa5740 1 -- 172.21.15.18:0/1992912607 wait complete. 2024-09-12T03:00:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.069+0000 7fe8f3aa5740 20 client.25990 trim_cache size 0 max 16384 2024-09-12T03:00:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T03:00:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T03:00:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T03:00:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T03:00:21.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.071+0000 7fe8f0c00640 1 -- 172.21.15.18:0/1416388352 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fe8d00a2da0 msgr2=0x7fe8d00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:21.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.071+0000 7fe8f0c00640 1 --2- 172.21.15.18:0/1416388352 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fe8d00a2da0 0x7fe8d00a5260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0ed4c0 tx=0x7fe8dc0b7800 comp rx=0 tx=0).stop 2024-09-12T03:00:21.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.071+0000 7fe8f0c00640 1 -- 172.21.15.18:0/1416388352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8ec0ffae0 msgr2=0x7fe8ec19a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:21.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.071+0000 7fe8f0c00640 1 --2- 172.21.15.18:0/1416388352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8ec0ffae0 0x7fe8ec19a490 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009230 tx=0x7fe8dc004270 comp rx=0 tx=0).stop 2024-09-12T03:00:21.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.071+0000 7fe8f0c00640 1 -- 172.21.15.18:0/1416388352 shutdown_connections 2024-09-12T03:00:21.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.071+0000 7fe8f0c00640 1 --2- 172.21.15.18:0/1416388352 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fe8d00a2da0 0x7fe8d00a5260 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:21.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.071+0000 7fe8f0c00640 1 --2- 172.21.15.18:0/1416388352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8ec106b10 0x7fe8ec19ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:21.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.071+0000 7fe8f0c00640 1 --2- 172.21.15.18:0/1416388352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8ec100480 0x7fe8ec19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:21.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.071+0000 7fe8f0c00640 1 --2- 172.21.15.18:0/1416388352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8ec0ffae0 0x7fe8ec19a490 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:21.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.071+0000 7fe8f0c00640 1 -- 172.21.15.18:0/1416388352 >> 172.21.15.18:0/1416388352 conn(0x7fe8ec0fba30 msgr2=0x7fe8ec0fc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:21.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.071+0000 7fe8f0c00640 1 -- 172.21.15.18:0/1416388352 shutdown_connections 2024-09-12T03:00:21.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:21.071+0000 7fe8f0c00640 1 -- 172.21.15.18:0/1416388352 wait complete. 2024-09-12T03:00:21.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:20 smithi018 ceph-mon[30616]: pgmap v361: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 136 op/s 2024-09-12T03:00:22.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:22 smithi018 ceph-mon[30616]: pgmap v362: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 196 op/s 2024-09-12T03:00:22.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:22 smithi176 ceph-mon[35713]: pgmap v362: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 196 op/s 2024-09-12T03:00:23.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:22 smithi062 ceph-mon[35527]: pgmap v362: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 196 op/s 2024-09-12T03:00:24.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:24 smithi176 ceph-mon[35713]: pgmap v363: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 192 op/s 2024-09-12T03:00:25.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:24 smithi062 ceph-mon[35527]: pgmap v363: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 192 op/s 2024-09-12T03:00:25.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:24 smithi018 ceph-mon[30616]: pgmap v363: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 192 op/s 2024-09-12T03:00:26.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:26 smithi176 ceph-mon[35713]: pgmap v364: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 352 op/s 2024-09-12T03:00:26.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:26 smithi176 ceph-mon[35713]: osdmap e110: 12 total, 12 up, 12 in 2024-09-12T03:00:27.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:26 smithi062 ceph-mon[35527]: pgmap v364: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 352 op/s 2024-09-12T03:00:27.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:26 smithi062 ceph-mon[35527]: osdmap e110: 12 total, 12 up, 12 in 2024-09-12T03:00:27.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:26 smithi018 ceph-mon[30616]: pgmap v364: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 352 op/s 2024-09-12T03:00:27.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:26 smithi018 ceph-mon[30616]: osdmap e110: 12 total, 12 up, 12 in 2024-09-12T03:00:28.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:28 smithi018 ceph-mon[30616]: pgmap v366: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 351 op/s 2024-09-12T03:00:28.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:28 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:00:28.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:28 smithi176 ceph-mon[35713]: pgmap v366: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 351 op/s 2024-09-12T03:00:28.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:28 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:00:28.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:28 smithi062 ceph-mon[35527]: pgmap v366: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 351 op/s 2024-09-12T03:00:28.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:28 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:00:30.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:30 smithi018 ceph-mon[30616]: pgmap v367: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 351 op/s 2024-09-12T03:00:30.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:30 smithi176 ceph-mon[35713]: pgmap v367: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 351 op/s 2024-09-12T03:00:30.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:30 smithi062 ceph-mon[35527]: pgmap v367: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 351 op/s 2024-09-12T03:00:32.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:32 smithi018 ceph-mon[30616]: pgmap v368: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 341 op/s 2024-09-12T03:00:32.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:32 smithi176 ceph-mon[35713]: pgmap v368: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 341 op/s 2024-09-12T03:00:32.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:32 smithi062 ceph-mon[35527]: pgmap v368: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 341 op/s 2024-09-12T03:00:33.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:33 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:00:33.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:33 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:00:33.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:33 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:00:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.476+0000 7fc130e00640 1 -- 172.21.15.18:0/2985542372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc12c1048e0 msgr2=0x7fc12c108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.476+0000 7fc130e00640 1 --2- 172.21.15.18:0/2985542372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc12c1048e0 0x7fc12c108920 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009900 tx=0x7fc11c02a400 comp rx=0 tx=0).stop 2024-09-12T03:00:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.477+0000 7fc130e00640 1 -- 172.21.15.18:0/2985542372 shutdown_connections 2024-09-12T03:00:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.477+0000 7fc130e00640 1 --2- 172.21.15.18:0/2985542372 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc12c109080 0x7fc12c110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.477+0000 7fc130e00640 1 --2- 172.21.15.18:0/2985542372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc12c1048e0 0x7fc12c108920 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.477+0000 7fc130e00640 1 --2- 172.21.15.18:0/2985542372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc12c103f30 0x7fc12c104310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.477+0000 7fc130e00640 1 -- 172.21.15.18:0/2985542372 >> 172.21.15.18:0/2985542372 conn(0x7fc12c0ff980 msgr2=0x7fc12c101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.477+0000 7fc130e00640 1 -- 172.21.15.18:0/2985542372 shutdown_connections 2024-09-12T03:00:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.477+0000 7fc130e00640 1 -- 172.21.15.18:0/2985542372 wait complete. 2024-09-12T03:00:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.479+0000 7fc130e00640 1 Processor -- start 2024-09-12T03:00:34.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.480+0000 7fc130e00640 1 -- start start 2024-09-12T03:00:34.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.481+0000 7fc130e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc12c103f30 0x7fc12c19a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.481+0000 7fc130e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc12c109080 0x7fc12c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.481+0000 7fc130e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc12c19ee40 0x7fc12c19f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.481+0000 7fc130e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c1140f0 con 0x7fc12c109080 2024-09-12T03:00:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.481+0000 7fc130e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c113f70 con 0x7fc12c19ee40 2024-09-12T03:00:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.481+0000 7fc130e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c114270 con 0x7fc12c103f30 2024-09-12T03:00:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.481+0000 7fc12a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc12c19ee40 0x7fc12c19f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.481+0000 7fc12a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc12c19ee40 0x7fc12c19f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:44604/0 (socket says 172.21.15.18:44604) 2024-09-12T03:00:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.481+0000 7fc12a800640 1 -- 172.21.15.18:0/2933313481 learned_addr learned my addr 172.21.15.18:0/2933313481 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.481+0000 7fc129400640 1 --2- 172.21.15.18:0/2933313481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc12c109080 0x7fc12c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.482+0000 7fc12a800640 1 -- 172.21.15.18:0/2933313481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc12c103f30 msgr2=0x7fc12c19a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.482+0000 7fc12a800640 1 --2- 172.21.15.18:0/2933313481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc12c103f30 0x7fc12c19a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.482+0000 7fc12a800640 1 -- 172.21.15.18:0/2933313481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc12c109080 msgr2=0x7fc12c19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.482+0000 7fc12a800640 1 --2- 172.21.15.18:0/2933313481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc12c109080 0x7fc12c19aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.482+0000 7fc12a800640 1 -- 172.21.15.18:0/2933313481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc12c19f930 con 0x7fc12c19ee40 2024-09-12T03:00:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.482+0000 7fc12a800640 1 --2- 172.21.15.18:0/2933313481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc12c19ee40 0x7fc12c19f2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc12400eb10 tx=0x7fc12400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.484+0000 7fc122a00640 1 -- 172.21.15.18:0/2933313481 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc124004b20 con 0x7fc12c19ee40 2024-09-12T03:00:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.484+0000 7fc122a00640 1 -- 172.21.15.18:0/2933313481 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc124004cc0 con 0x7fc12c19ee40 2024-09-12T03:00:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.484+0000 7fc122a00640 1 -- 172.21.15.18:0/2933313481 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc124010760 con 0x7fc12c19ee40 2024-09-12T03:00:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.484+0000 7fc130e00640 1 -- 172.21.15.18:0/2933313481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc12c19fc20 con 0x7fc12c19ee40 2024-09-12T03:00:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.484+0000 7fc130e00640 1 -- 172.21.15.18:0/2933313481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc12c1a73e0 con 0x7fc12c19ee40 2024-09-12T03:00:34.490 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.490+0000 7fc133c4b740 1 Processor -- start 2024-09-12T03:00:34.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.494+0000 7fc122a00640 1 -- 172.21.15.18:0/2933313481 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fc124005020 con 0x7fc12c19ee40 2024-09-12T03:00:34.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.494+0000 7fc133c4b740 1 -- start start 2024-09-12T03:00:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.496+0000 7fc133c4b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51ade1e0 0x560d51ade5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.496+0000 7fc133c4b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51adeb00 0x560d51ae8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.496+0000 7fc133c4b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ae93a0 0x560d51aeb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.496+0000 7fc133c4b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560d51a44100 con 0x560d51ade1e0 2024-09-12T03:00:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.496+0000 7fc133c4b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560d519ec1b0 con 0x560d51ae93a0 2024-09-12T03:00:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.496+0000 7fc133c4b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x560d51a400c0 con 0x560d51adeb00 2024-09-12T03:00:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.496+0000 7fc129400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51ade1e0 0x560d51ade5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.497+0000 7fc129400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ae93a0 0x560d51aeb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.497+0000 7fc129400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ae93a0 0x560d51aeb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:44620/0 (socket says 172.21.15.18:44620) 2024-09-12T03:00:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.497+0000 7fc129400640 1 -- 172.21.15.18:0/4058469096 learned_addr learned my addr 172.21.15.18:0/4058469096 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.497+0000 7fc122a00640 1 --2- 172.21.15.18:0/2933313481 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc1100a2ea0 0x7fc1100a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.497+0000 7fc129e00640 1 --2- 172.21.15.18:0/4058469096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51adeb00 0x560d51ae8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.497+0000 7fc122a00640 1 -- 172.21.15.18:0/2933313481 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9622+0+0 (secure 0 0 0) 0x7fc1240cff20 con 0x7fc12c19ee40 2024-09-12T03:00:34.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.497+0000 7fc129400640 1 -- 172.21.15.18:0/4058469096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51adeb00 msgr2=0x560d51ae8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:34.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.497+0000 7fc129400640 1 --2- 172.21.15.18:0/4058469096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51adeb00 0x560d51ae8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.497+0000 7fc129400640 1 -- 172.21.15.18:0/4058469096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51ade1e0 msgr2=0x560d51ade5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:34.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.497+0000 7fc129400640 1 --2- 172.21.15.18:0/4058469096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51ade1e0 0x560d51ade5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.497+0000 7fc129400640 1 -- 172.21.15.18:0/4058469096 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d51757210 con 0x560d51ae93a0 2024-09-12T03:00:34.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.498+0000 7fc12a800640 1 --2- 172.21.15.18:0/2933313481 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc1100a2ea0 0x7fc1100a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.498+0000 7fc129400640 1 --2- 172.21.15.18:0/4058469096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ae93a0 0x560d51aeb790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc12c06b470 tx=0x7fc11c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcc0332ee9c2a763 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:34.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.499+0000 7fc11b400640 1 -- 172.21.15.18:0/4058469096 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c035040 con 0x560d51ae93a0 2024-09-12T03:00:34.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.499+0000 7fc12a800640 1 --2- 172.21.15.18:0/2933313481 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc1100a2ea0 0x7fc1100a5360 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc1240049d0 tx=0x7fc124005b40 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:34.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.499+0000 7fc11b400640 1 -- 172.21.15.18:0/4058469096 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc11c004360 con 0x560d51ae93a0 2024-09-12T03:00:34.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.499+0000 7fc11b400640 1 -- 172.21.15.18:0/4058469096 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c0319d0 con 0x560d51ae93a0 2024-09-12T03:00:34.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.500+0000 7fc133c4b740 1 -- 172.21.15.18:0/4058469096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ae93a0 msgr2=0x560d51aeb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:34.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.500+0000 7fc133c4b740 1 --2- 172.21.15.18:0/4058469096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ae93a0 0x560d51aeb790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc12c06b470 tx=0x7fc11c000bc0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.501+0000 7fc133c4b740 1 -- 172.21.15.18:0/4058469096 shutdown_connections 2024-09-12T03:00:34.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.501+0000 7fc133c4b740 1 --2- 172.21.15.18:0/4058469096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ae93a0 0x560d51aeb790 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.501+0000 7fc133c4b740 1 --2- 172.21.15.18:0/4058469096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51adeb00 0x560d51ae8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.501+0000 7fc133c4b740 1 --2- 172.21.15.18:0/4058469096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51ade1e0 0x560d51ade5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.501+0000 7fc133c4b740 1 -- 172.21.15.18:0/4058469096 >> 172.21.15.18:0/4058469096 conn(0x560d51ada750 msgr2=0x560d51adab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:34.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.501+0000 7fc133c4b740 1 -- 172.21.15.18:0/4058469096 shutdown_connections 2024-09-12T03:00:34.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.501+0000 7fc133c4b740 1 -- 172.21.15.18:0/4058469096 wait complete. 2024-09-12T03:00:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.502+0000 7fc133c4b740 1 -- start start 2024-09-12T03:00:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.503+0000 7fc133c4b740 1 Processor -- start 2024-09-12T03:00:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.504+0000 7fc133c4b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ade1e0 0x560d51ae6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.504+0000 7fc133c4b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51adeb00 0x560d51ae67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.504+0000 7fc133c4b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51ae93a0 0x560d51ae6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.504+0000 7fc133c4b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560d51af4780 con 0x560d51adeb00 2024-09-12T03:00:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.504+0000 7fc133c4b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560d519cd090 con 0x560d51ade1e0 2024-09-12T03:00:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.504+0000 7fc133c4b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x560d51af4900 con 0x560d51ae93a0 2024-09-12T03:00:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.504+0000 7fc133c4b740 10 client.0 _ll_register_callbacks cb 0x560d51a21f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:00:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.504+0000 7fc129400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ade1e0 0x560d51ae6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.504+0000 7fc129400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ade1e0 0x560d51ae6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:44626/0 (socket says 172.21.15.18:44626) 2024-09-12T03:00:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.504+0000 7fc129400640 1 -- 172.21.15.18:0/3987496307 learned_addr learned my addr 172.21.15.18:0/3987496307 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.504+0000 7fc129400640 1 --2- 172.21.15.18:0/3987496307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51ae93a0 0x560d51ae6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.505+0000 7fc129e00640 1 --2- 172.21.15.18:0/3987496307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51adeb00 0x560d51ae67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.505+0000 7fc129400640 1 -- 172.21.15.18:0/3987496307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51ae93a0 msgr2=0x560d51ae6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.505+0000 7fc129400640 1 --2- 172.21.15.18:0/3987496307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51ae93a0 0x560d51ae6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.505+0000 7fc129400640 1 -- 172.21.15.18:0/3987496307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51adeb00 msgr2=0x560d51ae67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.505+0000 7fc129400640 1 --2- 172.21.15.18:0/3987496307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51adeb00 0x560d51ae67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.505+0000 7fc129400640 1 -- 172.21.15.18:0/3987496307 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d51823620 con 0x560d51ade1e0 2024-09-12T03:00:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.506+0000 7fc129400640 1 --2- 172.21.15.18:0/3987496307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ade1e0 0x560d51ae6260 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc11c004650 tx=0x7fc11c0315b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1114ff49aeb4baeb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.506+0000 7fc10fe00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T03:00:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.506+0000 7fc10fe00640 1 -- 172.21.15.18:0/3987496307 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c051060 con 0x560d51ade1e0 2024-09-12T03:00:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.506+0000 7fc10fe00640 1 -- 172.21.15.18:0/3987496307 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9622+0+0 (secure 0 0 0) 0x7fc11c031750 con 0x560d51ade1e0 2024-09-12T03:00:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.507+0000 7fc133c4b740 1 -- 172.21.15.18:0/3987496307 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc11c004360 con 0x560d51ade1e0 2024-09-12T03:00:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.509+0000 7fc10fe00640 1 -- 172.21.15.18:0/3987496307 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7fc11c0055c0 con 0x560d51ade1e0 2024-09-12T03:00:34.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.512+0000 7fc133c4b740 10 client.26018 fetch_fsmap learned FSMap version 67 2024-09-12T03:00:34.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.512+0000 7fc133c4b740 1 -- 172.21.15.18:0/3987496307 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) -- 0x560d51b003f0 con 0x560d51ade1e0 2024-09-12T03:00:34.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.513+0000 7fc10fe00640 1 -- 172.21.15.18:0/3987496307 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc11c004360 con 0x560d51ade1e0 2024-09-12T03:00:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.513+0000 7fc10fe00640 1 -- 172.21.15.18:0/3987496307 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 67) ==== 8450+0+0 (secure 0 0 0) 0x7fc11c004ce0 con 0x560d51ade1e0 2024-09-12T03:00:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.513+0000 7fc133c4b740 10 client.26018 fetch_fsmap finished waiting for FSMap version 67 2024-09-12T03:00:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.513+0000 7fc133c4b740 10 client.26018 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:00:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.513+0000 7fc133c4b740 20 client.26018 populate_metadata read hostname 'smithi018' 2024-09-12T03:00:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.513+0000 7fc133c4b740 1 --2- 172.21.15.18:0/3987496307 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x560d51b01740 0x560d51b03b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.513+0000 7fc133c4b740 4 client.26018 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:00:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.513+0000 7fc133c4b740 1 -- 172.21.15.18:0/3987496307 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d51a51830 con 0x560d51b01740 2024-09-12T03:00:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.514+0000 7fc129e00640 1 --2- 172.21.15.18:0/3987496307 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x560d51b01740 0x560d51b03b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.515+0000 7fc10fe00640 10 client.26018 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:00:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.516+0000 7fc129e00640 1 --2- 172.21.15.18:0/3987496307 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x560d51b01740 0x560d51b03b30 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bae5bfb197844c5b server_cookie=2765abeb6a5de049 in_seq=0 out_seq=0 2024-09-12T03:00:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.517+0000 7fc10fe00640 1 -- 172.21.15.18:0/3987496307 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560d51a51830 con 0x560d51b01740 2024-09-12T03:00:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.517+0000 7fc10fe00640 10 client.26018 handle_command_reply: tid=0 2024-09-12T03:00:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.517+0000 7fc133c4b740 1 client.26018 shutdown 2024-09-12T03:00:34.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.518+0000 7fc133c4b740 1 -- 172.21.15.18:0/3987496307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ade1e0 msgr2=0x560d51ae6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:34.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.518+0000 7fc133c4b740 1 --2- 172.21.15.18:0/3987496307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ade1e0 0x560d51ae6260 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc11c004650 tx=0x7fc11c0315b0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.518+0000 7fc133c4b740 1 -- 172.21.15.18:0/3987496307 shutdown_connections 2024-09-12T03:00:34.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.518+0000 7fc133c4b740 1 --2- 172.21.15.18:0/3987496307 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x560d51b01740 0x560d51b03b30 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.518+0000 7fc133c4b740 1 --2- 172.21.15.18:0/3987496307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51ae93a0 0x560d51ae6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.518+0000 7fc133c4b740 1 --2- 172.21.15.18:0/3987496307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51adeb00 0x560d51ae67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.518+0000 7fc133c4b740 1 --2- 172.21.15.18:0/3987496307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ade1e0 0x560d51ae6260 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.518+0000 7fc10fe00640 0 client.26018 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:00:34.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.518+0000 7fc133c4b740 1 -- 172.21.15.18:0/3987496307 >> 172.21.15.18:0/3987496307 conn(0x560d51ada750 msgr2=0x560d51ae04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:34.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.518+0000 7fc133c4b740 1 -- 172.21.15.18:0/3987496307 shutdown_connections 2024-09-12T03:00:34.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.518+0000 7fc133c4b740 1 -- 172.21.15.18:0/3987496307 wait complete. 2024-09-12T03:00:34.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.518+0000 7fc133c4b740 20 client.26018 trim_cache size 0 max 16384 2024-09-12T03:00:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.554+0000 7fc133c4b740 1 Processor -- start 2024-09-12T03:00:34.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.554+0000 7fc133c4b740 1 -- start start 2024-09-12T03:00:34.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.554+0000 7fc133c4b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ade1e0 0x560d51ae0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.554+0000 7fc133c4b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51adeb00 0x560d51b09190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.554+0000 7fc133c4b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51ae93a0 0x560d51b096d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.554+0000 7fc133c4b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c1ad0a0 con 0x560d51adeb00 2024-09-12T03:00:34.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.554+0000 7fc133c4b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c1aeee0 con 0x560d51ade1e0 2024-09-12T03:00:34.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.554+0000 7fc133c4b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c1ad830 con 0x560d51ae93a0 2024-09-12T03:00:34.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.554+0000 7fc129400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ade1e0 0x560d51ae0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.554+0000 7fc129400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ade1e0 0x560d51ae0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:44628/0 (socket says 172.21.15.18:44628) 2024-09-12T03:00:34.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.555+0000 7fc129400640 1 -- 172.21.15.18:0/528682359 learned_addr learned my addr 172.21.15.18:0/528682359 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:34.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.555+0000 7fc129e00640 1 --2- 172.21.15.18:0/528682359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51adeb00 0x560d51b09190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.555+0000 7fc129400640 1 --2- 172.21.15.18:0/528682359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51ae93a0 0x560d51b096d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.556+0000 7fc129400640 1 -- 172.21.15.18:0/528682359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51ae93a0 msgr2=0x560d51b096d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.556+0000 7fc129400640 1 --2- 172.21.15.18:0/528682359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51ae93a0 0x560d51b096d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.556+0000 7fc129400640 1 -- 172.21.15.18:0/528682359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51adeb00 msgr2=0x560d51b09190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.556+0000 7fc129400640 1 --2- 172.21.15.18:0/528682359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51adeb00 0x560d51b09190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.556+0000 7fc129400640 1 -- 172.21.15.18:0/528682359 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d51ada580 con 0x560d51ade1e0 2024-09-12T03:00:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.559+0000 7fc129400640 1 --2- 172.21.15.18:0/528682359 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ade1e0 0x560d51ae0c50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc11c006010 tx=0x7fc11c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81829f98476f3a53 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:34.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.559+0000 7fc11aa00640 1 -- 172.21.15.18:0/528682359 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c035040 con 0x560d51ade1e0 2024-09-12T03:00:34.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.560+0000 7fc11aa00640 1 -- 172.21.15.18:0/528682359 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc11c0042e0 con 0x560d51ade1e0 2024-09-12T03:00:34.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.560+0000 7fc11aa00640 1 -- 172.21.15.18:0/528682359 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c031c60 con 0x560d51ade1e0 2024-09-12T03:00:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.561+0000 7fc133c4b740 1 -- 172.21.15.18:0/528682359 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ade1e0 msgr2=0x560d51ae0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.561+0000 7fc133c4b740 1 --2- 172.21.15.18:0/528682359 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ade1e0 0x560d51ae0c50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc11c006010 tx=0x7fc11c000bc0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.561+0000 7fc133c4b740 1 -- 172.21.15.18:0/528682359 shutdown_connections 2024-09-12T03:00:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.561+0000 7fc133c4b740 1 --2- 172.21.15.18:0/528682359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51ae93a0 0x560d51b096d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.561+0000 7fc133c4b740 1 --2- 172.21.15.18:0/528682359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51adeb00 0x560d51b09190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.561+0000 7fc133c4b740 1 --2- 172.21.15.18:0/528682359 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51ade1e0 0x560d51ae0c50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.561+0000 7fc133c4b740 1 -- 172.21.15.18:0/528682359 >> 172.21.15.18:0/528682359 conn(0x560d51ada750 msgr2=0x560d51ae81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.562+0000 7fc133c4b740 1 -- 172.21.15.18:0/528682359 shutdown_connections 2024-09-12T03:00:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.562+0000 7fc133c4b740 1 -- 172.21.15.18:0/528682359 wait complete. 2024-09-12T03:00:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.563+0000 7fc133c4b740 1 -- start start 2024-09-12T03:00:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.563+0000 7fc133c4b740 1 Processor -- start 2024-09-12T03:00:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.564+0000 7fc133c4b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51ade1e0 0x560d51b67b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.564+0000 7fc133c4b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51adeb00 0x560d51af9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.564+0000 7fc133c4b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51ae93a0 0x560d51afa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.564+0000 7fc133c4b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c1ae750 con 0x560d51ade1e0 2024-09-12T03:00:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.564+0000 7fc133c4b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c1adfc0 con 0x560d51adeb00 2024-09-12T03:00:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.564+0000 7fc133c4b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c1ab0a0 con 0x560d51ae93a0 2024-09-12T03:00:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.564+0000 7fc133c4b740 10 client.0 _ll_register_callbacks cb 0x7fc1240093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:00:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.565+0000 7fc129e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51adeb00 0x560d51af9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.565+0000 7fc129e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51adeb00 0x560d51af9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:44634/0 (socket says 172.21.15.18:44634) 2024-09-12T03:00:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.565+0000 7fc129e00640 1 -- 172.21.15.18:0/3602174674 learned_addr learned my addr 172.21.15.18:0/3602174674 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.565+0000 7fc129400640 1 --2- 172.21.15.18:0/3602174674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51ae93a0 0x560d51afa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.566+0000 7fc129e00640 1 -- 172.21.15.18:0/3602174674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51ae93a0 msgr2=0x560d51afa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.566+0000 7fc129e00640 1 --2- 172.21.15.18:0/3602174674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51ae93a0 0x560d51afa1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.566+0000 7fc129e00640 1 -- 172.21.15.18:0/3602174674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51ade1e0 msgr2=0x560d51b67b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.566+0000 7fc129e00640 1 --2- 172.21.15.18:0/3602174674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51ade1e0 0x560d51b67b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.566+0000 7fc129e00640 1 -- 172.21.15.18:0/3602174674 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d51adb3e0 con 0x560d51adeb00 2024-09-12T03:00:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.567+0000 7fc129e00640 1 --2- 172.21.15.18:0/3602174674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51adeb00 0x560d51af9bc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x560d51ae78a0 tx=0x7fc114014840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f98ed5b83aab02f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.567+0000 7fc10fe00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T03:00:34.568 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.568+0000 7fc10fe00640 1 -- 172.21.15.18:0/3602174674 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1140142d0 con 0x560d51adeb00 2024-09-12T03:00:34.569 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.569+0000 7fc10fe00640 1 -- 172.21.15.18:0/3602174674 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9622+0+0 (secure 0 0 0) 0x7fc114012450 con 0x560d51adeb00 2024-09-12T03:00:34.569 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.569+0000 7fc133c4b740 1 -- 172.21.15.18:0/3602174674 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc11c0042e0 con 0x560d51adeb00 2024-09-12T03:00:34.569 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.569+0000 7fc10fe00640 1 -- 172.21.15.18:0/3602174674 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7fc114012650 con 0x560d51adeb00 2024-09-12T03:00:34.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.570+0000 7fc133c4b740 10 client.26024 fetch_fsmap learned FSMap version 67 2024-09-12T03:00:34.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.570+0000 7fc133c4b740 1 -- 172.21.15.18:0/3602174674 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) -- 0x560d51ad5d60 con 0x560d51adeb00 2024-09-12T03:00:34.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.571+0000 7fc10fe00640 1 -- 172.21.15.18:0/3602174674 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc11c0042e0 con 0x560d51adeb00 2024-09-12T03:00:34.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.571+0000 7fc10fe00640 1 -- 172.21.15.18:0/3602174674 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 67) ==== 8450+0+0 (secure 0 0 0) 0x7fc114022070 con 0x560d51adeb00 2024-09-12T03:00:34.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.571+0000 7fc133c4b740 10 client.26024 fetch_fsmap finished waiting for FSMap version 67 2024-09-12T03:00:34.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.571+0000 7fc133c4b740 10 client.26024 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:00:34.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.571+0000 7fc133c4b740 20 client.26024 populate_metadata read hostname 'smithi018' 2024-09-12T03:00:34.571 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.571+0000 7fc133c4b740 1 --2- 172.21.15.18:0/3602174674 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x560d51af04f0 0x560d51af2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.571+0000 7fc133c4b740 4 client.26024 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T03:00:34.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.571+0000 7fc133c4b740 1 -- 172.21.15.18:0/3602174674 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d51a4bb80 con 0x560d51af04f0 2024-09-12T03:00:34.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.572+0000 7fc129400640 1 --2- 172.21.15.18:0/3602174674 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x560d51af04f0 0x560d51af2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.573+0000 7fc10fe00640 10 client.26024 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:00:34.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:34.574+0000 7fc129400640 1 --2- 172.21.15.18:0/3602174674 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x560d51af04f0 0x560d51af2910 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=323bd4d2a333f32c server_cookie=a885eaf43df38095 in_seq=0 out_seq=0 2024-09-12T03:00:34.684 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:34 smithi062 ceph-mon[35527]: pgmap v369: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 325 op/s 2024-09-12T03:00:34.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:34 smithi176 ceph-mon[35713]: pgmap v369: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 325 op/s 2024-09-12T03:00:34.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:34 smithi018 ceph-mon[30616]: pgmap v369: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 325 op/s 2024-09-12T03:00:36.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:36 smithi176 ceph-mon[35713]: pgmap v370: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 208 op/s 2024-09-12T03:00:36.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:36 smithi062 ceph-mon[35527]: pgmap v370: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 208 op/s 2024-09-12T03:00:36.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:36 smithi018 ceph-mon[30616]: pgmap v370: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 208 op/s 2024-09-12T03:00:38.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:38 smithi176 ceph-mon[35713]: pgmap v371: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 210 op/s 2024-09-12T03:00:38.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:38 smithi062 ceph-mon[35527]: pgmap v371: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 210 op/s 2024-09-12T03:00:38.854 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:38 smithi018 ceph-mon[30616]: pgmap v371: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 210 op/s 2024-09-12T03:00:40.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:40 smithi176 ceph-mon[35713]: pgmap v372: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 355 op/s 2024-09-12T03:00:40.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:40 smithi062 ceph-mon[35527]: pgmap v372: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 355 op/s 2024-09-12T03:00:40.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:40 smithi018 ceph-mon[30616]: pgmap v372: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 355 op/s 2024-09-12T03:00:42.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:42 smithi176 ceph-mon[35713]: pgmap v373: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.28k op/s 2024-09-12T03:00:42.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:42 smithi062 ceph-mon[35527]: pgmap v373: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.28k op/s 2024-09-12T03:00:42.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:42 smithi018 ceph-mon[30616]: pgmap v373: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.28k op/s 2024-09-12T03:00:43.854 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 03:00:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T03:00:43.405+0000 7fea77000640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-12T03:00:44.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:44 smithi176 ceph-mon[35713]: pgmap v374: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 1.21k op/s 2024-09-12T03:00:44.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:44 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:00:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:44 smithi062 ceph-mon[35527]: pgmap v374: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 1.21k op/s 2024-09-12T03:00:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:44 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:00:44.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:44 smithi018 ceph-mon[30616]: pgmap v374: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 1.21k op/s 2024-09-12T03:00:44.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:44 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:00:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.979+0000 7fc10fe00640 1 -- 172.21.15.18:0/3602174674 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d51a4bb80 con 0x560d51af04f0 2024-09-12T03:00:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.980+0000 7fc10fe00640 10 client.26024 handle_command_reply: tid=0 2024-09-12T03:00:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.980+0000 7fc133c4b740 1 client.26024 shutdown 2024-09-12T03:00:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.980+0000 7fc133c4b740 1 -- 172.21.15.18:0/3602174674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51adeb00 msgr2=0x560d51af9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.980+0000 7fc133c4b740 1 --2- 172.21.15.18:0/3602174674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51adeb00 0x560d51af9bc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x560d51ae78a0 tx=0x7fc114014840 comp rx=0 tx=0).stop 2024-09-12T03:00:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.980+0000 7fc133c4b740 1 -- 172.21.15.18:0/3602174674 shutdown_connections 2024-09-12T03:00:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.980+0000 7fc133c4b740 1 --2- 172.21.15.18:0/3602174674 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x560d51af04f0 0x560d51af2910 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.980+0000 7fc133c4b740 1 --2- 172.21.15.18:0/3602174674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d51ae93a0 0x560d51afa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.980+0000 7fc133c4b740 1 --2- 172.21.15.18:0/3602174674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d51adeb00 0x560d51af9bc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.980+0000 7fc133c4b740 1 --2- 172.21.15.18:0/3602174674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d51ade1e0 0x560d51b67b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.980+0000 7fc133c4b740 1 -- 172.21.15.18:0/3602174674 >> 172.21.15.18:0/3602174674 conn(0x560d51ada750 msgr2=0x560d51ae78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.981+0000 7fc10fe00640 0 client.26024 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:00:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.981+0000 7fc133c4b740 1 -- 172.21.15.18:0/3602174674 shutdown_connections 2024-09-12T03:00:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.981+0000 7fc133c4b740 1 -- 172.21.15.18:0/3602174674 wait complete. 2024-09-12T03:00:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.981+0000 7fc133c4b740 20 client.26024 trim_cache size 0 max 16384 2024-09-12T03:00:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T03:00:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T03:00:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T03:00:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T03:00:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.982+0000 7fc130e00640 1 -- 172.21.15.18:0/2933313481 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc1100a2ea0 msgr2=0x7fc1100a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.982+0000 7fc130e00640 1 --2- 172.21.15.18:0/2933313481 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc1100a2ea0 0x7fc1100a5360 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc1240049d0 tx=0x7fc124005b40 comp rx=0 tx=0).stop 2024-09-12T03:00:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.982+0000 7fc130e00640 1 -- 172.21.15.18:0/2933313481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc12c19ee40 msgr2=0x7fc12c19f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.982+0000 7fc130e00640 1 --2- 172.21.15.18:0/2933313481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc12c19ee40 0x7fc12c19f2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc12400eb10 tx=0x7fc12400c2d0 comp rx=0 tx=0).stop 2024-09-12T03:00:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.983+0000 7fc130e00640 1 -- 172.21.15.18:0/2933313481 shutdown_connections 2024-09-12T03:00:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.983+0000 7fc130e00640 1 --2- 172.21.15.18:0/2933313481 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fc1100a2ea0 0x7fc1100a5360 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.983+0000 7fc130e00640 1 --2- 172.21.15.18:0/2933313481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc12c19ee40 0x7fc12c19f2f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.983+0000 7fc130e00640 1 --2- 172.21.15.18:0/2933313481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc12c109080 0x7fc12c19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.983+0000 7fc130e00640 1 --2- 172.21.15.18:0/2933313481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc12c103f30 0x7fc12c19a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.983+0000 7fc130e00640 1 -- 172.21.15.18:0/2933313481 >> 172.21.15.18:0/2933313481 conn(0x7fc12c0ff980 msgr2=0x7fc12c101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.983+0000 7fc130e00640 1 -- 172.21.15.18:0/2933313481 shutdown_connections 2024-09-12T03:00:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:45.983+0000 7fc130e00640 1 -- 172.21.15.18:0/2933313481 wait complete. 2024-09-12T03:00:46.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:46 smithi176 ceph-mon[35713]: pgmap v375: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 1.58k op/s 2024-09-12T03:00:46.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:46 smithi062 ceph-mon[35527]: pgmap v375: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 1.58k op/s 2024-09-12T03:00:46.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:46 smithi018 ceph-mon[30616]: pgmap v375: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 1.58k op/s 2024-09-12T03:00:48.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:48 smithi176 ceph-mon[35713]: pgmap v376: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 1.66k op/s 2024-09-12T03:00:48.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:48 smithi062 ceph-mon[35527]: pgmap v376: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 1.66k op/s 2024-09-12T03:00:48.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:48 smithi018 ceph-mon[30616]: pgmap v376: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 1.66k op/s 2024-09-12T03:00:50.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:50 smithi176 ceph-mon[35713]: pgmap v377: 129 pgs: 56 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 1.66k op/s 2024-09-12T03:00:50.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:50 smithi062 ceph-mon[35527]: pgmap v377: 129 pgs: 56 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 1.66k op/s 2024-09-12T03:00:50.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:50 smithi018 ceph-mon[30616]: pgmap v377: 129 pgs: 56 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 1.66k op/s 2024-09-12T03:00:52.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:52 smithi176 ceph-mon[35713]: pgmap v378: 129 pgs: 56 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 1.58k op/s 2024-09-12T03:00:52.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:52 smithi062 ceph-mon[35527]: pgmap v378: 129 pgs: 56 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 1.58k op/s 2024-09-12T03:00:52.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:52 smithi018 ceph-mon[30616]: pgmap v378: 129 pgs: 56 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 1.58k op/s 2024-09-12T03:00:53.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:53 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:00:53.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:53 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:00:53.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:53 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:00:54.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:54 smithi176 ceph-mon[35713]: pgmap v379: 129 pgs: 56 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 633 op/s 2024-09-12T03:00:54.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:54 smithi062 ceph-mon[35527]: pgmap v379: 129 pgs: 56 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 633 op/s 2024-09-12T03:00:54.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:54 smithi018 ceph-mon[30616]: pgmap v379: 129 pgs: 56 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 633 op/s 2024-09-12T03:00:56.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:56 smithi176 ceph-mon[35713]: pgmap v380: 129 pgs: 56 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 700 op/s 2024-09-12T03:00:56.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:56 smithi062 ceph-mon[35527]: pgmap v380: 129 pgs: 56 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 700 op/s 2024-09-12T03:00:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:56 smithi018 ceph-mon[30616]: pgmap v380: 129 pgs: 56 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 700 op/s 2024-09-12T03:00:58.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:58 smithi176 ceph-mon[35713]: pgmap v381: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 336 op/s 2024-09-12T03:00:58.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:58 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:00:58.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:00:58 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T03:00:58.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:58 smithi062 ceph-mon[35527]: pgmap v381: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 336 op/s 2024-09-12T03:00:58.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:58 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:00:58.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:00:58 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T03:00:58.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:58 smithi018 ceph-mon[30616]: pgmap v381: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 336 op/s 2024-09-12T03:00:58.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:58 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:00:58.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:00:58 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T03:00:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.223+0000 7f8d76000640 1 -- 172.21.15.18:0/1549342474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d70102ae0 msgr2=0x7f8d70102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.223+0000 7f8d76000640 1 --2- 172.21.15.18:0/1549342474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d70102ae0 0x7f8d70102ec0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009900 tx=0x7f8d6402a4a0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.224+0000 7f8d76000640 1 -- 172.21.15.18:0/1549342474 shutdown_connections 2024-09-12T03:00:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.224+0000 7f8d76000640 1 --2- 172.21.15.18:0/1549342474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d7010bf00 0x7f8d7010e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.224+0000 7f8d76000640 1 --2- 172.21.15.18:0/1549342474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d70103400 0x7f8d7010b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.224+0000 7f8d76000640 1 --2- 172.21.15.18:0/1549342474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d70102ae0 0x7f8d70102ec0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.224+0000 7f8d76000640 1 -- 172.21.15.18:0/1549342474 >> 172.21.15.18:0/1549342474 conn(0x7f8d700777c0 msgr2=0x7f8d700feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.224+0000 7f8d76000640 1 -- 172.21.15.18:0/1549342474 shutdown_connections 2024-09-12T03:00:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.225+0000 7f8d76000640 1 -- 172.21.15.18:0/1549342474 wait complete. 2024-09-12T03:00:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.226+0000 7f8d76000640 1 Processor -- start 2024-09-12T03:00:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.230+0000 7f8d76000640 1 -- start start 2024-09-12T03:00:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.231+0000 7f8d76000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d70102ae0 0x7f8d7019efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.231+0000 7f8d76000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d70103400 0x7f8d7019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.231+0000 7f8d76000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d7010bf00 0x7f8d7010ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.231+0000 7f8d76000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8d70111d80 con 0x7f8d70102ae0 2024-09-12T03:00:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.231+0000 7f8d76000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8d70111c00 con 0x7f8d70103400 2024-09-12T03:00:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.231+0000 7f8d76000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8d70111f00 con 0x7f8d7010bf00 2024-09-12T03:00:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.232+0000 7f8d6fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d70103400 0x7f8d7019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.232+0000 7f8d6fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d70103400 0x7f8d7019f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:60168/0 (socket says 172.21.15.18:60168) 2024-09-12T03:00:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.232+0000 7f8d6fe00640 1 -- 172.21.15.18:0/3749526319 learned_addr learned my addr 172.21.15.18:0/3749526319 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.232+0000 7f8d75600640 1 --2- 172.21.15.18:0/3749526319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d7010bf00 0x7f8d7010ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.232+0000 7f8d74c00640 1 --2- 172.21.15.18:0/3749526319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d70102ae0 0x7f8d7019efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.232+0000 7f8d6fe00640 1 -- 172.21.15.18:0/3749526319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d7010bf00 msgr2=0x7f8d7010ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.232+0000 7f8d6fe00640 1 --2- 172.21.15.18:0/3749526319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d7010bf00 0x7f8d7010ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.232+0000 7f8d6fe00640 1 -- 172.21.15.18:0/3749526319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d70102ae0 msgr2=0x7f8d7019efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.232+0000 7f8d6fe00640 1 --2- 172.21.15.18:0/3749526319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d70102ae0 0x7f8d7019efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.232+0000 7f8d6fe00640 1 -- 172.21.15.18:0/3749526319 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7010b630 con 0x7f8d70103400 2024-09-12T03:00:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.232+0000 7f8d6fe00640 1 --2- 172.21.15.18:0/3749526319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d70103400 0x7f8d7019f520 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00ea60 tx=0x7f8d5c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.233+0000 7f8d6d600640 1 -- 172.21.15.18:0/3749526319 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c00cde0 con 0x7f8d70103400 2024-09-12T03:00:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.233+0000 7f8d6d600640 1 -- 172.21.15.18:0/3749526319 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d5c0035f0 con 0x7f8d70103400 2024-09-12T03:00:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.233+0000 7f8d6d600640 1 -- 172.21.15.18:0/3749526319 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c010690 con 0x7f8d70103400 2024-09-12T03:00:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.233+0000 7f8d76000640 1 -- 172.21.15.18:0/3749526319 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7010b920 con 0x7f8d70103400 2024-09-12T03:00:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.233+0000 7f8d76000640 1 -- 172.21.15.18:0/3749526319 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d7019acf0 con 0x7f8d70103400 2024-09-12T03:00:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.241+0000 7f8d7a5cd740 1 Processor -- start 2024-09-12T03:00:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.242+0000 7f8d7a5cd740 1 -- start start 2024-09-12T03:00:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.242+0000 7f8d6d600640 1 -- 172.21.15.18:0/3749526319 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f8d5c004020 con 0x7f8d70103400 2024-09-12T03:00:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.242+0000 7f8d7a5cd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55893090e3b0 0x55893090e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.243+0000 7f8d7a5cd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090ecd0 0x558930919030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.243+0000 7f8d7a5cd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558930919570 0x55893091b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.243+0000 7f8d7a5cd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558930874100 con 0x55893090e3b0 2024-09-12T03:00:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.243+0000 7f8d7a5cd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55893081c1b0 con 0x558930919570 2024-09-12T03:00:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.243+0000 7f8d7a5cd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5589308700c0 con 0x55893090ecd0 2024-09-12T03:00:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.244+0000 7f8d6fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558930919570 0x55893091b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.244+0000 7f8d6fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558930919570 0x55893091b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:60182/0 (socket says 172.21.15.18:60182) 2024-09-12T03:00:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.244+0000 7f8d6fe00640 1 -- 172.21.15.18:0/3874789815 learned_addr learned my addr 172.21.15.18:0/3874789815 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.244+0000 7f8d75600640 1 --2- 172.21.15.18:0/3874789815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55893090e3b0 0x55893090e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.244+0000 7f8d6fe00640 1 -- 172.21.15.18:0/3874789815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090ecd0 msgr2=0x558930919030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T03:00:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.244+0000 7f8d6fe00640 1 --2- 172.21.15.18:0/3874789815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090ecd0 0x558930919030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.244+0000 7f8d6fe00640 1 -- 172.21.15.18:0/3874789815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55893090e3b0 msgr2=0x55893090e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.245+0000 7f8d6d600640 1 --2- 172.21.15.18:0/3749526319 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f8d580a2dc0 0x7f8d580a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.246+0000 7f8d6d600640 1 -- 172.21.15.18:0/3749526319 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9622+0+0 (secure 0 0 0) 0x7f8d5c0cfc20 con 0x7f8d70103400 2024-09-12T03:00:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.246+0000 7f8d74c00640 1 --2- 172.21.15.18:0/3749526319 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f8d580a2dc0 0x7f8d580a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:59.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.247+0000 7f8d74c00640 1 --2- 172.21.15.18:0/3749526319 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f8d580a2dc0 0x7f8d580a5280 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55893090b780 tx=0x7f8d64005fd0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:59.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.248+0000 7f8d6fe00640 1 --2- 172.21.15.18:0/3874789815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55893090e3b0 0x55893090e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.248+0000 7f8d6fe00640 1 -- 172.21.15.18:0/3874789815 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558930587210 con 0x558930919570 2024-09-12T03:00:59.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.248+0000 7f8d75600640 1 --2- 172.21.15.18:0/3874789815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55893090e3b0 0x55893090e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:00:59.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.248+0000 7f8d6fe00640 1 --2- 172.21.15.18:0/3874789815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558930919570 0x55893091b960 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0cce90 tx=0x7f8d5c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f09448396bd6996 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:59.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.249+0000 7f8d61c00640 1 -- 172.21.15.18:0/3874789815 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c09bc40 con 0x558930919570 2024-09-12T03:00:59.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.251+0000 7f8d61c00640 1 -- 172.21.15.18:0/3874789815 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d5c09c570 con 0x558930919570 2024-09-12T03:00:59.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.251+0000 7f8d61c00640 1 -- 172.21.15.18:0/3874789815 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c09b7d0 con 0x558930919570 2024-09-12T03:00:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.252+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/3874789815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558930919570 msgr2=0x55893091b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.252+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/3874789815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558930919570 0x55893091b960 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0cce90 tx=0x7f8d5c000bc0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.252+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/3874789815 shutdown_connections 2024-09-12T03:00:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.252+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/3874789815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558930919570 0x55893091b960 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.252+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/3874789815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090ecd0 0x558930919030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.252+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/3874789815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55893090e3b0 0x55893090e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.252+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/3874789815 >> 172.21.15.18:0/3874789815 conn(0x55893090a920 msgr2=0x55893090ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.253+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/3874789815 shutdown_connections 2024-09-12T03:00:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.253+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/3874789815 wait complete. 2024-09-12T03:00:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.254+0000 7f8d7a5cd740 1 -- start start 2024-09-12T03:00:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.254+0000 7f8d7a5cd740 1 Processor -- start 2024-09-12T03:00:59.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.255+0000 7f8d7a5cd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090e3b0 0x5589309165e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.255+0000 7f8d7a5cd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090ecd0 0x558930916b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.255+0000 7f8d7a5cd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558930919570 0x558930917060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.255+0000 7f8d7a5cd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55893091c050 con 0x558930919570 2024-09-12T03:00:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.255+0000 7f8d7a5cd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5589307fd090 con 0x55893090e3b0 2024-09-12T03:00:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.255+0000 7f8d7a5cd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55893091c1d0 con 0x55893090ecd0 2024-09-12T03:00:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.255+0000 7f8d7a5cd740 10 client.0 _ll_register_callbacks cb 0x558930851f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:00:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.256+0000 7f8d74c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090e3b0 0x5589309165e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.256+0000 7f8d74c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090e3b0 0x5589309165e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:60192/0 (socket says 172.21.15.18:60192) 2024-09-12T03:00:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.256+0000 7f8d74c00640 1 -- 172.21.15.18:0/193053519 learned_addr learned my addr 172.21.15.18:0/193053519 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.256+0000 7f8d74c00640 1 -- 172.21.15.18:0/193053519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090ecd0 msgr2=0x558930916b20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T03:00:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.256+0000 7f8d74c00640 1 --2- 172.21.15.18:0/193053519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090ecd0 0x558930916b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.256+0000 7f8d74c00640 1 -- 172.21.15.18:0/193053519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558930919570 msgr2=0x558930917060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.256+0000 7f8d74c00640 1 --2- 172.21.15.18:0/193053519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558930919570 0x558930917060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.256+0000 7f8d74c00640 1 -- 172.21.15.18:0/193053519 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558930653620 con 0x55893090e3b0 2024-09-12T03:00:59.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.260+0000 7f8d74c00640 1 --2- 172.21.15.18:0/193053519 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090e3b0 0x5589309165e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8d64004510 tx=0x7f8d64009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=184997f9ae0b36d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:59.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.260+0000 7f8d56000640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T03:00:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.262+0000 7f8d56000640 1 -- 172.21.15.18:0/193053519 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6404c020 con 0x55893090e3b0 2024-09-12T03:00:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.262+0000 7f8d56000640 1 -- 172.21.15.18:0/193053519 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9622+0+0 (secure 0 0 0) 0x7f8d640046c0 con 0x55893090e3b0 2024-09-12T03:00:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.264+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/193053519 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d5c09c570 con 0x55893090e3b0 2024-09-12T03:00:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.265+0000 7f8d56000640 1 -- 172.21.15.18:0/193053519 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f8d64035050 con 0x55893090e3b0 2024-09-12T03:00:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.267+0000 7f8d7a5cd740 10 client.26036 fetch_fsmap learned FSMap version 70 2024-09-12T03:00:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.267+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/193053519 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x558930927ef0 con 0x55893090e3b0 2024-09-12T03:00:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.267+0000 7f8d56000640 1 -- 172.21.15.18:0/193053519 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d5c09c570 con 0x55893090e3b0 2024-09-12T03:00:59.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.269+0000 7f8d56000640 1 -- 172.21.15.18:0/193053519 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 70) ==== 8438+0+0 (secure 0 0 0) 0x7f8d64059020 con 0x55893090e3b0 2024-09-12T03:00:59.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.269+0000 7f8d7a5cd740 10 client.26036 fetch_fsmap finished waiting for FSMap version 70 2024-09-12T03:00:59.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.269+0000 7f8d7a5cd740 10 client.26036 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:00:59.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.269+0000 7f8d7a5cd740 20 client.26036 populate_metadata read hostname 'smithi018' 2024-09-12T03:00:59.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.269+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/193053519 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5589309297e0 0x55893092bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.269+0000 7f8d7a5cd740 4 client.26036 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:00:59.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.269+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/193053519 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558930881830 con 0x5589309297e0 2024-09-12T03:00:59.271 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.269+0000 7f8d6fe00640 1 --2- 172.21.15.18:0/193053519 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5589309297e0 0x55893092bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:59.272 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.271+0000 7f8d56000640 10 client.26036 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:00:59.272 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.271+0000 7f8d6fe00640 1 --2- 172.21.15.18:0/193053519 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5589309297e0 0x55893092bc70 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e9c4ad313789f29 server_cookie=23933a2e9f55867 in_seq=0 out_seq=0 2024-09-12T03:00:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.272+0000 7f8d56000640 1 -- 172.21.15.18:0/193053519 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558930881830 con 0x5589309297e0 2024-09-12T03:00:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.272+0000 7f8d56000640 10 client.26036 handle_command_reply: tid=0 2024-09-12T03:00:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.272+0000 7f8d7a5cd740 1 client.26036 shutdown 2024-09-12T03:00:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.273+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/193053519 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090e3b0 msgr2=0x5589309165e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.274+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/193053519 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090e3b0 0x5589309165e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8d64004510 tx=0x7f8d64009260 comp rx=0 tx=0).stop 2024-09-12T03:00:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.274+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/193053519 shutdown_connections 2024-09-12T03:00:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.274+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/193053519 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5589309297e0 0x55893092bc70 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.274+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/193053519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558930919570 0x558930917060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.274+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/193053519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090ecd0 0x558930916b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.274+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/193053519 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090e3b0 0x5589309165e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.274+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/193053519 >> 172.21.15.18:0/193053519 conn(0x55893090a920 msgr2=0x558930910680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.274+0000 7f8d56000640 0 client.26036 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:00:59.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.275+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/193053519 shutdown_connections 2024-09-12T03:00:59.277 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.276+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/193053519 wait complete. 2024-09-12T03:00:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.277+0000 7f8d7a5cd740 20 client.26036 trim_cache size 0 max 16384 2024-09-12T03:00:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.319+0000 7f8d7a5cd740 1 Processor -- start 2024-09-12T03:00:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.319+0000 7f8d7a5cd740 1 -- start start 2024-09-12T03:00:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.320+0000 7f8d7a5cd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090e3b0 0x55893090ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.320+0000 7f8d7a5cd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090ecd0 0x558930931550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.320+0000 7f8d7a5cd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558930919570 0x558930931a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.320+0000 7f8d7a5cd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8d701bdf40 con 0x558930919570 2024-09-12T03:00:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.320+0000 7f8d7a5cd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8d701bfcf0 con 0x55893090ecd0 2024-09-12T03:00:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.320+0000 7f8d7a5cd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8d701be6d0 con 0x55893090e3b0 2024-09-12T03:00:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.320+0000 7f8d75600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558930919570 0x558930931a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.320+0000 7f8d75600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558930919570 0x558930931a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34202/0 (socket says 172.21.15.18:34202) 2024-09-12T03:00:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.320+0000 7f8d75600640 1 -- 172.21.15.18:0/2848618894 learned_addr learned my addr 172.21.15.18:0/2848618894 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.321+0000 7f8d75600640 1 -- 172.21.15.18:0/2848618894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090e3b0 msgr2=0x55893090ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.321+0000 7f8d74c00640 1 --2- 172.21.15.18:0/2848618894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090e3b0 0x55893090ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.321+0000 7f8d75600640 1 --2- 172.21.15.18:0/2848618894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090e3b0 0x55893090ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.321+0000 7f8d75600640 1 -- 172.21.15.18:0/2848618894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090ecd0 msgr2=0x558930931550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.321+0000 7f8d6fe00640 1 --2- 172.21.15.18:0/2848618894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090ecd0 0x558930931550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.321+0000 7f8d75600640 1 --2- 172.21.15.18:0/2848618894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090ecd0 0x558930931550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.321+0000 7f8d75600640 1 -- 172.21.15.18:0/2848618894 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55893090bab0 con 0x558930919570 2024-09-12T03:00:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.321+0000 7f8d6fe00640 1 --2- 172.21.15.18:0/2848618894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090ecd0 0x558930931550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:00:59.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.322+0000 7f8d74c00640 1 --2- 172.21.15.18:0/2848618894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090e3b0 0x55893090ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:00:59.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.322+0000 7f8d75600640 1 --2- 172.21.15.18:0/2848618894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558930919570 0x558930931a90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800afc0 tx=0x7f8d68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b3f72991836e4d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.326+0000 7f8d61200640 1 -- 172.21.15.18:0/2848618894 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d68007780 con 0x558930919570 2024-09-12T03:00:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.326+0000 7f8d61200640 1 -- 172.21.15.18:0/2848618894 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d68019070 con 0x558930919570 2024-09-12T03:00:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.326+0000 7f8d61200640 1 -- 172.21.15.18:0/2848618894 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d68014dd0 con 0x558930919570 2024-09-12T03:00:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.327+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/2848618894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558930919570 msgr2=0x558930931a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.327+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/2848618894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558930919570 0x558930931a90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800afc0 tx=0x7f8d68009840 comp rx=0 tx=0).stop 2024-09-12T03:00:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.328+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/2848618894 shutdown_connections 2024-09-12T03:00:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.328+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/2848618894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558930919570 0x558930931a90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.328+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/2848618894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090ecd0 0x558930931550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.328+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/2848618894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090e3b0 0x55893090ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.328+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/2848618894 >> 172.21.15.18:0/2848618894 conn(0x55893090a920 msgr2=0x558930914e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.330+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/2848618894 shutdown_connections 2024-09-12T03:00:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.330+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/2848618894 wait complete. 2024-09-12T03:00:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.331+0000 7f8d7a5cd740 1 -- start start 2024-09-12T03:00:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.331+0000 7f8d7a5cd740 1 Processor -- start 2024-09-12T03:00:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.332+0000 7f8d7a5cd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090e3b0 0x5589309142a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.333+0000 7f8d7a5cd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090ecd0 0x558930921570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.333+0000 7f8d7a5cd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558930919570 0x558930921d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.333+0000 7f8d74c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090e3b0 0x5589309142a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.333+0000 7f8d7a5cd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8d701bf5f0 con 0x558930919570 2024-09-12T03:00:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.333+0000 7f8d7a5cd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8d701bee60 con 0x55893090ecd0 2024-09-12T03:00:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.333+0000 7f8d6fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090ecd0 0x558930921570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.333+0000 7f8d7a5cd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8d701bbf20 con 0x55893090e3b0 2024-09-12T03:00:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.333+0000 7f8d6fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090ecd0 0x558930921570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:60198/0 (socket says 172.21.15.18:60198) 2024-09-12T03:00:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.333+0000 7f8d6fe00640 1 -- 172.21.15.18:0/2409571257 learned_addr learned my addr 172.21.15.18:0/2409571257 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:00:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.334+0000 7f8d7a5cd740 10 client.0 _ll_register_callbacks cb 0x7f8d5c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:00:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.334+0000 7f8d75600640 1 --2- 172.21.15.18:0/2409571257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558930919570 0x558930921d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.335+0000 7f8d74c00640 1 -- 172.21.15.18:0/2409571257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090ecd0 msgr2=0x558930921570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.335+0000 7f8d74c00640 1 --2- 172.21.15.18:0/2409571257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090ecd0 0x558930921570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.335+0000 7f8d74c00640 1 -- 172.21.15.18:0/2409571257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558930919570 msgr2=0x558930921d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.335+0000 7f8d74c00640 1 --2- 172.21.15.18:0/2409571257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558930919570 0x558930921d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.335+0000 7f8d74c00640 1 -- 172.21.15.18:0/2409571257 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589309128b0 con 0x55893090e3b0 2024-09-12T03:00:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.335+0000 7f8d74c00640 1 --2- 172.21.15.18:0/2409571257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090e3b0 0x5589309142a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009230 tx=0x7f8d64009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a01a72e450729352 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.335+0000 7f8d56000640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T03:00:59.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.336+0000 7f8d56000640 1 -- 172.21.15.18:0/2409571257 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6404c040 con 0x55893090e3b0 2024-09-12T03:00:59.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.336+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/2409571257 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d68019070 con 0x55893090e3b0 2024-09-12T03:00:59.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.336+0000 7f8d56000640 1 -- 172.21.15.18:0/2409571257 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9622+0+0 (secure 0 0 0) 0x7f8d640035f0 con 0x55893090e3b0 2024-09-12T03:00:59.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.337+0000 7f8d56000640 1 -- 172.21.15.18:0/2409571257 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f8d6406b050 con 0x55893090e3b0 2024-09-12T03:00:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.337+0000 7f8d7a5cd740 10 client.26011 fetch_fsmap learned FSMap version 70 2024-09-12T03:00:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.337+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/2409571257 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x5589309937f0 con 0x55893090e3b0 2024-09-12T03:00:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.338+0000 7f8d56000640 1 -- 172.21.15.18:0/2409571257 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d68019070 con 0x55893090e3b0 2024-09-12T03:00:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.339+0000 7f8d56000640 1 -- 172.21.15.18:0/2409571257 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 70) ==== 8438+0+0 (secure 0 0 0) 0x7f8d64059070 con 0x55893090e3b0 2024-09-12T03:00:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.339+0000 7f8d7a5cd740 10 client.26011 fetch_fsmap finished waiting for FSMap version 70 2024-09-12T03:00:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.339+0000 7f8d7a5cd740 10 client.26011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:00:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.339+0000 7f8d7a5cd740 20 client.26011 populate_metadata read hostname 'smithi018' 2024-09-12T03:00:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.339+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/2409571257 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x558930993f10 0x558930996330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.339+0000 7f8d7a5cd740 4 client.26011 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T03:00:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.339+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/2409571257 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55893087bb80 con 0x558930993f10 2024-09-12T03:00:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.339+0000 7f8d6fe00640 1 --2- 172.21.15.18:0/2409571257 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x558930993f10 0x558930996330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.342+0000 7f8d56000640 10 client.26011 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:00:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.342+0000 7f8d6fe00640 1 --2- 172.21.15.18:0/2409571257 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x558930993f10 0x558930996330 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8555bcf76ab8958 server_cookie=dc6160a7089ed7d1 in_seq=0 out_seq=0 2024-09-12T03:00:59.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.445+0000 7f8d56000640 1 -- 172.21.15.18:0/2409571257 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55893087bb80 con 0x558930993f10 2024-09-12T03:00:59.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.445+0000 7f8d56000640 10 client.26011 handle_command_reply: tid=0 2024-09-12T03:00:59.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.445+0000 7f8d7a5cd740 1 client.26011 shutdown 2024-09-12T03:00:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.445+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/2409571257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090e3b0 msgr2=0x5589309142a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.445+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/2409571257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090e3b0 0x5589309142a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009230 tx=0x7f8d64009520 comp rx=0 tx=0).stop 2024-09-12T03:00:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.445+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/2409571257 shutdown_connections 2024-09-12T03:00:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.446+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/2409571257 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x558930993f10 0x558930996330 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.446+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/2409571257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558930919570 0x558930921d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.446+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/2409571257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55893090ecd0 0x558930921570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.446+0000 7f8d7a5cd740 1 --2- 172.21.15.18:0/2409571257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55893090e3b0 0x5589309142a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.446+0000 7f8d56000640 0 client.26011 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:00:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.446+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/2409571257 >> 172.21.15.18:0/2409571257 conn(0x55893090a920 msgr2=0x5589309165a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.446+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/2409571257 shutdown_connections 2024-09-12T03:00:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.446+0000 7f8d7a5cd740 1 -- 172.21.15.18:0/2409571257 wait complete. 2024-09-12T03:00:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.446+0000 7f8d7a5cd740 20 client.26011 trim_cache size 0 max 16384 2024-09-12T03:00:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T03:00:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T03:00:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T03:00:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T03:00:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.448+0000 7f8d76000640 1 -- 172.21.15.18:0/3749526319 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f8d580a2dc0 msgr2=0x7f8d580a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.448+0000 7f8d76000640 1 --2- 172.21.15.18:0/3749526319 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f8d580a2dc0 0x7f8d580a5280 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55893090b780 tx=0x7f8d64005fd0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.448+0000 7f8d76000640 1 -- 172.21.15.18:0/3749526319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d70103400 msgr2=0x7f8d7019f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.448+0000 7f8d76000640 1 --2- 172.21.15.18:0/3749526319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d70103400 0x7f8d7019f520 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00ea60 tx=0x7f8d5c00ef20 comp rx=0 tx=0).stop 2024-09-12T03:00:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.453+0000 7f8d76000640 1 -- 172.21.15.18:0/3749526319 shutdown_connections 2024-09-12T03:00:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.453+0000 7f8d76000640 1 --2- 172.21.15.18:0/3749526319 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f8d580a2dc0 0x7f8d580a5280 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.453+0000 7f8d76000640 1 --2- 172.21.15.18:0/3749526319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d7010bf00 0x7f8d7010ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.453+0000 7f8d76000640 1 --2- 172.21.15.18:0/3749526319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d70103400 0x7f8d7019f520 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.453+0000 7f8d76000640 1 --2- 172.21.15.18:0/3749526319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d70102ae0 0x7f8d7019efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.453+0000 7f8d76000640 1 -- 172.21.15.18:0/3749526319 >> 172.21.15.18:0/3749526319 conn(0x7f8d700777c0 msgr2=0x7f8d70100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.454+0000 7f8d76000640 1 -- 172.21.15.18:0/3749526319 shutdown_connections 2024-09-12T03:00:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:00:59.454+0000 7f8d76000640 1 -- 172.21.15.18:0/3749526319 wait complete. 2024-09-12T03:01:00.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:00 smithi062 ceph-mon[35527]: pgmap v382: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 213 op/s 2024-09-12T03:01:00.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:00 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T03:01:00.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:00 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T03:01:00.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:00 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T03:01:00.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:00 smithi018 ceph-mon[30616]: pgmap v382: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 213 op/s 2024-09-12T03:01:00.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:00 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T03:01:00.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:00 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T03:01:00.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:00 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T03:01:00.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:00 smithi176 ceph-mon[35713]: pgmap v382: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 213 op/s 2024-09-12T03:01:00.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:00 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T03:01:00.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:00 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T03:01:00.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:00 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T03:01:02.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:02 smithi176 ceph-mon[35713]: pgmap v383: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 258 op/s 2024-09-12T03:01:02.755 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:02 smithi018 ceph-mon[30616]: pgmap v383: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 258 op/s 2024-09-12T03:01:02.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:02 smithi062 ceph-mon[35527]: pgmap v383: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 258 op/s 2024-09-12T03:01:04.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:04 smithi062 ceph-mon[35527]: pgmap v384: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 173 op/s 2024-09-12T03:01:04.853 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:04 smithi018 ceph-mon[30616]: pgmap v384: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 173 op/s 2024-09-12T03:01:04.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:04 smithi176 ceph-mon[35713]: pgmap v384: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 173 op/s 2024-09-12T03:01:06.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:06 smithi062 ceph-mon[35527]: pgmap v385: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 254 op/s 2024-09-12T03:01:06.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:06 smithi018 ceph-mon[30616]: pgmap v385: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 254 op/s 2024-09-12T03:01:06.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:06 smithi176 ceph-mon[35713]: pgmap v385: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 254 op/s 2024-09-12T03:01:08.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:08 smithi062 ceph-mon[35527]: pgmap v386: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 214 op/s 2024-09-12T03:01:08.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:08 smithi062 ceph-mon[35527]: osdmap e111: 12 total, 12 up, 12 in 2024-09-12T03:01:08.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:08 smithi018 ceph-mon[30616]: pgmap v386: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 214 op/s 2024-09-12T03:01:08.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:08 smithi018 ceph-mon[30616]: osdmap e111: 12 total, 12 up, 12 in 2024-09-12T03:01:08.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:08 smithi176 ceph-mon[35713]: pgmap v386: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 214 op/s 2024-09-12T03:01:08.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:08 smithi176 ceph-mon[35713]: osdmap e111: 12 total, 12 up, 12 in 2024-09-12T03:01:10.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:10 smithi062 ceph-mon[35527]: pgmap v388: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 220 op/s 2024-09-12T03:01:10.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:10 smithi018 ceph-mon[30616]: pgmap v388: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 220 op/s 2024-09-12T03:01:10.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:10 smithi176 ceph-mon[35713]: pgmap v388: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 220 op/s 2024-09-12T03:01:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.710+0000 7efc18e00640 1 -- 172.21.15.18:0/1030204175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc14105ea0 msgr2=0x7efc14106310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.710+0000 7efc18e00640 1 --2- 172.21.15.18:0/1030204175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc14105ea0 0x7efc14106310 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009be0 tx=0x7efc0c02a750 comp rx=0 tx=0).stop 2024-09-12T03:01:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.711+0000 7efc18e00640 1 -- 172.21.15.18:0/1030204175 shutdown_connections 2024-09-12T03:01:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.711+0000 7efc18e00640 1 --2- 172.21.15.18:0/1030204175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc14105ea0 0x7efc14106310 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.711+0000 7efc18e00640 1 --2- 172.21.15.18:0/1030204175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc14101390 0x7efc14105850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.711+0000 7efc18e00640 1 --2- 172.21.15.18:0/1030204175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc14100a70 0x7efc14100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.711+0000 7efc18e00640 1 -- 172.21.15.18:0/1030204175 >> 172.21.15.18:0/1030204175 conn(0x7efc14077990 msgr2=0x7efc140fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:12.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.713+0000 7efc18e00640 1 -- 172.21.15.18:0/1030204175 shutdown_connections 2024-09-12T03:01:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.715+0000 7efc18e00640 1 -- 172.21.15.18:0/1030204175 wait complete. 2024-09-12T03:01:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.717+0000 7efc18e00640 1 Processor -- start 2024-09-12T03:01:12.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.718+0000 7efc18e00640 1 -- start start 2024-09-12T03:01:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.719+0000 7efc18e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc14100a70 0x7efc141a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.719+0000 7efc18e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc14101390 0x7efc141a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.719+0000 7efc18e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc14105ea0 0x7efc1419e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.719+0000 7efc18e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc14118490 con 0x7efc14101390 2024-09-12T03:01:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.719+0000 7efc18e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efc14118310 con 0x7efc14100a70 2024-09-12T03:01:12.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.719+0000 7efc18e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efc14118610 con 0x7efc14105ea0 2024-09-12T03:01:12.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.719+0000 7efc11e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc14100a70 0x7efc141a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:12.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.719+0000 7efc11e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc14100a70 0x7efc141a4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:55272/0 (socket says 172.21.15.18:55272) 2024-09-12T03:01:12.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.719+0000 7efc11e00640 1 -- 172.21.15.18:0/1615907765 learned_addr learned my addr 172.21.15.18:0/1615907765 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:12.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.719+0000 7efc11400640 1 --2- 172.21.15.18:0/1615907765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc14101390 0x7efc141a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.720+0000 7efc11e00640 1 -- 172.21.15.18:0/1615907765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc14105ea0 msgr2=0x7efc1419e800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T03:01:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.720+0000 7efc11e00640 1 --2- 172.21.15.18:0/1615907765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc14105ea0 0x7efc1419e800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.720+0000 7efc11e00640 1 -- 172.21.15.18:0/1615907765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc14101390 msgr2=0x7efc141a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.720+0000 7efc11e00640 1 --2- 172.21.15.18:0/1615907765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc14101390 0x7efc141a4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.720+0000 7efc11e00640 1 -- 172.21.15.18:0/1615907765 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1419efd0 con 0x7efc14100a70 2024-09-12T03:01:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.721+0000 7efc11e00640 1 --2- 172.21.15.18:0/1615907765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc14100a70 0x7efc141a4690 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efc0400d950 tx=0x7efc0400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.722+0000 7efc0aa00640 1 -- 172.21.15.18:0/1615907765 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc04017070 con 0x7efc14100a70 2024-09-12T03:01:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.722+0000 7efc18e00640 1 -- 172.21.15.18:0/1615907765 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc1419f2c0 con 0x7efc14100a70 2024-09-12T03:01:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.722+0000 7efc0aa00640 1 -- 172.21.15.18:0/1615907765 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc04009c30 con 0x7efc14100a70 2024-09-12T03:01:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.722+0000 7efc0aa00640 1 -- 172.21.15.18:0/1615907765 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0400f620 con 0x7efc14100a70 2024-09-12T03:01:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.722+0000 7efc18e00640 1 -- 172.21.15.18:0/1615907765 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc141ab4e0 con 0x7efc14100a70 2024-09-12T03:01:12.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.730+0000 7efc0aa00640 1 -- 172.21.15.18:0/1615907765 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7efc04010460 con 0x7efc14100a70 2024-09-12T03:01:12.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.731+0000 7efc1bcaf740 1 Processor -- start 2024-09-12T03:01:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.733+0000 7efc0aa00640 1 --2- 172.21.15.18:0/1615907765 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efbf80a2df0 0x7efbf80a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.733+0000 7efc0aa00640 1 -- 172.21.15.18:0/1615907765 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9714+0+0 (secure 0 0 0) 0x7efc040cf5a0 con 0x7efc14100a70 2024-09-12T03:01:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.734+0000 7efc1bcaf740 1 -- start start 2024-09-12T03:01:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.734+0000 7efc1bcaf740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1871e0 0x56147a1875c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.734+0000 7efc1bcaf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a187b00 0x56147a191e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.734+0000 7efc1bcaf740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1923a0 0x56147a194790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.734+0000 7efc1bcaf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56147a0ed100 con 0x56147a187b00 2024-09-12T03:01:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.734+0000 7efc1bcaf740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56147a0951b0 con 0x56147a1923a0 2024-09-12T03:01:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.734+0000 7efc1bcaf740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56147a0e90c0 con 0x56147a1871e0 2024-09-12T03:01:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.734+0000 7efc12800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1923a0 0x56147a194790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.735+0000 7efc12800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1923a0 0x56147a194790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:55284/0 (socket says 172.21.15.18:55284) 2024-09-12T03:01:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.735+0000 7efc12800640 1 -- 172.21.15.18:0/527207230 learned_addr learned my addr 172.21.15.18:0/527207230 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.735+0000 7efc11400640 1 --2- 172.21.15.18:0/527207230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a187b00 0x56147a191e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.735+0000 7efc12800640 1 --2- 172.21.15.18:0/1615907765 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efbf80a2df0 0x7efbf80a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.735+0000 7efc11e00640 1 --2- 172.21.15.18:0/527207230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1871e0 0x56147a1875c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.735+0000 7efc11400640 1 -- 172.21.15.18:0/527207230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1871e0 msgr2=0x56147a1875c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.735+0000 7efc11400640 1 --2- 172.21.15.18:0/527207230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1871e0 0x56147a1875c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.735+0000 7efc11400640 1 -- 172.21.15.18:0/527207230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1923a0 msgr2=0x56147a194790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.735+0000 7efc11400640 1 --2- 172.21.15.18:0/527207230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1923a0 0x56147a194790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.735+0000 7efc11400640 1 -- 172.21.15.18:0/527207230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561479e00210 con 0x56147a187b00 2024-09-12T03:01:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.736+0000 7efc11e00640 1 --2- 172.21.15.18:0/527207230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1871e0 0x56147a1875c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:01:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.736+0000 7efc11400640 1 --2- 172.21.15.18:0/527207230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a187b00 0x56147a191e60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efc1419fb50 tx=0x7efc000103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f956e43589f2e88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:12.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.737+0000 7efc12800640 1 --2- 172.21.15.18:0/1615907765 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efbf80a2df0 0x7efbf80a52b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x56147a184ad0 tx=0x7efc0c005fd0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:12.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.737+0000 7efbff400640 1 -- 172.21.15.18:0/527207230 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc00004030 con 0x56147a187b00 2024-09-12T03:01:12.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.737+0000 7efbff400640 1 -- 172.21.15.18:0/527207230 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc000041d0 con 0x56147a187b00 2024-09-12T03:01:12.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.737+0000 7efbff400640 1 -- 172.21.15.18:0/527207230 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc00011680 con 0x56147a187b00 2024-09-12T03:01:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.738+0000 7efc1bcaf740 1 -- 172.21.15.18:0/527207230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a187b00 msgr2=0x56147a191e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.738+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/527207230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a187b00 0x56147a191e60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efc1419fb50 tx=0x7efc000103d0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.739+0000 7efc1bcaf740 1 -- 172.21.15.18:0/527207230 shutdown_connections 2024-09-12T03:01:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.739+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/527207230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1923a0 0x56147a194790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.739+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/527207230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a187b00 0x56147a191e60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.739+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/527207230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1871e0 0x56147a1875c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.739+0000 7efc1bcaf740 1 -- 172.21.15.18:0/527207230 >> 172.21.15.18:0/527207230 conn(0x56147a183750 msgr2=0x56147a183b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:12.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.739+0000 7efc1bcaf740 1 -- 172.21.15.18:0/527207230 shutdown_connections 2024-09-12T03:01:12.741 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.740+0000 7efc1bcaf740 1 -- 172.21.15.18:0/527207230 wait complete. 2024-09-12T03:01:12.744 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.740+0000 7efc1bcaf740 1 -- start start 2024-09-12T03:01:12.744 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.740+0000 7efc1bcaf740 1 Processor -- start 2024-09-12T03:01:12.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.744+0000 7efc1bcaf740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1871e0 0x56147a18f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.744+0000 7efc1bcaf740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a187b00 0x56147a18f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.744+0000 7efc1bcaf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a1923a0 0x56147a18fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.744+0000 7efc1bcaf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56147a194f70 con 0x56147a1923a0 2024-09-12T03:01:12.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.744+0000 7efc1bcaf740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56147a076090 con 0x56147a1871e0 2024-09-12T03:01:12.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.744+0000 7efc1bcaf740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56147a1950f0 con 0x56147a187b00 2024-09-12T03:01:12.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.744+0000 7efc1bcaf740 10 client.0 _ll_register_callbacks cb 0x56147a0caf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:01:12.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.744+0000 7efc11e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1871e0 0x56147a18f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:12.746 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.744+0000 7efc11e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1871e0 0x56147a18f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:55300/0 (socket says 172.21.15.18:55300) 2024-09-12T03:01:12.747 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.744+0000 7efc11e00640 1 -- 172.21.15.18:0/2736363782 learned_addr learned my addr 172.21.15.18:0/2736363782 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:12.747 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.745+0000 7efc11400640 1 --2- 172.21.15.18:0/2736363782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a187b00 0x56147a18f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:12.747 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.745+0000 7efc12800640 1 --2- 172.21.15.18:0/2736363782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a1923a0 0x56147a18fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:12.747 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.745+0000 7efc11e00640 1 -- 172.21.15.18:0/2736363782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a187b00 msgr2=0x56147a18f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:12.747 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.745+0000 7efc11e00640 1 --2- 172.21.15.18:0/2736363782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a187b00 0x56147a18f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.747 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.745+0000 7efc11e00640 1 -- 172.21.15.18:0/2736363782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a1923a0 msgr2=0x56147a18fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:12.747 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.745+0000 7efc11e00640 1 --2- 172.21.15.18:0/2736363782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a1923a0 0x56147a18fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.747 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.745+0000 7efc11e00640 1 -- 172.21.15.18:0/2736363782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561479ecc620 con 0x56147a1871e0 2024-09-12T03:01:12.747 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.745+0000 7efc11400640 1 --2- 172.21.15.18:0/2736363782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a187b00 0x56147a18f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:01:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.746+0000 7efc12800640 1 --2- 172.21.15.18:0/2736363782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a1923a0 0x56147a18fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:01:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.746+0000 7efc11e00640 1 --2- 172.21.15.18:0/2736363782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1871e0 0x56147a18f360 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efc0409b5a0 tx=0x7efc04009f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a4f32b5a1d92dd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.746+0000 7efbf3e00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T03:01:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.746+0000 7efbf3e00640 1 -- 172.21.15.18:0/2736363782 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc04020040 con 0x56147a1871e0 2024-09-12T03:01:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.746+0000 7efbf3e00640 1 -- 172.21.15.18:0/2736363782 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9714+0+0 (secure 0 0 0) 0x7efc040cf170 con 0x56147a1871e0 2024-09-12T03:01:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.747+0000 7efc1bcaf740 1 -- 172.21.15.18:0/2736363782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc000041d0 con 0x56147a1871e0 2024-09-12T03:01:12.749 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.748+0000 7efbf3e00640 1 -- 172.21.15.18:0/2736363782 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7efc0409f9c0 con 0x56147a1871e0 2024-09-12T03:01:12.749 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.748+0000 7efc1bcaf740 10 client.26051 fetch_fsmap learned FSMap version 70 2024-09-12T03:01:12.749 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.748+0000 7efc1bcaf740 1 -- 172.21.15.18:0/2736363782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x56147a1a0bb0 con 0x56147a1871e0 2024-09-12T03:01:12.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.748+0000 7efbf3e00640 1 -- 172.21.15.18:0/2736363782 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc040b4070 con 0x56147a1871e0 2024-09-12T03:01:12.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.749+0000 7efbf3e00640 1 -- 172.21.15.18:0/2736363782 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 70) ==== 8438+0+0 (secure 0 0 0) 0x7efc04084b50 con 0x56147a1871e0 2024-09-12T03:01:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.750+0000 7efc1bcaf740 10 client.26051 fetch_fsmap finished waiting for FSMap version 70 2024-09-12T03:01:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.750+0000 7efc1bcaf740 10 client.26051 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:01:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.750+0000 7efc1bcaf740 20 client.26051 populate_metadata read hostname 'smithi018' 2024-09-12T03:01:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.750+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/2736363782 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56147a1a2070 0x56147a1a4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.750+0000 7efc1bcaf740 4 client.26051 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:01:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.750+0000 7efc1bcaf740 1 -- 172.21.15.18:0/2736363782 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56147a0fa830 con 0x56147a1a2070 2024-09-12T03:01:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.750+0000 7efc11400640 1 --2- 172.21.15.18:0/2736363782 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56147a1a2070 0x56147a1a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:12.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.751+0000 7efc11400640 1 --2- 172.21.15.18:0/2736363782 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56147a1a2070 0x56147a1a4460 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab18b397190f7be server_cookie=ebe35fe709d0b1df in_seq=0 out_seq=0 2024-09-12T03:01:12.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.751+0000 7efbf3e00640 10 client.26051 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:01:12.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.752+0000 7efbf3e00640 1 -- 172.21.15.18:0/2736363782 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56147a0fa830 con 0x56147a1a2070 2024-09-12T03:01:12.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.753+0000 7efbf3e00640 10 client.26051 handle_command_reply: tid=0 2024-09-12T03:01:12.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.753+0000 7efc1bcaf740 1 client.26051 shutdown 2024-09-12T03:01:12.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.755+0000 7efc1bcaf740 1 -- 172.21.15.18:0/2736363782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1871e0 msgr2=0x56147a18f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:12.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.755+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/2736363782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1871e0 0x56147a18f360 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efc0409b5a0 tx=0x7efc04009f20 comp rx=0 tx=0).stop 2024-09-12T03:01:12.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.756+0000 7efc1bcaf740 1 -- 172.21.15.18:0/2736363782 shutdown_connections 2024-09-12T03:01:12.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.756+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/2736363782 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56147a1a2070 0x56147a1a4460 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.756+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/2736363782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a1923a0 0x56147a18fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.756+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/2736363782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a187b00 0x56147a18f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.756+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/2736363782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1871e0 0x56147a18f360 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.756+0000 7efbf3e00640 0 client.26051 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:01:12.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.756+0000 7efc1bcaf740 1 -- 172.21.15.18:0/2736363782 >> 172.21.15.18:0/2736363782 conn(0x56147a183750 msgr2=0x56147a189460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:12.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.756+0000 7efc1bcaf740 1 -- 172.21.15.18:0/2736363782 shutdown_connections 2024-09-12T03:01:12.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.756+0000 7efc1bcaf740 1 -- 172.21.15.18:0/2736363782 wait complete. 2024-09-12T03:01:12.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.757+0000 7efc1bcaf740 20 client.26051 trim_cache size 0 max 16384 2024-09-12T03:01:12.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:12 smithi062 ceph-mon[35527]: pgmap v389: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 196 op/s 2024-09-12T03:01:12.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.788+0000 7efc1bcaf740 1 Processor -- start 2024-09-12T03:01:12.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.789+0000 7efc1bcaf740 1 -- start start 2024-09-12T03:01:12.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.789+0000 7efc1bcaf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a1871e0 0x56147a18fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.789+0000 7efc1bcaf740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a187b00 0x56147a1a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.789+0000 7efc1bcaf740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1923a0 0x56147a1aa210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.789+0000 7efc1bcaf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc141b5990 con 0x56147a1871e0 2024-09-12T03:01:12.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.789+0000 7efc1bcaf740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efc141b7740 con 0x56147a187b00 2024-09-12T03:01:12.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.789+0000 7efc1bcaf740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efc141b6120 con 0x56147a1923a0 2024-09-12T03:01:12.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.790+0000 7efc12800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1923a0 0x56147a1aa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:12.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.790+0000 7efc12800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1923a0 0x56147a1aa210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:54886/0 (socket says 172.21.15.18:54886) 2024-09-12T03:01:12.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.790+0000 7efc12800640 1 -- 172.21.15.18:0/1828995521 learned_addr learned my addr 172.21.15.18:0/1828995521 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:12.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.790+0000 7efc11400640 1 --2- 172.21.15.18:0/1828995521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a187b00 0x56147a1a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:12.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.790+0000 7efc11e00640 1 --2- 172.21.15.18:0/1828995521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a1871e0 0x56147a18fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:12.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.791+0000 7efc11400640 1 -- 172.21.15.18:0/1828995521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1923a0 msgr2=0x56147a1aa210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:12.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.791+0000 7efc11400640 1 --2- 172.21.15.18:0/1828995521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1923a0 0x56147a1aa210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.791+0000 7efc11400640 1 -- 172.21.15.18:0/1828995521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a1871e0 msgr2=0x56147a18fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:12.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.791+0000 7efc11400640 1 --2- 172.21.15.18:0/1828995521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a1871e0 0x56147a18fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.791+0000 7efc11400640 1 -- 172.21.15.18:0/1828995521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56147a17ed60 con 0x56147a187b00 2024-09-12T03:01:12.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.791+0000 7efc12800640 1 --2- 172.21.15.18:0/1828995521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1923a0 0x56147a1aa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:01:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.791+0000 7efc11400640 1 --2- 172.21.15.18:0/1828995521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a187b00 0x56147a1a9cd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efc00003dc0 tx=0x7efc000103d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8f7925707769340 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.791+0000 7efbfea00640 1 -- 172.21.15.18:0/1828995521 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0002e070 con 0x56147a187b00 2024-09-12T03:01:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.792+0000 7efbfea00640 1 -- 172.21.15.18:0/1828995521 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc00005520 con 0x56147a187b00 2024-09-12T03:01:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.792+0000 7efbfea00640 1 -- 172.21.15.18:0/1828995521 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc00028700 con 0x56147a187b00 2024-09-12T03:01:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.793+0000 7efc1bcaf740 1 -- 172.21.15.18:0/1828995521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a187b00 msgr2=0x56147a1a9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.793+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/1828995521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a187b00 0x56147a1a9cd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efc00003dc0 tx=0x7efc000103d0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.793+0000 7efc1bcaf740 1 -- 172.21.15.18:0/1828995521 shutdown_connections 2024-09-12T03:01:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.793+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/1828995521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1923a0 0x56147a1aa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.793+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/1828995521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a187b00 0x56147a1a9cd0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.793+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/1828995521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a1871e0 0x56147a18fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.793+0000 7efc1bcaf740 1 -- 172.21.15.18:0/1828995521 >> 172.21.15.18:0/1828995521 conn(0x56147a183750 msgr2=0x56147a1912d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.794+0000 7efc1bcaf740 1 -- 172.21.15.18:0/1828995521 shutdown_connections 2024-09-12T03:01:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.794+0000 7efc1bcaf740 1 -- 172.21.15.18:0/1828995521 wait complete. 2024-09-12T03:01:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.794+0000 7efc1bcaf740 1 -- start start 2024-09-12T03:01:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.795+0000 7efc1bcaf740 1 Processor -- start 2024-09-12T03:01:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.795+0000 7efc1bcaf740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1871e0 0x56147a208670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.795+0000 7efc1bcaf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a187b00 0x56147a19a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.795+0000 7efc1bcaf740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1923a0 0x56147a19a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.796+0000 7efc11400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a187b00 0x56147a19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.796+0000 7efc1bcaf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc141b7040 con 0x56147a187b00 2024-09-12T03:01:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.796+0000 7efc1bcaf740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efc141b68b0 con 0x56147a1871e0 2024-09-12T03:01:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.796+0000 7efc1bcaf740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efc141b3990 con 0x56147a1923a0 2024-09-12T03:01:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.796+0000 7efc11e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1871e0 0x56147a208670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.796+0000 7efc1bcaf740 10 client.0 _ll_register_callbacks cb 0x7efc040971f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:01:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.796+0000 7efc11e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1871e0 0x56147a208670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:55316/0 (socket says 172.21.15.18:55316) 2024-09-12T03:01:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.796+0000 7efc11e00640 1 -- 172.21.15.18:0/1442382516 learned_addr learned my addr 172.21.15.18:0/1442382516 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.796+0000 7efc12800640 1 --2- 172.21.15.18:0/1442382516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1923a0 0x56147a19a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.797+0000 7efc12800640 1 -- 172.21.15.18:0/1442382516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1871e0 msgr2=0x56147a208670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.797+0000 7efc12800640 1 --2- 172.21.15.18:0/1442382516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1871e0 0x56147a208670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.797+0000 7efc12800640 1 -- 172.21.15.18:0/1442382516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a187b00 msgr2=0x56147a19a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.797+0000 7efc12800640 1 --2- 172.21.15.18:0/1442382516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a187b00 0x56147a19a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.797+0000 7efc12800640 1 -- 172.21.15.18:0/1442382516 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56147a1843e0 con 0x56147a1923a0 2024-09-12T03:01:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.798+0000 7efc12800640 1 --2- 172.21.15.18:0/1442382516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1923a0 0x56147a19a8c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0099a0 tx=0x7efc0c009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9331b7817d48b276 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.798+0000 7efbf3e00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T03:01:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.799+0000 7efbf3e00640 1 -- 172.21.15.18:0/1442382516 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c04f070 con 0x56147a1923a0 2024-09-12T03:01:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.800+0000 7efbf3e00640 1 -- 172.21.15.18:0/1442382516 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9714+0+0 (secure 0 0 0) 0x7efc0c004450 con 0x56147a1923a0 2024-09-12T03:01:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.800+0000 7efc1bcaf740 1 -- 172.21.15.18:0/1442382516 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc00005520 con 0x56147a1923a0 2024-09-12T03:01:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.800+0000 7efbf3e00640 1 -- 172.21.15.18:0/1442382516 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7efc0c059050 con 0x56147a1923a0 2024-09-12T03:01:12.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.801+0000 7efc1bcaf740 10 client.26023 fetch_fsmap learned FSMap version 70 2024-09-12T03:01:12.802 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.801+0000 7efc1bcaf740 1 -- 172.21.15.18:0/1442382516 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x56147a21dd70 con 0x56147a1923a0 2024-09-12T03:01:12.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.802+0000 7efbf3e00640 1 -- 172.21.15.18:0/1442382516 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc00005520 con 0x56147a1923a0 2024-09-12T03:01:12.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.802+0000 7efbf3e00640 1 -- 172.21.15.18:0/1442382516 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 70) ==== 8438+0+0 (secure 0 0 0) 0x7efc0c054bc0 con 0x56147a1923a0 2024-09-12T03:01:12.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.802+0000 7efc1bcaf740 10 client.26023 fetch_fsmap finished waiting for FSMap version 70 2024-09-12T03:01:12.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.802+0000 7efc1bcaf740 10 client.26023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:01:12.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.802+0000 7efc1bcaf740 20 client.26023 populate_metadata read hostname 'smithi018' 2024-09-12T03:01:12.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.802+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/1442382516 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56147a21e4c0 0x56147a2208e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:12.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.802+0000 7efc1bcaf740 4 client.26023 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T03:01:12.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.802+0000 7efc1bcaf740 1 -- 172.21.15.18:0/1442382516 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56147a0f4b80 con 0x56147a21e4c0 2024-09-12T03:01:12.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.804+0000 7efc11e00640 1 --2- 172.21.15.18:0/1442382516 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56147a21e4c0 0x56147a2208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:12.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.806+0000 7efc11e00640 1 --2- 172.21.15.18:0/1442382516 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56147a21e4c0 0x56147a2208e0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf43995b01074a65 server_cookie=ec7bbb00ac79145a in_seq=0 out_seq=0 2024-09-12T03:01:12.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.806+0000 7efbf3e00640 10 client.26023 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:01:12.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:12 smithi018 ceph-mon[30616]: pgmap v389: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 196 op/s 2024-09-12T03:01:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.974+0000 7efbf3e00640 1 -- 172.21.15.18:0/1442382516 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56147a0f4b80 con 0x56147a21e4c0 2024-09-12T03:01:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.975+0000 7efbf3e00640 10 client.26023 handle_command_reply: tid=0 2024-09-12T03:01:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.975+0000 7efc1bcaf740 1 client.26023 shutdown 2024-09-12T03:01:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.975+0000 7efc1bcaf740 1 -- 172.21.15.18:0/1442382516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1923a0 msgr2=0x56147a19a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:12.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.975+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/1442382516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1923a0 0x56147a19a8c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0099a0 tx=0x7efc0c009500 comp rx=0 tx=0).stop 2024-09-12T03:01:12.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.975+0000 7efc1bcaf740 1 -- 172.21.15.18:0/1442382516 shutdown_connections 2024-09-12T03:01:12.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.975+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/1442382516 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x56147a21e4c0 0x56147a2208e0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.975+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/1442382516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56147a1923a0 0x56147a19a8c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.975+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/1442382516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56147a187b00 0x56147a19a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.975+0000 7efbf3e00640 0 client.26023 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:01:12.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.975+0000 7efc1bcaf740 1 --2- 172.21.15.18:0/1442382516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56147a1871e0 0x56147a208670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.975+0000 7efc1bcaf740 1 -- 172.21.15.18:0/1442382516 >> 172.21.15.18:0/1442382516 conn(0x56147a183750 msgr2=0x56147a1909a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:12.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.976+0000 7efc1bcaf740 1 -- 172.21.15.18:0/1442382516 shutdown_connections 2024-09-12T03:01:12.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.976+0000 7efc1bcaf740 1 -- 172.21.15.18:0/1442382516 wait complete. 2024-09-12T03:01:12.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:12 smithi176 ceph-mon[35713]: pgmap v389: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 196 op/s 2024-09-12T03:01:12.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.976+0000 7efc1bcaf740 20 client.26023 trim_cache size 0 max 16384 2024-09-12T03:01:12.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T03:01:12.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T03:01:12.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T03:01:12.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T03:01:12.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.979+0000 7efc18e00640 1 -- 172.21.15.18:0/1615907765 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efbf80a2df0 msgr2=0x7efbf80a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.979+0000 7efc18e00640 1 --2- 172.21.15.18:0/1615907765 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efbf80a2df0 0x7efbf80a52b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x56147a184ad0 tx=0x7efc0c005fd0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.979+0000 7efc18e00640 1 -- 172.21.15.18:0/1615907765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc14100a70 msgr2=0x7efc141a4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.979+0000 7efc18e00640 1 --2- 172.21.15.18:0/1615907765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc14100a70 0x7efc141a4690 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efc0400d950 tx=0x7efc0400de10 comp rx=0 tx=0).stop 2024-09-12T03:01:12.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.987+0000 7efc18e00640 1 -- 172.21.15.18:0/1615907765 shutdown_connections 2024-09-12T03:01:12.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.987+0000 7efc18e00640 1 --2- 172.21.15.18:0/1615907765 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7efbf80a2df0 0x7efbf80a52b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.987+0000 7efc18e00640 1 --2- 172.21.15.18:0/1615907765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc14105ea0 0x7efc1419e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.987+0000 7efc18e00640 1 --2- 172.21.15.18:0/1615907765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc14101390 0x7efc141a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.987+0000 7efc18e00640 1 --2- 172.21.15.18:0/1615907765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc14100a70 0x7efc141a4690 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:12.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.987+0000 7efc18e00640 1 -- 172.21.15.18:0/1615907765 >> 172.21.15.18:0/1615907765 conn(0x7efc14077990 msgr2=0x7efc14103800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:12.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.988+0000 7efc18e00640 1 -- 172.21.15.18:0/1615907765 shutdown_connections 2024-09-12T03:01:12.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:12.988+0000 7efc18e00640 1 -- 172.21.15.18:0/1615907765 wait complete. 2024-09-12T03:01:14.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:14 smithi062 ceph-mon[35527]: pgmap v390: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 196 op/s 2024-09-12T03:01:14.849 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:14 smithi018 ceph-mon[30616]: pgmap v390: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 196 op/s 2024-09-12T03:01:14.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:14 smithi176 ceph-mon[35713]: pgmap v390: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 196 op/s 2024-09-12T03:01:16.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:16 smithi062 ceph-mon[35527]: pgmap v391: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 156 op/s 2024-09-12T03:01:16.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:16 smithi062 ceph-mon[35527]: osdmap e112: 12 total, 12 up, 12 in 2024-09-12T03:01:16.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:16 smithi018 ceph-mon[30616]: pgmap v391: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 156 op/s 2024-09-12T03:01:16.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:16 smithi018 ceph-mon[30616]: osdmap e112: 12 total, 12 up, 12 in 2024-09-12T03:01:16.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:16 smithi176 ceph-mon[35713]: pgmap v391: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 156 op/s 2024-09-12T03:01:16.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:16 smithi176 ceph-mon[35713]: osdmap e112: 12 total, 12 up, 12 in 2024-09-12T03:01:18.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:18 smithi018 ceph-mon[30616]: pgmap v393: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 152 op/s 2024-09-12T03:01:18.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:18 smithi176 ceph-mon[35713]: pgmap v393: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 152 op/s 2024-09-12T03:01:19.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:18 smithi062 ceph-mon[35527]: pgmap v393: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 152 op/s 2024-09-12T03:01:20.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:20 smithi018 ceph-mon[30616]: pgmap v394: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 156 op/s 2024-09-12T03:01:20.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:20 smithi176 ceph-mon[35713]: pgmap v394: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 156 op/s 2024-09-12T03:01:21.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:20 smithi062 ceph-mon[35527]: pgmap v394: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 156 op/s 2024-09-12T03:01:22.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:22 smithi018 ceph-mon[30616]: pgmap v395: 129 pgs: 70 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 36 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 170 op/s 2024-09-12T03:01:22.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:22 smithi176 ceph-mon[35713]: pgmap v395: 129 pgs: 70 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 36 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 170 op/s 2024-09-12T03:01:23.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:22 smithi062 ceph-mon[35527]: pgmap v395: 129 pgs: 70 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 36 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 170 op/s 2024-09-12T03:01:23.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:23 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:01:23.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:23 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:01:24.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:23 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:01:25.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:24 smithi018 ceph-mon[30616]: pgmap v396: 129 pgs: 70 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 36 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 170 op/s 2024-09-12T03:01:25.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:24 smithi176 ceph-mon[35713]: pgmap v396: 129 pgs: 70 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 36 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 170 op/s 2024-09-12T03:01:25.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:24 smithi062 ceph-mon[35527]: pgmap v396: 129 pgs: 70 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 36 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 170 op/s 2024-09-12T03:01:26.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.203+0000 7f1cb2400640 1 -- 172.21.15.18:0/3420152197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac1078c0 msgr2=0x7f1cac107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:26.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.203+0000 7f1cb2400640 1 --2- 172.21.15.18:0/3420152197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac1078c0 0x7f1cac107ca0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009930 tx=0x7f1ca002a440 comp rx=0 tx=0).stop 2024-09-12T03:01:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.209+0000 7f1cb2400640 1 -- 172.21.15.18:0/3420152197 shutdown_connections 2024-09-12T03:01:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.209+0000 7f1cb2400640 1 --2- 172.21.15.18:0/3420152197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cac102250 0x7f1cac10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.209+0000 7f1cb2400640 1 --2- 172.21.15.18:0/3420152197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cac1018b0 0x7f1cac101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.209+0000 7f1cb2400640 1 --2- 172.21.15.18:0/3420152197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac1078c0 0x7f1cac107ca0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.209+0000 7f1cb2400640 1 -- 172.21.15.18:0/3420152197 >> 172.21.15.18:0/3420152197 conn(0x7f1cac0fd5d0 msgr2=0x7f1cac0ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:26.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.211+0000 7f1cb2400640 1 -- 172.21.15.18:0/3420152197 shutdown_connections 2024-09-12T03:01:26.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.211+0000 7f1cb2400640 1 -- 172.21.15.18:0/3420152197 wait complete. 2024-09-12T03:01:26.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.212+0000 7f1cb2400640 1 Processor -- start 2024-09-12T03:01:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.213+0000 7f1cb2400640 1 -- start start 2024-09-12T03:01:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.213+0000 7f1cb2400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac1018b0 0x7f1cac19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.213+0000 7f1cb2400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cac102250 0x7f1cac19a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.213+0000 7f1cb2400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cac1078c0 0x7f1cac19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.213+0000 7f1cb2400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac111d50 con 0x7f1cac1078c0 2024-09-12T03:01:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.213+0000 7f1cb2400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac111bd0 con 0x7f1cac102250 2024-09-12T03:01:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.213+0000 7f1cb2400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac111ed0 con 0x7f1cac1018b0 2024-09-12T03:01:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.214+0000 7f1cb1000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac1018b0 0x7f1cac19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.214+0000 7f1cb1a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cac1078c0 0x7f1cac19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.214+0000 7f1cb1a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cac1078c0 0x7f1cac19ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54944/0 (socket says 172.21.15.18:54944) 2024-09-12T03:01:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.214+0000 7f1cb1a00640 1 -- 172.21.15.18:0/1605919346 learned_addr learned my addr 172.21.15.18:0/1605919346 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:26.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.214+0000 7f1cb1a00640 1 -- 172.21.15.18:0/1605919346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac1018b0 msgr2=0x7f1cac19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:26.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.214+0000 7f1cb1a00640 1 --2- 172.21.15.18:0/1605919346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac1018b0 0x7f1cac19a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.214+0000 7f1cb1a00640 1 -- 172.21.15.18:0/1605919346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cac102250 msgr2=0x7f1cac19a9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T03:01:26.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.214+0000 7f1cb1a00640 1 --2- 172.21.15.18:0/1605919346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cac102250 0x7f1cac19a9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.214+0000 7f1cb1a00640 1 -- 172.21.15.18:0/1605919346 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cac19f450 con 0x7f1cac1078c0 2024-09-12T03:01:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.215+0000 7f1cb1a00640 1 --2- 172.21.15.18:0/1605919346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cac1078c0 0x7f1cac19ed20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009fd0 tx=0x7f1ca400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.215+0000 7f1ca9600640 1 -- 172.21.15.18:0/1605919346 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4017070 con 0x7f1cac1078c0 2024-09-12T03:01:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.216+0000 7f1ca9600640 1 -- 172.21.15.18:0/1605919346 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ca4003e50 con 0x7f1cac1078c0 2024-09-12T03:01:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.216+0000 7f1ca9600640 1 -- 172.21.15.18:0/1605919346 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca40106c0 con 0x7f1cac1078c0 2024-09-12T03:01:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.217+0000 7f1cb2400640 1 -- 172.21.15.18:0/1605919346 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cac19f740 con 0x7f1cac1078c0 2024-09-12T03:01:26.218 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.217+0000 7f1cb2400640 1 -- 172.21.15.18:0/1605919346 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cac1a6fd0 con 0x7f1cac1078c0 2024-09-12T03:01:26.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.221+0000 7f1cb6828740 1 Processor -- start 2024-09-12T03:01:26.224 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.222+0000 7f1ca9600640 1 -- 172.21.15.18:0/1605919346 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f1ca4003970 con 0x7f1cac1078c0 2024-09-12T03:01:26.224 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.222+0000 7f1cb6828740 1 -- start start 2024-09-12T03:01:26.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.223+0000 7f1cb6828740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fd2b0 0x5640b41fd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.224+0000 7f1cb6828740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 0x5640b4210840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.224+0000 7f1cb6828740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b4213170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.224+0000 7f1cb6828740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5640b4163100 con 0x5640b41fd2b0 2024-09-12T03:01:26.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.224+0000 7f1cb6828740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5640b410b1b0 con 0x5640b4210d80 2024-09-12T03:01:26.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.224+0000 7f1cb6828740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5640b415f0c0 con 0x5640b41fdbd0 2024-09-12T03:01:26.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.224+0000 7f1cb1000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 0x5640b4210840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:26.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.226+0000 7f1cb1000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 0x5640b4210840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:59196/0 (socket says 172.21.15.18:59196) 2024-09-12T03:01:26.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.226+0000 7f1cb1000640 1 -- 172.21.15.18:0/463024715 learned_addr learned my addr 172.21.15.18:0/463024715 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:26.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.226+0000 7f1cabe00640 1 --2- 172.21.15.18:0/463024715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b4213170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:26.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.226+0000 7f1cabe00640 1 --2- 172.21.15.18:0/463024715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fd2b0 0x5640b41fd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:26.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.227+0000 7f1cb1000640 1 -- 172.21.15.18:0/463024715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 msgr2=0x5640b4213170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.227+0000 7f1cb1000640 1 --2- 172.21.15.18:0/463024715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b4213170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.227+0000 7f1cb1000640 1 -- 172.21.15.18:0/463024715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fd2b0 msgr2=0x5640b41fd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.227+0000 7f1cb1000640 1 --2- 172.21.15.18:0/463024715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fd2b0 0x5640b41fd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.227+0000 7f1cb1000640 1 -- 172.21.15.18:0/463024715 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b3e76210 con 0x5640b41fdbd0 2024-09-12T03:01:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.227+0000 7f1cabe00640 1 --2- 172.21.15.18:0/463024715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fd2b0 0x5640b41fd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:01:26.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.230+0000 7f1ca9600640 1 --2- 172.21.15.18:0/1605919346 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1c940a2d70 0x7f1c940a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.230+0000 7f1ca9600640 1 -- 172.21.15.18:0/1605919346 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9654+0+0 (secure 0 0 0) 0x7f1ca40cf560 con 0x7f1cac1078c0 2024-09-12T03:01:26.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.230+0000 7f1cabe00640 1 --2- 172.21.15.18:0/1605919346 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1c940a2d70 0x7f1c940a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:26.232 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.231+0000 7f1cb1000640 1 --2- 172.21.15.18:0/463024715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 0x5640b4210840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0006010 tx=0x7f1ca0005e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d15e3921bc81f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:26.233 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.232+0000 7f1c9e000640 1 -- 172.21.15.18:0/463024715 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca003f070 con 0x5640b41fdbd0 2024-09-12T03:01:26.233 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.232+0000 7f1c9e000640 1 -- 172.21.15.18:0/463024715 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ca00043c0 con 0x5640b41fdbd0 2024-09-12T03:01:26.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.233+0000 7f1c9e000640 1 -- 172.21.15.18:0/463024715 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0035030 con 0x5640b41fdbd0 2024-09-12T03:01:26.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.233+0000 7f1cb6828740 1 -- 172.21.15.18:0/463024715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 msgr2=0x5640b4210840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:26.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.233+0000 7f1cb6828740 1 --2- 172.21.15.18:0/463024715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 0x5640b4210840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0006010 tx=0x7f1ca0005e60 comp rx=0 tx=0).stop 2024-09-12T03:01:26.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.233+0000 7f1cabe00640 1 --2- 172.21.15.18:0/1605919346 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1c940a2d70 0x7f1c940a5230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x5640b41fee30 tx=0x7f1c98005f90 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:26.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.234+0000 7f1cb6828740 1 -- 172.21.15.18:0/463024715 shutdown_connections 2024-09-12T03:01:26.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.234+0000 7f1cb6828740 1 --2- 172.21.15.18:0/463024715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b4213170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.234+0000 7f1cb6828740 1 --2- 172.21.15.18:0/463024715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 0x5640b4210840 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.234+0000 7f1cb6828740 1 --2- 172.21.15.18:0/463024715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fd2b0 0x5640b41fd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.234+0000 7f1cb6828740 1 -- 172.21.15.18:0/463024715 >> 172.21.15.18:0/463024715 conn(0x5640b41f9920 msgr2=0x5640b41f9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:26.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.234+0000 7f1cb6828740 1 -- 172.21.15.18:0/463024715 shutdown_connections 2024-09-12T03:01:26.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.234+0000 7f1cb6828740 1 -- 172.21.15.18:0/463024715 wait complete. 2024-09-12T03:01:26.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.235+0000 7f1cb6828740 1 -- start start 2024-09-12T03:01:26.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.235+0000 7f1cb6828740 1 Processor -- start 2024-09-12T03:01:26.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.236+0000 7f1cb6828740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fd2b0 0x5640b420dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.236+0000 7f1cb6828740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 0x5640b420e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.236+0000 7f1cb6828740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b420e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.236+0000 7f1cb6828740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5640b4213980 con 0x5640b41fd2b0 2024-09-12T03:01:26.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.236+0000 7f1cb6828740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5640b40ec090 con 0x5640b4210d80 2024-09-12T03:01:26.239 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.236+0000 7f1cb6828740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5640b4213b00 con 0x5640b41fdbd0 2024-09-12T03:01:26.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.236+0000 7f1cb1a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b420e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:26.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.236+0000 7f1cb1a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b420e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:39690/0 (socket says 172.21.15.18:39690) 2024-09-12T03:01:26.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.236+0000 7f1cb1a00640 1 -- 172.21.15.18:0/967715820 learned_addr learned my addr 172.21.15.18:0/967715820 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:26.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.236+0000 7f1cabe00640 1 --2- 172.21.15.18:0/967715820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 0x5640b420e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:26.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.236+0000 7f1cb1000640 1 --2- 172.21.15.18:0/967715820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fd2b0 0x5640b420dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:26.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.236+0000 7f1cb6828740 10 client.0 _ll_register_callbacks cb 0x5640b4140f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:01:26.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.237+0000 7f1cb1a00640 1 -- 172.21.15.18:0/967715820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 msgr2=0x5640b420e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:26.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.237+0000 7f1cb1a00640 1 --2- 172.21.15.18:0/967715820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 0x5640b420e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.237+0000 7f1cb1a00640 1 -- 172.21.15.18:0/967715820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fd2b0 msgr2=0x5640b420dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:26.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.237+0000 7f1cb1a00640 1 --2- 172.21.15.18:0/967715820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fd2b0 0x5640b420dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.237+0000 7f1cb1a00640 1 -- 172.21.15.18:0/967715820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640b3f42620 con 0x5640b4210d80 2024-09-12T03:01:26.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.237+0000 7f1cb1a00640 1 --2- 172.21.15.18:0/967715820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b420e780 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400b760 tx=0x7f1ca409b090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7eae640bdbd502b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.237+0000 7f1c92a00640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T03:01:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.237+0000 7f1c92a00640 1 -- 172.21.15.18:0/967715820 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4020070 con 0x5640b4210d80 2024-09-12T03:01:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.238+0000 7f1cb6828740 1 -- 172.21.15.18:0/967715820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ca00043c0 con 0x5640b4210d80 2024-09-12T03:01:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.238+0000 7f1c92a00640 1 -- 172.21.15.18:0/967715820 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9654+0+0 (secure 0 0 0) 0x7f1ca4097d20 con 0x5640b4210d80 2024-09-12T03:01:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.238+0000 7f1c92a00640 1 -- 172.21.15.18:0/967715820 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f1ca409b6b0 con 0x5640b4210d80 2024-09-12T03:01:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.238+0000 7f1cb6828740 10 client.26066 fetch_fsmap learned FSMap version 71 2024-09-12T03:01:26.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.238+0000 7f1cb6828740 1 -- 172.21.15.18:0/967715820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x5640b421f660 con 0x5640b4210d80 2024-09-12T03:01:26.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.238+0000 7f1c92a00640 1 -- 172.21.15.18:0/967715820 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ca00043c0 con 0x5640b4210d80 2024-09-12T03:01:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.240+0000 7f1c92a00640 1 -- 172.21.15.18:0/967715820 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 71) ==== 8450+0+0 (secure 0 0 0) 0x7f1ca40bb050 con 0x5640b4210d80 2024-09-12T03:01:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.240+0000 7f1cb6828740 10 client.26066 fetch_fsmap finished waiting for FSMap version 71 2024-09-12T03:01:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.240+0000 7f1cb6828740 10 client.26066 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:01:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.240+0000 7f1cb6828740 20 client.26066 populate_metadata read hostname 'smithi018' 2024-09-12T03:01:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.240+0000 7f1cb6828740 1 --2- 172.21.15.18:0/967715820 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5640b4220b90 0x5640b4222fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.240+0000 7f1cb6828740 4 client.26066 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:01:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.240+0000 7f1cb6828740 1 -- 172.21.15.18:0/967715820 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640b4170830 con 0x5640b4220b90 2024-09-12T03:01:26.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.241+0000 7f1cb1000640 1 --2- 172.21.15.18:0/967715820 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5640b4220b90 0x5640b4222fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:26.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.243+0000 7f1cb1000640 1 --2- 172.21.15.18:0/967715820 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5640b4220b90 0x5640b4222fe0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83d2db1b01467c server_cookie=aba9d8c9890a8405 in_seq=0 out_seq=0 2024-09-12T03:01:26.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.243+0000 7f1c92a00640 10 client.26066 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:01:26.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.244+0000 7f1c92a00640 1 -- 172.21.15.18:0/967715820 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5640b4170830 con 0x5640b4220b90 2024-09-12T03:01:26.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.244+0000 7f1c92a00640 10 client.26066 handle_command_reply: tid=0 2024-09-12T03:01:26.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.244+0000 7f1cb6828740 1 client.26066 shutdown 2024-09-12T03:01:26.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.244+0000 7f1cb6828740 1 -- 172.21.15.18:0/967715820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 msgr2=0x5640b420e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:26.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.244+0000 7f1cb6828740 1 --2- 172.21.15.18:0/967715820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b420e780 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400b760 tx=0x7f1ca409b090 comp rx=0 tx=0).stop 2024-09-12T03:01:26.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.244+0000 7f1cb6828740 1 -- 172.21.15.18:0/967715820 shutdown_connections 2024-09-12T03:01:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.244+0000 7f1cb6828740 1 --2- 172.21.15.18:0/967715820 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5640b4220b90 0x5640b4222fe0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.244+0000 7f1cb6828740 1 --2- 172.21.15.18:0/967715820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b420e780 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.244+0000 7f1cb6828740 1 --2- 172.21.15.18:0/967715820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 0x5640b420e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.244+0000 7f1cb6828740 1 --2- 172.21.15.18:0/967715820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fd2b0 0x5640b420dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.244+0000 7f1cb6828740 1 -- 172.21.15.18:0/967715820 >> 172.21.15.18:0/967715820 conn(0x5640b41f9920 msgr2=0x5640b41ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.244+0000 7f1c92a00640 0 client.26066 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:01:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.245+0000 7f1cb6828740 1 -- 172.21.15.18:0/967715820 shutdown_connections 2024-09-12T03:01:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.245+0000 7f1cb6828740 1 -- 172.21.15.18:0/967715820 wait complete. 2024-09-12T03:01:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.245+0000 7f1cb6828740 20 client.26066 trim_cache size 0 max 16384 2024-09-12T03:01:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.277+0000 7f1cb6828740 1 Processor -- start 2024-09-12T03:01:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.277+0000 7f1cb6828740 1 -- start start 2024-09-12T03:01:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.277+0000 7f1cb6828740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fd2b0 0x5640b420e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.277+0000 7f1cb6828740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fdbd0 0x5640b420fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.277+0000 7f1cb6828740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b42288f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.277+0000 7f1cb6828740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac1acf50 con 0x5640b41fdbd0 2024-09-12T03:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.277+0000 7f1cb6828740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac1aed90 con 0x5640b4210d80 2024-09-12T03:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.277+0000 7f1cb6828740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac1ad6e0 con 0x5640b41fd2b0 2024-09-12T03:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.278+0000 7f1cb1a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b42288f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.278+0000 7f1cb1a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b42288f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:39704/0 (socket says 172.21.15.18:39704) 2024-09-12T03:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.278+0000 7f1cb1a00640 1 -- 172.21.15.18:0/876769388 learned_addr learned my addr 172.21.15.18:0/876769388 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.278+0000 7f1cb1000640 1 --2- 172.21.15.18:0/876769388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fd2b0 0x5640b420e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.278+0000 7f1cabe00640 1 --2- 172.21.15.18:0/876769388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fdbd0 0x5640b420fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.279+0000 7f1cb1a00640 1 -- 172.21.15.18:0/876769388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fd2b0 msgr2=0x5640b420e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.279+0000 7f1cb1a00640 1 --2- 172.21.15.18:0/876769388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fd2b0 0x5640b420e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.279+0000 7f1cb1a00640 1 -- 172.21.15.18:0/876769388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fdbd0 msgr2=0x5640b420fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:26.282 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.280+0000 7f1cb1a00640 1 --2- 172.21.15.18:0/876769388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fdbd0 0x5640b420fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.282 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.280+0000 7f1cb1a00640 1 -- 172.21.15.18:0/876769388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b4213b20 con 0x5640b4210d80 2024-09-12T03:01:26.282 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.280+0000 7f1cb1a00640 1 --2- 172.21.15.18:0/876769388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b42288f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1ca40b1040 tx=0x7f1ca4097950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78075075704b25d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:26.282 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.281+0000 7f1cabe00640 1 --2- 172.21.15.18:0/876769388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fdbd0 0x5640b420fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:01:26.282 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.281+0000 7f1c9d600640 1 -- 172.21.15.18:0/876769388 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4020070 con 0x5640b4210d80 2024-09-12T03:01:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.281+0000 7f1c9d600640 1 -- 172.21.15.18:0/876769388 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ca40a4320 con 0x5640b4210d80 2024-09-12T03:01:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.281+0000 7f1c9d600640 1 -- 172.21.15.18:0/876769388 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca40afbd0 con 0x5640b4210d80 2024-09-12T03:01:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.282+0000 7f1cb6828740 1 -- 172.21.15.18:0/876769388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 msgr2=0x5640b42288f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.282+0000 7f1cb6828740 1 --2- 172.21.15.18:0/876769388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b42288f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1ca40b1040 tx=0x7f1ca4097950 comp rx=0 tx=0).stop 2024-09-12T03:01:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.282+0000 7f1cb6828740 1 -- 172.21.15.18:0/876769388 shutdown_connections 2024-09-12T03:01:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.282+0000 7f1cb6828740 1 --2- 172.21.15.18:0/876769388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b42288f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.282+0000 7f1cb6828740 1 --2- 172.21.15.18:0/876769388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fdbd0 0x5640b420fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.282+0000 7f1cb6828740 1 --2- 172.21.15.18:0/876769388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fd2b0 0x5640b420e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.282+0000 7f1cb6828740 1 -- 172.21.15.18:0/876769388 >> 172.21.15.18:0/876769388 conn(0x5640b41f9920 msgr2=0x5640b420f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.283+0000 7f1cb6828740 1 -- 172.21.15.18:0/876769388 shutdown_connections 2024-09-12T03:01:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.283+0000 7f1cb6828740 1 -- 172.21.15.18:0/876769388 wait complete. 2024-09-12T03:01:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.283+0000 7f1cb6828740 1 -- start start 2024-09-12T03:01:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.284+0000 7f1cb6828740 1 Processor -- start 2024-09-12T03:01:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.287+0000 7f1cb6828740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fd2b0 0x5640b4218e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.287+0000 7f1cb6828740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 0x5640b42193c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.288+0000 7f1cb6828740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b4214340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.288+0000 7f1cb6828740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac1ae600 con 0x5640b41fd2b0 2024-09-12T03:01:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.288+0000 7f1cb6828740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac1ade70 con 0x5640b4210d80 2024-09-12T03:01:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.288+0000 7f1cb6828740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac1aaf50 con 0x5640b41fdbd0 2024-09-12T03:01:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.288+0000 7f1cb1a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b4214340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.288+0000 7f1cb1a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b4214340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:39714/0 (socket says 172.21.15.18:39714) 2024-09-12T03:01:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.288+0000 7f1cb1a00640 1 -- 172.21.15.18:0/761130220 learned_addr learned my addr 172.21.15.18:0/761130220 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.288+0000 7f1cb6828740 10 client.0 _ll_register_callbacks cb 0x7f1ca4097290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:01:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.288+0000 7f1cabe00640 1 --2- 172.21.15.18:0/761130220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 0x5640b42193c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.290+0000 7f1cb1a00640 1 -- 172.21.15.18:0/761130220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 msgr2=0x5640b42193c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.290+0000 7f1cb1a00640 1 --2- 172.21.15.18:0/761130220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 0x5640b42193c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.290+0000 7f1cb1a00640 1 -- 172.21.15.18:0/761130220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fd2b0 msgr2=0x5640b4218e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.290+0000 7f1cb1a00640 1 --2- 172.21.15.18:0/761130220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fd2b0 0x5640b4218e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.290+0000 7f1cb1a00640 1 -- 172.21.15.18:0/761130220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640b4208a10 con 0x5640b4210d80 2024-09-12T03:01:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.290+0000 7f1cabe00640 1 --2- 172.21.15.18:0/761130220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 0x5640b42193c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:01:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.290+0000 7f1cb6828740 1 -- 172.21.15.18:0/761130220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ca40a4320 con 0x5640b4210d80 2024-09-12T03:01:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.290+0000 7f1cb1a00640 1 --2- 172.21.15.18:0/761130220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b4214340 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4004990 tx=0x7f1ca40afe00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c85ae4e66d74f92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.290+0000 7f1c92a00640 10 client.26072 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T03:01:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.291+0000 7f1c92a00640 1 -- 172.21.15.18:0/761130220 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4020070 con 0x5640b4210d80 2024-09-12T03:01:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.292+0000 7f1c92a00640 1 -- 172.21.15.18:0/761130220 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9654+0+0 (secure 0 0 0) 0x7f1ca409ad10 con 0x5640b4210d80 2024-09-12T03:01:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.292+0000 7f1c92a00640 1 -- 172.21.15.18:0/761130220 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f1ca409b010 con 0x5640b4210d80 2024-09-12T03:01:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.292+0000 7f1cb6828740 10 client.26072 fetch_fsmap learned FSMap version 71 2024-09-12T03:01:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.292+0000 7f1cb6828740 1 -- 172.21.15.18:0/761130220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({fsmap=71}) -- 0x5640b42107f0 con 0x5640b4210d80 2024-09-12T03:01:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.293+0000 7f1c92a00640 1 -- 172.21.15.18:0/761130220 <== mon.2 v2:172.21.15.62:3300/0 4 ==== fsmap(e 71) ==== 8450+0+0 (secure 0 0 0) 0x7f1ca40bb040 con 0x5640b4210d80 2024-09-12T03:01:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.294+0000 7f1cb6828740 10 client.26072 fetch_fsmap finished waiting for FSMap version 71 2024-09-12T03:01:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.294+0000 7f1cb6828740 10 client.26072 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:01:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.294+0000 7f1cb6828740 20 client.26072 populate_metadata read hostname 'smithi018' 2024-09-12T03:01:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.294+0000 7f1cb6828740 1 --2- 172.21.15.18:0/761130220 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5640b428b1e0 0x5640b428d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.294+0000 7f1cb6828740 4 client.26072 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T03:01:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.294+0000 7f1cb6828740 1 -- 172.21.15.18:0/761130220 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5640b416ab80 con 0x5640b428b1e0 2024-09-12T03:01:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.294+0000 7f1cb1000640 1 --2- 172.21.15.18:0/761130220 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5640b428b1e0 0x5640b428d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.300+0000 7f1c92a00640 10 client.26072 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:01:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.300+0000 7f1cb1000640 1 --2- 172.21.15.18:0/761130220 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5640b428b1e0 0x5640b428d640 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbcd83a433c8ad01 server_cookie=2d3f0f6e5920b327 in_seq=0 out_seq=0 2024-09-12T03:01:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.363+0000 7f1c92a00640 1 -- 172.21.15.18:0/761130220 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5640b416ab80 con 0x5640b428b1e0 2024-09-12T03:01:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.363+0000 7f1c92a00640 10 client.26072 handle_command_reply: tid=0 2024-09-12T03:01:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.364+0000 7f1cb6828740 1 client.26072 shutdown 2024-09-12T03:01:26.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.364+0000 7f1cb6828740 1 -- 172.21.15.18:0/761130220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 msgr2=0x5640b4214340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:26.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.364+0000 7f1cb6828740 1 --2- 172.21.15.18:0/761130220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b4214340 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4004990 tx=0x7f1ca40afe00 comp rx=0 tx=0).stop 2024-09-12T03:01:26.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.364+0000 7f1cb6828740 1 -- 172.21.15.18:0/761130220 shutdown_connections 2024-09-12T03:01:26.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.364+0000 7f1cb6828740 1 --2- 172.21.15.18:0/761130220 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5640b428b1e0 0x5640b428d640 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.364+0000 7f1cb6828740 1 --2- 172.21.15.18:0/761130220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5640b4210d80 0x5640b4214340 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.364+0000 7f1cb6828740 1 --2- 172.21.15.18:0/761130220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b41fdbd0 0x5640b42193c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.364+0000 7f1c92a00640 0 client.26072 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:01:26.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.364+0000 7f1cb6828740 1 --2- 172.21.15.18:0/761130220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640b41fd2b0 0x5640b4218e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.364+0000 7f1cb6828740 1 -- 172.21.15.18:0/761130220 >> 172.21.15.18:0/761130220 conn(0x5640b41f9920 msgr2=0x5640b41ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:26.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.364+0000 7f1cb6828740 1 -- 172.21.15.18:0/761130220 shutdown_connections 2024-09-12T03:01:26.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.366+0000 7f1cb6828740 1 -- 172.21.15.18:0/761130220 wait complete. 2024-09-12T03:01:26.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.366+0000 7f1cb6828740 20 client.26072 trim_cache size 0 max 16384 2024-09-12T03:01:26.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T03:01:26.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T03:01:26.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T03:01:26.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T03:01:26.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.367+0000 7f1cb2400640 1 -- 172.21.15.18:0/1605919346 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1c940a2d70 msgr2=0x7f1c940a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:26.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.367+0000 7f1cb2400640 1 --2- 172.21.15.18:0/1605919346 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1c940a2d70 0x7f1c940a5230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x5640b41fee30 tx=0x7f1c98005f90 comp rx=0 tx=0).stop 2024-09-12T03:01:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.367+0000 7f1cb2400640 1 -- 172.21.15.18:0/1605919346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cac1078c0 msgr2=0x7f1cac19ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.367+0000 7f1cb2400640 1 --2- 172.21.15.18:0/1605919346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cac1078c0 0x7f1cac19ed20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009fd0 tx=0x7f1ca400b260 comp rx=0 tx=0).stop 2024-09-12T03:01:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.368+0000 7f1cb2400640 1 -- 172.21.15.18:0/1605919346 shutdown_connections 2024-09-12T03:01:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.368+0000 7f1cb2400640 1 --2- 172.21.15.18:0/1605919346 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f1c940a2d70 0x7f1c940a5230 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.368+0000 7f1cb2400640 1 --2- 172.21.15.18:0/1605919346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cac1078c0 0x7f1cac19ed20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.368+0000 7f1cb2400640 1 --2- 172.21.15.18:0/1605919346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cac102250 0x7f1cac19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.368+0000 7f1cb2400640 1 --2- 172.21.15.18:0/1605919346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac1018b0 0x7f1cac19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.368+0000 7f1cb2400640 1 -- 172.21.15.18:0/1605919346 >> 172.21.15.18:0/1605919346 conn(0x7f1cac0fd5d0 msgr2=0x7f1cac0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.368+0000 7f1cb2400640 1 -- 172.21.15.18:0/1605919346 shutdown_connections 2024-09-12T03:01:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:26.368+0000 7f1cb2400640 1 -- 172.21.15.18:0/1605919346 wait complete. 2024-09-12T03:01:27.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:26 smithi018 ceph-mon[30616]: pgmap v397: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 166 op/s 2024-09-12T03:01:27.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:26 smithi176 ceph-mon[35713]: pgmap v397: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 166 op/s 2024-09-12T03:01:27.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:26 smithi062 ceph-mon[35527]: pgmap v397: 129 pgs: 70 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 166 op/s 2024-09-12T03:01:29.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:28 smithi018 ceph-mon[30616]: pgmap v398: 129 pgs: 63 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 45 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 144 op/s 2024-09-12T03:01:29.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:28 smithi176 ceph-mon[35713]: pgmap v398: 129 pgs: 63 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 45 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 144 op/s 2024-09-12T03:01:29.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:28 smithi062 ceph-mon[35527]: pgmap v398: 129 pgs: 63 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 45 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 144 op/s 2024-09-12T03:01:30.903 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:30 smithi018 ceph-mon[30616]: pgmap v399: 129 pgs: 63 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 45 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 139 op/s 2024-09-12T03:01:31.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:30 smithi176 ceph-mon[35713]: pgmap v399: 129 pgs: 63 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 45 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 139 op/s 2024-09-12T03:01:31.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:30 smithi062 ceph-mon[35527]: pgmap v399: 129 pgs: 63 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 45 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 139 op/s 2024-09-12T03:01:33.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:32 smithi018 ceph-mon[30616]: pgmap v400: 129 pgs: 59 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 50 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 177 op/s 2024-09-12T03:01:33.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:32 smithi176 ceph-mon[35713]: pgmap v400: 129 pgs: 59 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 50 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 177 op/s 2024-09-12T03:01:33.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:32 smithi062 ceph-mon[35527]: pgmap v400: 129 pgs: 59 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 50 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 177 op/s 2024-09-12T03:01:35.084 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:34 smithi062 ceph-mon[35527]: pgmap v401: 129 pgs: 59 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 50 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 117 op/s 2024-09-12T03:01:35.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:34 smithi018 ceph-mon[30616]: pgmap v401: 129 pgs: 59 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 50 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 117 op/s 2024-09-12T03:01:35.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:34 smithi176 ceph-mon[35713]: pgmap v401: 129 pgs: 59 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 50 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 117 op/s 2024-09-12T03:01:37.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:36 smithi018 ceph-mon[30616]: pgmap v402: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 150 op/s 2024-09-12T03:01:37.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:36 smithi176 ceph-mon[35713]: pgmap v402: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 150 op/s 2024-09-12T03:01:37.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:36 smithi062 ceph-mon[35527]: pgmap v402: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 150 op/s 2024-09-12T03:01:39.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:38 smithi018 ceph-mon[30616]: pgmap v403: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 117 op/s 2024-09-12T03:01:39.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:38 smithi176 ceph-mon[35713]: pgmap v403: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 117 op/s 2024-09-12T03:01:39.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:38 smithi062 ceph-mon[35527]: pgmap v403: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 117 op/s 2024-09-12T03:01:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.033+0000 7f10b4c00640 1 -- 172.21.15.18:0/2992200379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10b0107b70 msgr2=0x7f10b0107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.033+0000 7f10b4c00640 1 --2- 172.21.15.18:0/2992200379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10b0107b70 0x7f10b0107f50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009930 tx=0x7f10a002a420 comp rx=0 tx=0).stop 2024-09-12T03:01:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.033+0000 7f10b4c00640 1 -- 172.21.15.18:0/2992200379 shutdown_connections 2024-09-12T03:01:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.033+0000 7f10b4c00640 1 --2- 172.21.15.18:0/2992200379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b0102470 0x7f10b010e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.033+0000 7f10b4c00640 1 --2- 172.21.15.18:0/2992200379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b0101ad0 0x7f10b0101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.033+0000 7f10b4c00640 1 --2- 172.21.15.18:0/2992200379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10b0107b70 0x7f10b0107f50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.033+0000 7f10b4c00640 1 -- 172.21.15.18:0/2992200379 >> 172.21.15.18:0/2992200379 conn(0x7f10b00fd7d0 msgr2=0x7f10b00ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.034+0000 7f10b4c00640 1 -- 172.21.15.18:0/2992200379 shutdown_connections 2024-09-12T03:01:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.034+0000 7f10b4c00640 1 -- 172.21.15.18:0/2992200379 wait complete. 2024-09-12T03:01:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.035+0000 7f10b4c00640 1 Processor -- start 2024-09-12T03:01:40.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.037+0000 7f10b4c00640 1 -- start start 2024-09-12T03:01:40.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.037+0000 7f10b4c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b0101ad0 0x7f10b0198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.037+0000 7f10b4c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10b0102470 0x7f10b01988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.038+0000 7f10b4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b0107b70 0x7f10b019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.038+0000 7f10b4c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0111f30 con 0x7f10b0107b70 2024-09-12T03:01:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.038+0000 7f10b4c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0111db0 con 0x7f10b0101ad0 2024-09-12T03:01:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.038+0000 7f10b4c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01120b0 con 0x7f10b0102470 2024-09-12T03:01:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.038+0000 7f10ade00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b0101ad0 0x7f10b0198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.038+0000 7f10ad400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10b0102470 0x7f10b01988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.038+0000 7f10ad400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10b0102470 0x7f10b01988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:33934/0 (socket says 172.21.15.18:33934) 2024-09-12T03:01:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.038+0000 7f10ade00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b0101ad0 0x7f10b0198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:55468/0 (socket says 172.21.15.18:55468) 2024-09-12T03:01:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.038+0000 7f10ad400640 1 -- 172.21.15.18:0/4059479219 learned_addr learned my addr 172.21.15.18:0/4059479219 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.038+0000 7f10ae800640 1 --2- 172.21.15.18:0/4059479219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b0107b70 0x7f10b019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.039+0000 7f10ae800640 1 -- 172.21.15.18:0/4059479219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10b0102470 msgr2=0x7f10b01988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.039+0000 7f10ae800640 1 --2- 172.21.15.18:0/4059479219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10b0102470 0x7f10b01988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.039+0000 7f10ae800640 1 -- 172.21.15.18:0/4059479219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b0101ad0 msgr2=0x7f10b0198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.039+0000 7f10ae800640 1 --2- 172.21.15.18:0/4059479219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b0101ad0 0x7f10b0198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.039+0000 7f10ae800640 1 -- 172.21.15.18:0/4059479219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b019d350 con 0x7f10b0107b70 2024-09-12T03:01:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.040+0000 7f10ae800640 1 --2- 172.21.15.18:0/4059479219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b0107b70 0x7f10b019cc20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f10a800e940 tx=0x7f10a800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.040+0000 7f10a6a00640 1 -- 172.21.15.18:0/4059479219 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8004d20 con 0x7f10b0107b70 2024-09-12T03:01:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.040+0000 7f10a6a00640 1 -- 172.21.15.18:0/4059479219 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a8013770 con 0x7f10b0107b70 2024-09-12T03:01:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.040+0000 7f10a6a00640 1 -- 172.21.15.18:0/4059479219 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a80053a0 con 0x7f10b0107b70 2024-09-12T03:01:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.040+0000 7f10b4c00640 1 -- 172.21.15.18:0/4059479219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b019d640 con 0x7f10b0107b70 2024-09-12T03:01:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.040+0000 7f10b4c00640 1 -- 172.21.15.18:0/4059479219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b0074420 con 0x7f10b0107b70 2024-09-12T03:01:40.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.048+0000 7f10b7a13740 1 Processor -- start 2024-09-12T03:01:40.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.049+0000 7f10a6a00640 1 -- 172.21.15.18:0/4059479219 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f10a800cb20 con 0x7f10b0107b70 2024-09-12T03:01:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.051+0000 7f10b7a13740 1 -- start start 2024-09-12T03:01:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.051+0000 7f10b7a13740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd271e0 0x5608fbd275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.051+0000 7f10b7a13740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd27b00 0x5608fbd31e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.051+0000 7f10b7a13740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd323a0 0x5608fbd34790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.051+0000 7f10b7a13740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5608fbc8d100 con 0x5608fbd323a0 2024-09-12T03:01:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.051+0000 7f10b7a13740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5608fbc351b0 con 0x5608fbd271e0 2024-09-12T03:01:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.051+0000 7f10b7a13740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5608fbc890c0 con 0x5608fbd27b00 2024-09-12T03:01:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.052+0000 7f10ade00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd27b00 0x5608fbd31e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.052+0000 7f10ade00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd27b00 0x5608fbd31e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:33946/0 (socket says 172.21.15.18:33946) 2024-09-12T03:01:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.052+0000 7f10ade00640 1 -- 172.21.15.18:0/3512020086 learned_addr learned my addr 172.21.15.18:0/3512020086 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.052+0000 7f10ad400640 1 --2- 172.21.15.18:0/3512020086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd271e0 0x5608fbd275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.052+0000 7f10ade00640 1 -- 172.21.15.18:0/3512020086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd271e0 msgr2=0x5608fbd275c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.052+0000 7f10ade00640 1 --2- 172.21.15.18:0/3512020086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd271e0 0x5608fbd275c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.052+0000 7f10ade00640 1 -- 172.21.15.18:0/3512020086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd323a0 msgr2=0x5608fbd34790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.052+0000 7f10ade00640 1 --2- 172.21.15.18:0/3512020086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd323a0 0x5608fbd34790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.052+0000 7f10ade00640 1 -- 172.21.15.18:0/3512020086 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608fb9a0210 con 0x5608fbd27b00 2024-09-12T03:01:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.053+0000 7f10ade00640 1 --2- 172.21.15.18:0/3512020086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd27b00 0x5608fbd31e60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f10a002aa10 tx=0x7f10a0005e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c86c4b4759d67598 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.053+0000 7f10a6a00640 1 --2- 172.21.15.18:0/4059479219 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f10940a2e20 0x7f10940a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.053+0000 7f109b000640 1 -- 172.21.15.18:0/3512020086 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0035030 con 0x5608fbd27b00 2024-09-12T03:01:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.053+0000 7f109b000640 1 -- 172.21.15.18:0/3512020086 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a00043c0 con 0x5608fbd27b00 2024-09-12T03:01:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.053+0000 7f10a6a00640 1 -- 172.21.15.18:0/4059479219 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9654+0+0 (secure 0 0 0) 0x7f10a80d38c0 con 0x7f10b0107b70 2024-09-12T03:01:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.053+0000 7f109b000640 1 -- 172.21.15.18:0/3512020086 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a00035f0 con 0x5608fbd27b00 2024-09-12T03:01:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.053+0000 7f10ad400640 1 --2- 172.21.15.18:0/4059479219 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f10940a2e20 0x7f10940a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.054+0000 7f10b7a13740 1 -- 172.21.15.18:0/3512020086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd27b00 msgr2=0x5608fbd31e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.054+0000 7f10b7a13740 1 --2- 172.21.15.18:0/3512020086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd27b00 0x5608fbd31e60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f10a002aa10 tx=0x7f10a0005e60 comp rx=0 tx=0).stop 2024-09-12T03:01:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.055+0000 7f10b7a13740 1 -- 172.21.15.18:0/3512020086 shutdown_connections 2024-09-12T03:01:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.055+0000 7f10b7a13740 1 --2- 172.21.15.18:0/3512020086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd323a0 0x5608fbd34790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.055+0000 7f10b7a13740 1 --2- 172.21.15.18:0/3512020086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd27b00 0x5608fbd31e60 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f10a002aa10 tx=0x7f10a0005e60 comp rx=0 tx=0).stop 2024-09-12T03:01:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.055+0000 7f10b7a13740 1 --2- 172.21.15.18:0/3512020086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd271e0 0x5608fbd275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.055+0000 7f10b7a13740 1 -- 172.21.15.18:0/3512020086 >> 172.21.15.18:0/3512020086 conn(0x5608fbd23750 msgr2=0x5608fbd23b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.056+0000 7f10b7a13740 1 -- 172.21.15.18:0/3512020086 shutdown_connections 2024-09-12T03:01:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.056+0000 7f10b7a13740 1 -- 172.21.15.18:0/3512020086 wait complete. 2024-09-12T03:01:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.056+0000 7f10b7a13740 1 -- start start 2024-09-12T03:01:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.057+0000 7f10b7a13740 1 Processor -- start 2024-09-12T03:01:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.058+0000 7f10ad400640 1 --2- 172.21.15.18:0/4059479219 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f10940a2e20 0x7f10940a52e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f109c005d00 tx=0x7f109c005c90 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.058+0000 7f10b7a13740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd271e0 0x5608fbd2f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.058+0000 7f10b7a13740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd323a0 0x5608fbd2fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.058+0000 7f10b7a13740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd2ff80 0x5608fbd3e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.058+0000 7f10ade00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd271e0 0x5608fbd2f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.058+0000 7f10ade00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd271e0 0x5608fbd2f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:55490/0 (socket says 172.21.15.18:55490) 2024-09-12T03:01:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.059+0000 7f10ad400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd323a0 0x5608fbd2fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.059+0000 7f10ad400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd323a0 0x5608fbd2fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:33962/0 (socket says 172.21.15.18:33962) 2024-09-12T03:01:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.059+0000 7f10ae800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd2ff80 0x5608fbd3e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.059+0000 7f10ae800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd2ff80 0x5608fbd3e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48492/0 (socket says 172.21.15.18:48492) 2024-09-12T03:01:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.059+0000 7f10ade00640 1 -- 172.21.15.18:0/795948362 learned_addr learned my addr 172.21.15.18:0/795948362 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.059+0000 7f10b7a13740 1 -- 172.21.15.18:0/795948362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5608fbd34f70 con 0x5608fbd2ff80 2024-09-12T03:01:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.059+0000 7f10b7a13740 1 -- 172.21.15.18:0/795948362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5608fbc16090 con 0x5608fbd271e0 2024-09-12T03:01:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.059+0000 7f10b7a13740 1 -- 172.21.15.18:0/795948362 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5608fbd350f0 con 0x5608fbd323a0 2024-09-12T03:01:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.059+0000 7f10b7a13740 10 client.0 _ll_register_callbacks cb 0x5608fbc6af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:01:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.060+0000 7f10ade00640 1 -- 172.21.15.18:0/795948362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd323a0 msgr2=0x5608fbd2fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.060+0000 7f10ade00640 1 --2- 172.21.15.18:0/795948362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd323a0 0x5608fbd2fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.060+0000 7f10ade00640 1 -- 172.21.15.18:0/795948362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd2ff80 msgr2=0x5608fbd3e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.060+0000 7f10ade00640 1 --2- 172.21.15.18:0/795948362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd2ff80 0x5608fbd3e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.060+0000 7f10ade00640 1 -- 172.21.15.18:0/795948362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608fba6c620 con 0x5608fbd271e0 2024-09-12T03:01:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.060+0000 7f10ade00640 1 --2- 172.21.15.18:0/795948362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd271e0 0x5608fbd2f500 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f10a0000c00 tx=0x7f10a00095b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85c5555625b8019e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.060+0000 7f108f400640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T03:01:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.060+0000 7f108f400640 1 -- 172.21.15.18:0/795948362 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0063060 con 0x5608fbd271e0 2024-09-12T03:01:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.061+0000 7f10ad400640 1 --2- 172.21.15.18:0/795948362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd323a0 0x5608fbd2fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-12T03:01:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.061+0000 7f10ae800640 1 --2- 172.21.15.18:0/795948362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd2ff80 0x5608fbd3e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-12T03:01:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.061+0000 7f108f400640 1 -- 172.21.15.18:0/795948362 <== mon.2 v2:172.21.15.62:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9654+0+0 (secure 0 0 0) 0x7f10a0032c00 con 0x5608fbd271e0 2024-09-12T03:01:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.061+0000 7f10b7a13740 1 -- 172.21.15.18:0/795948362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10a00043c0 con 0x5608fbd271e0 2024-09-12T03:01:40.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.061+0000 7f108f400640 1 -- 172.21.15.18:0/795948362 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f10a0032e00 con 0x5608fbd271e0 2024-09-12T03:01:40.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.061+0000 7f10b7a13740 10 client.26084 fetch_fsmap learned FSMap version 71 2024-09-12T03:01:40.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.061+0000 7f10b7a13740 1 -- 172.21.15.18:0/795948362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x5608fbd41200 con 0x5608fbd271e0 2024-09-12T03:01:40.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.063+0000 7f108f400640 1 -- 172.21.15.18:0/795948362 <== mon.2 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a00043c0 con 0x5608fbd271e0 2024-09-12T03:01:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.068+0000 7f108f400640 1 -- 172.21.15.18:0/795948362 <== mon.2 v2:172.21.15.62:3300/0 5 ==== fsmap(e 71) ==== 8450+0+0 (secure 0 0 0) 0x7f10a0066050 con 0x5608fbd271e0 2024-09-12T03:01:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.068+0000 7f10b7a13740 10 client.26084 fetch_fsmap finished waiting for FSMap version 71 2024-09-12T03:01:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.068+0000 7f10b7a13740 10 client.26084 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:01:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.068+0000 7f10b7a13740 20 client.26084 populate_metadata read hostname 'smithi018' 2024-09-12T03:01:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.068+0000 7f10b7a13740 1 --2- 172.21.15.18:0/795948362 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5608fbd42550 0x5608fbd44940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.068+0000 7f10b7a13740 4 client.26084 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:01:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.068+0000 7f10b7a13740 1 -- 172.21.15.18:0/795948362 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608fbc9a830 con 0x5608fbd42550 2024-09-12T03:01:40.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.071+0000 7f10ad400640 1 --2- 172.21.15.18:0/795948362 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5608fbd42550 0x5608fbd44940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.075+0000 7f108f400640 10 client.26084 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:01:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.075+0000 7f10ad400640 1 --2- 172.21.15.18:0/795948362 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5608fbd42550 0x5608fbd44940 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9817e384307df3f server_cookie=33b7b8577670c824 in_seq=0 out_seq=0 2024-09-12T03:01:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.076+0000 7f108f400640 1 -- 172.21.15.18:0/795948362 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608fbc9a830 con 0x5608fbd42550 2024-09-12T03:01:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.076+0000 7f108f400640 10 client.26084 handle_command_reply: tid=0 2024-09-12T03:01:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.076+0000 7f10b7a13740 1 client.26084 shutdown 2024-09-12T03:01:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.077+0000 7f10b7a13740 1 -- 172.21.15.18:0/795948362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd271e0 msgr2=0x5608fbd2f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.077+0000 7f10b7a13740 1 --2- 172.21.15.18:0/795948362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd271e0 0x5608fbd2f500 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f10a0000c00 tx=0x7f10a00095b0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.077+0000 7f10b7a13740 1 -- 172.21.15.18:0/795948362 shutdown_connections 2024-09-12T03:01:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.077+0000 7f10b7a13740 1 --2- 172.21.15.18:0/795948362 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5608fbd42550 0x5608fbd44940 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.077+0000 7f10b7a13740 1 --2- 172.21.15.18:0/795948362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd2ff80 0x5608fbd3e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.077+0000 7f10b7a13740 1 --2- 172.21.15.18:0/795948362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd323a0 0x5608fbd2fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.077+0000 7f10b7a13740 1 --2- 172.21.15.18:0/795948362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd271e0 0x5608fbd2f500 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.077+0000 7f10b7a13740 1 -- 172.21.15.18:0/795948362 >> 172.21.15.18:0/795948362 conn(0x5608fbd23750 msgr2=0x5608fbd294b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.077+0000 7f108f400640 0 client.26084 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:01:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.077+0000 7f10b7a13740 1 -- 172.21.15.18:0/795948362 shutdown_connections 2024-09-12T03:01:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.078+0000 7f10b7a13740 1 -- 172.21.15.18:0/795948362 wait complete. 2024-09-12T03:01:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.079+0000 7f10b7a13740 20 client.26084 trim_cache size 0 max 16384 2024-09-12T03:01:40.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.113+0000 7f10b7a13740 1 Processor -- start 2024-09-12T03:01:40.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.114+0000 7f10b7a13740 1 -- start start 2024-09-12T03:01:40.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.115+0000 7f10b7a13740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd271e0 0x5608fbd3e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.115+0000 7f10b7a13740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd2ff80 0x5608fbd47960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.115+0000 7f10b7a13740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd323a0 0x5608fbd47ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.115+0000 7f10b7a13740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0073b20 con 0x5608fbd2ff80 2024-09-12T03:01:40.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.115+0000 7f10b7a13740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01aec30 con 0x5608fbd323a0 2024-09-12T03:01:40.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.115+0000 7f10b7a13740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01ad6e0 con 0x5608fbd271e0 2024-09-12T03:01:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.115+0000 7f10ade00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd271e0 0x5608fbd3e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.115+0000 7f10ade00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd271e0 0x5608fbd3e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:33974/0 (socket says 172.21.15.18:33974) 2024-09-12T03:01:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.115+0000 7f10ade00640 1 -- 172.21.15.18:0/4255487511 learned_addr learned my addr 172.21.15.18:0/4255487511 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.115+0000 7f10ad400640 1 --2- 172.21.15.18:0/4255487511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd2ff80 0x5608fbd47960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.115+0000 7f10ae800640 1 --2- 172.21.15.18:0/4255487511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd323a0 0x5608fbd47ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.116+0000 7f10ade00640 1 -- 172.21.15.18:0/4255487511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd323a0 msgr2=0x5608fbd47ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.116+0000 7f10ade00640 1 --2- 172.21.15.18:0/4255487511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd323a0 0x5608fbd47ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.116+0000 7f10ade00640 1 -- 172.21.15.18:0/4255487511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd2ff80 msgr2=0x5608fbd47960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.116+0000 7f10ade00640 1 --2- 172.21.15.18:0/4255487511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd2ff80 0x5608fbd47960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.116+0000 7f10ade00640 1 -- 172.21.15.18:0/4255487511 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608fbd1ed60 con 0x5608fbd271e0 2024-09-12T03:01:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.116+0000 7f10ad400640 1 --2- 172.21.15.18:0/4255487511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd2ff80 0x5608fbd47960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:01:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.117+0000 7f10ade00640 1 --2- 172.21.15.18:0/4255487511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd271e0 0x5608fbd3e350 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f10a0005c40 tx=0x7f10a0009620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b43c39776ad3891c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:40.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.119+0000 7f109a600640 1 -- 172.21.15.18:0/4255487511 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0035070 con 0x5608fbd271e0 2024-09-12T03:01:40.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.119+0000 7f109a600640 1 -- 172.21.15.18:0/4255487511 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a006d020 con 0x5608fbd271e0 2024-09-12T03:01:40.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.119+0000 7f109a600640 1 -- 172.21.15.18:0/4255487511 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0063040 con 0x5608fbd271e0 2024-09-12T03:01:40.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.120+0000 7f10b7a13740 1 -- 172.21.15.18:0/4255487511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd271e0 msgr2=0x5608fbd3e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:40.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.120+0000 7f10b7a13740 1 --2- 172.21.15.18:0/4255487511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd271e0 0x5608fbd3e350 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f10a0005c40 tx=0x7f10a0009620 comp rx=0 tx=0).stop 2024-09-12T03:01:40.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.120+0000 7f10b7a13740 1 -- 172.21.15.18:0/4255487511 shutdown_connections 2024-09-12T03:01:40.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.120+0000 7f10b7a13740 1 --2- 172.21.15.18:0/4255487511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd323a0 0x5608fbd47ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.120+0000 7f10b7a13740 1 --2- 172.21.15.18:0/4255487511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd2ff80 0x5608fbd47960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.120+0000 7f10b7a13740 1 --2- 172.21.15.18:0/4255487511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd271e0 0x5608fbd3e350 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.120+0000 7f10b7a13740 1 -- 172.21.15.18:0/4255487511 >> 172.21.15.18:0/4255487511 conn(0x5608fbd23750 msgr2=0x5608fbd31580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:40.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.120+0000 7f10b7a13740 1 -- 172.21.15.18:0/4255487511 shutdown_connections 2024-09-12T03:01:40.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.122+0000 7f10b7a13740 1 -- 172.21.15.18:0/4255487511 wait complete. 2024-09-12T03:01:40.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.123+0000 7f10b7a13740 1 -- start start 2024-09-12T03:01:40.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.123+0000 7f10b7a13740 1 Processor -- start 2024-09-12T03:01:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.124+0000 7f10b7a13740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd271e0 0x5608fbd457f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.124+0000 7f10b7a13740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd2ff80 0x5608fbd45d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.124+0000 7f10b7a13740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd323a0 0x5608fbd46270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.125+0000 7f10b7a13740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01ae4a0 con 0x5608fbd271e0 2024-09-12T03:01:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.125+0000 7f10ad400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd2ff80 0x5608fbd45d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.125+0000 7f10ae800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd323a0 0x5608fbd46270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.125+0000 7f10b7a13740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01add10 con 0x5608fbd2ff80 2024-09-12T03:01:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.125+0000 7f10ae800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd323a0 0x5608fbd46270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:33984/0 (socket says 172.21.15.18:33984) 2024-09-12T03:01:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.125+0000 7f10ae800640 1 -- 172.21.15.18:0/1768825842 learned_addr learned my addr 172.21.15.18:0/1768825842 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.125+0000 7f10b7a13740 1 -- 172.21.15.18:0/1768825842 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0071bb0 con 0x5608fbd323a0 2024-09-12T03:01:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.125+0000 7f10b7a13740 10 client.0 _ll_register_callbacks cb 0x7f10a0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:01:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.125+0000 7f10ade00640 1 --2- 172.21.15.18:0/1768825842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd271e0 0x5608fbd457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.125+0000 7f10ae800640 1 -- 172.21.15.18:0/1768825842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd2ff80 msgr2=0x5608fbd45d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.125+0000 7f10ae800640 1 --2- 172.21.15.18:0/1768825842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd2ff80 0x5608fbd45d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.125+0000 7f10ae800640 1 -- 172.21.15.18:0/1768825842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd271e0 msgr2=0x5608fbd457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.126+0000 7f10ae800640 1 --2- 172.21.15.18:0/1768825842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd271e0 0x5608fbd457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.126+0000 7f10ae800640 1 -- 172.21.15.18:0/1768825842 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608fbd2fdb0 con 0x5608fbd323a0 2024-09-12T03:01:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.126+0000 7f10ade00640 1 --2- 172.21.15.18:0/1768825842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd271e0 0x5608fbd457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:01:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.126+0000 7f10ae800640 1 --2- 172.21.15.18:0/1768825842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd323a0 0x5608fbd46270 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f10a809bee0 tx=0x7f10a809fb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99267dc0777c43c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.126+0000 7f108f400640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T03:01:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.126+0000 7f108f400640 1 -- 172.21.15.18:0/1768825842 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a800ce10 con 0x5608fbd323a0 2024-09-12T03:01:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.126+0000 7f108f400640 1 -- 172.21.15.18:0/1768825842 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9654+0+0 (secure 0 0 0) 0x7f10a809c0f0 con 0x5608fbd323a0 2024-09-12T03:01:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.126+0000 7f10b7a13740 1 -- 172.21.15.18:0/1768825842 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10a006d020 con 0x5608fbd323a0 2024-09-12T03:01:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.127+0000 7f108f400640 1 -- 172.21.15.18:0/1768825842 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f10a80a8260 con 0x5608fbd323a0 2024-09-12T03:01:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.127+0000 7f10b7a13740 10 client.26050 fetch_fsmap learned FSMap version 71 2024-09-12T03:01:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.127+0000 7f10b7a13740 1 -- 172.21.15.18:0/1768825842 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x5608fbd32090 con 0x5608fbd323a0 2024-09-12T03:01:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.127+0000 7f108f400640 1 -- 172.21.15.18:0/1768825842 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a006d020 con 0x5608fbd323a0 2024-09-12T03:01:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.128+0000 7f108f400640 1 -- 172.21.15.18:0/1768825842 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 71) ==== 8450+0+0 (secure 0 0 0) 0x7f10a80d2040 con 0x5608fbd323a0 2024-09-12T03:01:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.128+0000 7f10b7a13740 10 client.26050 fetch_fsmap finished waiting for FSMap version 71 2024-09-12T03:01:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.128+0000 7f10b7a13740 10 client.26050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:01:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.128+0000 7f10b7a13740 20 client.26050 populate_metadata read hostname 'smithi018' 2024-09-12T03:01:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.128+0000 7f10b7a13740 1 --2- 172.21.15.18:0/1768825842 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5608fbdad6a0 0x5608fbdafac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.128+0000 7f10b7a13740 4 client.26050 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T03:01:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.128+0000 7f10b7a13740 1 -- 172.21.15.18:0/1768825842 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5608fbd24670 con 0x5608fbdad6a0 2024-09-12T03:01:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.128+0000 7f10ade00640 1 --2- 172.21.15.18:0/1768825842 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5608fbdad6a0 0x5608fbdafac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:40.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.129+0000 7f10ade00640 1 --2- 172.21.15.18:0/1768825842 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5608fbdad6a0 0x5608fbdafac0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed240042788de01b server_cookie=7e9110d6518e6b93 in_seq=0 out_seq=0 2024-09-12T03:01:40.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.129+0000 7f108f400640 10 client.26050 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:01:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.201+0000 7f108f400640 1 -- 172.21.15.18:0/1768825842 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5608fbd24670 con 0x5608fbdad6a0 2024-09-12T03:01:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.201+0000 7f108f400640 10 client.26050 handle_command_reply: tid=0 2024-09-12T03:01:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.201+0000 7f10b7a13740 1 client.26050 shutdown 2024-09-12T03:01:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.205+0000 7f10b7a13740 1 -- 172.21.15.18:0/1768825842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd323a0 msgr2=0x5608fbd46270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.205+0000 7f10b7a13740 1 --2- 172.21.15.18:0/1768825842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd323a0 0x5608fbd46270 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f10a809bee0 tx=0x7f10a809fb40 comp rx=0 tx=0).stop 2024-09-12T03:01:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.205+0000 7f10b7a13740 1 -- 172.21.15.18:0/1768825842 shutdown_connections 2024-09-12T03:01:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.205+0000 7f10b7a13740 1 --2- 172.21.15.18:0/1768825842 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5608fbdad6a0 0x5608fbdafac0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.205+0000 7f10b7a13740 1 --2- 172.21.15.18:0/1768825842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608fbd323a0 0x5608fbd46270 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.205+0000 7f10b7a13740 1 --2- 172.21.15.18:0/1768825842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5608fbd2ff80 0x5608fbd45d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.205+0000 7f10b7a13740 1 --2- 172.21.15.18:0/1768825842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608fbd271e0 0x5608fbd457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.205+0000 7f10b7a13740 1 -- 172.21.15.18:0/1768825842 >> 172.21.15.18:0/1768825842 conn(0x5608fbd23750 msgr2=0x5608fbd2eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.205+0000 7f108f400640 0 client.26050 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:01:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.206+0000 7f10b7a13740 1 -- 172.21.15.18:0/1768825842 shutdown_connections 2024-09-12T03:01:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.206+0000 7f10b7a13740 1 -- 172.21.15.18:0/1768825842 wait complete. 2024-09-12T03:01:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.206+0000 7f10b7a13740 20 client.26050 trim_cache size 0 max 16384 2024-09-12T03:01:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T03:01:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T03:01:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T03:01:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T03:01:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.207+0000 7f10b4c00640 1 -- 172.21.15.18:0/4059479219 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f10940a2e20 msgr2=0x7f10940a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.207+0000 7f10b4c00640 1 --2- 172.21.15.18:0/4059479219 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f10940a2e20 0x7f10940a52e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f109c005d00 tx=0x7f109c005c90 comp rx=0 tx=0).stop 2024-09-12T03:01:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.207+0000 7f10b4c00640 1 -- 172.21.15.18:0/4059479219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b0107b70 msgr2=0x7f10b019cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.207+0000 7f10b4c00640 1 --2- 172.21.15.18:0/4059479219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b0107b70 0x7f10b019cc20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f10a800e940 tx=0x7f10a800ee00 comp rx=0 tx=0).stop 2024-09-12T03:01:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.207+0000 7f10b4c00640 1 -- 172.21.15.18:0/4059479219 shutdown_connections 2024-09-12T03:01:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.207+0000 7f10b4c00640 1 --2- 172.21.15.18:0/4059479219 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f10940a2e20 0x7f10940a52e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.207+0000 7f10b4c00640 1 --2- 172.21.15.18:0/4059479219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b0107b70 0x7f10b019cc20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.207+0000 7f10b4c00640 1 --2- 172.21.15.18:0/4059479219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10b0102470 0x7f10b01988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.207+0000 7f10b4c00640 1 --2- 172.21.15.18:0/4059479219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b0101ad0 0x7f10b0198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.207+0000 7f10b4c00640 1 -- 172.21.15.18:0/4059479219 >> 172.21.15.18:0/4059479219 conn(0x7f10b00fd7d0 msgr2=0x7f10b00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.207+0000 7f10b4c00640 1 -- 172.21.15.18:0/4059479219 shutdown_connections 2024-09-12T03:01:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:40.207+0000 7f10b4c00640 1 -- 172.21.15.18:0/4059479219 wait complete. 2024-09-12T03:01:41.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:40 smithi018 ceph-mon[30616]: pgmap v404: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 103 op/s 2024-09-12T03:01:41.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:40 smithi176 ceph-mon[35713]: pgmap v404: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 103 op/s 2024-09-12T03:01:41.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:40 smithi062 ceph-mon[35527]: pgmap v404: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 103 op/s 2024-09-12T03:01:43.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:42 smithi018 ceph-mon[30616]: pgmap v405: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 168 op/s 2024-09-12T03:01:43.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:42 smithi176 ceph-mon[35713]: pgmap v405: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 168 op/s 2024-09-12T03:01:43.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:42 smithi062 ceph-mon[35527]: pgmap v405: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 168 op/s 2024-09-12T03:01:43.851 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 03:01:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T03:01:43.445+0000 7fea77000640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-12T03:01:45.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:44 smithi018 ceph-mon[30616]: pgmap v406: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 121 op/s 2024-09-12T03:01:45.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:44 smithi176 ceph-mon[35713]: pgmap v406: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 121 op/s 2024-09-12T03:01:45.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:44 smithi062 ceph-mon[35527]: pgmap v406: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 121 op/s 2024-09-12T03:01:47.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:46 smithi018 ceph-mon[30616]: pgmap v407: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 170 op/s 2024-09-12T03:01:47.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:46 smithi176 ceph-mon[35713]: pgmap v407: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 170 op/s 2024-09-12T03:01:47.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:46 smithi062 ceph-mon[35527]: pgmap v407: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 170 op/s 2024-09-12T03:01:49.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:48 smithi176 ceph-mon[35713]: pgmap v408: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-09-12T03:01:49.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:48 smithi062 ceph-mon[35527]: pgmap v408: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-09-12T03:01:49.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:48 smithi018 ceph-mon[30616]: pgmap v408: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-09-12T03:01:51.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:50 smithi176 ceph-mon[35713]: pgmap v409: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 140 op/s 2024-09-12T03:01:51.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:50 smithi062 ceph-mon[35527]: pgmap v409: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 140 op/s 2024-09-12T03:01:51.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:50 smithi018 ceph-mon[30616]: pgmap v409: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 140 op/s 2024-09-12T03:01:53.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:52 smithi018 ceph-mon[30616]: pgmap v410: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 208 op/s 2024-09-12T03:01:53.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:52 smithi176 ceph-mon[35713]: pgmap v410: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 208 op/s 2024-09-12T03:01:53.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:52 smithi062 ceph-mon[35527]: pgmap v410: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 208 op/s 2024-09-12T03:01:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.978+0000 7ffac2200640 1 -- 172.21.15.18:0/4214627605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffabc0ffb80 msgr2=0x7ffabc0fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.978+0000 7ffac2200640 1 --2- 172.21.15.18:0/4214627605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffabc0ffb80 0x7ffabc0fffe0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009890 tx=0x7ffaa802a360 comp rx=0 tx=0).stop 2024-09-12T03:01:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.978+0000 7ffac2200640 1 -- 172.21.15.18:0/4214627605 shutdown_connections 2024-09-12T03:01:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.978+0000 7ffac2200640 1 --2- 172.21.15.18:0/4214627605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffabc100520 0x7ffabc10e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.978+0000 7ffac2200640 1 --2- 172.21.15.18:0/4214627605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffabc0ffb80 0x7ffabc0fffe0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.978+0000 7ffac2200640 1 --2- 172.21.15.18:0/4214627605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffabc106b10 0x7ffabc106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.978+0000 7ffac2200640 1 -- 172.21.15.18:0/4214627605 >> 172.21.15.18:0/4214627605 conn(0x7ffabc0fba30 msgr2=0x7ffabc0fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.978+0000 7ffac2200640 1 -- 172.21.15.18:0/4214627605 shutdown_connections 2024-09-12T03:01:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.979+0000 7ffac2200640 1 -- 172.21.15.18:0/4214627605 wait complete. 2024-09-12T03:01:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.980+0000 7ffac2200640 1 Processor -- start 2024-09-12T03:01:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.983+0000 7ffac2200640 1 -- start start 2024-09-12T03:01:53.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.984+0000 7ffac2200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffabc0ffb80 0x7ffabc19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:53.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.984+0000 7ffac2200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffabc100520 0x7ffabc19f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:53.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.984+0000 7ffac2200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffabc106b10 0x7ffabc10da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.984+0000 7ffac2200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc111f20 con 0x7ffabc100520 2024-09-12T03:01:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.984+0000 7ffac2200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc111da0 con 0x7ffabc106b10 2024-09-12T03:01:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.984+0000 7ffac2200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1120a0 con 0x7ffabc0ffb80 2024-09-12T03:01:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.985+0000 7ffabbe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffabc106b10 0x7ffabc10da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.985+0000 7ffabbe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffabc106b10 0x7ffabc10da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:45234/0 (socket says 172.21.15.18:45234) 2024-09-12T03:01:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.985+0000 7ffabbe00640 1 -- 172.21.15.18:0/2975735764 learned_addr learned my addr 172.21.15.18:0/2975735764 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:53.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.985+0000 7ffabaa00640 1 --2- 172.21.15.18:0/2975735764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffabc100520 0x7ffabc19f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:53.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.985+0000 7ffabb400640 1 --2- 172.21.15.18:0/2975735764 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffabc0ffb80 0x7ffabc19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:53.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.985+0000 7ffabbe00640 1 -- 172.21.15.18:0/2975735764 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffabc0ffb80 msgr2=0x7ffabc19ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:53.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.985+0000 7ffabbe00640 1 --2- 172.21.15.18:0/2975735764 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffabc0ffb80 0x7ffabc19ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:53.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.985+0000 7ffabbe00640 1 -- 172.21.15.18:0/2975735764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffabc100520 msgr2=0x7ffabc19f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:53.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.985+0000 7ffabbe00640 1 --2- 172.21.15.18:0/2975735764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffabc100520 0x7ffabc19f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:53.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.985+0000 7ffabbe00640 1 -- 172.21.15.18:0/2975735764 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffabc10e250 con 0x7ffabc106b10 2024-09-12T03:01:53.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.985+0000 7ffabb400640 1 --2- 172.21.15.18:0/2975735764 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffabc0ffb80 0x7ffabc19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:01:53.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.986+0000 7ffabbe00640 1 --2- 172.21.15.18:0/2975735764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffabc106b10 0x7ffabc10da80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009fd0 tx=0x7ffab400b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:53.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.986+0000 7ffab3e00640 1 -- 172.21.15.18:0/2975735764 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4017070 con 0x7ffabc106b10 2024-09-12T03:01:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.986+0000 7ffac2200640 1 -- 172.21.15.18:0/2975735764 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffabc10e540 con 0x7ffabc106b10 2024-09-12T03:01:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.987+0000 7ffab3e00640 1 -- 172.21.15.18:0/2975735764 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffab4003e50 con 0x7ffabc106b10 2024-09-12T03:01:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.987+0000 7ffab3e00640 1 -- 172.21.15.18:0/2975735764 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab40106c0 con 0x7ffabc106b10 2024-09-12T03:01:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.987+0000 7ffac2200640 1 -- 172.21.15.18:0/2975735764 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffabc19a9c0 con 0x7ffabc106b10 2024-09-12T03:01:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.992+0000 7ffac527b740 1 Processor -- start 2024-09-12T03:01:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.994+0000 7ffab3e00640 1 -- 172.21.15.18:0/2975735764 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7ffab4003970 con 0x7ffabc106b10 2024-09-12T03:01:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.996+0000 7ffac527b740 1 -- start start 2024-09-12T03:01:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.996+0000 7ffac527b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b9131e0 0x560d0b9135c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.996+0000 7ffac527b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 0x560d0b91de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.996+0000 7ffac527b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b91e3a0 0x560d0b920790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.996+0000 7ffac527b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560d0b879100 con 0x560d0b913b00 2024-09-12T03:01:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.996+0000 7ffac527b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560d0b8211b0 con 0x560d0b9131e0 2024-09-12T03:01:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.996+0000 7ffac527b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x560d0b8750c0 con 0x560d0b91e3a0 2024-09-12T03:01:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.997+0000 7ffabb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 0x560d0b91de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.997+0000 7ffab3e00640 1 --2- 172.21.15.18:0/2975735764 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ffaa00a2e20 0x7ffaa00a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.997+0000 7ffabb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 0x560d0b91de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54442/0 (socket says 172.21.15.18:54442) 2024-09-12T03:01:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.997+0000 7ffabb400640 1 -- 172.21.15.18:0/1418735523 learned_addr learned my addr 172.21.15.18:0/1418735523 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.997+0000 7ffab3e00640 1 -- 172.21.15.18:0/2975735764 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9654+0+0 (secure 0 0 0) 0x7ffab40cf6f0 con 0x7ffabc106b10 2024-09-12T03:01:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.998+0000 7ffabb400640 1 -- 172.21.15.18:0/1418735523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b91e3a0 msgr2=0x560d0b920790 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T03:01:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.998+0000 7ffabb400640 1 --2- 172.21.15.18:0/1418735523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b91e3a0 0x560d0b920790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.998+0000 7ffabb400640 1 -- 172.21.15.18:0/1418735523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b9131e0 msgr2=0x560d0b9135c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.998+0000 7ffabb400640 1 --2- 172.21.15.18:0/1418735523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b9131e0 0x560d0b9135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.998+0000 7ffabb400640 1 -- 172.21.15.18:0/1418735523 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d0b58c210 con 0x560d0b913b00 2024-09-12T03:01:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.999+0000 7ffabbe00640 1 --2- 172.21.15.18:0/2975735764 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ffaa00a2e20 0x7ffaa00a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:53.999+0000 7ffabb400640 1 --2- 172.21.15.18:0/1418735523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 0x560d0b91de60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009d00 tx=0x7ffaac0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687ca937fea2459c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.000+0000 7ffaa7e00640 1 -- 172.21.15.18:0/1418735523 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac01c480 con 0x560d0b913b00 2024-09-12T03:01:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.000+0000 7ffabbe00640 1 --2- 172.21.15.18:0/2975735764 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ffaa00a2e20 0x7ffaa00a52e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffab40cca80 tx=0x7ffab400bea0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.000+0000 7ffaa7e00640 1 -- 172.21.15.18:0/1418735523 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaac01cb00 con 0x560d0b913b00 2024-09-12T03:01:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.001+0000 7ffaa7e00640 1 -- 172.21.15.18:0/1418735523 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac011c60 con 0x560d0b913b00 2024-09-12T03:01:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.002+0000 7ffac527b740 1 -- 172.21.15.18:0/1418735523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 msgr2=0x560d0b91de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.002+0000 7ffac527b740 1 --2- 172.21.15.18:0/1418735523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 0x560d0b91de60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009d00 tx=0x7ffaac0107a0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.002+0000 7ffac527b740 1 -- 172.21.15.18:0/1418735523 shutdown_connections 2024-09-12T03:01:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.003+0000 7ffac527b740 1 --2- 172.21.15.18:0/1418735523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b91e3a0 0x560d0b920790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.003+0000 7ffac527b740 1 --2- 172.21.15.18:0/1418735523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 0x560d0b91de60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.003+0000 7ffac527b740 1 --2- 172.21.15.18:0/1418735523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b9131e0 0x560d0b9135c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.003+0000 7ffac527b740 1 -- 172.21.15.18:0/1418735523 >> 172.21.15.18:0/1418735523 conn(0x560d0b90f750 msgr2=0x560d0b90fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:54.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.007+0000 7ffac527b740 1 -- 172.21.15.18:0/1418735523 shutdown_connections 2024-09-12T03:01:54.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.007+0000 7ffac527b740 1 -- 172.21.15.18:0/1418735523 wait complete. 2024-09-12T03:01:54.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.007+0000 7ffac527b740 1 -- start start 2024-09-12T03:01:54.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.008+0000 7ffac527b740 1 Processor -- start 2024-09-12T03:01:54.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.011+0000 7ffac527b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b9131e0 0x560d0b91b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:54.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.011+0000 7ffac527b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 0x560d0b91b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:54.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.012+0000 7ffac527b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b91e3a0 0x560d0b91bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:54.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.012+0000 7ffabaa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b9131e0 0x560d0b91b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:54.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.012+0000 7ffabaa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b9131e0 0x560d0b91b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:46352/0 (socket says 172.21.15.18:46352) 2024-09-12T03:01:54.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.012+0000 7ffabb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 0x560d0b91b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:54.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.012+0000 7ffabb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 0x560d0b91b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54444/0 (socket says 172.21.15.18:54444) 2024-09-12T03:01:54.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.013+0000 7ffabaa00640 1 -- 172.21.15.18:0/880255166 learned_addr learned my addr 172.21.15.18:0/880255166 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:54.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.013+0000 7ffac527b740 1 -- 172.21.15.18:0/880255166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560d0b931f80 con 0x560d0b913b00 2024-09-12T03:01:54.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.013+0000 7ffac527b740 1 -- 172.21.15.18:0/880255166 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560d0b802090 con 0x560d0b91e3a0 2024-09-12T03:01:54.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.013+0000 7ffac527b740 1 -- 172.21.15.18:0/880255166 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x560d0b932100 con 0x560d0b9131e0 2024-09-12T03:01:54.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.013+0000 7ffac527b740 10 client.0 _ll_register_callbacks cb 0x560d0b856f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:01:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.014+0000 7ffabb400640 1 -- 172.21.15.18:0/880255166 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b9131e0 msgr2=0x560d0b91b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.014+0000 7ffabb400640 1 --2- 172.21.15.18:0/880255166 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b9131e0 0x560d0b91b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.014+0000 7ffabb400640 1 -- 172.21.15.18:0/880255166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b91e3a0 msgr2=0x560d0b91bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.014+0000 7ffabb400640 1 --2- 172.21.15.18:0/880255166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b91e3a0 0x560d0b91bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.015+0000 7ffabb400640 1 -- 172.21.15.18:0/880255166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d0b658620 con 0x560d0b913b00 2024-09-12T03:01:54.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.016+0000 7ffabb400640 1 --2- 172.21.15.18:0/880255166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 0x560d0b91b870 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ffaac000c00 tx=0x7ffaac0045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbfe4248b38aaee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:54.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.017+0000 7ffaa4c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T03:01:54.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.018+0000 7ffaa4c00640 1 -- 172.21.15.18:0/880255166 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0119a0 con 0x560d0b913b00 2024-09-12T03:01:54.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.018+0000 7ffaa4c00640 1 -- 172.21.15.18:0/880255166 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9654+0+0 (secure 0 0 0) 0x7ffaac011b40 con 0x560d0b913b00 2024-09-12T03:01:54.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.018+0000 7ffac527b740 1 -- 172.21.15.18:0/880255166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaac01cb00 con 0x560d0b913b00 2024-09-12T03:01:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.019+0000 7ffaa4c00640 1 -- 172.21.15.18:0/880255166 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7ffaac011d40 con 0x560d0b913b00 2024-09-12T03:01:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.019+0000 7ffac527b740 10 client.16029 fetch_fsmap learned FSMap version 71 2024-09-12T03:01:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.019+0000 7ffac527b740 1 -- 172.21.15.18:0/880255166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x560d0b93dce0 con 0x560d0b913b00 2024-09-12T03:01:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.020+0000 7ffaa4c00640 1 -- 172.21.15.18:0/880255166 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaac01cb00 con 0x560d0b913b00 2024-09-12T03:01:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.020+0000 7ffaa4c00640 1 -- 172.21.15.18:0/880255166 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 71) ==== 8450+0+0 (secure 0 0 0) 0x7ffaac0046c0 con 0x560d0b913b00 2024-09-12T03:01:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.020+0000 7ffac527b740 10 client.16029 fetch_fsmap finished waiting for FSMap version 71 2024-09-12T03:01:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.020+0000 7ffac527b740 10 client.16029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:01:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.020+0000 7ffac527b740 20 client.16029 populate_metadata read hostname 'smithi018' 2024-09-12T03:01:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.020+0000 7ffac527b740 1 --2- 172.21.15.18:0/880255166 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x560d0b93f150 0x560d0b941540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.020+0000 7ffac527b740 4 client.16029 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:01:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.020+0000 7ffac527b740 1 -- 172.21.15.18:0/880255166 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d0b886830 con 0x560d0b93f150 2024-09-12T03:01:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.021+0000 7ffabaa00640 1 --2- 172.21.15.18:0/880255166 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x560d0b93f150 0x560d0b941540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:54.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.024+0000 7ffabaa00640 1 --2- 172.21.15.18:0/880255166 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x560d0b93f150 0x560d0b941540 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a29e1848682290ce server_cookie=99ace71d66415034 in_seq=0 out_seq=0 2024-09-12T03:01:54.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.024+0000 7ffaa4c00640 10 client.16029 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:01:54.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.025+0000 7ffaa4c00640 1 -- 172.21.15.18:0/880255166 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560d0b886830 con 0x560d0b93f150 2024-09-12T03:01:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.025+0000 7ffaa4c00640 10 client.16029 handle_command_reply: tid=0 2024-09-12T03:01:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.025+0000 7ffac527b740 1 client.16029 shutdown 2024-09-12T03:01:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.026+0000 7ffac527b740 1 -- 172.21.15.18:0/880255166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 msgr2=0x560d0b91b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.026+0000 7ffac527b740 1 --2- 172.21.15.18:0/880255166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 0x560d0b91b870 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ffaac000c00 tx=0x7ffaac0045d0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.026+0000 7ffac527b740 1 -- 172.21.15.18:0/880255166 shutdown_connections 2024-09-12T03:01:54.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.026+0000 7ffac527b740 1 --2- 172.21.15.18:0/880255166 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x560d0b93f150 0x560d0b941540 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.026+0000 7ffac527b740 1 --2- 172.21.15.18:0/880255166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b91e3a0 0x560d0b91bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.026+0000 7ffac527b740 1 --2- 172.21.15.18:0/880255166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 0x560d0b91b870 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.026+0000 7ffaa4c00640 0 client.16029 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:01:54.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.026+0000 7ffac527b740 1 --2- 172.21.15.18:0/880255166 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b9131e0 0x560d0b91b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.026+0000 7ffac527b740 1 -- 172.21.15.18:0/880255166 >> 172.21.15.18:0/880255166 conn(0x560d0b90f750 msgr2=0x560d0b9154b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:54.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.026+0000 7ffac527b740 1 -- 172.21.15.18:0/880255166 shutdown_connections 2024-09-12T03:01:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.026+0000 7ffac527b740 1 -- 172.21.15.18:0/880255166 wait complete. 2024-09-12T03:01:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.027+0000 7ffac527b740 20 client.16029 trim_cache size 0 max 16384 2024-09-12T03:01:54.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.057+0000 7ffac527b740 1 Processor -- start 2024-09-12T03:01:54.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.057+0000 7ffac527b740 1 -- start start 2024-09-12T03:01:54.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.058+0000 7ffac527b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b9131e0 0x560d0b91bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:54.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.058+0000 7ffac527b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 0x560d0b946bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:54.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.058+0000 7ffac527b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b91e3a0 0x560d0b947110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:54.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.058+0000 7ffac527b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1b57a0 con 0x560d0b913b00 2024-09-12T03:01:54.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.058+0000 7ffac527b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1b75e0 con 0x560d0b9131e0 2024-09-12T03:01:54.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.058+0000 7ffac527b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1b5f30 con 0x560d0b91e3a0 2024-09-12T03:01:54.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.059+0000 7ffabaa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b91e3a0 0x560d0b947110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:54.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.059+0000 7ffabaa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b91e3a0 0x560d0b947110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:46356/0 (socket says 172.21.15.18:46356) 2024-09-12T03:01:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.059+0000 7ffabaa00640 1 -- 172.21.15.18:0/1162316611 learned_addr learned my addr 172.21.15.18:0/1162316611 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.059+0000 7ffabb400640 1 --2- 172.21.15.18:0/1162316611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 0x560d0b946bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.060+0000 7ffabaa00640 1 --2- 172.21.15.18:0/1162316611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b9131e0 0x560d0b91bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.062+0000 7ffabaa00640 1 -- 172.21.15.18:0/1162316611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b9131e0 msgr2=0x560d0b91bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.062+0000 7ffabaa00640 1 --2- 172.21.15.18:0/1162316611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b9131e0 0x560d0b91bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.062+0000 7ffabaa00640 1 -- 172.21.15.18:0/1162316611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 msgr2=0x560d0b946bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.063+0000 7ffabaa00640 1 --2- 172.21.15.18:0/1162316611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 0x560d0b946bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.063+0000 7ffabaa00640 1 -- 172.21.15.18:0/1162316611 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d0b90ad60 con 0x560d0b91e3a0 2024-09-12T03:01:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.066+0000 7ffabaa00640 1 --2- 172.21.15.18:0/1162316611 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b91e3a0 0x560d0b947110 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009890 tx=0x7ffaa8000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c717c604b75c169 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:54.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.069+0000 7ffaa7400640 1 -- 172.21.15.18:0/1162316611 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa804f070 con 0x560d0b91e3a0 2024-09-12T03:01:54.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.069+0000 7ffaa7400640 1 -- 172.21.15.18:0/1162316611 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaa8038040 con 0x560d0b91e3a0 2024-09-12T03:01:54.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.069+0000 7ffaa7400640 1 -- 172.21.15.18:0/1162316611 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8037040 con 0x560d0b91e3a0 2024-09-12T03:01:54.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.070+0000 7ffac527b740 1 -- 172.21.15.18:0/1162316611 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b91e3a0 msgr2=0x560d0b947110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:54.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.070+0000 7ffac527b740 1 --2- 172.21.15.18:0/1162316611 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b91e3a0 0x560d0b947110 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009890 tx=0x7ffaa8000bc0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.070+0000 7ffac527b740 1 -- 172.21.15.18:0/1162316611 shutdown_connections 2024-09-12T03:01:54.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.070+0000 7ffac527b740 1 --2- 172.21.15.18:0/1162316611 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b91e3a0 0x560d0b947110 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.070+0000 7ffac527b740 1 --2- 172.21.15.18:0/1162316611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b913b00 0x560d0b946bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.070+0000 7ffac527b740 1 --2- 172.21.15.18:0/1162316611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b9131e0 0x560d0b91bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.070+0000 7ffac527b740 1 -- 172.21.15.18:0/1162316611 >> 172.21.15.18:0/1162316611 conn(0x560d0b90f750 msgr2=0x560d0b91d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:54.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.070+0000 7ffac527b740 1 -- 172.21.15.18:0/1162316611 shutdown_connections 2024-09-12T03:01:54.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.070+0000 7ffac527b740 1 -- 172.21.15.18:0/1162316611 wait complete. 2024-09-12T03:01:54.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.071+0000 7ffac527b740 1 -- start start 2024-09-12T03:01:54.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.071+0000 7ffac527b740 1 Processor -- start 2024-09-12T03:01:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.072+0000 7ffac527b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b9131e0 0x560d0b932470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.072+0000 7ffac527b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b913b00 0x560d0b9329b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.072+0000 7ffac527b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b91e3a0 0x560d0b9a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.072+0000 7ffac527b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1b6e50 con 0x560d0b91e3a0 2024-09-12T03:01:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.072+0000 7ffac527b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1b66c0 con 0x560d0b913b00 2024-09-12T03:01:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.072+0000 7ffac527b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc072fd0 con 0x560d0b9131e0 2024-09-12T03:01:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.072+0000 7ffac527b740 10 client.0 _ll_register_callbacks cb 0x7ffaac009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:01:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.072+0000 7ffabaa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b9131e0 0x560d0b932470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.072+0000 7ffabb400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b913b00 0x560d0b9329b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.073+0000 7ffabb400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b913b00 0x560d0b9329b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:45278/0 (socket says 172.21.15.18:45278) 2024-09-12T03:01:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.073+0000 7ffabb400640 1 -- 172.21.15.18:0/3894809856 learned_addr learned my addr 172.21.15.18:0/3894809856 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:01:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.074+0000 7ffabaa00640 1 --2- 172.21.15.18:0/3894809856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b91e3a0 0x560d0b9a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.075+0000 7ffabaa00640 1 -- 172.21.15.18:0/3894809856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b913b00 msgr2=0x560d0b9329b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.075+0000 7ffabaa00640 1 --2- 172.21.15.18:0/3894809856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b913b00 0x560d0b9329b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.075+0000 7ffabaa00640 1 -- 172.21.15.18:0/3894809856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b91e3a0 msgr2=0x560d0b9a7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.075+0000 7ffabaa00640 1 --2- 172.21.15.18:0/3894809856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b91e3a0 0x560d0b9a7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.075+0000 7ffabaa00640 1 -- 172.21.15.18:0/3894809856 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d0b9a80d0 con 0x560d0b9131e0 2024-09-12T03:01:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.075+0000 7ffabaa00640 1 --2- 172.21.15.18:0/3894809856 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b9131e0 0x560d0b932470 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8035040 tx=0x7ffaa8009450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=192f8a0c9b62ea3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.075+0000 7ffaa4c00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T03:01:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.075+0000 7ffaa4c00640 1 -- 172.21.15.18:0/3894809856 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8037070 con 0x560d0b9131e0 2024-09-12T03:01:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.075+0000 7ffaa4c00640 1 -- 172.21.15.18:0/3894809856 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9654+0+0 (secure 0 0 0) 0x7ffaa8003b10 con 0x560d0b9131e0 2024-09-12T03:01:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.076+0000 7ffac527b740 1 -- 172.21.15.18:0/3894809856 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaa8038040 con 0x560d0b9131e0 2024-09-12T03:01:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.076+0000 7ffaa4c00640 1 -- 172.21.15.18:0/3894809856 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7ffaa804f040 con 0x560d0b9131e0 2024-09-12T03:01:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.076+0000 7ffac527b740 10 client.26065 fetch_fsmap learned FSMap version 71 2024-09-12T03:01:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.076+0000 7ffac527b740 1 -- 172.21.15.18:0/3894809856 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x560d0b9a9280 con 0x560d0b9131e0 2024-09-12T03:01:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.077+0000 7ffaa4c00640 1 -- 172.21.15.18:0/3894809856 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaa8038040 con 0x560d0b9131e0 2024-09-12T03:01:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.077+0000 7ffaa4c00640 1 -- 172.21.15.18:0/3894809856 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 71) ==== 8450+0+0 (secure 0 0 0) 0x7ffaa8047050 con 0x560d0b9131e0 2024-09-12T03:01:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.077+0000 7ffac527b740 10 client.26065 fetch_fsmap finished waiting for FSMap version 71 2024-09-12T03:01:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.077+0000 7ffac527b740 10 client.26065 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:01:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.078+0000 7ffac527b740 20 client.26065 populate_metadata read hostname 'smithi018' 2024-09-12T03:01:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.078+0000 7ffac527b740 1 --2- 172.21.15.18:0/3894809856 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x560d0b9a9980 0x560d0b9abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.078+0000 7ffac527b740 4 client.26065 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T03:01:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.078+0000 7ffac527b740 1 -- 172.21.15.18:0/3894809856 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d0b880b80 con 0x560d0b9a9980 2024-09-12T03:01:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.084+0000 7ffabb400640 1 --2- 172.21.15.18:0/3894809856 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x560d0b9a9980 0x560d0b9abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:54.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.086+0000 7ffabb400640 1 --2- 172.21.15.18:0/3894809856 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x560d0b9a9980 0x560d0b9abda0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=748593ac892fb521 server_cookie=fb8f490289cb3665 in_seq=0 out_seq=0 2024-09-12T03:01:54.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.086+0000 7ffaa4c00640 10 client.26065 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:01:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.178+0000 7ffaa4c00640 1 -- 172.21.15.18:0/3894809856 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d0b880b80 con 0x560d0b9a9980 2024-09-12T03:01:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.178+0000 7ffaa4c00640 10 client.26065 handle_command_reply: tid=0 2024-09-12T03:01:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.178+0000 7ffac527b740 1 client.26065 shutdown 2024-09-12T03:01:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.178+0000 7ffac527b740 1 -- 172.21.15.18:0/3894809856 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b9131e0 msgr2=0x560d0b932470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.178+0000 7ffac527b740 1 --2- 172.21.15.18:0/3894809856 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b9131e0 0x560d0b932470 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8035040 tx=0x7ffaa8009450 comp rx=0 tx=0).stop 2024-09-12T03:01:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.179+0000 7ffac527b740 1 -- 172.21.15.18:0/3894809856 shutdown_connections 2024-09-12T03:01:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.179+0000 7ffac527b740 1 --2- 172.21.15.18:0/3894809856 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x560d0b9a9980 0x560d0b9abda0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.179+0000 7ffac527b740 1 --2- 172.21.15.18:0/3894809856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d0b91e3a0 0x560d0b9a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.179+0000 7ffac527b740 1 --2- 172.21.15.18:0/3894809856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560d0b913b00 0x560d0b9329b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.179+0000 7ffac527b740 1 --2- 172.21.15.18:0/3894809856 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560d0b9131e0 0x560d0b932470 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.179+0000 7ffac527b740 1 -- 172.21.15.18:0/3894809856 >> 172.21.15.18:0/3894809856 conn(0x560d0b90f750 msgr2=0x560d0b919ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.179+0000 7ffaa4c00640 0 client.26065 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:01:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.179+0000 7ffac527b740 1 -- 172.21.15.18:0/3894809856 shutdown_connections 2024-09-12T03:01:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.179+0000 7ffac527b740 1 -- 172.21.15.18:0/3894809856 wait complete. 2024-09-12T03:01:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.179+0000 7ffac527b740 20 client.26065 trim_cache size 0 max 16384 2024-09-12T03:01:54.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T03:01:54.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T03:01:54.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T03:01:54.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T03:01:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.181+0000 7ffac2200640 1 -- 172.21.15.18:0/2975735764 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ffaa00a2e20 msgr2=0x7ffaa00a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.181+0000 7ffac2200640 1 --2- 172.21.15.18:0/2975735764 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ffaa00a2e20 0x7ffaa00a52e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffab40cca80 tx=0x7ffab400bea0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.181+0000 7ffac2200640 1 -- 172.21.15.18:0/2975735764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffabc106b10 msgr2=0x7ffabc10da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.181+0000 7ffac2200640 1 --2- 172.21.15.18:0/2975735764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffabc106b10 0x7ffabc10da80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009fd0 tx=0x7ffab400b260 comp rx=0 tx=0).stop 2024-09-12T03:01:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.181+0000 7ffac2200640 1 -- 172.21.15.18:0/2975735764 shutdown_connections 2024-09-12T03:01:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.181+0000 7ffac2200640 1 --2- 172.21.15.18:0/2975735764 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ffaa00a2e20 0x7ffaa00a52e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.181+0000 7ffac2200640 1 --2- 172.21.15.18:0/2975735764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffabc106b10 0x7ffabc10da80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.181+0000 7ffac2200640 1 --2- 172.21.15.18:0/2975735764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffabc100520 0x7ffabc19f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.181+0000 7ffac2200640 1 --2- 172.21.15.18:0/2975735764 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffabc0ffb80 0x7ffabc19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:54.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.181+0000 7ffac2200640 1 -- 172.21.15.18:0/2975735764 >> 172.21.15.18:0/2975735764 conn(0x7ffabc0fba30 msgr2=0x7ffabc0fbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:54.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.181+0000 7ffac2200640 1 -- 172.21.15.18:0/2975735764 shutdown_connections 2024-09-12T03:01:54.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:01:54.181+0000 7ffac2200640 1 -- 172.21.15.18:0/2975735764 wait complete. 2024-09-12T03:01:55.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:54 smithi176 ceph-mon[35713]: pgmap v411: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 140 op/s 2024-09-12T03:01:55.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:54 smithi062 ceph-mon[35527]: pgmap v411: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 140 op/s 2024-09-12T03:01:55.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:54 smithi018 ceph-mon[30616]: pgmap v411: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 140 op/s 2024-09-12T03:01:57.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:56 smithi176 ceph-mon[35713]: pgmap v412: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 183 op/s 2024-09-12T03:01:57.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:56 smithi062 ceph-mon[35527]: pgmap v412: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 183 op/s 2024-09-12T03:01:57.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:56 smithi018 ceph-mon[30616]: pgmap v412: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 183 op/s 2024-09-12T03:01:59.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:01:58 smithi176 ceph-mon[35713]: pgmap v413: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 147 op/s 2024-09-12T03:01:59.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:01:58 smithi062 ceph-mon[35527]: pgmap v413: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 147 op/s 2024-09-12T03:01:59.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:01:58 smithi018 ceph-mon[30616]: pgmap v413: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 147 op/s 2024-09-12T03:02:01.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:00 smithi018 ceph-mon[30616]: pgmap v414: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 133 op/s 2024-09-12T03:02:01.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:00 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T03:02:01.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:00 smithi176 ceph-mon[35713]: pgmap v414: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 133 op/s 2024-09-12T03:02:01.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:00 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T03:02:01.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:00 smithi062 ceph-mon[35527]: pgmap v414: 129 pgs: 54 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 56 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 133 op/s 2024-09-12T03:02:01.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:00 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T03:02:03.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:02 smithi176 ceph-mon[35713]: pgmap v415: 129 pgs: 54 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 57 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 181 op/s 2024-09-12T03:02:03.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:02 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T03:02:03.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:02 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T03:02:03.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:02 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T03:02:03.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:02 smithi062 ceph-mon[35527]: pgmap v415: 129 pgs: 54 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 57 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 181 op/s 2024-09-12T03:02:03.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:02 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T03:02:03.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:02 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T03:02:03.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:02 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T03:02:03.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:02 smithi018 ceph-mon[30616]: pgmap v415: 129 pgs: 54 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 57 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 181 op/s 2024-09-12T03:02:03.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:02 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T03:02:03.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:02 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T03:02:03.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:02 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T03:02:05.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:04 smithi176 ceph-mon[35713]: pgmap v416: 129 pgs: 48 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 64 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 119 op/s 2024-09-12T03:02:05.229 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:04 smithi018 ceph-mon[30616]: pgmap v416: 129 pgs: 48 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 64 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 119 op/s 2024-09-12T03:02:05.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:04 smithi062 ceph-mon[35527]: pgmap v416: 129 pgs: 48 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 64 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 119 op/s 2024-09-12T03:02:07.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:06 smithi176 ceph-mon[35713]: pgmap v417: 129 pgs: 48 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 65 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 192 op/s 2024-09-12T03:02:07.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:06 smithi062 ceph-mon[35527]: pgmap v417: 129 pgs: 48 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 65 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 192 op/s 2024-09-12T03:02:07.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:06 smithi018 ceph-mon[30616]: pgmap v417: 129 pgs: 48 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 65 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 192 op/s 2024-09-12T03:02:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.504+0000 7f3369a00640 1 -- 172.21.15.18:0/3842322698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3364101ac0 msgr2=0x7f3364101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.504+0000 7f3369a00640 1 --2- 172.21.15.18:0/3842322698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3364101ac0 0x7f3364101f20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f335400fb10 tx=0x7f335402e570 comp rx=0 tx=0).stop 2024-09-12T03:02:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.505+0000 7f3369a00640 1 -- 172.21.15.18:0/3842322698 shutdown_connections 2024-09-12T03:02:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.505+0000 7f3369a00640 1 --2- 172.21.15.18:0/3842322698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3364102460 0x7f336410e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.505+0000 7f3369a00640 1 --2- 172.21.15.18:0/3842322698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3364101ac0 0x7f3364101f20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.505+0000 7f3369a00640 1 --2- 172.21.15.18:0/3842322698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3364107ad0 0x7f3364107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.505+0000 7f3369a00640 1 -- 172.21.15.18:0/3842322698 >> 172.21.15.18:0/3842322698 conn(0x7f33640fd7e0 msgr2=0x7f33640ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.505+0000 7f3369a00640 1 -- 172.21.15.18:0/3842322698 shutdown_connections 2024-09-12T03:02:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.505+0000 7f3369a00640 1 -- 172.21.15.18:0/3842322698 wait complete. 2024-09-12T03:02:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.506+0000 7f3369a00640 1 Processor -- start 2024-09-12T03:02:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.507+0000 7f3369a00640 1 -- start start 2024-09-12T03:02:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.507+0000 7f3369a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3364101ac0 0x7f3364196140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.507+0000 7f3369a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3364102460 0x7f3364196680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.507+0000 7f3369a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3364107ad0 0x7f336419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.507+0000 7f3369a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f336410fd70 con 0x7f3364101ac0 2024-09-12T03:02:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.507+0000 7f3369a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f336410fbf0 con 0x7f3364102460 2024-09-12T03:02:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.507+0000 7f3369a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f336410fef0 con 0x7f3364107ad0 2024-09-12T03:02:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.508+0000 7f3362000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3364102460 0x7f3364196680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.508+0000 7f3363400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3364107ad0 0x7f336419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.508+0000 7f3363400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3364107ad0 0x7f336419aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:33352/0 (socket says 172.21.15.18:33352) 2024-09-12T03:02:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.508+0000 7f3363400640 1 -- 172.21.15.18:0/427548899 learned_addr learned my addr 172.21.15.18:0/427548899 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.508+0000 7f3362a00640 1 --2- 172.21.15.18:0/427548899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3364101ac0 0x7f3364196140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.508+0000 7f3363400640 1 -- 172.21.15.18:0/427548899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3364102460 msgr2=0x7f3364196680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.508+0000 7f3363400640 1 --2- 172.21.15.18:0/427548899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3364102460 0x7f3364196680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.508+0000 7f3363400640 1 -- 172.21.15.18:0/427548899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3364101ac0 msgr2=0x7f3364196140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.508+0000 7f3363400640 1 --2- 172.21.15.18:0/427548899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3364101ac0 0x7f3364196140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.508+0000 7f3363400640 1 -- 172.21.15.18:0/427548899 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336419b130 con 0x7f3364107ad0 2024-09-12T03:02:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.509+0000 7f3363400640 1 --2- 172.21.15.18:0/427548899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3364107ad0 0x7f336419aa00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f335c00eb10 tx=0x7f335c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.509+0000 7f335b400640 1 -- 172.21.15.18:0/427548899 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c004b20 con 0x7f3364107ad0 2024-09-12T03:02:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.510+0000 7f335b400640 1 -- 172.21.15.18:0/427548899 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f335c004cc0 con 0x7f3364107ad0 2024-09-12T03:02:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.510+0000 7f335b400640 1 -- 172.21.15.18:0/427548899 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c010790 con 0x7f3364107ad0 2024-09-12T03:02:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.510+0000 7f3369a00640 1 -- 172.21.15.18:0/427548899 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f336419b420 con 0x7f3364107ad0 2024-09-12T03:02:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.510+0000 7f3369a00640 1 -- 172.21.15.18:0/427548899 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33641a2cb0 con 0x7f3364107ad0 2024-09-12T03:02:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.515+0000 7f336c88c740 1 Processor -- start 2024-09-12T03:02:07.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.518+0000 7f335b400640 1 -- 172.21.15.18:0/427548899 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f335c005020 con 0x7f3364107ad0 2024-09-12T03:02:07.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.520+0000 7f335b400640 1 --2- 172.21.15.18:0/427548899 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f33480a2e20 0x7f33480a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.520+0000 7f335b400640 1 -- 172.21.15.18:0/427548899 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9654+0+0 (secure 0 0 0) 0x7f335c09a070 con 0x7f3364107ad0 2024-09-12T03:02:07.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.521+0000 7f336c88c740 1 -- start start 2024-09-12T03:02:07.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.521+0000 7f3362000640 1 --2- 172.21.15.18:0/427548899 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f33480a2e20 0x7f33480a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.522+0000 7f336c88c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 0x55a4d6c16dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.522+0000 7f336c88c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c17310 0x55a4d6c21670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.522+0000 7f336c88c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c23fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.522+0000 7f3362a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 0x55a4d6c16dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.522+0000 7f3362a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 0x55a4d6c16dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:59648/0 (socket says 172.21.15.18:59648) 2024-09-12T03:02:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.523+0000 7f3362000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c17310 0x55a4d6c21670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.523+0000 7f3362000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c17310 0x55a4d6c21670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:33366/0 (socket says 172.21.15.18:33366) 2024-09-12T03:02:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.523+0000 7f3363400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c23fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.523+0000 7f336c88c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a4d6b74100 con 0x55a4d6c21bb0 2024-09-12T03:02:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.523+0000 7f336c88c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a4d6b1c1b0 con 0x55a4d6c169f0 2024-09-12T03:02:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.523+0000 7f336c88c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55a4d6b700c0 con 0x55a4d6c17310 2024-09-12T03:02:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.523+0000 7f3363400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c23fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47362/0 (socket says 172.21.15.18:47362) 2024-09-12T03:02:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.523+0000 7f3363400640 1 -- 172.21.15.18:0/965121525 learned_addr learned my addr 172.21.15.18:0/965121525 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.524+0000 7f3363400640 1 -- 172.21.15.18:0/965121525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c17310 msgr2=0x55a4d6c21670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.524+0000 7f3363400640 1 --2- 172.21.15.18:0/965121525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c17310 0x55a4d6c21670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.524+0000 7f3363400640 1 -- 172.21.15.18:0/965121525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 msgr2=0x55a4d6c16dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.524+0000 7f3363400640 1 --2- 172.21.15.18:0/965121525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 0x55a4d6c16dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.524+0000 7f3363400640 1 -- 172.21.15.18:0/965121525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4d6887210 con 0x55a4d6c21bb0 2024-09-12T03:02:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.525+0000 7f3362000640 1 --2- 172.21.15.18:0/427548899 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f33480a2e20 0x7f33480a52e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f33640ffce0 tx=0x7f335400ee00 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.525+0000 7f3363400640 1 --2- 172.21.15.18:0/965121525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c23fa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f335c0a4710 tx=0x7f335c0a14a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b875167b3c7248c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.526+0000 7f3353e00640 1 -- 172.21.15.18:0/965121525 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c098a00 con 0x55a4d6c21bb0 2024-09-12T03:02:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.526+0000 7f3353e00640 1 -- 172.21.15.18:0/965121525 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f335c01ee50 con 0x55a4d6c21bb0 2024-09-12T03:02:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.526+0000 7f3353e00640 1 -- 172.21.15.18:0/965121525 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c098ba0 con 0x55a4d6c21bb0 2024-09-12T03:02:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.530+0000 7f336c88c740 1 -- 172.21.15.18:0/965121525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 msgr2=0x55a4d6c23fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.530+0000 7f336c88c740 1 --2- 172.21.15.18:0/965121525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c23fa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f335c0a4710 tx=0x7f335c0a14a0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.531+0000 7f336c88c740 1 -- 172.21.15.18:0/965121525 shutdown_connections 2024-09-12T03:02:07.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.531+0000 7f336c88c740 1 --2- 172.21.15.18:0/965121525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c23fa0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.531+0000 7f336c88c740 1 --2- 172.21.15.18:0/965121525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c17310 0x55a4d6c21670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.531+0000 7f336c88c740 1 --2- 172.21.15.18:0/965121525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 0x55a4d6c16dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.531+0000 7f336c88c740 1 -- 172.21.15.18:0/965121525 >> 172.21.15.18:0/965121525 conn(0x55a4d6c12f60 msgr2=0x55a4d6c13340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.532+0000 7f336c88c740 1 -- 172.21.15.18:0/965121525 shutdown_connections 2024-09-12T03:02:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.532+0000 7f336c88c740 1 -- 172.21.15.18:0/965121525 wait complete. 2024-09-12T03:02:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.532+0000 7f336c88c740 1 -- start start 2024-09-12T03:02:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.533+0000 7f336c88c740 1 Processor -- start 2024-09-12T03:02:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.533+0000 7f336c88c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 0x55a4d6c1eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.533+0000 7f336c88c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c17310 0x55a4d6c1f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.533+0000 7f336c88c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c1f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.533+0000 7f336c88c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a4d6c246f0 con 0x55a4d6c21bb0 2024-09-12T03:02:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.533+0000 7f336c88c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a4d6afd090 con 0x55a4d6c169f0 2024-09-12T03:02:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.533+0000 7f336c88c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55a4d6c24870 con 0x55a4d6c17310 2024-09-12T03:02:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.534+0000 7f336c88c740 10 client.0 _ll_register_callbacks cb 0x55a4d6b51f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:02:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.534+0000 7f3363400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c1f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.534+0000 7f3363400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c1f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47370/0 (socket says 172.21.15.18:47370) 2024-09-12T03:02:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.534+0000 7f3363400640 1 -- 172.21.15.18:0/3102397454 learned_addr learned my addr 172.21.15.18:0/3102397454 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.534+0000 7f3362a00640 1 --2- 172.21.15.18:0/3102397454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 0x55a4d6c1eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.535+0000 7f3362000640 1 --2- 172.21.15.18:0/3102397454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c17310 0x55a4d6c1f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.535+0000 7f3363400640 1 -- 172.21.15.18:0/3102397454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c17310 msgr2=0x55a4d6c1f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.535+0000 7f3363400640 1 --2- 172.21.15.18:0/3102397454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c17310 0x55a4d6c1f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.535+0000 7f3363400640 1 -- 172.21.15.18:0/3102397454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 msgr2=0x55a4d6c1eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.535+0000 7f3363400640 1 --2- 172.21.15.18:0/3102397454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 0x55a4d6c1eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.535+0000 7f3363400640 1 -- 172.21.15.18:0/3102397454 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4d6953620 con 0x55a4d6c21bb0 2024-09-12T03:02:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.536+0000 7f3363400640 1 --2- 172.21.15.18:0/3102397454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c1f580 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f335c099250 tx=0x7f335c09a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91925f63fb221fc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.536+0000 7f3350c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T03:02:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.536+0000 7f3350c00640 1 -- 172.21.15.18:0/3102397454 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c098d40 con 0x55a4d6c21bb0 2024-09-12T03:02:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.536+0000 7f3350c00640 1 -- 172.21.15.18:0/3102397454 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9654+0+0 (secure 0 0 0) 0x7f335c09bb10 con 0x55a4d6c21bb0 2024-09-12T03:02:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.536+0000 7f336c88c740 1 -- 172.21.15.18:0/3102397454 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f335c01ee50 con 0x55a4d6c21bb0 2024-09-12T03:02:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.537+0000 7f3350c00640 1 -- 172.21.15.18:0/3102397454 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f335c098f10 con 0x55a4d6c21bb0 2024-09-12T03:02:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.537+0000 7f336c88c740 10 client.16047 fetch_fsmap learned FSMap version 71 2024-09-12T03:02:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.537+0000 7f336c88c740 1 -- 172.21.15.18:0/3102397454 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55a4d6c413c0 con 0x55a4d6c21bb0 2024-09-12T03:02:07.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.538+0000 7f3350c00640 1 -- 172.21.15.18:0/3102397454 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f335c01ee50 con 0x55a4d6c21bb0 2024-09-12T03:02:07.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.538+0000 7f3350c00640 1 -- 172.21.15.18:0/3102397454 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 71) ==== 8450+0+0 (secure 0 0 0) 0x7f335c0a2b70 con 0x55a4d6c21bb0 2024-09-12T03:02:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.538+0000 7f336c88c740 10 client.16047 fetch_fsmap finished waiting for FSMap version 71 2024-09-12T03:02:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.538+0000 7f336c88c740 10 client.16047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:02:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.538+0000 7f336c88c740 20 client.16047 populate_metadata read hostname 'smithi018' 2024-09-12T03:02:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.538+0000 7f336c88c740 1 --2- 172.21.15.18:0/3102397454 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a4d6c42710 0x55a4d6c44b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.538+0000 7f336c88c740 4 client.16047 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:02:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.538+0000 7f336c88c740 1 -- 172.21.15.18:0/3102397454 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4d6b81830 con 0x55a4d6c42710 2024-09-12T03:02:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.539+0000 7f3362a00640 1 --2- 172.21.15.18:0/3102397454 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a4d6c42710 0x55a4d6c44b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.539+0000 7f3362a00640 1 --2- 172.21.15.18:0/3102397454 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a4d6c42710 0x55a4d6c44b00 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c480f06ec874876 server_cookie=8c85a25900b6d469 in_seq=0 out_seq=0 2024-09-12T03:02:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.539+0000 7f3350c00640 10 client.16047 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:02:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.540+0000 7f3350c00640 1 -- 172.21.15.18:0/3102397454 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a4d6b81830 con 0x55a4d6c42710 2024-09-12T03:02:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.541+0000 7f3350c00640 10 client.16047 handle_command_reply: tid=0 2024-09-12T03:02:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.541+0000 7f336c88c740 1 client.16047 shutdown 2024-09-12T03:02:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.541+0000 7f336c88c740 1 -- 172.21.15.18:0/3102397454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 msgr2=0x55a4d6c1f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:07.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.541+0000 7f336c88c740 1 --2- 172.21.15.18:0/3102397454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c1f580 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f335c099250 tx=0x7f335c09a4e0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.542+0000 7f336c88c740 1 -- 172.21.15.18:0/3102397454 shutdown_connections 2024-09-12T03:02:07.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.542+0000 7f336c88c740 1 --2- 172.21.15.18:0/3102397454 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a4d6c42710 0x55a4d6c44b00 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.542+0000 7f336c88c740 1 --2- 172.21.15.18:0/3102397454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c1f580 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.542+0000 7f3350c00640 0 client.16047 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:02:07.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.542+0000 7f336c88c740 1 --2- 172.21.15.18:0/3102397454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c17310 0x55a4d6c1f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.542+0000 7f336c88c740 1 --2- 172.21.15.18:0/3102397454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 0x55a4d6c1eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.542+0000 7f336c88c740 1 -- 172.21.15.18:0/3102397454 >> 172.21.15.18:0/3102397454 conn(0x55a4d6c12f60 msgr2=0x55a4d6c18cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.542+0000 7f336c88c740 1 -- 172.21.15.18:0/3102397454 shutdown_connections 2024-09-12T03:02:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.542+0000 7f336c88c740 1 -- 172.21.15.18:0/3102397454 wait complete. 2024-09-12T03:02:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.543+0000 7f336c88c740 20 client.16047 trim_cache size 0 max 16384 2024-09-12T03:02:07.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.573+0000 7f336c88c740 1 Processor -- start 2024-09-12T03:02:07.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.573+0000 7f336c88c740 1 -- start start 2024-09-12T03:02:07.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.574+0000 7f336c88c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 0x55a4d6c1da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.574+0000 7f336c88c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c17310 0x55a4d6c19480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.574+0000 7f336c88c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c1f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.574+0000 7f336c88c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33641a4870 con 0x55a4d6c21bb0 2024-09-12T03:02:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.574+0000 7f336c88c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f33641a66b0 con 0x55a4d6c169f0 2024-09-12T03:02:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.574+0000 7f336c88c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f33641a5000 con 0x55a4d6c17310 2024-09-12T03:02:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.575+0000 7f3362a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 0x55a4d6c1da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.575+0000 7f3362a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 0x55a4d6c1da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:59660/0 (socket says 172.21.15.18:59660) 2024-09-12T03:02:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.575+0000 7f3362a00640 1 -- 172.21.15.18:0/1587971627 learned_addr learned my addr 172.21.15.18:0/1587971627 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.575+0000 7f3362a00640 1 -- 172.21.15.18:0/1587971627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c17310 msgr2=0x55a4d6c19480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T03:02:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.575+0000 7f3362a00640 1 --2- 172.21.15.18:0/1587971627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c17310 0x55a4d6c19480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.575+0000 7f3362a00640 1 -- 172.21.15.18:0/1587971627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 msgr2=0x55a4d6c1f3b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T03:02:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.575+0000 7f3362a00640 1 --2- 172.21.15.18:0/1587971627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c1f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.575+0000 7f3362a00640 1 -- 172.21.15.18:0/1587971627 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4d6c05d60 con 0x55a4d6c169f0 2024-09-12T03:02:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.576+0000 7f3362a00640 1 --2- 172.21.15.18:0/1587971627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 0x55a4d6c1da20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f334c009b60 tx=0x7f334c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92a638e07329b45d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:07.577 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.576+0000 7f3353400640 1 -- 172.21.15.18:0/1587971627 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c004250 con 0x55a4d6c169f0 2024-09-12T03:02:07.577 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.576+0000 7f3353400640 1 -- 172.21.15.18:0/1587971627 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f334c0043f0 con 0x55a4d6c169f0 2024-09-12T03:02:07.577 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.576+0000 7f3353400640 1 -- 172.21.15.18:0/1587971627 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c01fa60 con 0x55a4d6c169f0 2024-09-12T03:02:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.577+0000 7f336c88c740 1 -- 172.21.15.18:0/1587971627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 msgr2=0x55a4d6c1da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.577+0000 7f336c88c740 1 --2- 172.21.15.18:0/1587971627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 0x55a4d6c1da20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f334c009b60 tx=0x7f334c005f90 comp rx=0 tx=0).stop 2024-09-12T03:02:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.578+0000 7f336c88c740 1 -- 172.21.15.18:0/1587971627 shutdown_connections 2024-09-12T03:02:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.578+0000 7f336c88c740 1 --2- 172.21.15.18:0/1587971627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c1f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.578+0000 7f336c88c740 1 --2- 172.21.15.18:0/1587971627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c17310 0x55a4d6c19480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.578+0000 7f336c88c740 1 --2- 172.21.15.18:0/1587971627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c169f0 0x55a4d6c1da20 secure :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f334c009b60 tx=0x7f334c005f90 comp rx=0 tx=0).stop 2024-09-12T03:02:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.578+0000 7f336c88c740 1 -- 172.21.15.18:0/1587971627 >> 172.21.15.18:0/1587971627 conn(0x55a4d6c12f60 msgr2=0x55a4d6c20250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.580+0000 7f336c88c740 1 -- 172.21.15.18:0/1587971627 shutdown_connections 2024-09-12T03:02:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.580+0000 7f336c88c740 1 -- 172.21.15.18:0/1587971627 wait complete. 2024-09-12T03:02:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.580+0000 7f336c88c740 1 -- start start 2024-09-12T03:02:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.581+0000 7f336c88c740 1 Processor -- start 2024-09-12T03:02:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.582+0000 7f336c88c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c17310 0x55a4d6c25080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.582+0000 7f336c88c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c255c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.582+0000 7f336c88c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c42710 0x55a4d6ca50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.582+0000 7f336c88c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33641a5f20 con 0x55a4d6c21bb0 2024-09-12T03:02:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.582+0000 7f336c88c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f33641a5790 con 0x55a4d6c17310 2024-09-12T03:02:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.582+0000 7f336c88c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3364103250 con 0x55a4d6c42710 2024-09-12T03:02:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.582+0000 7f336c88c740 10 client.0 _ll_register_callbacks cb 0x7f334c009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:02:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.583+0000 7f3363400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c42710 0x55a4d6ca50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.583+0000 7f3363400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c42710 0x55a4d6ca50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:33392/0 (socket says 172.21.15.18:33392) 2024-09-12T03:02:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.583+0000 7f3363400640 1 -- 172.21.15.18:0/1216912136 learned_addr learned my addr 172.21.15.18:0/1216912136 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.583+0000 7f3362a00640 1 --2- 172.21.15.18:0/1216912136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c17310 0x55a4d6c25080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.583+0000 7f3363400640 1 -- 172.21.15.18:0/1216912136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c17310 msgr2=0x55a4d6c25080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.583+0000 7f3363400640 1 --2- 172.21.15.18:0/1216912136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c17310 0x55a4d6c25080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.583+0000 7f3362000640 1 --2- 172.21.15.18:0/1216912136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c255c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.583+0000 7f3363400640 1 -- 172.21.15.18:0/1216912136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 msgr2=0x55a4d6c255c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.583+0000 7f3363400640 1 --2- 172.21.15.18:0/1216912136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c255c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.583+0000 7f3363400640 1 -- 172.21.15.18:0/1216912136 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4d6ca5790 con 0x55a4d6c42710 2024-09-12T03:02:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.584+0000 7f3363400640 1 --2- 172.21.15.18:0/1216912136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c42710 0x55a4d6ca50f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f335c0b0640 tx=0x7f335c009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8de57c6372ff3c5b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.584+0000 7f3350c00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T03:02:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.584+0000 7f3350c00640 1 -- 172.21.15.18:0/1216912136 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c07f060 con 0x55a4d6c42710 2024-09-12T03:02:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.584+0000 7f336c88c740 1 -- 172.21.15.18:0/1216912136 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f334c0043f0 con 0x55a4d6c42710 2024-09-12T03:02:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.584+0000 7f3350c00640 1 -- 172.21.15.18:0/1216912136 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9654+0+0 (secure 0 0 0) 0x7f335c0cd480 con 0x55a4d6c42710 2024-09-12T03:02:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.585+0000 7f3350c00640 1 -- 172.21.15.18:0/1216912136 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f335c0990b0 con 0x55a4d6c42710 2024-09-12T03:02:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.585+0000 7f336c88c740 10 client.26080 fetch_fsmap learned FSMap version 71 2024-09-12T03:02:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.585+0000 7f336c88c740 1 -- 172.21.15.18:0/1216912136 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55a4d6ca5790 con 0x55a4d6c42710 2024-09-12T03:02:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.586+0000 7f3350c00640 1 -- 172.21.15.18:0/1216912136 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f334c0043f0 con 0x55a4d6c42710 2024-09-12T03:02:07.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.587+0000 7f3350c00640 1 -- 172.21.15.18:0/1216912136 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 71) ==== 8450+0+0 (secure 0 0 0) 0x7f335c09af00 con 0x55a4d6c42710 2024-09-12T03:02:07.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.587+0000 7f336c88c740 10 client.26080 fetch_fsmap finished waiting for FSMap version 71 2024-09-12T03:02:07.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.587+0000 7f336c88c740 10 client.26080 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:02:07.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.587+0000 7f336c88c740 20 client.26080 populate_metadata read hostname 'smithi018' 2024-09-12T03:02:07.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.587+0000 7f336c88c740 1 --2- 172.21.15.18:0/1216912136 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a4d6cace40 0x55a4d6caf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:07.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.587+0000 7f336c88c740 4 client.26080 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T03:02:07.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.587+0000 7f336c88c740 1 -- 172.21.15.18:0/1216912136 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a4d6b7bb80 con 0x55a4d6cace40 2024-09-12T03:02:07.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.588+0000 7f3362a00640 1 --2- 172.21.15.18:0/1216912136 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a4d6cace40 0x55a4d6caf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:07.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.590+0000 7f3362a00640 1 --2- 172.21.15.18:0/1216912136 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a4d6cace40 0x55a4d6caf260 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56ea839aa12379e9 server_cookie=90aa24f9e21cfe33 in_seq=0 out_seq=0 2024-09-12T03:02:07.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.590+0000 7f3350c00640 10 client.26080 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:02:07.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.657+0000 7f3350c00640 1 -- 172.21.15.18:0/1216912136 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a4d6b7bb80 con 0x55a4d6cace40 2024-09-12T03:02:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.657+0000 7f3350c00640 10 client.26080 handle_command_reply: tid=0 2024-09-12T03:02:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.657+0000 7f336c88c740 1 client.26080 shutdown 2024-09-12T03:02:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.661+0000 7f336c88c740 1 -- 172.21.15.18:0/1216912136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c42710 msgr2=0x55a4d6ca50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.661+0000 7f336c88c740 1 --2- 172.21.15.18:0/1216912136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c42710 0x55a4d6ca50f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f335c0b0640 tx=0x7f335c009680 comp rx=0 tx=0).stop 2024-09-12T03:02:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.661+0000 7f336c88c740 1 -- 172.21.15.18:0/1216912136 shutdown_connections 2024-09-12T03:02:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.661+0000 7f336c88c740 1 --2- 172.21.15.18:0/1216912136 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55a4d6cace40 0x55a4d6caf260 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.661+0000 7f3350c00640 0 client.26080 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:02:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.661+0000 7f336c88c740 1 --2- 172.21.15.18:0/1216912136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a4d6c42710 0x55a4d6ca50f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.661+0000 7f336c88c740 1 --2- 172.21.15.18:0/1216912136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4d6c21bb0 0x55a4d6c255c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.661+0000 7f336c88c740 1 --2- 172.21.15.18:0/1216912136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a4d6c17310 0x55a4d6c25080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.661+0000 7f336c88c740 1 -- 172.21.15.18:0/1216912136 >> 172.21.15.18:0/1216912136 conn(0x55a4d6c12f60 msgr2=0x55a4d6c09830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.662+0000 7f336c88c740 1 -- 172.21.15.18:0/1216912136 shutdown_connections 2024-09-12T03:02:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.662+0000 7f336c88c740 1 -- 172.21.15.18:0/1216912136 wait complete. 2024-09-12T03:02:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.662+0000 7f336c88c740 20 client.26080 trim_cache size 0 max 16384 2024-09-12T03:02:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T03:02:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T03:02:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T03:02:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T03:02:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.663+0000 7f3369a00640 1 -- 172.21.15.18:0/427548899 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f33480a2e20 msgr2=0x7f33480a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.663+0000 7f3369a00640 1 --2- 172.21.15.18:0/427548899 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f33480a2e20 0x7f33480a52e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f33640ffce0 tx=0x7f335400ee00 comp rx=0 tx=0).stop 2024-09-12T03:02:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.663+0000 7f3369a00640 1 -- 172.21.15.18:0/427548899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3364107ad0 msgr2=0x7f336419aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.663+0000 7f3369a00640 1 --2- 172.21.15.18:0/427548899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3364107ad0 0x7f336419aa00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f335c00eb10 tx=0x7f335c00c2d0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.663+0000 7f3369a00640 1 -- 172.21.15.18:0/427548899 shutdown_connections 2024-09-12T03:02:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.663+0000 7f3369a00640 1 --2- 172.21.15.18:0/427548899 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f33480a2e20 0x7f33480a52e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.663+0000 7f3369a00640 1 --2- 172.21.15.18:0/427548899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3364107ad0 0x7f336419aa00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.663+0000 7f3369a00640 1 --2- 172.21.15.18:0/427548899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3364102460 0x7f3364196680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.663+0000 7f3369a00640 1 --2- 172.21.15.18:0/427548899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3364101ac0 0x7f3364196140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.663+0000 7f3369a00640 1 -- 172.21.15.18:0/427548899 >> 172.21.15.18:0/427548899 conn(0x7f33640fd7e0 msgr2=0x7f33640fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.663+0000 7f3369a00640 1 -- 172.21.15.18:0/427548899 shutdown_connections 2024-09-12T03:02:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:07.663+0000 7f3369a00640 1 -- 172.21.15.18:0/427548899 wait complete. 2024-09-12T03:02:09.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:08 smithi176 ceph-mon[35713]: pgmap v418: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 170 op/s 2024-09-12T03:02:09.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:08 smithi176 ceph-mon[35713]: osdmap e113: 12 total, 12 up, 12 in 2024-09-12T03:02:09.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:08 smithi062 ceph-mon[35527]: pgmap v418: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 170 op/s 2024-09-12T03:02:09.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:08 smithi062 ceph-mon[35527]: osdmap e113: 12 total, 12 up, 12 in 2024-09-12T03:02:09.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:08 smithi018 ceph-mon[30616]: pgmap v418: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 170 op/s 2024-09-12T03:02:09.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:08 smithi018 ceph-mon[30616]: osdmap e113: 12 total, 12 up, 12 in 2024-09-12T03:02:11.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:10 smithi176 ceph-mon[35713]: pgmap v420: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 185 op/s 2024-09-12T03:02:11.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:10 smithi062 ceph-mon[35527]: pgmap v420: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 185 op/s 2024-09-12T03:02:11.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:10 smithi018 ceph-mon[30616]: pgmap v420: 129 pgs: 48 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 66 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 185 op/s 2024-09-12T03:02:13.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:12 smithi176 ceph-mon[35713]: pgmap v421: 129 pgs: 64 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 42 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 209 op/s 2024-09-12T03:02:13.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:12 smithi062 ceph-mon[35527]: pgmap v421: 129 pgs: 64 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 42 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 209 op/s 2024-09-12T03:02:13.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:12 smithi018 ceph-mon[30616]: pgmap v421: 129 pgs: 64 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 42 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 209 op/s 2024-09-12T03:02:15.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:14 smithi062 ceph-mon[35527]: pgmap v422: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 218 op/s 2024-09-12T03:02:15.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:14 smithi018 ceph-mon[30616]: pgmap v422: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 218 op/s 2024-09-12T03:02:15.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:14 smithi176 ceph-mon[35713]: pgmap v422: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 218 op/s 2024-09-12T03:02:17.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:16 smithi062 ceph-mon[35527]: pgmap v423: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 179 op/s 2024-09-12T03:02:17.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:16 smithi018 ceph-mon[30616]: pgmap v423: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 179 op/s 2024-09-12T03:02:17.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:16 smithi176 ceph-mon[35713]: pgmap v423: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 179 op/s 2024-09-12T03:02:19.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:18 smithi062 ceph-mon[35527]: pgmap v424: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 183 op/s 2024-09-12T03:02:19.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:18 smithi018 ceph-mon[30616]: pgmap v424: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 183 op/s 2024-09-12T03:02:19.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:18 smithi176 ceph-mon[35713]: pgmap v424: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 183 op/s 2024-09-12T03:02:20.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.886+0000 7f93f3200640 1 -- 172.21.15.18:0/3203852035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93f4102b00 msgr2=0x7f93f4102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:20.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.886+0000 7f93f3200640 1 --2- 172.21.15.18:0/3203852035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93f4102b00 0x7f93f4102ee0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f93e4009860 tx=0x7f93e402a410 comp rx=0 tx=0).stop 2024-09-12T03:02:20.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.887+0000 7f93f3200640 1 -- 172.21.15.18:0/3203852035 shutdown_connections 2024-09-12T03:02:20.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.887+0000 7f93f3200640 1 --2- 172.21.15.18:0/3203852035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93f410bed0 0x7f93f410e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.887+0000 7f93f3200640 1 --2- 172.21.15.18:0/3203852035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93f4103420 0x7f93f410b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.887+0000 7f93f3200640 1 --2- 172.21.15.18:0/3203852035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93f4102b00 0x7f93f4102ee0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.887+0000 7f93f3200640 1 -- 172.21.15.18:0/3203852035 >> 172.21.15.18:0/3203852035 conn(0x7f93f40777c0 msgr2=0x7f93f40feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.887+0000 7f93f3200640 1 -- 172.21.15.18:0/3203852035 shutdown_connections 2024-09-12T03:02:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.887+0000 7f93f3200640 1 -- 172.21.15.18:0/3203852035 wait complete. 2024-09-12T03:02:20.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.888+0000 7f93f3200640 1 Processor -- start 2024-09-12T03:02:20.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.890+0000 7f93f3200640 1 -- start start 2024-09-12T03:02:20.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.895+0000 7f93f3200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93f4102b00 0x7f93f41a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.895+0000 7f93f3200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93f4103420 0x7f93f41a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.895+0000 7f93f3200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93f410bed0 0x7f93f410ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.895+0000 7f93f3200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f93f4111d20 con 0x7f93f410bed0 2024-09-12T03:02:20.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.895+0000 7f93f3200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f93f4111ba0 con 0x7f93f4103420 2024-09-12T03:02:20.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.895+0000 7f93f3200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f93f4111ea0 con 0x7f93f4102b00 2024-09-12T03:02:20.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.896+0000 7f93f1400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93f4103420 0x7f93f41a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:20.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.896+0000 7f93f1400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93f4103420 0x7f93f41a4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:53386/0 (socket says 172.21.15.18:53386) 2024-09-12T03:02:20.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.896+0000 7f93f1400640 1 -- 172.21.15.18:0/4090037029 learned_addr learned my addr 172.21.15.18:0/4090037029 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:20.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.897+0000 7f93f2800640 1 --2- 172.21.15.18:0/4090037029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93f410bed0 0x7f93f410ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:20.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.897+0000 7f93f1e00640 1 --2- 172.21.15.18:0/4090037029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93f4102b00 0x7f93f41a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:20.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.898+0000 7f93f1e00640 1 -- 172.21.15.18:0/4090037029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93f4103420 msgr2=0x7f93f41a4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:20.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.898+0000 7f93f1e00640 1 --2- 172.21.15.18:0/4090037029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93f4103420 0x7f93f41a4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.898+0000 7f93f1e00640 1 -- 172.21.15.18:0/4090037029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93f410bed0 msgr2=0x7f93f410ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:20.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.898+0000 7f93f1e00640 1 --2- 172.21.15.18:0/4090037029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93f410bed0 0x7f93f410ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.898+0000 7f93f1e00640 1 -- 172.21.15.18:0/4090037029 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f410b3f0 con 0x7f93f4102b00 2024-09-12T03:02:20.898 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.898+0000 7f93f2800640 1 --2- 172.21.15.18:0/4090037029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93f410bed0 0x7f93f410ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:02:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.899+0000 7f93f1e00640 1 --2- 172.21.15.18:0/4090037029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93f4102b00 0x7f93f41a45f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f93e4000c00 tx=0x7f93e4030940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:20.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.900+0000 7f93eaa00640 1 -- 172.21.15.18:0/4090037029 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4005520 con 0x7f93f4102b00 2024-09-12T03:02:20.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.900+0000 7f93eaa00640 1 -- 172.21.15.18:0/4090037029 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93e40318e0 con 0x7f93f4102b00 2024-09-12T03:02:20.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.900+0000 7f93f3200640 1 -- 172.21.15.18:0/4090037029 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f410b680 con 0x7f93f4102b00 2024-09-12T03:02:20.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.900+0000 7f93eaa00640 1 -- 172.21.15.18:0/4090037029 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4004df0 con 0x7f93f4102b00 2024-09-12T03:02:20.900 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.900+0000 7f93f3200640 1 -- 172.21.15.18:0/4090037029 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f41ab390 con 0x7f93f4102b00 2024-09-12T03:02:20.909 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.909+0000 7f93eaa00640 1 -- 172.21.15.18:0/4090037029 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f93e4039040 con 0x7f93f4102b00 2024-09-12T03:02:20.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.910+0000 7f93fbffc740 1 Processor -- start 2024-09-12T03:02:20.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.910+0000 7f93fbffc740 1 -- start start 2024-09-12T03:02:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.910+0000 7f93fbffc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db573b0 0x55c27db57790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.911+0000 7f93eaa00640 1 --2- 172.21.15.18:0/4090037029 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f93d80a2d40 0x7f93d80a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.911+0000 7f93eaa00640 1 -- 172.21.15.18:0/4090037029 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9778+0+0 (secure 0 0 0) 0x7f93e40f0bf0 con 0x7f93f4102b00 2024-09-12T03:02:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.912+0000 7f93f1e00640 1 --2- 172.21.15.18:0/4090037029 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f93d80a2d40 0x7f93d80a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.913+0000 7f93fbffc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db57cd0 0x55c27db62030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.913+0000 7f93f2800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db573b0 0x55c27db57790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:20.914 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.913+0000 7f93f2800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db573b0 0x55c27db57790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:55832/0 (socket says 172.21.15.18:55832) 2024-09-12T03:02:20.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.913+0000 7f93f2800640 1 -- 172.21.15.18:0/2006494466 learned_addr learned my addr 172.21.15.18:0/2006494466 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:20.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.913+0000 7f93fbffc740 1 --2- 172.21.15.18:0/2006494466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db62570 0x55c27db64960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.913+0000 7f93fbffc740 1 -- 172.21.15.18:0/2006494466 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c27dabd100 con 0x55c27db57cd0 2024-09-12T03:02:20.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.913+0000 7f93fbffc740 1 -- 172.21.15.18:0/2006494466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c27da651b0 con 0x55c27db62570 2024-09-12T03:02:20.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.913+0000 7f93fbffc740 1 -- 172.21.15.18:0/2006494466 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c27dab90c0 con 0x55c27db573b0 2024-09-12T03:02:20.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.914+0000 7f93f1e00640 1 --2- 172.21.15.18:0/4090037029 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f93d80a2d40 0x7f93d80a5200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f93e40c5360 tx=0x7f93e402a910 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:20.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.914+0000 7f93f2800640 1 --2- 172.21.15.18:0/2006494466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db62570 0x55c27db64960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:20.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.914+0000 7f93f2800640 1 -- 172.21.15.18:0/2006494466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db62570 msgr2=0x55c27db64960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:20.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.914+0000 7f93f2800640 1 --2- 172.21.15.18:0/2006494466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db62570 0x55c27db64960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.914+0000 7f93f2800640 1 -- 172.21.15.18:0/2006494466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db57cd0 msgr2=0x55c27db62030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:20.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.914+0000 7f93f2800640 1 --2- 172.21.15.18:0/2006494466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db57cd0 0x55c27db62030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.914+0000 7f93f2800640 1 -- 172.21.15.18:0/2006494466 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c27d7d0210 con 0x55c27db573b0 2024-09-12T03:02:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.914+0000 7f93f2800640 1 --2- 172.21.15.18:0/2006494466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db573b0 0x55c27db57790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f93ec009f60 tx=0x7f93ec009cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5a22f7f7f33c773 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.915+0000 7f93df400640 1 -- 172.21.15.18:0/2006494466 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec004b20 con 0x55c27db573b0 2024-09-12T03:02:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.915+0000 7f93df400640 1 -- 172.21.15.18:0/2006494466 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93ec019040 con 0x55c27db573b0 2024-09-12T03:02:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.915+0000 7f93df400640 1 -- 172.21.15.18:0/2006494466 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec005760 con 0x55c27db573b0 2024-09-12T03:02:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.916+0000 7f93fbffc740 1 -- 172.21.15.18:0/2006494466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db573b0 msgr2=0x55c27db57790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.916+0000 7f93fbffc740 1 --2- 172.21.15.18:0/2006494466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db573b0 0x55c27db57790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f93ec009f60 tx=0x7f93ec009cc0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.917+0000 7f93fbffc740 1 -- 172.21.15.18:0/2006494466 shutdown_connections 2024-09-12T03:02:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.917+0000 7f93fbffc740 1 --2- 172.21.15.18:0/2006494466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db62570 0x55c27db64960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.917+0000 7f93fbffc740 1 --2- 172.21.15.18:0/2006494466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db57cd0 0x55c27db62030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.917+0000 7f93fbffc740 1 --2- 172.21.15.18:0/2006494466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db573b0 0x55c27db57790 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.917+0000 7f93fbffc740 1 -- 172.21.15.18:0/2006494466 >> 172.21.15.18:0/2006494466 conn(0x55c27db53920 msgr2=0x55c27db53d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.917+0000 7f93fbffc740 1 -- 172.21.15.18:0/2006494466 shutdown_connections 2024-09-12T03:02:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.917+0000 7f93fbffc740 1 -- 172.21.15.18:0/2006494466 wait complete. 2024-09-12T03:02:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.918+0000 7f93fbffc740 1 -- start start 2024-09-12T03:02:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.918+0000 7f93fbffc740 1 Processor -- start 2024-09-12T03:02:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.919+0000 7f93fbffc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db573b0 0x55c27db5f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.919+0000 7f93fbffc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db57cd0 0x55c27db5fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.919+0000 7f93fbffc740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db62570 0x55c27db60080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.919+0000 7f93fbffc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c27db64ff0 con 0x55c27db573b0 2024-09-12T03:02:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.919+0000 7f93fbffc740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c27da46090 con 0x55c27db62570 2024-09-12T03:02:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.920+0000 7f93fbffc740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c27db65170 con 0x55c27db57cd0 2024-09-12T03:02:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.920+0000 7f93fbffc740 10 client.0 _ll_register_callbacks cb 0x55c27da9af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:02:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.921+0000 7f93f1400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db57cd0 0x55c27db5fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.921+0000 7f93f1400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db57cd0 0x55c27db5fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:55834/0 (socket says 172.21.15.18:55834) 2024-09-12T03:02:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.921+0000 7f93f1400640 1 -- 172.21.15.18:0/2137543059 learned_addr learned my addr 172.21.15.18:0/2137543059 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.921+0000 7f93f2800640 1 --2- 172.21.15.18:0/2137543059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db62570 0x55c27db60080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.921+0000 7f93f2800640 1 --2- 172.21.15.18:0/2137543059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db573b0 0x55c27db5f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.922+0000 7f93f1400640 1 -- 172.21.15.18:0/2137543059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db62570 msgr2=0x55c27db60080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.922+0000 7f93f1400640 1 --2- 172.21.15.18:0/2137543059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db62570 0x55c27db60080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.922+0000 7f93f1400640 1 -- 172.21.15.18:0/2137543059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db573b0 msgr2=0x55c27db5f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.922+0000 7f93f1400640 1 --2- 172.21.15.18:0/2137543059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db573b0 0x55c27db5f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.922+0000 7f93f1400640 1 -- 172.21.15.18:0/2137543059 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c27d89c620 con 0x55c27db57cd0 2024-09-12T03:02:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.922+0000 7f93f2800640 1 --2- 172.21.15.18:0/2137543059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db573b0 0x55c27db5f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:02:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.923+0000 7f93f1400640 1 --2- 172.21.15.18:0/2137543059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db57cd0 0x55c27db5fb40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f93e000be30 tx=0x7f93e00107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53c400ba830901ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.923+0000 7f93d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T03:02:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.923+0000 7f93d3e00640 1 -- 172.21.15.18:0/2137543059 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0004230 con 0x55c27db57cd0 2024-09-12T03:02:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.924+0000 7f93d3e00640 1 -- 172.21.15.18:0/2137543059 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9778+0+0 (secure 0 0 0) 0x7f93e00043d0 con 0x55c27db57cd0 2024-09-12T03:02:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.924+0000 7f93fbffc740 1 -- 172.21.15.18:0/2137543059 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93ec019040 con 0x55c27db57cd0 2024-09-12T03:02:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.924+0000 7f93d3e00640 1 -- 172.21.15.18:0/2137543059 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f93e0011650 con 0x55c27db57cd0 2024-09-12T03:02:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.924+0000 7f93fbffc740 10 client.26092 fetch_fsmap learned FSMap version 71 2024-09-12T03:02:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.924+0000 7f93fbffc740 1 -- 172.21.15.18:0/2137543059 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55c27db81f00 con 0x55c27db57cd0 2024-09-12T03:02:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.926+0000 7f93d3e00640 1 -- 172.21.15.18:0/2137543059 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93e0011cd0 con 0x55c27db57cd0 2024-09-12T03:02:20.927 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.928+0000 7f93d3e00640 1 -- 172.21.15.18:0/2137543059 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 71) ==== 8450+0+0 (secure 0 0 0) 0x7f93e0025420 con 0x55c27db57cd0 2024-09-12T03:02:20.928 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.928+0000 7f93fbffc740 10 client.26092 fetch_fsmap finished waiting for FSMap version 71 2024-09-12T03:02:20.928 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.928+0000 7f93fbffc740 10 client.26092 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:02:20.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.928+0000 7f93fbffc740 20 client.26092 populate_metadata read hostname 'smithi018' 2024-09-12T03:02:20.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.928+0000 7f93fbffc740 1 --2- 172.21.15.18:0/2137543059 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c27db83410 0x55c27db85830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.928+0000 7f93fbffc740 4 client.26092 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:02:20.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.928+0000 7f93fbffc740 1 -- 172.21.15.18:0/2137543059 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f93ec019040 con 0x55c27db83410 2024-09-12T03:02:20.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.929+0000 7f93f2800640 1 --2- 172.21.15.18:0/2137543059 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c27db83410 0x55c27db85830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.931+0000 7f93f2800640 1 --2- 172.21.15.18:0/2137543059 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c27db83410 0x55c27db85830 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8014c0f024bce44c server_cookie=5f995f381e10d87e in_seq=0 out_seq=0 2024-09-12T03:02:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.931+0000 7f93d3e00640 10 client.26092 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:02:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.933+0000 7f93d3e00640 1 -- 172.21.15.18:0/2137543059 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f93ec019040 con 0x55c27db83410 2024-09-12T03:02:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.933+0000 7f93d3e00640 10 client.26092 handle_command_reply: tid=0 2024-09-12T03:02:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.933+0000 7f93fbffc740 1 client.26092 shutdown 2024-09-12T03:02:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.933+0000 7f93fbffc740 1 -- 172.21.15.18:0/2137543059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db57cd0 msgr2=0x55c27db5fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.934+0000 7f93fbffc740 1 --2- 172.21.15.18:0/2137543059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db57cd0 0x55c27db5fb40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f93e000be30 tx=0x7f93e00107a0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.934+0000 7f93fbffc740 1 -- 172.21.15.18:0/2137543059 shutdown_connections 2024-09-12T03:02:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.934+0000 7f93fbffc740 1 --2- 172.21.15.18:0/2137543059 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c27db83410 0x55c27db85830 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.934+0000 7f93d3e00640 0 client.26092 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:02:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.934+0000 7f93fbffc740 1 --2- 172.21.15.18:0/2137543059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db62570 0x55c27db60080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.934+0000 7f93fbffc740 1 --2- 172.21.15.18:0/2137543059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db57cd0 0x55c27db5fb40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.934+0000 7f93fbffc740 1 --2- 172.21.15.18:0/2137543059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db573b0 0x55c27db5f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.934+0000 7f93fbffc740 1 -- 172.21.15.18:0/2137543059 >> 172.21.15.18:0/2137543059 conn(0x55c27db53920 msgr2=0x55c27db59680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.934+0000 7f93fbffc740 1 -- 172.21.15.18:0/2137543059 shutdown_connections 2024-09-12T03:02:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.934+0000 7f93fbffc740 1 -- 172.21.15.18:0/2137543059 wait complete. 2024-09-12T03:02:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.935+0000 7f93fbffc740 20 client.26092 trim_cache size 0 max 16384 2024-09-12T03:02:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.965+0000 7f93fbffc740 1 Processor -- start 2024-09-12T03:02:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.965+0000 7f93fbffc740 1 -- start start 2024-09-12T03:02:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.966+0000 7f93fbffc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db573b0 0x55c27db4e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.966+0000 7f93fbffc740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db57cd0 0x55c27db59e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.966+0000 7f93fbffc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db62570 0x55c27db5feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.966+0000 7f93fbffc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f93f406d5f0 con 0x55c27db573b0 2024-09-12T03:02:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.966+0000 7f93fbffc740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f93f406f430 con 0x55c27db57cd0 2024-09-12T03:02:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.966+0000 7f93fbffc740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f93f406dd80 con 0x55c27db62570 2024-09-12T03:02:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.966+0000 7f93f1400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db57cd0 0x55c27db59e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.966+0000 7f93f1400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db57cd0 0x55c27db59e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:53408/0 (socket says 172.21.15.18:53408) 2024-09-12T03:02:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.966+0000 7f93f1400640 1 -- 172.21.15.18:0/526989702 learned_addr learned my addr 172.21.15.18:0/526989702 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.968+0000 7f93f2800640 1 --2- 172.21.15.18:0/526989702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db62570 0x55c27db5feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.968+0000 7f93f2800640 1 --2- 172.21.15.18:0/526989702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db573b0 0x55c27db4e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.968+0000 7f93f1400640 1 -- 172.21.15.18:0/526989702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db62570 msgr2=0x55c27db5feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.968+0000 7f93f1400640 1 --2- 172.21.15.18:0/526989702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db62570 0x55c27db5feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.968+0000 7f93f1400640 1 -- 172.21.15.18:0/526989702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db573b0 msgr2=0x55c27db4e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.968+0000 7f93f1400640 1 --2- 172.21.15.18:0/526989702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db573b0 0x55c27db4e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.968+0000 7f93f1400640 1 -- 172.21.15.18:0/526989702 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c27db85ba0 con 0x55c27db57cd0 2024-09-12T03:02:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.968+0000 7f93f2800640 1 --2- 172.21.15.18:0/526989702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db62570 0x55c27db5feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:02:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.968+0000 7f93f1400640 1 --2- 172.21.15.18:0/526989702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db57cd0 0x55c27db59e70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f93e0000c00 tx=0x7f93e0025d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74fb6f35fa9887d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.969+0000 7f93dea00640 1 -- 172.21.15.18:0/526989702 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e002a070 con 0x55c27db57cd0 2024-09-12T03:02:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.969+0000 7f93dea00640 1 -- 172.21.15.18:0/526989702 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93e000b480 con 0x55c27db57cd0 2024-09-12T03:02:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.969+0000 7f93dea00640 1 -- 172.21.15.18:0/526989702 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0011bd0 con 0x55c27db57cd0 2024-09-12T03:02:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.970+0000 7f93fbffc740 1 -- 172.21.15.18:0/526989702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db57cd0 msgr2=0x55c27db59e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.970+0000 7f93fbffc740 1 --2- 172.21.15.18:0/526989702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db57cd0 0x55c27db59e70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f93e0000c00 tx=0x7f93e0025d90 comp rx=0 tx=0).stop 2024-09-12T03:02:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.971+0000 7f93fbffc740 1 -- 172.21.15.18:0/526989702 shutdown_connections 2024-09-12T03:02:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.971+0000 7f93fbffc740 1 --2- 172.21.15.18:0/526989702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db62570 0x55c27db5feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.971+0000 7f93fbffc740 1 --2- 172.21.15.18:0/526989702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db57cd0 0x55c27db59e70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.971+0000 7f93fbffc740 1 --2- 172.21.15.18:0/526989702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db573b0 0x55c27db4e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.971+0000 7f93fbffc740 1 -- 172.21.15.18:0/526989702 >> 172.21.15.18:0/526989702 conn(0x55c27db53920 msgr2=0x55c27db5e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.971+0000 7f93fbffc740 1 -- 172.21.15.18:0/526989702 shutdown_connections 2024-09-12T03:02:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.971+0000 7f93fbffc740 1 -- 172.21.15.18:0/526989702 wait complete. 2024-09-12T03:02:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.971+0000 7f93fbffc740 1 -- start start 2024-09-12T03:02:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.972+0000 7f93fbffc740 1 Processor -- start 2024-09-12T03:02:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.973+0000 7f93fbffc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db573b0 0x55c27db76520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.973+0000 7f93fbffc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db57cd0 0x55c27db76a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.973+0000 7f93f2800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db573b0 0x55c27db76520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.973+0000 7f93fbffc740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db62570 0x55c27db76fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.974+0000 7f93fbffc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f93f406eca0 con 0x55c27db57cd0 2024-09-12T03:02:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.974+0000 7f93f2800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db573b0 0x55c27db76520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:55850/0 (socket says 172.21.15.18:55850) 2024-09-12T03:02:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.974+0000 7f93f2800640 1 -- 172.21.15.18:0/3581994997 learned_addr learned my addr 172.21.15.18:0/3581994997 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.974+0000 7f93fbffc740 1 -- 172.21.15.18:0/3581994997 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f93f406e510 con 0x55c27db62570 2024-09-12T03:02:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.974+0000 7f93fbffc740 1 -- 172.21.15.18:0/3581994997 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f93f419fbe0 con 0x55c27db573b0 2024-09-12T03:02:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.974+0000 7f93fbffc740 10 client.0 _ll_register_callbacks cb 0x7f93e000ba70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:02:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.974+0000 7f93f1400640 1 --2- 172.21.15.18:0/3581994997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db57cd0 0x55c27db76a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.975+0000 7f93f2800640 1 --2- 172.21.15.18:0/3581994997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db62570 0x55c27db76fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:20.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.976+0000 7f93f2800640 1 -- 172.21.15.18:0/3581994997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db62570 msgr2=0x55c27db76fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:20.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.976+0000 7f93f2800640 1 --2- 172.21.15.18:0/3581994997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db62570 0x55c27db76fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.976+0000 7f93f2800640 1 -- 172.21.15.18:0/3581994997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db57cd0 msgr2=0x55c27db76a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:20.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.976+0000 7f93f2800640 1 --2- 172.21.15.18:0/3581994997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db57cd0 0x55c27db76a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:20.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.976+0000 7f93f2800640 1 -- 172.21.15.18:0/3581994997 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c27dbec3a0 con 0x55c27db573b0 2024-09-12T03:02:20.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.976+0000 7f93f2800640 1 --2- 172.21.15.18:0/3581994997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db573b0 0x55c27db76520 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f93ec011010 tx=0x7f93ec005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=467f55a789d126 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:20.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.976+0000 7f93d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T03:02:20.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.977+0000 7f93d3e00640 1 -- 172.21.15.18:0/3581994997 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec0049e0 con 0x55c27db573b0 2024-09-12T03:02:20.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.977+0000 7f93d3e00640 1 -- 172.21.15.18:0/3581994997 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9778+0+0 (secure 0 0 0) 0x7f93ec004b80 con 0x55c27db573b0 2024-09-12T03:02:20.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.977+0000 7f93fbffc740 1 -- 172.21.15.18:0/3581994997 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93e000b480 con 0x55c27db573b0 2024-09-12T03:02:20.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.979+0000 7f93d3e00640 1 -- 172.21.15.18:0/3581994997 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f93ec04e050 con 0x55c27db573b0 2024-09-12T03:02:20.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.979+0000 7f93fbffc740 10 client.26095 fetch_fsmap learned FSMap version 71 2024-09-12T03:02:20.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.979+0000 7f93fbffc740 1 -- 172.21.15.18:0/3581994997 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55c27dbed660 con 0x55c27db573b0 2024-09-12T03:02:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.979+0000 7f93d3e00640 1 -- 172.21.15.18:0/3581994997 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93e000b480 con 0x55c27db573b0 2024-09-12T03:02:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.980+0000 7f93d3e00640 1 -- 172.21.15.18:0/3581994997 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 71) ==== 8450+0+0 (secure 0 0 0) 0x7f93ec039070 con 0x55c27db573b0 2024-09-12T03:02:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.980+0000 7f93fbffc740 10 client.26095 fetch_fsmap finished waiting for FSMap version 71 2024-09-12T03:02:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.980+0000 7f93fbffc740 10 client.26095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:02:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.980+0000 7f93fbffc740 20 client.26095 populate_metadata read hostname 'smithi018' 2024-09-12T03:02:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.980+0000 7f93fbffc740 1 --2- 172.21.15.18:0/3581994997 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c27db83410 0x55c27dbefc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.980+0000 7f93fbffc740 4 client.26095 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T03:02:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.980+0000 7f93fbffc740 1 -- 172.21.15.18:0/3581994997 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c27daca830 con 0x55c27db83410 2024-09-12T03:02:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.980+0000 7f93f1400640 1 --2- 172.21.15.18:0/3581994997 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c27db83410 0x55c27dbefc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.982+0000 7f93f1400640 1 --2- 172.21.15.18:0/3581994997 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c27db83410 0x55c27dbefc10 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1a32db9b994ddb4 server_cookie=600abc5e418037ee in_seq=0 out_seq=0 2024-09-12T03:02:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:20.983+0000 7f93d3e00640 10 client.26095 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:02:21.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:21 smithi062 ceph-mon[35527]: pgmap v425: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 161 op/s 2024-09-12T03:02:21.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:20 smithi018 ceph-mon[30616]: pgmap v425: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 161 op/s 2024-09-12T03:02:21.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:21 smithi176 ceph-mon[35713]: pgmap v425: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 161 op/s 2024-09-12T03:02:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.136+0000 7f93d3e00640 1 -- 172.21.15.18:0/3581994997 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c27daca830 con 0x55c27db83410 2024-09-12T03:02:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.136+0000 7f93d3e00640 10 client.26095 handle_command_reply: tid=0 2024-09-12T03:02:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.136+0000 7f93fbffc740 1 client.26095 shutdown 2024-09-12T03:02:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.136+0000 7f93fbffc740 1 -- 172.21.15.18:0/3581994997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db573b0 msgr2=0x55c27db76520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.136+0000 7f93fbffc740 1 --2- 172.21.15.18:0/3581994997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db573b0 0x55c27db76520 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f93ec011010 tx=0x7f93ec005fd0 comp rx=0 tx=0).stop 2024-09-12T03:02:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.137+0000 7f93fbffc740 1 -- 172.21.15.18:0/3581994997 shutdown_connections 2024-09-12T03:02:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.137+0000 7f93fbffc740 1 --2- 172.21.15.18:0/3581994997 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55c27db83410 0x55c27dbefc10 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.137+0000 7f93fbffc740 1 --2- 172.21.15.18:0/3581994997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c27db62570 0x55c27db76fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.137+0000 7f93fbffc740 1 --2- 172.21.15.18:0/3581994997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c27db57cd0 0x55c27db76a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.137+0000 7f93fbffc740 1 --2- 172.21.15.18:0/3581994997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c27db573b0 0x55c27db76520 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.137+0000 7f93fbffc740 1 -- 172.21.15.18:0/3581994997 >> 172.21.15.18:0/3581994997 conn(0x55c27db53920 msgr2=0x55c27db51f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.137+0000 7f93d3e00640 0 client.26095 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:02:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.137+0000 7f93fbffc740 1 -- 172.21.15.18:0/3581994997 shutdown_connections 2024-09-12T03:02:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.137+0000 7f93fbffc740 1 -- 172.21.15.18:0/3581994997 wait complete. 2024-09-12T03:02:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.138+0000 7f93fbffc740 20 client.26095 trim_cache size 0 max 16384 2024-09-12T03:02:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T03:02:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T03:02:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T03:02:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T03:02:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.139+0000 7f93f3200640 1 -- 172.21.15.18:0/4090037029 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f93d80a2d40 msgr2=0x7f93d80a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.139+0000 7f93f3200640 1 --2- 172.21.15.18:0/4090037029 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f93d80a2d40 0x7f93d80a5200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f93e40c5360 tx=0x7f93e402a910 comp rx=0 tx=0).stop 2024-09-12T03:02:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.139+0000 7f93f3200640 1 -- 172.21.15.18:0/4090037029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93f4102b00 msgr2=0x7f93f41a45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.139+0000 7f93f3200640 1 --2- 172.21.15.18:0/4090037029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93f4102b00 0x7f93f41a45f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f93e4000c00 tx=0x7f93e4030940 comp rx=0 tx=0).stop 2024-09-12T03:02:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.143+0000 7f93f3200640 1 -- 172.21.15.18:0/4090037029 shutdown_connections 2024-09-12T03:02:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.143+0000 7f93f3200640 1 --2- 172.21.15.18:0/4090037029 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f93d80a2d40 0x7f93d80a5200 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.143+0000 7f93f3200640 1 --2- 172.21.15.18:0/4090037029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93f410bed0 0x7f93f410ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.143+0000 7f93f3200640 1 --2- 172.21.15.18:0/4090037029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93f4103420 0x7f93f41a4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.143+0000 7f93f3200640 1 --2- 172.21.15.18:0/4090037029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93f4102b00 0x7f93f41a45f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.143+0000 7f93f3200640 1 -- 172.21.15.18:0/4090037029 >> 172.21.15.18:0/4090037029 conn(0x7f93f40777c0 msgr2=0x7f93f4100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.147+0000 7f93f3200640 1 -- 172.21.15.18:0/4090037029 shutdown_connections 2024-09-12T03:02:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:22.147+0000 7f93f3200640 1 -- 172.21.15.18:0/4090037029 wait complete. 2024-09-12T03:02:23.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:23 smithi062 ceph-mon[35527]: pgmap v426: 129 pgs: 63 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 44 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 216 op/s 2024-09-12T03:02:23.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:23 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:02:23.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:23 smithi018 ceph-mon[30616]: pgmap v426: 129 pgs: 63 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 44 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 216 op/s 2024-09-12T03:02:23.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:23 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:02:23.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:23 smithi176 ceph-mon[35713]: pgmap v426: 129 pgs: 63 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 44 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 216 op/s 2024-09-12T03:02:23.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:23 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:02:25.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:25 smithi062 ceph-mon[35527]: pgmap v427: 129 pgs: 63 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 44 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 180 op/s 2024-09-12T03:02:25.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:25 smithi018 ceph-mon[30616]: pgmap v427: 129 pgs: 63 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 44 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 180 op/s 2024-09-12T03:02:25.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:25 smithi176 ceph-mon[35713]: pgmap v427: 129 pgs: 63 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 44 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 180 op/s 2024-09-12T03:02:27.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:27 smithi018 ceph-mon[30616]: pgmap v428: 129 pgs: 63 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 44 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 253 op/s 2024-09-12T03:02:27.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:27 smithi018 ceph-mon[30616]: osdmap e114: 12 total, 12 up, 12 in 2024-09-12T03:02:27.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:27 smithi176 ceph-mon[35713]: pgmap v428: 129 pgs: 63 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 44 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 253 op/s 2024-09-12T03:02:27.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:27 smithi176 ceph-mon[35713]: osdmap e114: 12 total, 12 up, 12 in 2024-09-12T03:02:27.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:27 smithi062 ceph-mon[35527]: pgmap v428: 129 pgs: 63 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 44 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 253 op/s 2024-09-12T03:02:27.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:27 smithi062 ceph-mon[35527]: osdmap e114: 12 total, 12 up, 12 in 2024-09-12T03:02:28.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:28 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:02:28.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:28 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:02:28.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:28 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:02:29.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:29 smithi018 ceph-mon[30616]: pgmap v430: 129 pgs: 63 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 44 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 283 op/s 2024-09-12T03:02:29.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:29 smithi176 ceph-mon[35713]: pgmap v430: 129 pgs: 63 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 44 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 283 op/s 2024-09-12T03:02:29.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:29 smithi062 ceph-mon[35527]: pgmap v430: 129 pgs: 63 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 44 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 283 op/s 2024-09-12T03:02:31.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:31 smithi018 ceph-mon[30616]: pgmap v431: 129 pgs: 63 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 44 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 283 op/s 2024-09-12T03:02:31.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:31 smithi176 ceph-mon[35713]: pgmap v431: 129 pgs: 63 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 44 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 283 op/s 2024-09-12T03:02:31.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:31 smithi062 ceph-mon[35527]: pgmap v431: 129 pgs: 63 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 44 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 283 op/s 2024-09-12T03:02:33.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:33 smithi018 ceph-mon[30616]: pgmap v432: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 289 op/s 2024-09-12T03:02:33.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:33 smithi176 ceph-mon[35713]: pgmap v432: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 289 op/s 2024-09-12T03:02:33.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:33 smithi062 ceph-mon[35527]: pgmap v432: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 289 op/s 2024-09-12T03:02:35.335 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:35 smithi062 ceph-mon[35527]: pgmap v433: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 281 op/s 2024-09-12T03:02:35.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:35 smithi018 ceph-mon[30616]: pgmap v433: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 281 op/s 2024-09-12T03:02:35.383 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.382+0000 7f94dd600640 1 -- 172.21.15.18:0/2873115796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94d8114ab0 msgr2=0x7f94d8116ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:35.383 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.382+0000 7f94dd600640 1 --2- 172.21.15.18:0/2873115796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94d8114ab0 0x7f94d8116ea0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009ca0 tx=0x7f94d002a8c0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.384+0000 7f94dd600640 1 -- 172.21.15.18:0/2873115796 shutdown_connections 2024-09-12T03:02:35.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.384+0000 7f94dd600640 1 --2- 172.21.15.18:0/2873115796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94d8114ab0 0x7f94d8116ea0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.384+0000 7f94dd600640 1 --2- 172.21.15.18:0/2873115796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94d8109b10 0x7f94d8114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.384+0000 7f94dd600640 1 --2- 172.21.15.18:0/2873115796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94d81091f0 0x7f94d81095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.384+0000 7f94dd600640 1 -- 172.21.15.18:0/2873115796 >> 172.21.15.18:0/2873115796 conn(0x7f94d806ce00 msgr2=0x7f94d806d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:35.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.384+0000 7f94dd600640 1 -- 172.21.15.18:0/2873115796 shutdown_connections 2024-09-12T03:02:35.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.384+0000 7f94dd600640 1 -- 172.21.15.18:0/2873115796 wait complete. 2024-09-12T03:02:35.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.385+0000 7f94dd600640 1 Processor -- start 2024-09-12T03:02:35.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.385+0000 7f94dd600640 1 -- start start 2024-09-12T03:02:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.386+0000 7f94dd600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94d81091f0 0x7f94d81a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.386+0000 7f94dd600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94d8109b10 0x7f94d81a32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.386+0000 7f94dd600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94d8114ab0 0x7f94d81a7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.386+0000 7f94dd600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f94d811a6e0 con 0x7f94d8114ab0 2024-09-12T03:02:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.386+0000 7f94dd600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f94d811a560 con 0x7f94d8109b10 2024-09-12T03:02:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.386+0000 7f94dd600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f94d811a860 con 0x7f94d81091f0 2024-09-12T03:02:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.387+0000 7f94d6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94d81091f0 0x7f94d81a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.387+0000 7f94d6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94d81091f0 0x7f94d81a2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:49216/0 (socket says 172.21.15.18:49216) 2024-09-12T03:02:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.387+0000 7f94d6a00640 1 -- 172.21.15.18:0/3025110800 learned_addr learned my addr 172.21.15.18:0/3025110800 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.387+0000 7f94d6000640 1 --2- 172.21.15.18:0/3025110800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94d8109b10 0x7f94d81a32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.387+0000 7f94d7400640 1 --2- 172.21.15.18:0/3025110800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94d8114ab0 0x7f94d81a7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.388+0000 7f94d6a00640 1 -- 172.21.15.18:0/3025110800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94d8109b10 msgr2=0x7f94d81a32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.388+0000 7f94d6a00640 1 --2- 172.21.15.18:0/3025110800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94d8109b10 0x7f94d81a32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.388+0000 7f94d6a00640 1 -- 172.21.15.18:0/3025110800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94d8114ab0 msgr2=0x7f94d81a7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:35.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.388+0000 7f94d6a00640 1 --2- 172.21.15.18:0/3025110800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94d8114ab0 0x7f94d81a7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.388+0000 7f94d6a00640 1 -- 172.21.15.18:0/3025110800 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d81a7d80 con 0x7f94d81091f0 2024-09-12T03:02:35.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.389+0000 7f94d6a00640 1 --2- 172.21.15.18:0/3025110800 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94d81091f0 0x7f94d81a2d90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f94c800d950 tx=0x7f94c800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:35.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.389+0000 7f94cf400640 1 -- 172.21.15.18:0/3025110800 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8017070 con 0x7f94d81091f0 2024-09-12T03:02:35.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.389+0000 7f94cf400640 1 -- 172.21.15.18:0/3025110800 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94c8009c30 con 0x7f94d81091f0 2024-09-12T03:02:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.389+0000 7f94cf400640 1 -- 172.21.15.18:0/3025110800 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c800f6b0 con 0x7f94d81091f0 2024-09-12T03:02:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.389+0000 7f94dd600640 1 -- 172.21.15.18:0/3025110800 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d81a8070 con 0x7f94d81091f0 2024-09-12T03:02:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.390+0000 7f94dd600640 1 -- 172.21.15.18:0/3025110800 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d81af900 con 0x7f94d81091f0 2024-09-12T03:02:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.395+0000 7f94cf400640 1 -- 172.21.15.18:0/3025110800 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f94c80109d0 con 0x7f94d81091f0 2024-09-12T03:02:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.399+0000 7f94cf400640 1 --2- 172.21.15.18:0/3025110800 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f94bc0a2e20 0x7f94bc0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.400+0000 7f94cf400640 1 -- 172.21.15.18:0/3025110800 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 9718+0+0 (secure 0 0 0) 0x7f94c80cf560 con 0x7f94d81091f0 2024-09-12T03:02:35.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.400+0000 7f94d6000640 1 --2- 172.21.15.18:0/3025110800 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f94bc0a2e20 0x7f94bc0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:35.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.401+0000 7f94d6000640 1 --2- 172.21.15.18:0/3025110800 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f94bc0a2e20 0x7f94bc0a52e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f94d810bd20 tx=0x7f94c4005f90 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.403+0000 7f94e0488740 1 Processor -- start 2024-09-12T03:02:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.404+0000 7f94e0488740 1 -- start start 2024-09-12T03:02:35.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.404+0000 7f94e0488740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c751e0 0x564a89c755c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.404+0000 7f94e0488740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c75b00 0x564a89c7fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.404+0000 7f94e0488740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 0x564a89c82790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.404+0000 7f94e0488740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564a89bdb100 con 0x564a89c803a0 2024-09-12T03:02:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.404+0000 7f94e0488740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564a89b831b0 con 0x564a89c751e0 2024-09-12T03:02:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.404+0000 7f94e0488740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564a89bd70c0 con 0x564a89c75b00 2024-09-12T03:02:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.404+0000 7f94d6000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c75b00 0x564a89c7fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.405+0000 7f94d6000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c75b00 0x564a89c7fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:49218/0 (socket says 172.21.15.18:49218) 2024-09-12T03:02:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.405+0000 7f94d6000640 1 -- 172.21.15.18:0/3333624239 learned_addr learned my addr 172.21.15.18:0/3333624239 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.405+0000 7f94d6a00640 1 --2- 172.21.15.18:0/3333624239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c751e0 0x564a89c755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.405+0000 7f94d6a00640 1 -- 172.21.15.18:0/3333624239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c75b00 msgr2=0x564a89c7fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.405+0000 7f94d6a00640 1 --2- 172.21.15.18:0/3333624239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c75b00 0x564a89c7fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.405+0000 7f94d6a00640 1 -- 172.21.15.18:0/3333624239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 msgr2=0x564a89c82790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.405+0000 7f94d7400640 1 --2- 172.21.15.18:0/3333624239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 0x564a89c82790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.405+0000 7f94d6a00640 1 --2- 172.21.15.18:0/3333624239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 0x564a89c82790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.405+0000 7f94d6a00640 1 -- 172.21.15.18:0/3333624239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a898ee210 con 0x564a89c751e0 2024-09-12T03:02:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.405+0000 7f94d6000640 1 --2- 172.21.15.18:0/3333624239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c75b00 0x564a89c7fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:02:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.405+0000 7f94d7400640 1 --2- 172.21.15.18:0/3333624239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 0x564a89c82790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:02:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.406+0000 7f94d6a00640 1 --2- 172.21.15.18:0/3333624239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c751e0 0x564a89c755c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f94c80cc800 tx=0x7f94c809b220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9f63e34e30679f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.407+0000 7f94c3400640 1 -- 172.21.15.18:0/3333624239 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8020040 con 0x564a89c751e0 2024-09-12T03:02:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.407+0000 7f94c3400640 1 -- 172.21.15.18:0/3333624239 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94c809f980 con 0x564a89c751e0 2024-09-12T03:02:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.407+0000 7f94c3400640 1 -- 172.21.15.18:0/3333624239 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c809aa20 con 0x564a89c751e0 2024-09-12T03:02:35.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.408+0000 7f94e0488740 1 -- 172.21.15.18:0/3333624239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c751e0 msgr2=0x564a89c755c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:35.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.408+0000 7f94e0488740 1 --2- 172.21.15.18:0/3333624239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c751e0 0x564a89c755c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f94c80cc800 tx=0x7f94c809b220 comp rx=0 tx=0).stop 2024-09-12T03:02:35.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.409+0000 7f94e0488740 1 -- 172.21.15.18:0/3333624239 shutdown_connections 2024-09-12T03:02:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.409+0000 7f94e0488740 1 --2- 172.21.15.18:0/3333624239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 0x564a89c82790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.409+0000 7f94e0488740 1 --2- 172.21.15.18:0/3333624239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c75b00 0x564a89c7fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.409+0000 7f94e0488740 1 --2- 172.21.15.18:0/3333624239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c751e0 0x564a89c755c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.409+0000 7f94e0488740 1 -- 172.21.15.18:0/3333624239 >> 172.21.15.18:0/3333624239 conn(0x564a89c71750 msgr2=0x564a89c71b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.411+0000 7f94e0488740 1 -- 172.21.15.18:0/3333624239 shutdown_connections 2024-09-12T03:02:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.412+0000 7f94e0488740 1 -- 172.21.15.18:0/3333624239 wait complete. 2024-09-12T03:02:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.413+0000 7f94e0488740 1 -- start start 2024-09-12T03:02:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.413+0000 7f94e0488740 1 Processor -- start 2024-09-12T03:02:35.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.415+0000 7f94e0488740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c751e0 0x564a89c7d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.416+0000 7f94e0488740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c75b00 0x564a89c7d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.416+0000 7f94e0488740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 0x564a89c7dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.416+0000 7f94e0488740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564a89c82f10 con 0x564a89c803a0 2024-09-12T03:02:35.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.416+0000 7f94e0488740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564a89b64090 con 0x564a89c75b00 2024-09-12T03:02:35.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.416+0000 7f94e0488740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564a89c83090 con 0x564a89c751e0 2024-09-12T03:02:35.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.416+0000 7f94e0488740 10 client.0 _ll_register_callbacks cb 0x564a89bb8f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:02:35.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.418+0000 7f94d6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c751e0 0x564a89c7d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:35.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.418+0000 7f94d6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c751e0 0x564a89c7d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:49232/0 (socket says 172.21.15.18:49232) 2024-09-12T03:02:35.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.418+0000 7f94d6a00640 1 -- 172.21.15.18:0/2124007573 learned_addr learned my addr 172.21.15.18:0/2124007573 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:35.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.418+0000 7f94d6000640 1 --2- 172.21.15.18:0/2124007573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c75b00 0x564a89c7d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:35.420 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.418+0000 7f94d7400640 1 --2- 172.21.15.18:0/2124007573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 0x564a89c7dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.419+0000 7f94d6a00640 1 -- 172.21.15.18:0/2124007573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c75b00 msgr2=0x564a89c7d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.419+0000 7f94d6a00640 1 --2- 172.21.15.18:0/2124007573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c75b00 0x564a89c7d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.419+0000 7f94d6a00640 1 -- 172.21.15.18:0/2124007573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 msgr2=0x564a89c7dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.419+0000 7f94d6a00640 1 --2- 172.21.15.18:0/2124007573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 0x564a89c7dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.420+0000 7f94d6a00640 1 -- 172.21.15.18:0/2124007573 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a899ba620 con 0x564a89c751e0 2024-09-12T03:02:35.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.420+0000 7f94d6a00640 1 --2- 172.21.15.18:0/2124007573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c751e0 0x564a89c7d360 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f94c8000c00 tx=0x7f94c80ccc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72f2afa76a0b3b12 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:35.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.420+0000 7f94b7e00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T03:02:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.425+0000 7f94b7e00640 1 -- 172.21.15.18:0/2124007573 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8020050 con 0x564a89c751e0 2024-09-12T03:02:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.425+0000 7f94b7e00640 1 -- 172.21.15.18:0/2124007573 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9718+0+0 (secure 0 0 0) 0x7f94c809aa20 con 0x564a89c751e0 2024-09-12T03:02:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.425+0000 7f94e0488740 1 -- 172.21.15.18:0/2124007573 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94c809f980 con 0x564a89c751e0 2024-09-12T03:02:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.426+0000 7f94b7e00640 1 -- 172.21.15.18:0/2124007573 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f94c8097c40 con 0x564a89c751e0 2024-09-12T03:02:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.426+0000 7f94e0488740 10 client.26107 fetch_fsmap learned FSMap version 73 2024-09-12T03:02:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.426+0000 7f94e0488740 1 -- 172.21.15.18:0/2124007573 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x564a89c82f10 con 0x564a89c751e0 2024-09-12T03:02:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.427+0000 7f94b7e00640 1 -- 172.21.15.18:0/2124007573 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94c809f980 con 0x564a89c751e0 2024-09-12T03:02:35.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.427+0000 7f94b7e00640 1 -- 172.21.15.18:0/2124007573 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 73) ==== 8434+0+0 (secure 0 0 0) 0x7f94c8097400 con 0x564a89c751e0 2024-09-12T03:02:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.427+0000 7f94e0488740 10 client.26107 fetch_fsmap finished waiting for FSMap version 73 2024-09-12T03:02:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.427+0000 7f94e0488740 10 client.26107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:02:35.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.427+0000 7f94e0488740 20 client.26107 populate_metadata read hostname 'smithi018' 2024-09-12T03:02:35.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.427+0000 7f94e0488740 1 --2- 172.21.15.18:0/2124007573 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x564a89c984e0 0x564a89c9a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.428+0000 7f94e0488740 4 client.26107 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:02:35.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.428+0000 7f94e0488740 1 -- 172.21.15.18:0/2124007573 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a89be8830 con 0x564a89c984e0 2024-09-12T03:02:35.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.430+0000 7f94d6000640 1 --2- 172.21.15.18:0/2124007573 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x564a89c984e0 0x564a89c9a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:35.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.431+0000 7f94d6000640 1 --2- 172.21.15.18:0/2124007573 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x564a89c984e0 0x564a89c9a8d0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c6cb5c33871aef3 server_cookie=8137e21bf2ddbe89 in_seq=0 out_seq=0 2024-09-12T03:02:35.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.431+0000 7f94b7e00640 10 client.26107 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:02:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.432+0000 7f94b7e00640 1 -- 172.21.15.18:0/2124007573 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564a89be8830 con 0x564a89c984e0 2024-09-12T03:02:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.433+0000 7f94b7e00640 10 client.26107 handle_command_reply: tid=0 2024-09-12T03:02:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.433+0000 7f94e0488740 1 client.26107 shutdown 2024-09-12T03:02:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.435+0000 7f94e0488740 1 -- 172.21.15.18:0/2124007573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c751e0 msgr2=0x564a89c7d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.435+0000 7f94e0488740 1 --2- 172.21.15.18:0/2124007573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c751e0 0x564a89c7d360 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f94c8000c00 tx=0x7f94c80ccc90 comp rx=0 tx=0).stop 2024-09-12T03:02:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.435+0000 7f94e0488740 1 -- 172.21.15.18:0/2124007573 shutdown_connections 2024-09-12T03:02:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.435+0000 7f94e0488740 1 --2- 172.21.15.18:0/2124007573 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x564a89c984e0 0x564a89c9a8d0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.435+0000 7f94e0488740 1 --2- 172.21.15.18:0/2124007573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 0x564a89c7dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.435+0000 7f94e0488740 1 --2- 172.21.15.18:0/2124007573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c75b00 0x564a89c7d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.435+0000 7f94e0488740 1 --2- 172.21.15.18:0/2124007573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c751e0 0x564a89c7d360 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.435+0000 7f94e0488740 1 -- 172.21.15.18:0/2124007573 >> 172.21.15.18:0/2124007573 conn(0x564a89c71750 msgr2=0x564a89c77460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.435+0000 7f94b7e00640 0 client.26107 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:02:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.435+0000 7f94e0488740 1 -- 172.21.15.18:0/2124007573 shutdown_connections 2024-09-12T03:02:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.435+0000 7f94e0488740 1 -- 172.21.15.18:0/2124007573 wait complete. 2024-09-12T03:02:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.436+0000 7f94e0488740 20 client.26107 trim_cache size 0 max 16384 2024-09-12T03:02:35.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.469+0000 7f94e0488740 1 Processor -- start 2024-09-12T03:02:35.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.470+0000 7f94e0488740 1 -- start start 2024-09-12T03:02:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.471+0000 7f94e0488740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c751e0 0x564a89c7dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.471+0000 7f94e0488740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c75b00 0x564a89c70740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.471+0000 7f94e0488740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 0x564a89ca0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.471+0000 7f94e0488740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f94d81b5950 con 0x564a89c803a0 2024-09-12T03:02:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.471+0000 7f94e0488740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f94d81b7730 con 0x564a89c751e0 2024-09-12T03:02:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.471+0000 7f94e0488740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f94d81b60e0 con 0x564a89c75b00 2024-09-12T03:02:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.471+0000 7f94d6a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c751e0 0x564a89c7dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.471+0000 7f94d6a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c751e0 0x564a89c7dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:42460/0 (socket says 172.21.15.18:42460) 2024-09-12T03:02:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.471+0000 7f94d6a00640 1 -- 172.21.15.18:0/16586362 learned_addr learned my addr 172.21.15.18:0/16586362 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.471+0000 7f94d6000640 1 --2- 172.21.15.18:0/16586362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c75b00 0x564a89c70740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.472+0000 7f94d6a00640 1 -- 172.21.15.18:0/16586362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c75b00 msgr2=0x564a89c70740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.472+0000 7f94d6a00640 1 --2- 172.21.15.18:0/16586362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c75b00 0x564a89c70740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.472+0000 7f94d6a00640 1 -- 172.21.15.18:0/16586362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 msgr2=0x564a89ca0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.472+0000 7f94d6a00640 1 --2- 172.21.15.18:0/16586362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 0x564a89ca0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.472+0000 7f94d6a00640 1 -- 172.21.15.18:0/16586362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a89c9af00 con 0x564a89c751e0 2024-09-12T03:02:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.472+0000 7f94d6a00640 1 --2- 172.21.15.18:0/16586362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c751e0 0x564a89c7dc10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f94c8099880 tx=0x7f94c8005bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=221201d9102739f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.472+0000 7f94c2a00640 1 -- 172.21.15.18:0/16586362 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8097c40 con 0x564a89c751e0 2024-09-12T03:02:35.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.473+0000 7f94c2a00640 1 -- 172.21.15.18:0/16586362 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94c80cf380 con 0x564a89c751e0 2024-09-12T03:02:35.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.473+0000 7f94c2a00640 1 -- 172.21.15.18:0/16586362 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c809aa20 con 0x564a89c751e0 2024-09-12T03:02:35.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.474+0000 7f94e0488740 1 -- 172.21.15.18:0/16586362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c751e0 msgr2=0x564a89c7dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:35.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.474+0000 7f94e0488740 1 --2- 172.21.15.18:0/16586362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c751e0 0x564a89c7dc10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f94c8099880 tx=0x7f94c8005bb0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.477+0000 7f94e0488740 1 -- 172.21.15.18:0/16586362 shutdown_connections 2024-09-12T03:02:35.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.477+0000 7f94e0488740 1 --2- 172.21.15.18:0/16586362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 0x564a89ca0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.477+0000 7f94e0488740 1 --2- 172.21.15.18:0/16586362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c75b00 0x564a89c70740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.477+0000 7f94e0488740 1 --2- 172.21.15.18:0/16586362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c751e0 0x564a89c7dc10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.477+0000 7f94e0488740 1 -- 172.21.15.18:0/16586362 >> 172.21.15.18:0/16586362 conn(0x564a89c71750 msgr2=0x564a89c70030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:35.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:35 smithi176 ceph-mon[35713]: pgmap v433: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 281 op/s 2024-09-12T03:02:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.477+0000 7f94e0488740 1 -- 172.21.15.18:0/16586362 shutdown_connections 2024-09-12T03:02:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.478+0000 7f94e0488740 1 -- 172.21.15.18:0/16586362 wait complete. 2024-09-12T03:02:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.478+0000 7f94e0488740 1 -- start start 2024-09-12T03:02:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.479+0000 7f94e0488740 1 Processor -- start 2024-09-12T03:02:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.480+0000 7f94e0488740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c751e0 0x564a89c8c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.480+0000 7f94e0488740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c75b00 0x564a89c8c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.480+0000 7f94e0488740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 0x564a89cfb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.480+0000 7f94e0488740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f94d81b6fa0 con 0x564a89c803a0 2024-09-12T03:02:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.480+0000 7f94e0488740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f94d81b6870 con 0x564a89c75b00 2024-09-12T03:02:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.480+0000 7f94e0488740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f94d81b3910 con 0x564a89c751e0 2024-09-12T03:02:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.480+0000 7f94e0488740 10 client.0 _ll_register_callbacks cb 0x7f94c80ccf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:02:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.480+0000 7f94d6000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c75b00 0x564a89c8c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.480+0000 7f94d6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c751e0 0x564a89c8c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.481+0000 7f94d6000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c75b00 0x564a89c8c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:42476/0 (socket says 172.21.15.18:42476) 2024-09-12T03:02:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.481+0000 7f94d6000640 1 -- 172.21.15.18:0/1342234938 learned_addr learned my addr 172.21.15.18:0/1342234938 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.481+0000 7f94d7400640 1 --2- 172.21.15.18:0/1342234938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 0x564a89cfb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.481+0000 7f94d6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c751e0 0x564a89c8c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:49250/0 (socket says 172.21.15.18:49250) 2024-09-12T03:02:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.482+0000 7f94d6a00640 1 -- 172.21.15.18:0/1342234938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c75b00 msgr2=0x564a89c8c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.483+0000 7f94d6a00640 1 --2- 172.21.15.18:0/1342234938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c75b00 0x564a89c8c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.483+0000 7f94d6a00640 1 -- 172.21.15.18:0/1342234938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 msgr2=0x564a89cfb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.483+0000 7f94d6a00640 1 --2- 172.21.15.18:0/1342234938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 0x564a89cfb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.483+0000 7f94d6a00640 1 -- 172.21.15.18:0/1342234938 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a89c723e0 con 0x564a89c751e0 2024-09-12T03:02:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.483+0000 7f94d7400640 1 --2- 172.21.15.18:0/1342234938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 0x564a89cfb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:02:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.483+0000 7f94d6000640 1 --2- 172.21.15.18:0/1342234938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c75b00 0x564a89c8c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:02:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.486+0000 7f94d6a00640 1 --2- 172.21.15.18:0/1342234938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c751e0 0x564a89c8c260 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009610 tx=0x7f94c8010cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e36d9cacd4e3653 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.486+0000 7f94b7e00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T03:02:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.486+0000 7f94b7e00640 1 -- 172.21.15.18:0/1342234938 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8097c40 con 0x564a89c751e0 2024-09-12T03:02:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.486+0000 7f94b7e00640 1 -- 172.21.15.18:0/1342234938 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9718+0+0 (secure 0 0 0) 0x7f94c8084b10 con 0x564a89c751e0 2024-09-12T03:02:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.487+0000 7f94e0488740 1 -- 172.21.15.18:0/1342234938 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94c80cf380 con 0x564a89c751e0 2024-09-12T03:02:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.487+0000 7f94b7e00640 1 -- 172.21.15.18:0/1342234938 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f94c809f980 con 0x564a89c751e0 2024-09-12T03:02:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.487+0000 7f94e0488740 10 client.26110 fetch_fsmap learned FSMap version 73 2024-09-12T03:02:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.487+0000 7f94e0488740 1 -- 172.21.15.18:0/1342234938 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x564a89c6cd60 con 0x564a89c751e0 2024-09-12T03:02:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.487+0000 7f94b7e00640 1 -- 172.21.15.18:0/1342234938 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94c80cf380 con 0x564a89c751e0 2024-09-12T03:02:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.491+0000 7f94b7e00640 1 -- 172.21.15.18:0/1342234938 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 73) ==== 8434+0+0 (secure 0 0 0) 0x7f94c80afaf0 con 0x564a89c751e0 2024-09-12T03:02:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.491+0000 7f94e0488740 10 client.26110 fetch_fsmap finished waiting for FSMap version 73 2024-09-12T03:02:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.491+0000 7f94e0488740 10 client.26110 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:02:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.491+0000 7f94e0488740 20 client.26110 populate_metadata read hostname 'smithi018' 2024-09-12T03:02:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.491+0000 7f94e0488740 1 --2- 172.21.15.18:0/1342234938 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x564a89d02b90 0x564a89d04fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.491+0000 7f94e0488740 4 client.26110 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T03:02:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.491+0000 7f94e0488740 1 -- 172.21.15.18:0/1342234938 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564a89be2b80 con 0x564a89d02b90 2024-09-12T03:02:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.491+0000 7f94d6000640 1 --2- 172.21.15.18:0/1342234938 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x564a89d02b90 0x564a89d04fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.494+0000 7f94d6000640 1 --2- 172.21.15.18:0/1342234938 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x564a89d02b90 0x564a89d04fb0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f1f58f18994f420 server_cookie=7a17d63efd87f0b1 in_seq=0 out_seq=0 2024-09-12T03:02:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:35.494+0000 7f94b7e00640 10 client.26110 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:02:36.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:36 smithi176 ceph-mon[35713]: pgmap v434: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 249 op/s 2024-09-12T03:02:36.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:36 smithi062 ceph-mon[35527]: pgmap v434: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 249 op/s 2024-09-12T03:02:36.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:36 smithi018 ceph-mon[30616]: pgmap v434: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 249 op/s 2024-09-12T03:02:36.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.874+0000 7f94b7e00640 1 -- 172.21.15.18:0/1342234938 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564a89be2b80 con 0x564a89d02b90 2024-09-12T03:02:36.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.874+0000 7f94b7e00640 10 client.26110 handle_command_reply: tid=0 2024-09-12T03:02:36.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.874+0000 7f94e0488740 1 client.26110 shutdown 2024-09-12T03:02:36.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.874+0000 7f94e0488740 1 -- 172.21.15.18:0/1342234938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c751e0 msgr2=0x564a89c8c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:36.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.874+0000 7f94e0488740 1 --2- 172.21.15.18:0/1342234938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c751e0 0x564a89c8c260 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009610 tx=0x7f94c8010cc0 comp rx=0 tx=0).stop 2024-09-12T03:02:36.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.874+0000 7f94e0488740 1 -- 172.21.15.18:0/1342234938 shutdown_connections 2024-09-12T03:02:36.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.874+0000 7f94e0488740 1 --2- 172.21.15.18:0/1342234938 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x564a89d02b90 0x564a89d04fb0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:36.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.874+0000 7f94e0488740 1 --2- 172.21.15.18:0/1342234938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564a89c803a0 0x564a89cfb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.874+0000 7f94e0488740 1 --2- 172.21.15.18:0/1342234938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564a89c75b00 0x564a89c8c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.874+0000 7f94e0488740 1 --2- 172.21.15.18:0/1342234938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a89c751e0 0x564a89c8c260 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.874+0000 7f94e0488740 1 -- 172.21.15.18:0/1342234938 >> 172.21.15.18:0/1342234938 conn(0x564a89c71750 msgr2=0x564a89c94190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.875+0000 7f94b7e00640 0 client.26110 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:02:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.875+0000 7f94e0488740 1 -- 172.21.15.18:0/1342234938 shutdown_connections 2024-09-12T03:02:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.875+0000 7f94e0488740 1 -- 172.21.15.18:0/1342234938 wait complete. 2024-09-12T03:02:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.876+0000 7f94e0488740 20 client.26110 trim_cache size 0 max 16384 2024-09-12T03:02:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T03:02:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T03:02:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T03:02:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T03:02:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.877+0000 7f94dd600640 1 -- 172.21.15.18:0/3025110800 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f94bc0a2e20 msgr2=0x7f94bc0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.877+0000 7f94dd600640 1 --2- 172.21.15.18:0/3025110800 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f94bc0a2e20 0x7f94bc0a52e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f94d810bd20 tx=0x7f94c4005f90 comp rx=0 tx=0).stop 2024-09-12T03:02:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.877+0000 7f94dd600640 1 -- 172.21.15.18:0/3025110800 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94d81091f0 msgr2=0x7f94d81a2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.877+0000 7f94dd600640 1 --2- 172.21.15.18:0/3025110800 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94d81091f0 0x7f94d81a2d90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f94c800d950 tx=0x7f94c800de10 comp rx=0 tx=0).stop 2024-09-12T03:02:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.878+0000 7f94dd600640 1 -- 172.21.15.18:0/3025110800 shutdown_connections 2024-09-12T03:02:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.878+0000 7f94dd600640 1 --2- 172.21.15.18:0/3025110800 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f94bc0a2e20 0x7f94bc0a52e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.878+0000 7f94dd600640 1 --2- 172.21.15.18:0/3025110800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94d8114ab0 0x7f94d81a7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.878+0000 7f94dd600640 1 --2- 172.21.15.18:0/3025110800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94d8109b10 0x7f94d81a32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.878+0000 7f94dd600640 1 --2- 172.21.15.18:0/3025110800 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94d81091f0 0x7f94d81a2d90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.878+0000 7f94dd600640 1 -- 172.21.15.18:0/3025110800 >> 172.21.15.18:0/3025110800 conn(0x7f94d806ce00 msgr2=0x7f94d810a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.878+0000 7f94dd600640 1 -- 172.21.15.18:0/3025110800 shutdown_connections 2024-09-12T03:02:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:36.878+0000 7f94dd600640 1 -- 172.21.15.18:0/3025110800 wait complete. 2024-09-12T03:02:38.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:38 smithi176 ceph-mon[35713]: pgmap v435: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 243 op/s 2024-09-12T03:02:38.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:38 smithi062 ceph-mon[35527]: pgmap v435: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 243 op/s 2024-09-12T03:02:38.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:38 smithi018 ceph-mon[30616]: pgmap v435: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 243 op/s 2024-09-12T03:02:40.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:40 smithi176 ceph-mon[35713]: pgmap v436: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 765 KiB/s wr, 204 op/s 2024-09-12T03:02:40.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:40 smithi062 ceph-mon[35527]: pgmap v436: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 765 KiB/s wr, 204 op/s 2024-09-12T03:02:40.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:40 smithi018 ceph-mon[30616]: pgmap v436: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 765 KiB/s wr, 204 op/s 2024-09-12T03:02:42.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:42 smithi176 ceph-mon[35713]: pgmap v437: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 320 op/s 2024-09-12T03:02:42.746 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:42 smithi018 ceph-mon[30616]: pgmap v437: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 320 op/s 2024-09-12T03:02:42.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:42 smithi062 ceph-mon[35527]: pgmap v437: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 320 op/s 2024-09-12T03:02:43.851 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 03:02:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T03:02:43.477+0000 7fea77000640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-12T03:02:44.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:44 smithi176 ceph-mon[35713]: pgmap v438: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 273 op/s 2024-09-12T03:02:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:44 smithi062 ceph-mon[35527]: pgmap v438: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 273 op/s 2024-09-12T03:02:44.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:44 smithi018 ceph-mon[30616]: pgmap v438: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 273 op/s 2024-09-12T03:02:46.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:46 smithi176 ceph-mon[35713]: pgmap v439: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 303 op/s 2024-09-12T03:02:46.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:46 smithi062 ceph-mon[35527]: pgmap v439: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 303 op/s 2024-09-12T03:02:46.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:46 smithi018 ceph-mon[30616]: pgmap v439: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 303 op/s 2024-09-12T03:02:48.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:48 smithi176 ceph-mon[35713]: pgmap v440: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 282 op/s 2024-09-12T03:02:48.758 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:48 smithi018 ceph-mon[30616]: pgmap v440: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 282 op/s 2024-09-12T03:02:48.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:48 smithi062 ceph-mon[35527]: pgmap v440: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 282 op/s 2024-09-12T03:02:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.107+0000 7f579be00640 1 -- 172.21.15.18:0/2842024057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5794068bc0 msgr2=0x7f5794104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.107+0000 7f579be00640 1 --2- 172.21.15.18:0/2842024057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5794068bc0 0x7f5794104970 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5788009900 tx=0x7f578802a410 comp rx=0 tx=0).stop 2024-09-12T03:02:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.107+0000 7f579be00640 1 -- 172.21.15.18:0/2842024057 shutdown_connections 2024-09-12T03:02:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.107+0000 7f579be00640 1 --2- 172.21.15.18:0/2842024057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f579410ac10 0x7f579410d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.107+0000 7f579be00640 1 --2- 172.21.15.18:0/2842024057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57941008a0 0x7f5794104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.107+0000 7f579be00640 1 --2- 172.21.15.18:0/2842024057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5794068bc0 0x7f5794104970 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.107+0000 7f579be00640 1 -- 172.21.15.18:0/2842024057 >> 172.21.15.18:0/2842024057 conn(0x7f57940fba30 msgr2=0x7f57940fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.107+0000 7f579be00640 1 -- 172.21.15.18:0/2842024057 shutdown_connections 2024-09-12T03:02:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.107+0000 7f579be00640 1 -- 172.21.15.18:0/2842024057 wait complete. 2024-09-12T03:02:50.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.109+0000 7f579be00640 1 Processor -- start 2024-09-12T03:02:50.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.110+0000 7f579be00640 1 -- start start 2024-09-12T03:02:50.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.110+0000 7f579be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5794068bc0 0x7f5794073900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.110+0000 7f579be00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57941008a0 0x7f5794073e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.110+0000 7f579be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f579410ac10 0x7f579406cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.110+0000 7f579be00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5794111f60 con 0x7f579410ac10 2024-09-12T03:02:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.110+0000 7f579be00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5794111de0 con 0x7f5794068bc0 2024-09-12T03:02:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.110+0000 7f579be00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f57941120e0 con 0x7f57941008a0 2024-09-12T03:02:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.110+0000 7f5798a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57941008a0 0x7f5794073e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.110+0000 7f5799400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5794068bc0 0x7f5794073900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.110+0000 7f5798a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57941008a0 0x7f5794073e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:45700/0 (socket says 172.21.15.18:45700) 2024-09-12T03:02:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.110+0000 7f5799400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5794068bc0 0x7f5794073900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:37440/0 (socket says 172.21.15.18:37440) 2024-09-12T03:02:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.110+0000 7f5798a00640 1 -- 172.21.15.18:0/447227673 learned_addr learned my addr 172.21.15.18:0/447227673 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.111+0000 7f5799e00640 1 --2- 172.21.15.18:0/447227673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f579410ac10 0x7f579406cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.111+0000 7f5798a00640 1 -- 172.21.15.18:0/447227673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5794068bc0 msgr2=0x7f5794073900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.111+0000 7f5798a00640 1 --2- 172.21.15.18:0/447227673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5794068bc0 0x7f5794073900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.111+0000 7f5798a00640 1 -- 172.21.15.18:0/447227673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f579410ac10 msgr2=0x7f579406cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.111+0000 7f5798a00640 1 --2- 172.21.15.18:0/447227673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f579410ac10 0x7f579406cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.111+0000 7f5798a00640 1 -- 172.21.15.18:0/447227673 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579406d530 con 0x7f57941008a0 2024-09-12T03:02:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.111+0000 7f5798a00640 1 --2- 172.21.15.18:0/447227673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57941008a0 0x7f5794073e60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f578000e9f0 tx=0x7f578000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.112+0000 7f5792000640 1 -- 172.21.15.18:0/447227673 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578000cd80 con 0x7f57941008a0 2024-09-12T03:02:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.112+0000 7f5792000640 1 -- 172.21.15.18:0/447227673 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5780005500 con 0x7f57941008a0 2024-09-12T03:02:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.112+0000 7f5792000640 1 -- 172.21.15.18:0/447227673 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780010690 con 0x7f57941008a0 2024-09-12T03:02:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.115+0000 7f579be00640 1 -- 172.21.15.18:0/447227673 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f579406d7c0 con 0x7f57941008a0 2024-09-12T03:02:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.115+0000 7f579be00640 1 -- 172.21.15.18:0/447227673 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57940716d0 con 0x7f57941008a0 2024-09-12T03:02:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.121+0000 7f579edbd740 1 Processor -- start 2024-09-12T03:02:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.121+0000 7f579edbd740 1 -- start start 2024-09-12T03:02:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.122+0000 7f579edbd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f31e0 0x5560e65f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.122+0000 7f579edbd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f3b00 0x5560e65fde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.122+0000 7f579edbd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65fe3a0 0x5560e6600790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.122+0000 7f579edbd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5560e6559100 con 0x5560e65f3b00 2024-09-12T03:02:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.122+0000 7f579edbd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5560e65011b0 con 0x5560e65fe3a0 2024-09-12T03:02:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.122+0000 7f579edbd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5560e65550c0 con 0x5560e65f31e0 2024-09-12T03:02:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.122+0000 7f5799e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f31e0 0x5560e65f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.122+0000 7f5799e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f31e0 0x5560e65f35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:45714/0 (socket says 172.21.15.18:45714) 2024-09-12T03:02:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.122+0000 7f5799e00640 1 -- 172.21.15.18:0/14844693 learned_addr learned my addr 172.21.15.18:0/14844693 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.122+0000 7f5799e00640 1 -- 172.21.15.18:0/14844693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65fe3a0 msgr2=0x5560e6600790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T03:02:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.122+0000 7f5799e00640 1 --2- 172.21.15.18:0/14844693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65fe3a0 0x5560e6600790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.122+0000 7f5799e00640 1 -- 172.21.15.18:0/14844693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f3b00 msgr2=0x5560e65fde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.122+0000 7f5799e00640 1 --2- 172.21.15.18:0/14844693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f3b00 0x5560e65fde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.122+0000 7f5799e00640 1 -- 172.21.15.18:0/14844693 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560e626c210 con 0x5560e65f31e0 2024-09-12T03:02:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.125+0000 7f5792000640 1 -- 172.21.15.18:0/447227673 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f57800046c0 con 0x7f57941008a0 2024-09-12T03:02:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.125+0000 7f5799e00640 1 --2- 172.21.15.18:0/14844693 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f31e0 0x5560e65f35c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f578c009f00 tx=0x7f578c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4916540d8d7885f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.126+0000 7f5786600640 1 -- 172.21.15.18:0/14844693 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c003b70 con 0x5560e65f31e0 2024-09-12T03:02:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.127+0000 7f5786600640 1 -- 172.21.15.18:0/14844693 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f578c003d10 con 0x5560e65f31e0 2024-09-12T03:02:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.127+0000 7f5786600640 1 -- 172.21.15.18:0/14844693 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c011ab0 con 0x5560e65f31e0 2024-09-12T03:02:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.128+0000 7f579edbd740 1 -- 172.21.15.18:0/14844693 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f31e0 msgr2=0x5560e65f35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.128+0000 7f5792000640 1 --2- 172.21.15.18:0/447227673 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f577c0a2e70 0x7f577c0a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.128+0000 7f579edbd740 1 --2- 172.21.15.18:0/14844693 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f31e0 0x5560e65f35c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f578c009f00 tx=0x7f578c0107a0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.129+0000 7f579edbd740 1 -- 172.21.15.18:0/14844693 shutdown_connections 2024-09-12T03:02:50.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.129+0000 7f579edbd740 1 --2- 172.21.15.18:0/14844693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65fe3a0 0x5560e6600790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.129+0000 7f579edbd740 1 --2- 172.21.15.18:0/14844693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f3b00 0x5560e65fde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.129+0000 7f579edbd740 1 --2- 172.21.15.18:0/14844693 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f31e0 0x5560e65f35c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.129+0000 7f579edbd740 1 -- 172.21.15.18:0/14844693 >> 172.21.15.18:0/14844693 conn(0x5560e65ef750 msgr2=0x5560e65efb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:50.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.129+0000 7f579edbd740 1 -- 172.21.15.18:0/14844693 shutdown_connections 2024-09-12T03:02:50.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.129+0000 7f5799400640 1 --2- 172.21.15.18:0/447227673 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f577c0a2e70 0x7f577c0a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:50.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.129+0000 7f579edbd740 1 -- 172.21.15.18:0/14844693 wait complete. 2024-09-12T03:02:50.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.130+0000 7f5792000640 1 -- 172.21.15.18:0/447227673 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 9718+0+0 (secure 0 0 0) 0x7f57800cfe10 con 0x7f57941008a0 2024-09-12T03:02:50.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.130+0000 7f579edbd740 1 -- start start 2024-09-12T03:02:50.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.131+0000 7f579edbd740 1 Processor -- start 2024-09-12T03:02:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.132+0000 7f579edbd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f31e0 0x5560e65fb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.132+0000 7f579edbd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f3b00 0x5560e65fb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.132+0000 7f579edbd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65fe3a0 0x5560e65fbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.132+0000 7f579edbd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5560e6600f70 con 0x5560e65f3b00 2024-09-12T03:02:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.132+0000 7f579edbd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5560e64e2090 con 0x5560e65fe3a0 2024-09-12T03:02:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.132+0000 7f579edbd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5560e66010f0 con 0x5560e65f31e0 2024-09-12T03:02:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.132+0000 7f579edbd740 10 client.0 _ll_register_callbacks cb 0x5560e6536f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:02:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.132+0000 7f5798a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f3b00 0x5560e65fb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.132+0000 7f5798a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f3b00 0x5560e65fb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40764/0 (socket says 172.21.15.18:40764) 2024-09-12T03:02:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.132+0000 7f5798a00640 1 -- 172.21.15.18:0/1081299725 learned_addr learned my addr 172.21.15.18:0/1081299725 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.133+0000 7f5799e00640 1 --2- 172.21.15.18:0/1081299725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65fe3a0 0x5560e65fbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.133+0000 7f5798a00640 1 -- 172.21.15.18:0/1081299725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f31e0 msgr2=0x5560e65fb460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T03:02:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.133+0000 7f5798a00640 1 --2- 172.21.15.18:0/1081299725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f31e0 0x5560e65fb460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.133+0000 7f5798a00640 1 -- 172.21.15.18:0/1081299725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65fe3a0 msgr2=0x5560e65fbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.133+0000 7f5798a00640 1 --2- 172.21.15.18:0/1081299725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65fe3a0 0x5560e65fbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.133+0000 7f5798a00640 1 -- 172.21.15.18:0/1081299725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560e6338620 con 0x5560e65f3b00 2024-09-12T03:02:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.134+0000 7f5798a00640 1 --2- 172.21.15.18:0/1081299725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f3b00 0x5560e65fb9a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f57800cd6b0 tx=0x7f578009c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff322c647176925 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.134+0000 7f577aa00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T03:02:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.134+0000 7f5799400640 1 --2- 172.21.15.18:0/447227673 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f577c0a2e70 0x7f577c0a5330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5788000c00 tx=0x7f578803c040 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.134+0000 7f577aa00640 1 -- 172.21.15.18:0/1081299725 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57800a4af0 con 0x5560e65f3b00 2024-09-12T03:02:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.134+0000 7f577aa00640 1 -- 172.21.15.18:0/1081299725 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9718+0+0 (secure 0 0 0) 0x7f57800984f0 con 0x5560e65f3b00 2024-09-12T03:02:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.138+0000 7f579edbd740 1 -- 172.21.15.18:0/1081299725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f578c003d10 con 0x5560e65f3b00 2024-09-12T03:02:50.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.138+0000 7f577aa00640 1 -- 172.21.15.18:0/1081299725 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f578009b2d0 con 0x5560e65f3b00 2024-09-12T03:02:50.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.138+0000 7f579edbd740 10 client.16077 fetch_fsmap learned FSMap version 73 2024-09-12T03:02:50.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.138+0000 7f579edbd740 1 -- 172.21.15.18:0/1081299725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x5560e66154c0 con 0x5560e65f3b00 2024-09-12T03:02:50.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.138+0000 7f577aa00640 1 -- 172.21.15.18:0/1081299725 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f578c003d10 con 0x5560e65f3b00 2024-09-12T03:02:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.140+0000 7f577aa00640 1 -- 172.21.15.18:0/1081299725 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 73) ==== 8434+0+0 (secure 0 0 0) 0x7f57800bac50 con 0x5560e65f3b00 2024-09-12T03:02:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.140+0000 7f579edbd740 10 client.16077 fetch_fsmap finished waiting for FSMap version 73 2024-09-12T03:02:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.140+0000 7f579edbd740 10 client.16077 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:02:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.140+0000 7f579edbd740 20 client.16077 populate_metadata read hostname 'smithi018' 2024-09-12T03:02:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.140+0000 7f579edbd740 1 --2- 172.21.15.18:0/1081299725 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5560e66169d0 0x5560e6618e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.140+0000 7f579edbd740 4 client.16077 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:02:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.140+0000 7f579edbd740 1 -- 172.21.15.18:0/1081299725 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560e6566830 con 0x5560e66169d0 2024-09-12T03:02:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.140+0000 7f5799400640 1 --2- 172.21.15.18:0/1081299725 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5560e66169d0 0x5560e6618e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.141+0000 7f5799400640 1 --2- 172.21.15.18:0/1081299725 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5560e66169d0 0x5560e6618e00 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7ebfc7d6c6dfea0 server_cookie=973c33260595a1a8 in_seq=0 out_seq=0 2024-09-12T03:02:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.141+0000 7f577aa00640 10 client.16077 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:02:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.151+0000 7f577aa00640 1 -- 172.21.15.18:0/1081299725 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560e6566830 con 0x5560e66169d0 2024-09-12T03:02:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.151+0000 7f577aa00640 10 client.16077 handle_command_reply: tid=0 2024-09-12T03:02:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.151+0000 7f579edbd740 1 client.16077 shutdown 2024-09-12T03:02:50.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.152+0000 7f579edbd740 1 -- 172.21.15.18:0/1081299725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f3b00 msgr2=0x5560e65fb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:50.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.152+0000 7f579edbd740 1 --2- 172.21.15.18:0/1081299725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f3b00 0x5560e65fb9a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f57800cd6b0 tx=0x7f578009c580 comp rx=0 tx=0).stop 2024-09-12T03:02:50.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.152+0000 7f579edbd740 1 -- 172.21.15.18:0/1081299725 shutdown_connections 2024-09-12T03:02:50.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.152+0000 7f579edbd740 1 --2- 172.21.15.18:0/1081299725 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5560e66169d0 0x5560e6618e00 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.152+0000 7f579edbd740 1 --2- 172.21.15.18:0/1081299725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65fe3a0 0x5560e65fbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.152+0000 7f579edbd740 1 --2- 172.21.15.18:0/1081299725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f3b00 0x5560e65fb9a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.152+0000 7f579edbd740 1 --2- 172.21.15.18:0/1081299725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f31e0 0x5560e65fb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.152+0000 7f577aa00640 0 client.16077 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:02:50.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.152+0000 7f579edbd740 1 -- 172.21.15.18:0/1081299725 >> 172.21.15.18:0/1081299725 conn(0x5560e65ef750 msgr2=0x5560e65f54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:50.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.152+0000 7f579edbd740 1 -- 172.21.15.18:0/1081299725 shutdown_connections 2024-09-12T03:02:50.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.153+0000 7f579edbd740 1 -- 172.21.15.18:0/1081299725 wait complete. 2024-09-12T03:02:50.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.153+0000 7f579edbd740 20 client.16077 trim_cache size 0 max 16384 2024-09-12T03:02:50.196 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.195+0000 7f579edbd740 1 Processor -- start 2024-09-12T03:02:50.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.195+0000 7f579edbd740 1 -- start start 2024-09-12T03:02:50.197 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.196+0000 7f579edbd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65f31e0 0x5560e65f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.196+0000 7f579edbd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f3b00 0x5560e661e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.197+0000 7f579edbd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65fe3a0 0x5560e661ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.197+0000 7f579edbd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f57941b5620 con 0x5560e65fe3a0 2024-09-12T03:02:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.197+0000 7f579edbd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f57941b7400 con 0x5560e65f31e0 2024-09-12T03:02:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.197+0000 7f579edbd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f57941b5db0 con 0x5560e65f3b00 2024-09-12T03:02:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.197+0000 7f5798a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f3b00 0x5560e661e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.197+0000 7f5798a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f3b00 0x5560e661e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:45722/0 (socket says 172.21.15.18:45722) 2024-09-12T03:02:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.197+0000 7f5798a00640 1 -- 172.21.15.18:0/1260176018 learned_addr learned my addr 172.21.15.18:0/1260176018 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.197+0000 7f5799400640 1 --2- 172.21.15.18:0/1260176018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65f31e0 0x5560e65f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.197+0000 7f5799e00640 1 --2- 172.21.15.18:0/1260176018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65fe3a0 0x5560e661ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.198+0000 7f5798a00640 1 -- 172.21.15.18:0/1260176018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65f31e0 msgr2=0x5560e65f53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.198+0000 7f5798a00640 1 --2- 172.21.15.18:0/1260176018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65f31e0 0x5560e65f53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.198+0000 7f5798a00640 1 -- 172.21.15.18:0/1260176018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65fe3a0 msgr2=0x5560e661ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.198+0000 7f5798a00640 1 --2- 172.21.15.18:0/1260176018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65fe3a0 0x5560e661ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.198+0000 7f5798a00640 1 -- 172.21.15.18:0/1260176018 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560e65ead60 con 0x5560e65f3b00 2024-09-12T03:02:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.198+0000 7f5798a00640 1 --2- 172.21.15.18:0/1260176018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f3b00 0x5560e661e6d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f57800982e0 tx=0x7f578009a390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16e6f082cbd4e803 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.200+0000 7f5785c00640 1 -- 172.21.15.18:0/1260176018 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57800a4af0 con 0x5560e65f3b00 2024-09-12T03:02:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.200+0000 7f5785c00640 1 -- 172.21.15.18:0/1260176018 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57800cd330 con 0x5560e65f3b00 2024-09-12T03:02:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.200+0000 7f5785c00640 1 -- 172.21.15.18:0/1260176018 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780098120 con 0x5560e65f3b00 2024-09-12T03:02:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.201+0000 7f579edbd740 1 -- 172.21.15.18:0/1260176018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f3b00 msgr2=0x5560e661e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.201+0000 7f579edbd740 1 --2- 172.21.15.18:0/1260176018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f3b00 0x5560e661e6d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f57800982e0 tx=0x7f578009a390 comp rx=0 tx=0).stop 2024-09-12T03:02:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.201+0000 7f579edbd740 1 -- 172.21.15.18:0/1260176018 shutdown_connections 2024-09-12T03:02:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.201+0000 7f579edbd740 1 --2- 172.21.15.18:0/1260176018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65fe3a0 0x5560e661ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.201+0000 7f579edbd740 1 --2- 172.21.15.18:0/1260176018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f3b00 0x5560e661e6d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.201+0000 7f579edbd740 1 --2- 172.21.15.18:0/1260176018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65f31e0 0x5560e65f53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.201+0000 7f579edbd740 1 -- 172.21.15.18:0/1260176018 >> 172.21.15.18:0/1260176018 conn(0x5560e65ef750 msgr2=0x5560e65f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.202+0000 7f579edbd740 1 -- 172.21.15.18:0/1260176018 shutdown_connections 2024-09-12T03:02:50.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.202+0000 7f579edbd740 1 -- 172.21.15.18:0/1260176018 wait complete. 2024-09-12T03:02:50.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.202+0000 7f579edbd740 1 -- start start 2024-09-12T03:02:50.204 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.203+0000 7f579edbd740 1 Processor -- start 2024-09-12T03:02:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.205+0000 7f579edbd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f31e0 0x5560e660a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.205+0000 7f579edbd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f3b00 0x5560e660adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.205+0000 7f579edbd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65fe3a0 0x5560e660b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.206+0000 7f579edbd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f57941b6c70 con 0x5560e65f31e0 2024-09-12T03:02:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.206+0000 7f5798a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f3b00 0x5560e660adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.206+0000 7f579edbd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f57941b6540 con 0x5560e65fe3a0 2024-09-12T03:02:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.206+0000 7f579edbd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f57941b36b0 con 0x5560e65f3b00 2024-09-12T03:02:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.206+0000 7f579edbd740 10 client.0 _ll_register_callbacks cb 0x7f5780004ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:02:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.206+0000 7f5799400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f31e0 0x5560e660a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.206+0000 7f5798a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f3b00 0x5560e660adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:45732/0 (socket says 172.21.15.18:45732) 2024-09-12T03:02:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.206+0000 7f5799400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f31e0 0x5560e660a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40776/0 (socket says 172.21.15.18:40776) 2024-09-12T03:02:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.206+0000 7f5799400640 1 -- 172.21.15.18:0/1127148636 learned_addr learned my addr 172.21.15.18:0/1127148636 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:02:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.206+0000 7f5799e00640 1 --2- 172.21.15.18:0/1127148636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65fe3a0 0x5560e660b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.207+0000 7f5799400640 1 -- 172.21.15.18:0/1127148636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f3b00 msgr2=0x5560e660adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.207+0000 7f5799400640 1 --2- 172.21.15.18:0/1127148636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f3b00 0x5560e660adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.207+0000 7f5799400640 1 -- 172.21.15.18:0/1127148636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65fe3a0 msgr2=0x5560e660b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.207+0000 7f5799400640 1 --2- 172.21.15.18:0/1127148636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65fe3a0 0x5560e660b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.207+0000 7f5799400640 1 -- 172.21.15.18:0/1127148636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560e66806a0 con 0x5560e65f31e0 2024-09-12T03:02:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.208+0000 7f5798a00640 1 --2- 172.21.15.18:0/1127148636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f3b00 0x5560e660adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:02:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.208+0000 7f5799400640 1 --2- 172.21.15.18:0/1127148636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f31e0 0x5560e660a8b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5788009900 tx=0x7f5788009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b83e2f2f15b72b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.208+0000 7f577aa00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T03:02:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.209+0000 7f577aa00640 1 -- 172.21.15.18:0/1127148636 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5788035050 con 0x5560e65f31e0 2024-09-12T03:02:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.209+0000 7f577aa00640 1 -- 172.21.15.18:0/1127148636 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9718+0+0 (secure 0 0 0) 0x7f5788005450 con 0x5560e65f31e0 2024-09-12T03:02:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.209+0000 7f579edbd740 1 -- 172.21.15.18:0/1127148636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57800cd330 con 0x5560e65f31e0 2024-09-12T03:02:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.210+0000 7f577aa00640 1 -- 172.21.15.18:0/1127148636 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f578805e050 con 0x5560e65f31e0 2024-09-12T03:02:50.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.211+0000 7f579edbd740 10 client.16080 fetch_fsmap learned FSMap version 73 2024-09-12T03:02:50.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.211+0000 7f579edbd740 1 -- 172.21.15.18:0/1127148636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x5560e66819c0 con 0x5560e65f31e0 2024-09-12T03:02:50.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.211+0000 7f577aa00640 1 -- 172.21.15.18:0/1127148636 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57800cd330 con 0x5560e65f31e0 2024-09-12T03:02:50.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.211+0000 7f577aa00640 1 -- 172.21.15.18:0/1127148636 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 73) ==== 8434+0+0 (secure 0 0 0) 0x7f5788003a70 con 0x5560e65f31e0 2024-09-12T03:02:50.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.212+0000 7f579edbd740 10 client.16080 fetch_fsmap finished waiting for FSMap version 73 2024-09-12T03:02:50.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.212+0000 7f579edbd740 10 client.16080 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:02:50.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.212+0000 7f579edbd740 20 client.16080 populate_metadata read hostname 'smithi018' 2024-09-12T03:02:50.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.212+0000 7f579edbd740 1 --2- 172.21.15.18:0/1127148636 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5560e66821d0 0x5560e66845f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:50.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.212+0000 7f579edbd740 4 client.16080 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T03:02:50.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.212+0000 7f579edbd740 1 -- 172.21.15.18:0/1127148636 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5560e6560b80 con 0x5560e66821d0 2024-09-12T03:02:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.214+0000 7f5798a00640 1 --2- 172.21.15.18:0/1127148636 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5560e66821d0 0x5560e66845f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.219+0000 7f577aa00640 10 client.16080 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:02:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:50.219+0000 7f5798a00640 1 --2- 172.21.15.18:0/1127148636 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5560e66821d0 0x5560e66845f0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2a8caec64a526d9 server_cookie=3f191388123f42fb in_seq=0 out_seq=0 2024-09-12T03:02:50.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:50 smithi176 ceph-mon[35713]: pgmap v441: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 247 op/s 2024-09-12T03:02:50.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:50 smithi062 ceph-mon[35527]: pgmap v441: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 247 op/s 2024-09-12T03:02:50.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:50 smithi018 ceph-mon[30616]: pgmap v441: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 247 op/s 2024-09-12T03:02:52.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:52 smithi176 ceph-mon[35713]: pgmap v442: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 321 op/s 2024-09-12T03:02:52.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.746+0000 7f577aa00640 1 -- 172.21.15.18:0/1127148636 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5560e6560b80 con 0x5560e66821d0 2024-09-12T03:02:52.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.746+0000 7f577aa00640 10 client.16080 handle_command_reply: tid=0 2024-09-12T03:02:52.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.746+0000 7f579edbd740 1 client.16080 shutdown 2024-09-12T03:02:52.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.747+0000 7f579edbd740 1 -- 172.21.15.18:0/1127148636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f31e0 msgr2=0x5560e660a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:52.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.747+0000 7f579edbd740 1 --2- 172.21.15.18:0/1127148636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f31e0 0x5560e660a8b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5788009900 tx=0x7f5788009260 comp rx=0 tx=0).stop 2024-09-12T03:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.748+0000 7f579edbd740 1 -- 172.21.15.18:0/1127148636 shutdown_connections 2024-09-12T03:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.748+0000 7f579edbd740 1 --2- 172.21.15.18:0/1127148636 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x5560e66821d0 0x5560e66845f0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.748+0000 7f579edbd740 1 --2- 172.21.15.18:0/1127148636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560e65fe3a0 0x5560e660b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.748+0000 7f579edbd740 1 --2- 172.21.15.18:0/1127148636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560e65f3b00 0x5560e660adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.748+0000 7f579edbd740 1 --2- 172.21.15.18:0/1127148636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560e65f31e0 0x5560e660a8b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.748+0000 7f579edbd740 1 -- 172.21.15.18:0/1127148636 >> 172.21.15.18:0/1127148636 conn(0x5560e65ef750 msgr2=0x5560e65fbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.748+0000 7f577aa00640 0 client.16080 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.748+0000 7f579edbd740 1 -- 172.21.15.18:0/1127148636 shutdown_connections 2024-09-12T03:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.748+0000 7f579edbd740 1 -- 172.21.15.18:0/1127148636 wait complete. 2024-09-12T03:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.748+0000 7f579edbd740 20 client.16080 trim_cache size 0 max 16384 2024-09-12T03:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T03:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T03:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T03:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T03:02:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.750+0000 7f579be00640 1 -- 172.21.15.18:0/447227673 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f577c0a2e70 msgr2=0x7f577c0a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.750+0000 7f579be00640 1 --2- 172.21.15.18:0/447227673 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f577c0a2e70 0x7f577c0a5330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5788000c00 tx=0x7f578803c040 comp rx=0 tx=0).stop 2024-09-12T03:02:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.750+0000 7f579be00640 1 -- 172.21.15.18:0/447227673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57941008a0 msgr2=0x7f5794073e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.750+0000 7f579be00640 1 --2- 172.21.15.18:0/447227673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57941008a0 0x7f5794073e60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f578000e9f0 tx=0x7f578000edf0 comp rx=0 tx=0).stop 2024-09-12T03:02:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.750+0000 7f579be00640 1 -- 172.21.15.18:0/447227673 shutdown_connections 2024-09-12T03:02:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.750+0000 7f579be00640 1 --2- 172.21.15.18:0/447227673 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f577c0a2e70 0x7f577c0a5330 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.750+0000 7f579be00640 1 --2- 172.21.15.18:0/447227673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f579410ac10 0x7f579406cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.750+0000 7f579be00640 1 --2- 172.21.15.18:0/447227673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57941008a0 0x7f5794073e60 secure :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f578000e9f0 tx=0x7f578000edf0 comp rx=0 tx=0).stop 2024-09-12T03:02:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.750+0000 7f579be00640 1 --2- 172.21.15.18:0/447227673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5794068bc0 0x7f5794073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.750+0000 7f579be00640 1 -- 172.21.15.18:0/447227673 >> 172.21.15.18:0/447227673 conn(0x7f57940fba30 msgr2=0x7f579410b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.750+0000 7f579be00640 1 -- 172.21.15.18:0/447227673 shutdown_connections 2024-09-12T03:02:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:02:52.750+0000 7f579be00640 1 -- 172.21.15.18:0/447227673 wait complete. 2024-09-12T03:02:52.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:52 smithi062 ceph-mon[35527]: pgmap v442: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 321 op/s 2024-09-12T03:02:52.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:52 smithi018 ceph-mon[30616]: pgmap v442: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 321 op/s 2024-09-12T03:02:54.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:54 smithi062 ceph-mon[35527]: pgmap v443: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 893 KiB/s wr, 245 op/s 2024-09-12T03:02:54.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:54 smithi018 ceph-mon[30616]: pgmap v443: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 893 KiB/s wr, 245 op/s 2024-09-12T03:02:54.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:54 smithi176 ceph-mon[35713]: pgmap v443: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 893 KiB/s wr, 245 op/s 2024-09-12T03:02:56.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:56 smithi062 ceph-mon[35527]: pgmap v444: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 1.1 MiB/s wr, 299 op/s 2024-09-12T03:02:56.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:56 smithi062 ceph-mon[35527]: osdmap e115: 12 total, 12 up, 12 in 2024-09-12T03:02:56.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:56 smithi018 ceph-mon[30616]: pgmap v444: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 1.1 MiB/s wr, 299 op/s 2024-09-12T03:02:56.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:56 smithi018 ceph-mon[30616]: osdmap e115: 12 total, 12 up, 12 in 2024-09-12T03:02:56.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:56 smithi176 ceph-mon[35713]: pgmap v444: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 1.1 MiB/s wr, 299 op/s 2024-09-12T03:02:56.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:56 smithi176 ceph-mon[35713]: osdmap e115: 12 total, 12 up, 12 in 2024-09-12T03:02:58.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:02:58 smithi062 ceph-mon[35527]: pgmap v446: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 972 KiB/s wr, 304 op/s 2024-09-12T03:02:58.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:02:58 smithi018 ceph-mon[30616]: pgmap v446: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 972 KiB/s wr, 304 op/s 2024-09-12T03:02:58.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:02:58 smithi176 ceph-mon[35713]: pgmap v446: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 972 KiB/s wr, 304 op/s 2024-09-12T03:03:00.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:00 smithi062 ceph-mon[35527]: pgmap v447: 129 pgs: 52 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 58 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 980 KiB/s wr, 314 op/s 2024-09-12T03:03:00.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:00 smithi018 ceph-mon[30616]: pgmap v447: 129 pgs: 52 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 58 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 980 KiB/s wr, 314 op/s 2024-09-12T03:03:00.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:00 smithi176 ceph-mon[35713]: pgmap v447: 129 pgs: 52 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 58 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 980 KiB/s wr, 314 op/s 2024-09-12T03:03:02.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:02 smithi018 ceph-mon[30616]: pgmap v448: 129 pgs: 52 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 58 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 784 KiB/s wr, 292 op/s 2024-09-12T03:03:02.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:02 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:03:02.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:02 smithi176 ceph-mon[35713]: pgmap v448: 129 pgs: 52 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 58 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 784 KiB/s wr, 292 op/s 2024-09-12T03:03:02.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:02 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:03:03.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:02 smithi062 ceph-mon[35527]: pgmap v448: 129 pgs: 52 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 58 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 784 KiB/s wr, 292 op/s 2024-09-12T03:03:03.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:02 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:03:03.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:03 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T03:03:03.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:03 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T03:03:04.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:03 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T03:03:04.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:04 smithi018 ceph-mon[30616]: pgmap v449: 129 pgs: 52 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 58 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 723 KiB/s wr, 293 op/s 2024-09-12T03:03:04.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:04 smithi176 ceph-mon[35713]: pgmap v449: 129 pgs: 52 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 58 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 723 KiB/s wr, 293 op/s 2024-09-12T03:03:05.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:04 smithi062 ceph-mon[35527]: pgmap v449: 129 pgs: 52 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 58 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 723 KiB/s wr, 293 op/s 2024-09-12T03:03:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:05 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T03:03:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:05 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T03:03:05.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:05 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T03:03:05.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:05 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T03:03:05.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:05 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T03:03:05.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:05 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T03:03:05.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.969+0000 7fa4fa400640 1 -- 172.21.15.18:0/3572424850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4f4102480 msgr2=0x7fa4f410e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:05.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.969+0000 7fa4fa400640 1 --2- 172.21.15.18:0/3572424850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4f4102480 0x7fa4f410e9b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec009cd0 tx=0x7fa4ec02a8f0 comp rx=0 tx=0).stop 2024-09-12T03:03:05.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.972+0000 7fa4fa400640 1 -- 172.21.15.18:0/3572424850 shutdown_connections 2024-09-12T03:03:05.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.972+0000 7fa4fa400640 1 --2- 172.21.15.18:0/3572424850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4f4102480 0x7fa4f410e9b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:05.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.972+0000 7fa4fa400640 1 --2- 172.21.15.18:0/3572424850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4f4101ae0 0x7fa4f4101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.972+0000 7fa4fa400640 1 --2- 172.21.15.18:0/3572424850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4f4107b80 0x7fa4f4107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.972+0000 7fa4fa400640 1 -- 172.21.15.18:0/3572424850 >> 172.21.15.18:0/3572424850 conn(0x7fa4f40fd7e0 msgr2=0x7fa4f40ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.975+0000 7fa4fa400640 1 -- 172.21.15.18:0/3572424850 shutdown_connections 2024-09-12T03:03:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.975+0000 7fa4fa400640 1 -- 172.21.15.18:0/3572424850 wait complete. 2024-09-12T03:03:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.977+0000 7fa4fa400640 1 Processor -- start 2024-09-12T03:03:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.977+0000 7fa4fa400640 1 -- start start 2024-09-12T03:03:05.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:05 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T03:03:05.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:05 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T03:03:05.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:05 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T03:03:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.978+0000 7fa4fa400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4f4101ae0 0x7fa4f406f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.978+0000 7fa4fa400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4f4102480 0x7fa4f406fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.978+0000 7fa4fa400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4f4107b80 0x7fa4f410da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.978+0000 7fa4fa400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f4111f30 con 0x7fa4f4101ae0 2024-09-12T03:03:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.978+0000 7fa4fa400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f4111db0 con 0x7fa4f4102480 2024-09-12T03:03:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.978+0000 7fa4fa400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f41120b0 con 0x7fa4f4107b80 2024-09-12T03:03:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.978+0000 7fa4f3e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4f4107b80 0x7fa4f410da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.978+0000 7fa4f3e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4f4107b80 0x7fa4f410da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:55888/0 (socket says 172.21.15.18:55888) 2024-09-12T03:03:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.978+0000 7fa4f3e00640 1 -- 172.21.15.18:0/1285873072 learned_addr learned my addr 172.21.15.18:0/1285873072 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.978+0000 7fa4f2a00640 1 --2- 172.21.15.18:0/1285873072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4f4102480 0x7fa4f406fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.979+0000 7fa4f3e00640 1 -- 172.21.15.18:0/1285873072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4f4102480 msgr2=0x7fa4f406fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.979+0000 7fa4f3e00640 1 --2- 172.21.15.18:0/1285873072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4f4102480 0x7fa4f406fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.979+0000 7fa4f3e00640 1 -- 172.21.15.18:0/1285873072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4f4101ae0 msgr2=0x7fa4f406f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.979+0000 7fa4f3e00640 1 --2- 172.21.15.18:0/1285873072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4f4101ae0 0x7fa4f406f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.979+0000 7fa4f3e00640 1 -- 172.21.15.18:0/1285873072 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f410e300 con 0x7fa4f4107b80 2024-09-12T03:03:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.979+0000 7fa4f3e00640 1 --2- 172.21.15.18:0/1285873072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4f4107b80 0x7fa4f410da40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec009bf0 tx=0x7fa4ec030b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.980+0000 7fa4ebe00640 1 -- 172.21.15.18:0/1285873072 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec004240 con 0x7fa4f4107b80 2024-09-12T03:03:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.980+0000 7fa4ebe00640 1 -- 172.21.15.18:0/1285873072 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4ec040070 con 0x7fa4f4107b80 2024-09-12T03:03:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.980+0000 7fa4ebe00640 1 -- 172.21.15.18:0/1285873072 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec004240 con 0x7fa4f4107b80 2024-09-12T03:03:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.980+0000 7fa4fa400640 1 -- 172.21.15.18:0/1285873072 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f410e590 con 0x7fa4f4107b80 2024-09-12T03:03:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.980+0000 7fa4fa400640 1 -- 172.21.15.18:0/1285873072 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f4073350 con 0x7fa4f4107b80 2024-09-12T03:03:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.991+0000 7fa4ebe00640 1 -- 172.21.15.18:0/1285873072 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fa4ec0043e0 con 0x7fa4f4107b80 2024-09-12T03:03:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.991+0000 7fa4fd22c740 1 Processor -- start 2024-09-12T03:03:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.993+0000 7fa4fd22c740 1 -- start start 2024-09-12T03:03:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.993+0000 7fa4fd22c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b001e0 0x55d080b005c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.993+0000 7fa4fd22c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b00b00 0x55d080b0ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.993+0000 7fa4fd22c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b0b3a0 0x55d080b0d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.993+0000 7fa4fd22c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d080a66100 con 0x55d080b00b00 2024-09-12T03:03:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.993+0000 7fa4fd22c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d080a0e1b0 con 0x55d080b0b3a0 2024-09-12T03:03:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.993+0000 7fa4fd22c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d080a620c0 con 0x55d080b001e0 2024-09-12T03:03:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.994+0000 7fa4ebe00640 1 --2- 172.21.15.18:0/1285873072 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fa4d80a3070 0x7fa4d80a5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.995+0000 7fa4f2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b001e0 0x55d080b005c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.995+0000 7fa4f2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b001e0 0x55d080b005c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:55894/0 (socket says 172.21.15.18:55894) 2024-09-12T03:03:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.995+0000 7fa4f2a00640 1 -- 172.21.15.18:0/4127506147 learned_addr learned my addr 172.21.15.18:0/4127506147 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.995+0000 7fa4f2a00640 1 --2- 172.21.15.18:0/4127506147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b0b3a0 0x55d080b0d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.995+0000 7fa4ebe00640 1 -- 172.21.15.18:0/1285873072 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9718+0+0 (secure 0 0 0) 0x7fa4ec0f05b0 con 0x7fa4f4107b80 2024-09-12T03:03:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.996+0000 7fa4f3400640 1 --2- 172.21.15.18:0/4127506147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b00b00 0x55d080b0ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.996+0000 7fa4f3e00640 1 --2- 172.21.15.18:0/1285873072 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fa4d80a3070 0x7fa4d80a5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.997+0000 7fa4f2a00640 1 -- 172.21.15.18:0/4127506147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b0b3a0 msgr2=0x55d080b0d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:03:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.997+0000 7fa4f2a00640 1 --2- 172.21.15.18:0/4127506147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b0b3a0 0x55d080b0d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.997+0000 7fa4f2a00640 1 -- 172.21.15.18:0/4127506147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b00b00 msgr2=0x55d080b0ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:03:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.997+0000 7fa4f2a00640 1 --2- 172.21.15.18:0/4127506147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b00b00 0x55d080b0ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.997+0000 7fa4f2a00640 1 -- 172.21.15.18:0/4127506147 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d080779210 con 0x55d080b001e0 2024-09-12T03:03:05.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.998+0000 7fa4f2a00640 1 --2- 172.21.15.18:0/4127506147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b001e0 0x55d080b005c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0014990 tx=0x7fa4e000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3a2cf577d2d1f5e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:05.999+0000 7fa4f3e00640 1 --2- 172.21.15.18:0/1285873072 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fa4d80a3070 0x7fa4d80a5530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0edab0 tx=0x7fa4ec0095c0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.001+0000 7fa4e8c00640 1 -- 172.21.15.18:0/4127506147 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00142d0 con 0x55d080b001e0 2024-09-12T03:03:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.002+0000 7fa4e8c00640 1 -- 172.21.15.18:0/4127506147 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4e000fc40 con 0x55d080b001e0 2024-09-12T03:03:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.002+0000 7fa4e8c00640 1 -- 172.21.15.18:0/4127506147 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0012a20 con 0x55d080b001e0 2024-09-12T03:03:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.004+0000 7fa4fd22c740 1 -- 172.21.15.18:0/4127506147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b001e0 msgr2=0x55d080b005c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.004+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/4127506147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b001e0 0x55d080b005c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0014990 tx=0x7fa4e000c490 comp rx=0 tx=0).stop 2024-09-12T03:03:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.005+0000 7fa4fd22c740 1 -- 172.21.15.18:0/4127506147 shutdown_connections 2024-09-12T03:03:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.005+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/4127506147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b0b3a0 0x55d080b0d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.005+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/4127506147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b00b00 0x55d080b0ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.005+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/4127506147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b001e0 0x55d080b005c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.005+0000 7fa4fd22c740 1 -- 172.21.15.18:0/4127506147 >> 172.21.15.18:0/4127506147 conn(0x55d080afc750 msgr2=0x55d080afcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.008+0000 7fa4fd22c740 1 -- 172.21.15.18:0/4127506147 shutdown_connections 2024-09-12T03:03:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.008+0000 7fa4fd22c740 1 -- 172.21.15.18:0/4127506147 wait complete. 2024-09-12T03:03:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.008+0000 7fa4fd22c740 1 -- start start 2024-09-12T03:03:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.009+0000 7fa4fd22c740 1 Processor -- start 2024-09-12T03:03:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.010+0000 7fa4fd22c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b001e0 0x55d080b082c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.010+0000 7fa4fd22c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b00b00 0x55d080b08800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.010+0000 7fa4fd22c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b0b3a0 0x55d080b08d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.010+0000 7fa4fd22c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d080b0dfc0 con 0x55d080b0b3a0 2024-09-12T03:03:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.010+0000 7fa4fd22c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d0809ef090 con 0x55d080b001e0 2024-09-12T03:03:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.010+0000 7fa4fd22c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d080b0e140 con 0x55d080b00b00 2024-09-12T03:03:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.010+0000 7fa4fd22c740 10 client.0 _ll_register_callbacks cb 0x55d080a43f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:03:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.011+0000 7fa4f2a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b001e0 0x55d080b082c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.011+0000 7fa4f2a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b001e0 0x55d080b082c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:34594/0 (socket says 172.21.15.18:34594) 2024-09-12T03:03:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.011+0000 7fa4f3400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b00b00 0x55d080b08800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.011+0000 7fa4f3400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b00b00 0x55d080b08800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:55906/0 (socket says 172.21.15.18:55906) 2024-09-12T03:03:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.011+0000 7fa4f3400640 1 -- 172.21.15.18:0/2144587376 learned_addr learned my addr 172.21.15.18:0/2144587376 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:06.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.012+0000 7fa4f3400640 1 -- 172.21.15.18:0/2144587376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b001e0 msgr2=0x55d080b082c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:03:06.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.012+0000 7fa4f3400640 1 --2- 172.21.15.18:0/2144587376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b001e0 0x55d080b082c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.012+0000 7fa4f3400640 1 -- 172.21.15.18:0/2144587376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b0b3a0 msgr2=0x55d080b08d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:03:06.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.012+0000 7fa4f3400640 1 --2- 172.21.15.18:0/2144587376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b0b3a0 0x55d080b08d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.012+0000 7fa4f3400640 1 -- 172.21.15.18:0/2144587376 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d080845620 con 0x55d080b00b00 2024-09-12T03:03:06.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.013+0000 7fa4f3400640 1 --2- 172.21.15.18:0/2144587376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b00b00 0x55d080b08800 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400d410 tx=0x7fa4e400d8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f31be2828afc0cba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:06.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.013+0000 7fa4dd600640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T03:03:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.014+0000 7fa4dd600640 1 -- 172.21.15.18:0/2144587376 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4004220 con 0x55d080b00b00 2024-09-12T03:03:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.014+0000 7fa4dd600640 1 -- 172.21.15.18:0/2144587376 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9718+0+0 (secure 0 0 0) 0x7fa4e40043c0 con 0x55d080b00b00 2024-09-12T03:03:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.015+0000 7fa4fd22c740 1 -- 172.21.15.18:0/2144587376 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4e000fc40 con 0x55d080b00b00 2024-09-12T03:03:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.015+0000 7fa4dd600640 1 -- 172.21.15.18:0/2144587376 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fa4e400f6f0 con 0x55d080b00b00 2024-09-12T03:03:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.016+0000 7fa4fd22c740 10 client.26137 fetch_fsmap learned FSMap version 74 2024-09-12T03:03:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.016+0000 7fa4fd22c740 1 -- 172.21.15.18:0/2144587376 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x55d080b19be0 con 0x55d080b00b00 2024-09-12T03:03:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.018+0000 7fa4dd600640 1 -- 172.21.15.18:0/2144587376 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4e000fc40 con 0x55d080b00b00 2024-09-12T03:03:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.018+0000 7fa4dd600640 1 -- 172.21.15.18:0/2144587376 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 74) ==== 8438+0+0 (secure 0 0 0) 0x7fa4e4003cb0 con 0x55d080b00b00 2024-09-12T03:03:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.018+0000 7fa4fd22c740 10 client.26137 fetch_fsmap finished waiting for FSMap version 74 2024-09-12T03:03:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.018+0000 7fa4fd22c740 10 client.26137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:03:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.019+0000 7fa4fd22c740 20 client.26137 populate_metadata read hostname 'smithi018' 2024-09-12T03:03:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.019+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/2144587376 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d080b1b580 0x55d080b1d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.019+0000 7fa4fd22c740 4 client.26137 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:03:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.019+0000 7fa4fd22c740 1 -- 172.21.15.18:0/2144587376 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d080a73830 con 0x55d080b1b580 2024-09-12T03:03:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.020+0000 7fa4f2a00640 1 --2- 172.21.15.18:0/2144587376 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d080b1b580 0x55d080b1d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.020+0000 7fa4dd600640 10 client.26137 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:03:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.021+0000 7fa4f2a00640 1 --2- 172.21.15.18:0/2144587376 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d080b1b580 0x55d080b1d9c0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=935d37784c571509 server_cookie=c59cb4304f858b0 in_seq=0 out_seq=0 2024-09-12T03:03:06.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.023+0000 7fa4dd600640 1 -- 172.21.15.18:0/2144587376 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d080a73830 con 0x55d080b1b580 2024-09-12T03:03:06.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.023+0000 7fa4dd600640 10 client.26137 handle_command_reply: tid=0 2024-09-12T03:03:06.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.023+0000 7fa4fd22c740 1 client.26137 shutdown 2024-09-12T03:03:06.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.025+0000 7fa4fd22c740 1 -- 172.21.15.18:0/2144587376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b00b00 msgr2=0x55d080b08800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:06.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.025+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/2144587376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b00b00 0x55d080b08800 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400d410 tx=0x7fa4e400d8d0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.030+0000 7fa4fd22c740 1 -- 172.21.15.18:0/2144587376 shutdown_connections 2024-09-12T03:03:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.030+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/2144587376 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d080b1b580 0x55d080b1d9c0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.030+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/2144587376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b0b3a0 0x55d080b08d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.030+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/2144587376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b00b00 0x55d080b08800 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.030+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/2144587376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b001e0 0x55d080b082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.030+0000 7fa4dd600640 0 client.26137 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:03:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.030+0000 7fa4fd22c740 1 -- 172.21.15.18:0/2144587376 >> 172.21.15.18:0/2144587376 conn(0x55d080afc750 msgr2=0x55d080b024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.030+0000 7fa4fd22c740 1 -- 172.21.15.18:0/2144587376 shutdown_connections 2024-09-12T03:03:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.031+0000 7fa4fd22c740 1 -- 172.21.15.18:0/2144587376 wait complete. 2024-09-12T03:03:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.033+0000 7fa4fd22c740 20 client.26137 trim_cache size 0 max 16384 2024-09-12T03:03:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.065+0000 7fa4fd22c740 1 Processor -- start 2024-09-12T03:03:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.066+0000 7fa4fd22c740 1 -- start start 2024-09-12T03:03:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.068+0000 7fa4fd22c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b001e0 0x55d080b0a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.068+0000 7fa4fd22c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b00b00 0x55d080b05500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.068+0000 7fa4fd22c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b0b3a0 0x55d080b05a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.068+0000 7fa4fd22c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f41c6840 con 0x55d080b00b00 2024-09-12T03:03:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.068+0000 7fa4fd22c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f41c8620 con 0x55d080b001e0 2024-09-12T03:03:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.068+0000 7fa4fd22c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f41c6fd0 con 0x55d080b0b3a0 2024-09-12T03:03:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.070+0000 7fa4f2a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b001e0 0x55d080b0a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.070+0000 7fa4f2a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b001e0 0x55d080b0a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:34610/0 (socket says 172.21.15.18:34610) 2024-09-12T03:03:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.070+0000 7fa4f2a00640 1 -- 172.21.15.18:0/1897948286 learned_addr learned my addr 172.21.15.18:0/1897948286 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.070+0000 7fa4f2a00640 1 --2- 172.21.15.18:0/1897948286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b0b3a0 0x55d080b05a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.070+0000 7fa4f2a00640 1 -- 172.21.15.18:0/1897948286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b001e0 msgr2=0x55d080b0a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:03:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.070+0000 7fa4f2a00640 1 --2- 172.21.15.18:0/1897948286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b001e0 0x55d080b0a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.070+0000 7fa4f2a00640 1 -- 172.21.15.18:0/1897948286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b00b00 msgr2=0x55d080b05500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:03:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.070+0000 7fa4f2a00640 1 --2- 172.21.15.18:0/1897948286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b00b00 0x55d080b05500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.070+0000 7fa4f2a00640 1 -- 172.21.15.18:0/1897948286 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d080af7d60 con 0x55d080b0b3a0 2024-09-12T03:03:06.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.072+0000 7fa4f2a00640 1 --2- 172.21.15.18:0/1897948286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b0b3a0 0x55d080b05a40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0005fd0 tx=0x7fa4e00126e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e563e4156c9aac26 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.074+0000 7fa4dfe00640 1 -- 172.21.15.18:0/1897948286 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0012750 con 0x55d080b0b3a0 2024-09-12T03:03:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.074+0000 7fa4dfe00640 1 -- 172.21.15.18:0/1897948286 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4e0012dd0 con 0x55d080b0b3a0 2024-09-12T03:03:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.074+0000 7fa4dfe00640 1 -- 172.21.15.18:0/1897948286 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e002a2e0 con 0x55d080b0b3a0 2024-09-12T03:03:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.075+0000 7fa4fd22c740 1 -- 172.21.15.18:0/1897948286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b0b3a0 msgr2=0x55d080b05a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.075+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/1897948286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b0b3a0 0x55d080b05a40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0005fd0 tx=0x7fa4e00126e0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.075+0000 7fa4fd22c740 1 -- 172.21.15.18:0/1897948286 shutdown_connections 2024-09-12T03:03:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.075+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/1897948286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b0b3a0 0x55d080b05a40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.075+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/1897948286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b00b00 0x55d080b05500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.075+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/1897948286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b001e0 0x55d080b0a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.075+0000 7fa4fd22c740 1 -- 172.21.15.18:0/1897948286 >> 172.21.15.18:0/1897948286 conn(0x55d080afc750 msgr2=0x55d080b09a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.076+0000 7fa4fd22c740 1 -- 172.21.15.18:0/1897948286 shutdown_connections 2024-09-12T03:03:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.076+0000 7fa4fd22c740 1 -- 172.21.15.18:0/1897948286 wait complete. 2024-09-12T03:03:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.076+0000 7fa4fd22c740 1 -- start start 2024-09-12T03:03:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.077+0000 7fa4fd22c740 1 Processor -- start 2024-09-12T03:03:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.079+0000 7fa4fd22c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b001e0 0x55d080b23790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.079+0000 7fa4fd22c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b00b00 0x55d080b20b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:06.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.079+0000 7fa4fd22c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b0b3a0 0x55d080b21060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:06.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.079+0000 7fa4fd22c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f41c7e90 con 0x55d080b00b00 2024-09-12T03:03:06.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.079+0000 7fa4fd22c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f41c7760 con 0x55d080b0b3a0 2024-09-12T03:03:06.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.079+0000 7fa4fd22c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f41c4820 con 0x55d080b001e0 2024-09-12T03:03:06.081 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.079+0000 7fa4fd22c740 10 client.0 _ll_register_callbacks cb 0x7fa4e4005e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:03:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.080+0000 7fa4f2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b001e0 0x55d080b23790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.080+0000 7fa4f2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b001e0 0x55d080b23790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:55934/0 (socket says 172.21.15.18:55934) 2024-09-12T03:03:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.080+0000 7fa4f2a00640 1 -- 172.21.15.18:0/3380282210 learned_addr learned my addr 172.21.15.18:0/3380282210 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.080+0000 7fa4f2a00640 1 --2- 172.21.15.18:0/3380282210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b0b3a0 0x55d080b21060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.080+0000 7fa4f3400640 1 --2- 172.21.15.18:0/3380282210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b00b00 0x55d080b20b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.082+0000 7fa4f3400640 1 -- 172.21.15.18:0/3380282210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b001e0 msgr2=0x55d080b23790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:03:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.082+0000 7fa4f3400640 1 --2- 172.21.15.18:0/3380282210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b001e0 0x55d080b23790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.082+0000 7fa4f3400640 1 -- 172.21.15.18:0/3380282210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b0b3a0 msgr2=0x55d080b21060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:03:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.082+0000 7fa4f3400640 1 --2- 172.21.15.18:0/3380282210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b0b3a0 0x55d080b21060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.082+0000 7fa4f3400640 1 -- 172.21.15.18:0/3380282210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d080b21750 con 0x55d080b00b00 2024-09-12T03:03:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.083+0000 7fa4f3400640 1 --2- 172.21.15.18:0/3380282210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b00b00 0x55d080b20b20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55d080af7940 tx=0x7fa4e4021cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911be89fba1d3cfe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.083+0000 7fa4dd600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-12T03:03:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.084+0000 7fa4dd600640 1 -- 172.21.15.18:0/3380282210 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e400faa0 con 0x55d080b00b00 2024-09-12T03:03:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.085+0000 7fa4dd600640 1 -- 172.21.15.18:0/3380282210 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9718+0+0 (secure 0 0 0) 0x7fa4e400fc40 con 0x55d080b00b00 2024-09-12T03:03:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.085+0000 7fa4fd22c740 1 -- 172.21.15.18:0/3380282210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4e0012dd0 con 0x55d080b00b00 2024-09-12T03:03:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.086+0000 7fa4dd600640 1 -- 172.21.15.18:0/3380282210 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fa4e400fe40 con 0x55d080b00b00 2024-09-12T03:03:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.087+0000 7fa4fd22c740 10 client.16083 fetch_fsmap learned FSMap version 74 2024-09-12T03:03:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.088+0000 7fa4fd22c740 1 -- 172.21.15.18:0/3380282210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x55d080b86040 con 0x55d080b00b00 2024-09-12T03:03:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.088+0000 7fa4dd600640 1 -- 172.21.15.18:0/3380282210 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4e0012dd0 con 0x55d080b00b00 2024-09-12T03:03:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.089+0000 7fa4dd600640 1 -- 172.21.15.18:0/3380282210 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 74) ==== 8438+0+0 (secure 0 0 0) 0x7fa4e4017540 con 0x55d080b00b00 2024-09-12T03:03:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.089+0000 7fa4fd22c740 10 client.16083 fetch_fsmap finished waiting for FSMap version 74 2024-09-12T03:03:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.089+0000 7fa4fd22c740 10 client.16083 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:03:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.089+0000 7fa4fd22c740 20 client.16083 populate_metadata read hostname 'smithi018' 2024-09-12T03:03:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.089+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/3380282210 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d080b86820 0x55d080b88c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.089+0000 7fa4fd22c740 4 client.16083 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T03:03:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.089+0000 7fa4fd22c740 1 -- 172.21.15.18:0/3380282210 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d080a6db80 con 0x55d080b86820 2024-09-12T03:03:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.090+0000 7fa4f2a00640 1 --2- 172.21.15.18:0/3380282210 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d080b86820 0x55d080b88c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.094+0000 7fa4dd600640 10 client.16083 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:03:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.094+0000 7fa4f2a00640 1 --2- 172.21.15.18:0/3380282210 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d080b86820 0x55d080b88c40 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5601d9a8ceebc4ac server_cookie=b34437b2ba3b77d1 in_seq=0 out_seq=0 2024-09-12T03:03:06.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.788+0000 7fa4dd600640 1 -- 172.21.15.18:0/3380282210 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d080a6db80 con 0x55d080b86820 2024-09-12T03:03:06.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.788+0000 7fa4dd600640 10 client.16083 handle_command_reply: tid=0 2024-09-12T03:03:06.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.789+0000 7fa4fd22c740 1 client.16083 shutdown 2024-09-12T03:03:06.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.789+0000 7fa4fd22c740 1 -- 172.21.15.18:0/3380282210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b00b00 msgr2=0x55d080b20b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:06.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.789+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/3380282210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b00b00 0x55d080b20b20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55d080af7940 tx=0x7fa4e4021cf0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.789+0000 7fa4fd22c740 1 -- 172.21.15.18:0/3380282210 shutdown_connections 2024-09-12T03:03:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.789+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/3380282210 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55d080b86820 0x55d080b88c40 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.789+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/3380282210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d080b0b3a0 0x55d080b21060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.789+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/3380282210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d080b00b00 0x55d080b20b20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.789+0000 7fa4fd22c740 1 --2- 172.21.15.18:0/3380282210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d080b001e0 0x55d080b23790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.789+0000 7fa4fd22c740 1 -- 172.21.15.18:0/3380282210 >> 172.21.15.18:0/3380282210 conn(0x55d080afc750 msgr2=0x55d080b08aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.789+0000 7fa4dd600640 0 client.16083 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:03:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.790+0000 7fa4fd22c740 1 -- 172.21.15.18:0/3380282210 shutdown_connections 2024-09-12T03:03:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.790+0000 7fa4fd22c740 1 -- 172.21.15.18:0/3380282210 wait complete. 2024-09-12T03:03:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.790+0000 7fa4fd22c740 20 client.16083 trim_cache size 0 max 16384 2024-09-12T03:03:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T03:03:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T03:03:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T03:03:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T03:03:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.792+0000 7fa4fa400640 1 -- 172.21.15.18:0/1285873072 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fa4d80a3070 msgr2=0x7fa4d80a5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.792+0000 7fa4fa400640 1 --2- 172.21.15.18:0/1285873072 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fa4d80a3070 0x7fa4d80a5530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0edab0 tx=0x7fa4ec0095c0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.792+0000 7fa4fa400640 1 -- 172.21.15.18:0/1285873072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4f4107b80 msgr2=0x7fa4f410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.792+0000 7fa4fa400640 1 --2- 172.21.15.18:0/1285873072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4f4107b80 0x7fa4f410da40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec009bf0 tx=0x7fa4ec030b60 comp rx=0 tx=0).stop 2024-09-12T03:03:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.792+0000 7fa4fa400640 1 -- 172.21.15.18:0/1285873072 shutdown_connections 2024-09-12T03:03:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.792+0000 7fa4fa400640 1 --2- 172.21.15.18:0/1285873072 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fa4d80a3070 0x7fa4d80a5530 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.792+0000 7fa4fa400640 1 --2- 172.21.15.18:0/1285873072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4f4107b80 0x7fa4f410da40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.792+0000 7fa4fa400640 1 --2- 172.21.15.18:0/1285873072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4f4102480 0x7fa4f406fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.792+0000 7fa4fa400640 1 --2- 172.21.15.18:0/1285873072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4f4101ae0 0x7fa4f406f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.792+0000 7fa4fa400640 1 -- 172.21.15.18:0/1285873072 >> 172.21.15.18:0/1285873072 conn(0x7fa4f40fd7e0 msgr2=0x7fa4f40fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.792+0000 7fa4fa400640 1 -- 172.21.15.18:0/1285873072 shutdown_connections 2024-09-12T03:03:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:06.792+0000 7fa4fa400640 1 -- 172.21.15.18:0/1285873072 wait complete. 2024-09-12T03:03:07.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:06 smithi176 ceph-mon[35713]: pgmap v450: 129 pgs: 52 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 58 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 635 KiB/s wr, 253 op/s 2024-09-12T03:03:07.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:06 smithi062 ceph-mon[35527]: pgmap v450: 129 pgs: 52 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 58 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 635 KiB/s wr, 253 op/s 2024-09-12T03:03:07.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:06 smithi018 ceph-mon[30616]: pgmap v450: 129 pgs: 52 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 58 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 635 KiB/s wr, 253 op/s 2024-09-12T03:03:09.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:08 smithi018 ceph-mon[30616]: pgmap v451: 129 pgs: 52 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 58 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 583 KiB/s wr, 246 op/s 2024-09-12T03:03:09.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:08 smithi018 ceph-mon[30616]: osdmap e116: 12 total, 12 up, 12 in 2024-09-12T03:03:09.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:08 smithi176 ceph-mon[35713]: pgmap v451: 129 pgs: 52 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 58 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 583 KiB/s wr, 246 op/s 2024-09-12T03:03:09.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:08 smithi176 ceph-mon[35713]: osdmap e116: 12 total, 12 up, 12 in 2024-09-12T03:03:09.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:08 smithi062 ceph-mon[35527]: pgmap v451: 129 pgs: 52 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 58 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 583 KiB/s wr, 246 op/s 2024-09-12T03:03:09.284 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:08 smithi062 ceph-mon[35527]: osdmap e116: 12 total, 12 up, 12 in 2024-09-12T03:03:11.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:10 smithi176 ceph-mon[35713]: pgmap v453: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 650 KiB/s wr, 267 op/s 2024-09-12T03:03:11.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:10 smithi062 ceph-mon[35527]: pgmap v453: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 650 KiB/s wr, 267 op/s 2024-09-12T03:03:11.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:10 smithi018 ceph-mon[30616]: pgmap v453: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 650 KiB/s wr, 267 op/s 2024-09-12T03:03:13.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:12 smithi176 ceph-mon[35713]: pgmap v454: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 868 KiB/s wr, 317 op/s 2024-09-12T03:03:13.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:12 smithi062 ceph-mon[35527]: pgmap v454: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 868 KiB/s wr, 317 op/s 2024-09-12T03:03:13.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:12 smithi018 ceph-mon[30616]: pgmap v454: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 868 KiB/s wr, 317 op/s 2024-09-12T03:03:15.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:14 smithi176 ceph-mon[35713]: pgmap v455: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 891 KiB/s wr, 317 op/s 2024-09-12T03:03:15.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:14 smithi062 ceph-mon[35527]: pgmap v455: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 891 KiB/s wr, 317 op/s 2024-09-12T03:03:15.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:14 smithi018 ceph-mon[30616]: pgmap v455: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 891 KiB/s wr, 317 op/s 2024-09-12T03:03:17.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:16 smithi176 ceph-mon[35713]: pgmap v456: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 1008 KiB/s wr, 310 op/s 2024-09-12T03:03:17.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:16 smithi062 ceph-mon[35527]: pgmap v456: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 1008 KiB/s wr, 310 op/s 2024-09-12T03:03:17.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:16 smithi018 ceph-mon[30616]: pgmap v456: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 1008 KiB/s wr, 310 op/s 2024-09-12T03:03:18.060 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-09-12T03:03:18.060 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T03:03:19.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:18 smithi176 ceph-mon[35713]: pgmap v457: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 985 KiB/s wr, 290 op/s 2024-09-12T03:03:19.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:18 smithi062 ceph-mon[35527]: pgmap v457: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 985 KiB/s wr, 290 op/s 2024-09-12T03:03:19.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:18 smithi018 ceph-mon[30616]: pgmap v457: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 985 KiB/s wr, 290 op/s 2024-09-12T03:03:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.006+0000 7f6e62800640 1 -- 172.21.15.18:0/1569457287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e5c10c4e0 msgr2=0x7f6e5c10c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.006+0000 7f6e62800640 1 --2- 172.21.15.18:0/1569457287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e5c10c4e0 0x7f6e5c10c940 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009930 tx=0x7f6e4402a420 comp rx=0 tx=0).stop 2024-09-12T03:03:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.011+0000 7f6e62800640 1 -- 172.21.15.18:0/1569457287 shutdown_connections 2024-09-12T03:03:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.011+0000 7f6e62800640 1 --2- 172.21.15.18:0/1569457287 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e5c10ce80 0x7f6e5c119360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.011+0000 7f6e62800640 1 --2- 172.21.15.18:0/1569457287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e5c10c4e0 0x7f6e5c10c940 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.011+0000 7f6e62800640 1 --2- 172.21.15.18:0/1569457287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e5c1125a0 0x7f6e5c112980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.011+0000 7f6e62800640 1 -- 172.21.15.18:0/1569457287 >> 172.21.15.18:0/1569457287 conn(0x7f6e5c06c850 msgr2=0x7f6e5c06cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.011+0000 7f6e62800640 1 -- 172.21.15.18:0/1569457287 shutdown_connections 2024-09-12T03:03:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.011+0000 7f6e62800640 1 -- 172.21.15.18:0/1569457287 wait complete. 2024-09-12T03:03:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.013+0000 7f6e62800640 1 Processor -- start 2024-09-12T03:03:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.013+0000 7f6e62800640 1 -- start start 2024-09-12T03:03:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.014+0000 7f6e62800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e5c10c4e0 0x7f6e5c1a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.014+0000 7f6e62800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e5c10ce80 0x7f6e5c1a3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.014+0000 7f6e62800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e5c1125a0 0x7f6e5c1a75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.014+0000 7f6e62800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c11c940 con 0x7f6e5c10c4e0 2024-09-12T03:03:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.014+0000 7f6e62800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c11c7c0 con 0x7f6e5c1125a0 2024-09-12T03:03:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.014+0000 7f6e62800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c11cac0 con 0x7f6e5c10ce80 2024-09-12T03:03:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.014+0000 7f6e5be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e5c1125a0 0x7f6e5c1a75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.014+0000 7f6e5aa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e5c10ce80 0x7f6e5c1a3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.014+0000 7f6e5aa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e5c10ce80 0x7f6e5c1a3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:54832/0 (socket says 172.21.15.18:54832) 2024-09-12T03:03:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.014+0000 7f6e5aa00640 1 -- 172.21.15.18:0/1792686247 learned_addr learned my addr 172.21.15.18:0/1792686247 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.015+0000 7f6e5b400640 1 --2- 172.21.15.18:0/1792686247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e5c10c4e0 0x7f6e5c1a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.015+0000 7f6e5aa00640 1 -- 172.21.15.18:0/1792686247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e5c1125a0 msgr2=0x7f6e5c1a75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.015+0000 7f6e5aa00640 1 --2- 172.21.15.18:0/1792686247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e5c1125a0 0x7f6e5c1a75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.015+0000 7f6e5aa00640 1 -- 172.21.15.18:0/1792686247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e5c10c4e0 msgr2=0x7f6e5c1a2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.015+0000 7f6e5aa00640 1 --2- 172.21.15.18:0/1792686247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e5c10c4e0 0x7f6e5c1a2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.015+0000 7f6e5aa00640 1 -- 172.21.15.18:0/1792686247 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c1a7d20 con 0x7f6e5c10ce80 2024-09-12T03:03:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.015+0000 7f6e5b400640 1 --2- 172.21.15.18:0/1792686247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e5c10c4e0 0x7f6e5c1a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:03:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.016+0000 7f6e5aa00640 1 --2- 172.21.15.18:0/1792686247 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e5c10ce80 0x7f6e5c1a3270 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6e4402a940 tx=0x7f6e44003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.017+0000 7f6e53e00640 1 -- 172.21.15.18:0/1792686247 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4403f070 con 0x7f6e5c10ce80 2024-09-12T03:03:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.017+0000 7f6e62800640 1 -- 172.21.15.18:0/1792686247 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e5c1a7fb0 con 0x7f6e5c10ce80 2024-09-12T03:03:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.017+0000 7f6e62800640 1 -- 172.21.15.18:0/1792686247 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e5c1af8a0 con 0x7f6e5c10ce80 2024-09-12T03:03:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.017+0000 7f6e53e00640 1 -- 172.21.15.18:0/1792686247 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e44031c90 con 0x7f6e5c10ce80 2024-09-12T03:03:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.017+0000 7f6e53e00640 1 -- 172.21.15.18:0/1792686247 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e44049060 con 0x7f6e5c10ce80 2024-09-12T03:03:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.026+0000 7f6e6587c740 1 Processor -- start 2024-09-12T03:03:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.027+0000 7f6e6587c740 1 -- start start 2024-09-12T03:03:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.027+0000 7f6e6587c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac5f91e0 0x55bdac5f95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.027+0000 7f6e6587c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac603e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.027+0000 7f6e6587c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac6043a0 0x55bdac606790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.027+0000 7f6e6587c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bdac55f100 con 0x55bdac5f91e0 2024-09-12T03:03:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.027+0000 7f6e6587c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bdac5071b0 con 0x55bdac6043a0 2024-09-12T03:03:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.027+0000 7f6e6587c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55bdac55b0c0 con 0x55bdac5f9b00 2024-09-12T03:03:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.028+0000 7f6e53e00640 1 -- 172.21.15.18:0/1792686247 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f6e44042070 con 0x7f6e5c10ce80 2024-09-12T03:03:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.028+0000 7f6e5aa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac6043a0 0x55bdac606790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.028+0000 7f6e5aa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac6043a0 0x55bdac606790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:51698/0 (socket says 172.21.15.18:51698) 2024-09-12T03:03:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.028+0000 7f6e5aa00640 1 -- 172.21.15.18:0/638389442 learned_addr learned my addr 172.21.15.18:0/638389442 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.029+0000 7f6e5aa00640 1 -- 172.21.15.18:0/638389442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 msgr2=0x55bdac603e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:03:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.029+0000 7f6e5b400640 1 --2- 172.21.15.18:0/638389442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac603e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.029+0000 7f6e5aa00640 1 --2- 172.21.15.18:0/638389442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac603e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.029+0000 7f6e5aa00640 1 -- 172.21.15.18:0/638389442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac5f91e0 msgr2=0x55bdac5f95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:03:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.029+0000 7f6e5aa00640 1 --2- 172.21.15.18:0/638389442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac5f91e0 0x55bdac5f95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.029+0000 7f6e5aa00640 1 -- 172.21.15.18:0/638389442 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdac272210 con 0x55bdac6043a0 2024-09-12T03:03:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.030+0000 7f6e5b400640 1 --2- 172.21.15.18:0/638389442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac603e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:03:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.030+0000 7f6e53e00640 1 --2- 172.21.15.18:0/1792686247 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6e400a2da0 0x7f6e400a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.030+0000 7f6e53e00640 1 -- 172.21.15.18:0/1792686247 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9842+0+0 (secure 0 0 0) 0x7f6e440efcb0 con 0x7f6e5c10ce80 2024-09-12T03:03:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.031+0000 7f6e5aa00640 1 --2- 172.21.15.18:0/638389442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac6043a0 0x55bdac606790 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6e440ece40 tx=0x7f6e440f3f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67e97560008dc095 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.033+0000 7f6e5be00640 1 --2- 172.21.15.18:0/1792686247 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6e400a2da0 0x7f6e400a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.033+0000 7f6e50c00640 1 -- 172.21.15.18:0/638389442 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e440b7f40 con 0x55bdac6043a0 2024-09-12T03:03:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.034+0000 7f6e50c00640 1 -- 172.21.15.18:0/638389442 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e44031e40 con 0x55bdac6043a0 2024-09-12T03:03:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.034+0000 7f6e50c00640 1 -- 172.21.15.18:0/638389442 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e440bb600 con 0x55bdac6043a0 2024-09-12T03:03:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.035+0000 7f6e5be00640 1 --2- 172.21.15.18:0/1792686247 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6e400a2da0 0x7f6e400a5260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400a400 tx=0x7f6e5400d040 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.035+0000 7f6e6587c740 1 -- 172.21.15.18:0/638389442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac6043a0 msgr2=0x55bdac606790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.035+0000 7f6e6587c740 1 --2- 172.21.15.18:0/638389442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac6043a0 0x55bdac606790 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6e440ece40 tx=0x7f6e440f3f80 comp rx=0 tx=0).stop 2024-09-12T03:03:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.035+0000 7f6e6587c740 1 -- 172.21.15.18:0/638389442 shutdown_connections 2024-09-12T03:03:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.035+0000 7f6e6587c740 1 --2- 172.21.15.18:0/638389442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac6043a0 0x55bdac606790 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6e440ece40 tx=0x7f6e440f3f80 comp rx=0 tx=0).stop 2024-09-12T03:03:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.035+0000 7f6e6587c740 1 --2- 172.21.15.18:0/638389442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac603e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.035+0000 7f6e6587c740 1 --2- 172.21.15.18:0/638389442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac5f91e0 0x55bdac5f95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.035+0000 7f6e6587c740 1 -- 172.21.15.18:0/638389442 >> 172.21.15.18:0/638389442 conn(0x55bdac5f5750 msgr2=0x55bdac5f5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.038+0000 7f6e6587c740 1 -- 172.21.15.18:0/638389442 shutdown_connections 2024-09-12T03:03:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.038+0000 7f6e6587c740 1 -- 172.21.15.18:0/638389442 wait complete. 2024-09-12T03:03:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.038+0000 7f6e6587c740 1 -- start start 2024-09-12T03:03:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.039+0000 7f6e6587c740 1 Processor -- start 2024-09-12T03:03:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.040+0000 7f6e6587c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac5f91e0 0x55bdac601450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.040+0000 7f6e6587c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac601990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.040+0000 7f6e6587c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac601ed0 0x55bdac618920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.040+0000 7f6e5aa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac601990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.040+0000 7f6e5aa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac601990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:54856/0 (socket says 172.21.15.18:54856) 2024-09-12T03:03:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.040+0000 7f6e5b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac5f91e0 0x55bdac601450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.040+0000 7f6e5b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac5f91e0 0x55bdac601450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:51708/0 (socket says 172.21.15.18:51708) 2024-09-12T03:03:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.042+0000 7f6e5aa00640 1 -- 172.21.15.18:0/1019379445 learned_addr learned my addr 172.21.15.18:0/1019379445 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.042+0000 7f6e6587c740 1 -- 172.21.15.18:0/1019379445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bdac606d30 con 0x55bdac601ed0 2024-09-12T03:03:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.042+0000 7f6e6587c740 1 -- 172.21.15.18:0/1019379445 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bdac4e8090 con 0x55bdac5f91e0 2024-09-12T03:03:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.042+0000 7f6e6587c740 1 -- 172.21.15.18:0/1019379445 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55bdac606eb0 con 0x55bdac5f9b00 2024-09-12T03:03:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.042+0000 7f6e6587c740 10 client.0 _ll_register_callbacks cb 0x55bdac53cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:03:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.042+0000 7f6e5be00640 1 --2- 172.21.15.18:0/1019379445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac601ed0 0x55bdac618920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.043+0000 7f6e5aa00640 1 -- 172.21.15.18:0/1019379445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac5f91e0 msgr2=0x55bdac601450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:03:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.043+0000 7f6e5aa00640 1 --2- 172.21.15.18:0/1019379445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac5f91e0 0x55bdac601450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.043+0000 7f6e5aa00640 1 -- 172.21.15.18:0/1019379445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac601ed0 msgr2=0x55bdac618920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:03:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.044+0000 7f6e5aa00640 1 --2- 172.21.15.18:0/1019379445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac601ed0 0x55bdac618920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.044+0000 7f6e5aa00640 1 -- 172.21.15.18:0/1019379445 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdac33e620 con 0x55bdac5f9b00 2024-09-12T03:03:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.044+0000 7f6e5b400640 1 --2- 172.21.15.18:0/1019379445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac5f91e0 0x55bdac601450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:03:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.044+0000 7f6e5be00640 1 --2- 172.21.15.18:0/1019379445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac601ed0 0x55bdac618920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:03:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.044+0000 7f6e5aa00640 1 --2- 172.21.15.18:0/1019379445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac601990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6e44006010 tx=0x7f6e44003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1969382e302a64a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.045+0000 7f6e49600640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T03:03:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.045+0000 7f6e49600640 1 -- 172.21.15.18:0/1019379445 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e440bb7e0 con 0x55bdac5f9b00 2024-09-12T03:03:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.047+0000 7f6e49600640 1 -- 172.21.15.18:0/1019379445 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9842+0+0 (secure 0 0 0) 0x7f6e440b9fa0 con 0x55bdac5f9b00 2024-09-12T03:03:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.047+0000 7f6e6587c740 1 -- 172.21.15.18:0/1019379445 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bdac56c830 con 0x55bdac5f9b00 2024-09-12T03:03:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.047+0000 7f6e49600640 1 -- 172.21.15.18:0/1019379445 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f6e440bba70 con 0x55bdac5f9b00 2024-09-12T03:03:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.049+0000 7f6e6587c740 10 client.26149 fetch_fsmap learned FSMap version 74 2024-09-12T03:03:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.049+0000 7f6e6587c740 1 -- 172.21.15.18:0/1019379445 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x55bdac606d30 con 0x55bdac5f9b00 2024-09-12T03:03:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.053+0000 7f6e49600640 1 -- 172.21.15.18:0/1019379445 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55bdac56c830 con 0x55bdac5f9b00 2024-09-12T03:03:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.053+0000 7f6e49600640 1 -- 172.21.15.18:0/1019379445 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 74) ==== 8438+0+0 (secure 0 0 0) 0x7f6e4403bce0 con 0x55bdac5f9b00 2024-09-12T03:03:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.053+0000 7f6e6587c740 10 client.26149 fetch_fsmap finished waiting for FSMap version 74 2024-09-12T03:03:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.053+0000 7f6e6587c740 10 client.26149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:03:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.053+0000 7f6e6587c740 20 client.26149 populate_metadata read hostname 'smithi018' 2024-09-12T03:03:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.053+0000 7f6e6587c740 1 --2- 172.21.15.18:0/1019379445 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bdac61c9a0 0x55bdac61edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.053+0000 7f6e6587c740 4 client.26149 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:03:20.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.053+0000 7f6e6587c740 1 -- 172.21.15.18:0/1019379445 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bdac566b80 con 0x55bdac61c9a0 2024-09-12T03:03:20.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.054+0000 7f6e5b400640 1 --2- 172.21.15.18:0/1019379445 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bdac61c9a0 0x55bdac61edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:20.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.056+0000 7f6e49600640 10 client.26149 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:03:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.060+0000 7f6e5b400640 1 --2- 172.21.15.18:0/1019379445 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bdac61c9a0 0x55bdac61edc0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=719a64f2d84c8c5 server_cookie=45879581fab40b7f in_seq=0 out_seq=0 2024-09-12T03:03:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.063+0000 7f6e49600640 1 -- 172.21.15.18:0/1019379445 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bdac566b80 con 0x55bdac61c9a0 2024-09-12T03:03:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.063+0000 7f6e49600640 10 client.26149 handle_command_reply: tid=0 2024-09-12T03:03:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.063+0000 7f6e6587c740 1 client.26149 shutdown 2024-09-12T03:03:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.065+0000 7f6e6587c740 1 -- 172.21.15.18:0/1019379445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 msgr2=0x55bdac601990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.065+0000 7f6e6587c740 1 --2- 172.21.15.18:0/1019379445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac601990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6e44006010 tx=0x7f6e44003f90 comp rx=0 tx=0).stop 2024-09-12T03:03:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.065+0000 7f6e6587c740 1 -- 172.21.15.18:0/1019379445 shutdown_connections 2024-09-12T03:03:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.065+0000 7f6e6587c740 1 --2- 172.21.15.18:0/1019379445 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bdac61c9a0 0x55bdac61edc0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.065+0000 7f6e6587c740 1 --2- 172.21.15.18:0/1019379445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac601ed0 0x55bdac618920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.065+0000 7f6e6587c740 1 --2- 172.21.15.18:0/1019379445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac601990 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.065+0000 7f6e6587c740 1 --2- 172.21.15.18:0/1019379445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac5f91e0 0x55bdac601450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.065+0000 7f6e49600640 0 client.26149 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:03:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.065+0000 7f6e6587c740 1 -- 172.21.15.18:0/1019379445 >> 172.21.15.18:0/1019379445 conn(0x55bdac5f5750 msgr2=0x55bdac5fb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.065+0000 7f6e6587c740 1 -- 172.21.15.18:0/1019379445 shutdown_connections 2024-09-12T03:03:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.066+0000 7f6e6587c740 1 -- 172.21.15.18:0/1019379445 wait complete. 2024-09-12T03:03:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.066+0000 7f6e6587c740 20 client.26149 trim_cache size 0 max 16384 2024-09-12T03:03:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.114+0000 7f6e6587c740 1 Processor -- start 2024-09-12T03:03:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.114+0000 7f6e6587c740 1 -- start start 2024-09-12T03:03:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.115+0000 7f6e6587c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac5f91e0 0x55bdac618790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.115+0000 7f6e6587c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac624650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.115+0000 7f6e6587c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac601ed0 0x55bdac624b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.115+0000 7f6e6587c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6e38010360 con 0x55bdac601ed0 2024-09-12T03:03:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.115+0000 7f6e6587c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6e38012140 con 0x55bdac5f91e0 2024-09-12T03:03:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.115+0000 7f6e6587c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6e38010af0 con 0x55bdac5f9b00 2024-09-12T03:03:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.115+0000 7f6e5aa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac624650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.115+0000 7f6e5aa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac624650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:54862/0 (socket says 172.21.15.18:54862) 2024-09-12T03:03:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.115+0000 7f6e5aa00640 1 -- 172.21.15.18:0/3150376793 learned_addr learned my addr 172.21.15.18:0/3150376793 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.115+0000 7f6e5b400640 1 --2- 172.21.15.18:0/3150376793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac5f91e0 0x55bdac618790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.115+0000 7f6e5be00640 1 --2- 172.21.15.18:0/3150376793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac601ed0 0x55bdac624b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.116+0000 7f6e5aa00640 1 -- 172.21.15.18:0/3150376793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac5f91e0 msgr2=0x55bdac618790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:03:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.116+0000 7f6e5aa00640 1 --2- 172.21.15.18:0/3150376793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac5f91e0 0x55bdac618790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.116+0000 7f6e5aa00640 1 -- 172.21.15.18:0/3150376793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac601ed0 msgr2=0x55bdac624b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:03:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.116+0000 7f6e5aa00640 1 --2- 172.21.15.18:0/3150376793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac601ed0 0x55bdac624b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.116+0000 7f6e5aa00640 1 -- 172.21.15.18:0/3150376793 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdac601d00 con 0x55bdac5f9b00 2024-09-12T03:03:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.116+0000 7f6e5b400640 1 --2- 172.21.15.18:0/3150376793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac5f91e0 0x55bdac618790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:03:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.116+0000 7f6e5aa00640 1 --2- 172.21.15.18:0/3150376793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac624650 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6e44036040 tx=0x7f6e4402a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeb64b584943d814 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.117+0000 7f6e4be00640 1 -- 172.21.15.18:0/3150376793 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e440bb7e0 con 0x55bdac5f9b00 2024-09-12T03:03:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.117+0000 7f6e4be00640 1 -- 172.21.15.18:0/3150376793 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e440ed2a0 con 0x55bdac5f9b00 2024-09-12T03:03:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.117+0000 7f6e4be00640 1 -- 172.21.15.18:0/3150376793 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e440b7f40 con 0x55bdac5f9b00 2024-09-12T03:03:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.118+0000 7f6e6587c740 1 -- 172.21.15.18:0/3150376793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 msgr2=0x55bdac624650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.118+0000 7f6e6587c740 1 --2- 172.21.15.18:0/3150376793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac624650 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6e44036040 tx=0x7f6e4402a420 comp rx=0 tx=0).stop 2024-09-12T03:03:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.119+0000 7f6e6587c740 1 -- 172.21.15.18:0/3150376793 shutdown_connections 2024-09-12T03:03:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.119+0000 7f6e6587c740 1 --2- 172.21.15.18:0/3150376793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac601ed0 0x55bdac624b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.119+0000 7f6e6587c740 1 --2- 172.21.15.18:0/3150376793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac624650 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.119+0000 7f6e6587c740 1 --2- 172.21.15.18:0/3150376793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac5f91e0 0x55bdac618790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.119+0000 7f6e6587c740 1 -- 172.21.15.18:0/3150376793 >> 172.21.15.18:0/3150376793 conn(0x55bdac5f5750 msgr2=0x55bdac6034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.119+0000 7f6e6587c740 1 -- 172.21.15.18:0/3150376793 shutdown_connections 2024-09-12T03:03:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.119+0000 7f6e6587c740 1 -- 172.21.15.18:0/3150376793 wait complete. 2024-09-12T03:03:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.119+0000 7f6e6587c740 1 -- start start 2024-09-12T03:03:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.120+0000 7f6e6587c740 1 Processor -- start 2024-09-12T03:03:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.121+0000 7f6e6587c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac5f91e0 0x55bdac60f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.122+0000 7f6e6587c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac60fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.122+0000 7f6e6587c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac601ed0 0x55bdac610340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.122+0000 7f6e6587c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6e380119b0 con 0x55bdac5f91e0 2024-09-12T03:03:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.122+0000 7f6e6587c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6e38011280 con 0x55bdac601ed0 2024-09-12T03:03:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.122+0000 7f6e6587c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3800e360 con 0x55bdac5f9b00 2024-09-12T03:03:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.122+0000 7f6e6587c740 10 client.0 _ll_register_callbacks cb 0x7f6e440f3d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:03:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.122+0000 7f6e5be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac601ed0 0x55bdac610340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.122+0000 7f6e5b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac5f91e0 0x55bdac60f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.122+0000 7f6e5be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac601ed0 0x55bdac610340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:51740/0 (socket says 172.21.15.18:51740) 2024-09-12T03:03:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.122+0000 7f6e5be00640 1 -- 172.21.15.18:0/856549535 learned_addr learned my addr 172.21.15.18:0/856549535 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.123+0000 7f6e5aa00640 1 --2- 172.21.15.18:0/856549535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac60fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.124+0000 7f6e5aa00640 1 -- 172.21.15.18:0/856549535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac601ed0 msgr2=0x55bdac610340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:03:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.124+0000 7f6e5aa00640 1 --2- 172.21.15.18:0/856549535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac601ed0 0x55bdac610340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.124+0000 7f6e5aa00640 1 -- 172.21.15.18:0/856549535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac5f91e0 msgr2=0x55bdac60f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:03:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.124+0000 7f6e5aa00640 1 --2- 172.21.15.18:0/856549535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac5f91e0 0x55bdac60f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.124+0000 7f6e5aa00640 1 -- 172.21.15.18:0/856549535 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdac685640 con 0x55bdac5f9b00 2024-09-12T03:03:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.124+0000 7f6e5aa00640 1 --2- 172.21.15.18:0/856549535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac60fe00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6e440bcfd0 tx=0x7f6e44005b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb1196749316eed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.124+0000 7f6e49600640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-12T03:03:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.125+0000 7f6e49600640 1 -- 172.21.15.18:0/856549535 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e440bb600 con 0x55bdac5f9b00 2024-09-12T03:03:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.125+0000 7f6e49600640 1 -- 172.21.15.18:0/856549535 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9842+0+0 (secure 0 0 0) 0x7f6e440c4480 con 0x55bdac5f9b00 2024-09-12T03:03:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.126+0000 7f6e6587c740 1 -- 172.21.15.18:0/856549535 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e440ed2a0 con 0x55bdac5f9b00 2024-09-12T03:03:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.127+0000 7f6e49600640 1 -- 172.21.15.18:0/856549535 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f6e440b7f40 con 0x55bdac5f9b00 2024-09-12T03:03:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.128+0000 7f6e6587c740 10 client.26155 fetch_fsmap learned FSMap version 74 2024-09-12T03:03:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.128+0000 7f6e6587c740 1 -- 172.21.15.18:0/856549535 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x55bdac685640 con 0x55bdac5f9b00 2024-09-12T03:03:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.128+0000 7f6e49600640 1 -- 172.21.15.18:0/856549535 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e440ed2a0 con 0x55bdac5f9b00 2024-09-12T03:03:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.129+0000 7f6e49600640 1 -- 172.21.15.18:0/856549535 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 74) ==== 8438+0+0 (secure 0 0 0) 0x7f6e4403bce0 con 0x55bdac5f9b00 2024-09-12T03:03:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.134+0000 7f6e6587c740 10 client.26155 fetch_fsmap finished waiting for FSMap version 74 2024-09-12T03:03:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.134+0000 7f6e6587c740 10 client.26155 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T03:03:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.134+0000 7f6e6587c740 20 client.26155 populate_metadata read hostname 'smithi018' 2024-09-12T03:03:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.134+0000 7f6e6587c740 1 --2- 172.21.15.18:0/856549535 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bdac686be0 0x55bdac689000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.134+0000 7f6e6587c740 4 client.26155 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T03:03:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.134+0000 7f6e6587c740 1 -- 172.21.15.18:0/856549535 --> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bdac4e37c0 con 0x55bdac686be0 2024-09-12T03:03:20.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.134+0000 7f6e5b400640 1 --2- 172.21.15.18:0/856549535 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bdac686be0 0x55bdac689000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:20.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.135+0000 7f6e5b400640 1 --2- 172.21.15.18:0/856549535 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bdac686be0 0x55bdac689000 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1db3abb786cee9a9 server_cookie=de47e2bc09d1747c in_seq=0 out_seq=0 2024-09-12T03:03:20.135 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.135+0000 7f6e49600640 10 client.26155 ms_handle_connect on v2:172.21.15.62:6838/3744347102 2024-09-12T03:03:20.351 DEBUG:teuthology.parallel:result is None 2024-09-12T03:03:20.351 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T03:03:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.473+0000 7f6e49600640 1 -- 172.21.15.18:0/856549535 <== mds.0 v2:172.21.15.62:6838/3744347102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bdac4e37c0 con 0x55bdac686be0 2024-09-12T03:03:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.474+0000 7f6e49600640 10 client.26155 handle_command_reply: tid=0 2024-09-12T03:03:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.474+0000 7f6e6587c740 1 client.26155 shutdown 2024-09-12T03:03:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.474+0000 7f6e6587c740 1 -- 172.21.15.18:0/856549535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 msgr2=0x55bdac60fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.474+0000 7f6e6587c740 1 --2- 172.21.15.18:0/856549535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac60fe00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6e440bcfd0 tx=0x7f6e44005b70 comp rx=0 tx=0).stop 2024-09-12T03:03:20.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.477+0000 7f6e6587c740 1 -- 172.21.15.18:0/856549535 shutdown_connections 2024-09-12T03:03:20.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.477+0000 7f6e6587c740 1 --2- 172.21.15.18:0/856549535 >> [v2:172.21.15.62:6838/3744347102,v1:172.21.15.62:6839/3744347102] conn(0x55bdac686be0 0x55bdac689000 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.477+0000 7f6e6587c740 1 --2- 172.21.15.18:0/856549535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bdac601ed0 0x55bdac610340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.477+0000 7f6e6587c740 1 --2- 172.21.15.18:0/856549535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bdac5f9b00 0x55bdac60fe00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.477+0000 7f6e6587c740 1 --2- 172.21.15.18:0/856549535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdac5f91e0 0x55bdac60f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.477+0000 7f6e6587c740 1 -- 172.21.15.18:0/856549535 >> 172.21.15.18:0/856549535 conn(0x55bdac5f5750 msgr2=0x55bdac5fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:20.477 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.477+0000 7f6e49600640 0 client.26155 ms_handle_reset on v2:172.21.15.62:6838/3744347102 2024-09-12T03:03:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.477+0000 7f6e6587c740 1 -- 172.21.15.18:0/856549535 shutdown_connections 2024-09-12T03:03:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.477+0000 7f6e6587c740 1 -- 172.21.15.18:0/856549535 wait complete. 2024-09-12T03:03:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.478+0000 7f6e6587c740 20 client.26155 trim_cache size 0 max 16384 2024-09-12T03:03:20.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-12T03:03:20.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-12T03:03:20.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-12T03:03:20.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-12T03:03:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.483+0000 7f6e62800640 1 -- 172.21.15.18:0/1792686247 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6e400a2da0 msgr2=0x7f6e400a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.483+0000 7f6e62800640 1 --2- 172.21.15.18:0/1792686247 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6e400a2da0 0x7f6e400a5260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400a400 tx=0x7f6e5400d040 comp rx=0 tx=0).stop 2024-09-12T03:03:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.483+0000 7f6e62800640 1 -- 172.21.15.18:0/1792686247 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e5c10ce80 msgr2=0x7f6e5c1a3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.483+0000 7f6e62800640 1 --2- 172.21.15.18:0/1792686247 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e5c10ce80 0x7f6e5c1a3270 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6e4402a940 tx=0x7f6e44003b90 comp rx=0 tx=0).stop 2024-09-12T03:03:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.484+0000 7f6e62800640 1 -- 172.21.15.18:0/1792686247 shutdown_connections 2024-09-12T03:03:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.484+0000 7f6e62800640 1 --2- 172.21.15.18:0/1792686247 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f6e400a2da0 0x7f6e400a5260 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.484+0000 7f6e62800640 1 --2- 172.21.15.18:0/1792686247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e5c1125a0 0x7f6e5c1a75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.484+0000 7f6e62800640 1 --2- 172.21.15.18:0/1792686247 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e5c10ce80 0x7f6e5c1a3270 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.484+0000 7f6e62800640 1 --2- 172.21.15.18:0/1792686247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e5c10c4e0 0x7f6e5c1a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.484+0000 7f6e62800640 1 -- 172.21.15.18:0/1792686247 >> 172.21.15.18:0/1792686247 conn(0x7f6e5c06c850 msgr2=0x7f6e5c10aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:20.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.485+0000 7f6e62800640 1 -- 172.21.15.18:0/1792686247 shutdown_connections 2024-09-12T03:03:20.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-12T03:03:20.485+0000 7f6e62800640 1 -- 172.21.15.18:0/1792686247 wait complete. 2024-09-12T03:03:20.486 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T03:03:20.486 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-12T03:03:20.497 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi018.front.sepia.ceph.com 2024-09-12T03:03:20.520 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-12T03:03:20.530 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-12T03:03:20.530 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T03:03:20.530 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-12T03:03:20.530 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-12T03:03:20.690 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-12T03:03:20.811 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-12T03:03:21.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.113+0000 7f96e7c00640 1 -- 172.21.15.18:0/1469321538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e0101ad0 msgr2=0x7f96e0101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:21.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.113+0000 7f96e7c00640 1 --2- 172.21.15.18:0/1469321538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e0101ad0 0x7f96e0101f30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009860 tx=0x7f96cc02a360 comp rx=0 tx=0).stop 2024-09-12T03:03:21.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.113+0000 7f96e7c00640 1 -- 172.21.15.18:0/1469321538 shutdown_connections 2024-09-12T03:03:21.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.113+0000 7f96e7c00640 1 --2- 172.21.15.18:0/1469321538 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96e0102470 0x7f96e010e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:21.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.113+0000 7f96e7c00640 1 --2- 172.21.15.18:0/1469321538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e0101ad0 0x7f96e0101f30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:21.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.113+0000 7f96e7c00640 1 --2- 172.21.15.18:0/1469321538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96e0107b70 0x7f96e0107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:21.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.113+0000 7f96e7c00640 1 -- 172.21.15.18:0/1469321538 >> 172.21.15.18:0/1469321538 conn(0x7f96e00fd7d0 msgr2=0x7f96e00ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:21.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.113+0000 7f96e7c00640 1 -- 172.21.15.18:0/1469321538 shutdown_connections 2024-09-12T03:03:21.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.114+0000 7f96e7c00640 1 -- 172.21.15.18:0/1469321538 wait complete. 2024-09-12T03:03:21.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.115+0000 7f96e7c00640 1 Processor -- start 2024-09-12T03:03:21.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.115+0000 7f96e7c00640 1 -- start start 2024-09-12T03:03:21.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.117+0000 7f96e7c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e0101ad0 0x7f96e019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:21.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.117+0000 7f96e7c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96e0102470 0x7f96e019f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:21.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.117+0000 7f96e7c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96e0107b70 0x7f96e010ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:21.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.117+0000 7f96e7c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f96e0111ee0 con 0x7f96e0102470 2024-09-12T03:03:21.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.117+0000 7f96e7c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f96e0111d60 con 0x7f96e0101ad0 2024-09-12T03:03:21.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.117+0000 7f96e7c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f96e0112060 con 0x7f96e0107b70 2024-09-12T03:03:21.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.117+0000 7f96e5200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e0101ad0 0x7f96e019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:21.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.117+0000 7f96e5200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e0101ad0 0x7f96e019efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:51770/0 (socket says 172.21.15.18:51770) 2024-09-12T03:03:21.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.117+0000 7f96e5200640 1 -- 172.21.15.18:0/1850649421 learned_addr learned my addr 172.21.15.18:0/1850649421 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:21.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.118+0000 7f96e5c00640 1 --2- 172.21.15.18:0/1850649421 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96e0107b70 0x7f96e010ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:21.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.118+0000 7f96e5200640 1 -- 172.21.15.18:0/1850649421 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96e0107b70 msgr2=0x7f96e010ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:21.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.118+0000 7f96e5200640 1 --2- 172.21.15.18:0/1850649421 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96e0107b70 0x7f96e010ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:21.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.118+0000 7f96e5200640 1 -- 172.21.15.18:0/1850649421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96e0102470 msgr2=0x7f96e019f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:21.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.118+0000 7f96e5200640 1 --2- 172.21.15.18:0/1850649421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96e0102470 0x7f96e019f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:21.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.118+0000 7f96e5200640 1 -- 172.21.15.18:0/1850649421 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e010d2e0 con 0x7f96e0101ad0 2024-09-12T03:03:21.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.118+0000 7f96e5c00640 1 --2- 172.21.15.18:0/1850649421 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96e0107b70 0x7f96e010ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:03:21.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.120+0000 7f96e5200640 1 --2- 172.21.15.18:0/1850649421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e0101ad0 0x7f96e019efa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f96d400e9f0 tx=0x7f96d400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:21.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.124+0000 7f96dd600640 1 -- 172.21.15.18:0/1850649421 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d400cd80 con 0x7f96e0101ad0 2024-09-12T03:03:21.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.124+0000 7f96dd600640 1 -- 172.21.15.18:0/1850649421 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96d4010910 con 0x7f96e0101ad0 2024-09-12T03:03:21.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.124+0000 7f96dd600640 1 -- 172.21.15.18:0/1850649421 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d4018990 con 0x7f96e0101ad0 2024-09-12T03:03:21.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.125+0000 7f96e7c00640 1 -- 172.21.15.18:0/1850649421 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e010d5d0 con 0x7f96e0101ad0 2024-09-12T03:03:21.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.125+0000 7f96e7c00640 1 -- 172.21.15.18:0/1850649421 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e019abc0 con 0x7f96e0101ad0 2024-09-12T03:03:21.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.127+0000 7f96e7c00640 1 -- 172.21.15.18:0/1850649421 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e01031d0 con 0x7f96e0101ad0 2024-09-12T03:03:21.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.134+0000 7f96dd600640 1 -- 172.21.15.18:0/1850649421 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f96d4010ac0 con 0x7f96e0101ad0 2024-09-12T03:03:21.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.136+0000 7f96dd600640 1 --2- 172.21.15.18:0/1850649421 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f96c80a2f00 0x7f96c80a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:21.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.137+0000 7f96dd600640 1 -- 172.21.15.18:0/1850649421 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9842+0+0 (secure 0 0 0) 0x7f96d40d03a0 con 0x7f96e0101ad0 2024-09-12T03:03:21.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.137+0000 7f96dfe00640 1 --2- 172.21.15.18:0/1850649421 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f96c80a2f00 0x7f96c80a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:21.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.138+0000 7f96dfe00640 1 --2- 172.21.15.18:0/1850649421 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f96c80a2f00 0x7f96c80a53c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0095f0 tx=0x7f96cc0058b0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:21.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.139+0000 7f96dd600640 1 -- 172.21.15.18:0/1850649421 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f96d409cb10 con 0x7f96e0101ad0 2024-09-12T03:03:21.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:20 smithi176 ceph-mon[35713]: pgmap v458: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 908 KiB/s wr, 252 op/s 2024-09-12T03:03:21.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:20 smithi062 ceph-mon[35527]: pgmap v458: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 908 KiB/s wr, 252 op/s 2024-09-12T03:03:21.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:20 smithi018 ceph-mon[30616]: pgmap v458: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 908 KiB/s wr, 252 op/s 2024-09-12T03:03:21.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.543+0000 7f96e7c00640 1 -- 172.21.15.18:0/1850649421 --> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f96e019b650 con 0x7f96c80a2f00 2024-09-12T03:03:21.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.765+0000 7f96dd600640 1 -- 172.21.15.18:0/1850649421 <== mgr.25213 v2:172.21.15.18:6800/4058201283 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f96e019b650 con 0x7f96c80a2f00 2024-09-12T03:03:21.765 INFO:teuthology.orchestra.run.smithi018.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-12T00:00:00", "created": "2024-09-12T02:48:45", "first": "2024-09-12T02:49:00", "last": "2024-09-12T03:03:00", "last_pruned": "2024-09-12T03:03:02", "created_count": 15, "pruned_count": 9, "active": true} 2024-09-12T03:03:21.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.770+0000 7f96e7c00640 1 -- 172.21.15.18:0/1850649421 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f96c80a2f00 msgr2=0x7f96c80a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:21.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.770+0000 7f96e7c00640 1 --2- 172.21.15.18:0/1850649421 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f96c80a2f00 0x7f96c80a53c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0095f0 tx=0x7f96cc0058b0 comp rx=0 tx=0).stop 2024-09-12T03:03:21.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.770+0000 7f96e7c00640 1 -- 172.21.15.18:0/1850649421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e0101ad0 msgr2=0x7f96e019efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:21.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.770+0000 7f96e7c00640 1 --2- 172.21.15.18:0/1850649421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e0101ad0 0x7f96e019efa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f96d400e9f0 tx=0x7f96d400eeb0 comp rx=0 tx=0).stop 2024-09-12T03:03:21.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.770+0000 7f96e7c00640 1 -- 172.21.15.18:0/1850649421 shutdown_connections 2024-09-12T03:03:21.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.770+0000 7f96e7c00640 1 --2- 172.21.15.18:0/1850649421 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f96c80a2f00 0x7f96c80a53c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:21.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.770+0000 7f96e7c00640 1 --2- 172.21.15.18:0/1850649421 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96e0107b70 0x7f96e010ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:21.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.770+0000 7f96e7c00640 1 --2- 172.21.15.18:0/1850649421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96e0102470 0x7f96e019f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:21.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.770+0000 7f96e7c00640 1 --2- 172.21.15.18:0/1850649421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e0101ad0 0x7f96e019efa0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:21.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.770+0000 7f96e7c00640 1 -- 172.21.15.18:0/1850649421 >> 172.21.15.18:0/1850649421 conn(0x7f96e00fd7d0 msgr2=0x7f96e0074860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:21.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.770+0000 7f96e7c00640 1 -- 172.21.15.18:0/1850649421 shutdown_connections 2024-09-12T03:03:21.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:21.770+0000 7f96e7c00640 1 -- 172.21.15.18:0/1850649421 wait complete. 2024-09-12T03:03:21.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-12T03:03:22.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.094+0000 7f3318000640 1 -- 172.21.15.18:0/2368958537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33101091f0 msgr2=0x7f33101095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:22.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.094+0000 7f3318000640 1 --2- 172.21.15.18:0/2368958537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33101091f0 0x7f33101095d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3308009ca0 tx=0x7f330802a8d0 comp rx=0 tx=0).stop 2024-09-12T03:03:22.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.095+0000 7f3318000640 1 -- 172.21.15.18:0/2368958537 shutdown_connections 2024-09-12T03:03:22.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.095+0000 7f3318000640 1 --2- 172.21.15.18:0/2368958537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3310114ab0 0x7f3310116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:22.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.095+0000 7f3318000640 1 --2- 172.21.15.18:0/2368958537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3310109b10 0x7f3310114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:22.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.095+0000 7f3318000640 1 --2- 172.21.15.18:0/2368958537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33101091f0 0x7f33101095d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:22.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.095+0000 7f3318000640 1 -- 172.21.15.18:0/2368958537 >> 172.21.15.18:0/2368958537 conn(0x7f331006ce00 msgr2=0x7f331006d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:22.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.095+0000 7f3318000640 1 -- 172.21.15.18:0/2368958537 shutdown_connections 2024-09-12T03:03:22.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.097+0000 7f3318000640 1 -- 172.21.15.18:0/2368958537 wait complete. 2024-09-12T03:03:22.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.098+0000 7f3318000640 1 Processor -- start 2024-09-12T03:03:22.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.099+0000 7f3318000640 1 -- start start 2024-09-12T03:03:22.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:21 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:03:22.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.101+0000 7f3318000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33101091f0 0x7f33101a8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:22.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.101+0000 7f3318000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3310109b10 0x7f33101a8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:22.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.101+0000 7f3318000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3310114ab0 0x7f33101a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:22.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.101+0000 7f3316000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3310114ab0 0x7f33101a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:22.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.101+0000 7f3314c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3310109b10 0x7f33101a8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:22.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.102+0000 7f3316000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3310114ab0 0x7f33101a2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:54892/0 (socket says 172.21.15.18:54892) 2024-09-12T03:03:22.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.102+0000 7f3316000640 1 -- 172.21.15.18:0/3957216951 learned_addr learned my addr 172.21.15.18:0/3957216951 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:22.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.102+0000 7f3315600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33101091f0 0x7f33101a8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:22.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.102+0000 7f3318000640 1 -- 172.21.15.18:0/3957216951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f331011c970 con 0x7f33101091f0 2024-09-12T03:03:22.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.102+0000 7f3318000640 1 -- 172.21.15.18:0/3957216951 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f331011c7f0 con 0x7f3310109b10 2024-09-12T03:03:22.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.102+0000 7f3318000640 1 -- 172.21.15.18:0/3957216951 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f331011caf0 con 0x7f3310114ab0 2024-09-12T03:03:22.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.103+0000 7f3316000640 1 -- 172.21.15.18:0/3957216951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3310109b10 msgr2=0x7f33101a8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:22.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.103+0000 7f3316000640 1 --2- 172.21.15.18:0/3957216951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3310109b10 0x7f33101a8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:22.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.103+0000 7f3316000640 1 -- 172.21.15.18:0/3957216951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33101091f0 msgr2=0x7f33101a8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:22.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.103+0000 7f3316000640 1 --2- 172.21.15.18:0/3957216951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33101091f0 0x7f33101a8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:22.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.104+0000 7f3316000640 1 -- 172.21.15.18:0/3957216951 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33101a3240 con 0x7f3310114ab0 2024-09-12T03:03:22.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.104+0000 7f3314c00640 1 --2- 172.21.15.18:0/3957216951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3310109b10 0x7f33101a8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:03:22.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.104+0000 7f3316000640 1 --2- 172.21.15.18:0/3957216951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3310114ab0 0x7f33101a2ac0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00e970 tx=0x7f32fc00ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:22.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.105+0000 7f330e000640 1 -- 172.21.15.18:0/3957216951 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc00eea0 con 0x7f3310114ab0 2024-09-12T03:03:22.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.105+0000 7f330e000640 1 -- 172.21.15.18:0/3957216951 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32fc005500 con 0x7f3310114ab0 2024-09-12T03:03:22.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.105+0000 7f3318000640 1 -- 172.21.15.18:0/3957216951 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33101a3530 con 0x7f3310114ab0 2024-09-12T03:03:22.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.105+0000 7f330e000640 1 -- 172.21.15.18:0/3957216951 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc010430 con 0x7f3310114ab0 2024-09-12T03:03:22.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.105+0000 7f3318000640 1 -- 172.21.15.18:0/3957216951 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33101af7d0 con 0x7f3310114ab0 2024-09-12T03:03:22.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.108+0000 7f3318000640 1 -- 172.21.15.18:0/3957216951 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33101095d0 con 0x7f3310114ab0 2024-09-12T03:03:22.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.112+0000 7f330e000640 1 -- 172.21.15.18:0/3957216951 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f32fc005020 con 0x7f3310114ab0 2024-09-12T03:03:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.118+0000 7f330e000640 1 --2- 172.21.15.18:0/3957216951 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f32f80a2f50 0x7f32f80a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.118+0000 7f330e000640 1 -- 172.21.15.18:0/3957216951 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9842+0+0 (secure 0 0 0) 0x7f32fc0cfb90 con 0x7f3310114ab0 2024-09-12T03:03:22.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.119+0000 7f3315600640 1 --2- 172.21.15.18:0/3957216951 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f32f80a2f50 0x7f32f80a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:22.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.120+0000 7f3315600640 1 --2- 172.21.15.18:0/3957216951 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f32f80a2f50 0x7f32f80a5410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3308000f80 tx=0x7f330802f320 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:22.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.121+0000 7f330e000640 1 -- 172.21.15.18:0/3957216951 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f32fc09c280 con 0x7f3310114ab0 2024-09-12T03:03:22.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:21 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:03:22.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:21 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:03:22.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.522+0000 7f3318000640 1 -- 172.21.15.18:0/3957216951 --> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f3310070e60 con 0x7f32f80a2f50 2024-09-12T03:03:22.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.687+0000 7f330e000640 1 -- 172.21.15.18:0/3957216951 <== mgr.25213 v2:172.21.15.18:6800/4058201283 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f3310070e60 con 0x7f32f80a2f50 2024-09-12T03:03:22.688 INFO:teuthology.orchestra.run.smithi018.stdout:/ 1m 6m3h 2024-09-12T03:03:22.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.694+0000 7f3318000640 1 -- 172.21.15.18:0/3957216951 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f32f80a2f50 msgr2=0x7f32f80a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:22.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.694+0000 7f3318000640 1 --2- 172.21.15.18:0/3957216951 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f32f80a2f50 0x7f32f80a5410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3308000f80 tx=0x7f330802f320 comp rx=0 tx=0).stop 2024-09-12T03:03:22.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.694+0000 7f3318000640 1 -- 172.21.15.18:0/3957216951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3310114ab0 msgr2=0x7f33101a2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.694+0000 7f3318000640 1 --2- 172.21.15.18:0/3957216951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3310114ab0 0x7f33101a2ac0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00e970 tx=0x7f32fc00ed70 comp rx=0 tx=0).stop 2024-09-12T03:03:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.695+0000 7f3318000640 1 -- 172.21.15.18:0/3957216951 shutdown_connections 2024-09-12T03:03:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.695+0000 7f3318000640 1 --2- 172.21.15.18:0/3957216951 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f32f80a2f50 0x7f32f80a5410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.695+0000 7f3318000640 1 --2- 172.21.15.18:0/3957216951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3310114ab0 0x7f33101a2ac0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.695+0000 7f3318000640 1 --2- 172.21.15.18:0/3957216951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3310109b10 0x7f33101a8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.695+0000 7f3318000640 1 --2- 172.21.15.18:0/3957216951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33101091f0 0x7f33101a8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.695+0000 7f3318000640 1 -- 172.21.15.18:0/3957216951 >> 172.21.15.18:0/3957216951 conn(0x7f331006ce00 msgr2=0x7f3310070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.695+0000 7f3318000640 1 -- 172.21.15.18:0/3957216951 shutdown_connections 2024-09-12T03:03:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:22.695+0000 7f3318000640 1 -- 172.21.15.18:0/3957216951 wait complete. 2024-09-12T03:03:22.722 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-12T03:03:22.733 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:03:22.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:22 smithi018 ceph-mon[30616]: pgmap v459: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 288 op/s 2024-09-12T03:03:22.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:22 smithi018 ceph-mon[30616]: from='client.26210 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T03:03:23.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:22 smithi176 ceph-mon[35713]: pgmap v459: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 288 op/s 2024-09-12T03:03:23.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:22 smithi176 ceph-mon[35713]: from='client.26210 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T03:03:23.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:22 smithi062 ceph-mon[35527]: pgmap v459: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 288 op/s 2024-09-12T03:03:23.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:22 smithi062 ceph-mon[35527]: from='client.26210 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T03:03:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.895+0000 7f5d28a00640 1 -- 172.21.15.18:0/1345218541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d24109b80 msgr2=0x7f5d24109f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.895+0000 7f5d28a00640 1 --2- 172.21.15.18:0/1345218541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d24109b80 0x7f5d24109f60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009930 tx=0x7f5d1402a460 comp rx=0 tx=0).stop 2024-09-12T03:03:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.895+0000 7f5d28a00640 1 -- 172.21.15.18:0/1345218541 shutdown_connections 2024-09-12T03:03:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.895+0000 7f5d28a00640 1 --2- 172.21.15.18:0/1345218541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d24104480 0x7f5d241109b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.895+0000 7f5d28a00640 1 --2- 172.21.15.18:0/1345218541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d24103ae0 0x7f5d24103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.895+0000 7f5d28a00640 1 --2- 172.21.15.18:0/1345218541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d24109b80 0x7f5d24109f60 secure :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009930 tx=0x7f5d1402a460 comp rx=0 tx=0).stop 2024-09-12T03:03:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.895+0000 7f5d28a00640 1 -- 172.21.15.18:0/1345218541 >> 172.21.15.18:0/1345218541 conn(0x7f5d240ff7c0 msgr2=0x7f5d24101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.896+0000 7f5d28a00640 1 -- 172.21.15.18:0/1345218541 shutdown_connections 2024-09-12T03:03:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.896+0000 7f5d28a00640 1 -- 172.21.15.18:0/1345218541 wait complete. 2024-09-12T03:03:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.897+0000 7f5d28a00640 1 Processor -- start 2024-09-12T03:03:23.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.899+0000 7f5d28a00640 1 -- start start 2024-09-12T03:03:23.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.900+0000 7f5d28a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d24103ae0 0x7f5d24076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:23.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.900+0000 7f5d28a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d24104480 0x7f5d24076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:23.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.900+0000 7f5d28a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d24077180 0x7f5d241aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:23.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.900+0000 7f5d28a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5d24113f80 con 0x7f5d24104480 2024-09-12T03:03:23.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.900+0000 7f5d28a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5d24113e00 con 0x7f5d24103ae0 2024-09-12T03:03:23.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.900+0000 7f5d28a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5d24114100 con 0x7f5d24077180 2024-09-12T03:03:23.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.900+0000 7f5d22800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d24103ae0 0x7f5d24076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.900+0000 7f5d22800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d24103ae0 0x7f5d24076700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:51808/0 (socket says 172.21.15.18:51808) 2024-09-12T03:03:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.900+0000 7f5d22800640 1 -- 172.21.15.18:0/3304943606 learned_addr learned my addr 172.21.15.18:0/3304943606 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.900+0000 7f5d23200640 1 --2- 172.21.15.18:0/3304943606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d24077180 0x7f5d241aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.900+0000 7f5d21e00640 1 --2- 172.21.15.18:0/3304943606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d24104480 0x7f5d24076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.901+0000 7f5d23200640 1 -- 172.21.15.18:0/3304943606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d24103ae0 msgr2=0x7f5d24076700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.901+0000 7f5d23200640 1 --2- 172.21.15.18:0/3304943606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d24103ae0 0x7f5d24076700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.901+0000 7f5d23200640 1 -- 172.21.15.18:0/3304943606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d24104480 msgr2=0x7f5d24076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.901+0000 7f5d23200640 1 --2- 172.21.15.18:0/3304943606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d24104480 0x7f5d24076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.901+0000 7f5d23200640 1 -- 172.21.15.18:0/3304943606 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d241ab210 con 0x7f5d24077180 2024-09-12T03:03:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.901+0000 7f5d21e00640 1 --2- 172.21.15.18:0/3304943606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d24104480 0x7f5d24076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:03:23.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.904+0000 7f5d23200640 1 --2- 172.21.15.18:0/3304943606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d24077180 0x7f5d241aacd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00ec50 tx=0x7f5d1c00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:23.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.904+0000 7f5d1b400640 1 -- 172.21.15.18:0/3304943606 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c003b70 con 0x7f5d24077180 2024-09-12T03:03:23.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.904+0000 7f5d28a00640 1 -- 172.21.15.18:0/3304943606 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d241ab500 con 0x7f5d24077180 2024-09-12T03:03:23.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.905+0000 7f5d1b400640 1 -- 172.21.15.18:0/3304943606 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d1c003d10 con 0x7f5d24077180 2024-09-12T03:03:23.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.905+0000 7f5d28a00640 1 -- 172.21.15.18:0/3304943606 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d241aba20 con 0x7f5d24077180 2024-09-12T03:03:23.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.906+0000 7f5d1b400640 1 -- 172.21.15.18:0/3304943606 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c010890 con 0x7f5d24077180 2024-09-12T03:03:23.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.909+0000 7f5d28a00640 1 -- 172.21.15.18:0/3304943606 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d241051e0 con 0x7f5d24077180 2024-09-12T03:03:23.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.912+0000 7f5d1b400640 1 -- 172.21.15.18:0/3304943606 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f5d1c004020 con 0x7f5d24077180 2024-09-12T03:03:23.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.915+0000 7f5d1b400640 1 --2- 172.21.15.18:0/3304943606 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f5d080a2d40 0x7f5d080a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:23.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.915+0000 7f5d1b400640 1 -- 172.21.15.18:0/3304943606 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9842+0+0 (secure 0 0 0) 0x7f5d1c0d0070 con 0x7f5d24077180 2024-09-12T03:03:23.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.916+0000 7f5d22800640 1 --2- 172.21.15.18:0/3304943606 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f5d080a2d40 0x7f5d080a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:23.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.918+0000 7f5d22800640 1 --2- 172.21.15.18:0/3304943606 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f5d080a2d40 0x7f5d080a5200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5d14006010 tx=0x7f5d14000bc0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:23.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:23.921+0000 7f5d1b400640 1 -- 172.21.15.18:0/3304943606 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5d1c09c760 con 0x7f5d24077180 2024-09-12T03:03:24.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:23 smithi062 ceph-mon[35527]: from='client.26167 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T03:03:24.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.321+0000 7f5d28a00640 1 -- 172.21.15.18:0/3304943606 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d2410c080 con 0x7f5d24077180 2024-09-12T03:03:24.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.323+0000 7f5d1b400640 1 -- 172.21.15.18:0/3304943606 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+25847 (secure 0 0 0) 0x7f5d1c09c060 con 0x7f5d24077180 2024-09-12T03:03:24.328 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T03:03:24.329 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":116,"fsid":"c7666100-70af-11ef-bcea-c7b262605968","created":"2024-09-12T02:37:14.139566+0000","modified":"2024-09-12T03:03:07.879984+0000","last_up_change":"2024-09-12T02:44:37.774835+0000","last_in_change":"2024-09-12T02:44:16.028970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:40:35.157621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:45:31.022530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:45:34.131637+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":25,"snap_epoch":116,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:45:43.992286+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":25,"snap_epoch":116,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a61ecdc1-ceb9-43cb-a67d-b197888cca42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6803","nonce":2278662522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6805","nonce":2278662522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6809","nonce":2278662522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6807","nonce":2278662522}]},"public_addr":"172.21.15.18:6803/2278662522","cluster_addr":"172.21.15.18:6805/2278662522","heartbeat_back_addr":"172.21.15.18:6809/2278662522","heartbeat_front_addr":"172.21.15.18:6807/2278662522","state":["exists","up"]},{"osd":1,"uuid":"1b84f4be-23ce-466c-b974-b9851521785d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6801","nonce":3139630617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6803","nonce":3139630617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6807","nonce":3139630617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6805","nonce":3139630617}]},"public_addr":"172.21.15.62:6801/3139630617","cluster_addr":"172.21.15.62:6803/3139630617","heartbeat_back_addr":"172.21.15.62:6807/3139630617","heartbeat_front_addr":"172.21.15.62:6805/3139630617","state":["exists","up"]},{"osd":2,"uuid":"f7bdf028-db32-4d92-a039-bada37c3a146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6801","nonce":2704054654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6803","nonce":2704054654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6807","nonce":2704054654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6805","nonce":2704054654}]},"public_addr":"172.21.15.176:6801/2704054654","cluster_addr":"172.21.15.176:6803/2704054654","heartbeat_back_addr":"172.21.15.176:6807/2704054654","heartbeat_front_addr":"172.21.15.176:6805/2704054654","state":["exists","up"]},{"osd":3,"uuid":"39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6811","nonce":3378134261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6813","nonce":3378134261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6817","nonce":3378134261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6815","nonce":3378134261}]},"public_addr":"172.21.15.18:6811/3378134261","cluster_addr":"172.21.15.18:6813/3378134261","heartbeat_back_addr":"172.21.15.18:6817/3378134261","heartbeat_front_addr":"172.21.15.18:6815/3378134261","state":["exists","up"]},{"osd":4,"uuid":"66a2c8a0-1a99-4c6d-b56a-f1f6c3199655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6809","nonce":1416302860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6811","nonce":1416302860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6815","nonce":1416302860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6813","nonce":1416302860}]},"public_addr":"172.21.15.62:6809/1416302860","cluster_addr":"172.21.15.62:6811/1416302860","heartbeat_back_addr":"172.21.15.62:6815/1416302860","heartbeat_front_addr":"172.21.15.62:6813/1416302860","state":["exists","up"]},{"osd":5,"uuid":"c4070ecf-703a-4f5f-9a2b-63473ff7f98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6809","nonce":2234269387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6811","nonce":2234269387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6815","nonce":2234269387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6813","nonce":2234269387}]},"public_addr":"172.21.15.176:6809/2234269387","cluster_addr":"172.21.15.176:6811/2234269387","heartbeat_back_addr":"172.21.15.176:6815/2234269387","heartbeat_front_addr":"172.21.15.176:6813/2234269387","state":["exists","up"]},{"osd":6,"uuid":"12a08874-041e-4734-bc33-68ebfce97b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6819","nonce":3613955982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6821","nonce":3613955982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6825","nonce":3613955982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6823","nonce":3613955982}]},"public_addr":"172.21.15.18:6819/3613955982","cluster_addr":"172.21.15.18:6821/3613955982","heartbeat_back_addr":"172.21.15.18:6825/3613955982","heartbeat_front_addr":"172.21.15.18:6823/3613955982","state":["exists","up"]},{"osd":7,"uuid":"86a5b47c-143f-4848-892f-c7b6a17a2799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6817","nonce":750933013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6819","nonce":750933013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6823","nonce":750933013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6821","nonce":750933013}]},"public_addr":"172.21.15.62:6817/750933013","cluster_addr":"172.21.15.62:6819/750933013","heartbeat_back_addr":"172.21.15.62:6823/750933013","heartbeat_front_addr":"172.21.15.62:6821/750933013","state":["exists","up"]},{"osd":8,"uuid":"0426a455-ed11-4d6a-8e1d-c8aa2ee65cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6817","nonce":8496953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6819","nonce":8496953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6823","nonce":8496953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6821","nonce":8496953}]},"public_addr":"172.21.15.176:6817/8496953","cluster_addr":"172.21.15.176:6819/8496953","heartbeat_back_addr":"172.21.15.176:6823/8496953","heartbeat_front_addr":"172.21.15.176:6821/8496953","state":["exists","up"]},{"osd":9,"uuid":"241aa2cf-0765-465d-b400-4911e653412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6827","nonce":422514390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6829","nonce":422514390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6833","nonce":422514390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6831","nonce":422514390}]},"public_addr":"172.21.15.18:6827/422514390","cluster_addr":"172.21.15.18:6829/422514390","heartbeat_back_addr":"172.21.15.18:6833/422514390","heartbeat_front_addr":"172.21.15.18:6831/422514390","state":["exists","up"]},{"osd":10,"uuid":"b1d4ab1f-0ec4-4641-bab0-f39d15857615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6825","nonce":269877918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6827","nonce":269877918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6831","nonce":269877918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6829","nonce":269877918}]},"public_addr":"172.21.15.62:6825/269877918","cluster_addr":"172.21.15.62:6827/269877918","heartbeat_back_addr":"172.21.15.62:6831/269877918","heartbeat_front_addr":"172.21.15.62:6829/269877918","state":["exists","up"]},{"osd":11,"uuid":"d122f1bf-bd4f-45d5-b07c-7301b005977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6825","nonce":770358485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6827","nonce":770358485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6831","nonce":770358485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6829","nonce":770358485}]},"public_addr":"172.21.15.176:6825/770358485","cluster_addr":"172.21.15.176:6827/770358485","heartbeat_back_addr":"172.21.15.176:6831/770358485","heartbeat_front_addr":"172.21.15.176:6829/770358485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:39:42.435560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:09.100602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:32.884117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:01.733821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:29.812775+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:53.846503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:24.363464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:51.023614+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:15.782652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:45.378178+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:12.469173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:36.303058+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":1,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.3","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/4167793150":"2024-09-13T02:48:42.970169+0000","172.21.15.18:6801/494888664":"2024-09-13T02:48:42.970169+0000","172.21.15.18:0/1531572357":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6800/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6801/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/3024661873":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6800/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/4191505851":"2024-09-13T02:48:42.970169+0000","172.21.15.18:0/1185819845":"2024-09-13T02:48:42.970169+0000","172.21.15.18:0/2429098892":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6801/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/4236556151":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6800/494888664":"2024-09-13T02:48:42.970169+0000","172.21.15.18:0/1197309398":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/2679362143":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/880406453":"2024-09-13T02:48:42.970169+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":8,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":19,"length":1},{"begin":21,"length":1},{"begin":23,"length":1},{"begin":25,"length":1}]},{"pool":4,"snaps":[{"begin":8,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":19,"length":1},{"begin":21,"length":1},{"begin":23,"length":1},{"begin":25,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":12,"length":1},{"begin":25,"length":1}]},{"pool":4,"snaps":[{"begin":12,"length":1},{"begin":25,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:03:24.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.328+0000 7f5d28a00640 1 -- 172.21.15.18:0/3304943606 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f5d080a2d40 msgr2=0x7f5d080a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:24.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.328+0000 7f5d28a00640 1 --2- 172.21.15.18:0/3304943606 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f5d080a2d40 0x7f5d080a5200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5d14006010 tx=0x7f5d14000bc0 comp rx=0 tx=0).stop 2024-09-12T03:03:24.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.328+0000 7f5d28a00640 1 -- 172.21.15.18:0/3304943606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d24077180 msgr2=0x7f5d241aacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:24.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.328+0000 7f5d28a00640 1 --2- 172.21.15.18:0/3304943606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d24077180 0x7f5d241aacd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00ec50 tx=0x7f5d1c00c6a0 comp rx=0 tx=0).stop 2024-09-12T03:03:24.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.329+0000 7f5d28a00640 1 -- 172.21.15.18:0/3304943606 shutdown_connections 2024-09-12T03:03:24.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.329+0000 7f5d28a00640 1 --2- 172.21.15.18:0/3304943606 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f5d080a2d40 0x7f5d080a5200 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:24.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.329+0000 7f5d28a00640 1 --2- 172.21.15.18:0/3304943606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d24077180 0x7f5d241aacd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:24.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.329+0000 7f5d28a00640 1 --2- 172.21.15.18:0/3304943606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d24104480 0x7f5d24076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:24.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.329+0000 7f5d28a00640 1 --2- 172.21.15.18:0/3304943606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d24103ae0 0x7f5d24076700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:24.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.329+0000 7f5d28a00640 1 -- 172.21.15.18:0/3304943606 >> 172.21.15.18:0/3304943606 conn(0x7f5d240ff7c0 msgr2=0x7f5d241001c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:24.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.329+0000 7f5d28a00640 1 -- 172.21.15.18:0/3304943606 shutdown_connections 2024-09-12T03:03:24.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.329+0000 7f5d28a00640 1 -- 172.21.15.18:0/3304943606 wait complete. 2024-09-12T03:03:24.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:23 smithi018 ceph-mon[30616]: from='client.26167 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T03:03:24.356 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:40:35.157621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T02:45:31.022530+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T02:45:34.131637+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 25, 'snap_epoch': 116, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-12T02:45:43.992286+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 25, 'snap_epoch': 116, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-12T03:03:24.357 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T03:03:24.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:23 smithi176 ceph-mon[35713]: from='client.26167 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T03:03:24.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.672+0000 7f2ff3200640 1 -- 172.21.15.18:0/3508796852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ff4109b10 msgr2=0x7f2ff4114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:24.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.672+0000 7f2ff3200640 1 --2- 172.21.15.18:0/3508796852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ff4109b10 0x7f2ff4114570 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009900 tx=0x7f2fe002a3f0 comp rx=0 tx=0).stop 2024-09-12T03:03:24.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.672+0000 7f2ff3200640 1 -- 172.21.15.18:0/3508796852 shutdown_connections 2024-09-12T03:03:24.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.672+0000 7f2ff3200640 1 --2- 172.21.15.18:0/3508796852 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ff4114ab0 0x7f2ff4116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:24.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.672+0000 7f2ff3200640 1 --2- 172.21.15.18:0/3508796852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ff4109b10 0x7f2ff4114570 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:24.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.672+0000 7f2ff3200640 1 --2- 172.21.15.18:0/3508796852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ff41091f0 0x7f2ff41095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:24.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.672+0000 7f2ff3200640 1 -- 172.21.15.18:0/3508796852 >> 172.21.15.18:0/3508796852 conn(0x7f2ff406cc50 msgr2=0x7f2ff406d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:24.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.672+0000 7f2ff3200640 1 -- 172.21.15.18:0/3508796852 shutdown_connections 2024-09-12T03:03:24.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.672+0000 7f2ff3200640 1 -- 172.21.15.18:0/3508796852 wait complete. 2024-09-12T03:03:24.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.673+0000 7f2ff3200640 1 Processor -- start 2024-09-12T03:03:24.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.674+0000 7f2ff3200640 1 -- start start 2024-09-12T03:03:24.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.677+0000 7f2ff3200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ff41091f0 0x7f2ff41a2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.677+0000 7f2ff3200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ff4109b10 0x7f2ff41a3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.677+0000 7f2ff3200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ff4114ab0 0x7f2ff41a7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.677+0000 7f2ff3200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff411a690 con 0x7f2ff4109b10 2024-09-12T03:03:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.677+0000 7f2ff3200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff411a510 con 0x7f2ff4114ab0 2024-09-12T03:03:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.677+0000 7f2ff3200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff411a810 con 0x7f2ff41091f0 2024-09-12T03:03:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.678+0000 7f2ff1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ff4109b10 0x7f2ff41a3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.678+0000 7f2ff2800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ff4114ab0 0x7f2ff41a7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.678+0000 7f2ff1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ff4109b10 0x7f2ff41a3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42420/0 (socket says 172.21.15.18:42420) 2024-09-12T03:03:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.678+0000 7f2ff1400640 1 -- 172.21.15.18:0/1300435249 learned_addr learned my addr 172.21.15.18:0/1300435249 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.678+0000 7f2ff1e00640 1 --2- 172.21.15.18:0/1300435249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ff41091f0 0x7f2ff41a2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.679+0000 7f2ff2800640 1 -- 172.21.15.18:0/1300435249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ff41091f0 msgr2=0x7f2ff41a2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.679+0000 7f2ff2800640 1 --2- 172.21.15.18:0/1300435249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ff41091f0 0x7f2ff41a2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.679+0000 7f2ff2800640 1 -- 172.21.15.18:0/1300435249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ff4109b10 msgr2=0x7f2ff41a3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.679+0000 7f2ff2800640 1 --2- 172.21.15.18:0/1300435249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ff4109b10 0x7f2ff41a3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.679+0000 7f2ff2800640 1 -- 172.21.15.18:0/1300435249 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff41a7d30 con 0x7f2ff4114ab0 2024-09-12T03:03:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.679+0000 7f2ff2800640 1 --2- 172.21.15.18:0/1300435249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ff4114ab0 0x7f2ff41a7600 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2fec00bdf0 tx=0x7f2fec00bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.679+0000 7f2feaa00640 1 -- 172.21.15.18:0/1300435249 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fec019070 con 0x7f2ff4114ab0 2024-09-12T03:03:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.679+0000 7f2ff3200640 1 -- 172.21.15.18:0/1300435249 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff41a8020 con 0x7f2ff4114ab0 2024-09-12T03:03:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.680+0000 7f2ff3200640 1 -- 172.21.15.18:0/1300435249 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff41af8b0 con 0x7f2ff4114ab0 2024-09-12T03:03:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.680+0000 7f2feaa00640 1 -- 172.21.15.18:0/1300435249 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fec014920 con 0x7f2ff4114ab0 2024-09-12T03:03:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.680+0000 7f2feaa00640 1 -- 172.21.15.18:0/1300435249 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fec01d970 con 0x7f2ff4114ab0 2024-09-12T03:03:24.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.681+0000 7f2ff3200640 1 -- 172.21.15.18:0/1300435249 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fd4005290 con 0x7f2ff4114ab0 2024-09-12T03:03:24.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.689+0000 7f2feaa00640 1 -- 172.21.15.18:0/1300435249 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f2fec01c070 con 0x7f2ff4114ab0 2024-09-12T03:03:24.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.691+0000 7f2feaa00640 1 --2- 172.21.15.18:0/1300435249 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f2fd80a2dc0 0x7f2fd80a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:24.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.692+0000 7f2feaa00640 1 -- 172.21.15.18:0/1300435249 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9842+0+0 (secure 0 0 0) 0x7f2fec0cf580 con 0x7f2ff4114ab0 2024-09-12T03:03:24.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.694+0000 7f2ff1e00640 1 --2- 172.21.15.18:0/1300435249 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f2fd80a2dc0 0x7f2fd80a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:24.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.696+0000 7f2ff1e00640 1 --2- 172.21.15.18:0/1300435249 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f2fd80a2dc0 0x7f2fd80a5280 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009b60 tx=0x7f2fe4005f90 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:24.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:24.697+0000 7f2feaa00640 1 -- 172.21.15.18:0/1300435249 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2fec023020 con 0x7f2ff4114ab0 2024-09-12T03:03:25.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.071+0000 7f2ff3200640 1 -- 172.21.15.18:0/1300435249 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2fd4005850 con 0x7f2ff4114ab0 2024-09-12T03:03:25.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.072+0000 7f2feaa00640 1 -- 172.21.15.18:0/1300435249 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) ==== 93+0+10 (secure 0 0 0) 0x7f2fec09bd80 con 0x7f2ff4114ab0 2024-09-12T03:03:25.072 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-12T03:03:25.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.076+0000 7f2ff3200640 1 -- 172.21.15.18:0/1300435249 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f2fd80a2dc0 msgr2=0x7f2fd80a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:25.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.076+0000 7f2ff3200640 1 --2- 172.21.15.18:0/1300435249 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f2fd80a2dc0 0x7f2fd80a5280 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009b60 tx=0x7f2fe4005f90 comp rx=0 tx=0).stop 2024-09-12T03:03:25.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.076+0000 7f2ff3200640 1 -- 172.21.15.18:0/1300435249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ff4114ab0 msgr2=0x7f2ff41a7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:25.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.076+0000 7f2ff3200640 1 --2- 172.21.15.18:0/1300435249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ff4114ab0 0x7f2ff41a7600 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2fec00bdf0 tx=0x7f2fec00bee0 comp rx=0 tx=0).stop 2024-09-12T03:03:25.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.076+0000 7f2ff3200640 1 -- 172.21.15.18:0/1300435249 shutdown_connections 2024-09-12T03:03:25.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.076+0000 7f2ff3200640 1 --2- 172.21.15.18:0/1300435249 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f2fd80a2dc0 0x7f2fd80a5280 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009b60 tx=0x7f2fe4005f90 comp rx=0 tx=0).stop 2024-09-12T03:03:25.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.076+0000 7f2ff3200640 1 --2- 172.21.15.18:0/1300435249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ff4114ab0 0x7f2ff41a7600 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:25.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.076+0000 7f2ff3200640 1 --2- 172.21.15.18:0/1300435249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ff4109b10 0x7f2ff41a3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:25.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.076+0000 7f2ff3200640 1 --2- 172.21.15.18:0/1300435249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ff41091f0 0x7f2ff41a2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:25.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.076+0000 7f2ff3200640 1 -- 172.21.15.18:0/1300435249 >> 172.21.15.18:0/1300435249 conn(0x7f2ff406cc50 msgr2=0x7f2ff410a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:25.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.077+0000 7f2ff3200640 1 -- 172.21.15.18:0/1300435249 shutdown_connections 2024-09-12T03:03:25.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.078+0000 7f2ff3200640 1 -- 172.21.15.18:0/1300435249 wait complete. 2024-09-12T03:03:25.111 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T03:03:25.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:24 smithi062 ceph-mon[35527]: pgmap v460: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 822 KiB/s wr, 225 op/s 2024-09-12T03:03:25.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:24 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3304943606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T03:03:25.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:24 smithi018 ceph-mon[30616]: pgmap v460: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 822 KiB/s wr, 225 op/s 2024-09-12T03:03:25.352 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:24 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3304943606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T03:03:25.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.410+0000 7ff017e00640 1 -- 172.21.15.18:0/2149012387 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff01810bfd0 msgr2=0x7ff01810e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:25.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.410+0000 7ff017e00640 1 --2- 172.21.15.18:0/2149012387 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff01810bfd0 0x7ff01810e420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff010009ca0 tx=0x7ff01002a950 comp rx=0 tx=0).stop 2024-09-12T03:03:25.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.410+0000 7ff017e00640 1 -- 172.21.15.18:0/2149012387 shutdown_connections 2024-09-12T03:03:25.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.410+0000 7ff017e00640 1 --2- 172.21.15.18:0/2149012387 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff01810bfd0 0x7ff01810e420 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:25.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.410+0000 7ff017e00640 1 --2- 172.21.15.18:0/2149012387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff018103520 0x7ff01810ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:25.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.410+0000 7ff017e00640 1 --2- 172.21.15.18:0/2149012387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff018102c00 0x7ff018102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:25.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.410+0000 7ff017e00640 1 -- 172.21.15.18:0/2149012387 >> 172.21.15.18:0/2149012387 conn(0x7ff0180778c0 msgr2=0x7ff0180fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:25.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.411+0000 7ff017e00640 1 -- 172.21.15.18:0/2149012387 shutdown_connections 2024-09-12T03:03:25.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.411+0000 7ff017e00640 1 -- 172.21.15.18:0/2149012387 wait complete. 2024-09-12T03:03:25.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.413+0000 7ff017e00640 1 Processor -- start 2024-09-12T03:03:25.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.413+0000 7ff017e00640 1 -- start start 2024-09-12T03:03:25.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.414+0000 7ff017e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff018102c00 0x7ff0181982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:25.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.414+0000 7ff017e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff018103520 0x7ff018198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:25.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.414+0000 7ff017e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff01810bfd0 0x7ff01819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:25.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.414+0000 7ff017e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff018111d40 con 0x7ff01810bfd0 2024-09-12T03:03:25.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.414+0000 7ff017e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff018111bc0 con 0x7ff018102c00 2024-09-12T03:03:25.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.414+0000 7ff017e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff018111ec0 con 0x7ff018103520 2024-09-12T03:03:25.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.414+0000 7ff016a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff018102c00 0x7ff0181982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:25.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.414+0000 7ff016a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff018102c00 0x7ff0181982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:50760/0 (socket says 172.21.15.18:50760) 2024-09-12T03:03:25.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.414+0000 7ff016a00640 1 -- 172.21.15.18:0/3853647824 learned_addr learned my addr 172.21.15.18:0/3853647824 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:25.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.414+0000 7ff016000640 1 --2- 172.21.15.18:0/3853647824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff018103520 0x7ff018198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:25.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.415+0000 7ff017400640 1 --2- 172.21.15.18:0/3853647824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff01810bfd0 0x7ff01819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:25.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.415+0000 7ff016000640 1 -- 172.21.15.18:0/3853647824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff018102c00 msgr2=0x7ff0181982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:25.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.415+0000 7ff016000640 1 --2- 172.21.15.18:0/3853647824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff018102c00 0x7ff0181982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:25.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.415+0000 7ff016000640 1 -- 172.21.15.18:0/3853647824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff01810bfd0 msgr2=0x7ff01819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:25.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.415+0000 7ff016000640 1 --2- 172.21.15.18:0/3853647824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff01810bfd0 0x7ff01819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:25.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.415+0000 7ff016000640 1 -- 172.21.15.18:0/3853647824 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff01819d2e0 con 0x7ff018103520 2024-09-12T03:03:25.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.415+0000 7ff017400640 1 --2- 172.21.15.18:0/3853647824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff01810bfd0 0x7ff01819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:03:25.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.416+0000 7ff016000640 1 --2- 172.21.15.18:0/3853647824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff018103520 0x7ff018198830 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff004009bc0 tx=0x7ff00400b690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:25.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.416+0000 7ff00f400640 1 -- 172.21.15.18:0/3853647824 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00400be60 con 0x7ff018103520 2024-09-12T03:03:25.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.416+0000 7ff017e00640 1 -- 172.21.15.18:0/3853647824 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff01819d5d0 con 0x7ff018103520 2024-09-12T03:03:25.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.417+0000 7ff017e00640 1 -- 172.21.15.18:0/3853647824 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff018100780 con 0x7ff018103520 2024-09-12T03:03:25.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.418+0000 7ff00f400640 1 -- 172.21.15.18:0/3853647824 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff00400f480 con 0x7ff018103520 2024-09-12T03:03:25.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.418+0000 7ff017e00640 1 -- 172.21.15.18:0/3853647824 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff018102fe0 con 0x7ff018103520 2024-09-12T03:03:25.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.419+0000 7ff00f400640 1 -- 172.21.15.18:0/3853647824 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00400e640 con 0x7ff018103520 2024-09-12T03:03:25.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.423+0000 7ff00f400640 1 -- 172.21.15.18:0/3853647824 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7ff00400e7e0 con 0x7ff018103520 2024-09-12T03:03:25.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.425+0000 7ff00f400640 1 --2- 172.21.15.18:0/3853647824 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7feffc0a2dc0 0x7feffc0a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:25.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.425+0000 7ff00f400640 1 -- 172.21.15.18:0/3853647824 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9842+0+0 (secure 0 0 0) 0x7ff0040cfa90 con 0x7ff018103520 2024-09-12T03:03:25.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.426+0000 7ff016a00640 1 --2- 172.21.15.18:0/3853647824 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7feffc0a2dc0 0x7feffc0a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:25.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.427+0000 7ff016a00640 1 --2- 172.21.15.18:0/3853647824 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7feffc0a2dc0 0x7feffc0a5280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff008005fd0 tx=0x7ff008017040 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:25.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.428+0000 7ff00f400640 1 -- 172.21.15.18:0/3853647824 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff00409d110 con 0x7ff018103520 2024-09-12T03:03:25.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:24 smithi176 ceph-mon[35713]: pgmap v460: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 822 KiB/s wr, 225 op/s 2024-09-12T03:03:25.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:24 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3304943606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T03:03:25.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.795+0000 7ff017e00640 1 -- 172.21.15.18:0/3853647824 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff0181070b0 con 0x7ff018103520 2024-09-12T03:03:25.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.797+0000 7ff00f400640 1 -- 172.21.15.18:0/3853647824 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) ==== 104+0+11 (secure 0 0 0) 0x7ff00409ca10 con 0x7ff018103520 2024-09-12T03:03:25.797 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-12T03:03:25.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.801+0000 7ff017e00640 1 -- 172.21.15.18:0/3853647824 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7feffc0a2dc0 msgr2=0x7feffc0a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:25.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.801+0000 7ff017e00640 1 --2- 172.21.15.18:0/3853647824 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7feffc0a2dc0 0x7feffc0a5280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff008005fd0 tx=0x7ff008017040 comp rx=0 tx=0).stop 2024-09-12T03:03:25.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.801+0000 7ff017e00640 1 -- 172.21.15.18:0/3853647824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff018103520 msgr2=0x7ff018198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:25.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.801+0000 7ff017e00640 1 --2- 172.21.15.18:0/3853647824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff018103520 0x7ff018198830 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff004009bc0 tx=0x7ff00400b690 comp rx=0 tx=0).stop 2024-09-12T03:03:25.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.801+0000 7ff017e00640 1 -- 172.21.15.18:0/3853647824 shutdown_connections 2024-09-12T03:03:25.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.801+0000 7ff017e00640 1 --2- 172.21.15.18:0/3853647824 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7feffc0a2dc0 0x7feffc0a5280 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:25.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.801+0000 7ff017e00640 1 --2- 172.21.15.18:0/3853647824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff01810bfd0 0x7ff01819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:25.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.801+0000 7ff017e00640 1 --2- 172.21.15.18:0/3853647824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff018103520 0x7ff018198830 secure :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff004009bc0 tx=0x7ff00400b690 comp rx=0 tx=0).stop 2024-09-12T03:03:25.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.801+0000 7ff017e00640 1 --2- 172.21.15.18:0/3853647824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff018102c00 0x7ff0181982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:25.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.801+0000 7ff017e00640 1 -- 172.21.15.18:0/3853647824 >> 172.21.15.18:0/3853647824 conn(0x7ff0180778c0 msgr2=0x7ff0180fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:25.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.802+0000 7ff017e00640 1 -- 172.21.15.18:0/3853647824 shutdown_connections 2024-09-12T03:03:25.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:25.802+0000 7ff017e00640 1 -- 172.21.15.18:0/3853647824 wait complete. 2024-09-12T03:03:25.829 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T03:03:26.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:25 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1300435249' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T03:03:26.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:25 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3853647824' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T03:03:26.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.122+0000 7f4fe0600640 1 -- 172.21.15.18:0/1310214458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fd8109060 msgr2=0x7f4fd8110bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:26.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.122+0000 7f4fe0600640 1 --2- 172.21.15.18:0/1310214458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fd8109060 0x7f4fd8110bb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009ca0 tx=0x7f4fd002a8c0 comp rx=0 tx=0).stop 2024-09-12T03:03:26.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.122+0000 7f4fe0600640 1 -- 172.21.15.18:0/1310214458 shutdown_connections 2024-09-12T03:03:26.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.122+0000 7f4fe0600640 1 --2- 172.21.15.18:0/1310214458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fd8109060 0x7f4fd8110bb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:26.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.122+0000 7f4fe0600640 1 --2- 172.21.15.18:0/1310214458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fd81048c0 0x7f4fd8108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:26.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.122+0000 7f4fe0600640 1 --2- 172.21.15.18:0/1310214458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fd8103f10 0x7f4fd81042f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:26.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.123+0000 7f4fe0600640 1 -- 172.21.15.18:0/1310214458 >> 172.21.15.18:0/1310214458 conn(0x7f4fd80ff980 msgr2=0x7f4fd8101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:26.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.123+0000 7f4fe0600640 1 -- 172.21.15.18:0/1310214458 shutdown_connections 2024-09-12T03:03:26.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.124+0000 7f4fe0600640 1 -- 172.21.15.18:0/1310214458 wait complete. 2024-09-12T03:03:26.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.125+0000 7f4fe0600640 1 Processor -- start 2024-09-12T03:03:26.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.125+0000 7f4fe0600640 1 -- start start 2024-09-12T03:03:26.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.126+0000 7f4fe0600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fd8103f10 0x7f4fd8076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:26.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.126+0000 7f4fe0600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fd8109060 0x7f4fd8076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:26.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.126+0000 7f4fe0600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fd8077180 0x7f4fd81aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:26.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.126+0000 7f4fe0600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd81141d0 con 0x7f4fd8077180 2024-09-12T03:03:26.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.126+0000 7f4fe0600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd8114050 con 0x7f4fd8109060 2024-09-12T03:03:26.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.126+0000 7f4fe0600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd8114350 con 0x7f4fd8103f10 2024-09-12T03:03:26.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.126+0000 7f4fdd200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fd8109060 0x7f4fd8076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:26.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.126+0000 7f4fde600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fd8077180 0x7f4fd81aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:26.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.126+0000 7f4fddc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fd8103f10 0x7f4fd8076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:26.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.126+0000 7f4fde600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fd8077180 0x7f4fd81aacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47314/0 (socket says 172.21.15.18:47314) 2024-09-12T03:03:26.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.126+0000 7f4fde600640 1 -- 172.21.15.18:0/2465416246 learned_addr learned my addr 172.21.15.18:0/2465416246 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:26.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.126+0000 7f4fdd200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fd8109060 0x7f4fd8076c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:50784/0 (socket says 172.21.15.18:50784) 2024-09-12T03:03:26.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.127+0000 7f4fdd200640 1 -- 172.21.15.18:0/2465416246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fd8103f10 msgr2=0x7f4fd8076700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:26.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.127+0000 7f4fdd200640 1 --2- 172.21.15.18:0/2465416246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fd8103f10 0x7f4fd8076700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:26.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.127+0000 7f4fdd200640 1 -- 172.21.15.18:0/2465416246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fd8077180 msgr2=0x7f4fd81aacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:26.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.127+0000 7f4fdd200640 1 --2- 172.21.15.18:0/2465416246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fd8077180 0x7f4fd81aacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:26.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.127+0000 7f4fdd200640 1 -- 172.21.15.18:0/2465416246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd81ab1f0 con 0x7f4fd8109060 2024-09-12T03:03:26.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.128+0000 7f4fdd200640 1 --2- 172.21.15.18:0/2465416246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fd8109060 0x7f4fd8076c40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400b3c0 tx=0x7f4fc400b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:26.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.128+0000 7f4fd6000640 1 -- 172.21.15.18:0/2465416246 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4015020 con 0x7f4fd8109060 2024-09-12T03:03:26.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.128+0000 7f4fe0600640 1 -- 172.21.15.18:0/2465416246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd81ab4e0 con 0x7f4fd8109060 2024-09-12T03:03:26.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.128+0000 7f4fe0600640 1 -- 172.21.15.18:0/2465416246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd81aba50 con 0x7f4fd8109060 2024-09-12T03:03:26.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.128+0000 7f4fd6000640 1 -- 172.21.15.18:0/2465416246 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fc4011d10 con 0x7f4fd8109060 2024-09-12T03:03:26.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.128+0000 7f4fd6000640 1 -- 172.21.15.18:0/2465416246 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc400f2e0 con 0x7f4fd8109060 2024-09-12T03:03:26.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.132+0000 7f4fe0600640 1 -- 172.21.15.18:0/2465416246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fb8005290 con 0x7f4fd8109060 2024-09-12T03:03:26.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.136+0000 7f4fd6000640 1 -- 172.21.15.18:0/2465416246 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f4fc4018020 con 0x7f4fd8109060 2024-09-12T03:03:26.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.138+0000 7f4fd6000640 1 --2- 172.21.15.18:0/2465416246 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4fc00a2d80 0x7f4fc00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:26.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.139+0000 7f4fd6000640 1 -- 172.21.15.18:0/2465416246 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9842+0+0 (secure 0 0 0) 0x7f4fc40cefa0 con 0x7f4fd8109060 2024-09-12T03:03:26.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.140+0000 7f4fddc00640 1 --2- 172.21.15.18:0/2465416246 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4fc00a2d80 0x7f4fc00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:26.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.141+0000 7f4fddc00640 1 --2- 172.21.15.18:0/2465416246 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4fc00a2d80 0x7f4fc00a5240 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009990 tx=0x7f4fcc009110 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:26.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.150+0000 7f4fd6000640 1 -- 172.21.15.18:0/2465416246 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4fc401f020 con 0x7f4fd8109060 2024-09-12T03:03:26.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:25 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1300435249' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T03:03:26.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:25 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3853647824' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T03:03:26.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:25 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1300435249' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T03:03:26.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:25 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3853647824' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T03:03:26.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.522+0000 7f4fe0600640 1 -- 172.21.15.18:0/2465416246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4fb8005850 con 0x7f4fd8109060 2024-09-12T03:03:26.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.523+0000 7f4fd6000640 1 -- 172.21.15.18:0/2465416246 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) ==== 100+0+11 (secure 0 0 0) 0x7f4fc40172c0 con 0x7f4fd8109060 2024-09-12T03:03:26.523 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-09-12T03:03:26.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.526+0000 7f4fe0600640 1 -- 172.21.15.18:0/2465416246 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4fc00a2d80 msgr2=0x7f4fc00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:26.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.527+0000 7f4fe0600640 1 --2- 172.21.15.18:0/2465416246 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4fc00a2d80 0x7f4fc00a5240 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009990 tx=0x7f4fcc009110 comp rx=0 tx=0).stop 2024-09-12T03:03:26.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.527+0000 7f4fe0600640 1 -- 172.21.15.18:0/2465416246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fd8109060 msgr2=0x7f4fd8076c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:26.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.527+0000 7f4fe0600640 1 --2- 172.21.15.18:0/2465416246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fd8109060 0x7f4fd8076c40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400b3c0 tx=0x7f4fc400b7c0 comp rx=0 tx=0).stop 2024-09-12T03:03:26.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.527+0000 7f4fe0600640 1 -- 172.21.15.18:0/2465416246 shutdown_connections 2024-09-12T03:03:26.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.527+0000 7f4fe0600640 1 --2- 172.21.15.18:0/2465416246 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f4fc00a2d80 0x7f4fc00a5240 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009990 tx=0x7f4fcc009110 comp rx=0 tx=0).stop 2024-09-12T03:03:26.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.527+0000 7f4fe0600640 1 --2- 172.21.15.18:0/2465416246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fd8077180 0x7f4fd81aacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:26.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.527+0000 7f4fe0600640 1 --2- 172.21.15.18:0/2465416246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fd8109060 0x7f4fd8076c40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:26.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.527+0000 7f4fe0600640 1 --2- 172.21.15.18:0/2465416246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fd8103f10 0x7f4fd8076700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:26.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.527+0000 7f4fe0600640 1 -- 172.21.15.18:0/2465416246 >> 172.21.15.18:0/2465416246 conn(0x7f4fd80ff980 msgr2=0x7f4fd8100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:26.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.527+0000 7f4fe0600640 1 -- 172.21.15.18:0/2465416246 shutdown_connections 2024-09-12T03:03:26.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.527+0000 7f4fe0600640 1 -- 172.21.15.18:0/2465416246 wait complete. 2024-09-12T03:03:26.555 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-12T03:03:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.846+0000 7f8727e00640 1 -- 172.21.15.18:0/2398884571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8720114ab0 msgr2=0x7f8720116ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.846+0000 7f8727e00640 1 --2- 172.21.15.18:0/2398884571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8720114ab0 0x7f8720116ea0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f870c009860 tx=0x7f870c02a360 comp rx=0 tx=0).stop 2024-09-12T03:03:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.846+0000 7f8727e00640 1 -- 172.21.15.18:0/2398884571 shutdown_connections 2024-09-12T03:03:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.846+0000 7f8727e00640 1 --2- 172.21.15.18:0/2398884571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8720114ab0 0x7f8720116ea0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.846+0000 7f8727e00640 1 --2- 172.21.15.18:0/2398884571 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8720109ba0 0x7f8720114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.846+0000 7f8727e00640 1 --2- 172.21.15.18:0/2398884571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87201091f0 0x7f87201095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.846+0000 7f8727e00640 1 -- 172.21.15.18:0/2398884571 >> 172.21.15.18:0/2398884571 conn(0x7f872006cdd0 msgr2=0x7f872006d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.846+0000 7f8727e00640 1 -- 172.21.15.18:0/2398884571 shutdown_connections 2024-09-12T03:03:26.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.848+0000 7f8727e00640 1 -- 172.21.15.18:0/2398884571 wait complete. 2024-09-12T03:03:26.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.850+0000 7f8727e00640 1 Processor -- start 2024-09-12T03:03:26.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.850+0000 7f8727e00640 1 -- start start 2024-09-12T03:03:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.851+0000 7f8727e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87201091f0 0x7f872010a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.851+0000 7f8727e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8720109ba0 0x7f872010a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.851+0000 7f8727e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8720114ab0 0x7f872010ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.851+0000 7f8727e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f872011a7e0 con 0x7f8720114ab0 2024-09-12T03:03:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.851+0000 7f8727e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f872011a660 con 0x7f8720109ba0 2024-09-12T03:03:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.851+0000 7f8727e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f872011a960 con 0x7f87201091f0 2024-09-12T03:03:26.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.851+0000 7f8725400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87201091f0 0x7f872010a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:26.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.851+0000 7f8724a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8720109ba0 0x7f872010a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:26.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.851+0000 7f8725400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87201091f0 0x7f872010a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:50692/0 (socket says 172.21.15.18:50692) 2024-09-12T03:03:26.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.851+0000 7f8725400640 1 -- 172.21.15.18:0/4058554714 learned_addr learned my addr 172.21.15.18:0/4058554714 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:26.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.851+0000 7f8725e00640 1 --2- 172.21.15.18:0/4058554714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8720114ab0 0x7f872010ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:26.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.852+0000 7f8725400640 1 -- 172.21.15.18:0/4058554714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8720109ba0 msgr2=0x7f872010a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:26.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.852+0000 7f8725400640 1 --2- 172.21.15.18:0/4058554714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8720109ba0 0x7f872010a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:26.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.852+0000 7f8725400640 1 -- 172.21.15.18:0/4058554714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8720114ab0 msgr2=0x7f872010ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:26.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.852+0000 7f8725400640 1 --2- 172.21.15.18:0/4058554714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8720114ab0 0x7f872010ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:26.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.852+0000 7f8725400640 1 -- 172.21.15.18:0/4058554714 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87201b3650 con 0x7f87201091f0 2024-09-12T03:03:26.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.852+0000 7f8724a00640 1 --2- 172.21.15.18:0/4058554714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8720109ba0 0x7f872010a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:03:26.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.852+0000 7f8725e00640 1 --2- 172.21.15.18:0/4058554714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8720114ab0 0x7f872010ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:03:26.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.852+0000 7f8725400640 1 --2- 172.21.15.18:0/4058554714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87201091f0 0x7f872010a3d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f871800c420 tx=0x7f871800c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:26.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.853+0000 7f871e000640 1 -- 172.21.15.18:0/4058554714 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718004b20 con 0x7f87201091f0 2024-09-12T03:03:26.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.853+0000 7f8727e00640 1 -- 172.21.15.18:0/4058554714 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87201b3880 con 0x7f87201091f0 2024-09-12T03:03:26.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.853+0000 7f8727e00640 1 -- 172.21.15.18:0/4058554714 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87201b3dd0 con 0x7f87201091f0 2024-09-12T03:03:26.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.853+0000 7f871e000640 1 -- 172.21.15.18:0/4058554714 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8718003e50 con 0x7f87201091f0 2024-09-12T03:03:26.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.853+0000 7f871e000640 1 -- 172.21.15.18:0/4058554714 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871800b590 con 0x7f87201091f0 2024-09-12T03:03:26.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.856+0000 7f8727e00640 1 -- 172.21.15.18:0/4058554714 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8700005290 con 0x7f87201091f0 2024-09-12T03:03:26.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.858+0000 7f871e000640 1 -- 172.21.15.18:0/4058554714 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f871801d020 con 0x7f87201091f0 2024-09-12T03:03:26.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.861+0000 7f871e000640 1 --2- 172.21.15.18:0/4058554714 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f87080a2e00 0x7f87080a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:26.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.861+0000 7f871e000640 1 -- 172.21.15.18:0/4058554714 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9842+0+0 (secure 0 0 0) 0x7f87180cf9d0 con 0x7f87201091f0 2024-09-12T03:03:26.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.862+0000 7f8724a00640 1 --2- 172.21.15.18:0/4058554714 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f87080a2e00 0x7f87080a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:26.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.866+0000 7f8724a00640 1 --2- 172.21.15.18:0/4058554714 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f87080a2e00 0x7f87080a52c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f872010bb90 tx=0x7f8714009110 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:26.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:26.867+0000 7f871e000640 1 -- 172.21.15.18:0/4058554714 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f871809c060 con 0x7f87201091f0 2024-09-12T03:03:27.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.259+0000 7f8727e00640 1 -- 172.21.15.18:0/4058554714 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f8700005850 con 0x7f87201091f0 2024-09-12T03:03:27.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.260+0000 7f871e000640 1 -- 172.21.15.18:0/4058554714 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v116) ==== 103+0+11 (secure 0 0 0) 0x7f871809b960 con 0x7f87201091f0 2024-09-12T03:03:27.266 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-12T03:03:27.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.267+0000 7f8727e00640 1 -- 172.21.15.18:0/4058554714 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f87080a2e00 msgr2=0x7f87080a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:27.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.267+0000 7f8727e00640 1 --2- 172.21.15.18:0/4058554714 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f87080a2e00 0x7f87080a52c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f872010bb90 tx=0x7f8714009110 comp rx=0 tx=0).stop 2024-09-12T03:03:27.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.267+0000 7f8727e00640 1 -- 172.21.15.18:0/4058554714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87201091f0 msgr2=0x7f872010a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:27.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.267+0000 7f8727e00640 1 --2- 172.21.15.18:0/4058554714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87201091f0 0x7f872010a3d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f871800c420 tx=0x7f871800c820 comp rx=0 tx=0).stop 2024-09-12T03:03:27.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.267+0000 7f8727e00640 1 -- 172.21.15.18:0/4058554714 shutdown_connections 2024-09-12T03:03:27.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.267+0000 7f8727e00640 1 --2- 172.21.15.18:0/4058554714 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f87080a2e00 0x7f87080a52c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:27.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.267+0000 7f8727e00640 1 --2- 172.21.15.18:0/4058554714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8720114ab0 0x7f872010ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:27.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.267+0000 7f8727e00640 1 --2- 172.21.15.18:0/4058554714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8720109ba0 0x7f872010a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:27.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.267+0000 7f8727e00640 1 --2- 172.21.15.18:0/4058554714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87201091f0 0x7f872010a3d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:27.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.267+0000 7f8727e00640 1 -- 172.21.15.18:0/4058554714 >> 172.21.15.18:0/4058554714 conn(0x7f872006cdd0 msgr2=0x7f87200708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:27.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.267+0000 7f8727e00640 1 -- 172.21.15.18:0/4058554714 shutdown_connections 2024-09-12T03:03:27.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.267+0000 7f8727e00640 1 -- 172.21.15.18:0/4058554714 wait complete. 2024-09-12T03:03:27.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:27 smithi062 ceph-mon[35527]: pgmap v461: 129 pgs: 69 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 832 KiB/s wr, 223 op/s 2024-09-12T03:03:27.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:27 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2465416246' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T03:03:27.292 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:27 smithi018 ceph-mon[30616]: pgmap v461: 129 pgs: 69 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 832 KiB/s wr, 223 op/s 2024-09-12T03:03:27.292 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:27 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2465416246' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T03:03:27.294 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-12T03:03:27.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:27 smithi176 ceph-mon[35713]: pgmap v461: 129 pgs: 69 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 832 KiB/s wr, 223 op/s 2024-09-12T03:03:27.479 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:27 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2465416246' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T03:03:27.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.585+0000 7f25d9e00640 1 -- 172.21.15.18:0/3682702315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25d4114ab0 msgr2=0x7f25d4116ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:27.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.585+0000 7f25d9e00640 1 --2- 172.21.15.18:0/3682702315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25d4114ab0 0x7f25d4116ea0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009ca0 tx=0x7f25cc02a8d0 comp rx=0 tx=0).stop 2024-09-12T03:03:27.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.586+0000 7f25d9e00640 1 -- 172.21.15.18:0/3682702315 shutdown_connections 2024-09-12T03:03:27.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.586+0000 7f25d9e00640 1 --2- 172.21.15.18:0/3682702315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25d4114ab0 0x7f25d4116ea0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:27.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.586+0000 7f25d9e00640 1 --2- 172.21.15.18:0/3682702315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25d4109b10 0x7f25d4114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:27.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.586+0000 7f25d9e00640 1 --2- 172.21.15.18:0/3682702315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25d41091f0 0x7f25d41095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:27.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.586+0000 7f25d9e00640 1 -- 172.21.15.18:0/3682702315 >> 172.21.15.18:0/3682702315 conn(0x7f25d406d020 msgr2=0x7f25d406d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:27.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.586+0000 7f25d9e00640 1 -- 172.21.15.18:0/3682702315 shutdown_connections 2024-09-12T03:03:27.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.586+0000 7f25d9e00640 1 -- 172.21.15.18:0/3682702315 wait complete. 2024-09-12T03:03:27.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.588+0000 7f25d9e00640 1 Processor -- start 2024-09-12T03:03:27.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.588+0000 7f25d9e00640 1 -- start start 2024-09-12T03:03:27.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.589+0000 7f25d9e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25d41091f0 0x7f25d410c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:27.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.589+0000 7f25d9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25d4109b10 0x7f25d410cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:27.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.589+0000 7f25d9e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25d4114ab0 0x7f25d410d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:27.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.589+0000 7f25d9e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25d411a4e0 con 0x7f25d4109b10 2024-09-12T03:03:27.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.589+0000 7f25d9e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f25d411a360 con 0x7f25d41091f0 2024-09-12T03:03:27.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.589+0000 7f25d9e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f25d411a660 con 0x7f25d4114ab0 2024-09-12T03:03:27.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.590+0000 7f25d3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25d4109b10 0x7f25d410cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:27.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.590+0000 7f25d3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25d4109b10 0x7f25d410cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47338/0 (socket says 172.21.15.18:47338) 2024-09-12T03:03:27.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.590+0000 7f25d3e00640 1 -- 172.21.15.18:0/3098563892 learned_addr learned my addr 172.21.15.18:0/3098563892 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:03:27.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.590+0000 7f25d3e00640 1 -- 172.21.15.18:0/3098563892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25d4114ab0 msgr2=0x7f25d410d060 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T03:03:27.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.590+0000 7f25d3e00640 1 --2- 172.21.15.18:0/3098563892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25d4114ab0 0x7f25d410d060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:27.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.590+0000 7f25d3e00640 1 -- 172.21.15.18:0/3098563892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25d41091f0 msgr2=0x7f25d410c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:27.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.590+0000 7f25d3e00640 1 --2- 172.21.15.18:0/3098563892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25d41091f0 0x7f25d410c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.590+0000 7f25d3e00640 1 -- 172.21.15.18:0/3098563892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d41b31e0 con 0x7f25d4109b10 2024-09-12T03:03:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.591+0000 7f25d3e00640 1 --2- 172.21.15.18:0/3098563892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25d4109b10 0x7f25d410cb20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f25c000ea20 tx=0x7f25c000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.592+0000 7f25d1600640 1 -- 172.21.15.18:0/3098563892 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c000cd80 con 0x7f25d4109b10 2024-09-12T03:03:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.592+0000 7f25d1600640 1 -- 172.21.15.18:0/3098563892 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25c0005500 con 0x7f25d4109b10 2024-09-12T03:03:27.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.592+0000 7f25d1600640 1 -- 172.21.15.18:0/3098563892 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0010690 con 0x7f25d4109b10 2024-09-12T03:03:27.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.593+0000 7f25d9e00640 1 -- 172.21.15.18:0/3098563892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25d41b34d0 con 0x7f25d4109b10 2024-09-12T03:03:27.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.593+0000 7f25d9e00640 1 -- 172.21.15.18:0/3098563892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25d41b39d0 con 0x7f25d4109b10 2024-09-12T03:03:27.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.595+0000 7f25d9e00640 1 -- 172.21.15.18:0/3098563892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25d40737f0 con 0x7f25d4109b10 2024-09-12T03:03:27.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.607+0000 7f25d1600640 1 -- 172.21.15.18:0/3098563892 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f25c00046c0 con 0x7f25d4109b10 2024-09-12T03:03:27.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.614+0000 7f25d1600640 1 --2- 172.21.15.18:0/3098563892 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f25bc0a2d80 0x7f25bc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:03:27.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.615+0000 7f25d1600640 1 -- 172.21.15.18:0/3098563892 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9842+0+0 (secure 0 0 0) 0x7f25c00cffa0 con 0x7f25d4109b10 2024-09-12T03:03:27.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.615+0000 7f25d8a00640 1 --2- 172.21.15.18:0/3098563892 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f25bc0a2d80 0x7f25bc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:03:27.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.616+0000 7f25d8a00640 1 --2- 172.21.15.18:0/3098563892 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f25bc0a2d80 0x7f25bc0a5240 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f25c800a990 tx=0x7f25c8005c70 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:03:27.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:27.617+0000 7f25d1600640 1 -- 172.21.15.18:0/3098563892 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f25c00541b0 con 0x7f25d4109b10 2024-09-12T03:03:28.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:28.086+0000 7f25d9e00640 1 -- 172.21.15.18:0/3098563892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f25d410db10 con 0x7f25d4109b10 2024-09-12T03:03:28.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:28.112+0000 7f25d1600640 1 -- 172.21.15.18:0/3098563892 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v27) ==== 81+0+740902 (secure 0 0 0) 0x7f25c009c690 con 0x7f25d4109b10 2024-09-12T03:03:28.125 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T03:03:28.126 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T03:03:28.126 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 27, 2024-09-12T03:03:28.126 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.126 INFO:teuthology.orchestra.run.smithi018.stdout: "active_gid": 25213, 2024-09-12T03:03:28.126 INFO:teuthology.orchestra.run.smithi018.stdout: "active_name": "x", 2024-09-12T03:03:28.126 INFO:teuthology.orchestra.run.smithi018.stdout: "active_addrs": { 2024-09-12T03:03:28.126 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-12T03:03:28.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.126 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-12T03:03:28.126 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-12T03:03:28.126 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4058201283 2024-09-12T03:03:28.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.127 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-12T03:03:28.127 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-12T03:03:28.127 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4058201283 2024-09-12T03:03:28.127 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.127 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-12T03:03:28.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.127 INFO:teuthology.orchestra.run.smithi018.stdout: "active_addr": "172.21.15.18:6801/4058201283", 2024-09-12T03:03:28.127 INFO:teuthology.orchestra.run.smithi018.stdout: "active_change": "2024-09-12T02:48:42.970414+0000", 2024-09-12T03:03:28.127 INFO:teuthology.orchestra.run.smithi018.stdout: "active_mgr_features": 4540701547738038271, 2024-09-12T03:03:28.127 INFO:teuthology.orchestra.run.smithi018.stdout: "available": true, 2024-09-12T03:03:28.127 INFO:teuthology.orchestra.run.smithi018.stdout: "standbys": [ 2024-09-12T03:03:28.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.128 INFO:teuthology.orchestra.run.smithi018.stdout: "gid": 25207, 2024-09-12T03:03:28.128 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "z", 2024-09-12T03:03:28.128 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_features": 4540701547738038271, 2024-09-12T03:03:28.128 INFO:teuthology.orchestra.run.smithi018.stdout: "available_modules": [ 2024-09-12T03:03:28.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.128 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "alerts", 2024-09-12T03:03:28.128 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.128 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.128 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.128 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-12T03:03:28.128 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-12T03:03:28.128 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.129 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.129 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.129 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-12T03:03:28.129 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.129 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.129 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.129 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T03:03:28.129 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.129 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.129 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.129 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.130 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.130 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.130 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.130 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.130 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.130 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.130 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.130 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.130 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.130 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.130 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.130 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.131 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.131 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.131 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.131 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.131 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.131 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.131 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.131 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.131 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.131 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.131 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.132 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.132 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.132 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.132 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.132 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.132 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.132 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.132 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.132 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.132 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.132 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.133 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.133 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.133 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.133 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.133 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.133 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.133 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.133 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.133 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.133 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.133 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.133 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.134 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.134 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.134 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.134 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.134 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.134 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.134 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.134 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.134 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.134 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.134 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.134 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.135 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.135 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.135 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.135 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.135 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.135 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.135 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_destination": { 2024-09-12T03:03:28.135 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_destination", 2024-09-12T03:03:28.135 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.135 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.135 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.135 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.136 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.136 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.136 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.136 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email address to send alerts to", 2024-09-12T03:03:28.136 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.136 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.136 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.136 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_from_name": { 2024-09-12T03:03:28.136 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_from_name", 2024-09-12T03:03:28.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.136 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.136 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.137 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "Ceph", 2024-09-12T03:03:28.137 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.137 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.137 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.137 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email From: name", 2024-09-12T03:03:28.137 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.137 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.137 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.137 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_host": { 2024-09-12T03:03:28.137 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_host", 2024-09-12T03:03:28.137 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.137 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.137 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.138 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.138 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.138 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.138 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.138 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP server", 2024-09-12T03:03:28.138 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.138 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.138 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.138 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_password": { 2024-09-12T03:03:28.138 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_password", 2024-09-12T03:03:28.138 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.138 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.138 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.139 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.139 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.139 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.139 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.139 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Password to authenticate with", 2024-09-12T03:03:28.139 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.139 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.139 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.139 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_port": { 2024-09-12T03:03:28.139 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_port", 2024-09-12T03:03:28.139 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.139 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.139 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.140 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "465", 2024-09-12T03:03:28.140 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.140 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.140 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.140 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP port", 2024-09-12T03:03:28.140 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.140 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.140 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.140 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_sender": { 2024-09-12T03:03:28.140 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_sender", 2024-09-12T03:03:28.140 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.140 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.141 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.141 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.141 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.141 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.141 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.141 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP envelope sender", 2024-09-12T03:03:28.141 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.141 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.141 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.141 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_ssl": { 2024-09-12T03:03:28.141 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_ssl", 2024-09-12T03:03:28.142 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.142 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.142 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.142 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.142 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.142 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.142 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.142 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T03:03:28.142 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.142 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.142 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.142 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_user": { 2024-09-12T03:03:28.143 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_user", 2024-09-12T03:03:28.143 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.143 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.143 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.143 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.143 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.143 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.143 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.143 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "User to authenticate as", 2024-09-12T03:03:28.143 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.143 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.143 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.143 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.143 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.144 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "balancer", 2024-09-12T03:03:28.144 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.144 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.144 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.144 INFO:teuthology.orchestra.run.smithi018.stdout: "active": { 2024-09-12T03:03:28.144 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "active", 2024-09-12T03:03:28.144 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.144 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.144 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.144 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.144 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.145 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.145 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.145 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T03:03:28.145 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.145 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.145 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.145 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_time": { 2024-09-12T03:03:28.145 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_time", 2024-09-12T03:03:28.145 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.145 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.145 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.145 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0000", 2024-09-12T03:03:28.146 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.146 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.146 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.146 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T03:03:28.146 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T03:03:28.146 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.146 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.146 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_weekday": { 2024-09-12T03:03:28.146 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_weekday", 2024-09-12T03:03:28.146 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-12T03:03:28.146 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.146 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.146 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-12T03:03:28.147 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-12T03:03:28.147 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-12T03:03:28.147 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.147 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T03:03:28.147 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T03:03:28.147 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.147 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.147 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_max_iterations": { 2024-09-12T03:03:28.147 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_max_iterations", 2024-09-12T03:03:28.147 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-12T03:03:28.147 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.147 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.148 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "25", 2024-09-12T03:03:28.148 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-12T03:03:28.148 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "250", 2024-09-12T03:03:28.148 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.148 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T03:03:28.148 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.148 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.148 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.148 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_metrics": { 2024-09-12T03:03:28.148 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_metrics", 2024-09-12T03:03:28.148 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.148 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.149 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.149 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T03:03:28.149 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.149 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.149 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.149 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T03:03:28.149 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T03:03:28.149 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.149 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.149 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_step": { 2024-09-12T03:03:28.149 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_step", 2024-09-12T03:03:28.149 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:28.149 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.150 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.150 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.5", 2024-09-12T03:03:28.150 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0.001", 2024-09-12T03:03:28.150 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "0.999", 2024-09-12T03:03:28.150 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.150 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "aggressiveness of optimization", 2024-09-12T03:03:28.150 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T03:03:28.150 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.150 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.150 INFO:teuthology.orchestra.run.smithi018.stdout: "end_time": { 2024-09-12T03:03:28.150 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_time", 2024-09-12T03:03:28.151 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.151 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.151 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.151 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2359", 2024-09-12T03:03:28.151 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.151 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.151 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.151 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T03:03:28.151 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T03:03:28.151 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.151 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.151 INFO:teuthology.orchestra.run.smithi018.stdout: "end_weekday": { 2024-09-12T03:03:28.152 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_weekday", 2024-09-12T03:03:28.152 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-12T03:03:28.152 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.152 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.152 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-12T03:03:28.152 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-12T03:03:28.152 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-12T03:03:28.152 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.152 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T03:03:28.152 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T03:03:28.152 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.152 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.153 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.153 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.153 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.153 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.153 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.153 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.153 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.153 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.153 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.153 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.153 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.153 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.153 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.154 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.154 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.154 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.154 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.154 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.154 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.154 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.154 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.154 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.154 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.154 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.154 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.155 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.155 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.155 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.155 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.155 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.155 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.155 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.155 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.155 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.155 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.155 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.155 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.156 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.156 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.156 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.156 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.156 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.156 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.156 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.156 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.156 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.156 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.156 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.156 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.156 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.157 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.157 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.157 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.157 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.157 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.157 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.157 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.157 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.157 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.157 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.157 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.157 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.158 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.158 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.158 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.158 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.158 INFO:teuthology.orchestra.run.smithi018.stdout: "min_score": { 2024-09-12T03:03:28.158 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_score", 2024-09-12T03:03:28.158 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:28.158 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.158 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.158 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-12T03:03:28.158 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.158 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.159 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.159 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T03:03:28.159 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.159 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.159 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.159 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-12T03:03:28.159 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-12T03:03:28.159 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.159 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.159 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.159 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "upmap", 2024-09-12T03:03:28.160 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.160 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.160 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.160 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-compat", 2024-09-12T03:03:28.160 INFO:teuthology.orchestra.run.smithi018.stdout: "none", 2024-09-12T03:03:28.160 INFO:teuthology.orchestra.run.smithi018.stdout: "read", 2024-09-12T03:03:28.160 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap", 2024-09-12T03:03:28.160 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap-read" 2024-09-12T03:03:28.160 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.160 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Balancer mode", 2024-09-12T03:03:28.160 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.160 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.161 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.161 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_ids": { 2024-09-12T03:03:28.161 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_ids", 2024-09-12T03:03:28.161 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.161 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.161 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.161 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.161 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.161 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.161 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.161 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T03:03:28.162 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.162 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.162 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.162 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-12T03:03:28.162 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-12T03:03:28.162 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.162 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.162 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.162 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-12T03:03:28.162 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.163 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.163 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.163 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T03:03:28.163 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.163 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.163 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.163 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_deviation": { 2024-09-12T03:03:28.163 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_deviation", 2024-09-12T03:03:28.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.163 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.163 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.164 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-12T03:03:28.164 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-12T03:03:28.164 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.164 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.164 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T03:03:28.164 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T03:03:28.164 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.164 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.164 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_optimizations": { 2024-09-12T03:03:28.164 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_optimizations", 2024-09-12T03:03:28.164 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-12T03:03:28.164 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.165 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.165 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:28.165 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.165 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.165 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.165 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T03:03:28.165 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.165 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.165 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.165 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.165 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.166 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm", 2024-09-12T03:03:28.166 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.166 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.166 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.166 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_down_multiplier": { 2024-09-12T03:03:28.166 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_down_multiplier", 2024-09-12T03:03:28.166 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:28.166 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.166 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.166 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-12T03:03:28.166 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.166 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.166 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.167 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T03:03:28.167 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.167 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.167 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.167 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_refresh_rate": { 2024-09-12T03:03:28.167 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_refresh_rate", 2024-09-12T03:03:28.167 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.167 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.167 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.167 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "20", 2024-09-12T03:03:28.167 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.167 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.167 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.168 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T03:03:28.168 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.168 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.168 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.168 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_starting_port": { 2024-09-12T03:03:28.168 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_starting_port", 2024-09-12T03:03:28.168 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.168 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.168 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.168 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4721", 2024-09-12T03:03:28.168 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.168 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.168 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.169 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T03:03:28.169 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.169 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.169 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.169 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_ptrace": { 2024-09-12T03:03:28.169 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_ptrace", 2024-09-12T03:03:28.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.169 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.169 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.169 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.170 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.170 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.170 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.170 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T03:03:28.170 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T03:03:28.170 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.170 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.170 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_interval": { 2024-09-12T03:03:28.170 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_interval", 2024-09-12T03:03:28.170 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.170 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.170 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.171 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-12T03:03:28.171 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.171 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.171 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.171 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T03:03:28.171 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.171 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.171 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.171 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_memory_target_ratio": { 2024-09-12T03:03:28.171 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T03:03:28.171 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:28.172 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.172 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.172 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.7", 2024-09-12T03:03:28.172 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.172 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.172 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.172 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T03:03:28.172 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.172 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.172 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.172 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm_log_destination": { 2024-09-12T03:03:28.172 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm_log_destination", 2024-09-12T03:03:28.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.173 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.173 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.173 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.173 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.173 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.173 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.173 INFO:teuthology.orchestra.run.smithi018.stdout: "file", 2024-09-12T03:03:28.173 INFO:teuthology.orchestra.run.smithi018.stdout: "file,syslog", 2024-09-12T03:03:28.173 INFO:teuthology.orchestra.run.smithi018.stdout: "syslog" 2024-09-12T03:03:28.173 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.173 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T03:03:28.173 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.173 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.174 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.174 INFO:teuthology.orchestra.run.smithi018.stdout: "cgroups_split": { 2024-09-12T03:03:28.174 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cgroups_split", 2024-09-12T03:03:28.174 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.174 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.174 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.174 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.174 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.174 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.174 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.174 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T03:03:28.174 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.175 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.175 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.175 INFO:teuthology.orchestra.run.smithi018.stdout: "config_checks_enabled": { 2024-09-12T03:03:28.175 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_checks_enabled", 2024-09-12T03:03:28.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.175 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.175 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.175 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.175 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.175 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.175 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.175 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T03:03:28.175 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.176 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.176 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.176 INFO:teuthology.orchestra.run.smithi018.stdout: "config_dashboard": { 2024-09-12T03:03:28.176 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_dashboard", 2024-09-12T03:03:28.176 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.176 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.176 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.176 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.176 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.176 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.176 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.177 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T03:03:28.177 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.177 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.177 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.177 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_alertmanager": { 2024-09-12T03:03:28.177 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_alertmanager", 2024-09-12T03:03:28.177 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.177 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.177 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.177 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T03:03:28.177 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.177 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.177 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.178 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-12T03:03:28.178 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.178 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.178 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.178 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_base": { 2024-09-12T03:03:28.178 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_base", 2024-09-12T03:03:28.178 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.178 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.178 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.178 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T03:03:28.178 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.178 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.178 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.178 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Container image name, without the tag", 2024-09-12T03:03:28.179 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.179 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.179 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.179 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_elasticsearch": { 2024-09-12T03:03:28.179 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_elasticsearch", 2024-09-12T03:03:28.179 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.179 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.179 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.179 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T03:03:28.179 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.179 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.179 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.179 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "elasticsearch container image", 2024-09-12T03:03:28.180 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.180 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.180 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.180 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_grafana": { 2024-09-12T03:03:28.180 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_grafana", 2024-09-12T03:03:28.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.180 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.180 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.180 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T03:03:28.180 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.180 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.180 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.181 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-12T03:03:28.181 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.181 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.181 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.181 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_haproxy": { 2024-09-12T03:03:28.181 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_haproxy", 2024-09-12T03:03:28.181 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.181 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.181 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.181 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T03:03:28.181 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.182 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.182 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.182 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "HAproxy container image", 2024-09-12T03:03:28.182 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.182 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.182 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.182 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_agent": { 2024-09-12T03:03:28.182 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_agent", 2024-09-12T03:03:28.182 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.182 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.182 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.183 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T03:03:28.183 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.183 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.183 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.183 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger agent container image", 2024-09-12T03:03:28.183 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.183 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.183 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.183 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_collector": { 2024-09-12T03:03:28.183 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_collector", 2024-09-12T03:03:28.183 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.183 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.183 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.184 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T03:03:28.184 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.184 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.184 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.184 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger collector container image", 2024-09-12T03:03:28.184 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.184 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.184 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.184 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_query": { 2024-09-12T03:03:28.184 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_query", 2024-09-12T03:03:28.184 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.184 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.185 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.185 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T03:03:28.185 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.185 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.185 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.185 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger query container image", 2024-09-12T03:03:28.185 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.185 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.185 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.185 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_keepalived": { 2024-09-12T03:03:28.185 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_keepalived", 2024-09-12T03:03:28.185 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.186 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.186 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.186 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T03:03:28.186 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.186 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.186 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.186 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Keepalived container image", 2024-09-12T03:03:28.186 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.186 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.186 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.186 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_loki": { 2024-09-12T03:03:28.186 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_loki", 2024-09-12T03:03:28.187 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.187 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.187 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.187 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T03:03:28.187 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.187 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.187 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.187 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Loki container image", 2024-09-12T03:03:28.187 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.187 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.187 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.187 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_node_exporter": { 2024-09-12T03:03:28.187 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_node_exporter", 2024-09-12T03:03:28.188 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.188 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.188 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.188 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T03:03:28.188 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.188 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.188 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.188 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-12T03:03:28.188 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.188 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.188 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.188 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nvmeof": { 2024-09-12T03:03:28.189 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nvmeof", 2024-09-12T03:03:28.189 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.189 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.189 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.189 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T03:03:28.189 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.189 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.189 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.189 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nvme-of container image", 2024-09-12T03:03:28.189 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.189 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.189 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.189 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_prometheus": { 2024-09-12T03:03:28.190 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_prometheus", 2024-09-12T03:03:28.190 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.190 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.190 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.190 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T03:03:28.190 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.190 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.190 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.190 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-12T03:03:28.190 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.190 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.190 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.190 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_promtail": { 2024-09-12T03:03:28.191 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_promtail", 2024-09-12T03:03:28.191 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.191 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.191 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.191 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T03:03:28.191 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.191 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.191 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.191 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Promtail container image", 2024-09-12T03:03:28.191 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.191 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.191 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.191 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_samba": { 2024-09-12T03:03:28.192 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_samba", 2024-09-12T03:03:28.192 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.192 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.192 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.192 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T03:03:28.192 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.192 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.192 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.192 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Samba/SMB container image", 2024-09-12T03:03:28.192 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.192 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.192 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.193 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_snmp_gateway": { 2024-09-12T03:03:28.193 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_snmp_gateway", 2024-09-12T03:03:28.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.193 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.193 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.193 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T03:03:28.193 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.193 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.193 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.193 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SNMP Gateway container image", 2024-09-12T03:03:28.193 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.193 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.194 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.194 INFO:teuthology.orchestra.run.smithi018.stdout: "container_init": { 2024-09-12T03:03:28.194 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_init", 2024-09-12T03:03:28.194 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.194 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.194 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.194 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.194 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.194 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.194 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.194 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T03:03:28.194 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.195 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.195 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.195 INFO:teuthology.orchestra.run.smithi018.stdout: "daemon_cache_timeout": { 2024-09-12T03:03:28.195 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "daemon_cache_timeout", 2024-09-12T03:03:28.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.195 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.195 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.195 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-12T03:03:28.195 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.195 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.195 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.196 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T03:03:28.196 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.196 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.196 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.196 INFO:teuthology.orchestra.run.smithi018.stdout: "default_cephadm_command_timeout": { 2024-09-12T03:03:28.196 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T03:03:28.196 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.196 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.196 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.196 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "900", 2024-09-12T03:03:28.196 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.196 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.197 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.197 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T03:03:28.197 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.197 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.197 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.197 INFO:teuthology.orchestra.run.smithi018.stdout: "default_registry": { 2024-09-12T03:03:28.197 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_registry", 2024-09-12T03:03:28.197 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.197 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.197 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.197 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io", 2024-09-12T03:03:28.197 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.197 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.198 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.198 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T03:03:28.198 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.198 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.198 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.198 INFO:teuthology.orchestra.run.smithi018.stdout: "device_cache_timeout": { 2024-09-12T03:03:28.198 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_cache_timeout", 2024-09-12T03:03:28.198 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.198 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.198 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.198 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1800", 2024-09-12T03:03:28.198 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.199 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.199 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.199 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache device inventory", 2024-09-12T03:03:28.199 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.199 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.199 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.199 INFO:teuthology.orchestra.run.smithi018.stdout: "device_enhanced_scan": { 2024-09-12T03:03:28.199 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_enhanced_scan", 2024-09-12T03:03:28.199 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.199 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.199 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.200 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.200 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.200 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.200 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T03:03:28.200 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.200 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.200 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.200 INFO:teuthology.orchestra.run.smithi018.stdout: "facts_cache_timeout": { 2024-09-12T03:03:28.200 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "facts_cache_timeout", 2024-09-12T03:03:28.200 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.200 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.200 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.201 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-12T03:03:28.201 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.201 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.201 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.201 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache host facts data", 2024-09-12T03:03:28.201 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.201 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.201 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.201 INFO:teuthology.orchestra.run.smithi018.stdout: "grafana_dashboards_path": { 2024-09-12T03:03:28.201 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "grafana_dashboards_path", 2024-09-12T03:03:28.201 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.201 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.201 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.202 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T03:03:28.202 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.202 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.202 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.202 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T03:03:28.202 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.202 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.202 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.202 INFO:teuthology.orchestra.run.smithi018.stdout: "host_check_interval": { 2024-09-12T03:03:28.202 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "host_check_interval", 2024-09-12T03:03:28.202 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.202 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.202 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.203 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-12T03:03:28.203 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.203 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.203 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.203 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to perform a host check", 2024-09-12T03:03:28.203 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.203 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.203 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.203 INFO:teuthology.orchestra.run.smithi018.stdout: "hw_monitoring": { 2024-09-12T03:03:28.203 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hw_monitoring", 2024-09-12T03:03:28.204 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.204 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.204 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.204 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.204 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.204 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.204 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.204 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T03:03:28.204 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.204 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.204 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.205 INFO:teuthology.orchestra.run.smithi018.stdout: "inventory_list_all": { 2024-09-12T03:03:28.205 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "inventory_list_all", 2024-09-12T03:03:28.205 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.205 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.205 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.205 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.205 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.205 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.205 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.205 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T03:03:28.205 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.205 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.205 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.206 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.206 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.206 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.206 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.206 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.206 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.206 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.206 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.206 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.206 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.206 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.206 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.206 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.207 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.207 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.207 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.207 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.207 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.207 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.207 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.207 INFO:teuthology.orchestra.run.smithi018.stdout: "log_refresh_metadata": { 2024-09-12T03:03:28.207 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_refresh_metadata", 2024-09-12T03:03:28.207 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.207 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.207 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.208 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.208 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.208 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.208 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.208 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T03:03:28.208 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.208 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.208 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.208 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.208 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.208 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.208 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.209 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.209 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.209 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.209 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.209 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.209 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T03:03:28.209 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.209 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.209 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.209 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.209 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.209 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.209 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.210 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.210 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.210 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.210 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.210 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.210 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.210 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.210 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.210 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.210 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.210 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.210 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.210 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.211 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.211 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.211 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.211 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.211 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.211 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.211 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.211 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.211 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.211 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.211 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.212 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.212 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.212 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.212 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.212 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.212 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T03:03:28.212 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T03:03:28.212 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.212 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.212 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.212 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.212 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.212 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.213 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.213 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T03:03:28.213 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.213 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.213 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.213 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T03:03:28.213 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T03:03:28.213 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.213 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.213 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.213 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "*", 2024-09-12T03:03:28.213 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.214 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.214 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.214 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T03:03:28.214 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.214 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.214 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.214 INFO:teuthology.orchestra.run.smithi018.stdout: "max_count_per_host": { 2024-09-12T03:03:28.214 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_count_per_host", 2024-09-12T03:03:28.214 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.214 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.214 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.214 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:28.214 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.215 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.215 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.215 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of daemons per service per host", 2024-09-12T03:03:28.215 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.215 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.215 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.215 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd_draining_count": { 2024-09-12T03:03:28.215 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_osd_draining_count", 2024-09-12T03:03:28.215 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.215 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.215 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.215 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:28.216 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.216 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.216 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.216 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T03:03:28.216 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.216 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.216 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.216 INFO:teuthology.orchestra.run.smithi018.stdout: "migration_current": { 2024-09-12T03:03:28.216 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "migration_current", 2024-09-12T03:03:28.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.216 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.216 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.217 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.217 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.217 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.217 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.217 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "internal - do not modify", 2024-09-12T03:03:28.217 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.217 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.217 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.217 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-12T03:03:28.217 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-12T03:03:28.217 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.217 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.218 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.218 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "root", 2024-09-12T03:03:28.218 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.218 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.218 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.218 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm-package", 2024-09-12T03:03:28.218 INFO:teuthology.orchestra.run.smithi018.stdout: "root" 2024-09-12T03:03:28.218 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.218 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T03:03:28.218 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.218 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.218 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.219 INFO:teuthology.orchestra.run.smithi018.stdout: "oob_default_addr": { 2024-09-12T03:03:28.219 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "oob_default_addr", 2024-09-12T03:03:28.219 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.219 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.219 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.219 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "169.254.1.1", 2024-09-12T03:03:28.219 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.219 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.219 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.219 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T03:03:28.219 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.219 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.219 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.220 INFO:teuthology.orchestra.run.smithi018.stdout: "prometheus_alerts_path": { 2024-09-12T03:03:28.220 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus_alerts_path", 2024-09-12T03:03:28.220 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.220 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.220 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.220 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T03:03:28.220 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.220 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.220 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.220 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T03:03:28.220 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.220 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.220 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.221 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_insecure": { 2024-09-12T03:03:28.221 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_insecure", 2024-09-12T03:03:28.221 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.221 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.221 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.221 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.221 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.221 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.221 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.221 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T03:03:28.222 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.222 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.222 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.222 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_password": { 2024-09-12T03:03:28.222 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_password", 2024-09-12T03:03:28.222 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.222 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.222 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.222 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.222 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.222 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.222 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.223 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T03:03:28.223 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.223 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.223 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.223 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_url": { 2024-09-12T03:03:28.223 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_url", 2024-09-12T03:03:28.223 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.223 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.223 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.223 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.223 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.223 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.224 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.224 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T03:03:28.224 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.224 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.224 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.224 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_username": { 2024-09-12T03:03:28.224 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_username", 2024-09-12T03:03:28.224 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.224 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.224 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.224 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.225 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.225 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.225 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.225 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T03:03:28.225 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.225 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.225 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.225 INFO:teuthology.orchestra.run.smithi018.stdout: "secure_monitoring_stack": { 2024-09-12T03:03:28.225 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secure_monitoring_stack", 2024-09-12T03:03:28.225 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.225 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.225 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.225 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.226 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.226 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.226 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.226 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T03:03:28.226 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.226 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.226 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.226 INFO:teuthology.orchestra.run.smithi018.stdout: "service_discovery_port": { 2024-09-12T03:03:28.226 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "service_discovery_port", 2024-09-12T03:03:28.226 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.226 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.226 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.227 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8765", 2024-09-12T03:03:28.227 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.227 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.227 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.227 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "cephadm service discovery port", 2024-09-12T03:03:28.227 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.227 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.227 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.227 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_config_file": { 2024-09-12T03:03:28.227 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_config_file", 2024-09-12T03:03:28.227 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.227 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.228 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.228 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.228 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.228 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.228 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.228 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T03:03:28.228 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.228 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.228 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.228 INFO:teuthology.orchestra.run.smithi018.stdout: "use_agent": { 2024-09-12T03:03:28.228 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_agent", 2024-09-12T03:03:28.228 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.228 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.229 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.229 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.229 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.229 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.229 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.229 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T03:03:28.229 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.229 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.229 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.229 INFO:teuthology.orchestra.run.smithi018.stdout: "use_repo_digest": { 2024-09-12T03:03:28.229 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_repo_digest", 2024-09-12T03:03:28.229 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.229 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.230 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.230 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.230 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.230 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.230 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.230 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T03:03:28.230 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.230 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.230 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.230 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_failed_host_check": { 2024-09-12T03:03:28.230 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_failed_host_check", 2024-09-12T03:03:28.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.230 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.231 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.231 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.231 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.231 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.231 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.231 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T03:03:28.231 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.231 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.231 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.231 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_daemons": { 2024-09-12T03:03:28.231 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_daemons", 2024-09-12T03:03:28.231 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.232 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.232 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.232 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.232 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.232 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.232 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.232 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T03:03:28.232 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.232 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.232 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.232 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_hosts": { 2024-09-12T03:03:28.232 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_hosts", 2024-09-12T03:03:28.233 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.233 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.233 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.233 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.233 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.233 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.233 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.233 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T03:03:28.233 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.233 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.233 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.233 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.233 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.234 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crash", 2024-09-12T03:03:28.234 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.234 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.234 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.234 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.234 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.234 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.234 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.234 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.234 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.234 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.234 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.235 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.235 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.235 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.235 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.235 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.235 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.235 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.235 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.235 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.235 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.235 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.235 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.236 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.236 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.236 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.236 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.236 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.236 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.236 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.236 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.236 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.236 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.236 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.237 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.237 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.237 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.237 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.237 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.237 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.237 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.237 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.237 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.237 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.237 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.237 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.238 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.238 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.238 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.238 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.238 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.238 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.238 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.238 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.238 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.238 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.238 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.238 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "retain_interval": { 2024-09-12T03:03:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retain_interval", 2024-09-12T03:03:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "31536000", 2024-09-12T03:03:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T03:03:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_recent_interval": { 2024-09-12T03:03:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_recent_interval", 2024-09-12T03:03:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1209600", 2024-09-12T03:03:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T03:03:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dashboard", 2024-09-12T03:03:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T03:03:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T03:03:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T03:03:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T03:03:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T03:03:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T03:03:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_ENABLED": { 2024-09-12T03:03:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T03:03:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T03:03:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T03:03:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T03:03:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T03:03:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T03:03:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T03:03:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T03:03:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T03:03:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T03:03:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T03:03:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T03:03:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T03:03:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T03:03:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T03:03:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T03:03:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T03:03:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T03:03:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T03:03:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T03:03:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T03:03:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.257 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.257 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T03:03:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T03:03:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-12T03:03:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T03:03:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T03:03:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_URL": { 2024-09-12T03:03:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_URL", 2024-09-12T03:03:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T03:03:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T03:03:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-12T03:03:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T03:03:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T03:03:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T03:03:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T03:03:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T03:03:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T03:03:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T03:03:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T03:03:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T03:03:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T03:03:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T03:03:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T03:03:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T03:03:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T03:03:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T03:03:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T03:03:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T03:03:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T03:03:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T03:03:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T03:03:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T03:03:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T03:03:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T03:03:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T03:03:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T03:03:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T03:03:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T03:03:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T03:03:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T03:03:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T03:03:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T03:03:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T03:03:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T03:03:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T03:03:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T03:03:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8", 2024-09-12T03:03:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T03:03:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T03:03:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "45", 2024-09-12T03:03:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T03:03:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T03:03:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T03:03:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T03:03:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-12T03:03:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T03:03:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T03:03:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T03:03:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T03:03:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T03:03:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T03:03:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-12T03:03:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T03:03:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T03:03:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T03:03:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T03:03:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-12T03:03:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "cross_origin_url": { 2024-09-12T03:03:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cross_origin_url", 2024-09-12T03:03:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "crt_file": { 2024-09-12T03:03:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crt_file", 2024-09-12T03:03:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "debug": { 2024-09-12T03:03:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "debug", 2024-09-12T03:03:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable/disable debug options", 2024-09-12T03:03:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "jwt_token_ttl": { 2024-09-12T03:03:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "jwt_token_ttl", 2024-09-12T03:03:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "28800", 2024-09-12T03:03:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-12T03:03:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-12T03:03:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "motd": { 2024-09-12T03:03:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "motd", 2024-09-12T03:03:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "The message of the day", 2024-09-12T03:03:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_resolve_ip_addr": { 2024-09-12T03:03:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T03:03:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-12T03:03:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-12T03:03:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-12T03:03:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-12T03:03:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-12T03:03:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8080", 2024-09-12T03:03:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-12T03:03:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-12T03:03:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl_server_port": { 2024-09-12T03:03:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl_server_port", 2024-09-12T03:03:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8443", 2024-09-12T03:03:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-12T03:03:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-12T03:03:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "redirect", 2024-09-12T03:03:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect" 2024-09-12T03:03:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-12T03:03:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-12T03:03:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-12T03:03:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-12T03:03:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-12T03:03:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "url_prefix": { 2024-09-12T03:03:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url_prefix", 2024-09-12T03:03:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-12T03:03:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_monitoring": { 2024-09-12T03:03:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_monitoring", 2024-09-12T03:03:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "monitor device health metrics", 2024-09-12T03:03:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.318 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.318 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.318 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.318 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.318 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.318 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.318 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.318 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.318 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.318 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.318 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.318 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.319 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.319 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.319 INFO:teuthology.orchestra.run.smithi018.stdout: "mark_out_threshold": { 2024-09-12T03:03:28.319 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mark_out_threshold", 2024-09-12T03:03:28.319 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.319 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.319 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.319 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2419200", 2024-09-12T03:03:28.319 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.319 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.319 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.319 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T03:03:28.319 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.320 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.320 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.320 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": { 2024-09-12T03:03:28.320 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_name", 2024-09-12T03:03:28.320 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.320 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.320 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.320 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "device_health_metrics", 2024-09-12T03:03:28.320 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.320 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.320 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.320 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T03:03:28.321 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.321 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.321 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.321 INFO:teuthology.orchestra.run.smithi018.stdout: "retention_period": { 2024-09-12T03:03:28.321 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retention_period", 2024-09-12T03:03:28.321 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.321 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.321 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.321 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15552000", 2024-09-12T03:03:28.321 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.321 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.322 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.322 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain device health metrics", 2024-09-12T03:03:28.322 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.322 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.322 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.322 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_frequency": { 2024-09-12T03:03:28.322 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_frequency", 2024-09-12T03:03:28.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.322 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.322 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.322 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-12T03:03:28.322 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.323 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.323 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.323 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T03:03:28.323 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.323 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.323 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.323 INFO:teuthology.orchestra.run.smithi018.stdout: "self_heal": { 2024-09-12T03:03:28.323 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "self_heal", 2024-09-12T03:03:28.323 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.323 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.323 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.323 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.324 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.324 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.324 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.324 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T03:03:28.324 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.324 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.324 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.324 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-12T03:03:28.324 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-12T03:03:28.324 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.324 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.324 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.325 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-12T03:03:28.325 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.325 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.325 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.325 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T03:03:28.325 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.325 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.325 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.325 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_threshold": { 2024-09-12T03:03:28.325 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_threshold", 2024-09-12T03:03:28.325 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.326 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.326 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.326 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7257600", 2024-09-12T03:03:28.326 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.326 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.326 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.326 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T03:03:28.326 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.326 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.326 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.326 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.326 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.327 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "diskprediction_local", 2024-09-12T03:03:28.327 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.327 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.327 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.327 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.327 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.327 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.327 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.327 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.327 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.327 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.327 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.328 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.328 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.328 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.328 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.328 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.328 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.328 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.328 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.328 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.328 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.328 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.328 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.329 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.329 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.329 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.329 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.329 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.329 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.329 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.329 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.329 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.329 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.329 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.329 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.329 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.330 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.330 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.330 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.330 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.330 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.330 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.330 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.330 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.330 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.330 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.330 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.330 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.330 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.331 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.331 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.331 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.331 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.331 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.331 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.331 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.331 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.331 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.331 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.331 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.331 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.332 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.332 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.332 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.332 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.332 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.332 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.332 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.332 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.332 INFO:teuthology.orchestra.run.smithi018.stdout: "predict_interval": { 2024-09-12T03:03:28.332 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predict_interval", 2024-09-12T03:03:28.332 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.332 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.333 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.333 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-12T03:03:28.333 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.333 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.333 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.333 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.333 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.333 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.333 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.333 INFO:teuthology.orchestra.run.smithi018.stdout: "predictor_model": { 2024-09-12T03:03:28.333 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predictor_model", 2024-09-12T03:03:28.333 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.333 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.334 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.334 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "prophetstor", 2024-09-12T03:03:28.334 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.334 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.334 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.334 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.334 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.334 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.334 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.334 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-12T03:03:28.334 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-12T03:03:28.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.334 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.335 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.335 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-12T03:03:28.335 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.335 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.335 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.335 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.335 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.335 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.335 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.335 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.335 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.335 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "influx", 2024-09-12T03:03:28.336 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": false, 2024-09-12T03:03:28.336 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "influxdb python module not found", 2024-09-12T03:03:28.336 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.336 INFO:teuthology.orchestra.run.smithi018.stdout: "batch_size": { 2024-09-12T03:03:28.336 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "batch_size", 2024-09-12T03:03:28.336 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.336 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.336 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.336 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5000", 2024-09-12T03:03:28.336 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.336 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.336 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.337 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T03:03:28.337 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.337 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.337 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.337 INFO:teuthology.orchestra.run.smithi018.stdout: "database": { 2024-09-12T03:03:28.337 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "database", 2024-09-12T03:03:28.337 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.337 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.337 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.337 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "ceph", 2024-09-12T03:03:28.337 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.338 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.338 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.338 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T03:03:28.338 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.338 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.338 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.338 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": { 2024-09-12T03:03:28.338 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hostname", 2024-09-12T03:03:28.338 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.338 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.338 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.338 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.338 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.339 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.339 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.339 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server hostname", 2024-09-12T03:03:28.339 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.339 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.339 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.339 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-12T03:03:28.339 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-12T03:03:28.339 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.339 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.339 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.339 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "30", 2024-09-12T03:03:28.339 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "5", 2024-09-12T03:03:28.340 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.340 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.340 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T03:03:28.340 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.340 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.340 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.340 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.340 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.340 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.340 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.340 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.340 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.341 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.341 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.341 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.341 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.341 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.341 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.341 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.341 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.341 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.341 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.341 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.341 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.341 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.342 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.342 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.342 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.342 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.342 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.342 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.342 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.342 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.342 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.342 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.342 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.342 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.342 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.343 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.343 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.343 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.343 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.343 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.343 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.343 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.343 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.343 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.343 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.343 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.343 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.344 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.344 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.344 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.344 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.344 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.344 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.344 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.344 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.344 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.344 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.344 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.344 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.345 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.345 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.345 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.345 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.345 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.345 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.345 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.345 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.345 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.345 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.345 INFO:teuthology.orchestra.run.smithi018.stdout: "password": { 2024-09-12T03:03:28.345 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "password", 2024-09-12T03:03:28.346 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.346 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.346 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.346 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.346 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.346 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.346 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.346 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "password of InfluxDB server user", 2024-09-12T03:03:28.346 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.346 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.346 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.346 INFO:teuthology.orchestra.run.smithi018.stdout: "port": { 2024-09-12T03:03:28.346 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "port", 2024-09-12T03:03:28.347 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.347 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.347 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.347 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8086", 2024-09-12T03:03:28.347 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.347 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.347 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.347 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server port", 2024-09-12T03:03:28.347 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.347 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.347 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.347 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-12T03:03:28.348 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-12T03:03:28.348 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.348 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.348 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.348 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "false", 2024-09-12T03:03:28.348 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.348 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.348 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.348 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T03:03:28.348 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.348 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.348 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.349 INFO:teuthology.orchestra.run.smithi018.stdout: "threads": { 2024-09-12T03:03:28.349 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threads", 2024-09-12T03:03:28.349 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.349 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.349 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.349 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-12T03:03:28.349 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-12T03:03:28.349 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "32", 2024-09-12T03:03:28.349 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.349 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T03:03:28.349 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.349 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.350 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.350 INFO:teuthology.orchestra.run.smithi018.stdout: "username": { 2024-09-12T03:03:28.350 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "username", 2024-09-12T03:03:28.350 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.350 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.350 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.350 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.350 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.350 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.350 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.350 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "username of InfluxDB server user", 2024-09-12T03:03:28.350 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.350 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.351 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.351 INFO:teuthology.orchestra.run.smithi018.stdout: "verify_ssl": { 2024-09-12T03:03:28.351 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "verify_ssl", 2024-09-12T03:03:28.351 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.351 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.351 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.351 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "true", 2024-09-12T03:03:28.351 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.351 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.351 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.351 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T03:03:28.351 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.352 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.352 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.352 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.352 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.352 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "insights", 2024-09-12T03:03:28.352 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.352 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.352 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.352 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.352 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.352 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.353 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.353 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.353 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.353 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.353 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.353 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.353 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.353 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.353 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.353 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.353 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.353 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.353 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.353 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.354 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.354 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.354 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.354 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.354 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.354 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.354 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.354 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.354 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.354 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.354 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.355 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.355 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.355 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.355 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.355 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.355 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.355 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.355 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.355 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.355 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.355 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.355 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.356 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.356 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.356 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.356 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.356 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.356 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.356 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.356 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.356 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.356 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.356 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.356 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.356 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.357 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.357 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.357 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.357 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.357 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.357 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.357 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.357 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.357 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.357 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.357 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.357 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.358 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.358 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.358 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.358 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "iostat", 2024-09-12T03:03:28.358 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.358 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.358 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.358 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.358 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.358 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.360 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.360 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.360 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.360 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.360 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.360 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.360 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.360 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.360 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.360 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.360 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.360 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.361 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.361 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.361 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.361 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.361 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.361 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.361 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.361 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.361 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.361 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.361 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.361 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.362 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.362 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.362 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.362 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.362 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.362 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.362 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.362 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.362 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.362 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.362 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.362 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.362 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.362 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.363 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.363 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.363 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.363 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.363 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.363 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.363 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.363 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.363 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.363 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.363 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.363 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.363 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.363 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.364 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.364 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "k8sevents", 2024-09-12T03:03:28.364 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.364 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.364 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.364 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_event_retention_days": { 2024-09-12T03:03:28.364 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ceph_event_retention_days", 2024-09-12T03:03:28.364 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.364 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.364 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.364 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7", 2024-09-12T03:03:28.365 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.365 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.365 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.365 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T03:03:28.365 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.365 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.365 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.365 INFO:teuthology.orchestra.run.smithi018.stdout: "config_check_secs": { 2024-09-12T03:03:28.365 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_check_secs", 2024-09-12T03:03:28.365 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.365 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.365 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.366 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:28.366 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "10", 2024-09-12T03:03:28.366 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.366 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.366 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T03:03:28.366 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.366 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.366 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.366 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.367 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.367 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.367 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.367 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.367 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.367 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.367 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.367 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.367 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.367 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.367 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.367 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.367 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.368 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.368 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.368 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.368 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.368 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.368 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.368 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.368 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.368 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.368 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.368 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.368 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.368 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.369 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.369 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.369 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.369 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.369 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.369 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.369 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.369 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.369 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.369 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.369 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.369 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.370 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.370 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.370 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.370 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.370 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.370 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.370 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.370 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.370 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.370 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.370 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.370 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.371 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.371 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.371 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.371 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.371 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.371 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.371 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.371 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.371 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.371 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.371 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.371 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.371 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.372 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.372 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.372 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.372 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.372 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "localpool", 2024-09-12T03:03:28.372 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.372 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.372 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.372 INFO:teuthology.orchestra.run.smithi018.stdout: "failure_domain": { 2024-09-12T03:03:28.372 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "failure_domain", 2024-09-12T03:03:28.372 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.373 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.373 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.373 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "host", 2024-09-12T03:03:28.373 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.373 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.373 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.373 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "failure domain for any created local pool", 2024-09-12T03:03:28.373 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T03:03:28.373 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.373 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.373 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.373 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.374 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.374 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.374 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.374 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.374 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.374 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.374 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.374 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.374 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.374 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.374 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.374 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.374 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.375 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.375 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.375 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.375 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.375 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.375 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.375 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.375 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.375 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.375 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.375 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.375 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.376 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.376 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.376 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.376 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.376 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.376 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.376 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.376 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.376 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.376 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.376 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.376 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.377 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.377 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.377 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.377 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.377 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.377 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.377 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.377 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.377 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.377 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.377 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.377 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.377 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.378 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.378 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.378 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.378 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.378 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.378 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.378 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.378 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.378 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.378 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.378 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.378 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.378 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.379 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.379 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": { 2024-09-12T03:03:28.379 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_size", 2024-09-12T03:03:28.379 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.379 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.379 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.379 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.379 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.379 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.379 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.379 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default min_size for any created local pool", 2024-09-12T03:03:28.380 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T03:03:28.380 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.380 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.380 INFO:teuthology.orchestra.run.smithi018.stdout: "num_rep": { 2024-09-12T03:03:28.380 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "num_rep", 2024-09-12T03:03:28.380 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.380 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.380 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.380 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-09-12T03:03:28.380 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.380 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.380 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.381 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default replica count for any created local pool", 2024-09-12T03:03:28.381 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.381 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.381 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.381 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": { 2024-09-12T03:03:28.381 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_num", 2024-09-12T03:03:28.381 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.381 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.381 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.381 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "128", 2024-09-12T03:03:28.381 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.382 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.382 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.382 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T03:03:28.382 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.382 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.382 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.382 INFO:teuthology.orchestra.run.smithi018.stdout: "prefix": { 2024-09-12T03:03:28.382 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prefix", 2024-09-12T03:03:28.382 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.382 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.382 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.383 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.383 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.383 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.383 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.383 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name prefix for any created local pool", 2024-09-12T03:03:28.383 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.383 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.383 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.383 INFO:teuthology.orchestra.run.smithi018.stdout: "subtree": { 2024-09-12T03:03:28.383 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "subtree", 2024-09-12T03:03:28.383 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.384 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.384 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.384 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "rack", 2024-09-12T03:03:28.384 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.384 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.384 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.384 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T03:03:28.384 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T03:03:28.384 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.384 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.384 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.384 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.385 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mds_autoscaler", 2024-09-12T03:03:28.385 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.385 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.385 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.385 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.385 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.385 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.385 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.385 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.385 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.385 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.386 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.386 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.386 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.386 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.386 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.386 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.386 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.386 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.386 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.386 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.386 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.386 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.386 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.387 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.387 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.387 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.387 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.387 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.387 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.387 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.387 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.387 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.387 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.387 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.388 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.388 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.388 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.388 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.388 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.388 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.388 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.388 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.388 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.388 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.389 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.389 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.389 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.389 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.389 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.389 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.389 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.389 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.389 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.389 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.389 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.389 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.390 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.390 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.390 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.390 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.390 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.390 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.390 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.390 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.390 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.391 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.391 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.391 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.391 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.391 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.391 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.391 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirroring", 2024-09-12T03:03:28.391 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.391 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.392 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.392 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.392 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.392 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.392 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.392 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.392 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.392 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.392 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.392 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.392 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.393 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.393 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.393 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.393 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.393 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.393 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.393 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.393 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.393 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.393 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.393 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.393 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.394 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.394 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.394 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.394 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.394 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.394 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.394 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.394 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.394 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.394 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.394 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.394 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.395 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.395 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.395 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.395 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.395 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.395 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.395 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.395 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.395 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.395 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.395 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.395 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.395 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.396 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.396 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.396 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.396 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.396 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.396 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.396 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.396 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.396 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.397 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.397 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.397 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.397 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.397 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.397 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.397 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.397 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.397 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.397 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.397 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "nfs", 2024-09-12T03:03:28.397 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.398 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.398 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.398 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.398 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.398 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.398 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.398 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.398 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.398 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.398 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.398 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.398 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.399 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.399 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.399 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.399 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.399 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.399 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.399 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.399 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.399 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.399 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.399 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.399 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.400 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.400 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.400 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.400 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.400 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.400 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.400 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.400 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.400 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.400 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.400 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.400 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.401 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.401 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.401 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.401 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.401 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.401 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.401 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.401 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.401 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.401 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.401 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.401 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.401 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.402 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.402 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.402 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.402 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.402 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.402 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.402 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.402 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.402 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.402 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.402 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.402 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.403 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.403 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.403 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.403 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.403 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.403 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.403 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.403 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.403 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-12T03:03:28.403 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.403 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.403 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.404 INFO:teuthology.orchestra.run.smithi018.stdout: "fail_fs": { 2024-09-12T03:03:28.404 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "fail_fs", 2024-09-12T03:03:28.404 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.404 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.404 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.404 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.404 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.404 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.404 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.405 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T03:03:28.405 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.405 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.405 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.405 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.405 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.405 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.405 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.405 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.405 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.405 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.405 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.406 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.406 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.406 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.406 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.406 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.406 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.406 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.406 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.406 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.406 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.406 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.407 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.407 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.407 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.407 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.407 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.407 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.407 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.407 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.407 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.407 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.407 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.408 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.408 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.408 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.408 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.408 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.408 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.408 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.408 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.408 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.408 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.409 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.409 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.409 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.409 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.409 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.409 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.409 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.409 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.409 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.409 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.409 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.409 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.410 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.410 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.410 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.410 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.410 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.410 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.410 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.410 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.410 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.410 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.410 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.411 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.411 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.411 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.411 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator": { 2024-09-12T03:03:28.411 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-12T03:03:28.411 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.411 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.411 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.411 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.411 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.411 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.411 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.412 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-12T03:03:28.412 INFO:teuthology.orchestra.run.smithi018.stdout: "rook", 2024-09-12T03:03:28.412 INFO:teuthology.orchestra.run.smithi018.stdout: "test_orchestrator" 2024-09-12T03:03:28.412 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.412 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Orchestrator backend", 2024-09-12T03:03:28.412 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.412 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.412 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.412 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.412 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.413 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_perf_query", 2024-09-12T03:03:28.413 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.413 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.413 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.413 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.413 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.413 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.414 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.414 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.414 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.414 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.414 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.414 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.414 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.414 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.414 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.416 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.416 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.416 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.416 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.416 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.416 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.416 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.417 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.417 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.417 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.417 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.417 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.417 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.417 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.417 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.417 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.417 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.417 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.418 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.418 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.418 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.418 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.418 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.418 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.418 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.418 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.418 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.418 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.418 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.418 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.419 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.419 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.419 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.419 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.419 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.419 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.419 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.419 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.419 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.419 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.419 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.419 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.420 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.420 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.420 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.420 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.420 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.420 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.420 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.420 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.420 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.420 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.420 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.421 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_support", 2024-09-12T03:03:28.421 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.421 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.421 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.421 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.421 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.421 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.421 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.421 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.421 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.422 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.422 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.422 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.422 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.422 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.422 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.422 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.422 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.422 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.422 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.422 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.422 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.423 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.423 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.423 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.423 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.423 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.423 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.423 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.423 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.423 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.423 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.423 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.424 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.424 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.424 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.424 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.424 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.424 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.424 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.424 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.424 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.424 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.424 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.425 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.425 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.425 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.425 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.425 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.425 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.425 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.425 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.425 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.425 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.425 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.425 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.426 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.426 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.426 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.426 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.426 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.426 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.426 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.426 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.426 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.426 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.426 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.426 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.426 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.427 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.427 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.427 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_autoscaler", 2024-09-12T03:03:28.427 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.427 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.427 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.427 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.427 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.427 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.427 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.427 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.428 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.428 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.428 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.428 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.428 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.428 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.428 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.428 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.428 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.428 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.428 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.428 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.428 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.429 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.429 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.429 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.429 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.429 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.429 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.429 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.429 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.429 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.429 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.429 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.429 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.430 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.430 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.430 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.430 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.430 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.430 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.430 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.430 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.430 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.430 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.430 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.431 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.431 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.431 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.431 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.431 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.431 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.431 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.431 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.431 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.431 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.431 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.431 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.431 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.432 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.432 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.432 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.432 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.432 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.432 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.432 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.432 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.432 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.432 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.432 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.432 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-12T03:03:28.433 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-12T03:03:28.433 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.433 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.433 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.433 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-12T03:03:28.433 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.433 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.433 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.433 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.433 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.433 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.433 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.434 INFO:teuthology.orchestra.run.smithi018.stdout: "threshold": { 2024-09-12T03:03:28.434 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threshold", 2024-09-12T03:03:28.434 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:28.434 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.434 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.434 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-12T03:03:28.434 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1.0", 2024-09-12T03:03:28.434 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.434 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.434 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "scaling threshold", 2024-09-12T03:03:28.434 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T03:03:28.434 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.434 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.435 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.435 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.435 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "progress", 2024-09-12T03:03:28.435 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.435 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.435 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.435 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_pg_recovery_event": { 2024-09-12T03:03:28.435 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_pg_recovery_event", 2024-09-12T03:03:28.435 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.435 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.435 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.435 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.436 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.436 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.436 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.436 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T03:03:28.436 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.436 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.436 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.436 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-12T03:03:28.436 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-12T03:03:28.436 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.436 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.436 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.437 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.437 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.437 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.437 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.437 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.437 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.437 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.437 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.437 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.437 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.437 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.438 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.438 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.438 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.438 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.438 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.438 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.438 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.438 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.438 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.438 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.438 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.438 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.438 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.439 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.439 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.439 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.439 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.439 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.439 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.439 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.439 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.439 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.439 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.439 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.439 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.440 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.440 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.440 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.440 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.440 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.440 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.440 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.440 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.440 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.440 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.440 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.440 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.441 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.441 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.441 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.441 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.441 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.441 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.441 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.441 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.441 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.441 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.441 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.441 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.441 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.442 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.442 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.442 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.442 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.442 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.442 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.442 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.442 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.442 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.442 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.442 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.442 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.442 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.443 INFO:teuthology.orchestra.run.smithi018.stdout: "max_completed_events": { 2024-09-12T03:03:28.443 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_completed_events", 2024-09-12T03:03:28.443 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.443 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.443 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.443 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "50", 2024-09-12T03:03:28.443 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.443 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.443 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.443 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "number of past completed events to remember", 2024-09-12T03:03:28.443 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.443 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.443 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.444 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-12T03:03:28.444 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-12T03:03:28.444 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.444 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.444 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.444 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-12T03:03:28.444 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.444 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.444 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.444 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long the module is going to sleep", 2024-09-12T03:03:28.444 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.444 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.445 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.445 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.445 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.445 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus", 2024-09-12T03:03:28.445 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.445 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.445 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.445 INFO:teuthology.orchestra.run.smithi018.stdout: "cache": { 2024-09-12T03:03:28.445 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cache", 2024-09-12T03:03:28.445 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.445 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.446 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.446 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.446 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.446 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.446 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.446 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.446 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.446 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.446 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.446 INFO:teuthology.orchestra.run.smithi018.stdout: "exclude_perf_counters": { 2024-09-12T03:03:28.446 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "exclude_perf_counters", 2024-09-12T03:03:28.446 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.446 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.447 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.447 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.447 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.447 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.447 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.447 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T03:03:28.447 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T03:03:28.447 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.447 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.447 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.447 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.447 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.448 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.448 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.448 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.448 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.448 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.448 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.448 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.448 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.448 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.448 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.448 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.448 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.448 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.449 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.449 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.449 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.449 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.449 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.449 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.449 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.449 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.449 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.449 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.449 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.450 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.450 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.450 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.450 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.450 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.450 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.450 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.450 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.450 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.450 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.450 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.450 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.451 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.451 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.451 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.451 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.451 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.451 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.451 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.451 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.451 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.451 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.451 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.451 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.451 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.452 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.452 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.452 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.452 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.452 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.452 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.452 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.452 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.452 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.452 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.453 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.453 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.453 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.453 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.453 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools": { 2024-09-12T03:03:28.453 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools", 2024-09-12T03:03:28.453 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.453 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.453 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.453 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.453 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.454 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.454 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.454 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.454 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.454 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.454 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.454 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T03:03:28.454 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T03:03:28.454 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.454 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.454 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.455 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "300", 2024-09-12T03:03:28.455 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.455 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.455 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.455 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.455 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.455 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.455 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.455 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_interval": { 2024-09-12T03:03:28.455 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_interval", 2024-09-12T03:03:28.455 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:28.456 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.456 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.456 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15.0", 2024-09-12T03:03:28.456 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.456 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.456 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.456 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.456 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.456 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.456 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.456 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-12T03:03:28.456 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-12T03:03:28.457 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.457 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.457 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.457 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-12T03:03:28.457 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.457 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.457 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.457 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T03:03:28.457 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.457 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.457 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.457 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-12T03:03:28.458 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-12T03:03:28.458 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.458 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.458 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.458 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "9283", 2024-09-12T03:03:28.458 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.458 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.458 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.458 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T03:03:28.458 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.458 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.458 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.458 INFO:teuthology.orchestra.run.smithi018.stdout: "stale_cache_strategy": { 2024-09-12T03:03:28.459 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stale_cache_strategy", 2024-09-12T03:03:28.459 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.459 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.459 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.459 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "log", 2024-09-12T03:03:28.459 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.459 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.459 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.459 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.459 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.459 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.459 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.460 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-12T03:03:28.460 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-12T03:03:28.460 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.460 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.460 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.460 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "default", 2024-09-12T03:03:28.460 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.460 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.460 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.460 INFO:teuthology.orchestra.run.smithi018.stdout: "default", 2024-09-12T03:03:28.460 INFO:teuthology.orchestra.run.smithi018.stdout: "error" 2024-09-12T03:03:28.461 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.461 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.461 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.461 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.461 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.461 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-12T03:03:28.461 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-12T03:03:28.461 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.461 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.461 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.461 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-12T03:03:28.461 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-12T03:03:28.461 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-12T03:03:28.462 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.462 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.462 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.462 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.462 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.462 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.462 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.462 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-12T03:03:28.462 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.462 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.462 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.462 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.463 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.463 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.463 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.463 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.463 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.463 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.463 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.463 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.463 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.463 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.463 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.463 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.463 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.464 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.464 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.464 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.464 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.464 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.464 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.464 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.464 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.464 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.464 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.464 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.464 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.465 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.465 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.465 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.465 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.465 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.465 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.465 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.465 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.465 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.465 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.465 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.465 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.466 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.466 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.466 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.466 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.466 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.466 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.466 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.466 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.466 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.466 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.466 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.466 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.466 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.467 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.467 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.467 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.467 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.467 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.467 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.467 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.467 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.467 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.467 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.467 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.467 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.468 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.468 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.468 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.468 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_snap_create": { 2024-09-12T03:03:28.468 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_snap_create", 2024-09-12T03:03:28.468 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.468 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.468 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.468 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:28.468 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.468 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.468 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.468 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.469 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.469 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.469 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.469 INFO:teuthology.orchestra.run.smithi018.stdout: "mirror_snapshot_schedule": { 2024-09-12T03:03:28.469 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T03:03:28.469 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.469 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.469 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.469 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.469 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.469 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.469 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.470 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.470 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.470 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.470 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.470 INFO:teuthology.orchestra.run.smithi018.stdout: "trash_purge_schedule": { 2024-09-12T03:03:28.470 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "trash_purge_schedule", 2024-09-12T03:03:28.470 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.470 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.470 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.470 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.470 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.470 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.470 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.471 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.471 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.471 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.471 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.471 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.471 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.471 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "restful", 2024-09-12T03:03:28.471 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.471 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.471 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.471 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_auth": { 2024-09-12T03:03:28.471 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_auth", 2024-09-12T03:03:28.471 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.472 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.472 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.472 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.472 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.472 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.472 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.472 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.472 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.472 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.472 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.472 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-12T03:03:28.472 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-12T03:03:28.473 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.473 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.473 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.473 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.473 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.473 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.473 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.473 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.473 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.473 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.474 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.474 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.474 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.474 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.474 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.474 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.474 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.474 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.474 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.474 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.474 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.474 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.475 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.475 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.475 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.475 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.475 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.475 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.475 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.475 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.475 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.475 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.475 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.475 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.476 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.476 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.476 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.476 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.476 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.476 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.476 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.476 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.476 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.476 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.476 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.477 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.477 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.477 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.477 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.477 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.477 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.477 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.477 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.477 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.477 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.477 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.477 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.477 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.477 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.478 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.478 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.478 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.478 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.478 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.478 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.478 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.478 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.478 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.478 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.478 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.478 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.479 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.479 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.479 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.479 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.479 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.479 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.479 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-12T03:03:28.479 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-12T03:03:28.479 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.479 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.479 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.479 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.480 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.480 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.480 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.480 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.480 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.480 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.480 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.480 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-12T03:03:28.480 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-12T03:03:28.480 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.480 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.480 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.481 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.481 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.481 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.481 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.481 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.481 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.481 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.481 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.481 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.481 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.481 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rgw", 2024-09-12T03:03:28.482 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.482 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.482 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.482 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.482 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.482 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.482 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.482 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.482 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.482 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.482 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.482 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.482 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.483 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.483 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.483 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.483 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.483 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.483 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.483 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.483 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.483 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.483 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.483 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.483 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.484 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.484 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.484 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.484 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.484 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.484 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.484 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.484 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.484 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.484 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.484 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.484 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.484 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.485 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.485 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.485 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.485 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.485 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.485 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.485 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.485 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.485 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.485 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.485 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.485 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.485 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.486 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.486 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.486 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.486 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.486 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.486 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.486 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.486 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.486 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.486 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.486 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.486 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.486 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.487 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.487 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.487 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.487 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.487 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.487 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.487 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.487 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rook", 2024-09-12T03:03:28.487 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.487 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.487 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.488 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.488 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.488 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.488 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.488 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.488 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.488 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.488 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.488 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.488 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.488 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.488 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.488 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.489 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.489 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.489 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.489 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.489 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.489 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.489 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.489 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.489 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.489 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.489 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.490 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.490 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.490 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.490 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.490 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.490 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.490 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.490 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.490 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.490 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.490 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.490 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.490 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.491 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.491 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.491 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.491 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.491 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.491 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.491 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.491 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.491 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.491 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.491 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.491 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.491 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.491 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.492 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.492 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.492 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.492 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.492 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.492 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.492 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.492 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.492 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.492 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.492 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.492 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.493 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.493 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.493 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.493 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_class": { 2024-09-12T03:03:28.493 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "storage_class", 2024-09-12T03:03:28.493 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.493 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.493 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.493 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "local", 2024-09-12T03:03:28.493 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.493 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.493 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.493 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T03:03:28.494 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.494 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.494 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.494 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.494 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.494 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "selftest", 2024-09-12T03:03:28.494 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.494 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.494 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.494 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.494 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.495 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.495 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.495 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.495 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.495 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.495 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.495 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.495 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.495 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.495 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.495 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.495 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.495 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.495 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.496 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.496 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.496 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.496 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.496 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.496 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.496 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.496 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.496 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.496 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.496 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.496 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.497 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.497 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.497 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.497 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.497 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.497 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.497 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.497 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.497 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.497 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.497 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.497 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.498 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.498 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.498 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.498 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.498 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.498 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.498 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.498 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.498 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.498 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.498 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.498 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.498 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.499 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.499 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.499 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.499 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.499 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.499 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.499 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.499 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.499 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.499 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.499 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.499 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.500 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.500 INFO:teuthology.orchestra.run.smithi018.stdout: "roption1": { 2024-09-12T03:03:28.500 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption1", 2024-09-12T03:03:28.500 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.500 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.500 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.500 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.500 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.500 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.500 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.500 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.500 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.501 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.501 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.501 INFO:teuthology.orchestra.run.smithi018.stdout: "roption2": { 2024-09-12T03:03:28.501 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption2", 2024-09-12T03:03:28.501 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.501 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.501 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.501 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "xyz", 2024-09-12T03:03:28.501 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.501 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.501 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.501 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.502 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.502 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.502 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.502 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption1": { 2024-09-12T03:03:28.502 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption1", 2024-09-12T03:03:28.502 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.502 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.502 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.502 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.502 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.502 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.502 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.502 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.503 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.503 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.503 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.503 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption2": { 2024-09-12T03:03:28.503 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption2", 2024-09-12T03:03:28.503 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.503 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.503 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.503 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.503 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.503 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.504 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.504 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.504 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.504 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.504 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.504 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption3": { 2024-09-12T03:03:28.504 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption3", 2024-09-12T03:03:28.504 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:28.504 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.504 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.504 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.505 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.505 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.505 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.505 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.505 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.505 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.505 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.505 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption4": { 2024-09-12T03:03:28.505 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption4", 2024-09-12T03:03:28.505 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.506 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.506 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.506 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.506 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.506 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.506 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.506 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.506 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.506 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.506 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.506 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption5": { 2024-09-12T03:03:28.506 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption5", 2024-09-12T03:03:28.506 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.507 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.507 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.507 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.507 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.507 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.507 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.507 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.507 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.507 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.507 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.507 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption6": { 2024-09-12T03:03:28.507 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption6", 2024-09-12T03:03:28.508 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.508 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.508 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.508 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.508 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.508 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.508 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.508 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.508 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.508 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.508 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.508 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption7": { 2024-09-12T03:03:28.509 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption7", 2024-09-12T03:03:28.509 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.509 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.509 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.509 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.509 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-12T03:03:28.509 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "42", 2024-09-12T03:03:28.509 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.509 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.509 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.509 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.509 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.510 INFO:teuthology.orchestra.run.smithi018.stdout: "testkey": { 2024-09-12T03:03:28.510 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testkey", 2024-09-12T03:03:28.510 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.510 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.510 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.510 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.510 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.510 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.510 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.510 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.510 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.510 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.510 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.511 INFO:teuthology.orchestra.run.smithi018.stdout: "testlkey": { 2024-09-12T03:03:28.511 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testlkey", 2024-09-12T03:03:28.511 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.511 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.511 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.511 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.511 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.511 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.511 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.511 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.511 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.511 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.511 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.512 INFO:teuthology.orchestra.run.smithi018.stdout: "testnewline": { 2024-09-12T03:03:28.512 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testnewline", 2024-09-12T03:03:28.512 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.512 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.512 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.512 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.512 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.512 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.512 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.512 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.512 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.512 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.512 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.513 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.513 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.513 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-09-12T03:03:28.513 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.513 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.513 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.513 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_m_granularity": { 2024-09-12T03:03:28.513 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_m_granularity", 2024-09-12T03:03:28.513 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.513 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.513 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.514 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.514 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.514 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.514 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.514 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T03:03:28.514 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.514 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.514 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.514 INFO:teuthology.orchestra.run.smithi018.stdout: "dump_on_update": { 2024-09-12T03:03:28.514 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dump_on_update", 2024-09-12T03:03:28.514 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.514 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.514 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.515 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.515 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.515 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.515 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.515 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "dump database to debug log on update", 2024-09-12T03:03:28.515 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.515 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.515 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.515 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.515 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.515 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.516 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.516 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.516 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.516 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.516 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.516 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.516 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.516 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.516 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.516 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.516 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.516 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.516 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.517 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.517 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.517 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.517 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.517 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.517 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.517 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.517 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.517 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.517 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.517 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.517 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.518 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.518 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.518 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.518 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.518 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.518 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.518 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.518 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.518 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.519 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.519 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.519 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.519 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.519 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.519 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.519 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.519 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.519 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.519 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.519 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.519 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.519 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.520 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.520 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.520 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.520 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.520 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.520 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.520 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.520 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.520 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.520 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.520 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.521 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.521 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.521 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.521 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.521 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.521 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.521 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.521 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stats", 2024-09-12T03:03:28.521 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.521 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.521 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.522 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.522 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.522 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.522 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.522 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.522 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.522 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.522 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.522 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.522 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.522 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.522 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.522 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.523 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.523 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.523 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.523 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.523 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.523 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.523 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.523 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.523 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.523 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.523 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.523 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.523 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.524 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.524 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.524 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.524 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.524 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.524 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.524 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.524 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.524 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.524 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.524 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.525 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.525 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.525 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.525 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.525 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.525 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.525 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.525 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.525 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.525 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.525 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.525 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.525 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.526 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.526 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.526 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.526 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.526 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.526 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.526 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.526 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.526 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.526 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.526 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.526 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.527 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.527 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.527 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.527 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.527 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.527 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.527 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "status", 2024-09-12T03:03:28.527 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.527 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.527 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.527 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.527 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.528 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.528 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.528 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.528 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.528 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.528 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.528 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.528 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.528 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.528 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.528 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.528 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.528 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.529 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.529 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.529 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.529 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.529 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.529 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.529 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.529 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.529 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.529 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.529 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.529 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.530 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.530 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.530 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.530 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.530 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.530 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.530 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.530 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.530 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.530 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.530 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.530 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.531 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.531 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.531 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.531 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.531 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.531 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.531 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.531 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.531 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.531 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.531 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.531 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.531 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.531 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.532 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.532 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.532 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.532 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.532 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.532 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.532 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.532 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.532 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.532 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.532 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.533 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.533 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.533 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.533 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.533 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telegraf", 2024-09-12T03:03:28.533 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.533 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.533 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.533 INFO:teuthology.orchestra.run.smithi018.stdout: "address": { 2024-09-12T03:03:28.533 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "address", 2024-09-12T03:03:28.533 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.533 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.534 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.534 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T03:03:28.534 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.534 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.534 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.534 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.534 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.534 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.534 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.534 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-12T03:03:28.534 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-12T03:03:28.534 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.535 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.535 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.535 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15", 2024-09-12T03:03:28.535 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.535 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.535 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.535 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.535 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.535 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.535 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.535 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.535 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.536 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.536 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.536 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.536 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.536 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.536 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.536 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.536 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.536 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.536 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.536 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.536 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.536 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.536 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.537 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.537 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.537 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.537 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.537 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.537 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.537 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.537 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.537 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.537 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.537 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.537 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.538 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.538 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.538 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.538 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.538 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.538 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.538 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.538 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.538 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.538 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.538 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.538 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.538 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.539 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.539 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.539 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.539 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.539 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.539 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.539 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.539 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.539 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.539 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.539 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.539 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.539 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.540 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.540 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.540 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.540 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.540 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.540 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.540 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.540 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.540 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.540 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.540 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.540 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.540 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.541 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telemetry", 2024-09-12T03:03:28.541 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.541 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.541 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.541 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_basic": { 2024-09-12T03:03:28.541 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_basic", 2024-09-12T03:03:28.541 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.541 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.541 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.541 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.542 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.542 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.542 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.542 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T03:03:28.542 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.542 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.542 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.542 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_crash": { 2024-09-12T03:03:28.542 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_crash", 2024-09-12T03:03:28.542 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.542 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.542 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.542 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.543 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.543 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.543 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.543 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T03:03:28.543 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.543 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.543 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.543 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_device": { 2024-09-12T03:03:28.543 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_device", 2024-09-12T03:03:28.543 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.543 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.543 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.544 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.544 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.544 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.544 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.544 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T03:03:28.544 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.544 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.544 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.544 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_ident": { 2024-09-12T03:03:28.544 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_ident", 2024-09-12T03:03:28.544 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.544 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.544 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.545 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.545 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.545 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.545 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.545 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T03:03:28.545 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.545 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.545 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.545 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_perf": { 2024-09-12T03:03:28.545 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_perf", 2024-09-12T03:03:28.545 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.545 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.545 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.546 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.546 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.546 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.546 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.546 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T03:03:28.546 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.546 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.546 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.546 INFO:teuthology.orchestra.run.smithi018.stdout: "contact": { 2024-09-12T03:03:28.546 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "contact", 2024-09-12T03:03:28.546 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.546 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.546 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.547 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.547 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.547 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.547 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.547 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.547 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.547 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.547 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.547 INFO:teuthology.orchestra.run.smithi018.stdout: "description": { 2024-09-12T03:03:28.547 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "description", 2024-09-12T03:03:28.547 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.547 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.548 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.548 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.548 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.548 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.548 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.548 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.548 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.548 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.548 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.548 INFO:teuthology.orchestra.run.smithi018.stdout: "device_url": { 2024-09-12T03:03:28.548 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_url", 2024-09-12T03:03:28.548 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.549 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.549 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.549 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T03:03:28.549 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.549 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.549 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.549 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.549 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.549 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.549 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.549 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-12T03:03:28.549 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-12T03:03:28.549 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.550 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.550 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.550 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.550 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.550 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.550 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.550 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.550 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.550 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.550 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.550 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-12T03:03:28.550 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-12T03:03:28.551 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.551 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.551 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.551 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "24", 2024-09-12T03:03:28.551 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "8", 2024-09-12T03:03:28.551 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.551 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.551 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.551 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.551 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.551 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.551 INFO:teuthology.orchestra.run.smithi018.stdout: "last_opt_revision": { 2024-09-12T03:03:28.552 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "last_opt_revision", 2024-09-12T03:03:28.552 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.552 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.552 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.552 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1", 2024-09-12T03:03:28.552 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.552 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.552 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.552 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.552 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.552 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.552 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.552 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard": { 2024-09-12T03:03:28.553 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard", 2024-09-12T03:03:28.553 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.553 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.553 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.553 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.553 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.553 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.553 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.553 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.553 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.553 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.553 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.554 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard_description": { 2024-09-12T03:03:28.554 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard_description", 2024-09-12T03:03:28.554 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.554 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.554 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.554 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.554 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.554 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.554 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.554 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.554 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.554 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.554 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.555 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.555 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.555 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.555 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.555 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.555 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.555 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.555 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.555 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.555 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.555 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.555 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.555 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.556 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.556 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.556 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.556 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.556 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.556 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.556 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.556 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.556 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.556 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.556 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.557 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.557 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.557 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.557 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.557 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.557 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.557 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.557 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.557 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.557 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.557 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.557 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.557 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.558 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.558 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.558 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.558 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.558 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.558 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.558 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.558 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.558 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.558 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.558 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.558 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.558 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.559 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.559 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.559 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.559 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.559 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.559 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.559 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.559 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.559 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.559 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.559 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.559 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.559 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.559 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.560 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.560 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.560 INFO:teuthology.orchestra.run.smithi018.stdout: "organization": { 2024-09-12T03:03:28.560 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "organization", 2024-09-12T03:03:28.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.560 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.560 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.560 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.560 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.560 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.560 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.560 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.561 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.561 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.561 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.561 INFO:teuthology.orchestra.run.smithi018.stdout: "proxy": { 2024-09-12T03:03:28.561 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "proxy", 2024-09-12T03:03:28.561 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.561 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.561 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.561 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.561 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.561 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.561 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.562 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.562 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.562 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.562 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.562 INFO:teuthology.orchestra.run.smithi018.stdout: "url": { 2024-09-12T03:03:28.562 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url", 2024-09-12T03:03:28.562 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.562 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.562 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.562 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T03:03:28.562 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.562 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.563 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.563 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.563 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.563 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.563 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.563 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.563 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.563 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test_orchestrator", 2024-09-12T03:03:28.563 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.563 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.563 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.563 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.564 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.564 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.564 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.564 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.564 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.564 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.564 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.564 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.564 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.564 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.564 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.564 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.564 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.565 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.565 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.565 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.565 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.565 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.565 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.565 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.565 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.565 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.565 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.565 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.565 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.565 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.566 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.566 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.566 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.566 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.566 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.566 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.566 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.566 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.566 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.566 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.566 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.566 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.566 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.567 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.567 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.567 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.567 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.567 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.567 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.567 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.567 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.567 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.567 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.567 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.567 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.567 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.568 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.568 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.568 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.568 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.568 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.568 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.568 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.568 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.568 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.568 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.568 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.568 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.569 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.569 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.569 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.569 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-12T03:03:28.569 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.569 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.569 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.569 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.569 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.569 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.569 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.569 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.570 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.570 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.570 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.570 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.570 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.570 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.570 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.570 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.570 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.570 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.570 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.570 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.570 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.570 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.571 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.571 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.571 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.571 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.571 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.571 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.571 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.571 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.571 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.571 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.571 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.571 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.571 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.572 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.572 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.572 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.572 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.572 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.572 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.572 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.572 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.572 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.572 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.572 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.572 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.572 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.573 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.573 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.573 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.573 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.573 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.573 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.573 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.573 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.573 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.573 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.573 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.573 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.573 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.574 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.574 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.574 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.574 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.574 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.574 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.574 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.574 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.574 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_clones": { 2024-09-12T03:03:28.574 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_clones", 2024-09-12T03:03:28.574 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.574 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.574 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.575 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4", 2024-09-12T03:03:28.575 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.575 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.575 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.575 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T03:03:28.575 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.575 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.575 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.575 INFO:teuthology.orchestra.run.smithi018.stdout: "periodic_async_work": { 2024-09-12T03:03:28.575 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "periodic_async_work", 2024-09-12T03:03:28.575 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.575 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.575 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.576 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.576 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.576 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.576 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.576 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Periodically check for async work", 2024-09-12T03:03:28.576 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.576 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.576 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.576 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_delay": { 2024-09-12T03:03:28.576 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_delay", 2024-09-12T03:03:28.576 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.577 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.577 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.577 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-12T03:03:28.577 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.577 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.577 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.577 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T03:03:28.577 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.577 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.577 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.577 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_no_wait": { 2024-09-12T03:03:28.577 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T03:03:28.578 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.578 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.578 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.578 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.578 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.578 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.578 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.578 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T03:03:28.578 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.578 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.578 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.578 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.578 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.579 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix", 2024-09-12T03:03:28.579 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.579 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.579 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.579 INFO:teuthology.orchestra.run.smithi018.stdout: "discovery_interval": { 2024-09-12T03:03:28.579 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "discovery_interval", 2024-09-12T03:03:28.579 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-12T03:03:28.579 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.579 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.579 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "100", 2024-09-12T03:03:28.579 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.579 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.580 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.580 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.580 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.580 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.580 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.580 INFO:teuthology.orchestra.run.smithi018.stdout: "identifier": { 2024-09-12T03:03:28.580 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "identifier", 2024-09-12T03:03:28.580 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.580 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.580 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.580 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.581 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.581 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.581 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.581 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.581 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.581 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.581 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.581 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-12T03:03:28.581 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-12T03:03:28.581 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.581 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.581 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.581 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-12T03:03:28.582 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.582 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.582 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.582 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.582 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.582 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.582 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.582 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.582 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.582 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.582 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.582 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.583 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.583 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.583 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.583 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.583 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.583 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.583 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.583 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.583 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.583 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.583 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.583 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.583 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.583 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.584 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.584 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.584 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.584 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.584 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.584 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.584 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.584 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.584 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.584 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.584 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.584 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.585 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.585 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.585 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.585 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.585 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.585 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.585 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.585 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.585 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.585 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.585 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.585 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.585 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.586 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.586 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.586 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.586 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.586 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.586 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.586 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.586 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.586 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.586 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.586 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.586 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.586 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.587 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.587 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.587 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.587 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.587 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.587 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.587 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.587 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.587 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.587 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_host": { 2024-09-12T03:03:28.587 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_host", 2024-09-12T03:03:28.587 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.588 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.588 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.588 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.588 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.588 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.588 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.588 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.588 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.588 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.588 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.588 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_port": { 2024-09-12T03:03:28.589 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_port", 2024-09-12T03:03:28.589 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.589 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.589 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.589 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10051", 2024-09-12T03:03:28.589 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.589 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.589 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.589 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.589 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.589 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.589 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.590 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_sender": { 2024-09-12T03:03:28.590 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_sender", 2024-09-12T03:03:28.590 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.590 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.590 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.590 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T03:03:28.590 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.590 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.590 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.590 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.590 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.590 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.591 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.591 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.591 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.591 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.591 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-12T03:03:28.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.591 INFO:teuthology.orchestra.run.smithi018.stdout: "gid": 25211, 2024-09-12T03:03:28.591 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "y", 2024-09-12T03:03:28.591 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_features": 4540701547738038271, 2024-09-12T03:03:28.591 INFO:teuthology.orchestra.run.smithi018.stdout: "available_modules": [ 2024-09-12T03:03:28.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.592 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "alerts", 2024-09-12T03:03:28.592 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.592 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.592 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.592 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-12T03:03:28.592 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-12T03:03:28.592 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.592 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.592 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.592 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-12T03:03:28.592 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.592 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.592 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.593 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T03:03:28.593 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.593 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.593 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.593 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.593 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.593 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.593 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.593 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.593 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.593 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.593 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.593 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.594 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.594 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.594 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.594 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.594 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.594 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.594 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.594 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.594 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.594 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.594 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.594 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.594 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.595 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.595 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.595 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.595 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.595 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.595 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.595 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.595 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.595 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.595 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.595 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.595 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.595 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.596 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.596 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.596 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.596 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.596 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.596 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.596 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.596 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.596 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.596 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.596 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.597 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.597 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.597 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.597 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.597 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.597 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.597 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.597 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.597 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.597 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.597 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.597 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.598 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.598 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.598 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.598 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.598 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.598 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.598 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_destination": { 2024-09-12T03:03:28.598 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_destination", 2024-09-12T03:03:28.598 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.598 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.598 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.598 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.598 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.599 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.599 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.599 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email address to send alerts to", 2024-09-12T03:03:28.599 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.599 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.599 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.599 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_from_name": { 2024-09-12T03:03:28.599 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_from_name", 2024-09-12T03:03:28.599 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.599 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.599 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.599 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "Ceph", 2024-09-12T03:03:28.600 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.600 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.600 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.600 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email From: name", 2024-09-12T03:03:28.600 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.600 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.600 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.600 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_host": { 2024-09-12T03:03:28.600 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_host", 2024-09-12T03:03:28.600 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.600 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.600 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.600 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.601 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.601 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.601 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.601 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP server", 2024-09-12T03:03:28.601 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.601 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.601 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.601 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_password": { 2024-09-12T03:03:28.601 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_password", 2024-09-12T03:03:28.601 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.601 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.601 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.602 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.602 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.602 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.602 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.602 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Password to authenticate with", 2024-09-12T03:03:28.602 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.602 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.602 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.602 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_port": { 2024-09-12T03:03:28.602 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_port", 2024-09-12T03:03:28.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.602 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.603 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.603 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "465", 2024-09-12T03:03:28.603 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.603 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.603 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.603 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP port", 2024-09-12T03:03:28.603 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.603 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.603 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.603 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_sender": { 2024-09-12T03:03:28.603 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_sender", 2024-09-12T03:03:28.603 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.604 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.604 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.604 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.604 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.604 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.604 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.604 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP envelope sender", 2024-09-12T03:03:28.604 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.604 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.604 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.604 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_ssl": { 2024-09-12T03:03:28.604 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_ssl", 2024-09-12T03:03:28.605 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.605 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.605 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.605 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.605 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.605 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.605 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.605 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T03:03:28.605 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.605 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.605 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.606 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_user": { 2024-09-12T03:03:28.606 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_user", 2024-09-12T03:03:28.606 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.606 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.606 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.606 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.606 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.606 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.606 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.606 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "User to authenticate as", 2024-09-12T03:03:28.606 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.606 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.606 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.607 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.607 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.607 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "balancer", 2024-09-12T03:03:28.607 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.607 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.607 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.607 INFO:teuthology.orchestra.run.smithi018.stdout: "active": { 2024-09-12T03:03:28.607 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "active", 2024-09-12T03:03:28.607 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.607 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.608 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.608 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.608 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.608 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.608 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.608 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T03:03:28.608 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.608 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.608 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.608 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_time": { 2024-09-12T03:03:28.608 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_time", 2024-09-12T03:03:28.608 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.609 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.609 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.609 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0000", 2024-09-12T03:03:28.609 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.609 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.609 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.609 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T03:03:28.609 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T03:03:28.609 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.609 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.609 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_weekday": { 2024-09-12T03:03:28.610 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_weekday", 2024-09-12T03:03:28.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-12T03:03:28.610 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.610 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.610 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-12T03:03:28.610 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-12T03:03:28.610 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-12T03:03:28.610 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.610 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T03:03:28.610 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T03:03:28.610 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.610 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.611 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_max_iterations": { 2024-09-12T03:03:28.611 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_max_iterations", 2024-09-12T03:03:28.611 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-12T03:03:28.611 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.611 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.611 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "25", 2024-09-12T03:03:28.611 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-12T03:03:28.611 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "250", 2024-09-12T03:03:28.611 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.611 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T03:03:28.611 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.611 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.611 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.612 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_metrics": { 2024-09-12T03:03:28.612 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_metrics", 2024-09-12T03:03:28.612 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.612 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.612 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.612 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T03:03:28.612 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.612 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.612 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.612 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T03:03:28.612 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T03:03:28.612 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.613 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.613 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_step": { 2024-09-12T03:03:28.613 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_step", 2024-09-12T03:03:28.613 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:28.613 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.613 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.613 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.5", 2024-09-12T03:03:28.613 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0.001", 2024-09-12T03:03:28.613 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "0.999", 2024-09-12T03:03:28.613 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.613 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "aggressiveness of optimization", 2024-09-12T03:03:28.613 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T03:03:28.614 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.614 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.614 INFO:teuthology.orchestra.run.smithi018.stdout: "end_time": { 2024-09-12T03:03:28.614 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_time", 2024-09-12T03:03:28.614 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.614 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.614 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.614 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2359", 2024-09-12T03:03:28.614 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.614 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.614 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.614 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T03:03:28.614 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T03:03:28.615 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.615 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.615 INFO:teuthology.orchestra.run.smithi018.stdout: "end_weekday": { 2024-09-12T03:03:28.615 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_weekday", 2024-09-12T03:03:28.615 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-12T03:03:28.615 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.615 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.615 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-12T03:03:28.615 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-12T03:03:28.615 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-12T03:03:28.615 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.615 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T03:03:28.615 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T03:03:28.616 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.616 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.616 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.616 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.616 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.616 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.616 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.616 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.616 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.616 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.616 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.616 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.616 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.617 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.617 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.617 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.617 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.617 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.617 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.617 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.617 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.617 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.617 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.617 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.617 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.617 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.618 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.618 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.618 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.618 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.618 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.618 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.618 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.618 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.618 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.618 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.618 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.618 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.619 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.619 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.619 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.619 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.619 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.619 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.619 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.619 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.619 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.619 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.619 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.619 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.620 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.620 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.620 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.620 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.620 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.620 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.620 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.620 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.620 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.620 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.620 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.620 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.621 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.621 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.621 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.621 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.621 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.621 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.621 INFO:teuthology.orchestra.run.smithi018.stdout: "min_score": { 2024-09-12T03:03:28.621 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_score", 2024-09-12T03:03:28.621 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:28.621 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.621 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.621 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-12T03:03:28.622 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.622 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.622 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.622 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T03:03:28.622 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.622 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.622 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.622 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-12T03:03:28.622 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-12T03:03:28.622 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.622 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.622 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.622 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "upmap", 2024-09-12T03:03:28.623 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.623 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.623 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.623 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-compat", 2024-09-12T03:03:28.623 INFO:teuthology.orchestra.run.smithi018.stdout: "none", 2024-09-12T03:03:28.623 INFO:teuthology.orchestra.run.smithi018.stdout: "read", 2024-09-12T03:03:28.623 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap", 2024-09-12T03:03:28.623 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap-read" 2024-09-12T03:03:28.623 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.623 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Balancer mode", 2024-09-12T03:03:28.623 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.623 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.624 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.624 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_ids": { 2024-09-12T03:03:28.624 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_ids", 2024-09-12T03:03:28.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.624 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.624 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.624 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.624 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.624 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.624 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.624 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T03:03:28.625 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.625 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.625 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.625 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-12T03:03:28.625 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-12T03:03:28.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.625 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.625 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-12T03:03:28.625 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.625 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.625 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.625 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T03:03:28.626 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.626 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.626 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.626 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_deviation": { 2024-09-12T03:03:28.626 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_deviation", 2024-09-12T03:03:28.626 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.626 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.626 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.626 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-12T03:03:28.626 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-12T03:03:28.626 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.626 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.627 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T03:03:28.627 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T03:03:28.627 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.627 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.627 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_optimizations": { 2024-09-12T03:03:28.627 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_optimizations", 2024-09-12T03:03:28.627 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-12T03:03:28.627 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.627 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.627 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:28.627 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.627 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.628 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.628 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T03:03:28.628 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.628 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.628 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.628 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm", 2024-09-12T03:03:28.628 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.628 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.628 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.629 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_down_multiplier": { 2024-09-12T03:03:28.629 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_down_multiplier", 2024-09-12T03:03:28.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:28.629 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.629 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-12T03:03:28.629 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.629 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.629 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.629 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T03:03:28.629 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.629 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.630 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_refresh_rate": { 2024-09-12T03:03:28.630 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_refresh_rate", 2024-09-12T03:03:28.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.630 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.630 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.630 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "20", 2024-09-12T03:03:28.630 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.630 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.630 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.630 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T03:03:28.630 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.630 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.631 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.631 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_starting_port": { 2024-09-12T03:03:28.631 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_starting_port", 2024-09-12T03:03:28.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.631 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.631 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.631 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4721", 2024-09-12T03:03:28.631 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.631 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.631 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.631 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T03:03:28.632 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.632 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.632 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.632 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_ptrace": { 2024-09-12T03:03:28.632 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_ptrace", 2024-09-12T03:03:28.632 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.632 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.632 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.632 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.632 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.632 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.633 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.633 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T03:03:28.633 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T03:03:28.633 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.633 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.633 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_interval": { 2024-09-12T03:03:28.633 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_interval", 2024-09-12T03:03:28.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.633 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.633 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.634 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-12T03:03:28.634 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.634 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.634 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.634 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T03:03:28.634 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.634 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.634 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.634 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_memory_target_ratio": { 2024-09-12T03:03:28.634 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T03:03:28.634 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:28.635 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.635 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.635 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.7", 2024-09-12T03:03:28.635 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.635 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.635 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.635 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T03:03:28.635 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.635 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.635 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.635 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm_log_destination": { 2024-09-12T03:03:28.635 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm_log_destination", 2024-09-12T03:03:28.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.636 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.636 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.636 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.636 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.636 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.636 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.636 INFO:teuthology.orchestra.run.smithi018.stdout: "file", 2024-09-12T03:03:28.636 INFO:teuthology.orchestra.run.smithi018.stdout: "file,syslog", 2024-09-12T03:03:28.636 INFO:teuthology.orchestra.run.smithi018.stdout: "syslog" 2024-09-12T03:03:28.636 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.636 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T03:03:28.637 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.637 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.637 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.637 INFO:teuthology.orchestra.run.smithi018.stdout: "cgroups_split": { 2024-09-12T03:03:28.637 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cgroups_split", 2024-09-12T03:03:28.637 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.637 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.637 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.637 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.637 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.637 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.637 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.638 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T03:03:28.638 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.638 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.638 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.638 INFO:teuthology.orchestra.run.smithi018.stdout: "config_checks_enabled": { 2024-09-12T03:03:28.638 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_checks_enabled", 2024-09-12T03:03:28.638 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.638 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.638 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.638 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.638 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.638 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.638 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.639 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T03:03:28.639 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.639 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.639 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.639 INFO:teuthology.orchestra.run.smithi018.stdout: "config_dashboard": { 2024-09-12T03:03:28.639 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_dashboard", 2024-09-12T03:03:28.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.639 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.639 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.639 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.639 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.639 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.640 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.640 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T03:03:28.640 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.640 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.640 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.640 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_alertmanager": { 2024-09-12T03:03:28.640 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_alertmanager", 2024-09-12T03:03:28.640 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.640 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.640 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.640 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T03:03:28.640 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.641 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.641 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.641 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-12T03:03:28.641 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.641 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.641 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.641 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_base": { 2024-09-12T03:03:28.641 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_base", 2024-09-12T03:03:28.641 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.641 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.641 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.641 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T03:03:28.642 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.642 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.642 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.642 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Container image name, without the tag", 2024-09-12T03:03:28.642 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.642 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.642 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.642 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_elasticsearch": { 2024-09-12T03:03:28.642 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_elasticsearch", 2024-09-12T03:03:28.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.642 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.642 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.642 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T03:03:28.643 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.643 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.643 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.643 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "elasticsearch container image", 2024-09-12T03:03:28.643 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.643 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.643 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.643 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_grafana": { 2024-09-12T03:03:28.643 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_grafana", 2024-09-12T03:03:28.643 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.643 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.643 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.644 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T03:03:28.644 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.644 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.644 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.644 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-12T03:03:28.644 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.644 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.644 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.644 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_haproxy": { 2024-09-12T03:03:28.644 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_haproxy", 2024-09-12T03:03:28.644 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.644 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.645 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.645 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T03:03:28.645 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.645 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.645 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.645 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "HAproxy container image", 2024-09-12T03:03:28.645 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.645 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.645 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.645 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_agent": { 2024-09-12T03:03:28.645 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_agent", 2024-09-12T03:03:28.646 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.646 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.646 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.646 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T03:03:28.646 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.646 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.646 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.646 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger agent container image", 2024-09-12T03:03:28.646 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.646 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.646 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.647 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_collector": { 2024-09-12T03:03:28.647 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_collector", 2024-09-12T03:03:28.647 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.647 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.647 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.647 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T03:03:28.647 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.647 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.647 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.647 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger collector container image", 2024-09-12T03:03:28.647 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.647 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.648 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.648 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_query": { 2024-09-12T03:03:28.648 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_query", 2024-09-12T03:03:28.648 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.648 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.648 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.648 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T03:03:28.648 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.648 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.648 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.649 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger query container image", 2024-09-12T03:03:28.649 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.649 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.649 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.649 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_keepalived": { 2024-09-12T03:03:28.649 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_keepalived", 2024-09-12T03:03:28.649 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.649 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.649 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.649 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T03:03:28.649 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.649 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.650 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.650 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Keepalived container image", 2024-09-12T03:03:28.650 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.650 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.650 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.650 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_loki": { 2024-09-12T03:03:28.650 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_loki", 2024-09-12T03:03:28.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.650 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.650 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.650 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T03:03:28.650 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.651 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.651 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.651 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Loki container image", 2024-09-12T03:03:28.651 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.651 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.651 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.651 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_node_exporter": { 2024-09-12T03:03:28.651 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_node_exporter", 2024-09-12T03:03:28.651 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.651 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.651 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.652 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T03:03:28.652 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.652 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.652 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.652 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-12T03:03:28.652 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.652 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.652 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.652 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nvmeof": { 2024-09-12T03:03:28.652 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nvmeof", 2024-09-12T03:03:28.652 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.652 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.653 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.653 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T03:03:28.653 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.653 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.653 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.653 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nvme-of container image", 2024-09-12T03:03:28.653 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.653 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.653 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.653 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_prometheus": { 2024-09-12T03:03:28.653 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_prometheus", 2024-09-12T03:03:28.653 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.653 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.654 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.654 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T03:03:28.654 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.654 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.654 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.654 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-12T03:03:28.654 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.654 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.654 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.654 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_promtail": { 2024-09-12T03:03:28.654 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_promtail", 2024-09-12T03:03:28.655 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.655 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.655 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.655 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T03:03:28.655 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.655 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.655 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.655 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Promtail container image", 2024-09-12T03:03:28.655 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.655 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.655 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.655 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_samba": { 2024-09-12T03:03:28.655 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_samba", 2024-09-12T03:03:28.656 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.656 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.656 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.656 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T03:03:28.656 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.656 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.656 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.656 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Samba/SMB container image", 2024-09-12T03:03:28.656 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.656 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.656 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.656 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_snmp_gateway": { 2024-09-12T03:03:28.657 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_snmp_gateway", 2024-09-12T03:03:28.657 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.657 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.657 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.657 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T03:03:28.657 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.657 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.657 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.657 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SNMP Gateway container image", 2024-09-12T03:03:28.657 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.657 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.657 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.657 INFO:teuthology.orchestra.run.smithi018.stdout: "container_init": { 2024-09-12T03:03:28.658 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_init", 2024-09-12T03:03:28.658 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.658 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.658 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.658 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.658 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.658 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.658 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.658 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T03:03:28.658 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.658 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.658 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.658 INFO:teuthology.orchestra.run.smithi018.stdout: "daemon_cache_timeout": { 2024-09-12T03:03:28.659 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "daemon_cache_timeout", 2024-09-12T03:03:28.659 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.659 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.659 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.659 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-12T03:03:28.659 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.659 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.659 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.659 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T03:03:28.659 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.659 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.659 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.660 INFO:teuthology.orchestra.run.smithi018.stdout: "default_cephadm_command_timeout": { 2024-09-12T03:03:28.660 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T03:03:28.660 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.660 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.660 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.660 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "900", 2024-09-12T03:03:28.660 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.660 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.660 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.660 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T03:03:28.660 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.660 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.661 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.661 INFO:teuthology.orchestra.run.smithi018.stdout: "default_registry": { 2024-09-12T03:03:28.661 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_registry", 2024-09-12T03:03:28.661 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.661 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.661 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.661 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io", 2024-09-12T03:03:28.661 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.661 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.661 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.661 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T03:03:28.661 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.662 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.662 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.662 INFO:teuthology.orchestra.run.smithi018.stdout: "device_cache_timeout": { 2024-09-12T03:03:28.662 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_cache_timeout", 2024-09-12T03:03:28.662 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.662 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.662 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.662 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1800", 2024-09-12T03:03:28.662 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.662 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.662 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.662 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache device inventory", 2024-09-12T03:03:28.662 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.663 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.663 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.663 INFO:teuthology.orchestra.run.smithi018.stdout: "device_enhanced_scan": { 2024-09-12T03:03:28.663 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_enhanced_scan", 2024-09-12T03:03:28.663 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.663 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.663 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.663 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.663 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.663 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.663 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.663 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T03:03:28.663 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.664 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.664 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.664 INFO:teuthology.orchestra.run.smithi018.stdout: "facts_cache_timeout": { 2024-09-12T03:03:28.664 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "facts_cache_timeout", 2024-09-12T03:03:28.664 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.664 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.664 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.664 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-12T03:03:28.664 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.664 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.664 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.664 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache host facts data", 2024-09-12T03:03:28.665 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.665 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.665 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.665 INFO:teuthology.orchestra.run.smithi018.stdout: "grafana_dashboards_path": { 2024-09-12T03:03:28.665 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "grafana_dashboards_path", 2024-09-12T03:03:28.665 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.665 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.665 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.665 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T03:03:28.665 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.665 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.665 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T03:03:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: "host_check_interval": { 2024-09-12T03:03:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "host_check_interval", 2024-09-12T03:03:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-12T03:03:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to perform a host check", 2024-09-12T03:03:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: "hw_monitoring": { 2024-09-12T03:03:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hw_monitoring", 2024-09-12T03:03:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T03:03:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: "inventory_list_all": { 2024-09-12T03:03:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "inventory_list_all", 2024-09-12T03:03:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T03:03:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: "log_refresh_metadata": { 2024-09-12T03:03:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_refresh_metadata", 2024-09-12T03:03:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T03:03:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T03:03:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T03:03:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T03:03:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T03:03:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T03:03:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T03:03:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "*", 2024-09-12T03:03:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T03:03:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: "max_count_per_host": { 2024-09-12T03:03:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_count_per_host", 2024-09-12T03:03:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of daemons per service per host", 2024-09-12T03:03:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd_draining_count": { 2024-09-12T03:03:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_osd_draining_count", 2024-09-12T03:03:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T03:03:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.680 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.680 INFO:teuthology.orchestra.run.smithi018.stdout: "migration_current": { 2024-09-12T03:03:28.680 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "migration_current", 2024-09-12T03:03:28.680 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.680 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.680 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.680 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.680 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.680 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.680 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.680 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "internal - do not modify", 2024-09-12T03:03:28.680 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.680 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.681 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.681 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-12T03:03:28.681 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-12T03:03:28.681 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.681 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.681 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.681 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "root", 2024-09-12T03:03:28.681 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.681 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.681 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.681 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm-package", 2024-09-12T03:03:28.681 INFO:teuthology.orchestra.run.smithi018.stdout: "root" 2024-09-12T03:03:28.682 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.682 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T03:03:28.682 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.682 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.682 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.682 INFO:teuthology.orchestra.run.smithi018.stdout: "oob_default_addr": { 2024-09-12T03:03:28.682 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "oob_default_addr", 2024-09-12T03:03:28.682 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.682 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.682 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.682 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "169.254.1.1", 2024-09-12T03:03:28.682 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.682 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.683 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.683 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T03:03:28.683 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.683 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.683 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.683 INFO:teuthology.orchestra.run.smithi018.stdout: "prometheus_alerts_path": { 2024-09-12T03:03:28.683 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus_alerts_path", 2024-09-12T03:03:28.683 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.683 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.683 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.683 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T03:03:28.683 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.684 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.684 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.684 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T03:03:28.684 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.684 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.684 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.684 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_insecure": { 2024-09-12T03:03:28.684 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_insecure", 2024-09-12T03:03:28.684 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.684 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.684 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.684 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.684 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.685 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.685 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.685 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T03:03:28.685 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.685 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.685 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.685 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_password": { 2024-09-12T03:03:28.685 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_password", 2024-09-12T03:03:28.685 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.685 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.685 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.686 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.686 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.686 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.686 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.686 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T03:03:28.686 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.686 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.686 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.686 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_url": { 2024-09-12T03:03:28.686 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_url", 2024-09-12T03:03:28.686 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.686 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.686 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.687 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.687 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.687 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.687 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.687 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T03:03:28.687 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.687 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.687 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.687 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_username": { 2024-09-12T03:03:28.687 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_username", 2024-09-12T03:03:28.687 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.688 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.688 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.688 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.688 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.688 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.688 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.688 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T03:03:28.688 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.688 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.688 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.688 INFO:teuthology.orchestra.run.smithi018.stdout: "secure_monitoring_stack": { 2024-09-12T03:03:28.688 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secure_monitoring_stack", 2024-09-12T03:03:28.689 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.689 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.689 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.689 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.689 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.689 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.689 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.689 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T03:03:28.689 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.689 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.689 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.689 INFO:teuthology.orchestra.run.smithi018.stdout: "service_discovery_port": { 2024-09-12T03:03:28.690 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "service_discovery_port", 2024-09-12T03:03:28.690 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.690 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.690 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.690 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8765", 2024-09-12T03:03:28.690 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.690 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.690 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.690 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "cephadm service discovery port", 2024-09-12T03:03:28.690 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.690 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.690 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.690 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_config_file": { 2024-09-12T03:03:28.691 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_config_file", 2024-09-12T03:03:28.691 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.691 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.691 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.691 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.691 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.691 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.691 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.691 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T03:03:28.691 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.691 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.691 INFO:teuthology.orchestra.run.smithi018.stdout: "use_agent": { 2024-09-12T03:03:28.692 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_agent", 2024-09-12T03:03:28.692 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.692 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.692 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.692 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.692 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.692 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.692 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.692 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T03:03:28.692 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.692 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.692 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.693 INFO:teuthology.orchestra.run.smithi018.stdout: "use_repo_digest": { 2024-09-12T03:03:28.693 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_repo_digest", 2024-09-12T03:03:28.693 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.693 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.693 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.693 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.693 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.693 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.693 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.693 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T03:03:28.693 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.693 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.693 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.694 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_failed_host_check": { 2024-09-12T03:03:28.694 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_failed_host_check", 2024-09-12T03:03:28.694 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.694 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.694 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.694 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.694 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.694 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.694 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.694 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T03:03:28.694 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.694 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.695 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.695 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_daemons": { 2024-09-12T03:03:28.695 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_daemons", 2024-09-12T03:03:28.695 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.695 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.695 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.695 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.695 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.695 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.695 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.695 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T03:03:28.695 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.696 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.696 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.696 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_hosts": { 2024-09-12T03:03:28.696 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_hosts", 2024-09-12T03:03:28.696 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.696 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.696 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.696 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.696 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.696 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.696 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.696 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T03:03:28.697 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.697 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.697 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.697 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.697 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.697 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crash", 2024-09-12T03:03:28.697 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.697 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.697 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.697 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.697 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.697 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.698 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.698 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.698 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.698 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.698 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.698 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.698 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.698 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.698 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.698 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.698 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.698 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.698 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.699 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.699 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.699 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.699 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.699 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.699 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.699 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.699 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.699 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.699 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.699 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.699 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.700 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.700 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.700 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.700 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.700 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.700 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.700 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.700 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.700 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.700 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.700 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.700 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.701 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.701 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.701 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.701 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.701 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.701 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.701 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.701 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.701 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.701 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.701 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.701 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.701 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.702 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.702 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.702 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.702 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.702 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.702 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.702 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.702 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.702 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.702 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.702 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.702 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.702 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.703 INFO:teuthology.orchestra.run.smithi018.stdout: "retain_interval": { 2024-09-12T03:03:28.703 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retain_interval", 2024-09-12T03:03:28.703 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.703 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.703 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.703 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "31536000", 2024-09-12T03:03:28.703 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.703 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.703 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.703 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T03:03:28.703 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.704 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.704 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.704 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_recent_interval": { 2024-09-12T03:03:28.704 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_recent_interval", 2024-09-12T03:03:28.704 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.704 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.704 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.704 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1209600", 2024-09-12T03:03:28.704 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.704 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.704 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.704 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T03:03:28.705 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.705 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.705 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.705 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.705 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.705 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dashboard", 2024-09-12T03:03:28.705 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.705 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.705 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.705 INFO:teuthology.orchestra.run.smithi018.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T03:03:28.705 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T03:03:28.705 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.706 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.706 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.706 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:28.706 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.706 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.706 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.706 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.706 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.706 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.706 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.706 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T03:03:28.707 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T03:03:28.707 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.707 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.707 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.707 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.707 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.707 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.707 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.707 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.707 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.707 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.707 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.707 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T03:03:28.708 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T03:03:28.708 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.708 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.708 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.708 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.708 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.708 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.708 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.708 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.708 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.708 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.708 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.708 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_ENABLED": { 2024-09-12T03:03:28.709 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T03:03:28.709 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.709 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.709 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.709 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.709 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.709 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.709 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.709 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.709 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.709 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.709 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.710 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T03:03:28.710 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T03:03:28.710 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.710 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.710 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.710 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.710 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.710 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.710 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.710 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.710 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.710 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.711 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.711 INFO:teuthology.orchestra.run.smithi018.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T03:03:28.711 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T03:03:28.711 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.711 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.711 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.711 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.711 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.711 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.711 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.711 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.711 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.712 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.712 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.712 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T03:03:28.712 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T03:03:28.712 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.712 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.712 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.712 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.712 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.712 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.712 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.712 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.713 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.713 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.713 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.713 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T03:03:28.713 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T03:03:28.713 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.713 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.713 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.713 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.713 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.713 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.713 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.714 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.714 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.714 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.714 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.714 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T03:03:28.714 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T03:03:28.714 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.714 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.714 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.714 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.714 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.714 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.715 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.715 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.715 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.715 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.715 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.715 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T03:03:28.715 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T03:03:28.715 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.715 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.715 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.715 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.715 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.715 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.716 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.716 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.716 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.716 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.716 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.716 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T03:03:28.716 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T03:03:28.716 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.716 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.716 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.716 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.717 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.717 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.717 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.717 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.717 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.717 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.717 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.717 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T03:03:28.717 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T03:03:28.717 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.717 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.717 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.718 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.718 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.718 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.718 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.718 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.718 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.718 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.718 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.718 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T03:03:28.718 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T03:03:28.718 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.718 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.718 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.719 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.719 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.719 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.719 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.719 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.719 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.719 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.719 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.719 INFO:teuthology.orchestra.run.smithi018.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T03:03:28.719 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T03:03:28.719 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.719 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.720 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.720 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.720 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.720 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.720 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.720 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.720 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.720 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.720 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.720 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T03:03:28.720 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T03:03:28.721 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.721 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.721 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.721 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-12T03:03:28.721 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.721 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.721 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.721 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.721 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.721 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.721 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.721 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T03:03:28.721 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T03:03:28.722 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.722 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.722 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.722 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.722 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.722 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.722 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.722 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.722 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.722 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.722 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.722 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_URL": { 2024-09-12T03:03:28.723 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_URL", 2024-09-12T03:03:28.723 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.723 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.723 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.723 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.723 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.723 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.723 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.723 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.723 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.723 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.723 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.723 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T03:03:28.724 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T03:03:28.724 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.724 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.724 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.724 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-12T03:03:28.724 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.724 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.724 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.724 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.724 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.724 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.724 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.725 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T03:03:28.725 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T03:03:28.725 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.725 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.725 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.725 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.725 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.725 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.725 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.725 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.725 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.725 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.725 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.726 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T03:03:28.726 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T03:03:28.726 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.726 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.726 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.726 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.726 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.726 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.726 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.726 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.726 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.726 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.726 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.727 INFO:teuthology.orchestra.run.smithi018.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T03:03:28.727 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T03:03:28.727 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.727 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.727 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.727 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.727 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.727 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.727 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.727 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.727 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.728 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.728 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.728 INFO:teuthology.orchestra.run.smithi018.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T03:03:28.728 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T03:03:28.728 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.728 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.728 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.728 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.728 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.728 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.728 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.728 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.729 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.729 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.729 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.729 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T03:03:28.729 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T03:03:28.729 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.729 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.729 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.729 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.729 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.729 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.729 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.730 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.730 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.730 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.730 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.730 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T03:03:28.730 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T03:03:28.730 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.730 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.730 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.730 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.730 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.730 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.731 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.731 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.731 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.731 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.731 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.731 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T03:03:28.731 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T03:03:28.731 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.731 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.731 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.731 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.731 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.732 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.732 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.732 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.732 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.732 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.732 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.732 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T03:03:28.732 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T03:03:28.732 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.732 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.732 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.732 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.733 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.733 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.733 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.733 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.733 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.733 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.733 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.733 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T03:03:28.733 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T03:03:28.733 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.733 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.734 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.734 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.734 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.734 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.734 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.734 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.734 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.734 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.734 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.734 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T03:03:28.734 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T03:03:28.734 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.735 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.735 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.735 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.735 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.735 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.735 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.735 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.735 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.735 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.735 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.735 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T03:03:28.735 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T03:03:28.736 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.736 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.736 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.736 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.736 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.736 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.736 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.736 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.736 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.736 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.736 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.737 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T03:03:28.737 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T03:03:28.737 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.737 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.737 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.737 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.737 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.737 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.737 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.737 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.737 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.737 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.737 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.738 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T03:03:28.738 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T03:03:28.738 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.738 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.738 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.738 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.738 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.738 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.738 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.738 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.738 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.738 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.738 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.739 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T03:03:28.739 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T03:03:28.739 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.739 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.739 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.739 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.739 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.739 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.739 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.739 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.739 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.740 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.740 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.740 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T03:03:28.740 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T03:03:28.740 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.740 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.740 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.740 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T03:03:28.740 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.740 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.740 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.740 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.741 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.741 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.741 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.741 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T03:03:28.741 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T03:03:28.741 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.741 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.741 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.741 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:28.741 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.741 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.741 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.742 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.742 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.742 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.742 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.742 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T03:03:28.742 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T03:03:28.742 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.742 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.742 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.742 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8", 2024-09-12T03:03:28.742 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.742 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.743 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.743 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.743 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.743 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.743 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.743 INFO:teuthology.orchestra.run.smithi018.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T03:03:28.743 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T03:03:28.743 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.743 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.743 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.743 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "45", 2024-09-12T03:03:28.743 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.743 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T03:03:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T03:03:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.744 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T03:03:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T03:03:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.745 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-12T03:03:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T03:03:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T03:03:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.746 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T03:03:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T03:03:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.747 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T03:03:28.748 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T03:03:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-12T03:03:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T03:03:28.749 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T03:03:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.750 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T03:03:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T03:03:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-12T03:03:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.751 INFO:teuthology.orchestra.run.smithi018.stdout: "cross_origin_url": { 2024-09-12T03:03:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cross_origin_url", 2024-09-12T03:03:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.752 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "crt_file": { 2024-09-12T03:03:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crt_file", 2024-09-12T03:03:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.753 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "debug": { 2024-09-12T03:03:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "debug", 2024-09-12T03:03:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable/disable debug options", 2024-09-12T03:03:28.754 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "jwt_token_ttl": { 2024-09-12T03:03:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "jwt_token_ttl", 2024-09-12T03:03:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "28800", 2024-09-12T03:03:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.755 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-12T03:03:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-12T03:03:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.756 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.757 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.759 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.760 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.761 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "motd": { 2024-09-12T03:03:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "motd", 2024-09-12T03:03:28.762 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "The message of the day", 2024-09-12T03:03:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_resolve_ip_addr": { 2024-09-12T03:03:28.763 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T03:03:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-12T03:03:28.764 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-12T03:03:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-12T03:03:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.765 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-12T03:03:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-12T03:03:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8080", 2024-09-12T03:03:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.766 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-12T03:03:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-12T03:03:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.767 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl_server_port": { 2024-09-12T03:03:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl_server_port", 2024-09-12T03:03:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8443", 2024-09-12T03:03:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.768 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-12T03:03:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-12T03:03:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "redirect", 2024-09-12T03:03:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.769 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect" 2024-09-12T03:03:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-12T03:03:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-12T03:03:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.770 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-12T03:03:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-12T03:03:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-12T03:03:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "url_prefix": { 2024-09-12T03:03:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url_prefix", 2024-09-12T03:03:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.771 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-12T03:03:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_monitoring": { 2024-09-12T03:03:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_monitoring", 2024-09-12T03:03:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.773 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "monitor device health metrics", 2024-09-12T03:03:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.774 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.777 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.778 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "mark_out_threshold": { 2024-09-12T03:03:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mark_out_threshold", 2024-09-12T03:03:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.779 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2419200", 2024-09-12T03:03:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T03:03:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.780 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": { 2024-09-12T03:03:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_name", 2024-09-12T03:03:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "device_health_metrics", 2024-09-12T03:03:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T03:03:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "retention_period": { 2024-09-12T03:03:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retention_period", 2024-09-12T03:03:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15552000", 2024-09-12T03:03:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain device health metrics", 2024-09-12T03:03:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_frequency": { 2024-09-12T03:03:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_frequency", 2024-09-12T03:03:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-12T03:03:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T03:03:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "self_heal": { 2024-09-12T03:03:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "self_heal", 2024-09-12T03:03:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T03:03:28.784 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-12T03:03:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-12T03:03:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-12T03:03:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.785 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T03:03:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_threshold": { 2024-09-12T03:03:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_threshold", 2024-09-12T03:03:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7257600", 2024-09-12T03:03:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.786 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T03:03:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "diskprediction_local", 2024-09-12T03:03:28.787 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.788 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.789 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.790 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.791 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.792 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "predict_interval": { 2024-09-12T03:03:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predict_interval", 2024-09-12T03:03:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.793 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-12T03:03:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "predictor_model": { 2024-09-12T03:03:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predictor_model", 2024-09-12T03:03:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.794 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "prophetstor", 2024-09-12T03:03:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-12T03:03:28.795 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-12T03:03:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-12T03:03:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.796 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "influx", 2024-09-12T03:03:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": false, 2024-09-12T03:03:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "influxdb python module not found", 2024-09-12T03:03:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: "batch_size": { 2024-09-12T03:03:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "batch_size", 2024-09-12T03:03:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.797 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5000", 2024-09-12T03:03:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T03:03:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "database": { 2024-09-12T03:03:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "database", 2024-09-12T03:03:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.798 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "ceph", 2024-09-12T03:03:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T03:03:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": { 2024-09-12T03:03:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hostname", 2024-09-12T03:03:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.799 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server hostname", 2024-09-12T03:03:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-12T03:03:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-12T03:03:28.800 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "30", 2024-09-12T03:03:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "5", 2024-09-12T03:03:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T03:03:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.801 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.802 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.803 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.804 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.805 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.806 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "password": { 2024-09-12T03:03:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "password", 2024-09-12T03:03:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "password of InfluxDB server user", 2024-09-12T03:03:28.807 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "port": { 2024-09-12T03:03:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "port", 2024-09-12T03:03:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8086", 2024-09-12T03:03:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.808 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server port", 2024-09-12T03:03:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-12T03:03:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-12T03:03:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "false", 2024-09-12T03:03:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.809 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T03:03:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "threads": { 2024-09-12T03:03:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threads", 2024-09-12T03:03:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-12T03:03:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-12T03:03:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "32", 2024-09-12T03:03:28.810 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T03:03:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "username": { 2024-09-12T03:03:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "username", 2024-09-12T03:03:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.811 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "username of InfluxDB server user", 2024-09-12T03:03:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "verify_ssl": { 2024-09-12T03:03:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "verify_ssl", 2024-09-12T03:03:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "true", 2024-09-12T03:03:28.812 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T03:03:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "insights", 2024-09-12T03:03:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.815 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.816 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.817 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.818 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "iostat", 2024-09-12T03:03:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.819 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.820 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.821 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.823 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.824 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "k8sevents", 2024-09-12T03:03:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.825 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_event_retention_days": { 2024-09-12T03:03:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ceph_event_retention_days", 2024-09-12T03:03:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7", 2024-09-12T03:03:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.829 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T03:03:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "config_check_secs": { 2024-09-12T03:03:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_check_secs", 2024-09-12T03:03:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:28.830 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "10", 2024-09-12T03:03:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T03:03:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.831 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.832 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.833 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.834 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.835 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.836 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "localpool", 2024-09-12T03:03:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: "failure_domain": { 2024-09-12T03:03:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "failure_domain", 2024-09-12T03:03:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.837 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "host", 2024-09-12T03:03:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "failure domain for any created local pool", 2024-09-12T03:03:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T03:03:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.838 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.839 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.840 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.841 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.842 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.843 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": { 2024-09-12T03:03:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_size", 2024-09-12T03:03:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default min_size for any created local pool", 2024-09-12T03:03:28.844 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T03:03:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "num_rep": { 2024-09-12T03:03:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "num_rep", 2024-09-12T03:03:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-09-12T03:03:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.845 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default replica count for any created local pool", 2024-09-12T03:03:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": { 2024-09-12T03:03:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_num", 2024-09-12T03:03:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.846 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "128", 2024-09-12T03:03:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T03:03:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "prefix": { 2024-09-12T03:03:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prefix", 2024-09-12T03:03:28.847 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name prefix for any created local pool", 2024-09-12T03:03:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "subtree": { 2024-09-12T03:03:28.848 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "subtree", 2024-09-12T03:03:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "rack", 2024-09-12T03:03:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T03:03:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T03:03:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.849 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mds_autoscaler", 2024-09-12T03:03:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.850 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.851 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.852 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.853 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.854 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.855 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirroring", 2024-09-12T03:03:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.856 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.857 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.858 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.859 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.860 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.861 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "nfs", 2024-09-12T03:03:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.862 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.863 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.864 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.865 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.866 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.867 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-12T03:03:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: "fail_fs": { 2024-09-12T03:03:28.868 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "fail_fs", 2024-09-12T03:03:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T03:03:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.869 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.870 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.871 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.872 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.873 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.874 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator": { 2024-09-12T03:03:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-12T03:03:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-12T03:03:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "rook", 2024-09-12T03:03:28.875 INFO:teuthology.orchestra.run.smithi018.stdout: "test_orchestrator" 2024-09-12T03:03:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Orchestrator backend", 2024-09-12T03:03:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_perf_query", 2024-09-12T03:03:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.876 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.877 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.878 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.880 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.881 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.881 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.881 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.881 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.881 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.881 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.881 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.881 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.881 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.881 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.881 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.881 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.881 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.882 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.882 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.882 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.882 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.882 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.882 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_support", 2024-09-12T03:03:28.882 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.882 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.882 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.882 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.883 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.883 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.883 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.883 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.883 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.883 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.883 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.883 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.883 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.883 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.883 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.883 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.883 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.885 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.885 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.885 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.885 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.885 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.885 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.885 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.885 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.885 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.885 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.885 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.885 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.886 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.886 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.886 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.886 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.886 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.886 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.886 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.886 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.886 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.886 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.886 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.886 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.886 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.886 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.887 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.887 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.887 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.887 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.887 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.887 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.887 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.887 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.887 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.887 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.887 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.887 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.888 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.888 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.888 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.888 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.888 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_autoscaler", 2024-09-12T03:03:28.888 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.888 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.888 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.888 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.888 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.888 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.888 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.889 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.889 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.889 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.889 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.889 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.889 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.889 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.889 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.889 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.889 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.889 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.889 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.889 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.889 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.890 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.890 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.890 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.890 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.890 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.890 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.890 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.890 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.890 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.890 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.890 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.890 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.891 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.891 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.891 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.891 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.891 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.891 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.891 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.891 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.891 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.891 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.891 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.891 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.891 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.892 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.892 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.892 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.892 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.892 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.892 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.892 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.892 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.892 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.892 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.892 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.892 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.893 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.893 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.893 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.893 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.893 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.893 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.893 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.893 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.893 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.893 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.893 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.894 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-12T03:03:28.894 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-12T03:03:28.894 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.894 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.894 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.894 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-12T03:03:28.894 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.894 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.894 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.894 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.894 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.894 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.894 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.895 INFO:teuthology.orchestra.run.smithi018.stdout: "threshold": { 2024-09-12T03:03:28.895 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threshold", 2024-09-12T03:03:28.895 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:28.895 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.895 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.895 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-12T03:03:28.895 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1.0", 2024-09-12T03:03:28.895 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.895 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.895 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "scaling threshold", 2024-09-12T03:03:28.895 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T03:03:28.896 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.896 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.896 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.896 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.896 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "progress", 2024-09-12T03:03:28.896 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.896 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.896 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.896 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_pg_recovery_event": { 2024-09-12T03:03:28.896 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_pg_recovery_event", 2024-09-12T03:03:28.896 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.897 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.897 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.897 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.897 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.897 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.897 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.897 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T03:03:28.897 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.897 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.897 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.897 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-12T03:03:28.897 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-12T03:03:28.898 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.898 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.898 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.898 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.898 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.898 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.898 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.898 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.898 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.898 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.898 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.899 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.899 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.899 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.899 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.899 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.899 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.899 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.899 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.899 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.899 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.899 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.899 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.899 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.899 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.900 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.900 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.900 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.900 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.900 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.900 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.900 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.900 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.900 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.900 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.900 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.901 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.901 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.901 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.901 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.901 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.901 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.901 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.901 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.901 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.901 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.901 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.901 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.902 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.902 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.902 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.902 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.902 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.902 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.902 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.902 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.902 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.902 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.902 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.902 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.902 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.903 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.903 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.903 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.903 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.903 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.903 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.903 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.903 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.903 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.903 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.903 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.903 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.904 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.904 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.904 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.904 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.904 INFO:teuthology.orchestra.run.smithi018.stdout: "max_completed_events": { 2024-09-12T03:03:28.904 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_completed_events", 2024-09-12T03:03:28.904 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.904 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.904 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.904 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "50", 2024-09-12T03:03:28.904 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.904 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.905 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.905 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "number of past completed events to remember", 2024-09-12T03:03:28.905 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.905 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.905 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.905 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-12T03:03:28.905 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-12T03:03:28.905 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.905 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.905 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.906 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-12T03:03:28.906 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.906 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.906 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.906 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long the module is going to sleep", 2024-09-12T03:03:28.906 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.906 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.906 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.906 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.906 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.907 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus", 2024-09-12T03:03:28.907 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.907 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.907 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.907 INFO:teuthology.orchestra.run.smithi018.stdout: "cache": { 2024-09-12T03:03:28.907 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cache", 2024-09-12T03:03:28.907 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.907 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.907 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.907 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.907 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.907 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.907 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.908 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.908 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.908 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.908 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.908 INFO:teuthology.orchestra.run.smithi018.stdout: "exclude_perf_counters": { 2024-09-12T03:03:28.908 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "exclude_perf_counters", 2024-09-12T03:03:28.908 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.908 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.908 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.908 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.908 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.908 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.909 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.909 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T03:03:28.909 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T03:03:28.909 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.909 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.909 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.909 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.909 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.909 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.909 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.909 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.909 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.910 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.910 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.910 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.910 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.910 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.910 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.910 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.910 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.910 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.910 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.910 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.910 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.910 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.911 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.911 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.911 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.911 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.911 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.911 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.911 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.911 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.911 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.911 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.911 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.911 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.911 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.912 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.912 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.912 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.912 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.912 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.912 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.912 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.912 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.912 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.912 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.912 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.912 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.913 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.913 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.913 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.913 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.913 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.913 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.913 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.913 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.913 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.913 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.913 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.913 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.914 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.914 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.914 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.914 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.914 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.914 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.914 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.914 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.914 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.914 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools": { 2024-09-12T03:03:28.914 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools", 2024-09-12T03:03:28.914 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.914 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.915 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.915 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.915 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.915 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.915 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.915 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.915 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.915 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.915 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.915 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T03:03:28.915 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T03:03:28.915 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.916 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.916 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.916 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "300", 2024-09-12T03:03:28.916 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.916 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.916 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.916 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.916 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.916 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.916 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.916 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_interval": { 2024-09-12T03:03:28.916 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_interval", 2024-09-12T03:03:28.917 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:28.917 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.917 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.917 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15.0", 2024-09-12T03:03:28.917 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.917 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.917 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.917 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.917 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.917 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.917 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.917 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-12T03:03:28.917 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-12T03:03:28.918 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.918 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.918 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.918 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-12T03:03:28.918 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.918 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.918 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.918 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T03:03:28.918 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.918 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.918 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.918 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-12T03:03:28.918 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-12T03:03:28.919 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.919 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.919 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.919 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "9283", 2024-09-12T03:03:28.919 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.919 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.919 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.919 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T03:03:28.919 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.919 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.919 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.919 INFO:teuthology.orchestra.run.smithi018.stdout: "stale_cache_strategy": { 2024-09-12T03:03:28.920 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stale_cache_strategy", 2024-09-12T03:03:28.920 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.920 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.920 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.920 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "log", 2024-09-12T03:03:28.920 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.920 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.920 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.920 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.920 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.920 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.920 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.921 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-12T03:03:28.921 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-12T03:03:28.921 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.921 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.921 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.921 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "default", 2024-09-12T03:03:28.921 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.921 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.921 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.921 INFO:teuthology.orchestra.run.smithi018.stdout: "default", 2024-09-12T03:03:28.921 INFO:teuthology.orchestra.run.smithi018.stdout: "error" 2024-09-12T03:03:28.921 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.922 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.922 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.922 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.922 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.922 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-12T03:03:28.922 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-12T03:03:28.922 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.922 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.922 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.922 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-12T03:03:28.922 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-12T03:03:28.922 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-12T03:03:28.923 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.923 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.923 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.923 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.923 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.923 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.923 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.923 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-12T03:03:28.923 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.923 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.924 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.924 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.924 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.924 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.924 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.924 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.924 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.924 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.924 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.924 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.924 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.924 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.925 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.925 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.925 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.925 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.925 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.925 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.925 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.925 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.925 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.925 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.925 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.925 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.926 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.926 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.926 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.926 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.926 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.926 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.926 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.926 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.926 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.926 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.926 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.926 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.926 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.927 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.927 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.927 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.927 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.927 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.927 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.927 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.927 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.927 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.927 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.927 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.927 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.927 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.927 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.928 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.928 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.928 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.928 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.928 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.928 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.928 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.928 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.928 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.928 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.928 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.929 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.929 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.929 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.929 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.929 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.929 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_snap_create": { 2024-09-12T03:03:28.929 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_snap_create", 2024-09-12T03:03:28.929 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.929 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.929 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.929 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:28.929 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.929 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.930 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.930 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.930 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.930 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.930 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.930 INFO:teuthology.orchestra.run.smithi018.stdout: "mirror_snapshot_schedule": { 2024-09-12T03:03:28.930 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T03:03:28.930 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.930 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.930 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.930 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.930 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.931 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.931 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.931 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.931 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.931 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.931 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.931 INFO:teuthology.orchestra.run.smithi018.stdout: "trash_purge_schedule": { 2024-09-12T03:03:28.931 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "trash_purge_schedule", 2024-09-12T03:03:28.931 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.931 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.931 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.931 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.932 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.932 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.932 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.932 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.932 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.932 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.932 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.932 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.932 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.932 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "restful", 2024-09-12T03:03:28.932 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.932 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.933 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.933 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_auth": { 2024-09-12T03:03:28.933 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_auth", 2024-09-12T03:03:28.933 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.933 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.933 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.933 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.933 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.933 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.933 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.933 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.933 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.934 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.934 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.934 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-12T03:03:28.934 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-12T03:03:28.934 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.934 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.934 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.934 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.934 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.934 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.934 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.934 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.935 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.935 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.935 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.935 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.935 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.935 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.935 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.935 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.935 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.935 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.935 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.935 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.935 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.936 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.936 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.936 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.936 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.936 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.936 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.936 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.936 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.936 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.936 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.936 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.936 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.937 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.937 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.937 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.937 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.937 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.937 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.937 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.937 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.937 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.937 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.937 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.938 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.938 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.938 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.938 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.938 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.938 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.938 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.938 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.938 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.938 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.938 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.938 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.938 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.939 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.939 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.939 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.939 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.939 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.939 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.939 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.939 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.939 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.939 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.939 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.939 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.940 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.940 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.940 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.940 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.940 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.940 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.940 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.940 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.940 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-12T03:03:28.940 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-12T03:03:28.940 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.940 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.941 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.941 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.941 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.941 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.941 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.941 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.941 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.941 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.941 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.941 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-12T03:03:28.941 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-12T03:03:28.941 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.941 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.942 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.942 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.942 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.942 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.942 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.942 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.942 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.942 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.942 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.942 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.942 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.943 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rgw", 2024-09-12T03:03:28.943 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.943 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.943 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.943 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.943 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.943 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.943 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.943 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.943 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.943 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.943 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.944 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.944 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.944 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.944 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.944 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.944 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.944 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.944 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.944 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.944 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.944 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.944 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.945 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.945 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.945 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.945 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.945 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.945 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.945 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.945 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.945 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.945 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.945 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.945 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.945 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.946 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.946 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.946 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.946 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.946 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.946 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.946 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.946 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.946 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.946 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.946 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.946 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.946 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.947 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.947 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.947 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.947 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.947 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.947 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.947 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.947 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.947 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.947 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.947 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.947 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.948 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.948 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.948 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.948 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.948 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.948 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.948 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.948 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.948 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.948 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.949 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rook", 2024-09-12T03:03:28.949 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.949 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.949 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.949 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.949 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.949 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.949 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.949 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.949 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.949 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.949 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.950 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.950 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.950 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.950 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.950 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.950 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.950 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.950 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.950 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.950 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.950 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.950 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.951 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.951 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.951 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.951 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.951 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.951 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.951 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.951 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.951 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.951 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.951 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.951 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.952 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.952 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.952 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.952 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.952 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.952 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.952 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.952 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.952 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.952 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.952 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.952 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.953 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.953 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.953 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.953 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.953 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.953 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.953 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.953 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.953 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.953 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.953 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.954 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.954 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.954 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.954 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.954 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.954 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.954 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.954 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.954 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.954 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.954 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.954 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_class": { 2024-09-12T03:03:28.955 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "storage_class", 2024-09-12T03:03:28.955 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.955 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.955 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.955 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "local", 2024-09-12T03:03:28.955 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.955 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.955 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.955 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T03:03:28.955 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.955 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.955 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.955 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.956 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.956 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "selftest", 2024-09-12T03:03:28.956 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.956 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.956 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.956 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.956 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.956 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.956 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.956 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.956 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.957 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.957 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.957 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.957 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.957 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.957 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.957 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.957 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.957 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.957 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.957 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.957 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.957 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.957 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.958 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.958 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.958 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.958 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.958 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.958 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.958 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.958 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.958 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.958 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.958 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.958 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.959 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.959 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.959 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.959 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.959 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.959 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.959 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.959 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.959 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.959 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.959 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.959 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.959 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.960 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.960 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.960 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.960 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.960 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.960 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.960 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.960 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.960 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.960 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.960 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.960 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.961 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.961 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.961 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.961 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.961 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.961 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.961 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.961 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.961 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.961 INFO:teuthology.orchestra.run.smithi018.stdout: "roption1": { 2024-09-12T03:03:28.961 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption1", 2024-09-12T03:03:28.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.961 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.962 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.962 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.962 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.962 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.962 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.962 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.962 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.962 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.962 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.962 INFO:teuthology.orchestra.run.smithi018.stdout: "roption2": { 2024-09-12T03:03:28.962 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption2", 2024-09-12T03:03:28.962 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.962 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.962 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.963 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "xyz", 2024-09-12T03:03:28.963 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.963 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.963 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.963 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.963 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.963 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.963 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.963 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption1": { 2024-09-12T03:03:28.963 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption1", 2024-09-12T03:03:28.963 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.963 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.963 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.964 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.964 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.964 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.964 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.964 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.964 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.964 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.964 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.964 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption2": { 2024-09-12T03:03:28.964 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption2", 2024-09-12T03:03:28.964 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.964 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.964 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.965 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.965 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.965 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.965 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.965 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.965 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.965 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.965 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.965 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption3": { 2024-09-12T03:03:28.965 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption3", 2024-09-12T03:03:28.965 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:28.965 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.966 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.966 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.966 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.966 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.966 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.966 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.966 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.966 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.966 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.966 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption4": { 2024-09-12T03:03:28.966 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption4", 2024-09-12T03:03:28.966 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.966 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.967 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.967 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.967 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.967 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.967 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.967 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.967 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.967 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.967 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.967 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption5": { 2024-09-12T03:03:28.967 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption5", 2024-09-12T03:03:28.967 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.968 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.968 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.968 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.968 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.968 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.968 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.968 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.968 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.968 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.968 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.968 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption6": { 2024-09-12T03:03:28.968 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption6", 2024-09-12T03:03:28.969 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.969 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.969 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.969 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:28.969 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.969 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.969 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.969 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.969 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.969 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.969 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.969 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption7": { 2024-09-12T03:03:28.970 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption7", 2024-09-12T03:03:28.970 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:28.970 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.970 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.970 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.970 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-12T03:03:28.970 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "42", 2024-09-12T03:03:28.970 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.970 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.970 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.970 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.970 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.970 INFO:teuthology.orchestra.run.smithi018.stdout: "testkey": { 2024-09-12T03:03:28.971 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testkey", 2024-09-12T03:03:28.971 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.971 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.971 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.971 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.971 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.971 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.971 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.971 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.971 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.971 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.971 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.971 INFO:teuthology.orchestra.run.smithi018.stdout: "testlkey": { 2024-09-12T03:03:28.972 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testlkey", 2024-09-12T03:03:28.972 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.972 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.972 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.972 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.972 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.972 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.972 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.972 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.972 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.972 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.972 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.973 INFO:teuthology.orchestra.run.smithi018.stdout: "testnewline": { 2024-09-12T03:03:28.973 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testnewline", 2024-09-12T03:03:28.973 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.973 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.973 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.973 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.973 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.973 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.973 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.973 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.973 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.973 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.973 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.973 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.974 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.974 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-09-12T03:03:28.974 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.974 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.974 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.974 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_m_granularity": { 2024-09-12T03:03:28.974 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_m_granularity", 2024-09-12T03:03:28.974 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.974 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.974 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.974 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.974 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.975 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.975 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.975 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T03:03:28.975 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.975 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.975 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.975 INFO:teuthology.orchestra.run.smithi018.stdout: "dump_on_update": { 2024-09-12T03:03:28.975 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dump_on_update", 2024-09-12T03:03:28.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.975 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.975 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.975 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.975 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.976 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.976 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.976 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "dump database to debug log on update", 2024-09-12T03:03:28.976 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.976 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.976 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.976 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.976 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.976 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.976 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.976 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.976 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.977 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.977 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.977 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.977 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.977 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.977 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.977 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.977 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.977 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.977 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.977 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.977 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.977 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.977 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.978 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.978 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.978 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.978 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.978 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.978 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.978 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.978 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.978 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.978 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.978 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.978 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.979 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.979 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.979 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.979 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.979 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.979 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.979 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.979 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.979 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.979 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.979 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.979 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.979 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.980 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.980 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.980 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.980 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.980 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.980 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.980 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.980 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.980 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.980 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.980 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.980 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.981 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.981 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.981 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.981 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.981 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.981 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.981 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.981 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.981 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.981 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.981 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stats", 2024-09-12T03:03:28.982 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.982 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.982 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.982 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.982 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.982 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.982 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.982 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.982 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.982 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.982 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.982 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.982 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.982 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.983 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.983 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.983 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.983 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.983 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.983 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.983 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.983 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.983 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.983 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.983 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.984 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.984 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.984 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.984 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.984 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.984 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.984 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.984 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.984 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.984 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.984 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.984 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.985 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.985 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.985 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.985 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.985 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.985 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.985 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.985 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.985 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.985 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.985 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.985 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.985 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.986 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.986 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.986 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.986 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.986 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.986 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.986 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.986 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.986 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.986 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.986 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.986 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.987 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.987 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.987 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.987 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.987 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.987 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.987 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.987 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.987 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "status", 2024-09-12T03:03:28.987 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.987 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.987 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.988 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.988 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.988 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.988 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.988 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.988 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.988 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.988 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.988 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.988 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.988 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.988 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.988 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.989 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.989 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.989 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.989 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.989 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.989 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.989 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.989 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.989 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.989 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.989 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.989 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.989 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.990 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.990 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.990 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.990 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.990 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.990 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.990 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.990 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.990 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.990 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.990 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.990 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.990 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.991 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.991 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.991 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.991 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.991 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.991 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.991 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.991 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.991 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.991 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.991 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.991 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.991 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.992 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.992 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:28.992 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:28.992 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.992 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.992 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.992 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.992 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.992 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.992 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.992 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.992 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.992 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.993 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.993 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.993 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:28.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:28.993 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telegraf", 2024-09-12T03:03:28.993 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:28.993 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:28.993 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:28.993 INFO:teuthology.orchestra.run.smithi018.stdout: "address": { 2024-09-12T03:03:28.993 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "address", 2024-09-12T03:03:28.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.993 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.994 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.994 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T03:03:28.994 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.994 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.994 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.994 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.994 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.994 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.994 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.994 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-12T03:03:28.994 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-12T03:03:28.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:28.994 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.995 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:28.995 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15", 2024-09-12T03:03:28.995 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.995 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.995 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.995 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.995 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.995 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.995 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.995 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:28.995 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:28.996 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.996 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.996 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.996 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:28.996 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.996 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.996 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.996 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.996 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.996 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.996 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.996 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.996 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.997 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.997 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.997 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.997 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.997 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.997 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:28.997 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:28.997 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:28.997 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.997 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.997 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:28.998 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.998 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.998 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:28.998 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:28.998 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:28.998 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:28.998 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:28.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:28.998 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:28.998 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:28.998 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:28.998 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:28.998 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:28.999 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:28.999 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:28.999 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:28.999 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:28.999 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:28.999 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:28.999 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:28.999 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:28.999 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:28.999 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:28.999 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:28.999 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.000 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.000 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.000 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.000 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.000 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.000 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.000 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.000 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.000 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.000 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.000 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.000 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.001 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.001 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.001 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.001 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.001 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.001 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.001 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telemetry", 2024-09-12T03:03:29.001 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.001 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.001 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.001 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_basic": { 2024-09-12T03:03:29.002 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_basic", 2024-09-12T03:03:29.002 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.002 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.002 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.002 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.002 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.002 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.002 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.002 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T03:03:29.002 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.002 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.002 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.003 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_crash": { 2024-09-12T03:03:29.003 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_crash", 2024-09-12T03:03:29.003 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.003 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.003 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.003 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.003 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.003 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.003 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.003 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T03:03:29.003 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.003 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.004 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.004 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_device": { 2024-09-12T03:03:29.004 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_device", 2024-09-12T03:03:29.004 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.004 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.004 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.004 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.004 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.004 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.004 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.004 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T03:03:29.005 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.005 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.005 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.005 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_ident": { 2024-09-12T03:03:29.005 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_ident", 2024-09-12T03:03:29.005 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.005 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.005 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.005 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.006 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.006 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.006 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.006 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T03:03:29.006 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.006 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.006 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.006 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_perf": { 2024-09-12T03:03:29.006 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_perf", 2024-09-12T03:03:29.006 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.006 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.006 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.006 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.007 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.007 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.007 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.007 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T03:03:29.007 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.007 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.007 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.007 INFO:teuthology.orchestra.run.smithi018.stdout: "contact": { 2024-09-12T03:03:29.007 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "contact", 2024-09-12T03:03:29.007 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.007 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.007 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.007 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.008 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.008 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.008 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.008 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.008 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.008 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.008 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.008 INFO:teuthology.orchestra.run.smithi018.stdout: "description": { 2024-09-12T03:03:29.008 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "description", 2024-09-12T03:03:29.008 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.008 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.008 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.009 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.009 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.009 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.009 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.009 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.009 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.009 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.009 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.009 INFO:teuthology.orchestra.run.smithi018.stdout: "device_url": { 2024-09-12T03:03:29.009 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_url", 2024-09-12T03:03:29.009 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.009 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.010 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.010 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T03:03:29.010 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.010 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.010 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.010 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.010 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.010 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.010 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.010 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-12T03:03:29.010 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-12T03:03:29.010 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.010 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.011 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.011 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.011 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.011 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.011 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.011 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.011 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.011 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.011 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.011 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-12T03:03:29.011 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-12T03:03:29.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.011 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.012 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.012 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "24", 2024-09-12T03:03:29.012 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "8", 2024-09-12T03:03:29.012 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.012 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.012 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.012 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.012 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.012 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.012 INFO:teuthology.orchestra.run.smithi018.stdout: "last_opt_revision": { 2024-09-12T03:03:29.012 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "last_opt_revision", 2024-09-12T03:03:29.012 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.013 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.013 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.013 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1", 2024-09-12T03:03:29.013 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.013 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.013 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.013 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.013 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.013 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.013 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.013 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard": { 2024-09-12T03:03:29.013 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard", 2024-09-12T03:03:29.014 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.014 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.014 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.014 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.014 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.014 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.014 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.014 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.014 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.014 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.014 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.015 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard_description": { 2024-09-12T03:03:29.015 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard_description", 2024-09-12T03:03:29.015 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.015 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.015 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.015 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.015 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.015 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.015 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.015 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.015 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.015 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.015 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.016 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.016 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.016 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.016 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.016 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.016 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.016 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.016 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.016 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.016 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.016 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.016 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.016 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.017 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.017 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.017 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.017 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.017 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.017 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.017 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.017 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.017 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.017 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.017 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.018 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.018 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.018 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.018 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.018 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.018 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.018 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.018 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.018 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.018 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.018 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.018 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.018 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.019 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.019 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.019 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.019 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.019 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.019 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.019 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.019 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.019 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.019 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.019 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.019 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.019 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.019 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.020 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.020 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.020 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.020 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.020 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.020 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.020 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.020 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.020 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.020 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.020 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.020 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.021 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.021 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.021 INFO:teuthology.orchestra.run.smithi018.stdout: "organization": { 2024-09-12T03:03:29.021 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "organization", 2024-09-12T03:03:29.021 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.021 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.021 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.021 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.021 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.021 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.021 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.021 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.021 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.022 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.022 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.022 INFO:teuthology.orchestra.run.smithi018.stdout: "proxy": { 2024-09-12T03:03:29.022 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "proxy", 2024-09-12T03:03:29.022 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.022 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.022 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.022 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.022 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.022 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.022 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.022 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.022 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.023 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.023 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.023 INFO:teuthology.orchestra.run.smithi018.stdout: "url": { 2024-09-12T03:03:29.023 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url", 2024-09-12T03:03:29.023 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.023 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.023 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.023 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T03:03:29.023 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.023 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.023 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.023 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.023 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.024 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.024 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.024 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.024 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.024 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test_orchestrator", 2024-09-12T03:03:29.024 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.024 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.024 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.024 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.024 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.024 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.025 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.025 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.025 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.025 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.025 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.025 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.025 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.025 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.025 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.025 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.025 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.025 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.025 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.026 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.026 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.026 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.026 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.026 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.026 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.026 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.026 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.026 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.026 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.026 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.026 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.026 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.027 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.027 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.027 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.027 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.027 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.027 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.027 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.027 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.027 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.027 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.027 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.027 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.028 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.028 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.028 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.028 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.028 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.028 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.028 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.028 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.028 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.028 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.028 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.028 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.029 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.029 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.029 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.029 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.029 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.029 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.029 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.029 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.029 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.029 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.029 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.029 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.029 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.030 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.030 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-12T03:03:29.030 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.030 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.030 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.030 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.030 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.030 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.030 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.030 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.030 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.030 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.031 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.031 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.031 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.031 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.031 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.031 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.031 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.031 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.031 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.031 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.031 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.031 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.031 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.032 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.032 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.032 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.032 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.032 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.032 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.032 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.032 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.032 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.032 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.032 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.032 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.033 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.033 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.033 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.033 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.033 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.033 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.036 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.036 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.036 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.036 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.036 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.036 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.036 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.036 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.037 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.037 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.037 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.037 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.037 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.037 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.037 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.037 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.037 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.037 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.037 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.037 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.037 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.038 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.038 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.038 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.038 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.038 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.038 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.038 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.038 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_clones": { 2024-09-12T03:03:29.038 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_clones", 2024-09-12T03:03:29.038 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.038 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.039 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.039 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4", 2024-09-12T03:03:29.039 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.039 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.039 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.039 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T03:03:29.039 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.039 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.039 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.039 INFO:teuthology.orchestra.run.smithi018.stdout: "periodic_async_work": { 2024-09-12T03:03:29.039 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "periodic_async_work", 2024-09-12T03:03:29.039 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.040 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.040 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.040 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.040 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.040 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.040 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.040 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Periodically check for async work", 2024-09-12T03:03:29.040 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.040 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.040 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.040 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_delay": { 2024-09-12T03:03:29.040 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_delay", 2024-09-12T03:03:29.041 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.041 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.041 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.041 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-12T03:03:29.041 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.041 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.041 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.041 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T03:03:29.041 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.041 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.041 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.042 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_no_wait": { 2024-09-12T03:03:29.042 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T03:03:29.042 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.042 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.042 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.042 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.042 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.042 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.042 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.042 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T03:03:29.042 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.042 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.042 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.043 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix", 2024-09-12T03:03:29.043 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.043 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.043 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.043 INFO:teuthology.orchestra.run.smithi018.stdout: "discovery_interval": { 2024-09-12T03:03:29.043 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "discovery_interval", 2024-09-12T03:03:29.043 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-12T03:03:29.043 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.043 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.044 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "100", 2024-09-12T03:03:29.044 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.044 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.044 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.044 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.044 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.044 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.044 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.044 INFO:teuthology.orchestra.run.smithi018.stdout: "identifier": { 2024-09-12T03:03:29.044 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "identifier", 2024-09-12T03:03:29.044 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.045 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.045 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.045 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.045 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.045 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.045 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.045 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.045 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.045 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.045 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.045 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-12T03:03:29.046 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-12T03:03:29.046 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.046 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.046 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.046 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-12T03:03:29.046 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.046 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.046 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.046 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.046 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.046 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.046 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.047 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.047 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.047 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.047 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.047 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.047 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.047 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.047 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.047 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.047 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.047 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.047 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.048 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.048 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.048 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.048 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.048 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.048 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.048 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.048 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.048 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.048 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.048 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.049 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.049 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.049 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.049 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.049 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.049 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.049 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.049 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.049 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.049 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.049 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.050 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.050 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.050 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.050 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.050 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.050 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.050 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.050 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.050 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.050 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.050 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.050 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.050 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.050 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.051 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.051 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.051 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.051 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.051 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.051 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.051 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.051 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.051 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.051 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.051 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.051 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.051 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.052 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.052 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.052 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.052 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.052 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.052 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_host": { 2024-09-12T03:03:29.052 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_host", 2024-09-12T03:03:29.052 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.052 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.052 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.052 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.052 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.053 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.053 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.053 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.053 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.053 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.053 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.053 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_port": { 2024-09-12T03:03:29.053 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_port", 2024-09-12T03:03:29.053 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.053 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.053 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.053 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10051", 2024-09-12T03:03:29.054 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.054 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.054 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.054 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.054 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.054 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.054 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.054 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_sender": { 2024-09-12T03:03:29.054 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_sender", 2024-09-12T03:03:29.054 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.054 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.054 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.055 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T03:03:29.055 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.055 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.055 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.055 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.055 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.055 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.055 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.055 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.055 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.055 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.055 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-12T03:03:29.055 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.055 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.056 INFO:teuthology.orchestra.run.smithi018.stdout: "modules": [ 2024-09-12T03:03:29.056 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-12T03:03:29.056 INFO:teuthology.orchestra.run.smithi018.stdout: "dashboard", 2024-09-12T03:03:29.056 INFO:teuthology.orchestra.run.smithi018.stdout: "iostat", 2024-09-12T03:03:29.056 INFO:teuthology.orchestra.run.smithi018.stdout: "nfs", 2024-09-12T03:03:29.056 INFO:teuthology.orchestra.run.smithi018.stdout: "restful", 2024-09-12T03:03:29.056 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_schedule" 2024-09-12T03:03:29.056 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.056 INFO:teuthology.orchestra.run.smithi018.stdout: "available_modules": [ 2024-09-12T03:03:29.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.056 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "alerts", 2024-09-12T03:03:29.056 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.056 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.056 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.057 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-12T03:03:29.057 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-12T03:03:29.057 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.057 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.057 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.057 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-12T03:03:29.057 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.057 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.057 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.057 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T03:03:29.057 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.057 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.058 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.058 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.058 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.058 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.058 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.058 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.058 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.058 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.058 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.058 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.058 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.059 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.059 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.059 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.059 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.059 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.059 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.059 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.059 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.059 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.059 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.059 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.059 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.059 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.060 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.060 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.060 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.060 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.060 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.060 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.060 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.060 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.060 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.060 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.060 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.060 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.061 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.061 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.061 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.061 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.061 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.061 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.061 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.061 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.061 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.061 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.061 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.061 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.062 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.062 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.062 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.062 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.062 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.062 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.062 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.062 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.062 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.062 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.062 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.062 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.062 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.063 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.063 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.063 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.063 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.063 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.063 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.063 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_destination": { 2024-09-12T03:03:29.063 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_destination", 2024-09-12T03:03:29.063 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.063 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.063 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.063 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.063 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.064 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.064 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.064 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email address to send alerts to", 2024-09-12T03:03:29.064 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.064 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.064 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.064 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_from_name": { 2024-09-12T03:03:29.064 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_from_name", 2024-09-12T03:03:29.064 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.064 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.064 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.064 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "Ceph", 2024-09-12T03:03:29.065 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.065 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.065 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.065 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email From: name", 2024-09-12T03:03:29.065 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.065 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.065 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.065 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_host": { 2024-09-12T03:03:29.065 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_host", 2024-09-12T03:03:29.065 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.065 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.065 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.066 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.066 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.066 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.066 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.066 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP server", 2024-09-12T03:03:29.066 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.066 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.066 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.066 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_password": { 2024-09-12T03:03:29.066 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_password", 2024-09-12T03:03:29.066 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.067 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.067 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.067 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.067 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.067 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.067 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.067 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Password to authenticate with", 2024-09-12T03:03:29.067 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.067 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.067 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.067 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_port": { 2024-09-12T03:03:29.067 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_port", 2024-09-12T03:03:29.068 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.068 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.068 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.068 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "465", 2024-09-12T03:03:29.068 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.068 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.068 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.068 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP port", 2024-09-12T03:03:29.068 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.068 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.068 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.068 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_sender": { 2024-09-12T03:03:29.069 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_sender", 2024-09-12T03:03:29.069 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.069 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.069 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.069 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.069 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.069 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.069 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.069 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP envelope sender", 2024-09-12T03:03:29.069 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.069 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.069 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.070 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_ssl": { 2024-09-12T03:03:29.070 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_ssl", 2024-09-12T03:03:29.070 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.070 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.070 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.070 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.070 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.070 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.070 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.070 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T03:03:29.070 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.070 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.070 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.071 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_user": { 2024-09-12T03:03:29.071 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_user", 2024-09-12T03:03:29.071 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.071 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.071 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.071 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.071 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.071 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.071 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.071 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "User to authenticate as", 2024-09-12T03:03:29.071 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.071 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.071 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.072 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.072 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.072 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "balancer", 2024-09-12T03:03:29.072 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.072 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.072 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.072 INFO:teuthology.orchestra.run.smithi018.stdout: "active": { 2024-09-12T03:03:29.072 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "active", 2024-09-12T03:03:29.072 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.072 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.072 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.072 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.073 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.073 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.073 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.073 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T03:03:29.073 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.073 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.073 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.073 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_time": { 2024-09-12T03:03:29.073 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_time", 2024-09-12T03:03:29.073 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.073 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.073 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.073 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0000", 2024-09-12T03:03:29.074 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.074 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.074 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.074 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T03:03:29.074 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T03:03:29.074 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.074 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.074 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_weekday": { 2024-09-12T03:03:29.074 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_weekday", 2024-09-12T03:03:29.074 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-12T03:03:29.074 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.075 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.075 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-12T03:03:29.075 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-12T03:03:29.075 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-12T03:03:29.075 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.075 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T03:03:29.075 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T03:03:29.075 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.075 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.075 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_max_iterations": { 2024-09-12T03:03:29.075 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_max_iterations", 2024-09-12T03:03:29.075 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-12T03:03:29.076 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.076 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.076 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "25", 2024-09-12T03:03:29.076 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-12T03:03:29.076 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "250", 2024-09-12T03:03:29.076 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.076 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T03:03:29.076 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.076 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.076 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.076 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_metrics": { 2024-09-12T03:03:29.076 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_metrics", 2024-09-12T03:03:29.077 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.077 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.077 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.077 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T03:03:29.077 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.077 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.077 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.077 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T03:03:29.077 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T03:03:29.077 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.077 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.077 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_step": { 2024-09-12T03:03:29.078 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_step", 2024-09-12T03:03:29.078 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:29.078 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.078 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.078 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.5", 2024-09-12T03:03:29.078 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0.001", 2024-09-12T03:03:29.078 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "0.999", 2024-09-12T03:03:29.078 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.078 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "aggressiveness of optimization", 2024-09-12T03:03:29.078 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T03:03:29.078 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.078 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.078 INFO:teuthology.orchestra.run.smithi018.stdout: "end_time": { 2024-09-12T03:03:29.079 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_time", 2024-09-12T03:03:29.079 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.079 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.079 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.079 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2359", 2024-09-12T03:03:29.079 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.079 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.079 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.079 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T03:03:29.079 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T03:03:29.079 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.079 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.080 INFO:teuthology.orchestra.run.smithi018.stdout: "end_weekday": { 2024-09-12T03:03:29.080 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_weekday", 2024-09-12T03:03:29.080 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-12T03:03:29.080 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.080 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.080 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-12T03:03:29.080 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-12T03:03:29.080 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-12T03:03:29.080 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.080 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T03:03:29.080 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T03:03:29.080 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.080 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.081 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.081 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.081 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.081 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.081 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.081 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.081 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.081 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.081 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.081 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.081 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.081 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.082 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.082 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.082 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.082 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.082 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.082 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.082 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.082 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.082 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.082 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.082 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.082 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.083 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.083 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.083 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.083 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.083 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.083 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.083 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.083 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.083 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.083 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.083 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.083 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.084 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.084 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.084 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.084 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.084 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.084 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.084 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.084 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.084 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.084 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.084 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.084 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.084 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.085 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.085 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.085 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.085 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.085 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.085 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.085 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.085 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.085 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.085 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.085 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.085 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.085 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.086 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.086 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.086 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.086 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.086 INFO:teuthology.orchestra.run.smithi018.stdout: "min_score": { 2024-09-12T03:03:29.086 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_score", 2024-09-12T03:03:29.086 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:29.086 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.086 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.086 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-12T03:03:29.086 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.086 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.087 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.087 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T03:03:29.087 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.087 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.087 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.087 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-12T03:03:29.087 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-12T03:03:29.087 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.087 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.087 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.087 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "upmap", 2024-09-12T03:03:29.087 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.088 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.088 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.088 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-compat", 2024-09-12T03:03:29.088 INFO:teuthology.orchestra.run.smithi018.stdout: "none", 2024-09-12T03:03:29.088 INFO:teuthology.orchestra.run.smithi018.stdout: "read", 2024-09-12T03:03:29.088 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap", 2024-09-12T03:03:29.088 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap-read" 2024-09-12T03:03:29.088 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.088 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Balancer mode", 2024-09-12T03:03:29.088 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.088 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.088 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.088 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_ids": { 2024-09-12T03:03:29.089 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_ids", 2024-09-12T03:03:29.089 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.089 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.089 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.089 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.089 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.089 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.089 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.089 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T03:03:29.089 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.089 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.089 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.090 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-12T03:03:29.090 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-12T03:03:29.090 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.090 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.090 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.090 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-12T03:03:29.090 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.090 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.090 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.090 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T03:03:29.090 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.090 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.090 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.091 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_deviation": { 2024-09-12T03:03:29.091 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_deviation", 2024-09-12T03:03:29.091 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.091 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.091 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.091 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-12T03:03:29.091 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-12T03:03:29.091 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.091 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.091 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T03:03:29.091 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T03:03:29.091 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.092 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.092 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_optimizations": { 2024-09-12T03:03:29.092 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_optimizations", 2024-09-12T03:03:29.092 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-12T03:03:29.092 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.092 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.092 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:29.092 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.092 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.092 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.092 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T03:03:29.092 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.093 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.093 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.093 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm", 2024-09-12T03:03:29.093 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.093 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.093 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.093 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_down_multiplier": { 2024-09-12T03:03:29.093 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_down_multiplier", 2024-09-12T03:03:29.093 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:29.094 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.094 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.094 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-12T03:03:29.094 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.094 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.094 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.094 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T03:03:29.094 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.094 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.094 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.094 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_refresh_rate": { 2024-09-12T03:03:29.094 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_refresh_rate", 2024-09-12T03:03:29.095 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.095 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.095 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.095 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "20", 2024-09-12T03:03:29.095 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.095 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.095 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.095 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T03:03:29.095 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.095 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.095 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_starting_port": { 2024-09-12T03:03:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_starting_port", 2024-09-12T03:03:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4721", 2024-09-12T03:03:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T03:03:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.097 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.097 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_ptrace": { 2024-09-12T03:03:29.097 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_ptrace", 2024-09-12T03:03:29.097 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.097 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.097 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.097 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.097 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.097 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.097 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.097 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T03:03:29.097 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T03:03:29.098 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.098 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.098 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_interval": { 2024-09-12T03:03:29.098 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_interval", 2024-09-12T03:03:29.098 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.098 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.098 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.098 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-12T03:03:29.098 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.098 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.098 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.098 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T03:03:29.098 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.099 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.099 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.099 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_memory_target_ratio": { 2024-09-12T03:03:29.099 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T03:03:29.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:29.099 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.099 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.099 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.7", 2024-09-12T03:03:29.099 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.099 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.099 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.099 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T03:03:29.100 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.100 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.100 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.100 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm_log_destination": { 2024-09-12T03:03:29.100 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm_log_destination", 2024-09-12T03:03:29.100 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.100 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.100 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.100 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.100 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.100 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.100 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.100 INFO:teuthology.orchestra.run.smithi018.stdout: "file", 2024-09-12T03:03:29.101 INFO:teuthology.orchestra.run.smithi018.stdout: "file,syslog", 2024-09-12T03:03:29.101 INFO:teuthology.orchestra.run.smithi018.stdout: "syslog" 2024-09-12T03:03:29.101 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.101 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T03:03:29.101 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.101 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.101 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.101 INFO:teuthology.orchestra.run.smithi018.stdout: "cgroups_split": { 2024-09-12T03:03:29.101 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cgroups_split", 2024-09-12T03:03:29.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.101 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.101 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.102 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.102 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.102 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.102 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.102 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T03:03:29.102 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.102 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.102 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.102 INFO:teuthology.orchestra.run.smithi018.stdout: "config_checks_enabled": { 2024-09-12T03:03:29.102 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_checks_enabled", 2024-09-12T03:03:29.102 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.102 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.102 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.103 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.103 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.103 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.103 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.103 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T03:03:29.103 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.103 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.103 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.103 INFO:teuthology.orchestra.run.smithi018.stdout: "config_dashboard": { 2024-09-12T03:03:29.103 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_dashboard", 2024-09-12T03:03:29.103 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.103 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.103 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.104 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.104 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.104 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.104 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.104 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T03:03:29.104 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.104 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.104 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.104 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_alertmanager": { 2024-09-12T03:03:29.104 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_alertmanager", 2024-09-12T03:03:29.104 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.104 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.105 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.105 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T03:03:29.105 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.105 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.105 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.105 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-12T03:03:29.105 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.105 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.105 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.105 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_base": { 2024-09-12T03:03:29.105 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_base", 2024-09-12T03:03:29.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.106 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.106 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.106 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T03:03:29.106 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.106 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.106 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.106 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Container image name, without the tag", 2024-09-12T03:03:29.106 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.106 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.106 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.106 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_elasticsearch": { 2024-09-12T03:03:29.107 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_elasticsearch", 2024-09-12T03:03:29.107 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.107 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.107 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.107 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T03:03:29.107 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.107 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.107 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.107 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "elasticsearch container image", 2024-09-12T03:03:29.107 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.107 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.107 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.108 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_grafana": { 2024-09-12T03:03:29.108 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_grafana", 2024-09-12T03:03:29.108 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.108 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.108 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.108 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T03:03:29.108 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.108 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.108 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.108 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-12T03:03:29.108 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.108 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.109 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.109 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_haproxy": { 2024-09-12T03:03:29.109 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_haproxy", 2024-09-12T03:03:29.109 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.109 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.109 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.109 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T03:03:29.109 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.109 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.109 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.109 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "HAproxy container image", 2024-09-12T03:03:29.109 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.110 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.110 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.110 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_agent": { 2024-09-12T03:03:29.110 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_agent", 2024-09-12T03:03:29.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.110 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.110 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.110 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T03:03:29.110 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.110 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.110 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.110 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger agent container image", 2024-09-12T03:03:29.111 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.111 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.111 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.111 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_collector": { 2024-09-12T03:03:29.111 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_collector", 2024-09-12T03:03:29.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.111 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.111 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.111 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T03:03:29.111 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.111 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.111 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.112 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger collector container image", 2024-09-12T03:03:29.112 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.112 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.112 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.112 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_query": { 2024-09-12T03:03:29.112 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_query", 2024-09-12T03:03:29.112 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.112 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.112 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.112 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T03:03:29.112 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.112 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.113 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.113 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger query container image", 2024-09-12T03:03:29.113 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.113 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.113 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.113 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_keepalived": { 2024-09-12T03:03:29.113 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_keepalived", 2024-09-12T03:03:29.113 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.113 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.113 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.113 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T03:03:29.114 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.114 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.114 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.114 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Keepalived container image", 2024-09-12T03:03:29.114 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.114 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.114 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.114 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_loki": { 2024-09-12T03:03:29.114 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_loki", 2024-09-12T03:03:29.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.114 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.114 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.115 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T03:03:29.115 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.115 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.115 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.115 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Loki container image", 2024-09-12T03:03:29.115 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.115 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.115 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.115 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_node_exporter": { 2024-09-12T03:03:29.115 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_node_exporter", 2024-09-12T03:03:29.115 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.116 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.116 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.116 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T03:03:29.116 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.116 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.116 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.116 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-12T03:03:29.116 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.116 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.116 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.117 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nvmeof": { 2024-09-12T03:03:29.117 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nvmeof", 2024-09-12T03:03:29.117 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.117 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.117 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.117 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T03:03:29.117 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.117 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.117 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.117 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nvme-of container image", 2024-09-12T03:03:29.118 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.118 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.118 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.118 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_prometheus": { 2024-09-12T03:03:29.118 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_prometheus", 2024-09-12T03:03:29.118 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.118 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.118 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.118 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T03:03:29.118 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.119 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.119 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.119 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-12T03:03:29.119 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.119 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.119 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.119 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_promtail": { 2024-09-12T03:03:29.119 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_promtail", 2024-09-12T03:03:29.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.119 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.119 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.119 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T03:03:29.120 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.120 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.120 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.120 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Promtail container image", 2024-09-12T03:03:29.120 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.120 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.120 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.120 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_samba": { 2024-09-12T03:03:29.120 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_samba", 2024-09-12T03:03:29.120 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.121 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.121 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.121 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T03:03:29.121 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.121 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.121 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.121 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Samba/SMB container image", 2024-09-12T03:03:29.121 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.121 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.121 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.121 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_snmp_gateway": { 2024-09-12T03:03:29.122 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_snmp_gateway", 2024-09-12T03:03:29.122 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.122 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.122 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.122 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T03:03:29.122 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.122 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.122 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.122 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SNMP Gateway container image", 2024-09-12T03:03:29.122 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.122 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.123 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.123 INFO:teuthology.orchestra.run.smithi018.stdout: "container_init": { 2024-09-12T03:03:29.123 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_init", 2024-09-12T03:03:29.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.123 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.123 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.123 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.123 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.123 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.124 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.124 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T03:03:29.124 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.124 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.124 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.124 INFO:teuthology.orchestra.run.smithi018.stdout: "daemon_cache_timeout": { 2024-09-12T03:03:29.124 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "daemon_cache_timeout", 2024-09-12T03:03:29.124 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.124 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.124 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.124 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-12T03:03:29.125 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.125 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.125 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.125 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T03:03:29.125 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.125 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.125 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.125 INFO:teuthology.orchestra.run.smithi018.stdout: "default_cephadm_command_timeout": { 2024-09-12T03:03:29.125 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T03:03:29.125 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.125 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.125 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.125 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "900", 2024-09-12T03:03:29.126 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.126 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.126 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.126 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T03:03:29.126 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.126 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.126 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.126 INFO:teuthology.orchestra.run.smithi018.stdout: "default_registry": { 2024-09-12T03:03:29.126 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_registry", 2024-09-12T03:03:29.126 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.126 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.126 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.127 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io", 2024-09-12T03:03:29.127 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.127 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.127 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.127 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T03:03:29.127 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.127 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.127 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.127 INFO:teuthology.orchestra.run.smithi018.stdout: "device_cache_timeout": { 2024-09-12T03:03:29.127 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_cache_timeout", 2024-09-12T03:03:29.127 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.128 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.128 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.128 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1800", 2024-09-12T03:03:29.128 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.128 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.128 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.128 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache device inventory", 2024-09-12T03:03:29.128 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.128 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.129 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.129 INFO:teuthology.orchestra.run.smithi018.stdout: "device_enhanced_scan": { 2024-09-12T03:03:29.129 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_enhanced_scan", 2024-09-12T03:03:29.129 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.129 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.129 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.129 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.129 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.129 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.130 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.130 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T03:03:29.130 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.130 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.130 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.130 INFO:teuthology.orchestra.run.smithi018.stdout: "facts_cache_timeout": { 2024-09-12T03:03:29.130 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "facts_cache_timeout", 2024-09-12T03:03:29.130 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.130 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.131 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.131 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-12T03:03:29.131 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.131 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.131 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.131 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache host facts data", 2024-09-12T03:03:29.131 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.131 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.131 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.131 INFO:teuthology.orchestra.run.smithi018.stdout: "grafana_dashboards_path": { 2024-09-12T03:03:29.131 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "grafana_dashboards_path", 2024-09-12T03:03:29.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.132 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.132 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.132 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T03:03:29.132 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.132 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.132 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.132 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T03:03:29.132 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.132 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.132 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.132 INFO:teuthology.orchestra.run.smithi018.stdout: "host_check_interval": { 2024-09-12T03:03:29.132 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "host_check_interval", 2024-09-12T03:03:29.133 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.133 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.133 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.133 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-12T03:03:29.133 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.133 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.133 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.133 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to perform a host check", 2024-09-12T03:03:29.133 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.133 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.133 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.133 INFO:teuthology.orchestra.run.smithi018.stdout: "hw_monitoring": { 2024-09-12T03:03:29.134 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hw_monitoring", 2024-09-12T03:03:29.134 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.134 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.134 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.134 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.134 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.134 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.134 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.134 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T03:03:29.135 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.135 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.135 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.135 INFO:teuthology.orchestra.run.smithi018.stdout: "inventory_list_all": { 2024-09-12T03:03:29.135 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "inventory_list_all", 2024-09-12T03:03:29.135 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.135 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.135 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.135 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.135 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.136 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.136 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.136 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T03:03:29.136 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.136 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.136 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.136 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.136 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.136 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.136 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.136 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.137 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.137 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.137 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.137 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.137 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.137 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.137 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.137 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.137 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.137 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.137 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.137 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.137 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.137 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.138 INFO:teuthology.orchestra.run.smithi018.stdout: "log_refresh_metadata": { 2024-09-12T03:03:29.138 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_refresh_metadata", 2024-09-12T03:03:29.138 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.138 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.138 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.138 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.138 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.138 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.138 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.138 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T03:03:29.138 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.138 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.139 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.139 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.139 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.139 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.139 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.139 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.139 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.139 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.139 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.139 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.139 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T03:03:29.139 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.139 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.140 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.140 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.140 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.140 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.140 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.140 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.140 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.140 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.140 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.140 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.140 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.140 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.141 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.141 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.141 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.141 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.141 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.141 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.141 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.141 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.141 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.141 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.141 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.141 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.142 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.142 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.142 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.142 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.142 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.142 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.142 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.142 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.142 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.142 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.142 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T03:03:29.142 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T03:03:29.142 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.143 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.143 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.143 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.143 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.143 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.143 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.143 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T03:03:29.143 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.143 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.143 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.143 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T03:03:29.143 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T03:03:29.144 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.144 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.144 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.144 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "*", 2024-09-12T03:03:29.144 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.144 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.144 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.144 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T03:03:29.144 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.144 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.144 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.144 INFO:teuthology.orchestra.run.smithi018.stdout: "max_count_per_host": { 2024-09-12T03:03:29.144 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_count_per_host", 2024-09-12T03:03:29.145 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.145 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.145 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.145 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:29.145 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.145 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.145 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.145 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of daemons per service per host", 2024-09-12T03:03:29.145 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.145 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.145 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.145 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd_draining_count": { 2024-09-12T03:03:29.146 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_osd_draining_count", 2024-09-12T03:03:29.146 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.146 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.146 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.146 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:29.146 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.146 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.146 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.146 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T03:03:29.146 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.146 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.146 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: "migration_current": { 2024-09-12T03:03:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "migration_current", 2024-09-12T03:03:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "internal - do not modify", 2024-09-12T03:03:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-12T03:03:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-12T03:03:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "root", 2024-09-12T03:03:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm-package", 2024-09-12T03:03:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: "root" 2024-09-12T03:03:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T03:03:29.148 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: "oob_default_addr": { 2024-09-12T03:03:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "oob_default_addr", 2024-09-12T03:03:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "169.254.1.1", 2024-09-12T03:03:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T03:03:29.149 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: "prometheus_alerts_path": { 2024-09-12T03:03:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus_alerts_path", 2024-09-12T03:03:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T03:03:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.150 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T03:03:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_insecure": { 2024-09-12T03:03:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_insecure", 2024-09-12T03:03:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.151 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T03:03:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_password": { 2024-09-12T03:03:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_password", 2024-09-12T03:03:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.152 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T03:03:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_url": { 2024-09-12T03:03:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_url", 2024-09-12T03:03:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.153 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T03:03:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_username": { 2024-09-12T03:03:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_username", 2024-09-12T03:03:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.154 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T03:03:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: "secure_monitoring_stack": { 2024-09-12T03:03:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secure_monitoring_stack", 2024-09-12T03:03:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.155 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T03:03:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: "service_discovery_port": { 2024-09-12T03:03:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "service_discovery_port", 2024-09-12T03:03:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.156 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8765", 2024-09-12T03:03:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "cephadm service discovery port", 2024-09-12T03:03:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_config_file": { 2024-09-12T03:03:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_config_file", 2024-09-12T03:03:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.157 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T03:03:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: "use_agent": { 2024-09-12T03:03:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_agent", 2024-09-12T03:03:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.158 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T03:03:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: "use_repo_digest": { 2024-09-12T03:03:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_repo_digest", 2024-09-12T03:03:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.159 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.160 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.160 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.160 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.160 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.160 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T03:03:29.160 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.160 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.160 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.160 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_failed_host_check": { 2024-09-12T03:03:29.160 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_failed_host_check", 2024-09-12T03:03:29.160 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.161 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.161 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.161 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.161 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.161 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.161 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.161 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T03:03:29.161 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.161 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.161 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.161 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_daemons": { 2024-09-12T03:03:29.161 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_daemons", 2024-09-12T03:03:29.161 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.162 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.162 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.162 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.162 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.162 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.162 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.162 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T03:03:29.162 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.162 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.162 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.162 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_hosts": { 2024-09-12T03:03:29.162 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_hosts", 2024-09-12T03:03:29.162 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.163 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.163 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.163 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.163 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.163 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.163 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.163 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T03:03:29.163 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.163 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.163 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.164 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crash", 2024-09-12T03:03:29.164 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.164 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.164 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.164 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.164 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.164 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.164 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.164 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.164 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.164 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.164 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.164 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.165 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.165 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.165 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.165 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.165 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.165 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.165 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.165 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.165 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.165 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.165 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.165 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.166 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.166 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.166 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.166 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.166 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.166 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.166 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.166 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.166 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.166 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.166 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.166 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.166 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.167 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.167 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.167 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.167 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.167 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.167 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.167 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.167 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.167 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.167 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.167 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.167 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.167 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.167 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.168 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.168 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.168 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.168 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.168 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.168 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.168 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.168 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.168 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.168 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.168 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.168 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.168 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.169 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.169 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.169 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.169 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.169 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.169 INFO:teuthology.orchestra.run.smithi018.stdout: "retain_interval": { 2024-09-12T03:03:29.169 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retain_interval", 2024-09-12T03:03:29.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.169 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.169 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.169 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "31536000", 2024-09-12T03:03:29.169 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.170 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.170 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.170 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T03:03:29.170 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.170 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.170 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.170 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_recent_interval": { 2024-09-12T03:03:29.170 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_recent_interval", 2024-09-12T03:03:29.170 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.170 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.170 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.170 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1209600", 2024-09-12T03:03:29.170 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.171 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.171 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.171 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T03:03:29.171 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.171 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.171 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.171 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.171 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.171 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dashboard", 2024-09-12T03:03:29.171 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.171 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.171 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.172 INFO:teuthology.orchestra.run.smithi018.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T03:03:29.172 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T03:03:29.172 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.172 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.172 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.172 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:29.172 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.172 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.172 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.172 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.172 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.172 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.172 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.173 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T03:03:29.173 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T03:03:29.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.173 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.173 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.173 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.173 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.173 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.173 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.173 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.173 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.173 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.174 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.174 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T03:03:29.174 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T03:03:29.174 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.174 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.174 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.174 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.174 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.174 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.174 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.174 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.174 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.175 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.175 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.175 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_ENABLED": { 2024-09-12T03:03:29.175 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T03:03:29.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.175 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.175 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.175 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.175 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.175 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.175 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.175 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.176 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.176 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.176 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.176 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T03:03:29.176 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T03:03:29.176 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.176 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.176 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.176 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.176 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.176 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.176 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.176 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.177 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.177 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.177 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.177 INFO:teuthology.orchestra.run.smithi018.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T03:03:29.177 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T03:03:29.177 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.177 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.177 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.177 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.177 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.177 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.177 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.178 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.178 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.178 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.178 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.178 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T03:03:29.178 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T03:03:29.178 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.178 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.178 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.178 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.178 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.178 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.179 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.179 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.179 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.179 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.179 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.179 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T03:03:29.179 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T03:03:29.179 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.179 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.179 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.179 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.179 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.180 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.180 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.180 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.180 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.180 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.180 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.180 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T03:03:29.180 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T03:03:29.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.180 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.180 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.180 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.180 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.181 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.181 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.181 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.181 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.181 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.181 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.181 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T03:03:29.181 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T03:03:29.181 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.181 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.181 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.181 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.181 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.182 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.182 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.182 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.182 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.182 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.182 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.182 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T03:03:29.182 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T03:03:29.182 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.182 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.182 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.182 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.182 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.183 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.183 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.183 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.183 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.183 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.183 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.183 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T03:03:29.183 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T03:03:29.183 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.183 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.183 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.183 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.184 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.184 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.184 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.184 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.184 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.184 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.184 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.184 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T03:03:29.184 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T03:03:29.184 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.184 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.184 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.184 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.184 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.185 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.185 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.185 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.185 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.185 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.185 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.185 INFO:teuthology.orchestra.run.smithi018.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T03:03:29.185 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T03:03:29.185 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.185 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.185 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.185 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.186 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.186 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.186 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.186 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.186 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.186 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.186 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.186 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T03:03:29.186 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T03:03:29.186 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.186 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.186 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.187 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-12T03:03:29.187 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.187 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.187 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.187 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.187 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.187 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.187 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.187 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T03:03:29.187 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T03:03:29.187 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.187 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.188 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.188 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.188 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.188 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.188 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.188 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.188 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.188 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.188 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.188 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_URL": { 2024-09-12T03:03:29.188 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_URL", 2024-09-12T03:03:29.188 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.188 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.189 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.189 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.189 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.189 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.189 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.189 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.189 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.189 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.189 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.189 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T03:03:29.189 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T03:03:29.189 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.190 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.190 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.190 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-12T03:03:29.190 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.190 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.190 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.190 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.190 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.190 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.190 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.190 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T03:03:29.190 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T03:03:29.191 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.191 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.191 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.191 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.191 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.191 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.191 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.191 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.191 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.191 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.191 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.191 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T03:03:29.191 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T03:03:29.192 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.192 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.192 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.192 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.192 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.192 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.192 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.192 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.192 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.192 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.192 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.192 INFO:teuthology.orchestra.run.smithi018.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T03:03:29.193 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T03:03:29.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.193 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.193 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.193 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.193 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.193 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.193 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.193 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.193 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.193 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.193 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.193 INFO:teuthology.orchestra.run.smithi018.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T03:03:29.194 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T03:03:29.194 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.194 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.194 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.194 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.194 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.194 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.194 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.194 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.194 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.194 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.194 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.195 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T03:03:29.195 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T03:03:29.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.195 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.195 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.195 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.195 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.195 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.195 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.195 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.195 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.195 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.195 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.196 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T03:03:29.196 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T03:03:29.196 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.196 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.196 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.196 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.196 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.196 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.196 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.196 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.196 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.196 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.196 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.197 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T03:03:29.197 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T03:03:29.197 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.197 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.197 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.197 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.197 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.197 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.197 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.197 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.197 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.197 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.197 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.198 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T03:03:29.198 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T03:03:29.198 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.198 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.198 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.198 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.198 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.198 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.198 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.198 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.198 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.199 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.199 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.199 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T03:03:29.199 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T03:03:29.199 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.199 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.199 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.199 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.199 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.199 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.199 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.199 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.200 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.200 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.200 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T03:03:29.200 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T03:03:29.200 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.200 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.200 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.200 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.200 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.200 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.200 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.200 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.200 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.201 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.201 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.201 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T03:03:29.201 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T03:03:29.201 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.201 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.201 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.201 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.201 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.201 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.201 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.201 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.202 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.202 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.202 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.202 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T03:03:29.202 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T03:03:29.202 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.202 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.202 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.202 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.202 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.202 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.202 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.202 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.203 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.203 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.203 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.203 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T03:03:29.203 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T03:03:29.203 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.203 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.203 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.203 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.203 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.203 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.203 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.203 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.204 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.204 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.204 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.204 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T03:03:29.204 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T03:03:29.204 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.204 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.204 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.204 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.204 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.204 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.204 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.205 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.205 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.205 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.205 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.205 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T03:03:29.205 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T03:03:29.205 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.205 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.205 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.205 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T03:03:29.205 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.205 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.206 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.206 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.206 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.206 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.206 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.206 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T03:03:29.206 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T03:03:29.206 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.206 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.206 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.206 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:29.206 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.207 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.207 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.207 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.207 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.207 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.207 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.207 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T03:03:29.207 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T03:03:29.207 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.207 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.207 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.207 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8", 2024-09-12T03:03:29.208 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.208 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.208 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.208 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.208 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.208 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.208 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.208 INFO:teuthology.orchestra.run.smithi018.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T03:03:29.208 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T03:03:29.208 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.208 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.208 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.209 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "45", 2024-09-12T03:03:29.209 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.209 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.209 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.209 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.209 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.209 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.209 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.209 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T03:03:29.209 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T03:03:29.209 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.209 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.209 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.210 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.210 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.210 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.210 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.210 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.210 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.210 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.210 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.210 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T03:03:29.210 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T03:03:29.210 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.210 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.211 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.211 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-12T03:03:29.211 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.211 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.211 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.211 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.211 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.211 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.211 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.211 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T03:03:29.211 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T03:03:29.211 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.212 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.212 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.212 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.212 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.212 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.212 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.212 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.212 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.212 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.212 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.212 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T03:03:29.212 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T03:03:29.213 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.213 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.213 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.213 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.213 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.213 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.213 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.213 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.213 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.213 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.213 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.213 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T03:03:29.213 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T03:03:29.214 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.214 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.214 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.214 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-12T03:03:29.214 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.214 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.214 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.214 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.214 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.214 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.214 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.214 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T03:03:29.215 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T03:03:29.215 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.215 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.215 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.215 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:29.215 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.215 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.215 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.215 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.215 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.215 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.215 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.215 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T03:03:29.216 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T03:03:29.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.216 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.216 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.216 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-12T03:03:29.216 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.216 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.216 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.216 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.216 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.216 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.216 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.216 INFO:teuthology.orchestra.run.smithi018.stdout: "cross_origin_url": { 2024-09-12T03:03:29.217 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cross_origin_url", 2024-09-12T03:03:29.217 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.217 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.217 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.217 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.217 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.217 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.217 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.217 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.217 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.217 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.217 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.217 INFO:teuthology.orchestra.run.smithi018.stdout: "crt_file": { 2024-09-12T03:03:29.218 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crt_file", 2024-09-12T03:03:29.218 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.218 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.218 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.218 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.218 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.218 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.218 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.218 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.218 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.218 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.218 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.219 INFO:teuthology.orchestra.run.smithi018.stdout: "debug": { 2024-09-12T03:03:29.219 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "debug", 2024-09-12T03:03:29.219 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.219 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.219 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.219 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.219 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.219 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.219 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.219 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable/disable debug options", 2024-09-12T03:03:29.219 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.219 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.219 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.220 INFO:teuthology.orchestra.run.smithi018.stdout: "jwt_token_ttl": { 2024-09-12T03:03:29.220 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "jwt_token_ttl", 2024-09-12T03:03:29.220 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.220 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.220 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.220 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "28800", 2024-09-12T03:03:29.220 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.220 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.220 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.220 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.220 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.220 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.220 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-12T03:03:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-12T03:03:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "motd": { 2024-09-12T03:03:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "motd", 2024-09-12T03:03:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "The message of the day", 2024-09-12T03:03:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_resolve_ip_addr": { 2024-09-12T03:03:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T03:03:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-12T03:03:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-12T03:03:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-12T03:03:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-12T03:03:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-12T03:03:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8080", 2024-09-12T03:03:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-12T03:03:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-12T03:03:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl_server_port": { 2024-09-12T03:03:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl_server_port", 2024-09-12T03:03:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8443", 2024-09-12T03:03:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-12T03:03:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-12T03:03:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "redirect", 2024-09-12T03:03:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect" 2024-09-12T03:03:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-12T03:03:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-12T03:03:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-12T03:03:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-12T03:03:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-12T03:03:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "url_prefix": { 2024-09-12T03:03:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url_prefix", 2024-09-12T03:03:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-12T03:03:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_monitoring": { 2024-09-12T03:03:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_monitoring", 2024-09-12T03:03:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "monitor device health metrics", 2024-09-12T03:03:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "mark_out_threshold": { 2024-09-12T03:03:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mark_out_threshold", 2024-09-12T03:03:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2419200", 2024-09-12T03:03:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T03:03:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": { 2024-09-12T03:03:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_name", 2024-09-12T03:03:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "device_health_metrics", 2024-09-12T03:03:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T03:03:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "retention_period": { 2024-09-12T03:03:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retention_period", 2024-09-12T03:03:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15552000", 2024-09-12T03:03:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain device health metrics", 2024-09-12T03:03:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_frequency": { 2024-09-12T03:03:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_frequency", 2024-09-12T03:03:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-12T03:03:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T03:03:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "self_heal": { 2024-09-12T03:03:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "self_heal", 2024-09-12T03:03:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T03:03:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-12T03:03:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-12T03:03:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-12T03:03:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T03:03:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_threshold": { 2024-09-12T03:03:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_threshold", 2024-09-12T03:03:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7257600", 2024-09-12T03:03:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T03:03:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "diskprediction_local", 2024-09-12T03:03:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: "predict_interval": { 2024-09-12T03:03:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predict_interval", 2024-09-12T03:03:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-12T03:03:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "predictor_model": { 2024-09-12T03:03:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predictor_model", 2024-09-12T03:03:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "prophetstor", 2024-09-12T03:03:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-12T03:03:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-12T03:03:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-12T03:03:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "influx", 2024-09-12T03:03:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": false, 2024-09-12T03:03:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "influxdb python module not found", 2024-09-12T03:03:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: "batch_size": { 2024-09-12T03:03:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "batch_size", 2024-09-12T03:03:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5000", 2024-09-12T03:03:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T03:03:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "database": { 2024-09-12T03:03:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "database", 2024-09-12T03:03:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "ceph", 2024-09-12T03:03:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T03:03:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": { 2024-09-12T03:03:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hostname", 2024-09-12T03:03:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server hostname", 2024-09-12T03:03:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-12T03:03:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-12T03:03:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "30", 2024-09-12T03:03:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "5", 2024-09-12T03:03:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T03:03:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "password": { 2024-09-12T03:03:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "password", 2024-09-12T03:03:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "password of InfluxDB server user", 2024-09-12T03:03:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "port": { 2024-09-12T03:03:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "port", 2024-09-12T03:03:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8086", 2024-09-12T03:03:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server port", 2024-09-12T03:03:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-12T03:03:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-12T03:03:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "false", 2024-09-12T03:03:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T03:03:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "threads": { 2024-09-12T03:03:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threads", 2024-09-12T03:03:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-12T03:03:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-12T03:03:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "32", 2024-09-12T03:03:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T03:03:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "username": { 2024-09-12T03:03:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "username", 2024-09-12T03:03:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "username of InfluxDB server user", 2024-09-12T03:03:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "verify_ssl": { 2024-09-12T03:03:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "verify_ssl", 2024-09-12T03:03:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "true", 2024-09-12T03:03:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T03:03:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "insights", 2024-09-12T03:03:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "iostat", 2024-09-12T03:03:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "k8sevents", 2024-09-12T03:03:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_event_retention_days": { 2024-09-12T03:03:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ceph_event_retention_days", 2024-09-12T03:03:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7", 2024-09-12T03:03:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T03:03:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "config_check_secs": { 2024-09-12T03:03:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_check_secs", 2024-09-12T03:03:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "10", 2024-09-12T03:03:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T03:03:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "localpool", 2024-09-12T03:03:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "failure_domain": { 2024-09-12T03:03:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "failure_domain", 2024-09-12T03:03:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "host", 2024-09-12T03:03:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "failure domain for any created local pool", 2024-09-12T03:03:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T03:03:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": { 2024-09-12T03:03:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_size", 2024-09-12T03:03:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default min_size for any created local pool", 2024-09-12T03:03:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T03:03:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "num_rep": { 2024-09-12T03:03:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "num_rep", 2024-09-12T03:03:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-09-12T03:03:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default replica count for any created local pool", 2024-09-12T03:03:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": { 2024-09-12T03:03:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_num", 2024-09-12T03:03:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "128", 2024-09-12T03:03:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T03:03:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "prefix": { 2024-09-12T03:03:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prefix", 2024-09-12T03:03:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name prefix for any created local pool", 2024-09-12T03:03:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "subtree": { 2024-09-12T03:03:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "subtree", 2024-09-12T03:03:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "rack", 2024-09-12T03:03:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T03:03:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T03:03:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mds_autoscaler", 2024-09-12T03:03:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.312 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.312 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.312 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.312 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.312 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.312 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.312 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.312 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.312 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.312 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.312 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.312 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.313 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.313 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.313 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.313 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.313 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.313 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.313 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.313 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.313 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.313 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.313 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.313 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.314 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.314 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.314 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.314 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.314 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.314 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.314 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.314 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.314 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.314 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.314 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.314 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.314 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.315 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.315 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.315 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.315 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.315 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.315 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.315 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.315 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.315 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.315 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.315 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.315 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirroring", 2024-09-12T03:03:29.316 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.316 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.316 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.316 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.316 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.316 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.316 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.316 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.316 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.316 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.316 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.316 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.316 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.317 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.317 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.317 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.317 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.317 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.317 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.317 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.317 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.317 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.317 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.317 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.317 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.318 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.318 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.318 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.318 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.318 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.318 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.318 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.318 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.318 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.318 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.318 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.318 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.318 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.319 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.319 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.319 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.319 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.319 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.319 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.319 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.319 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.319 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.319 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.319 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.319 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.319 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.320 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.320 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.320 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.320 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.320 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.320 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.320 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.320 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.320 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.320 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.320 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.321 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.321 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.321 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.321 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.321 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.321 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.321 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.321 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.321 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.321 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "nfs", 2024-09-12T03:03:29.321 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.322 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.322 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.322 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.322 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.322 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.322 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.322 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.322 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.322 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.322 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.322 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.322 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.323 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.323 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.323 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.323 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.323 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.323 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.323 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.323 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.323 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.323 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.323 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.324 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.324 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.324 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.324 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.324 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.324 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.324 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.324 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.324 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.324 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.324 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.324 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.326 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.326 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.326 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.326 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.326 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.326 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.326 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.326 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.327 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.327 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.327 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.327 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.327 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.327 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.327 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.327 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.327 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.327 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.327 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.328 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.328 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.328 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.328 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.328 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.328 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.328 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.328 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.328 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.328 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.328 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.328 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.329 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.329 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-12T03:03:29.329 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.329 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.329 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.329 INFO:teuthology.orchestra.run.smithi018.stdout: "fail_fs": { 2024-09-12T03:03:29.329 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "fail_fs", 2024-09-12T03:03:29.329 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.329 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.330 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.330 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.330 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.330 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.330 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.330 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T03:03:29.330 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.330 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.330 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.330 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.330 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.330 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.331 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.331 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.331 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.331 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.331 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.331 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.331 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.331 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.331 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.331 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.331 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.331 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.331 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.332 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.332 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.332 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.332 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.332 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.332 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.332 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.332 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.332 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.332 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.332 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.332 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.333 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.333 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.333 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.333 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.333 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.333 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.333 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.333 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.333 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.333 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.333 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.333 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.334 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.334 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.334 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.334 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.334 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.334 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.334 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.334 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.334 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.334 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.334 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.335 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.335 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.335 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.335 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.335 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.335 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.335 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.335 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.335 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.336 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.336 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.336 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.336 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.336 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.336 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.336 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator": { 2024-09-12T03:03:29.336 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-12T03:03:29.336 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.336 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.337 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.337 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.337 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.337 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.337 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.337 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-12T03:03:29.337 INFO:teuthology.orchestra.run.smithi018.stdout: "rook", 2024-09-12T03:03:29.337 INFO:teuthology.orchestra.run.smithi018.stdout: "test_orchestrator" 2024-09-12T03:03:29.337 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.337 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Orchestrator backend", 2024-09-12T03:03:29.337 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.337 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.337 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.338 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.338 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.338 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_perf_query", 2024-09-12T03:03:29.338 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.338 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.338 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.338 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.338 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.338 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.338 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.338 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.339 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.339 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.339 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.339 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.339 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.339 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.339 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.339 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.339 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.339 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.339 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.339 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.339 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.340 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.340 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.340 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.340 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.340 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.340 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.340 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.340 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.340 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.340 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.340 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.340 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.341 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.341 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.341 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.341 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.341 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.341 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.341 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.341 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.341 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.341 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.341 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.341 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.342 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.342 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.342 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.342 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.342 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.342 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.342 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.342 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.342 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.342 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.342 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.342 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.342 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.343 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.343 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.343 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.343 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.343 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.343 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.343 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.343 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.343 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.343 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.343 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.343 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.343 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.344 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_support", 2024-09-12T03:03:29.344 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.344 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.344 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.344 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.344 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.344 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.344 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.344 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.344 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.344 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.344 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.345 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.345 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.345 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.345 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.345 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.345 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.345 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.345 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.345 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.345 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.345 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.345 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.346 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.346 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.346 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.346 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.346 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.346 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.346 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.346 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.346 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.346 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.346 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.346 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.346 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.347 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.347 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.347 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.347 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.347 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.347 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.347 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.347 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.347 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.347 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.347 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.347 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.348 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.348 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.348 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.348 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.348 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.348 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.348 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.348 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.348 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.348 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.348 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.349 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.349 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.349 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.349 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.349 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.349 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.349 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.349 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.349 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.349 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.349 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.349 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.350 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_autoscaler", 2024-09-12T03:03:29.350 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.350 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.350 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.350 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.350 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.350 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.350 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.350 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.350 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.350 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.350 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.350 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.351 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.351 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.351 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.351 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.351 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.351 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.351 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.351 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.351 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.351 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.351 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.351 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.352 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.352 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.352 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.352 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.352 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.352 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.352 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.352 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.352 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.352 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.352 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.352 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.353 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.353 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.353 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.353 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.353 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.353 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.353 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.353 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.353 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.353 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.353 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.353 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.353 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.354 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.354 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.354 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.354 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.354 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.354 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.354 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.354 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.354 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.354 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.354 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.354 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-12T03:03:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-12T03:03:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.356 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-12T03:03:29.356 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.356 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.356 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.356 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.356 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.356 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.356 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.356 INFO:teuthology.orchestra.run.smithi018.stdout: "threshold": { 2024-09-12T03:03:29.356 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threshold", 2024-09-12T03:03:29.356 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:29.356 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.357 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.357 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-12T03:03:29.357 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1.0", 2024-09-12T03:03:29.357 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.357 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.357 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "scaling threshold", 2024-09-12T03:03:29.357 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T03:03:29.358 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.358 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.358 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.358 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.358 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "progress", 2024-09-12T03:03:29.358 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.358 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.358 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.358 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_pg_recovery_event": { 2024-09-12T03:03:29.358 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_pg_recovery_event", 2024-09-12T03:03:29.359 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.359 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.359 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.359 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.359 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.359 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.359 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.359 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T03:03:29.359 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.359 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.359 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.360 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-12T03:03:29.360 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-12T03:03:29.360 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.360 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.360 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.360 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.360 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.360 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.360 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.360 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.360 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.361 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.361 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.361 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.361 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.361 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.361 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.361 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.361 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.361 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.361 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.362 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.362 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.362 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.362 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.362 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.362 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.362 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.362 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.362 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.362 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.362 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.362 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.363 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.363 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.363 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.363 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.363 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.363 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.363 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.363 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.363 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.363 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.364 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.364 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.364 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.364 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.364 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.364 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.364 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.364 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.365 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.365 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.365 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.365 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.365 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.365 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.365 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.365 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.365 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.365 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.365 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.365 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.366 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.366 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.366 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.366 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.366 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.366 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.366 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.366 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.366 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.366 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.366 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.367 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.367 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.367 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.367 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.367 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.367 INFO:teuthology.orchestra.run.smithi018.stdout: "max_completed_events": { 2024-09-12T03:03:29.367 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_completed_events", 2024-09-12T03:03:29.367 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.367 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.367 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.367 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "50", 2024-09-12T03:03:29.367 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.368 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.368 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.368 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "number of past completed events to remember", 2024-09-12T03:03:29.368 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.368 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.368 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.368 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-12T03:03:29.368 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-12T03:03:29.368 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.368 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.368 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.369 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-12T03:03:29.369 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.369 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.369 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.369 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long the module is going to sleep", 2024-09-12T03:03:29.369 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.369 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.369 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.369 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.369 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.370 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus", 2024-09-12T03:03:29.370 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.370 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.370 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.370 INFO:teuthology.orchestra.run.smithi018.stdout: "cache": { 2024-09-12T03:03:29.370 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cache", 2024-09-12T03:03:29.370 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.370 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.370 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.370 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.371 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.371 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.371 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.371 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.371 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.371 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.371 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.372 INFO:teuthology.orchestra.run.smithi018.stdout: "exclude_perf_counters": { 2024-09-12T03:03:29.372 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "exclude_perf_counters", 2024-09-12T03:03:29.372 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.372 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.372 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.372 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.372 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.372 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.372 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.373 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T03:03:29.373 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T03:03:29.373 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.373 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.373 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.373 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.373 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.374 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.374 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.374 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.374 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.374 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.374 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.374 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.374 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.374 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.374 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.374 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.374 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.375 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.375 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.375 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.375 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.375 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.375 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.375 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.375 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.375 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.375 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.375 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.375 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.376 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.376 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.376 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.376 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.376 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.376 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.376 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.376 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.376 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.376 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.377 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.377 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.377 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.377 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.377 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.377 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.377 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.377 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.377 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.377 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.377 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.377 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.377 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.378 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.378 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.378 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.378 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.378 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.378 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.378 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.378 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.378 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.378 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.379 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.379 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.379 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.379 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.379 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.379 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.379 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools": { 2024-09-12T03:03:29.379 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools", 2024-09-12T03:03:29.379 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.379 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.379 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.380 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.380 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.380 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.380 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.380 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.380 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.380 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.380 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.380 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T03:03:29.380 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T03:03:29.380 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.381 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.381 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.381 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "300", 2024-09-12T03:03:29.381 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.381 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.381 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.381 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.381 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.381 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.381 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.381 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_interval": { 2024-09-12T03:03:29.382 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_interval", 2024-09-12T03:03:29.382 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:29.382 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.382 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.382 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15.0", 2024-09-12T03:03:29.382 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.382 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.382 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.382 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.382 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.382 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.383 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.383 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-12T03:03:29.383 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-12T03:03:29.383 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.383 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.383 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.383 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-12T03:03:29.383 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.383 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.383 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.383 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T03:03:29.384 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.384 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.384 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.384 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-12T03:03:29.384 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-12T03:03:29.384 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.384 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.384 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.384 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "9283", 2024-09-12T03:03:29.384 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.384 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.384 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.385 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T03:03:29.385 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.385 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.385 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.385 INFO:teuthology.orchestra.run.smithi018.stdout: "stale_cache_strategy": { 2024-09-12T03:03:29.385 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stale_cache_strategy", 2024-09-12T03:03:29.385 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.385 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.385 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.385 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "log", 2024-09-12T03:03:29.385 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.386 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.386 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.386 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.386 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.386 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.386 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.386 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-12T03:03:29.386 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-12T03:03:29.386 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.386 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.386 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.387 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "default", 2024-09-12T03:03:29.387 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.387 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.387 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.387 INFO:teuthology.orchestra.run.smithi018.stdout: "default", 2024-09-12T03:03:29.387 INFO:teuthology.orchestra.run.smithi018.stdout: "error" 2024-09-12T03:03:29.387 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.387 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.387 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.387 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.387 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.388 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-12T03:03:29.388 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-12T03:03:29.388 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.388 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.388 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.388 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-12T03:03:29.388 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-12T03:03:29.388 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-12T03:03:29.388 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.388 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.389 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.389 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.389 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.389 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.389 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.389 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-12T03:03:29.389 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.389 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.389 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.389 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.390 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.390 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.390 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.390 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.390 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.390 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.390 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.390 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.390 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.390 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.390 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.391 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.391 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.391 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.391 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.391 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.391 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.391 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.391 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.391 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.391 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.391 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.392 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.392 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.392 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.392 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.392 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.392 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.392 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.392 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.392 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.392 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.393 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.393 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.393 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.393 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.393 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.393 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.393 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.393 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.393 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.393 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.393 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.394 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.394 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.394 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.394 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.394 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.394 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.394 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.394 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.394 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.394 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.394 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.395 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.395 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.395 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.395 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.395 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.395 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.395 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.395 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.395 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.395 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.395 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.396 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_snap_create": { 2024-09-12T03:03:29.396 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_snap_create", 2024-09-12T03:03:29.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.396 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.396 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.396 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-12T03:03:29.396 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.396 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.396 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.396 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.397 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.397 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.397 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.397 INFO:teuthology.orchestra.run.smithi018.stdout: "mirror_snapshot_schedule": { 2024-09-12T03:03:29.397 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T03:03:29.397 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.397 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.397 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.397 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.397 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.397 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.398 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.398 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.398 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.398 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.398 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.398 INFO:teuthology.orchestra.run.smithi018.stdout: "trash_purge_schedule": { 2024-09-12T03:03:29.398 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "trash_purge_schedule", 2024-09-12T03:03:29.398 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.398 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.398 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.399 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.399 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.399 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.399 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.399 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.399 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.399 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.399 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.399 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.399 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.400 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "restful", 2024-09-12T03:03:29.400 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.400 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.400 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.400 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_auth": { 2024-09-12T03:03:29.400 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_auth", 2024-09-12T03:03:29.400 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.401 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.401 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.401 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.401 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.401 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.401 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.401 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.401 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.401 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.401 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.401 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-12T03:03:29.401 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-12T03:03:29.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.402 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.402 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.402 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.402 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.402 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.402 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.402 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.402 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.402 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.402 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.403 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.403 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.403 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.403 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.403 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.403 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.403 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.403 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.403 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.403 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.403 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.403 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.403 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.403 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.404 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.404 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.404 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.404 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.404 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.404 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.404 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.404 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.404 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.404 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.404 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.405 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.405 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.405 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.405 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.405 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.405 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.405 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.405 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.405 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.405 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.406 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.406 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.406 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.406 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.406 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.406 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.406 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.406 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.406 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.406 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.406 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.406 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.407 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.407 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.407 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.407 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.407 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.407 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.407 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.407 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.407 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.407 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.407 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.408 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.408 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.408 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.408 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.408 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.408 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.408 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.408 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.408 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-12T03:03:29.409 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-12T03:03:29.409 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.409 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.409 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.409 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.409 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.409 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.409 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.409 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.409 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.410 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.410 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.410 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-12T03:03:29.410 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-12T03:03:29.410 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.410 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.410 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.410 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.410 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.410 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.410 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.410 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.411 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.411 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.411 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.411 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.411 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.411 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rgw", 2024-09-12T03:03:29.411 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.411 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.411 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.411 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.412 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.412 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.412 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.412 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.412 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.412 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.412 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.412 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.412 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.412 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.412 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.412 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.412 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.413 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.413 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.413 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.413 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.413 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.413 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.413 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.413 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.413 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.413 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.414 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.414 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.414 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.414 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.414 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.414 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.414 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.414 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.414 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.414 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.414 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.415 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.415 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.415 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.415 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.415 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.415 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.415 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.415 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.415 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.415 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.415 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.415 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.415 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.416 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.416 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.416 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.416 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.416 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.416 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.416 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.416 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.416 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.416 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.416 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.417 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.417 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.417 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.417 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.417 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.417 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.417 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.417 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.417 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rook", 2024-09-12T03:03:29.417 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.418 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.418 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.418 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.418 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.418 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.418 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.418 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.418 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.418 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.418 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.418 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.418 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.419 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.419 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.419 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.419 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.419 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.419 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.419 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.419 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.419 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.419 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.420 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.420 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.420 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.420 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.420 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.420 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.420 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.420 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.420 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.420 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.420 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.421 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.421 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.421 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.421 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.421 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.421 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.421 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.421 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.421 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.422 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.422 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.422 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.422 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.422 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.422 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.422 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.422 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.422 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.422 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.422 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.422 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.423 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.423 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.423 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.423 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.423 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.423 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.423 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.423 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.423 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.423 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.423 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.423 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.424 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.424 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_class": { 2024-09-12T03:03:29.424 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "storage_class", 2024-09-12T03:03:29.424 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.424 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.424 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.424 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "local", 2024-09-12T03:03:29.424 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.424 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.424 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.424 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T03:03:29.425 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.425 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.425 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.425 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.425 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.425 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "selftest", 2024-09-12T03:03:29.425 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.425 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.425 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.426 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.426 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.426 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.426 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.426 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.426 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.426 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.426 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.426 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.426 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.426 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.427 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.427 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.427 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.427 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.427 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.427 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.427 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.427 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.427 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.427 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.427 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.428 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.428 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.428 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.428 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.428 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.428 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.428 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.428 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.428 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.428 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.428 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.429 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.429 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.429 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.429 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.429 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.429 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.429 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.429 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.429 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.429 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.430 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.430 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.430 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.430 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.430 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.430 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.430 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.430 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.430 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.430 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.431 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.431 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.431 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.431 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.431 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.431 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.431 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.431 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.431 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.431 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.431 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.431 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.431 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.432 INFO:teuthology.orchestra.run.smithi018.stdout: "roption1": { 2024-09-12T03:03:29.432 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption1", 2024-09-12T03:03:29.432 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.432 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.432 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.432 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.432 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.432 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.432 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.432 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.432 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.433 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.433 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.433 INFO:teuthology.orchestra.run.smithi018.stdout: "roption2": { 2024-09-12T03:03:29.433 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption2", 2024-09-12T03:03:29.433 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.433 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.433 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.433 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "xyz", 2024-09-12T03:03:29.433 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.433 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.433 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.433 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.433 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.434 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.434 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.434 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption1": { 2024-09-12T03:03:29.434 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption1", 2024-09-12T03:03:29.434 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.434 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.434 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.434 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.434 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.434 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.434 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.435 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.435 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.435 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.435 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.435 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption2": { 2024-09-12T03:03:29.435 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption2", 2024-09-12T03:03:29.435 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.436 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.436 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.436 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.436 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.436 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.436 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.436 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.436 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.436 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.436 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.436 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption3": { 2024-09-12T03:03:29.436 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption3", 2024-09-12T03:03:29.437 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-12T03:03:29.437 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.437 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.437 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.437 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.437 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.437 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.437 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.437 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.437 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.437 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.437 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption4": { 2024-09-12T03:03:29.438 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption4", 2024-09-12T03:03:29.438 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.438 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.438 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.438 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.438 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.438 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.438 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.438 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.438 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.438 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.438 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.439 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption5": { 2024-09-12T03:03:29.439 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption5", 2024-09-12T03:03:29.439 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.439 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.439 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.439 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.439 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.439 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.439 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.439 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.439 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.439 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.440 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.440 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption6": { 2024-09-12T03:03:29.440 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption6", 2024-09-12T03:03:29.440 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.440 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.440 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.440 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.440 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.440 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.440 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.441 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.441 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.441 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.441 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.441 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption7": { 2024-09-12T03:03:29.441 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption7", 2024-09-12T03:03:29.441 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.441 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.441 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.441 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.441 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-12T03:03:29.442 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "42", 2024-09-12T03:03:29.442 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.442 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.442 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.442 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.442 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.442 INFO:teuthology.orchestra.run.smithi018.stdout: "testkey": { 2024-09-12T03:03:29.442 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testkey", 2024-09-12T03:03:29.442 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.442 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.442 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.443 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.443 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.443 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.443 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.443 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.443 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.443 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.443 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.443 INFO:teuthology.orchestra.run.smithi018.stdout: "testlkey": { 2024-09-12T03:03:29.443 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testlkey", 2024-09-12T03:03:29.443 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.444 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.444 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.444 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.444 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.444 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.444 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.444 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.444 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.444 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.444 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.445 INFO:teuthology.orchestra.run.smithi018.stdout: "testnewline": { 2024-09-12T03:03:29.445 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testnewline", 2024-09-12T03:03:29.445 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.445 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.445 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.445 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.445 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.445 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.445 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.445 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.445 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.445 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.445 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.446 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.446 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.446 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-09-12T03:03:29.446 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.446 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.446 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.446 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_m_granularity": { 2024-09-12T03:03:29.446 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_m_granularity", 2024-09-12T03:03:29.446 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.446 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.446 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.447 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.447 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.447 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.447 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.447 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T03:03:29.447 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.447 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.447 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.447 INFO:teuthology.orchestra.run.smithi018.stdout: "dump_on_update": { 2024-09-12T03:03:29.447 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dump_on_update", 2024-09-12T03:03:29.448 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.448 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.448 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.448 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.448 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.448 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.448 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.448 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "dump database to debug log on update", 2024-09-12T03:03:29.448 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.448 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.448 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.449 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.449 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.449 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.449 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.449 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.449 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.449 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.449 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.449 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.449 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.449 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.449 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.449 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.450 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.450 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.450 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.450 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.450 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.450 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.450 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.450 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.450 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.450 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.450 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.450 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.451 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.451 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.451 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.451 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.451 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.451 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.451 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.451 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.451 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.451 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.452 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.452 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.452 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.452 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.452 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.452 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.452 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.452 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.452 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.452 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.453 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.453 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.453 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.453 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.453 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.453 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.453 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.453 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.453 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.453 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.454 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.454 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.454 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.454 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.454 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.454 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.454 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.454 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.454 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.454 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.454 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.454 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.455 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.455 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stats", 2024-09-12T03:03:29.455 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.455 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.455 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.455 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.455 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.455 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.455 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.456 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.456 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.456 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.456 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.456 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.456 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.456 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.456 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.456 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.456 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.456 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.456 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.457 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.457 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.457 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.457 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.457 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.457 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.457 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.457 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.457 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.457 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.458 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.458 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.458 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.458 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.458 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.458 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.458 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.458 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.458 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.458 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.458 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.460 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.460 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.460 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.460 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.460 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.460 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.460 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.460 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.460 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.460 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.462 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "status", 2024-09-12T03:03:29.462 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.462 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.462 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.462 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.462 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.462 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.462 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.462 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.462 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.462 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.462 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.464 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.464 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.464 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.464 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.464 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.464 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.464 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.464 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.464 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.464 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.464 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.465 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.465 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.465 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.465 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.465 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.465 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.465 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.465 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.465 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.465 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.465 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.465 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.466 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.466 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.466 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.466 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.466 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.466 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.466 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.466 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.466 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.466 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.466 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.466 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.466 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.467 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.467 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.467 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.467 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.467 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.467 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.467 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.467 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.467 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.467 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.467 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.468 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telegraf", 2024-09-12T03:03:29.468 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.468 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.468 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.468 INFO:teuthology.orchestra.run.smithi018.stdout: "address": { 2024-09-12T03:03:29.468 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "address", 2024-09-12T03:03:29.468 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.468 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.468 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.468 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T03:03:29.468 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.468 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.469 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.469 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.469 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.469 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.469 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.469 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-12T03:03:29.469 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-12T03:03:29.469 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.469 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.469 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.469 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15", 2024-09-12T03:03:29.470 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.470 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.470 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.470 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.470 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.470 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.470 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.470 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.470 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.470 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.470 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.470 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.471 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.471 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.471 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.471 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.471 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.471 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.471 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.471 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.471 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.471 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.471 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.471 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.471 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.472 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.472 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.472 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.472 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.472 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.472 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.472 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.472 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.472 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.472 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.473 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.473 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.473 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.473 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.473 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.474 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.474 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.474 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.474 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.474 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.474 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.474 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.474 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.474 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.474 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.474 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.474 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.475 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.475 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.475 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.475 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.475 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.475 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.475 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.475 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.475 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.475 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.476 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.476 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.476 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.476 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.476 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.476 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.476 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.476 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.476 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.476 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.476 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.476 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.477 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.477 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telemetry", 2024-09-12T03:03:29.477 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.477 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.477 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.477 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_basic": { 2024-09-12T03:03:29.477 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_basic", 2024-09-12T03:03:29.478 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.478 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.478 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.478 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.478 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.478 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.478 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.478 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T03:03:29.478 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.478 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.479 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.479 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_crash": { 2024-09-12T03:03:29.479 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_crash", 2024-09-12T03:03:29.479 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.479 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.479 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.479 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.479 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.479 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.480 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.480 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T03:03:29.480 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.480 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.480 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.480 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_device": { 2024-09-12T03:03:29.480 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_device", 2024-09-12T03:03:29.480 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.480 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.480 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.480 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.481 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.481 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.481 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.481 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T03:03:29.481 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.481 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.481 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.481 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_ident": { 2024-09-12T03:03:29.481 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_ident", 2024-09-12T03:03:29.482 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.482 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.482 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.482 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.482 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.482 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.482 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.482 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T03:03:29.482 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.482 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.482 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.483 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_perf": { 2024-09-12T03:03:29.483 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_perf", 2024-09-12T03:03:29.483 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.483 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.483 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.483 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.483 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.483 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.483 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.483 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T03:03:29.483 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.484 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.484 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.484 INFO:teuthology.orchestra.run.smithi018.stdout: "contact": { 2024-09-12T03:03:29.484 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "contact", 2024-09-12T03:03:29.484 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.484 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.484 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.484 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.485 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.485 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.485 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.485 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.485 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.485 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.485 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.485 INFO:teuthology.orchestra.run.smithi018.stdout: "description": { 2024-09-12T03:03:29.486 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "description", 2024-09-12T03:03:29.486 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.486 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.486 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.486 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.486 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.486 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.486 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.486 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.486 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.487 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.487 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.487 INFO:teuthology.orchestra.run.smithi018.stdout: "device_url": { 2024-09-12T03:03:29.487 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_url", 2024-09-12T03:03:29.487 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.487 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.487 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.487 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T03:03:29.487 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.488 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.488 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.488 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.488 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.488 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.488 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.488 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-12T03:03:29.488 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-12T03:03:29.489 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.489 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.489 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.489 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.489 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.489 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.489 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.489 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.489 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.490 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.490 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.490 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-12T03:03:29.490 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-12T03:03:29.490 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.490 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.490 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.490 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "24", 2024-09-12T03:03:29.490 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "8", 2024-09-12T03:03:29.491 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.491 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.491 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.491 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.491 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.491 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.491 INFO:teuthology.orchestra.run.smithi018.stdout: "last_opt_revision": { 2024-09-12T03:03:29.491 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "last_opt_revision", 2024-09-12T03:03:29.492 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.492 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.492 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.492 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1", 2024-09-12T03:03:29.492 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.492 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.492 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.492 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.493 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.493 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.493 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.493 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard": { 2024-09-12T03:03:29.493 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard", 2024-09-12T03:03:29.493 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.493 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.493 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.494 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.494 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.494 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.494 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.494 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.494 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.494 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.494 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.494 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard_description": { 2024-09-12T03:03:29.494 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard_description", 2024-09-12T03:03:29.495 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.495 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.495 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.495 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.495 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.495 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.495 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.495 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.496 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.496 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.496 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.496 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.496 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.496 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.496 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.496 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.496 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.496 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.497 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.497 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.497 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.497 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.497 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.497 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.497 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.497 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.497 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.497 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.497 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.497 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.497 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.498 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.498 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.498 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.498 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.498 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.498 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.498 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.498 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.498 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.498 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.498 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.498 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.498 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.499 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.499 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.499 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.499 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.499 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.499 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.499 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.499 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.499 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.499 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.499 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.499 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.500 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.500 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.500 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.500 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.500 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.500 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.500 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.500 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.500 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.500 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.500 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.501 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.501 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.501 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.501 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.501 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.501 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.501 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.501 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.501 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.501 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.501 INFO:teuthology.orchestra.run.smithi018.stdout: "organization": { 2024-09-12T03:03:29.501 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "organization", 2024-09-12T03:03:29.502 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.502 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.502 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.502 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.502 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.502 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.502 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.502 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.502 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.502 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.502 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.502 INFO:teuthology.orchestra.run.smithi018.stdout: "proxy": { 2024-09-12T03:03:29.503 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "proxy", 2024-09-12T03:03:29.503 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.503 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.503 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.503 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.503 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.503 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.503 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.503 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.503 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.503 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.503 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.504 INFO:teuthology.orchestra.run.smithi018.stdout: "url": { 2024-09-12T03:03:29.504 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url", 2024-09-12T03:03:29.504 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.504 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.504 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.504 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T03:03:29.504 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.504 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.504 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.504 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.504 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.504 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.504 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.505 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.505 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.505 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test_orchestrator", 2024-09-12T03:03:29.505 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.505 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.505 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.505 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.505 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.505 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.505 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.505 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.506 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.506 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.506 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.506 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.506 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.506 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.506 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.506 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.506 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.507 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.507 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.507 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.507 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.507 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.507 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.507 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.507 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.507 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.507 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.508 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.508 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.508 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.508 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.508 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.508 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.508 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.508 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.508 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.508 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.509 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.509 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.509 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.509 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.509 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.509 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.509 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.509 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.509 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.509 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.509 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.509 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.510 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.510 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.510 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.510 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.510 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.510 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.510 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.510 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.510 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.510 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.510 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.510 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.510 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.511 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.511 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.511 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.511 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.511 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.511 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.511 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.511 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.511 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.511 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-12T03:03:29.511 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.512 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.512 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.512 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.512 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.512 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.512 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.512 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.512 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.512 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.512 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.512 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.512 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.512 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.513 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.513 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.513 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.513 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.513 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.513 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.513 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.513 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.513 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.513 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.513 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.513 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.514 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.514 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.514 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.514 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.514 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.514 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.514 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.514 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.514 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.514 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.514 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.515 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.515 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.515 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.515 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.515 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.515 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.515 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.515 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.515 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.515 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.515 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.515 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.516 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.516 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.516 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.516 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.516 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.516 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.516 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.516 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.516 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.516 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.516 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.517 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.517 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.517 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.517 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.517 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.517 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.517 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.517 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.517 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.517 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_clones": { 2024-09-12T03:03:29.517 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_clones", 2024-09-12T03:03:29.518 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.518 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.518 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.518 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4", 2024-09-12T03:03:29.518 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.518 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.518 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.518 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T03:03:29.518 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.518 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.518 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.518 INFO:teuthology.orchestra.run.smithi018.stdout: "periodic_async_work": { 2024-09-12T03:03:29.519 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "periodic_async_work", 2024-09-12T03:03:29.519 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.519 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.519 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.519 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.519 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.519 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.519 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.519 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Periodically check for async work", 2024-09-12T03:03:29.519 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.519 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.519 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.520 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_delay": { 2024-09-12T03:03:29.520 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_delay", 2024-09-12T03:03:29.520 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.520 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.520 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.520 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-12T03:03:29.520 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.520 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.520 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.520 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T03:03:29.520 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.520 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.521 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.521 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_no_wait": { 2024-09-12T03:03:29.521 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T03:03:29.521 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.521 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.521 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.521 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-12T03:03:29.521 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.521 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.521 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.521 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T03:03:29.522 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.522 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.522 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.522 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.522 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.522 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix", 2024-09-12T03:03:29.522 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-12T03:03:29.522 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-12T03:03:29.522 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-12T03:03:29.522 INFO:teuthology.orchestra.run.smithi018.stdout: "discovery_interval": { 2024-09-12T03:03:29.523 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "discovery_interval", 2024-09-12T03:03:29.523 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-12T03:03:29.523 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.523 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.523 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "100", 2024-09-12T03:03:29.523 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.523 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.523 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.523 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.523 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.523 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.523 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.524 INFO:teuthology.orchestra.run.smithi018.stdout: "identifier": { 2024-09-12T03:03:29.524 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "identifier", 2024-09-12T03:03:29.524 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.524 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.524 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.524 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.524 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.524 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.524 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.524 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.525 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.525 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.525 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.525 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-12T03:03:29.525 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-12T03:03:29.525 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-12T03:03:29.525 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.525 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.525 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-12T03:03:29.525 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.525 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.526 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.526 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.526 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.526 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.526 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.526 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-12T03:03:29.526 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-12T03:03:29.526 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.526 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.526 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.527 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.527 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.527 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.527 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.527 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.527 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.527 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.527 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.527 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.527 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.527 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.527 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.528 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.528 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.528 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.528 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-12T03:03:29.528 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-12T03:03:29.528 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.528 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.528 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.528 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.529 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.529 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.529 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.529 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.529 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.529 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.529 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.529 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-12T03:03:29.529 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-12T03:03:29.529 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.529 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.530 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.530 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-12T03:03:29.530 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.530 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.530 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-12T03:03:29.530 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-12T03:03:29.530 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-12T03:03:29.530 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-12T03:03:29.530 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-12T03:03:29.530 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-12T03:03:29.530 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-12T03:03:29.530 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.530 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.531 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.531 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.531 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.531 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-12T03:03:29.531 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-12T03:03:29.531 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-12T03:03:29.531 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.531 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-12T03:03:29.531 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-12T03:03:29.531 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.531 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.531 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.532 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.532 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.532 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.532 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.532 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_host": { 2024-09-12T03:03:29.532 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_host", 2024-09-12T03:03:29.532 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.532 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.532 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.532 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-12T03:03:29.532 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.532 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.533 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.533 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.533 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.533 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.533 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.533 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_port": { 2024-09-12T03:03:29.533 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_port", 2024-09-12T03:03:29.533 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-12T03:03:29.533 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.533 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.533 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10051", 2024-09-12T03:03:29.533 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.534 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.534 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.534 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.534 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.534 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.534 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.534 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_sender": { 2024-09-12T03:03:29.534 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_sender", 2024-09-12T03:03:29.534 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-12T03:03:29.534 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-12T03:03:29.534 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-12T03:03:29.534 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T03:03:29.535 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-12T03:03:29.535 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-12T03:03:29.535 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-12T03:03:29.535 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-12T03:03:29.535 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-12T03:03:29.535 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-12T03:03:29.535 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-12T03:03:29.535 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.535 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.536 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.536 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.536 INFO:teuthology.orchestra.run.smithi018.stdout: "services": { 2024-09-12T03:03:29.536 INFO:teuthology.orchestra.run.smithi018.stdout: "dashboard": "https://172.21.15.18:8443/" 2024-09-12T03:03:29.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.536 INFO:teuthology.orchestra.run.smithi018.stdout: "always_on_modules": { 2024-09-12T03:03:29.536 INFO:teuthology.orchestra.run.smithi018.stdout: "octopus": [ 2024-09-12T03:03:29.536 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-12T03:03:29.536 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-12T03:03:29.536 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-12T03:03:29.536 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-12T03:03:29.536 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-12T03:03:29.537 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-12T03:03:29.537 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-12T03:03:29.537 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-12T03:03:29.537 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-12T03:03:29.537 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-12T03:03:29.537 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.537 INFO:teuthology.orchestra.run.smithi018.stdout: "pacific": [ 2024-09-12T03:03:29.537 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-12T03:03:29.537 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-12T03:03:29.537 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-12T03:03:29.537 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-12T03:03:29.537 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-12T03:03:29.537 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-12T03:03:29.537 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-12T03:03:29.538 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-12T03:03:29.538 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-12T03:03:29.538 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-12T03:03:29.538 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.538 INFO:teuthology.orchestra.run.smithi018.stdout: "quincy": [ 2024-09-12T03:03:29.538 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-12T03:03:29.538 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-12T03:03:29.538 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-12T03:03:29.538 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-12T03:03:29.538 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-12T03:03:29.538 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-12T03:03:29.538 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-12T03:03:29.539 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-12T03:03:29.539 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-12T03:03:29.539 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-12T03:03:29.539 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.539 INFO:teuthology.orchestra.run.smithi018.stdout: "reef": [ 2024-09-12T03:03:29.539 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-12T03:03:29.539 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-12T03:03:29.539 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-12T03:03:29.539 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-12T03:03:29.539 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-12T03:03:29.539 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-12T03:03:29.539 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-12T03:03:29.539 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-12T03:03:29.540 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-12T03:03:29.540 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-12T03:03:29.540 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-12T03:03:29.540 INFO:teuthology.orchestra.run.smithi018.stdout: "squid": [ 2024-09-12T03:03:29.540 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-12T03:03:29.540 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-12T03:03:29.540 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-12T03:03:29.540 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-12T03:03:29.540 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-12T03:03:29.540 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-12T03:03:29.540 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-12T03:03:29.540 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-12T03:03:29.540 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-12T03:03:29.541 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-12T03:03:29.541 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-12T03:03:29.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.541 INFO:teuthology.orchestra.run.smithi018.stdout: "last_failure_osd_epoch": 99, 2024-09-12T03:03:29.541 INFO:teuthology.orchestra.run.smithi018.stdout: "active_clients": [ 2024-09-12T03:03:29.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.541 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-12T03:03:29.541 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-12T03:03:29.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.541 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-12T03:03:29.541 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-12T03:03:29.541 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1337001625 2024-09-12T03:03:29.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.541 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-12T03:03:29.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.542 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "libcephsqlite", 2024-09-12T03:03:29.542 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-12T03:03:29.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.542 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-12T03:03:29.542 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-12T03:03:29.542 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2959115064 2024-09-12T03:03:29.542 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.542 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-12T03:03:29.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.542 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-12T03:03:29.543 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-12T03:03:29.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.543 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-12T03:03:29.543 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-12T03:03:29.543 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2634353900 2024-09-12T03:03:29.543 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.543 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-12T03:03:29.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.543 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-09-12T03:03:29.543 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-12T03:03:29.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.543 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-12T03:03:29.543 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-12T03:03:29.544 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2224106813 2024-09-12T03:03:29.544 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.544 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-12T03:03:29.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.544 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-09-12T03:03:29.544 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-12T03:03:29.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.544 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-12T03:03:29.544 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-12T03:03:29.544 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 906595017 2024-09-12T03:03:29.544 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.544 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-12T03:03:29.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:29.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.545 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-12T03:03:29.545 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-12T03:03:29.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-12T03:03:29.545 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-12T03:03:29.545 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-12T03:03:29.545 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3906178057 2024-09-12T03:03:29.545 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.545 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-12T03:03:29.545 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:29.545 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-12T03:03:29.545 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T03:03:29.547 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:28 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/4058554714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T03:03:29.547 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:29 smithi176 ceph-mon[35713]: pgmap v462: 129 pgs: 69 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 463 KiB/s wr, 222 op/s 2024-09-12T03:03:29.547 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:29 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3098563892' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T03:03:29.547 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:28 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/4058554714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T03:03:29.547 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:29 smithi062 ceph-mon[35527]: pgmap v462: 129 pgs: 69 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 463 KiB/s wr, 222 op/s 2024-09-12T03:03:29.547 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:29 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3098563892' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T03:03:29.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:28.126+0000 7f25d9e00640 1 -- 172.21.15.18:0/3098563892 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f25bc0a2d80 msgr2=0x7f25bc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:29.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:28.126+0000 7f25d9e00640 1 --2- 172.21.15.18:0/3098563892 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f25bc0a2d80 0x7f25bc0a5240 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f25c800a990 tx=0x7f25c8005c70 comp rx=0 tx=0).stop 2024-09-12T03:03:29.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:28.126+0000 7f25d9e00640 1 -- 172.21.15.18:0/3098563892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25d4109b10 msgr2=0x7f25d410cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:03:29.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:28.126+0000 7f25d9e00640 1 --2- 172.21.15.18:0/3098563892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25d4109b10 0x7f25d410cb20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f25c000ea20 tx=0x7f25c000ee20 comp rx=0 tx=0).stop 2024-09-12T03:03:29.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:28.128+0000 7f25d9e00640 1 -- 172.21.15.18:0/3098563892 shutdown_connections 2024-09-12T03:03:29.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:28.128+0000 7f25d9e00640 1 --2- 172.21.15.18:0/3098563892 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f25bc0a2d80 0x7f25bc0a5240 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:29.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:28.128+0000 7f25d9e00640 1 --2- 172.21.15.18:0/3098563892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25d4114ab0 0x7f25d410d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:29.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:28.128+0000 7f25d9e00640 1 --2- 172.21.15.18:0/3098563892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25d4109b10 0x7f25d410cb20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:29.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:28.128+0000 7f25d9e00640 1 --2- 172.21.15.18:0/3098563892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25d41091f0 0x7f25d410c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:03:29.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:28.128+0000 7f25d9e00640 1 -- 172.21.15.18:0/3098563892 >> 172.21.15.18:0/3098563892 conn(0x7f25d406d020 msgr2=0x7f25d410a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:03:29.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:28.128+0000 7f25d9e00640 1 -- 172.21.15.18:0/3098563892 shutdown_connections 2024-09-12T03:03:29.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:03:28.128+0000 7f25d9e00640 1 -- 172.21.15.18:0/3098563892 wait complete. 2024-09-12T03:03:29.555 DEBUG:tasks.check_counter:Getting stats from a 2024-09-12T03:03:29.556 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-12T03:03:29.556 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:28 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/4058554714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T03:03:29.556 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:29 smithi018 ceph-mon[30616]: pgmap v462: 129 pgs: 69 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 463 KiB/s wr, 222 op/s 2024-09-12T03:03:29.556 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:29 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3098563892' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T03:03:30.695 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T03:03:31.151 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:31 smithi018 ceph-mon[30616]: pgmap v463: 129 pgs: 69 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 462 KiB/s wr, 221 op/s 2024-09-12T03:03:31.478 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:31 smithi176 ceph-mon[35713]: pgmap v463: 129 pgs: 69 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 462 KiB/s wr, 221 op/s 2024-09-12T03:03:31.533 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:31 smithi062 ceph-mon[35527]: pgmap v463: 129 pgs: 69 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 37 active+clean; 2.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 462 KiB/s wr, 221 op/s 2024-09-12T03:03:32.017 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T03:03:32.017 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T03:03:32.018 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 20986, 2024-09-12T03:03:32.018 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 18438, 2024-09-12T03:03:32.018 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 11093869, 2024-09-12T03:03:32.018 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 105742449, 2024-09-12T03:03:32.018 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 11, 2024-09-12T03:03:32.018 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 5, 2024-09-12T03:03:32.018 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 4.251130294, 2024-09-12T03:03:32.018 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 1.548313947, 2024-09-12T03:03:32.018 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 1.430259467, 2024-09-12T03:03:32.018 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 1.385772049, 2024-09-12T03:03:32.018 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:32.018 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 18436, 2024-09-12T03:03:32.018 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 6.170709630, 2024-09-12T03:03:32.019 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000334709 2024-09-12T03:03:32.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.019 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:32.019 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 19012, 2024-09-12T03:03:32.019 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.006545655, 2024-09-12T03:03:32.019 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000344 2024-09-12T03:03:32.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.019 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T03:03:32.019 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 407264 2024-09-12T03:03:32.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.019 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T03:03:32.019 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 34547, 2024-09-12T03:03:32.019 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 25296, 2024-09-12T03:03:32.020 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 21729235, 2024-09-12T03:03:32.020 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 132337618, 2024-09-12T03:03:32.020 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 16, 2024-09-12T03:03:32.020 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 9, 2024-09-12T03:03:32.020 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 5.552097529, 2024-09-12T03:03:32.020 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 2.012996191, 2024-09-12T03:03:32.020 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 29.501933274, 2024-09-12T03:03:32.020 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 1.682126463, 2024-09-12T03:03:32.020 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:32.020 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 25293, 2024-09-12T03:03:32.020 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 9.048685534, 2024-09-12T03:03:32.020 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000357754 2024-09-12T03:03:32.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.021 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:32.021 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 34253, 2024-09-12T03:03:32.021 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.024506863, 2024-09-12T03:03:32.021 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000715 2024-09-12T03:03:32.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.021 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 2127552, 2024-09-12T03:03:32.021 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 192816 2024-09-12T03:03:32.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.021 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T03:03:32.021 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 159076, 2024-09-12T03:03:32.021 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 246669, 2024-09-12T03:03:32.021 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 69665901, 2024-09-12T03:03:32.021 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 173216052, 2024-09-12T03:03:32.022 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 10, 2024-09-12T03:03:32.022 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 6, 2024-09-12T03:03:32.022 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 53.401479801, 2024-09-12T03:03:32.022 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 44.167720418, 2024-09-12T03:03:32.022 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 43.249464663, 2024-09-12T03:03:32.022 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.954359878, 2024-09-12T03:03:32.022 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:32.022 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 246669, 2024-09-12T03:03:32.022 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 147.112934795, 2024-09-12T03:03:32.022 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000596398 2024-09-12T03:03:32.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.022 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:32.022 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 189728, 2024-09-12T03:03:32.023 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.128037668, 2024-09-12T03:03:32.023 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000674 2024-09-12T03:03:32.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.023 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T03:03:32.023 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 135728 2024-09-12T03:03:32.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.023 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-12T03:03:32.023 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 1, 2024-09-12T03:03:32.023 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-12T03:03:32.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.023 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-MDSRank": { 2024-09-12T03:03:32.023 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-12T03:03:32.023 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-12T03:03:32.023 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 5384, 2024-09-12T03:03:32.024 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 112.438998484, 2024-09-12T03:03:32.024 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.020883915 2024-09-12T03:03:32.024 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:32.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.024 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-PurgeQueue": { 2024-09-12T03:03:32.024 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-12T03:03:32.024 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-12T03:03:32.024 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 20342, 2024-09-12T03:03:32.024 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 5.949749185, 2024-09-12T03:03:32.024 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000292485 2024-09-12T03:03:32.024 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:32.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.024 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": { 2024-09-12T03:03:32.025 INFO:teuthology.orchestra.run.smithi018.stdout: "request": 72729, 2024-09-12T03:03:32.025 INFO:teuthology.orchestra.run.smithi018.stdout: "reply": 70138, 2024-09-12T03:03:32.025 INFO:teuthology.orchestra.run.smithi018.stdout: "reply_latency": { 2024-09-12T03:03:32.025 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 70138, 2024-09-12T03:03:32.025 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 1756.845058715, 2024-09-12T03:03:32.025 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.025048405 2024-09-12T03:03:32.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.025 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_reply": 0, 2024-09-12T03:03:32.025 INFO:teuthology.orchestra.run.smithi018.stdout: "forward": 2588, 2024-09-12T03:03:32.025 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_complete": 176, 2024-09-12T03:03:32.025 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_keys": 0, 2024-09-12T03:03:32.025 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_commit": 684, 2024-09-12T03:03:32.025 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_split": 75, 2024-09-12T03:03:32.026 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_merge": 0, 2024-09-12T03:03:32.026 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes": 20529, 2024-09-12T03:03:32.026 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_top": 18, 2024-09-12T03:03:32.026 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_bottom": 3054, 2024-09-12T03:03:32.026 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pin_tail": 17457, 2024-09-12T03:03:32.026 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pinned": 20502, 2024-09-12T03:03:32.026 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_expired": 57528, 2024-09-12T03:03:32.026 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_with_caps": 2, 2024-09-12T03:03:32.026 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": 2, 2024-09-12T03:03:32.026 INFO:teuthology.orchestra.run.smithi018.stdout: "subtrees": 5, 2024-09-12T03:03:32.026 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse": 123436, 2024-09-12T03:03:32.026 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_hit": 101634, 2024-09-12T03:03:32.026 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_forward": 2317, 2024-09-12T03:03:32.026 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_discover": 615, 2024-09-12T03:03:32.027 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_dir_fetch": 46, 2024-09-12T03:03:32.027 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_remote_ino": 0, 2024-09-12T03:03:32.027 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_lock": 274, 2024-09-12T03:03:32.027 INFO:teuthology.orchestra.run.smithi018.stdout: "load_cent": 589, 2024-09-12T03:03:32.027 INFO:teuthology.orchestra.run.smithi018.stdout: "q": 0, 2024-09-12T03:03:32.027 INFO:teuthology.orchestra.run.smithi018.stdout: "exported": 262, 2024-09-12T03:03:32.027 INFO:teuthology.orchestra.run.smithi018.stdout: "exported_inodes": 44283, 2024-09-12T03:03:32.027 INFO:teuthology.orchestra.run.smithi018.stdout: "imported": 265, 2024-09-12T03:03:32.027 INFO:teuthology.orchestra.run.smithi018.stdout: "imported_inodes": 37751, 2024-09-12T03:03:32.027 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_dir_fetch": 0, 2024-09-12T03:03:32.027 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_backtrace_fetch": 0, 2024-09-12T03:03:32.027 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_peer_discover": 0, 2024-09-12T03:03:32.027 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rfiles": 4, 2024-09-12T03:03:32.028 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rbytes": 234, 2024-09-12T03:03:32.028 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rsnaps": 0, 2024-09-12T03:03:32.028 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T03:03:32.028 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_set_tag": 0, 2024-09-12T03:03:32.028 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T03:03:32.028 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_inotable_repaired": 0, 2024-09-12T03:03:32.028 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_inodes": 0, 2024-09-12T03:03:32.028 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T03:03:32.028 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T03:03:32.028 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_file_inodes": 0, 2024-09-12T03:03:32.028 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_inode_file_caps": 143, 2024-09-12T03:03:32.028 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_revoke": 12832, 2024-09-12T03:03:32.028 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_grant": 23341, 2024-09-12T03:03:32.029 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T03:03:32.029 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T03:03:32.029 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T03:03:32.029 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps": 41964, 2024-09-12T03:03:32.029 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps_dirty": 18608, 2024-09-12T03:03:32.029 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_cap_release": 436, 2024-09-12T03:03:32.029 INFO:teuthology.orchestra.run.smithi018.stdout: "process_request_cap_release": 25331 2024-09-12T03:03:32.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.029 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache": { 2024-09-12T03:03:32.029 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update": 3, 2024-09-12T03:03:32.029 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update_receipt": 3, 2024-09-12T03:03:32.029 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_try_discover": 2, 2024-09-12T03:03:32.029 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_send_discover": 788, 2024-09-12T03:03:32.029 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_handle_discover": 905, 2024-09-12T03:03:32.030 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays": 73, 2024-09-12T03:03:32.030 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_delayed": 0, 2024-09-12T03:03:32.030 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_enqueuing": 0, 2024-09-12T03:03:32.030 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_created": 10185, 2024-09-12T03:03:32.030 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_enqueued": 10112, 2024-09-12T03:03:32.030 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_reintegrated": 0, 2024-09-12T03:03:32.030 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_migrated": 0, 2024-09-12T03:03:32.030 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_processing": 0, 2024-09-12T03:03:32.030 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_enqueued": 0, 2024-09-12T03:03:32.030 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_prioritized": 0, 2024-09-12T03:03:32.030 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_started": 0, 2024-09-12T03:03:32.030 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_completed": 0, 2024-09-12T03:03:32.030 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_path": 0, 2024-09-12T03:03:32.031 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_inode": 0, 2024-09-12T03:03:32.031 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T03:03:32.031 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_exportdir": 262, 2024-09-12T03:03:32.031 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_flush": 0, 2024-09-12T03:03:32.031 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragmentdir": 75, 2024-09-12T03:03:32.031 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragstats": 0, 2024-09-12T03:03:32.031 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_inodestats": 0 2024-09-12T03:03:32.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.031 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log": { 2024-09-12T03:03:32.031 INFO:teuthology.orchestra.run.smithi018.stdout: "evlrg": 5, 2024-09-12T03:03:32.031 INFO:teuthology.orchestra.run.smithi018.stdout: "evadd": 80592, 2024-09-12T03:03:32.031 INFO:teuthology.orchestra.run.smithi018.stdout: "evex": 0, 2024-09-12T03:03:32.031 INFO:teuthology.orchestra.run.smithi018.stdout: "evtrm": 0, 2024-09-12T03:03:32.031 INFO:teuthology.orchestra.run.smithi018.stdout: "ev": 80592, 2024-09-12T03:03:32.032 INFO:teuthology.orchestra.run.smithi018.stdout: "evexg": 0, 2024-09-12T03:03:32.032 INFO:teuthology.orchestra.run.smithi018.stdout: "evexd": 0, 2024-09-12T03:03:32.032 INFO:teuthology.orchestra.run.smithi018.stdout: "segadd": 115, 2024-09-12T03:03:32.032 INFO:teuthology.orchestra.run.smithi018.stdout: "segex": 0, 2024-09-12T03:03:32.032 INFO:teuthology.orchestra.run.smithi018.stdout: "segtrm": 0, 2024-09-12T03:03:32.032 INFO:teuthology.orchestra.run.smithi018.stdout: "seg": 115, 2024-09-12T03:03:32.032 INFO:teuthology.orchestra.run.smithi018.stdout: "segmjr": 8, 2024-09-12T03:03:32.032 INFO:teuthology.orchestra.run.smithi018.stdout: "segexg": 0, 2024-09-12T03:03:32.032 INFO:teuthology.orchestra.run.smithi018.stdout: "segexd": 0, 2024-09-12T03:03:32.032 INFO:teuthology.orchestra.run.smithi018.stdout: "expos": 4194304, 2024-09-12T03:03:32.032 INFO:teuthology.orchestra.run.smithi018.stdout: "wrpos": 288846451, 2024-09-12T03:03:32.032 INFO:teuthology.orchestra.run.smithi018.stdout: "rdpos": 0, 2024-09-12T03:03:32.032 INFO:teuthology.orchestra.run.smithi018.stdout: "jlat": { 2024-09-12T03:03:32.032 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 2836, 2024-09-12T03:03:32.033 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 442.776287763, 2024-09-12T03:03:32.033 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.156127040 2024-09-12T03:03:32.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.033 INFO:teuthology.orchestra.run.smithi018.stdout: "replayed": 0 2024-09-12T03:03:32.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.033 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_mem": { 2024-09-12T03:03:32.033 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 10366, 2024-09-12T03:03:32.033 INFO:teuthology.orchestra.run.smithi018.stdout: "ino+": 52208, 2024-09-12T03:03:32.033 INFO:teuthology.orchestra.run.smithi018.stdout: "ino-": 41842, 2024-09-12T03:03:32.033 INFO:teuthology.orchestra.run.smithi018.stdout: "dir": 512, 2024-09-12T03:03:32.033 INFO:teuthology.orchestra.run.smithi018.stdout: "dir+": 1761, 2024-09-12T03:03:32.033 INFO:teuthology.orchestra.run.smithi018.stdout: "dir-": 1249, 2024-09-12T03:03:32.033 INFO:teuthology.orchestra.run.smithi018.stdout: "dn": 20560, 2024-09-12T03:03:32.034 INFO:teuthology.orchestra.run.smithi018.stdout: "dn+": 90387, 2024-09-12T03:03:32.034 INFO:teuthology.orchestra.run.smithi018.stdout: "dn-": 69827, 2024-09-12T03:03:32.034 INFO:teuthology.orchestra.run.smithi018.stdout: "cap": 2, 2024-09-12T03:03:32.034 INFO:teuthology.orchestra.run.smithi018.stdout: "cap+": 33989, 2024-09-12T03:03:32.034 INFO:teuthology.orchestra.run.smithi018.stdout: "cap-": 33987, 2024-09-12T03:03:32.034 INFO:teuthology.orchestra.run.smithi018.stdout: "rss": 183172, 2024-09-12T03:03:32.034 INFO:teuthology.orchestra.run.smithi018.stdout: "heap": 223520 2024-09-12T03:03:32.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.034 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_server": { 2024-09-12T03:03:32.034 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_client_request": 80109, 2024-09-12T03:03:32.034 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_server_request": 6216, 2024-09-12T03:03:32.034 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_request": 72729, 2024-09-12T03:03:32.034 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_session": 369, 2024-09-12T03:03:32.035 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_peer_request": 13508, 2024-09-12T03:03:32.035 INFO:teuthology.orchestra.run.smithi018.stdout: "req_create_latency": { 2024-09-12T03:03:32.035 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 11758, 2024-09-12T03:03:32.035 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 118.530669729, 2024-09-12T03:03:32.035 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.010080853 2024-09-12T03:03:32.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.035 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getattr_latency": { 2024-09-12T03:03:32.035 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 549, 2024-09-12T03:03:32.035 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 64.421547016, 2024-09-12T03:03:32.035 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.117343437 2024-09-12T03:03:32.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.035 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getfilelock_latency": { 2024-09-12T03:03:32.035 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.035 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.036 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.036 INFO:teuthology.orchestra.run.smithi018.stdout: "req_link_latency": { 2024-09-12T03:03:32.036 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.036 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.036 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.036 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookup_latency": { 2024-09-12T03:03:32.036 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 31737, 2024-09-12T03:03:32.036 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 1042.093654163, 2024-09-12T03:03:32.036 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.032835291 2024-09-12T03:03:32.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.036 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookuphash_latency": { 2024-09-12T03:03:32.036 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.037 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.037 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.037 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupino_latency": { 2024-09-12T03:03:32.037 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1, 2024-09-12T03:03:32.037 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000139524, 2024-09-12T03:03:32.037 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000139524 2024-09-12T03:03:32.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.037 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupname_latency": { 2024-09-12T03:03:32.037 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.037 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.037 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.037 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupparent_latency": { 2024-09-12T03:03:32.038 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.038 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.038 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.038 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupsnap_latency": { 2024-09-12T03:03:32.038 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.039 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.039 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.039 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lssnap_latency": { 2024-09-12T03:03:32.039 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.039 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.039 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.039 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mkdir_latency": { 2024-09-12T03:03:32.039 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 92, 2024-09-12T03:03:32.039 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 2.534266340, 2024-09-12T03:03:32.040 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.027546373 2024-09-12T03:03:32.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.040 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mknod_latency": { 2024-09-12T03:03:32.040 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.040 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.040 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.040 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mksnap_latency": { 2024-09-12T03:03:32.040 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.040 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.040 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.041 INFO:teuthology.orchestra.run.smithi018.stdout: "req_open_latency": { 2024-09-12T03:03:32.041 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 4349, 2024-09-12T03:03:32.041 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 36.190807530, 2024-09-12T03:03:32.041 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.008321638 2024-09-12T03:03:32.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.041 INFO:teuthology.orchestra.run.smithi018.stdout: "req_readdir_latency": { 2024-09-12T03:03:32.041 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 486, 2024-09-12T03:03:32.041 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 2.680515189, 2024-09-12T03:03:32.041 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.005515463 2024-09-12T03:03:32.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.041 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rename_latency": { 2024-09-12T03:03:32.041 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 11781, 2024-09-12T03:03:32.041 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 444.457480445, 2024-09-12T03:03:32.042 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.037726634 2024-09-12T03:03:32.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.042 INFO:teuthology.orchestra.run.smithi018.stdout: "req_renamesnap_latency": { 2024-09-12T03:03:32.042 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.042 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.042 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.042 INFO:teuthology.orchestra.run.smithi018.stdout: "req_snapdiff_latency": { 2024-09-12T03:03:32.042 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.042 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.042 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.043 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmdir_latency": { 2024-09-12T03:03:32.043 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 73, 2024-09-12T03:03:32.043 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 15.707923621, 2024-09-12T03:03:32.043 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.215177035 2024-09-12T03:03:32.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.043 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmsnap_latency": { 2024-09-12T03:03:32.043 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.043 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.043 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.043 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmxattr_latency": { 2024-09-12T03:03:32.043 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.043 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.043 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.044 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setattr_latency": { 2024-09-12T03:03:32.044 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.044 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.044 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.044 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setdirlayout_latency": { 2024-09-12T03:03:32.044 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.044 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.044 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.044 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setfilelock_latency": { 2024-09-12T03:03:32.044 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.045 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.045 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.045 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setlayout_latency": { 2024-09-12T03:03:32.045 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.045 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.045 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.045 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setxattr_latency": { 2024-09-12T03:03:32.045 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.045 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.045 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.046 INFO:teuthology.orchestra.run.smithi018.stdout: "req_symlink_latency": { 2024-09-12T03:03:32.046 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.046 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.046 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.046 INFO:teuthology.orchestra.run.smithi018.stdout: "req_unlink_latency": { 2024-09-12T03:03:32.046 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 9312, 2024-09-12T03:03:32.046 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 30.228055158, 2024-09-12T03:03:32.046 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.003246139 2024-09-12T03:03:32.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.046 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_revoke_eviction": 0, 2024-09-12T03:03:32.046 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_acquisition_throttle": 0, 2024-09-12T03:03:32.046 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getvxattr_latency": { 2024-09-12T03:03:32.046 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.047 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.047 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.047 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:32.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.047 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_sessions": { 2024-09-12T03:03:32.047 INFO:teuthology.orchestra.run.smithi018.stdout: "session_count": 1, 2024-09-12T03:03:32.047 INFO:teuthology.orchestra.run.smithi018.stdout: "session_add": 2, 2024-09-12T03:03:32.047 INFO:teuthology.orchestra.run.smithi018.stdout: "session_remove": 1, 2024-09-12T03:03:32.047 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_open": 1, 2024-09-12T03:03:32.047 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_stale": 0, 2024-09-12T03:03:32.047 INFO:teuthology.orchestra.run.smithi018.stdout: "total_load": 1635, 2024-09-12T03:03:32.047 INFO:teuthology.orchestra.run.smithi018.stdout: "average_load": 1635, 2024-09-12T03:03:32.047 INFO:teuthology.orchestra.run.smithi018.stdout: "avg_session_uptime": 889, 2024-09-12T03:03:32.048 INFO:teuthology.orchestra.run.smithi018.stdout: "mdthresh_evicted": 0 2024-09-12T03:03:32.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.048 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-12T03:03:32.048 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-12T03:03:32.048 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-12T03:03:32.048 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T03:03:32.048 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-12T03:03:32.048 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T03:03:32.048 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-12T03:03:32.048 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T03:03:32.048 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T03:03:32.048 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T03:03:32.048 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T03:03:32.049 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T03:03:32.049 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-12T03:03:32.049 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T03:03:32.049 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T03:03:32.049 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-12T03:03:32.049 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-12T03:03:32.049 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-12T03:03:32.049 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-12T03:03:32.049 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T03:03:32.049 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T03:03:32.049 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T03:03:32.049 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T03:03:32.050 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T03:03:32.050 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-12T03:03:32.050 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-12T03:03:32.050 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-12T03:03:32.050 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T03:03:32.050 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T03:03:32.050 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-12T03:03:32.050 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-12T03:03:32.050 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-12T03:03:32.050 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-12T03:03:32.050 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T03:03:32.050 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-12T03:03:32.050 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T03:03:32.051 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-12T03:03:32.051 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 1278112, 2024-09-12T03:03:32.051 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 10656, 2024-09-12T03:03:32.051 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-12T03:03:32.051 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-12T03:03:32.051 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-12T03:03:32.051 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-12T03:03:32.051 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-12T03:03:32.051 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-12T03:03:32.051 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-12T03:03:32.051 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-12T03:03:32.051 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 10272, 2024-09-12T03:03:32.051 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 219, 2024-09-12T03:03:32.051 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T03:03:32.052 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-12T03:03:32.052 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-12T03:03:32.052 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-12T03:03:32.052 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 40116014, 2024-09-12T03:03:32.052 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 435499, 2024-09-12T03:03:32.052 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-12T03:03:32.052 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-12T03:03:32.052 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-12T03:03:32.052 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-12T03:03:32.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.052 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter": { 2024-09-12T03:03:32.052 INFO:teuthology.orchestra.run.smithi018.stdout: "op_active": 0, 2024-09-12T03:03:32.052 INFO:teuthology.orchestra.run.smithi018.stdout: "op_laggy": 0, 2024-09-12T03:03:32.053 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send": 25825, 2024-09-12T03:03:32.053 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send_bytes": 300751141, 2024-09-12T03:03:32.053 INFO:teuthology.orchestra.run.smithi018.stdout: "op_resend": 32, 2024-09-12T03:03:32.053 INFO:teuthology.orchestra.run.smithi018.stdout: "op_reply": 25825, 2024-09-12T03:03:32.053 INFO:teuthology.orchestra.run.smithi018.stdout: "op_latency": { 2024-09-12T03:03:32.053 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 25825, 2024-09-12T03:03:32.053 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 1412.714518518, 2024-09-12T03:03:32.053 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.054703369 2024-09-12T03:03:32.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.053 INFO:teuthology.orchestra.run.smithi018.stdout: "op_inflight": 0, 2024-09-12T03:03:32.053 INFO:teuthology.orchestra.run.smithi018.stdout: "oplen_avg": { 2024-09-12T03:03:32.053 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 25825, 2024-09-12T03:03:32.053 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 27479 2024-09-12T03:03:32.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.054 INFO:teuthology.orchestra.run.smithi018.stdout: "op": 25825, 2024-09-12T03:03:32.054 INFO:teuthology.orchestra.run.smithi018.stdout: "op_r": 830, 2024-09-12T03:03:32.054 INFO:teuthology.orchestra.run.smithi018.stdout: "op_w": 24995, 2024-09-12T03:03:32.054 INFO:teuthology.orchestra.run.smithi018.stdout: "op_rmw": 0, 2024-09-12T03:03:32.054 INFO:teuthology.orchestra.run.smithi018.stdout: "op_pg": 0, 2024-09-12T03:03:32.054 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_stat": 0, 2024-09-12T03:03:32.054 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_create": 10, 2024-09-12T03:03:32.054 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_read": 403, 2024-09-12T03:03:32.054 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_write": 3240, 2024-09-12T03:03:32.054 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writefull": 238, 2024-09-12T03:03:32.054 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writesame": 0, 2024-09-12T03:03:32.054 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_append": 0, 2024-09-12T03:03:32.054 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_zero": 0, 2024-09-12T03:03:32.055 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_truncate": 75, 2024-09-12T03:03:32.055 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_delete": 20303, 2024-09-12T03:03:32.055 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_mapext": 0, 2024-09-12T03:03:32.055 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_sparse_read": 0, 2024-09-12T03:03:32.055 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_clonerange": 0, 2024-09-12T03:03:32.055 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_getxattr": 1, 2024-09-12T03:03:32.055 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_setxattr": 20, 2024-09-12T03:03:32.055 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_cmpxattr": 0, 2024-09-12T03:03:32.055 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_rmxattr": 0, 2024-09-12T03:03:32.055 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_resetxattrs": 0, 2024-09-12T03:03:32.055 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_call": 0, 2024-09-12T03:03:32.055 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_watch": 0, 2024-09-12T03:03:32.055 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_notify": 0, 2024-09-12T03:03:32.055 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T03:03:32.056 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls": 0, 2024-09-12T03:03:32.056 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls_filter": 0, 2024-09-12T03:03:32.056 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_other": 0, 2024-09-12T03:03:32.056 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_active": 0, 2024-09-12T03:03:32.056 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_send": 0, 2024-09-12T03:03:32.056 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_resend": 0, 2024-09-12T03:03:32.056 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_ping": 0, 2024-09-12T03:03:32.056 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_active": 0, 2024-09-12T03:03:32.056 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_send": 0, 2024-09-12T03:03:32.056 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_resend": 0, 2024-09-12T03:03:32.056 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_active": 0, 2024-09-12T03:03:32.056 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_send": 0, 2024-09-12T03:03:32.056 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_resend": 0, 2024-09-12T03:03:32.057 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_active": 0, 2024-09-12T03:03:32.057 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_send": 0, 2024-09-12T03:03:32.057 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_resend": 0, 2024-09-12T03:03:32.057 INFO:teuthology.orchestra.run.smithi018.stdout: "command_active": 0, 2024-09-12T03:03:32.057 INFO:teuthology.orchestra.run.smithi018.stdout: "command_send": 0, 2024-09-12T03:03:32.057 INFO:teuthology.orchestra.run.smithi018.stdout: "command_resend": 0, 2024-09-12T03:03:32.057 INFO:teuthology.orchestra.run.smithi018.stdout: "map_epoch": 117, 2024-09-12T03:03:32.057 INFO:teuthology.orchestra.run.smithi018.stdout: "map_full": 0, 2024-09-12T03:03:32.057 INFO:teuthology.orchestra.run.smithi018.stdout: "map_inc": 21, 2024-09-12T03:03:32.057 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_sessions": 12, 2024-09-12T03:03:32.057 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_open": 12, 2024-09-12T03:03:32.057 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_close": 0, 2024-09-12T03:03:32.057 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_laggy": 0, 2024-09-12T03:03:32.057 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_wr": 2188, 2024-09-12T03:03:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_rd": 603, 2024-09-12T03:03:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_del": 398 2024-09-12T03:03:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "oft": { 2024-09-12T03:03:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_objs": 1, 2024-09-12T03:03:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_kv_pairs": 0, 2024-09-12T03:03:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_updates": 0, 2024-09-12T03:03:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_removes": 0 2024-09-12T03:03:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "osd-slow-ops": { 2024-09-12T03:03:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_ops_count": 7 2024-09-12T03:03:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "purge_queue": { 2024-09-12T03:03:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops": 0, 2024-09-12T03:03:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops_high_water": 10, 2024-09-12T03:03:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing": 0, 2024-09-12T03:03:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_high_water": 5, 2024-09-12T03:03:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed_ops": 20224, 2024-09-12T03:03:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed": 10112, 2024-09-12T03:03:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_item_in_journal": 0 2024-09-12T03:03:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T03:03:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-12T03:03:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-12T03:03:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-12T03:03:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 214605, 2024-09-12T03:03:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 85366425, 2024-09-12T03:03:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 214605, 2024-09-12T03:03:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-12T03:03:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-12T03:03:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 214605, 2024-09-12T03:03:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 85366425, 2024-09-12T03:03:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-12T03:03:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_bytes": { 2024-09-12T03:03:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-12T03:03:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-12T03:03:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-12T03:03:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-12T03:03:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-12T03:03:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-12T03:03:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 25825, 2024-09-12T03:03:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 302276423, 2024-09-12T03:03:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 25825, 2024-09-12T03:03:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 302276423, 2024-09-12T03:03:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-12T03:03:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_ops": { 2024-09-12T03:03:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-12T03:03:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 1024, 2024-09-12T03:03:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-12T03:03:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-12T03:03:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-12T03:03:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-12T03:03:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 25825, 2024-09-12T03:03:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 25825, 2024-09-12T03:03:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 25825, 2024-09-12T03:03:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 25825, 2024-09-12T03:03:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-12T03:03:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle": { 2024-09-12T03:03:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-12T03:03:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-12T03:03:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-12T03:03:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 10112, 2024-09-12T03:03:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 1536760, 2024-09-12T03:03:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 10112, 2024-09-12T03:03:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-12T03:03:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-12T03:03:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 403, 2024-09-12T03:03:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 1536760, 2024-09-12T03:03:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-12T03:03:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle-0x556a099cc960": { 2024-09-12T03:03:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-12T03:03:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-12T03:03:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-12T03:03:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 80592, 2024-09-12T03:03:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 284652147, 2024-09-12T03:03:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 80592, 2024-09-12T03:03:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-12T03:03:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-12T03:03:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 2836, 2024-09-12T03:03:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 284652147, 2024-09-12T03:03:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-12T03:03:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:32.066 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T03:03:32.689 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:32 smithi018 ceph-mon[30616]: pgmap v464: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 399 KiB/s wr, 243 op/s 2024-09-12T03:03:32.689 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:32 smithi018 ceph-mon[30616]: osdmap e117: 12 total, 12 up, 12 in 2024-09-12T03:03:32.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:32 smithi176 ceph-mon[35713]: pgmap v464: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 399 KiB/s wr, 243 op/s 2024-09-12T03:03:32.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:32 smithi176 ceph-mon[35713]: osdmap e117: 12 total, 12 up, 12 in 2024-09-12T03:03:32.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:32 smithi062 ceph-mon[35527]: pgmap v464: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 399 KiB/s wr, 243 op/s 2024-09-12T03:03:32.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:32 smithi062 ceph-mon[35527]: osdmap e117: 12 total, 12 up, 12 in 2024-09-12T03:03:33.825 INFO:tasks.check_counter:Daemon mds.a mds.exported=262 2024-09-12T03:03:33.825 INFO:tasks.check_counter:Daemon mds.a mds.imported=265 2024-09-12T03:03:33.825 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-09-12T03:03:33.825 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-09-12T03:03:33.826 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T03:03:33.826 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=75 2024-09-12T03:03:33.826 DEBUG:tasks.check_counter:Getting stats from d 2024-09-12T03:03:33.826 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-12T03:03:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T03:03:34.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:34 smithi176 ceph-mon[35713]: pgmap v466: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 66 KiB/s wr, 218 op/s 2024-09-12T03:03:34.733 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:34 smithi018 ceph-mon[30616]: pgmap v466: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 66 KiB/s wr, 218 op/s 2024-09-12T03:03:34.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:34 smithi062 ceph-mon[35527]: pgmap v466: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 66 KiB/s wr, 218 op/s 2024-09-12T03:03:35.600 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T03:03:35.600 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T03:03:35.600 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 4, 2024-09-12T03:03:35.600 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 4, 2024-09-12T03:03:35.600 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 2992, 2024-09-12T03:03:35.600 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 448, 2024-09-12T03:03:35.600 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-12T03:03:35.600 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 0, 2024-09-12T03:03:35.600 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.006464558, 2024-09-12T03:03:35.600 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000083510, 2024-09-12T03:03:35.601 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.003449010, 2024-09-12T03:03:35.601 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T03:03:35.601 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:35.601 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 3, 2024-09-12T03:03:35.601 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.006167902, 2024-09-12T03:03:35.601 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.002055967 2024-09-12T03:03:35.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:35.601 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:35.601 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:35.601 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:35.601 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:35.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:35.601 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T03:03:35.602 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T03:03:35.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:35.602 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T03:03:35.602 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 2, 2024-09-12T03:03:35.602 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 228, 2024-09-12T03:03:35.602 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 320, 2024-09-12T03:03:35.602 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 197264, 2024-09-12T03:03:35.602 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 5, 2024-09-12T03:03:35.602 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 3, 2024-09-12T03:03:35.602 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.028506752, 2024-09-12T03:03:35.602 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.021655581, 2024-09-12T03:03:35.602 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.002744721, 2024-09-12T03:03:35.602 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T03:03:35.603 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:35.603 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 225, 2024-09-12T03:03:35.603 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.029216700, 2024-09-12T03:03:35.603 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000129852 2024-09-12T03:03:35.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:35.603 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:35.603 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:35.603 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:35.603 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:35.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:35.603 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T03:03:35.603 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 197264 2024-09-12T03:03:35.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:35.604 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T03:03:35.604 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 311, 2024-09-12T03:03:35.604 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 299, 2024-09-12T03:03:35.604 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 1744144, 2024-09-12T03:03:35.604 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 184240, 2024-09-12T03:03:35.604 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 2, 2024-09-12T03:03:35.604 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-09-12T03:03:35.604 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.092451070, 2024-09-12T03:03:35.604 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.045771013, 2024-09-12T03:03:35.604 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.064476642, 2024-09-12T03:03:35.604 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T03:03:35.604 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:35.604 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 298, 2024-09-12T03:03:35.605 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.050442188, 2024-09-12T03:03:35.605 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000169269 2024-09-12T03:03:35.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:35.605 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:35.605 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:35.605 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:35.605 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:35.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:35.606 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 1744144, 2024-09-12T03:03:35.606 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 184240 2024-09-12T03:03:35.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:35.606 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-12T03:03:35.606 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 0, 2024-09-12T03:03:35.606 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-12T03:03:35.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:35.606 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-12T03:03:35.606 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-12T03:03:35.606 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-12T03:03:35.606 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T03:03:35.606 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-12T03:03:35.606 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T03:03:35.607 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-12T03:03:35.607 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T03:03:35.607 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T03:03:35.607 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T03:03:35.607 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T03:03:35.607 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T03:03:35.607 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-12T03:03:35.607 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T03:03:35.607 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T03:03:35.607 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-12T03:03:35.607 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-12T03:03:35.607 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-12T03:03:35.607 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-12T03:03:35.608 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T03:03:35.608 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T03:03:35.608 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T03:03:35.608 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T03:03:35.608 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T03:03:35.608 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-12T03:03:35.608 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-12T03:03:35.608 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-12T03:03:35.608 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T03:03:35.608 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T03:03:35.608 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-12T03:03:35.608 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-12T03:03:35.609 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-12T03:03:35.609 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-12T03:03:35.609 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T03:03:35.609 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-12T03:03:35.609 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T03:03:35.609 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-12T03:03:35.609 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 148714, 2024-09-12T03:03:35.609 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 30, 2024-09-12T03:03:35.609 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-12T03:03:35.609 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-12T03:03:35.609 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-12T03:03:35.609 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-12T03:03:35.609 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-12T03:03:35.610 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-12T03:03:35.610 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-12T03:03:35.610 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-12T03:03:35.610 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 0, 2024-09-12T03:03:35.610 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 0, 2024-09-12T03:03:35.610 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T03:03:35.610 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-12T03:03:35.610 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-12T03:03:35.610 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-12T03:03:35.610 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 928, 2024-09-12T03:03:35.610 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2, 2024-09-12T03:03:35.610 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-12T03:03:35.610 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-12T03:03:35.611 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-12T03:03:35.611 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-12T03:03:35.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:35.611 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T03:03:35.611 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-12T03:03:35.611 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-12T03:03:35.611 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-12T03:03:35.611 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 313, 2024-09-12T03:03:35.611 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 1700251, 2024-09-12T03:03:35.611 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:35.611 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 313, 2024-09-12T03:03:35.611 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-12T03:03:35.611 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-12T03:03:35.612 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 313, 2024-09-12T03:03:35.612 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 1700251, 2024-09-12T03:03:35.612 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-12T03:03:35.612 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:35.612 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:35.612 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:35.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:35.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:35.612 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T03:03:36.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:36 smithi018 ceph-mon[30616]: pgmap v467: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 KiB/s wr, 197 op/s 2024-09-12T03:03:36.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:36 smithi176 ceph-mon[35713]: pgmap v467: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 KiB/s wr, 197 op/s 2024-09-12T03:03:36.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:36 smithi062 ceph-mon[35527]: pgmap v467: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 KiB/s wr, 197 op/s 2024-09-12T03:03:36.929 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-12T03:03:36.930 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-12T03:03:36.930 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-12T03:03:36.930 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-12T03:03:36.930 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-12T03:03:36.930 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-12T03:03:36.930 DEBUG:tasks.check_counter:Getting stats from g 2024-09-12T03:03:36.930 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-12T03:03:37.625 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T03:03:38.576 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T03:03:38.577 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T03:03:38.577 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 0, 2024-09-12T03:03:38.577 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 2, 2024-09-12T03:03:38.577 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 0, 2024-09-12T03:03:38.577 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 0, 2024-09-12T03:03:38.577 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-12T03:03:38.577 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 0, 2024-09-12T03:03:38.577 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.003497755, 2024-09-12T03:03:38.577 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T03:03:38.577 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.000549619, 2024-09-12T03:03:38.577 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T03:03:38.577 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:38.578 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:38.578 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:38.578 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:38.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:38.578 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:38.578 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:38.578 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:38.578 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:38.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:38.578 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T03:03:38.578 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T03:03:38.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:38.578 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T03:03:38.578 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 2, 2024-09-12T03:03:38.579 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 224, 2024-09-12T03:03:38.579 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 320, 2024-09-12T03:03:38.579 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 196560, 2024-09-12T03:03:38.579 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 5, 2024-09-12T03:03:38.579 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 3, 2024-09-12T03:03:38.579 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.029177508, 2024-09-12T03:03:38.579 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.022239177, 2024-09-12T03:03:38.579 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.003081469, 2024-09-12T03:03:38.579 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T03:03:38.579 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:38.579 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 221, 2024-09-12T03:03:38.579 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.044728608, 2024-09-12T03:03:38.579 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000202391 2024-09-12T03:03:38.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:38.580 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:38.580 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:38.580 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:38.580 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:38.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:38.580 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T03:03:38.580 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 196560 2024-09-12T03:03:38.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:38.580 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T03:03:38.580 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 310, 2024-09-12T03:03:38.580 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 296, 2024-09-12T03:03:38.580 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 1745712, 2024-09-12T03:03:38.581 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 181968, 2024-09-12T03:03:38.581 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 2, 2024-09-12T03:03:38.581 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-09-12T03:03:38.581 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.091264126, 2024-09-12T03:03:38.581 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.038194821, 2024-09-12T03:03:38.581 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.072524149, 2024-09-12T03:03:38.581 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T03:03:38.581 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:38.581 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 296, 2024-09-12T03:03:38.581 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.046752398, 2024-09-12T03:03:38.581 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000157947 2024-09-12T03:03:38.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:38.581 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:38.581 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:38.582 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:38.582 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:38.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:38.582 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 1745712, 2024-09-12T03:03:38.582 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 181968 2024-09-12T03:03:38.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:38.582 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-12T03:03:38.582 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 0, 2024-09-12T03:03:38.582 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-12T03:03:38.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:38.582 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-12T03:03:38.582 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-12T03:03:38.582 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-12T03:03:38.583 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T03:03:38.583 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-12T03:03:38.583 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T03:03:38.583 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-12T03:03:38.583 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T03:03:38.583 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T03:03:38.583 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T03:03:38.583 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T03:03:38.583 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T03:03:38.583 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-12T03:03:38.583 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T03:03:38.583 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T03:03:38.583 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-12T03:03:38.583 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-12T03:03:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-12T03:03:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-12T03:03:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T03:03:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T03:03:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T03:03:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T03:03:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T03:03:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-12T03:03:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-12T03:03:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-12T03:03:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T03:03:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T03:03:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-12T03:03:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-12T03:03:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-12T03:03:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-12T03:03:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T03:03:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-12T03:03:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T03:03:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-12T03:03:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 148714, 2024-09-12T03:03:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 30, 2024-09-12T03:03:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-12T03:03:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-12T03:03:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-12T03:03:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-12T03:03:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-12T03:03:38.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-12T03:03:38.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-12T03:03:38.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-12T03:03:38.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 0, 2024-09-12T03:03:38.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 0, 2024-09-12T03:03:38.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T03:03:38.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-12T03:03:38.586 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-12T03:03:38.586 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-12T03:03:38.586 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 928, 2024-09-12T03:03:38.586 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2, 2024-09-12T03:03:38.586 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-12T03:03:38.586 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-12T03:03:38.586 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-12T03:03:38.587 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-12T03:03:38.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:38.587 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T03:03:38.587 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-12T03:03:38.587 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-12T03:03:38.587 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-12T03:03:38.587 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 308, 2024-09-12T03:03:38.587 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 1699537, 2024-09-12T03:03:38.587 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:38.587 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 308, 2024-09-12T03:03:38.587 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-12T03:03:38.587 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-12T03:03:38.587 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 308, 2024-09-12T03:03:38.588 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 1699537, 2024-09-12T03:03:38.588 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-12T03:03:38.588 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:38.588 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:38.588 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:38.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:38.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:38.588 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T03:03:38.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:38 smithi018 ceph-mon[30616]: pgmap v468: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 181 op/s 2024-09-12T03:03:38.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:38 smithi176 ceph-mon[35713]: pgmap v468: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 181 op/s 2024-09-12T03:03:38.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:38 smithi062 ceph-mon[35527]: pgmap v468: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 181 op/s 2024-09-12T03:03:40.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:40 smithi176 ceph-mon[35713]: pgmap v469: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.9 KiB/s wr, 181 op/s 2024-09-12T03:03:40.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:40 smithi062 ceph-mon[35527]: pgmap v469: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.9 KiB/s wr, 181 op/s 2024-09-12T03:03:40.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:40 smithi018 ceph-mon[30616]: pgmap v469: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.9 KiB/s wr, 181 op/s 2024-09-12T03:03:41.939 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-12T03:03:41.939 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-12T03:03:41.939 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-12T03:03:41.940 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-12T03:03:41.940 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-12T03:03:41.940 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-12T03:03:41.940 DEBUG:tasks.check_counter:Getting stats from j 2024-09-12T03:03:41.940 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-12T03:03:42.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:42 smithi176 ceph-mon[35713]: pgmap v470: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.8 KiB/s wr, 169 op/s 2024-09-12T03:03:42.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:42 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:03:42.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:42 smithi062 ceph-mon[35527]: pgmap v470: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.8 KiB/s wr, 169 op/s 2024-09-12T03:03:42.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:42 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:03:42.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:42 smithi018 ceph-mon[30616]: pgmap v470: 129 pgs: 67 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.8 KiB/s wr, 169 op/s 2024-09-12T03:03:42.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:42 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:03:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T03:03:43.851 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 03:03:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T03:03:43.508+0000 7fea77000640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-12T03:03:44.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:44 smithi018 ceph-mon[30616]: pgmap v471: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.6 KiB/s wr, 152 op/s 2024-09-12T03:03:44.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:44 smithi176 ceph-mon[35713]: pgmap v471: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.6 KiB/s wr, 152 op/s 2024-09-12T03:03:44.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:44 smithi062 ceph-mon[35527]: pgmap v471: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.6 KiB/s wr, 152 op/s 2024-09-12T03:03:45.810 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-12T03:03:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T03:03:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 812, 2024-09-12T03:03:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 811, 2024-09-12T03:03:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 29572908, 2024-09-12T03:03:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 257138, 2024-09-12T03:03:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 7, 2024-09-12T03:03:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 3, 2024-09-12T03:03:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.185861386, 2024-09-12T03:03:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.027505911, 2024-09-12T03:03:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.102547892, 2024-09-12T03:03:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.039154746, 2024-09-12T03:03:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 810, 2024-09-12T03:03:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.133940039, 2024-09-12T03:03:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000165358 2024-09-12T03:03:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T03:03:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T03:03:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T03:03:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 840, 2024-09-12T03:03:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 1069, 2024-09-12T03:03:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 42163447, 2024-09-12T03:03:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 815737, 2024-09-12T03:03:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 8, 2024-09-12T03:03:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 6, 2024-09-12T03:03:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.289099721, 2024-09-12T03:03:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.095676512, 2024-09-12T03:03:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.125715073, 2024-09-12T03:03:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.052348051, 2024-09-12T03:03:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1066, 2024-09-12T03:03:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.195134194, 2024-09-12T03:03:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000183052 2024-09-12T03:03:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T03:03:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 549248 2024-09-12T03:03:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T03:03:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 1981, 2024-09-12T03:03:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 1921, 2024-09-12T03:03:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 36876621, 2024-09-12T03:03:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 697262, 2024-09-12T03:03:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 5, 2024-09-12T03:03:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 4, 2024-09-12T03:03:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.423005897, 2024-09-12T03:03:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.118452251, 2024-09-12T03:03:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.197415077, 2024-09-12T03:03:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.097550176, 2024-09-12T03:03:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1920, 2024-09-12T03:03:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.295940349, 2024-09-12T03:03:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000154135 2024-09-12T03:03:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 2105280, 2024-09-12T03:03:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 190688 2024-09-12T03:03:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-12T03:03:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 1, 2024-09-12T03:03:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-12T03:03:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-MDSRank": { 2024-09-12T03:03:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-12T03:03:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-12T03:03:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 5473, 2024-09-12T03:03:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.241894131, 2024-09-12T03:03:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000044197 2024-09-12T03:03:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-PurgeQueue": { 2024-09-12T03:03:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-12T03:03:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-12T03:03:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": { 2024-09-12T03:03:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "request": 0, 2024-09-12T03:03:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "reply": 0, 2024-09-12T03:03:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "reply_latency": { 2024-09-12T03:03:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_reply": 0, 2024-09-12T03:03:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "forward": 0, 2024-09-12T03:03:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_complete": 0, 2024-09-12T03:03:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_keys": 0, 2024-09-12T03:03:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_commit": 0, 2024-09-12T03:03:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_split": 0, 2024-09-12T03:03:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_merge": 0, 2024-09-12T03:03:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes": 10294, 2024-09-12T03:03:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_top": 0, 2024-09-12T03:03:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_bottom": 10294, 2024-09-12T03:03:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pin_tail": 0, 2024-09-12T03:03:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pinned": 10294, 2024-09-12T03:03:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_expired": 5, 2024-09-12T03:03:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_with_caps": 0, 2024-09-12T03:03:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": 0, 2024-09-12T03:03:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "subtrees": 1, 2024-09-12T03:03:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse": 0, 2024-09-12T03:03:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_hit": 0, 2024-09-12T03:03:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_forward": 0, 2024-09-12T03:03:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_discover": 0, 2024-09-12T03:03:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_dir_fetch": 0, 2024-09-12T03:03:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_remote_ino": 0, 2024-09-12T03:03:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_lock": 0, 2024-09-12T03:03:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "load_cent": 0, 2024-09-12T03:03:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "q": 0, 2024-09-12T03:03:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "exported": 0, 2024-09-12T03:03:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "exported_inodes": 0, 2024-09-12T03:03:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "imported": 0, 2024-09-12T03:03:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "imported_inodes": 0, 2024-09-12T03:03:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_dir_fetch": 0, 2024-09-12T03:03:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_backtrace_fetch": 0, 2024-09-12T03:03:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_peer_discover": 0, 2024-09-12T03:03:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rfiles": 0, 2024-09-12T03:03:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rbytes": 0, 2024-09-12T03:03:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rsnaps": 0, 2024-09-12T03:03:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T03:03:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_set_tag": 0, 2024-09-12T03:03:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T03:03:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_inotable_repaired": 0, 2024-09-12T03:03:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_inodes": 0, 2024-09-12T03:03:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T03:03:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T03:03:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_file_inodes": 0, 2024-09-12T03:03:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_inode_file_caps": 0, 2024-09-12T03:03:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T03:03:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_grant": 0, 2024-09-12T03:03:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T03:03:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T03:03:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T03:03:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps": 0, 2024-09-12T03:03:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps_dirty": 0, 2024-09-12T03:03:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_cap_release": 0, 2024-09-12T03:03:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "process_request_cap_release": 0 2024-09-12T03:03:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache": { 2024-09-12T03:03:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update": 0, 2024-09-12T03:03:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update_receipt": 0, 2024-09-12T03:03:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_try_discover": 0, 2024-09-12T03:03:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_send_discover": 0, 2024-09-12T03:03:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_handle_discover": 0, 2024-09-12T03:03:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays": 0, 2024-09-12T03:03:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_delayed": 0, 2024-09-12T03:03:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_enqueuing": 0, 2024-09-12T03:03:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_created": 0, 2024-09-12T03:03:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_enqueued": 0, 2024-09-12T03:03:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_reintegrated": 0, 2024-09-12T03:03:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_migrated": 0, 2024-09-12T03:03:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_processing": 0, 2024-09-12T03:03:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_enqueued": 0, 2024-09-12T03:03:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_prioritized": 0, 2024-09-12T03:03:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_started": 0, 2024-09-12T03:03:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_completed": 0, 2024-09-12T03:03:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_path": 0, 2024-09-12T03:03:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_inode": 0, 2024-09-12T03:03:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T03:03:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_exportdir": 0, 2024-09-12T03:03:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_flush": 0, 2024-09-12T03:03:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragmentdir": 0, 2024-09-12T03:03:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragstats": 0, 2024-09-12T03:03:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_inodestats": 0 2024-09-12T03:03:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log": { 2024-09-12T03:03:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "evlrg": 0, 2024-09-12T03:03:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "evadd": 0, 2024-09-12T03:03:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "evex": 0, 2024-09-12T03:03:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "evtrm": 0, 2024-09-12T03:03:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "ev": 40498, 2024-09-12T03:03:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "evexg": 0, 2024-09-12T03:03:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "evexd": 0, 2024-09-12T03:03:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "segadd": 0, 2024-09-12T03:03:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "segex": 0, 2024-09-12T03:03:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "segtrm": 0, 2024-09-12T03:03:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "seg": 58, 2024-09-12T03:03:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "segmjr": 5, 2024-09-12T03:03:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "segexg": 0, 2024-09-12T03:03:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "segexd": 0, 2024-09-12T03:03:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "expos": 4194304, 2024-09-12T03:03:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "wrpos": 109776443, 2024-09-12T03:03:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "rdpos": 109766787, 2024-09-12T03:03:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "jlat": { 2024-09-12T03:03:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "replayed": 40498 2024-09-12T03:03:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_mem": { 2024-09-12T03:03:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 13, 2024-09-12T03:03:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "ino+": 27140, 2024-09-12T03:03:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "ino-": 27127, 2024-09-12T03:03:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "dir": 11, 2024-09-12T03:03:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "dir+": 808, 2024-09-12T03:03:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "dir-": 797, 2024-09-12T03:03:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "dn": 10294, 2024-09-12T03:03:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "dn+": 48255, 2024-09-12T03:03:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "dn-": 37961, 2024-09-12T03:03:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "cap": 0, 2024-09-12T03:03:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "cap+": 0, 2024-09-12T03:03:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "cap-": 0, 2024-09-12T03:03:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "rss": 72240, 2024-09-12T03:03:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "heap": 215328 2024-09-12T03:03:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_server": { 2024-09-12T03:03:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_client_request": 0, 2024-09-12T03:03:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_server_request": 0, 2024-09-12T03:03:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_request": 0, 2024-09-12T03:03:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_session": 0, 2024-09-12T03:03:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_peer_request": 0, 2024-09-12T03:03:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "req_create_latency": { 2024-09-12T03:03:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getattr_latency": { 2024-09-12T03:03:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getfilelock_latency": { 2024-09-12T03:03:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "req_link_latency": { 2024-09-12T03:03:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookup_latency": { 2024-09-12T03:03:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookuphash_latency": { 2024-09-12T03:03:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupino_latency": { 2024-09-12T03:03:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupname_latency": { 2024-09-12T03:03:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupparent_latency": { 2024-09-12T03:03:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupsnap_latency": { 2024-09-12T03:03:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lssnap_latency": { 2024-09-12T03:03:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mkdir_latency": { 2024-09-12T03:03:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mknod_latency": { 2024-09-12T03:03:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mksnap_latency": { 2024-09-12T03:03:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "req_open_latency": { 2024-09-12T03:03:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "req_readdir_latency": { 2024-09-12T03:03:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rename_latency": { 2024-09-12T03:03:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "req_renamesnap_latency": { 2024-09-12T03:03:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "req_snapdiff_latency": { 2024-09-12T03:03:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmdir_latency": { 2024-09-12T03:03:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmsnap_latency": { 2024-09-12T03:03:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmxattr_latency": { 2024-09-12T03:03:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setattr_latency": { 2024-09-12T03:03:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setdirlayout_latency": { 2024-09-12T03:03:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setfilelock_latency": { 2024-09-12T03:03:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setlayout_latency": { 2024-09-12T03:03:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setxattr_latency": { 2024-09-12T03:03:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "req_symlink_latency": { 2024-09-12T03:03:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "req_unlink_latency": { 2024-09-12T03:03:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_revoke_eviction": 0, 2024-09-12T03:03:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_acquisition_throttle": 0, 2024-09-12T03:03:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getvxattr_latency": { 2024-09-12T03:03:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_sessions": { 2024-09-12T03:03:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "session_count": 2, 2024-09-12T03:03:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "session_add": 2, 2024-09-12T03:03:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "session_remove": 0, 2024-09-12T03:03:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_open": 2, 2024-09-12T03:03:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_stale": 0, 2024-09-12T03:03:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "total_load": 0, 2024-09-12T03:03:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "average_load": 0, 2024-09-12T03:03:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "avg_session_uptime": 2102, 2024-09-12T03:03:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "mdthresh_evicted": 0 2024-09-12T03:03:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-12T03:03:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-12T03:03:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-12T03:03:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T03:03:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-12T03:03:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T03:03:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-12T03:03:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T03:03:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T03:03:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T03:03:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T03:03:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T03:03:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-12T03:03:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T03:03:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T03:03:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-12T03:03:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-12T03:03:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-12T03:03:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-12T03:03:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T03:03:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T03:03:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T03:03:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T03:03:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T03:03:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-12T03:03:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-12T03:03:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-12T03:03:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T03:03:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T03:03:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-12T03:03:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-12T03:03:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-12T03:03:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-12T03:03:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T03:03:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-12T03:03:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T03:03:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-12T03:03:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 225096, 2024-09-12T03:03:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 74, 2024-09-12T03:03:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-12T03:03:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-12T03:03:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-12T03:03:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-12T03:03:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-12T03:03:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-12T03:03:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-12T03:03:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-12T03:03:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 10136, 2024-09-12T03:03:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 215, 2024-09-12T03:03:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T03:03:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-12T03:03:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-12T03:03:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-12T03:03:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 7351888, 2024-09-12T03:03:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 41396, 2024-09-12T03:03:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-12T03:03:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-12T03:03:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-12T03:03:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-12T03:03:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter": { 2024-09-12T03:03:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "op_active": 0, 2024-09-12T03:03:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "op_laggy": 0, 2024-09-12T03:03:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send": 3238, 2024-09-12T03:03:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send_bytes": 21, 2024-09-12T03:03:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "op_resend": 3, 2024-09-12T03:03:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "op_reply": 3238, 2024-09-12T03:03:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "op_latency": { 2024-09-12T03:03:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 3238, 2024-09-12T03:03:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 36.663568007, 2024-09-12T03:03:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.011322905 2024-09-12T03:03:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "op_inflight": 0, 2024-09-12T03:03:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "oplen_avg": { 2024-09-12T03:03:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 3238, 2024-09-12T03:03:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 3239 2024-09-12T03:03:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "op": 3238, 2024-09-12T03:03:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "op_r": 3238, 2024-09-12T03:03:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "op_w": 0, 2024-09-12T03:03:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "op_rmw": 0, 2024-09-12T03:03:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "op_pg": 0, 2024-09-12T03:03:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_stat": 1838, 2024-09-12T03:03:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_create": 0, 2024-09-12T03:03:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_read": 1398, 2024-09-12T03:03:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_write": 0, 2024-09-12T03:03:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writefull": 0, 2024-09-12T03:03:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writesame": 0, 2024-09-12T03:03:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_append": 0, 2024-09-12T03:03:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_zero": 0, 2024-09-12T03:03:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_truncate": 0, 2024-09-12T03:03:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_delete": 0, 2024-09-12T03:03:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_mapext": 0, 2024-09-12T03:03:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_sparse_read": 0, 2024-09-12T03:03:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_clonerange": 0, 2024-09-12T03:03:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_getxattr": 1, 2024-09-12T03:03:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_setxattr": 0, 2024-09-12T03:03:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_cmpxattr": 0, 2024-09-12T03:03:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_rmxattr": 0, 2024-09-12T03:03:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_resetxattrs": 0, 2024-09-12T03:03:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_call": 0, 2024-09-12T03:03:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_watch": 0, 2024-09-12T03:03:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_notify": 0, 2024-09-12T03:03:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T03:03:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls": 0, 2024-09-12T03:03:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls_filter": 0, 2024-09-12T03:03:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_other": 0, 2024-09-12T03:03:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_active": 0, 2024-09-12T03:03:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_send": 0, 2024-09-12T03:03:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_resend": 0, 2024-09-12T03:03:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_ping": 0, 2024-09-12T03:03:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_active": 0, 2024-09-12T03:03:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_send": 0, 2024-09-12T03:03:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_resend": 0, 2024-09-12T03:03:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_active": 0, 2024-09-12T03:03:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_send": 0, 2024-09-12T03:03:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_resend": 0, 2024-09-12T03:03:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_active": 0, 2024-09-12T03:03:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_send": 0, 2024-09-12T03:03:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_resend": 0, 2024-09-12T03:03:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "command_active": 0, 2024-09-12T03:03:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "command_send": 0, 2024-09-12T03:03:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "command_resend": 0, 2024-09-12T03:03:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "map_epoch": 117, 2024-09-12T03:03:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "map_full": 0, 2024-09-12T03:03:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "map_inc": 21, 2024-09-12T03:03:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_sessions": 9, 2024-09-12T03:03:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_open": 9, 2024-09-12T03:03:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_close": 0, 2024-09-12T03:03:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_laggy": 0, 2024-09-12T03:03:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_wr": 0, 2024-09-12T03:03:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_rd": 2, 2024-09-12T03:03:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_del": 0 2024-09-12T03:03:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "oft": { 2024-09-12T03:03:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_objs": 0, 2024-09-12T03:03:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_kv_pairs": 0, 2024-09-12T03:03:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_updates": 0, 2024-09-12T03:03:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_removes": 0 2024-09-12T03:03:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "osd-slow-ops": { 2024-09-12T03:03:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_ops_count": 0 2024-09-12T03:03:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "purge_queue": { 2024-09-12T03:03:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops": 0, 2024-09-12T03:03:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T03:03:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing": 0, 2024-09-12T03:03:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_high_water": 0, 2024-09-12T03:03:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed_ops": 0, 2024-09-12T03:03:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed": 0, 2024-09-12T03:03:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_item_in_journal": 0 2024-09-12T03:03:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T03:03:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-12T03:03:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-12T03:03:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-12T03:03:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 3629, 2024-09-12T03:03:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 108263731, 2024-09-12T03:03:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 3629, 2024-09-12T03:03:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-12T03:03:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-12T03:03:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 3629, 2024-09-12T03:03:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 108263731, 2024-09-12T03:03:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-12T03:03:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_bytes": { 2024-09-12T03:03:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-12T03:03:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-12T03:03:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-12T03:03:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-12T03:03:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-12T03:03:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-12T03:03:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 3238, 2024-09-12T03:03:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 105597440, 2024-09-12T03:03:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 3238, 2024-09-12T03:03:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 105597440, 2024-09-12T03:03:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-12T03:03:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_ops": { 2024-09-12T03:03:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-12T03:03:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 1024, 2024-09-12T03:03:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-12T03:03:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-12T03:03:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-12T03:03:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-12T03:03:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 3238, 2024-09-12T03:03:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 3238, 2024-09-12T03:03:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 3238, 2024-09-12T03:03:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 3238, 2024-09-12T03:03:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-12T03:03:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle": { 2024-09-12T03:03:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-12T03:03:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-12T03:03:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-12T03:03:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-12T03:03:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-12T03:03:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-12T03:03:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-12T03:03:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-12T03:03:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 0, 2024-09-12T03:03:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 0, 2024-09-12T03:03:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-12T03:03:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-12T03:03:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle-0x5608caa3cbe0": { 2024-09-12T03:03:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-12T03:03:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-12T03:03:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-12T03:03:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-12T03:03:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-12T03:03:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-12T03:03:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-12T03:03:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-12T03:03:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 0, 2024-09-12T03:03:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 0, 2024-09-12T03:03:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-12T03:03:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-12T03:03:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-12T03:03:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-12T03:03:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-12T03:03:45.874 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-12T03:03:46.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:46 smithi018 ceph-mon[30616]: pgmap v472: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 155 op/s 2024-09-12T03:03:46.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:46 smithi176 ceph-mon[35713]: pgmap v472: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 155 op/s 2024-09-12T03:03:46.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:46 smithi062 ceph-mon[35527]: pgmap v472: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 155 op/s 2024-09-12T03:03:48.655 INFO:tasks.check_counter:Daemon mds.j mds.exported=0 2024-09-12T03:03:48.656 INFO:tasks.check_counter:Daemon mds.j mds.imported=0 2024-09-12T03:03:48.656 INFO:tasks.check_counter:Daemon mds.j mds.root_rsnaps=0 2024-09-12T03:03:48.656 INFO:tasks.check_counter:Daemon mds.j mds_server.req_mksnap_latency.avgcount=0 2024-09-12T03:03:48.656 INFO:tasks.check_counter:Daemon mds.j mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T03:03:48.656 INFO:tasks.check_counter:Daemon mds.j mds.dir_split=0 2024-09-12T03:03:48.656 DEBUG:tasks.check_counter:Getting stats from b 2024-09-12T03:03:48.656 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-12T03:03:48.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:48 smithi176 ceph-mon[35713]: pgmap v473: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 153 op/s 2024-09-12T03:03:48.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:48 smithi062 ceph-mon[35527]: pgmap v473: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 153 op/s 2024-09-12T03:03:48.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:48 smithi018 ceph-mon[30616]: pgmap v473: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 153 op/s 2024-09-12T03:03:49.378 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T03:03:50.534 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:50 smithi062 ceph-mon[35527]: pgmap v474: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 158 op/s 2024-09-12T03:03:50.628 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T03:03:50.629 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T03:03:50.629 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 192661, 2024-09-12T03:03:50.629 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 273771, 2024-09-12T03:03:50.629 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 80944259, 2024-09-12T03:03:50.629 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 274179826, 2024-09-12T03:03:50.629 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 20, 2024-09-12T03:03:50.629 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 7, 2024-09-12T03:03:50.629 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 11.339054924, 2024-09-12T03:03:50.629 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 4.822881405, 2024-09-12T03:03:50.629 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 7.259459080, 2024-09-12T03:03:50.629 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 1.600351116, 2024-09-12T03:03:50.629 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 273764, 2024-09-12T03:03:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 78.652339086, 2024-09-12T03:03:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000287299 2024-09-12T03:03:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 178146, 2024-09-12T03:03:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.065596331, 2024-09-12T03:03:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000368 2024-09-12T03:03:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 532576, 2024-09-12T03:03:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 173952 2024-09-12T03:03:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T03:03:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 46176, 2024-09-12T03:03:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 40195, 2024-09-12T03:03:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 23624030, 2024-09-12T03:03:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 149429732, 2024-09-12T03:03:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 20, 2024-09-12T03:03:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 6, 2024-09-12T03:03:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 3.805741145, 2024-09-12T03:03:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 1.060506171, 2024-09-12T03:03:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 1.111449666, 2024-09-12T03:03:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 1.687086804, 2024-09-12T03:03:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 40197, 2024-09-12T03:03:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 37.523652585, 2024-09-12T03:03:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000933493 2024-09-12T03:03:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 20768, 2024-09-12T03:03:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.003400884, 2024-09-12T03:03:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000163 2024-09-12T03:03:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 2147552, 2024-09-12T03:03:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 199872 2024-09-12T03:03:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T03:03:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 38859, 2024-09-12T03:03:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 37981, 2024-09-12T03:03:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 17176664, 2024-09-12T03:03:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 99510994, 2024-09-12T03:03:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 114, 2024-09-12T03:03:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 9, 2024-09-12T03:03:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 3.589388714, 2024-09-12T03:03:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 1.039235575, 2024-09-12T03:03:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 1.095861675, 2024-09-12T03:03:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 1.484253766, 2024-09-12T03:03:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 37981, 2024-09-12T03:03:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 19.818009122, 2024-09-12T03:03:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000521787 2024-09-12T03:03:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 27472, 2024-09-12T03:03:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.004800253, 2024-09-12T03:03:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000174 2024-09-12T03:03:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 43472, 2024-09-12T03:03:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 574624 2024-09-12T03:03:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: "cct": { 2024-09-12T03:03:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: "total_workers": 1, 2024-09-12T03:03:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: "unhealthy_workers": 0 2024-09-12T03:03:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: "finisher-MDSRank": { 2024-09-12T03:03:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: "queue_len": 0, 2024-09-12T03:03:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: "complete_latency": { 2024-09-12T03:03:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 7869, 2024-09-12T03:03:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 63.256518146, 2024-09-12T03:03:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.008038698 2024-09-12T03:03:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: "finisher-PurgeQueue": { 2024-09-12T03:03:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: "queue_len": 0, 2024-09-12T03:03:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: "complete_latency": { 2024-09-12T03:03:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 23889, 2024-09-12T03:03:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 3.448294858, 2024-09-12T03:03:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000144346 2024-09-12T03:03:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-09-12T03:03:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: "request": 77280, 2024-09-12T03:03:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: "reply": 76177, 2024-09-12T03:03:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: "reply_latency": { 2024-09-12T03:03:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 76177, 2024-09-12T03:03:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 1044.855716837, 2024-09-12T03:03:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.013716157 2024-09-12T03:03:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: "slow_reply": 0, 2024-09-12T03:03:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: "forward": 1101, 2024-09-12T03:03:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_fetch_complete": 153, 2024-09-12T03:03:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_fetch_keys": 0, 2024-09-12T03:03:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_commit": 5359, 2024-09-12T03:03:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_split": 74, 2024-09-12T03:03:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_merge": 0, 2024-09-12T03:03:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes": 40294, 2024-09-12T03:03:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_top": 27958, 2024-09-12T03:03:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_bottom": 12178, 2024-09-12T03:03:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_pin_tail": 158, 2024-09-12T03:03:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_pinned": 162, 2024-09-12T03:03:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_expired": 35815, 2024-09-12T03:03:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_with_caps": 1, 2024-09-12T03:03:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": 1, 2024-09-12T03:03:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: "subtrees": 7, 2024-09-12T03:03:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse": 127223, 2024-09-12T03:03:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_hit": 108148, 2024-09-12T03:03:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_forward": 890, 2024-09-12T03:03:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_discover": 189, 2024-09-12T03:03:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_dir_fetch": 4, 2024-09-12T03:03:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_remote_ino": 0, 2024-09-12T03:03:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_lock": 248, 2024-09-12T03:03:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: "load_cent": 21, 2024-09-12T03:03:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: "q": 0, 2024-09-12T03:03:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: "exported": 257, 2024-09-12T03:03:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: "exported_inodes": 25523, 2024-09-12T03:03:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: "imported": 289, 2024-09-12T03:03:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: "imported_inodes": 40051, 2024-09-12T03:03:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_dir_fetch": 0, 2024-09-12T03:03:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_backtrace_fetch": 0, 2024-09-12T03:03:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_peer_discover": 0, 2024-09-12T03:03:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rfiles": 4, 2024-09-12T03:03:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rbytes": 234, 2024-09-12T03:03:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rsnaps": 6, 2024-09-12T03:03:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T03:03:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_set_tag": 0, 2024-09-12T03:03:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T03:03:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_inotable_repaired": 0, 2024-09-12T03:03:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dir_inodes": 0, 2024-09-12T03:03:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T03:03:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T03:03:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_file_inodes": 0, 2024-09-12T03:03:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_inode_file_caps": 189, 2024-09-12T03:03:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_revoke": 13398, 2024-09-12T03:03:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_grant": 28190, 2024-09-12T03:03:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T03:03:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T03:03:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T03:03:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_caps": 42804, 2024-09-12T03:03:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_caps_dirty": 18318, 2024-09-12T03:03:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_cap_release": 397, 2024-09-12T03:03:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: "process_request_cap_release": 31566 2024-09-12T03:03:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache": { 2024-09-12T03:03:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_update": 0, 2024-09-12T03:03:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_update_receipt": 6, 2024-09-12T03:03:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_try_discover": 4, 2024-09-12T03:03:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_send_discover": 364, 2024-09-12T03:03:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_handle_discover": 514, 2024-09-12T03:03:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays": 148, 2024-09-12T03:03:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays_delayed": 0, 2024-09-12T03:03:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays_enqueuing": 0, 2024-09-12T03:03:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_created": 14565, 2024-09-12T03:03:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_enqueued": 14417, 2024-09-12T03:03:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_reintegrated": 0, 2024-09-12T03:03:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_migrated": 0, 2024-09-12T03:03:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_processing": 0, 2024-09-12T03:03:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_enqueued": 0, 2024-09-12T03:03:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_prioritized": 0, 2024-09-12T03:03:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_started": 0, 2024-09-12T03:03:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_completed": 0, 2024-09-12T03:03:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_quiesce_path": 0, 2024-09-12T03:03:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_quiesce_inode": 0, 2024-09-12T03:03:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T03:03:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_exportdir": 257, 2024-09-12T03:03:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_flush": 0, 2024-09-12T03:03:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_fragmentdir": 74, 2024-09-12T03:03:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_fragstats": 0, 2024-09-12T03:03:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_inodestats": 0 2024-09-12T03:03:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log": { 2024-09-12T03:03:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: "evlrg": 3, 2024-09-12T03:03:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: "evadd": 95129, 2024-09-12T03:03:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: "evex": 95124, 2024-09-12T03:03:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: "evtrm": 95124, 2024-09-12T03:03:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: "ev": 5, 2024-09-12T03:03:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: "evexg": 0, 2024-09-12T03:03:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: "evexd": 3813, 2024-09-12T03:03:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: "segadd": 177, 2024-09-12T03:03:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: "segex": 176, 2024-09-12T03:03:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: "segtrm": 176, 2024-09-12T03:03:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: "seg": 1, 2024-09-12T03:03:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: "segmjr": 1, 2024-09-12T03:03:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: "segexg": 0, 2024-09-12T03:03:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: "segexd": 6, 2024-09-12T03:03:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: "expos": 291922540, 2024-09-12T03:03:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: "wrpos": 291958551, 2024-09-12T03:03:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: "rdpos": 0, 2024-09-12T03:03:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: "jlat": { 2024-09-12T03:03:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 2158, 2024-09-12T03:03:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 125.843890844, 2024-09-12T03:03:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.058315055 2024-09-12T03:03:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: "replayed": 0 2024-09-12T03:03:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_mem": { 2024-09-12T03:03:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: "ino": 22550, 2024-09-12T03:03:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: "ino+": 55306, 2024-09-12T03:03:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: "ino-": 32756, 2024-09-12T03:03:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: "dir": 925, 2024-09-12T03:03:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: "dir+": 1416, 2024-09-12T03:03:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: "dir-": 491, 2024-09-12T03:03:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: "dn": 40294, 2024-09-12T03:03:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: "dn+": 100765, 2024-09-12T03:03:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: "dn-": 60471, 2024-09-12T03:03:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: "cap": 1, 2024-09-12T03:03:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: "cap+": 30830, 2024-09-12T03:03:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: "cap-": 30829, 2024-09-12T03:03:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: "rss": 214632, 2024-09-12T03:03:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: "heap": 231712 2024-09-12T03:03:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_server": { 2024-09-12T03:03:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: "dispatch_client_request": 83278, 2024-09-12T03:03:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: "dispatch_server_request": 5791, 2024-09-12T03:03:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_request": 77280, 2024-09-12T03:03:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_session": 319, 2024-09-12T03:03:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_peer_request": 13117, 2024-09-12T03:03:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: "req_create_latency": { 2024-09-12T03:03:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 12368, 2024-09-12T03:03:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 28.479834831, 2024-09-12T03:03:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.002302703 2024-09-12T03:03:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getattr_latency": { 2024-09-12T03:03:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 570, 2024-09-12T03:03:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 12.382222225, 2024-09-12T03:03:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.021723196 2024-09-12T03:03:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getfilelock_latency": { 2024-09-12T03:03:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: "req_link_latency": { 2024-09-12T03:03:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookup_latency": { 2024-09-12T03:03:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 32426, 2024-09-12T03:03:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 721.628066189, 2024-09-12T03:03:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.022254612 2024-09-12T03:03:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookuphash_latency": { 2024-09-12T03:03:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupino_latency": { 2024-09-12T03:03:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 1, 2024-09-12T03:03:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000174227, 2024-09-12T03:03:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000174227 2024-09-12T03:03:50.650 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.650 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupname_latency": { 2024-09-12T03:03:50.650 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.650 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.650 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.650 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.651 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupparent_latency": { 2024-09-12T03:03:50.651 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.651 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.651 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.651 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.651 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupsnap_latency": { 2024-09-12T03:03:50.652 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.653 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.653 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.653 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.653 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lssnap_latency": { 2024-09-12T03:03:50.653 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 15, 2024-09-12T03:03:50.654 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.009293089, 2024-09-12T03:03:50.654 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000619539 2024-09-12T03:03:50.654 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.654 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mkdir_latency": { 2024-09-12T03:03:50.654 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 94, 2024-09-12T03:03:50.654 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 3.767645700, 2024-09-12T03:03:50.654 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.040081337 2024-09-12T03:03:50.654 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.655 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mknod_latency": { 2024-09-12T03:03:50.655 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.655 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.655 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.655 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.655 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mksnap_latency": { 2024-09-12T03:03:50.656 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 15, 2024-09-12T03:03:50.656 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 11.211821260, 2024-09-12T03:03:50.656 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.747454750 2024-09-12T03:03:50.656 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.656 INFO:teuthology.orchestra.run.smithi062.stdout: "req_open_latency": { 2024-09-12T03:03:50.656 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 3880, 2024-09-12T03:03:50.656 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 6.782973761, 2024-09-12T03:03:50.657 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.001748189 2024-09-12T03:03:50.657 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.658 INFO:teuthology.orchestra.run.smithi062.stdout: "req_readdir_latency": { 2024-09-12T03:03:50.658 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 745, 2024-09-12T03:03:50.658 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 2.065489664, 2024-09-12T03:03:50.658 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.002772469 2024-09-12T03:03:50.658 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.658 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rename_latency": { 2024-09-12T03:03:50.659 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 12347, 2024-09-12T03:03:50.659 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 170.794034110, 2024-09-12T03:03:50.659 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.013832836 2024-09-12T03:03:50.659 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.659 INFO:teuthology.orchestra.run.smithi062.stdout: "req_renamesnap_latency": { 2024-09-12T03:03:50.659 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.659 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.659 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.659 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.659 INFO:teuthology.orchestra.run.smithi062.stdout: "req_snapdiff_latency": { 2024-09-12T03:03:50.659 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.659 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.660 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.660 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.660 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmdir_latency": { 2024-09-12T03:03:50.660 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 148, 2024-09-12T03:03:50.660 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 29.410233556, 2024-09-12T03:03:50.660 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.198717794 2024-09-12T03:03:50.660 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.660 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmsnap_latency": { 2024-09-12T03:03:50.660 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 9, 2024-09-12T03:03:50.660 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 28.317061920, 2024-09-12T03:03:50.660 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 3.146340213 2024-09-12T03:03:50.660 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.660 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmxattr_latency": { 2024-09-12T03:03:50.661 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.661 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.661 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.661 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.661 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setattr_latency": { 2024-09-12T03:03:50.661 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 2, 2024-09-12T03:03:50.661 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.001989874, 2024-09-12T03:03:50.661 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000994937 2024-09-12T03:03:50.661 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.661 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setdirlayout_latency": { 2024-09-12T03:03:50.661 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.661 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.661 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.662 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.662 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setfilelock_latency": { 2024-09-12T03:03:50.662 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.662 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.662 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.662 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.662 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setlayout_latency": { 2024-09-12T03:03:50.662 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.662 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.662 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.662 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.662 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setxattr_latency": { 2024-09-12T03:03:50.662 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 8, 2024-09-12T03:03:50.663 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.021768171, 2024-09-12T03:03:50.663 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.002721021 2024-09-12T03:03:50.663 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.663 INFO:teuthology.orchestra.run.smithi062.stdout: "req_symlink_latency": { 2024-09-12T03:03:50.663 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.663 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.663 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.664 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.664 INFO:teuthology.orchestra.run.smithi062.stdout: "req_unlink_latency": { 2024-09-12T03:03:50.664 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 13549, 2024-09-12T03:03:50.664 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 29.983108260, 2024-09-12T03:03:50.664 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.002212938 2024-09-12T03:03:50.664 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.664 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_revoke_eviction": 0, 2024-09-12T03:03:50.664 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_acquisition_throttle": 0, 2024-09-12T03:03:50.664 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getvxattr_latency": { 2024-09-12T03:03:50.664 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.664 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.664 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.665 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:50.665 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.665 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_sessions": { 2024-09-12T03:03:50.665 INFO:teuthology.orchestra.run.smithi062.stdout: "session_count": 2, 2024-09-12T03:03:50.665 INFO:teuthology.orchestra.run.smithi062.stdout: "session_add": 5, 2024-09-12T03:03:50.665 INFO:teuthology.orchestra.run.smithi062.stdout: "session_remove": 3, 2024-09-12T03:03:50.665 INFO:teuthology.orchestra.run.smithi062.stdout: "sessions_open": 2, 2024-09-12T03:03:50.665 INFO:teuthology.orchestra.run.smithi062.stdout: "sessions_stale": 0, 2024-09-12T03:03:50.665 INFO:teuthology.orchestra.run.smithi062.stdout: "total_load": 8787, 2024-09-12T03:03:50.665 INFO:teuthology.orchestra.run.smithi062.stdout: "average_load": 4393, 2024-09-12T03:03:50.665 INFO:teuthology.orchestra.run.smithi062.stdout: "avg_session_uptime": 896, 2024-09-12T03:03:50.665 INFO:teuthology.orchestra.run.smithi062.stdout: "mdthresh_evicted": 0 2024-09-12T03:03:50.665 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.665 INFO:teuthology.orchestra.run.smithi062.stdout: "mempool": { 2024-09-12T03:03:50.666 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_bytes": 0, 2024-09-12T03:03:50.666 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_items": 0, 2024-09-12T03:03:50.666 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T03:03:50.666 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_items": 0, 2024-09-12T03:03:50.666 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T03:03:50.666 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_items": 0, 2024-09-12T03:03:50.666 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T03:03:50.666 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T03:03:50.666 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T03:03:50.666 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T03:03:50.666 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T03:03:50.666 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_items": 0, 2024-09-12T03:03:50.666 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T03:03:50.666 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T03:03:50.667 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_bytes": 0, 2024-09-12T03:03:50.667 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_items": 0, 2024-09-12T03:03:50.667 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_bytes": 0, 2024-09-12T03:03:50.667 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_items": 0, 2024-09-12T03:03:50.667 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T03:03:50.667 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T03:03:50.667 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T03:03:50.667 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T03:03:50.667 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T03:03:50.667 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_items": 0, 2024-09-12T03:03:50.667 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_bytes": 0, 2024-09-12T03:03:50.667 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_items": 0, 2024-09-12T03:03:50.667 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T03:03:50.668 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T03:03:50.668 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_bytes": 0, 2024-09-12T03:03:50.668 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_items": 0, 2024-09-12T03:03:50.668 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_bytes": 0, 2024-09-12T03:03:50.668 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_items": 0, 2024-09-12T03:03:50.668 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T03:03:50.668 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_items": 0, 2024-09-12T03:03:50.668 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T03:03:50.668 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_items": 0, 2024-09-12T03:03:50.668 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_bytes": 2742638, 2024-09-12T03:03:50.668 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_items": 22418, 2024-09-12T03:03:50.668 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_bytes": 2024, 2024-09-12T03:03:50.668 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_items": 23, 2024-09-12T03:03:50.669 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bytes": 0, 2024-09-12T03:03:50.669 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_items": 0, 2024-09-12T03:03:50.669 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_bytes": 0, 2024-09-12T03:03:50.669 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_items": 0, 2024-09-12T03:03:50.669 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_bytes": 0, 2024-09-12T03:03:50.669 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_items": 0, 2024-09-12T03:03:50.669 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_bytes": 10136, 2024-09-12T03:03:50.669 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_items": 215, 2024-09-12T03:03:50.669 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T03:03:50.669 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_items": 0, 2024-09-12T03:03:50.669 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_bytes": 0, 2024-09-12T03:03:50.669 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_items": 0, 2024-09-12T03:03:50.669 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_bytes": 83181493, 2024-09-12T03:03:50.669 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_items": 803846, 2024-09-12T03:03:50.670 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_bytes": 0, 2024-09-12T03:03:50.670 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_items": 0, 2024-09-12T03:03:50.670 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_bytes": 0, 2024-09-12T03:03:50.670 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_items": 0 2024-09-12T03:03:50.670 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.670 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter": { 2024-09-12T03:03:50.670 INFO:teuthology.orchestra.run.smithi062.stdout: "op_active": 6, 2024-09-12T03:03:50.670 INFO:teuthology.orchestra.run.smithi062.stdout: "op_laggy": 0, 2024-09-12T03:03:50.670 INFO:teuthology.orchestra.run.smithi062.stdout: "op_send": 82156, 2024-09-12T03:03:50.670 INFO:teuthology.orchestra.run.smithi062.stdout: "op_send_bytes": 367327187, 2024-09-12T03:03:50.671 INFO:teuthology.orchestra.run.smithi062.stdout: "op_resend": 37, 2024-09-12T03:03:50.671 INFO:teuthology.orchestra.run.smithi062.stdout: "op_reply": 82150, 2024-09-12T03:03:50.671 INFO:teuthology.orchestra.run.smithi062.stdout: "op_latency": { 2024-09-12T03:03:50.671 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 82150, 2024-09-12T03:03:50.671 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 92204.236094165, 2024-09-12T03:03:50.671 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 1.122388753 2024-09-12T03:03:50.671 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.671 INFO:teuthology.orchestra.run.smithi062.stdout: "op_inflight": 4, 2024-09-12T03:03:50.671 INFO:teuthology.orchestra.run.smithi062.stdout: "oplen_avg": { 2024-09-12T03:03:50.671 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 82156, 2024-09-12T03:03:50.671 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 166520 2024-09-12T03:03:50.671 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.671 INFO:teuthology.orchestra.run.smithi062.stdout: "op": 82156, 2024-09-12T03:03:50.672 INFO:teuthology.orchestra.run.smithi062.stdout: "op_r": 828, 2024-09-12T03:03:50.672 INFO:teuthology.orchestra.run.smithi062.stdout: "op_w": 81328, 2024-09-12T03:03:50.672 INFO:teuthology.orchestra.run.smithi062.stdout: "op_rmw": 0, 2024-09-12T03:03:50.672 INFO:teuthology.orchestra.run.smithi062.stdout: "op_pg": 0, 2024-09-12T03:03:50.672 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_stat": 4617, 2024-09-12T03:03:50.672 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_create": 47801, 2024-09-12T03:03:50.672 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_read": 317, 2024-09-12T03:03:50.672 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_write": 2476, 2024-09-12T03:03:50.672 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_writefull": 386, 2024-09-12T03:03:50.672 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_writesame": 0, 2024-09-12T03:03:50.672 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_append": 0, 2024-09-12T03:03:50.672 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_zero": 0, 2024-09-12T03:03:50.672 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_truncate": 74, 2024-09-12T03:03:50.673 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_delete": 24696, 2024-09-12T03:03:50.673 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_mapext": 0, 2024-09-12T03:03:50.673 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_sparse_read": 0, 2024-09-12T03:03:50.673 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_clonerange": 0, 2024-09-12T03:03:50.673 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_getxattr": 2, 2024-09-12T03:03:50.673 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_setxattr": 72195, 2024-09-12T03:03:50.673 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_cmpxattr": 0, 2024-09-12T03:03:50.673 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_rmxattr": 0, 2024-09-12T03:03:50.673 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_resetxattrs": 0, 2024-09-12T03:03:50.673 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_call": 0, 2024-09-12T03:03:50.673 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_watch": 0, 2024-09-12T03:03:50.673 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_notify": 0, 2024-09-12T03:03:50.673 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T03:03:50.673 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_pgls": 0, 2024-09-12T03:03:50.674 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_pgls_filter": 0, 2024-09-12T03:03:50.674 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_other": 0, 2024-09-12T03:03:50.674 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_active": 0, 2024-09-12T03:03:50.674 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_send": 0, 2024-09-12T03:03:50.674 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_resend": 0, 2024-09-12T03:03:50.674 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_ping": 0, 2024-09-12T03:03:50.674 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_active": 0, 2024-09-12T03:03:50.674 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_send": 0, 2024-09-12T03:03:50.674 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_resend": 0, 2024-09-12T03:03:50.674 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_active": 0, 2024-09-12T03:03:50.674 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_send": 0, 2024-09-12T03:03:50.674 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_resend": 0, 2024-09-12T03:03:50.674 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_active": 0, 2024-09-12T03:03:50.674 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_send": 0, 2024-09-12T03:03:50.675 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_resend": 0, 2024-09-12T03:03:50.675 INFO:teuthology.orchestra.run.smithi062.stdout: "command_active": 0, 2024-09-12T03:03:50.675 INFO:teuthology.orchestra.run.smithi062.stdout: "command_send": 0, 2024-09-12T03:03:50.675 INFO:teuthology.orchestra.run.smithi062.stdout: "command_resend": 0, 2024-09-12T03:03:50.675 INFO:teuthology.orchestra.run.smithi062.stdout: "map_epoch": 117, 2024-09-12T03:03:50.675 INFO:teuthology.orchestra.run.smithi062.stdout: "map_full": 0, 2024-09-12T03:03:50.675 INFO:teuthology.orchestra.run.smithi062.stdout: "map_inc": 30, 2024-09-12T03:03:50.675 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_sessions": 12, 2024-09-12T03:03:50.675 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_session_open": 12, 2024-09-12T03:03:50.675 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_session_close": 0, 2024-09-12T03:03:50.675 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_laggy": 0, 2024-09-12T03:03:50.675 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_wr": 10956, 2024-09-12T03:03:50.675 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_rd": 664, 2024-09-12T03:03:50.676 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_del": 2336 2024-09-12T03:03:50.676 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.676 INFO:teuthology.orchestra.run.smithi062.stdout: "oft": { 2024-09-12T03:03:50.676 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_objs": 1, 2024-09-12T03:03:50.676 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_kv_pairs": 0, 2024-09-12T03:03:50.676 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_updates": 0, 2024-09-12T03:03:50.676 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_removes": 0 2024-09-12T03:03:50.676 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.676 INFO:teuthology.orchestra.run.smithi062.stdout: "osd-slow-ops": { 2024-09-12T03:03:50.676 INFO:teuthology.orchestra.run.smithi062.stdout: "slow_ops_count": 9 2024-09-12T03:03:50.676 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.676 INFO:teuthology.orchestra.run.smithi062.stdout: "purge_queue": { 2024-09-12T03:03:50.676 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_ops": 10, 2024-09-12T03:03:50.676 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_ops_high_water": 10, 2024-09-12T03:03:50.677 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing": 5, 2024-09-12T03:03:50.677 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_high_water": 5, 2024-09-12T03:03:50.677 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executed_ops": 24038, 2024-09-12T03:03:50.677 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executed": 12019, 2024-09-12T03:03:50.677 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_item_in_journal": 3744 2024-09-12T03:03:50.677 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.677 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T03:03:50.677 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T03:03:50.677 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-09-12T03:03:50.677 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:03:50.677 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 277692, 2024-09-12T03:03:50.677 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 99089608, 2024-09-12T03:03:50.677 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:50.678 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 277692, 2024-09-12T03:03:50.678 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-09-12T03:03:50.678 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-09-12T03:03:50.678 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 277692, 2024-09-12T03:03:50.678 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 99089608, 2024-09-12T03:03:50.678 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:03:50.678 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.678 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.678 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.678 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:50.678 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.678 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-objecter_bytes": { 2024-09-12T03:03:50.678 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T03:03:50.679 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-09-12T03:03:50.679 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:03:50.679 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-09-12T03:03:50.679 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-09-12T03:03:50.679 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:50.679 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-09-12T03:03:50.679 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 82156, 2024-09-12T03:03:50.679 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 369475106, 2024-09-12T03:03:50.679 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 82150, 2024-09-12T03:03:50.679 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 369475106, 2024-09-12T03:03:50.679 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:03:50.679 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.679 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.679 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.680 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:50.680 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.680 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-objecter_ops": { 2024-09-12T03:03:50.680 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 6, 2024-09-12T03:03:50.680 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 1024, 2024-09-12T03:03:50.680 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:03:50.680 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-09-12T03:03:50.680 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-09-12T03:03:50.680 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:50.681 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-09-12T03:03:50.681 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 82156, 2024-09-12T03:03:50.681 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 82156, 2024-09-12T03:03:50.681 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 82150, 2024-09-12T03:03:50.681 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 82150, 2024-09-12T03:03:50.681 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:03:50.681 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.681 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.681 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.681 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:50.681 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.681 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-write_buf_throttle": { 2024-09-12T03:03:50.682 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T03:03:50.682 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 3758096384, 2024-09-12T03:03:50.682 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:03:50.682 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 14417, 2024-09-12T03:03:50.682 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 2162533, 2024-09-12T03:03:50.682 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:50.682 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 14417, 2024-09-12T03:03:50.682 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-09-12T03:03:50.682 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-09-12T03:03:50.682 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 317, 2024-09-12T03:03:50.682 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 2162533, 2024-09-12T03:03:50.682 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:03:50.682 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.682 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.683 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.683 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:50.683 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:50.683 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-write_buf_throttle-0x5630faea4960": { 2024-09-12T03:03:50.683 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T03:03:50.683 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 3758096384, 2024-09-12T03:03:50.683 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:03:50.683 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 95129, 2024-09-12T03:03:50.683 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 287764247, 2024-09-12T03:03:50.683 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:50.683 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 95129, 2024-09-12T03:03:50.683 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-09-12T03:03:50.683 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-09-12T03:03:50.684 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 2158, 2024-09-12T03:03:50.684 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 287764247, 2024-09-12T03:03:50.684 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:03:50.684 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:50.684 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:50.684 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:50.684 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:50.684 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:50.684 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T03:03:50.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:50 smithi176 ceph-mon[35713]: pgmap v474: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 158 op/s 2024-09-12T03:03:50.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:50 smithi018 ceph-mon[30616]: pgmap v474: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 158 op/s 2024-09-12T03:03:51.872 INFO:tasks.check_counter:Daemon mds.b mds.exported=257 2024-09-12T03:03:51.872 INFO:tasks.check_counter:Daemon mds.b mds.imported=289 2024-09-12T03:03:51.872 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-12T03:03:51.872 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=15 2024-09-12T03:03:51.872 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=9 2024-09-12T03:03:51.872 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=74 2024-09-12T03:03:51.872 DEBUG:tasks.check_counter:Getting stats from e 2024-09-12T03:03:51.873 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-12T03:03:52.352 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T03:03:52.634 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:52 smithi062 ceph-mon[35527]: pgmap v475: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.1 KiB/s wr, 179 op/s 2024-09-12T03:03:52.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:52 smithi176 ceph-mon[35713]: pgmap v475: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.1 KiB/s wr, 179 op/s 2024-09-12T03:03:52.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:52 smithi018 ceph-mon[30616]: pgmap v475: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.1 KiB/s wr, 179 op/s 2024-09-12T03:03:53.027 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T03:03:53.027 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T03:03:53.028 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 2021, 2024-09-12T03:03:53.028 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 1961, 2024-09-12T03:03:53.028 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 64960234, 2024-09-12T03:03:53.028 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 709982, 2024-09-12T03:03:53.028 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 7, 2024-09-12T03:03:53.028 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 3, 2024-09-12T03:03:53.028 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.248829832, 2024-09-12T03:03:53.028 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.065866898, 2024-09-12T03:03:53.028 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.129946697, 2024-09-12T03:03:53.028 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.060045332, 2024-09-12T03:03:53.028 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:53.028 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 1960, 2024-09-12T03:03:53.029 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.101305222, 2024-09-12T03:03:53.029 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000051686 2024-09-12T03:03:53.029 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.029 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:53.029 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.029 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.029 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.029 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.029 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 2105280, 2024-09-12T03:03:53.029 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 190688 2024-09-12T03:03:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T03:03:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 648, 2024-09-12T03:03:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 874, 2024-09-12T03:03:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 96659834, 2024-09-12T03:03:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 755212, 2024-09-12T03:03:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 9, 2024-09-12T03:03:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 7, 2024-09-12T03:03:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.116606123, 2024-09-12T03:03:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.021245827, 2024-09-12T03:03:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.072982912, 2024-09-12T03:03:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.016397131, 2024-09-12T03:03:53.031 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:53.031 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 872, 2024-09-12T03:03:53.031 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.071672901, 2024-09-12T03:03:53.031 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000082193 2024-09-12T03:03:53.031 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.031 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:53.031 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.031 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.031 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.031 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.031 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-12T03:03:53.031 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 551312 2024-09-12T03:03:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T03:03:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 1378, 2024-09-12T03:03:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 1380, 2024-09-12T03:03:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 126205811, 2024-09-12T03:03:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 438211, 2024-09-12T03:03:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 6, 2024-09-12T03:03:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 5, 2024-09-12T03:03:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.171116312, 2024-09-12T03:03:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.025255898, 2024-09-12T03:03:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.102096769, 2024-09-12T03:03:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.035400856, 2024-09-12T03:03:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 1378, 2024-09-12T03:03:53.033 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.057906087, 2024-09-12T03:03:53.033 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000042021 2024-09-12T03:03:53.033 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.033 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:53.033 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.033 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.033 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.033 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.033 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T03:03:53.033 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T03:03:53.033 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.033 INFO:teuthology.orchestra.run.smithi062.stdout: "cct": { 2024-09-12T03:03:53.033 INFO:teuthology.orchestra.run.smithi062.stdout: "total_workers": 1, 2024-09-12T03:03:53.033 INFO:teuthology.orchestra.run.smithi062.stdout: "unhealthy_workers": 0 2024-09-12T03:03:53.034 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.034 INFO:teuthology.orchestra.run.smithi062.stdout: "finisher-MDSRank": { 2024-09-12T03:03:53.034 INFO:teuthology.orchestra.run.smithi062.stdout: "queue_len": 0, 2024-09-12T03:03:53.034 INFO:teuthology.orchestra.run.smithi062.stdout: "complete_latency": { 2024-09-12T03:03:53.034 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 6011, 2024-09-12T03:03:53.034 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.146754999, 2024-09-12T03:03:53.034 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000024414 2024-09-12T03:03:53.034 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:53.034 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.034 INFO:teuthology.orchestra.run.smithi062.stdout: "finisher-PurgeQueue": { 2024-09-12T03:03:53.034 INFO:teuthology.orchestra.run.smithi062.stdout: "queue_len": 0, 2024-09-12T03:03:53.034 INFO:teuthology.orchestra.run.smithi062.stdout: "complete_latency": { 2024-09-12T03:03:53.034 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.035 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.035 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.035 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:53.035 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.035 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-09-12T03:03:53.035 INFO:teuthology.orchestra.run.smithi062.stdout: "request": 0, 2024-09-12T03:03:53.035 INFO:teuthology.orchestra.run.smithi062.stdout: "reply": 0, 2024-09-12T03:03:53.035 INFO:teuthology.orchestra.run.smithi062.stdout: "reply_latency": { 2024-09-12T03:03:53.035 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.035 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.035 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.035 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.035 INFO:teuthology.orchestra.run.smithi062.stdout: "slow_reply": 0, 2024-09-12T03:03:53.035 INFO:teuthology.orchestra.run.smithi062.stdout: "forward": 0, 2024-09-12T03:03:53.035 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_fetch_complete": 0, 2024-09-12T03:03:53.036 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_fetch_keys": 0, 2024-09-12T03:03:53.036 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_commit": 0, 2024-09-12T03:03:53.036 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_split": 0, 2024-09-12T03:03:53.036 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_merge": 0, 2024-09-12T03:03:53.036 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes": 36522, 2024-09-12T03:03:53.036 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_top": 4139, 2024-09-12T03:03:53.036 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_bottom": 32383, 2024-09-12T03:03:53.036 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_pin_tail": 0, 2024-09-12T03:03:53.036 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_pinned": 30609, 2024-09-12T03:03:53.036 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_expired": 2, 2024-09-12T03:03:53.036 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_with_caps": 0, 2024-09-12T03:03:53.036 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": 0, 2024-09-12T03:03:53.036 INFO:teuthology.orchestra.run.smithi062.stdout: "subtrees": 1, 2024-09-12T03:03:53.036 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse": 0, 2024-09-12T03:03:53.037 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_hit": 0, 2024-09-12T03:03:53.037 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_forward": 0, 2024-09-12T03:03:53.037 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_discover": 0, 2024-09-12T03:03:53.037 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_dir_fetch": 0, 2024-09-12T03:03:53.037 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_remote_ino": 0, 2024-09-12T03:03:53.037 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_lock": 0, 2024-09-12T03:03:53.037 INFO:teuthology.orchestra.run.smithi062.stdout: "load_cent": 0, 2024-09-12T03:03:53.037 INFO:teuthology.orchestra.run.smithi062.stdout: "q": 0, 2024-09-12T03:03:53.037 INFO:teuthology.orchestra.run.smithi062.stdout: "exported": 0, 2024-09-12T03:03:53.037 INFO:teuthology.orchestra.run.smithi062.stdout: "exported_inodes": 0, 2024-09-12T03:03:53.037 INFO:teuthology.orchestra.run.smithi062.stdout: "imported": 0, 2024-09-12T03:03:53.037 INFO:teuthology.orchestra.run.smithi062.stdout: "imported_inodes": 0, 2024-09-12T03:03:53.037 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_dir_fetch": 0, 2024-09-12T03:03:53.037 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_backtrace_fetch": 0, 2024-09-12T03:03:53.038 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_peer_discover": 0, 2024-09-12T03:03:53.038 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rfiles": 0, 2024-09-12T03:03:53.038 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rbytes": 0, 2024-09-12T03:03:53.038 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rsnaps": 0, 2024-09-12T03:03:53.038 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T03:03:53.038 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_set_tag": 0, 2024-09-12T03:03:53.038 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T03:03:53.038 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_inotable_repaired": 0, 2024-09-12T03:03:53.038 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dir_inodes": 0, 2024-09-12T03:03:53.038 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T03:03:53.038 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T03:03:53.038 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_file_inodes": 0, 2024-09-12T03:03:53.038 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_inode_file_caps": 0, 2024-09-12T03:03:53.039 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T03:03:53.039 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_grant": 0, 2024-09-12T03:03:53.039 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T03:03:53.039 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T03:03:53.039 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T03:03:53.039 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_caps": 0, 2024-09-12T03:03:53.039 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_caps_dirty": 0, 2024-09-12T03:03:53.039 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_cap_release": 0, 2024-09-12T03:03:53.039 INFO:teuthology.orchestra.run.smithi062.stdout: "process_request_cap_release": 0 2024-09-12T03:03:53.039 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.039 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache": { 2024-09-12T03:03:53.039 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_update": 0, 2024-09-12T03:03:53.039 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_update_receipt": 0, 2024-09-12T03:03:53.039 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_try_discover": 0, 2024-09-12T03:03:53.040 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_send_discover": 0, 2024-09-12T03:03:53.040 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_handle_discover": 0, 2024-09-12T03:03:53.040 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays": 0, 2024-09-12T03:03:53.040 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays_delayed": 0, 2024-09-12T03:03:53.040 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays_enqueuing": 0, 2024-09-12T03:03:53.040 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_created": 0, 2024-09-12T03:03:53.040 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_enqueued": 0, 2024-09-12T03:03:53.040 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_reintegrated": 0, 2024-09-12T03:03:53.040 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_migrated": 0, 2024-09-12T03:03:53.040 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_processing": 0, 2024-09-12T03:03:53.040 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_enqueued": 0, 2024-09-12T03:03:53.040 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_prioritized": 0, 2024-09-12T03:03:53.040 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_started": 0, 2024-09-12T03:03:53.041 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_completed": 0, 2024-09-12T03:03:53.041 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_quiesce_path": 0, 2024-09-12T03:03:53.041 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_quiesce_inode": 0, 2024-09-12T03:03:53.041 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T03:03:53.041 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_exportdir": 0, 2024-09-12T03:03:53.041 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_flush": 0, 2024-09-12T03:03:53.041 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_fragmentdir": 0, 2024-09-12T03:03:53.041 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_fragstats": 0, 2024-09-12T03:03:53.041 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_inodestats": 0 2024-09-12T03:03:53.041 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.041 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log": { 2024-09-12T03:03:53.041 INFO:teuthology.orchestra.run.smithi062.stdout: "evlrg": 0, 2024-09-12T03:03:53.041 INFO:teuthology.orchestra.run.smithi062.stdout: "evadd": 0, 2024-09-12T03:03:53.042 INFO:teuthology.orchestra.run.smithi062.stdout: "evex": 0, 2024-09-12T03:03:53.042 INFO:teuthology.orchestra.run.smithi062.stdout: "evtrm": 0, 2024-09-12T03:03:53.042 INFO:teuthology.orchestra.run.smithi062.stdout: "ev": 80592, 2024-09-12T03:03:53.042 INFO:teuthology.orchestra.run.smithi062.stdout: "evexg": 0, 2024-09-12T03:03:53.042 INFO:teuthology.orchestra.run.smithi062.stdout: "evexd": 0, 2024-09-12T03:03:53.042 INFO:teuthology.orchestra.run.smithi062.stdout: "segadd": 0, 2024-09-12T03:03:53.042 INFO:teuthology.orchestra.run.smithi062.stdout: "segex": 0, 2024-09-12T03:03:53.042 INFO:teuthology.orchestra.run.smithi062.stdout: "segtrm": 0, 2024-09-12T03:03:53.042 INFO:teuthology.orchestra.run.smithi062.stdout: "seg": 115, 2024-09-12T03:03:53.042 INFO:teuthology.orchestra.run.smithi062.stdout: "segmjr": 8, 2024-09-12T03:03:53.042 INFO:teuthology.orchestra.run.smithi062.stdout: "segexg": 0, 2024-09-12T03:03:53.042 INFO:teuthology.orchestra.run.smithi062.stdout: "segexd": 0, 2024-09-12T03:03:53.042 INFO:teuthology.orchestra.run.smithi062.stdout: "expos": 4194304, 2024-09-12T03:03:53.043 INFO:teuthology.orchestra.run.smithi062.stdout: "wrpos": 288846451, 2024-09-12T03:03:53.043 INFO:teuthology.orchestra.run.smithi062.stdout: "rdpos": 288837268, 2024-09-12T03:03:53.043 INFO:teuthology.orchestra.run.smithi062.stdout: "jlat": { 2024-09-12T03:03:53.043 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.043 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.043 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.043 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.043 INFO:teuthology.orchestra.run.smithi062.stdout: "replayed": 80592 2024-09-12T03:03:53.043 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.043 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_mem": { 2024-09-12T03:03:53.043 INFO:teuthology.orchestra.run.smithi062.stdout: "ino": 11599, 2024-09-12T03:03:53.043 INFO:teuthology.orchestra.run.smithi062.stdout: "ino+": 51102, 2024-09-12T03:03:53.043 INFO:teuthology.orchestra.run.smithi062.stdout: "ino-": 39503, 2024-09-12T03:03:53.043 INFO:teuthology.orchestra.run.smithi062.stdout: "dir": 490, 2024-09-12T03:03:53.043 INFO:teuthology.orchestra.run.smithi062.stdout: "dir+": 1727, 2024-09-12T03:03:53.044 INFO:teuthology.orchestra.run.smithi062.stdout: "dir-": 1237, 2024-09-12T03:03:53.044 INFO:teuthology.orchestra.run.smithi062.stdout: "dn": 36522, 2024-09-12T03:03:53.044 INFO:teuthology.orchestra.run.smithi062.stdout: "dn+": 85720, 2024-09-12T03:03:53.044 INFO:teuthology.orchestra.run.smithi062.stdout: "dn-": 49198, 2024-09-12T03:03:53.044 INFO:teuthology.orchestra.run.smithi062.stdout: "cap": 0, 2024-09-12T03:03:53.044 INFO:teuthology.orchestra.run.smithi062.stdout: "cap+": 0, 2024-09-12T03:03:53.044 INFO:teuthology.orchestra.run.smithi062.stdout: "cap-": 0, 2024-09-12T03:03:53.044 INFO:teuthology.orchestra.run.smithi062.stdout: "rss": 128008, 2024-09-12T03:03:53.044 INFO:teuthology.orchestra.run.smithi062.stdout: "heap": 215328 2024-09-12T03:03:53.044 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.044 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_server": { 2024-09-12T03:03:53.044 INFO:teuthology.orchestra.run.smithi062.stdout: "dispatch_client_request": 0, 2024-09-12T03:03:53.044 INFO:teuthology.orchestra.run.smithi062.stdout: "dispatch_server_request": 0, 2024-09-12T03:03:53.044 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_request": 0, 2024-09-12T03:03:53.045 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_session": 0, 2024-09-12T03:03:53.045 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_peer_request": 0, 2024-09-12T03:03:53.045 INFO:teuthology.orchestra.run.smithi062.stdout: "req_create_latency": { 2024-09-12T03:03:53.045 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.045 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.045 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.045 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.045 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getattr_latency": { 2024-09-12T03:03:53.045 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.045 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.045 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.045 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.045 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getfilelock_latency": { 2024-09-12T03:03:53.046 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.046 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.046 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.046 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.046 INFO:teuthology.orchestra.run.smithi062.stdout: "req_link_latency": { 2024-09-12T03:03:53.046 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.046 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.046 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.046 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.046 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookup_latency": { 2024-09-12T03:03:53.046 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.046 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.046 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.047 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.047 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookuphash_latency": { 2024-09-12T03:03:53.047 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.047 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.047 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.047 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.047 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupino_latency": { 2024-09-12T03:03:53.047 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.047 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.047 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.047 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.047 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupname_latency": { 2024-09-12T03:03:53.047 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.048 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.048 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.048 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.048 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupparent_latency": { 2024-09-12T03:03:53.048 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.048 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.048 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.048 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.048 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupsnap_latency": { 2024-09-12T03:03:53.048 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.048 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.048 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.048 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.048 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lssnap_latency": { 2024-09-12T03:03:53.049 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.049 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.049 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.049 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.049 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mkdir_latency": { 2024-09-12T03:03:53.050 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.050 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.050 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.050 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.050 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mknod_latency": { 2024-09-12T03:03:53.050 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.050 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.050 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.050 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.050 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mksnap_latency": { 2024-09-12T03:03:53.050 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.051 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.051 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.051 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.051 INFO:teuthology.orchestra.run.smithi062.stdout: "req_open_latency": { 2024-09-12T03:03:53.051 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.051 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.051 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.051 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.051 INFO:teuthology.orchestra.run.smithi062.stdout: "req_readdir_latency": { 2024-09-12T03:03:53.051 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.051 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.051 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.051 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.052 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rename_latency": { 2024-09-12T03:03:53.052 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.052 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.052 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.052 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.052 INFO:teuthology.orchestra.run.smithi062.stdout: "req_renamesnap_latency": { 2024-09-12T03:03:53.052 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.052 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.052 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.052 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.052 INFO:teuthology.orchestra.run.smithi062.stdout: "req_snapdiff_latency": { 2024-09-12T03:03:53.052 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.052 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.052 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.053 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.053 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmdir_latency": { 2024-09-12T03:03:53.053 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.053 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.053 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.053 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.053 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmsnap_latency": { 2024-09-12T03:03:53.053 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.053 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.053 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.053 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.053 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmxattr_latency": { 2024-09-12T03:03:53.053 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.053 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.054 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.054 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.054 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setattr_latency": { 2024-09-12T03:03:53.054 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.054 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.054 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.054 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.054 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setdirlayout_latency": { 2024-09-12T03:03:53.054 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.055 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.055 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.055 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.055 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setfilelock_latency": { 2024-09-12T03:03:53.055 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.055 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.055 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.055 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.055 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setlayout_latency": { 2024-09-12T03:03:53.055 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.055 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.055 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.055 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.056 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setxattr_latency": { 2024-09-12T03:03:53.056 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.056 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.056 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.056 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.056 INFO:teuthology.orchestra.run.smithi062.stdout: "req_symlink_latency": { 2024-09-12T03:03:53.056 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.056 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.056 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.056 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.056 INFO:teuthology.orchestra.run.smithi062.stdout: "req_unlink_latency": { 2024-09-12T03:03:53.056 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.056 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.057 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.057 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.057 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_revoke_eviction": 0, 2024-09-12T03:03:53.057 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_acquisition_throttle": 0, 2024-09-12T03:03:53.057 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getvxattr_latency": { 2024-09-12T03:03:53.057 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.057 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.057 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.057 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:53.057 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.057 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_sessions": { 2024-09-12T03:03:53.057 INFO:teuthology.orchestra.run.smithi062.stdout: "session_count": 1, 2024-09-12T03:03:53.057 INFO:teuthology.orchestra.run.smithi062.stdout: "session_add": 2, 2024-09-12T03:03:53.058 INFO:teuthology.orchestra.run.smithi062.stdout: "session_remove": 1, 2024-09-12T03:03:53.058 INFO:teuthology.orchestra.run.smithi062.stdout: "sessions_open": 2, 2024-09-12T03:03:53.058 INFO:teuthology.orchestra.run.smithi062.stdout: "sessions_stale": 0, 2024-09-12T03:03:53.058 INFO:teuthology.orchestra.run.smithi062.stdout: "total_load": 0, 2024-09-12T03:03:53.058 INFO:teuthology.orchestra.run.smithi062.stdout: "average_load": 0, 2024-09-12T03:03:53.058 INFO:teuthology.orchestra.run.smithi062.stdout: "avg_session_uptime": 3756, 2024-09-12T03:03:53.058 INFO:teuthology.orchestra.run.smithi062.stdout: "mdthresh_evicted": 0 2024-09-12T03:03:53.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.058 INFO:teuthology.orchestra.run.smithi062.stdout: "mempool": { 2024-09-12T03:03:53.058 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_bytes": 0, 2024-09-12T03:03:53.058 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_items": 0, 2024-09-12T03:03:53.058 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T03:03:53.058 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_items": 0, 2024-09-12T03:03:53.059 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T03:03:53.059 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_items": 0, 2024-09-12T03:03:53.059 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T03:03:53.059 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T03:03:53.059 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T03:03:53.059 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T03:03:53.059 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T03:03:53.059 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_items": 0, 2024-09-12T03:03:53.059 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T03:03:53.060 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T03:03:53.060 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_bytes": 0, 2024-09-12T03:03:53.060 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_items": 0, 2024-09-12T03:03:53.060 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_bytes": 0, 2024-09-12T03:03:53.060 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_items": 0, 2024-09-12T03:03:53.060 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T03:03:53.060 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T03:03:53.061 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T03:03:53.061 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T03:03:53.061 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T03:03:53.061 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_items": 0, 2024-09-12T03:03:53.061 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_bytes": 0, 2024-09-12T03:03:53.061 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_items": 0, 2024-09-12T03:03:53.061 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T03:03:53.061 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T03:03:53.061 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_bytes": 0, 2024-09-12T03:03:53.061 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_items": 0, 2024-09-12T03:03:53.061 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_bytes": 0, 2024-09-12T03:03:53.061 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_items": 0, 2024-09-12T03:03:53.062 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T03:03:53.062 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_items": 0, 2024-09-12T03:03:53.062 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T03:03:53.062 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_items": 0, 2024-09-12T03:03:53.062 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_bytes": 679971, 2024-09-12T03:03:53.062 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_items": 11966, 2024-09-12T03:03:53.062 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_bytes": 0, 2024-09-12T03:03:53.062 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_items": 0, 2024-09-12T03:03:53.062 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bytes": 0, 2024-09-12T03:03:53.062 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_items": 0, 2024-09-12T03:03:53.062 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_bytes": 0, 2024-09-12T03:03:53.062 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_items": 0, 2024-09-12T03:03:53.062 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_bytes": 0, 2024-09-12T03:03:53.062 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_items": 0, 2024-09-12T03:03:53.063 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_bytes": 10136, 2024-09-12T03:03:53.063 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_items": 215, 2024-09-12T03:03:53.063 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T03:03:53.063 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_items": 0, 2024-09-12T03:03:53.063 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_bytes": 0, 2024-09-12T03:03:53.063 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_items": 0, 2024-09-12T03:03:53.063 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_bytes": 53595094, 2024-09-12T03:03:53.063 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_items": 521062, 2024-09-12T03:03:53.063 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_bytes": 0, 2024-09-12T03:03:53.063 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_items": 0, 2024-09-12T03:03:53.063 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_bytes": 0, 2024-09-12T03:03:53.063 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_items": 0 2024-09-12T03:03:53.063 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.064 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter": { 2024-09-12T03:03:53.064 INFO:teuthology.orchestra.run.smithi062.stdout: "op_active": 0, 2024-09-12T03:03:53.064 INFO:teuthology.orchestra.run.smithi062.stdout: "op_laggy": 0, 2024-09-12T03:03:53.064 INFO:teuthology.orchestra.run.smithi062.stdout: "op_send": 3652, 2024-09-12T03:03:53.064 INFO:teuthology.orchestra.run.smithi062.stdout: "op_send_bytes": 21, 2024-09-12T03:03:53.064 INFO:teuthology.orchestra.run.smithi062.stdout: "op_resend": 3, 2024-09-12T03:03:53.064 INFO:teuthology.orchestra.run.smithi062.stdout: "op_reply": 3652, 2024-09-12T03:03:53.064 INFO:teuthology.orchestra.run.smithi062.stdout: "op_latency": { 2024-09-12T03:03:53.064 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 3652, 2024-09-12T03:03:53.064 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 34.358452174, 2024-09-12T03:03:53.064 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.009408119 2024-09-12T03:03:53.064 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.064 INFO:teuthology.orchestra.run.smithi062.stdout: "op_inflight": 0, 2024-09-12T03:03:53.065 INFO:teuthology.orchestra.run.smithi062.stdout: "oplen_avg": { 2024-09-12T03:03:53.065 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 3652, 2024-09-12T03:03:53.065 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 3653 2024-09-12T03:03:53.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.065 INFO:teuthology.orchestra.run.smithi062.stdout: "op": 3652, 2024-09-12T03:03:53.065 INFO:teuthology.orchestra.run.smithi062.stdout: "op_r": 3652, 2024-09-12T03:03:53.065 INFO:teuthology.orchestra.run.smithi062.stdout: "op_w": 0, 2024-09-12T03:03:53.065 INFO:teuthology.orchestra.run.smithi062.stdout: "op_rmw": 0, 2024-09-12T03:03:53.065 INFO:teuthology.orchestra.run.smithi062.stdout: "op_pg": 0, 2024-09-12T03:03:53.065 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_stat": 2185, 2024-09-12T03:03:53.065 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_create": 0, 2024-09-12T03:03:53.065 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_read": 1465, 2024-09-12T03:03:53.065 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_write": 0, 2024-09-12T03:03:53.065 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_writefull": 0, 2024-09-12T03:03:53.066 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_writesame": 0, 2024-09-12T03:03:53.066 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_append": 0, 2024-09-12T03:03:53.066 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_zero": 0, 2024-09-12T03:03:53.066 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_truncate": 0, 2024-09-12T03:03:53.066 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_delete": 0, 2024-09-12T03:03:53.066 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_mapext": 0, 2024-09-12T03:03:53.066 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_sparse_read": 0, 2024-09-12T03:03:53.066 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_clonerange": 0, 2024-09-12T03:03:53.066 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_getxattr": 1, 2024-09-12T03:03:53.066 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_setxattr": 0, 2024-09-12T03:03:53.066 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_cmpxattr": 0, 2024-09-12T03:03:53.066 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_rmxattr": 0, 2024-09-12T03:03:53.067 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_resetxattrs": 0, 2024-09-12T03:03:53.067 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_call": 0, 2024-09-12T03:03:53.067 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_watch": 0, 2024-09-12T03:03:53.067 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_notify": 0, 2024-09-12T03:03:53.067 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T03:03:53.067 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_pgls": 0, 2024-09-12T03:03:53.067 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_pgls_filter": 0, 2024-09-12T03:03:53.067 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_other": 0, 2024-09-12T03:03:53.067 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_active": 0, 2024-09-12T03:03:53.067 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_send": 0, 2024-09-12T03:03:53.067 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_resend": 0, 2024-09-12T03:03:53.067 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_ping": 0, 2024-09-12T03:03:53.067 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_active": 0, 2024-09-12T03:03:53.067 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_send": 0, 2024-09-12T03:03:53.068 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_resend": 0, 2024-09-12T03:03:53.068 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_active": 0, 2024-09-12T03:03:53.068 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_send": 0, 2024-09-12T03:03:53.068 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_resend": 0, 2024-09-12T03:03:53.068 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_active": 0, 2024-09-12T03:03:53.068 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_send": 0, 2024-09-12T03:03:53.068 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_resend": 0, 2024-09-12T03:03:53.068 INFO:teuthology.orchestra.run.smithi062.stdout: "command_active": 0, 2024-09-12T03:03:53.068 INFO:teuthology.orchestra.run.smithi062.stdout: "command_send": 0, 2024-09-12T03:03:53.068 INFO:teuthology.orchestra.run.smithi062.stdout: "command_resend": 0, 2024-09-12T03:03:53.068 INFO:teuthology.orchestra.run.smithi062.stdout: "map_epoch": 117, 2024-09-12T03:03:53.068 INFO:teuthology.orchestra.run.smithi062.stdout: "map_full": 0, 2024-09-12T03:03:53.068 INFO:teuthology.orchestra.run.smithi062.stdout: "map_inc": 21, 2024-09-12T03:03:53.069 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_sessions": 11, 2024-09-12T03:03:53.069 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_session_open": 11, 2024-09-12T03:03:53.069 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_session_close": 0, 2024-09-12T03:03:53.069 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_laggy": 0, 2024-09-12T03:03:53.069 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_wr": 0, 2024-09-12T03:03:53.069 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_rd": 2, 2024-09-12T03:03:53.069 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_del": 0 2024-09-12T03:03:53.069 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.069 INFO:teuthology.orchestra.run.smithi062.stdout: "oft": { 2024-09-12T03:03:53.069 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_objs": 0, 2024-09-12T03:03:53.069 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_kv_pairs": 0, 2024-09-12T03:03:53.069 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_updates": 0, 2024-09-12T03:03:53.069 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_removes": 0 2024-09-12T03:03:53.069 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.070 INFO:teuthology.orchestra.run.smithi062.stdout: "osd-slow-ops": { 2024-09-12T03:03:53.070 INFO:teuthology.orchestra.run.smithi062.stdout: "slow_ops_count": 0 2024-09-12T03:03:53.070 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.070 INFO:teuthology.orchestra.run.smithi062.stdout: "purge_queue": { 2024-09-12T03:03:53.070 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_ops": 0, 2024-09-12T03:03:53.070 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T03:03:53.070 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing": 0, 2024-09-12T03:03:53.070 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_high_water": 0, 2024-09-12T03:03:53.070 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executed_ops": 0, 2024-09-12T03:03:53.070 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executed": 0, 2024-09-12T03:03:53.070 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_item_in_journal": 0 2024-09-12T03:03:53.070 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.070 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T03:03:53.070 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T03:03:53.070 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-09-12T03:03:53.071 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:03:53.071 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 4043, 2024-09-12T03:03:53.071 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 287439374, 2024-09-12T03:03:53.071 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:53.071 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 4043, 2024-09-12T03:03:53.071 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-09-12T03:03:53.071 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-09-12T03:03:53.071 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 4043, 2024-09-12T03:03:53.071 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 287439374, 2024-09-12T03:03:53.071 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:03:53.071 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.071 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.071 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.071 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:53.072 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.072 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-objecter_bytes": { 2024-09-12T03:03:53.072 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T03:03:53.072 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-09-12T03:03:53.072 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:03:53.072 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-09-12T03:03:53.072 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-09-12T03:03:53.072 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:53.072 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-09-12T03:03:53.072 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 3652, 2024-09-12T03:03:53.072 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 284701917, 2024-09-12T03:03:53.072 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 3652, 2024-09-12T03:03:53.072 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 284701917, 2024-09-12T03:03:53.073 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:03:53.073 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.073 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.073 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.073 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:53.073 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.073 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-objecter_ops": { 2024-09-12T03:03:53.073 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T03:03:53.073 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 1024, 2024-09-12T03:03:53.073 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:03:53.073 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-09-12T03:03:53.073 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-09-12T03:03:53.073 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:53.074 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-09-12T03:03:53.074 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 3652, 2024-09-12T03:03:53.074 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 3652, 2024-09-12T03:03:53.074 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 3652, 2024-09-12T03:03:53.074 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 3652, 2024-09-12T03:03:53.074 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:03:53.074 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.074 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.074 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.074 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:53.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.074 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-write_buf_throttle": { 2024-09-12T03:03:53.074 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T03:03:53.075 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 3758096384, 2024-09-12T03:03:53.075 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:03:53.075 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-09-12T03:03:53.075 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-09-12T03:03:53.075 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:53.075 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-09-12T03:03:53.075 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-09-12T03:03:53.075 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-09-12T03:03:53.075 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 0, 2024-09-12T03:03:53.075 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 0, 2024-09-12T03:03:53.075 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:03:53.075 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.075 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.075 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.075 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:53.076 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:53.076 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-write_buf_throttle-0x5590cafc0b40": { 2024-09-12T03:03:53.076 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T03:03:53.076 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 3758096384, 2024-09-12T03:03:53.076 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:03:53.076 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-09-12T03:03:53.076 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-09-12T03:03:53.076 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:53.076 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-09-12T03:03:53.076 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-09-12T03:03:53.076 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-09-12T03:03:53.076 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 0, 2024-09-12T03:03:53.076 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 0, 2024-09-12T03:03:53.076 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:03:53.077 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:53.077 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:53.077 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:53.077 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:53.077 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:53.077 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T03:03:54.475 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-12T03:03:54.475 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-12T03:03:54.475 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-12T03:03:54.475 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-12T03:03:54.475 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T03:03:54.475 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-12T03:03:54.475 DEBUG:tasks.check_counter:Getting stats from h 2024-09-12T03:03:54.476 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-12T03:03:54.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:54 smithi176 ceph-mon[35713]: pgmap v476: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 149 op/s 2024-09-12T03:03:54.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:54 smithi062 ceph-mon[35527]: pgmap v476: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 149 op/s 2024-09-12T03:03:54.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:54 smithi018 ceph-mon[30616]: pgmap v476: 129 pgs: 60 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 49 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 149 op/s 2024-09-12T03:03:54.930 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T03:03:56.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:56 smithi062 ceph-mon[35527]: pgmap v477: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 203 op/s 2024-09-12T03:03:56.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:56 smithi018 ceph-mon[30616]: pgmap v477: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 203 op/s 2024-09-12T03:03:56.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:56 smithi176 ceph-mon[35713]: pgmap v477: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 203 op/s 2024-09-12T03:03:57.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:57 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:03:57.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:57 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:03:57.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:57 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:03:58.780 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:03:58 smithi062 ceph-mon[35527]: pgmap v478: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 193 op/s 2024-09-12T03:03:58.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:03:58 smithi018 ceph-mon[30616]: pgmap v478: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 193 op/s 2024-09-12T03:03:58.949 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T03:03:58.949 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T03:03:58.949 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 42985, 2024-09-12T03:03:58.949 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 51539, 2024-09-12T03:03:58.950 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 42570639, 2024-09-12T03:03:58.950 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 280629026, 2024-09-12T03:03:58.950 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 12, 2024-09-12T03:03:58.950 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 4, 2024-09-12T03:03:58.950 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 4.808857062, 2024-09-12T03:03:58.950 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 1.556288936, 2024-09-12T03:03:58.950 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 1.430941630, 2024-09-12T03:03:58.950 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 1.874204929, 2024-09-12T03:03:58.950 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:58.950 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 51539, 2024-09-12T03:03:58.950 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 15.489390824, 2024-09-12T03:03:58.950 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000300537 2024-09-12T03:03:58.950 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.950 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:58.951 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 38950, 2024-09-12T03:03:58.951 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.008263106, 2024-09-12T03:03:58.951 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000212 2024-09-12T03:03:58.951 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.951 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T03:03:58.951 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T03:03:58.951 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.951 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T03:03:58.951 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 67485, 2024-09-12T03:03:58.951 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 54562, 2024-09-12T03:03:58.951 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 39693277, 2024-09-12T03:03:58.951 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 227363122, 2024-09-12T03:03:58.951 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 9, 2024-09-12T03:03:58.952 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 7, 2024-09-12T03:03:58.952 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 6.032986388, 2024-09-12T03:03:58.952 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 2.014231392, 2024-09-12T03:03:58.952 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 3.006907745, 2024-09-12T03:03:58.952 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 2.008557195, 2024-09-12T03:03:58.952 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:58.952 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 54561, 2024-09-12T03:03:58.952 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 11.050303072, 2024-09-12T03:03:58.952 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000202531 2024-09-12T03:03:58.952 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.952 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:58.952 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 68961, 2024-09-12T03:03:58.953 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.013876874, 2024-09-12T03:03:58.953 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000201 2024-09-12T03:03:58.953 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.953 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 2124016, 2024-09-12T03:03:58.953 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 197776 2024-09-12T03:03:58.953 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.953 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T03:03:58.953 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 271155, 2024-09-12T03:03:58.953 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 454425, 2024-09-12T03:03:58.953 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 90526962, 2024-09-12T03:03:58.953 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 459104984, 2024-09-12T03:03:58.953 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 17, 2024-09-12T03:03:58.953 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 7, 2024-09-12T03:03:58.954 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 16.396661404, 2024-09-12T03:03:58.954 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 7.209279936, 2024-09-12T03:03:58.954 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 10.393836991, 2024-09-12T03:03:58.954 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 2.093900496, 2024-09-12T03:03:58.954 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:03:58.954 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 454421, 2024-09-12T03:03:58.954 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 66.579481777, 2024-09-12T03:03:58.954 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000146514 2024-09-12T03:03:58.955 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.955 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:03:58.955 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 297077, 2024-09-12T03:03:58.955 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.092023425, 2024-09-12T03:03:58.955 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000309 2024-09-12T03:03:58.956 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.956 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 5168, 2024-09-12T03:03:58.956 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 554704 2024-09-12T03:03:58.956 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.956 INFO:teuthology.orchestra.run.smithi062.stdout: "cct": { 2024-09-12T03:03:58.956 INFO:teuthology.orchestra.run.smithi062.stdout: "total_workers": 1, 2024-09-12T03:03:58.956 INFO:teuthology.orchestra.run.smithi062.stdout: "unhealthy_workers": 0 2024-09-12T03:03:58.957 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.957 INFO:teuthology.orchestra.run.smithi062.stdout: "finisher-MDSRank": { 2024-09-12T03:03:58.957 INFO:teuthology.orchestra.run.smithi062.stdout: "queue_len": 0, 2024-09-12T03:03:58.957 INFO:teuthology.orchestra.run.smithi062.stdout: "complete_latency": { 2024-09-12T03:03:58.957 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 8054, 2024-09-12T03:03:58.957 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 130.063304516, 2024-09-12T03:03:58.957 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.016148907 2024-09-12T03:03:58.957 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:58.957 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.957 INFO:teuthology.orchestra.run.smithi062.stdout: "finisher-PurgeQueue": { 2024-09-12T03:03:58.957 INFO:teuthology.orchestra.run.smithi062.stdout: "queue_len": 0, 2024-09-12T03:03:58.957 INFO:teuthology.orchestra.run.smithi062.stdout: "complete_latency": { 2024-09-12T03:03:58.958 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 55387, 2024-09-12T03:03:58.958 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 8.430993985, 2024-09-12T03:03:58.958 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000152219 2024-09-12T03:03:58.958 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:58.958 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.958 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-09-12T03:03:58.958 INFO:teuthology.orchestra.run.smithi062.stdout: "request": 141078, 2024-09-12T03:03:58.958 INFO:teuthology.orchestra.run.smithi062.stdout: "reply": 132399, 2024-09-12T03:03:58.958 INFO:teuthology.orchestra.run.smithi062.stdout: "reply_latency": { 2024-09-12T03:03:58.958 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 132399, 2024-09-12T03:03:58.958 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 1436.374459707, 2024-09-12T03:03:58.958 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.010848831 2024-09-12T03:03:58.959 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.959 INFO:teuthology.orchestra.run.smithi062.stdout: "slow_reply": 0, 2024-09-12T03:03:58.959 INFO:teuthology.orchestra.run.smithi062.stdout: "forward": 8611, 2024-09-12T03:03:58.959 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_fetch_complete": 151, 2024-09-12T03:03:58.959 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_fetch_keys": 0, 2024-09-12T03:03:58.959 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_commit": 1636, 2024-09-12T03:03:58.959 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_split": 150, 2024-09-12T03:03:58.959 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_merge": 2, 2024-09-12T03:03:58.959 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes": 77417, 2024-09-12T03:03:58.959 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_top": 5905, 2024-09-12T03:03:58.959 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_bottom": 54357, 2024-09-12T03:03:58.959 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_pin_tail": 17155, 2024-09-12T03:03:58.959 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_pinned": 68967, 2024-09-12T03:03:58.959 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_expired": 73197, 2024-09-12T03:03:58.960 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_with_caps": 2, 2024-09-12T03:03:58.960 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": 2, 2024-09-12T03:03:58.960 INFO:teuthology.orchestra.run.smithi062.stdout: "subtrees": 6, 2024-09-12T03:03:58.960 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse": 207854, 2024-09-12T03:03:58.960 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_hit": 182316, 2024-09-12T03:03:58.960 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_forward": 8459, 2024-09-12T03:03:58.960 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_discover": 523, 2024-09-12T03:03:58.960 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_dir_fetch": 1, 2024-09-12T03:03:58.960 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_remote_ino": 0, 2024-09-12T03:03:58.960 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_lock": 88, 2024-09-12T03:03:58.960 INFO:teuthology.orchestra.run.smithi062.stdout: "load_cent": 0, 2024-09-12T03:03:58.960 INFO:teuthology.orchestra.run.smithi062.stdout: "q": 0, 2024-09-12T03:03:58.960 INFO:teuthology.orchestra.run.smithi062.stdout: "exported": 309, 2024-09-12T03:03:58.961 INFO:teuthology.orchestra.run.smithi062.stdout: "exported_inodes": 52639, 2024-09-12T03:03:58.961 INFO:teuthology.orchestra.run.smithi062.stdout: "imported": 431, 2024-09-12T03:03:58.961 INFO:teuthology.orchestra.run.smithi062.stdout: "imported_inodes": 62237, 2024-09-12T03:03:58.961 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_dir_fetch": 0, 2024-09-12T03:03:58.961 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_backtrace_fetch": 0, 2024-09-12T03:03:58.961 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_peer_discover": 0, 2024-09-12T03:03:58.961 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rfiles": 4, 2024-09-12T03:03:58.961 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rbytes": 234, 2024-09-12T03:03:58.961 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rsnaps": 0, 2024-09-12T03:03:58.961 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T03:03:58.961 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_set_tag": 0, 2024-09-12T03:03:58.961 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T03:03:58.962 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_inotable_repaired": 0, 2024-09-12T03:03:58.962 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dir_inodes": 0, 2024-09-12T03:03:58.962 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T03:03:58.962 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T03:03:58.962 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_file_inodes": 0, 2024-09-12T03:03:58.962 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_inode_file_caps": 309, 2024-09-12T03:03:58.962 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_revoke": 20286, 2024-09-12T03:03:58.962 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_grant": 64571, 2024-09-12T03:03:58.962 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_trunc": 5, 2024-09-12T03:03:58.962 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T03:03:58.962 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T03:03:58.963 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_caps": 64824, 2024-09-12T03:03:58.963 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_caps_dirty": 30228, 2024-09-12T03:03:58.963 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_cap_release": 1315, 2024-09-12T03:03:58.963 INFO:teuthology.orchestra.run.smithi062.stdout: "process_request_cap_release": 70642 2024-09-12T03:03:58.963 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.963 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache": { 2024-09-12T03:03:58.963 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_update": 0, 2024-09-12T03:03:58.963 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_update_receipt": 0, 2024-09-12T03:03:58.963 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_try_discover": 0, 2024-09-12T03:03:58.963 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_send_discover": 787, 2024-09-12T03:03:58.963 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_handle_discover": 803, 2024-09-12T03:03:58.963 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays": 258, 2024-09-12T03:03:58.963 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays_delayed": 0, 2024-09-12T03:03:58.964 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays_enqueuing": 0, 2024-09-12T03:03:58.964 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_created": 29130, 2024-09-12T03:03:58.964 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_enqueued": 28872, 2024-09-12T03:03:58.964 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_reintegrated": 0, 2024-09-12T03:03:58.964 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_migrated": 0, 2024-09-12T03:03:58.964 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_processing": 0, 2024-09-12T03:03:58.964 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_enqueued": 0, 2024-09-12T03:03:58.964 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_prioritized": 0, 2024-09-12T03:03:58.964 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_started": 0, 2024-09-12T03:03:58.964 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_completed": 0, 2024-09-12T03:03:58.964 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_quiesce_path": 0, 2024-09-12T03:03:58.965 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_quiesce_inode": 0, 2024-09-12T03:03:58.965 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T03:03:58.965 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_exportdir": 311, 2024-09-12T03:03:58.965 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_flush": 0, 2024-09-12T03:03:58.965 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_fragmentdir": 157, 2024-09-12T03:03:58.965 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_fragstats": 0, 2024-09-12T03:03:58.965 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_inodestats": 0 2024-09-12T03:03:58.965 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.965 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log": { 2024-09-12T03:03:58.965 INFO:teuthology.orchestra.run.smithi062.stdout: "evlrg": 3, 2024-09-12T03:03:58.965 INFO:teuthology.orchestra.run.smithi062.stdout: "evadd": 185798, 2024-09-12T03:03:58.965 INFO:teuthology.orchestra.run.smithi062.stdout: "evex": 98321, 2024-09-12T03:03:58.966 INFO:teuthology.orchestra.run.smithi062.stdout: "evtrm": 98321, 2024-09-12T03:03:58.966 INFO:teuthology.orchestra.run.smithi062.stdout: "ev": 87477, 2024-09-12T03:03:58.966 INFO:teuthology.orchestra.run.smithi062.stdout: "evexg": 0, 2024-09-12T03:03:58.966 INFO:teuthology.orchestra.run.smithi062.stdout: "evexd": 12290, 2024-09-12T03:03:58.966 INFO:teuthology.orchestra.run.smithi062.stdout: "segadd": 255, 2024-09-12T03:03:58.966 INFO:teuthology.orchestra.run.smithi062.stdout: "segex": 127, 2024-09-12T03:03:58.966 INFO:teuthology.orchestra.run.smithi062.stdout: "segtrm": 127, 2024-09-12T03:03:58.966 INFO:teuthology.orchestra.run.smithi062.stdout: "seg": 128, 2024-09-12T03:03:58.966 INFO:teuthology.orchestra.run.smithi062.stdout: "segmjr": 8, 2024-09-12T03:03:58.966 INFO:teuthology.orchestra.run.smithi062.stdout: "segexg": 0, 2024-09-12T03:03:58.966 INFO:teuthology.orchestra.run.smithi062.stdout: "segexd": 17, 2024-09-12T03:03:58.966 INFO:teuthology.orchestra.run.smithi062.stdout: "expos": 260224420, 2024-09-12T03:03:58.966 INFO:teuthology.orchestra.run.smithi062.stdout: "wrpos": 676152216, 2024-09-12T03:03:58.967 INFO:teuthology.orchestra.run.smithi062.stdout: "rdpos": 0, 2024-09-12T03:03:58.967 INFO:teuthology.orchestra.run.smithi062.stdout: "jlat": { 2024-09-12T03:03:58.967 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 3826, 2024-09-12T03:03:58.967 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 443.605311082, 2024-09-12T03:03:58.967 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.115944932 2024-09-12T03:03:58.967 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.967 INFO:teuthology.orchestra.run.smithi062.stdout: "replayed": 0 2024-09-12T03:03:58.967 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.968 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_mem": { 2024-09-12T03:03:58.968 INFO:teuthology.orchestra.run.smithi062.stdout: "ino": 39033, 2024-09-12T03:03:58.968 INFO:teuthology.orchestra.run.smithi062.stdout: "ino+": 104078, 2024-09-12T03:03:58.968 INFO:teuthology.orchestra.run.smithi062.stdout: "ino-": 65045, 2024-09-12T03:03:58.968 INFO:teuthology.orchestra.run.smithi062.stdout: "dir": 1649, 2024-09-12T03:03:58.968 INFO:teuthology.orchestra.run.smithi062.stdout: "dir+": 3034, 2024-09-12T03:03:58.968 INFO:teuthology.orchestra.run.smithi062.stdout: "dir-": 1385, 2024-09-12T03:03:58.968 INFO:teuthology.orchestra.run.smithi062.stdout: "dn": 77417, 2024-09-12T03:03:58.968 INFO:teuthology.orchestra.run.smithi062.stdout: "dn+": 190918, 2024-09-12T03:03:58.968 INFO:teuthology.orchestra.run.smithi062.stdout: "dn-": 113501, 2024-09-12T03:03:58.968 INFO:teuthology.orchestra.run.smithi062.stdout: "cap": 2, 2024-09-12T03:03:58.968 INFO:teuthology.orchestra.run.smithi062.stdout: "cap+": 59444, 2024-09-12T03:03:58.969 INFO:teuthology.orchestra.run.smithi062.stdout: "cap-": 59442, 2024-09-12T03:03:58.969 INFO:teuthology.orchestra.run.smithi062.stdout: "rss": 333028, 2024-09-12T03:03:58.969 INFO:teuthology.orchestra.run.smithi062.stdout: "heap": 223520 2024-09-12T03:03:58.969 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.969 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_server": { 2024-09-12T03:03:58.969 INFO:teuthology.orchestra.run.smithi062.stdout: "dispatch_client_request": 146859, 2024-09-12T03:03:58.969 INFO:teuthology.orchestra.run.smithi062.stdout: "dispatch_server_request": 11351, 2024-09-12T03:03:58.969 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_request": 141078, 2024-09-12T03:03:58.969 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_session": 371, 2024-09-12T03:03:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_peer_request": 22395, 2024-09-12T03:03:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: "req_create_latency": { 2024-09-12T03:03:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 32364, 2024-09-12T03:03:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 124.183445225, 2024-09-12T03:03:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.003837085 2024-09-12T03:03:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getattr_latency": { 2024-09-12T03:03:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 137, 2024-09-12T03:03:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 9.517035787, 2024-09-12T03:03:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.069467414 2024-09-12T03:03:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getfilelock_latency": { 2024-09-12T03:03:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.970 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: "req_link_latency": { 2024-09-12T03:03:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookup_latency": { 2024-09-12T03:03:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 29220, 2024-09-12T03:03:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 750.653432125, 2024-09-12T03:03:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.025689713 2024-09-12T03:03:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookuphash_latency": { 2024-09-12T03:03:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.972 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.972 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.972 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.972 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupino_latency": { 2024-09-12T03:03:58.972 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.972 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.972 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.972 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.972 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupname_latency": { 2024-09-12T03:03:58.972 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.972 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.972 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.973 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.973 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupparent_latency": { 2024-09-12T03:03:58.973 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.973 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.973 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.973 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.973 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupsnap_latency": { 2024-09-12T03:03:58.974 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.974 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.974 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.974 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.974 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lssnap_latency": { 2024-09-12T03:03:58.974 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.974 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.974 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.974 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mkdir_latency": { 2024-09-12T03:03:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 271, 2024-09-12T03:03:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 9.668480271, 2024-09-12T03:03:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.035677048 2024-09-12T03:03:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mknod_latency": { 2024-09-12T03:03:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mksnap_latency": { 2024-09-12T03:03:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.975 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.976 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.976 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.976 INFO:teuthology.orchestra.run.smithi062.stdout: "req_open_latency": { 2024-09-12T03:03:58.976 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 9925, 2024-09-12T03:03:58.976 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 64.879328983, 2024-09-12T03:03:58.976 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.006536960 2024-09-12T03:03:58.976 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.976 INFO:teuthology.orchestra.run.smithi062.stdout: "req_readdir_latency": { 2024-09-12T03:03:58.976 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 1414, 2024-09-12T03:03:58.976 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 6.105307802, 2024-09-12T03:03:58.976 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.004317756 2024-09-12T03:03:58.977 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.977 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rename_latency": { 2024-09-12T03:03:58.977 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 31971, 2024-09-12T03:03:58.977 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 364.135116567, 2024-09-12T03:03:58.977 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.011389544 2024-09-12T03:03:58.977 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.977 INFO:teuthology.orchestra.run.smithi062.stdout: "req_renamesnap_latency": { 2024-09-12T03:03:58.977 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.978 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.978 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.978 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.978 INFO:teuthology.orchestra.run.smithi062.stdout: "req_snapdiff_latency": { 2024-09-12T03:03:58.978 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.978 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.978 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.978 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.978 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmdir_latency": { 2024-09-12T03:03:58.978 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 262, 2024-09-12T03:03:58.978 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 45.988095022, 2024-09-12T03:03:58.978 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.175527080 2024-09-12T03:03:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmsnap_latency": { 2024-09-12T03:03:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmxattr_latency": { 2024-09-12T03:03:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setattr_latency": { 2024-09-12T03:03:58.980 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 5, 2024-09-12T03:03:58.980 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.026124766, 2024-09-12T03:03:58.980 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.005224953 2024-09-12T03:03:58.980 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.980 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setdirlayout_latency": { 2024-09-12T03:03:58.980 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.980 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.980 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.980 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setfilelock_latency": { 2024-09-12T03:03:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setlayout_latency": { 2024-09-12T03:03:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setxattr_latency": { 2024-09-12T03:03:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.982 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.982 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.982 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.982 INFO:teuthology.orchestra.run.smithi062.stdout: "req_symlink_latency": { 2024-09-12T03:03:58.982 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 3, 2024-09-12T03:03:58.982 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.002096294, 2024-09-12T03:03:58.982 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000698764 2024-09-12T03:03:58.982 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.982 INFO:teuthology.orchestra.run.smithi062.stdout: "req_unlink_latency": { 2024-09-12T03:03:58.982 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 26827, 2024-09-12T03:03:58.982 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 61.215996865, 2024-09-12T03:03:58.982 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.002281880 2024-09-12T03:03:58.982 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_revoke_eviction": 0, 2024-09-12T03:03:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_acquisition_throttle": 0, 2024-09-12T03:03:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getvxattr_latency": { 2024-09-12T03:03:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_sessions": { 2024-09-12T03:03:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: "session_count": 1, 2024-09-12T03:03:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: "session_add": 3, 2024-09-12T03:03:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: "session_remove": 2, 2024-09-12T03:03:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: "sessions_open": 1, 2024-09-12T03:03:58.983 INFO:teuthology.orchestra.run.smithi062.stdout: "sessions_stale": 0, 2024-09-12T03:03:58.984 INFO:teuthology.orchestra.run.smithi062.stdout: "total_load": 6999, 2024-09-12T03:03:58.984 INFO:teuthology.orchestra.run.smithi062.stdout: "average_load": 6999, 2024-09-12T03:03:58.984 INFO:teuthology.orchestra.run.smithi062.stdout: "avg_session_uptime": 912, 2024-09-12T03:03:58.984 INFO:teuthology.orchestra.run.smithi062.stdout: "mdthresh_evicted": 0 2024-09-12T03:03:58.984 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.984 INFO:teuthology.orchestra.run.smithi062.stdout: "mempool": { 2024-09-12T03:03:58.984 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_bytes": 120, 2024-09-12T03:03:58.984 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_items": 120, 2024-09-12T03:03:58.984 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T03:03:58.984 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_items": 0, 2024-09-12T03:03:58.984 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T03:03:58.984 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_items": 0, 2024-09-12T03:03:58.984 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T03:03:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T03:03:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T03:03:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T03:03:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T03:03:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_items": 0, 2024-09-12T03:03:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T03:03:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T03:03:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_bytes": 0, 2024-09-12T03:03:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_items": 0, 2024-09-12T03:03:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_bytes": 0, 2024-09-12T03:03:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_items": 0, 2024-09-12T03:03:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T03:03:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T03:03:58.985 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T03:03:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T03:03:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T03:03:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_items": 0, 2024-09-12T03:03:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_bytes": 0, 2024-09-12T03:03:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_items": 0, 2024-09-12T03:03:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T03:03:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T03:03:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_bytes": 0, 2024-09-12T03:03:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_items": 0, 2024-09-12T03:03:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_bytes": 0, 2024-09-12T03:03:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_items": 0, 2024-09-12T03:03:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T03:03:58.986 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_items": 0, 2024-09-12T03:03:58.987 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T03:03:58.987 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_items": 0, 2024-09-12T03:03:58.987 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_bytes": 3971766, 2024-09-12T03:03:58.987 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_items": 38938, 2024-09-12T03:03:58.987 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_bytes": 1144, 2024-09-12T03:03:58.987 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_items": 13, 2024-09-12T03:03:58.988 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bytes": 0, 2024-09-12T03:03:58.988 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_items": 0, 2024-09-12T03:03:58.988 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_bytes": 0, 2024-09-12T03:03:58.988 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_items": 0, 2024-09-12T03:03:58.988 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_bytes": 0, 2024-09-12T03:03:58.988 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_items": 0, 2024-09-12T03:03:58.988 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_bytes": 10136, 2024-09-12T03:03:58.988 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_items": 215, 2024-09-12T03:03:58.988 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T03:03:58.988 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_items": 0, 2024-09-12T03:03:58.988 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_bytes": 0, 2024-09-12T03:03:58.988 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_items": 0, 2024-09-12T03:03:58.988 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_bytes": 149897838, 2024-09-12T03:03:58.989 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_items": 1584895, 2024-09-12T03:03:58.989 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_bytes": 0, 2024-09-12T03:03:58.989 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_items": 0, 2024-09-12T03:03:58.989 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_bytes": 0, 2024-09-12T03:03:58.989 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_items": 0 2024-09-12T03:03:58.989 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.989 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter": { 2024-09-12T03:03:58.989 INFO:teuthology.orchestra.run.smithi062.stdout: "op_active": 8, 2024-09-12T03:03:58.989 INFO:teuthology.orchestra.run.smithi062.stdout: "op_laggy": 0, 2024-09-12T03:03:58.989 INFO:teuthology.orchestra.run.smithi062.stdout: "op_send": 69633, 2024-09-12T03:03:58.989 INFO:teuthology.orchestra.run.smithi062.stdout: "op_send_bytes": 711781165, 2024-09-12T03:03:58.989 INFO:teuthology.orchestra.run.smithi062.stdout: "op_resend": 28, 2024-09-12T03:03:58.989 INFO:teuthology.orchestra.run.smithi062.stdout: "op_reply": 69625, 2024-09-12T03:03:58.989 INFO:teuthology.orchestra.run.smithi062.stdout: "op_latency": { 2024-09-12T03:03:58.990 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 69625, 2024-09-12T03:03:58.990 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 3387.958262186, 2024-09-12T03:03:58.990 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.048660082 2024-09-12T03:03:58.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.990 INFO:teuthology.orchestra.run.smithi062.stdout: "op_inflight": 8, 2024-09-12T03:03:58.990 INFO:teuthology.orchestra.run.smithi062.stdout: "oplen_avg": { 2024-09-12T03:03:58.990 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 69633, 2024-09-12T03:03:58.990 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 79956 2024-09-12T03:03:58.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "op": 69633, 2024-09-12T03:03:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "op_r": 966, 2024-09-12T03:03:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "op_w": 68667, 2024-09-12T03:03:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "op_rmw": 0, 2024-09-12T03:03:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "op_pg": 0, 2024-09-12T03:03:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_stat": 258, 2024-09-12T03:03:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_create": 4615, 2024-09-12T03:03:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_read": 526, 2024-09-12T03:03:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_write": 4352, 2024-09-12T03:03:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_writefull": 244, 2024-09-12T03:03:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_writesame": 0, 2024-09-12T03:03:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_append": 0, 2024-09-12T03:03:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_zero": 0, 2024-09-12T03:03:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_truncate": 150, 2024-09-12T03:03:58.991 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_delete": 57102, 2024-09-12T03:03:58.992 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_mapext": 0, 2024-09-12T03:03:58.992 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_sparse_read": 0, 2024-09-12T03:03:58.992 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_clonerange": 0, 2024-09-12T03:03:58.992 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_getxattr": 2, 2024-09-12T03:03:58.992 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_setxattr": 6955, 2024-09-12T03:03:58.992 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_cmpxattr": 0, 2024-09-12T03:03:58.992 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_rmxattr": 0, 2024-09-12T03:03:58.992 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_resetxattrs": 0, 2024-09-12T03:03:58.992 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_call": 0, 2024-09-12T03:03:58.992 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_watch": 0, 2024-09-12T03:03:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_notify": 0, 2024-09-12T03:03:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T03:03:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_pgls": 0, 2024-09-12T03:03:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_pgls_filter": 0, 2024-09-12T03:03:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_other": 5, 2024-09-12T03:03:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_active": 0, 2024-09-12T03:03:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_send": 0, 2024-09-12T03:03:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_resend": 0, 2024-09-12T03:03:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_ping": 0, 2024-09-12T03:03:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_active": 0, 2024-09-12T03:03:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_send": 0, 2024-09-12T03:03:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_resend": 0, 2024-09-12T03:03:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_active": 0, 2024-09-12T03:03:58.993 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_send": 0, 2024-09-12T03:03:58.994 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_resend": 0, 2024-09-12T03:03:58.994 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_active": 0, 2024-09-12T03:03:58.994 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_send": 0, 2024-09-12T03:03:58.994 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_resend": 0, 2024-09-12T03:03:58.994 INFO:teuthology.orchestra.run.smithi062.stdout: "command_active": 0, 2024-09-12T03:03:58.994 INFO:teuthology.orchestra.run.smithi062.stdout: "command_send": 0, 2024-09-12T03:03:58.994 INFO:teuthology.orchestra.run.smithi062.stdout: "command_resend": 0, 2024-09-12T03:03:58.994 INFO:teuthology.orchestra.run.smithi062.stdout: "map_epoch": 117, 2024-09-12T03:03:58.994 INFO:teuthology.orchestra.run.smithi062.stdout: "map_full": 0, 2024-09-12T03:03:58.995 INFO:teuthology.orchestra.run.smithi062.stdout: "map_inc": 21, 2024-09-12T03:03:58.995 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_sessions": 12, 2024-09-12T03:03:58.995 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_session_open": 12, 2024-09-12T03:03:58.995 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_session_close": 0, 2024-09-12T03:03:58.995 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_laggy": 0, 2024-09-12T03:03:58.995 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_wr": 4332, 2024-09-12T03:03:58.995 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_rd": 591, 2024-09-12T03:03:58.995 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_del": 824 2024-09-12T03:03:58.995 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.995 INFO:teuthology.orchestra.run.smithi062.stdout: "oft": { 2024-09-12T03:03:58.995 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_objs": 1, 2024-09-12T03:03:58.995 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_kv_pairs": 0, 2024-09-12T03:03:58.995 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_updates": 0, 2024-09-12T03:03:58.996 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_removes": 0 2024-09-12T03:03:58.996 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.996 INFO:teuthology.orchestra.run.smithi062.stdout: "osd-slow-ops": { 2024-09-12T03:03:58.996 INFO:teuthology.orchestra.run.smithi062.stdout: "slow_ops_count": 48 2024-09-12T03:03:58.996 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.996 INFO:teuthology.orchestra.run.smithi062.stdout: "purge_queue": { 2024-09-12T03:03:58.996 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_ops": 10, 2024-09-12T03:03:58.996 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_ops_high_water": 10, 2024-09-12T03:03:58.996 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing": 5, 2024-09-12T03:03:58.996 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_high_water": 6, 2024-09-12T03:03:58.996 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executed_ops": 56841, 2024-09-12T03:03:58.997 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executed": 28424, 2024-09-12T03:03:58.997 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_item_in_journal": 696 2024-09-12T03:03:58.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.997 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T03:03:58.997 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 164, 2024-09-12T03:03:58.997 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-09-12T03:03:58.997 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:03:58.997 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 381622, 2024-09-12T03:03:58.997 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 142387086, 2024-09-12T03:03:58.997 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:58.997 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 381622, 2024-09-12T03:03:58.997 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-09-12T03:03:58.997 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-09-12T03:03:58.998 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 381621, 2024-09-12T03:03:58.998 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 142386922, 2024-09-12T03:03:58.998 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:03:58.998 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:58.998 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:58.998 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:58.998 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:58.999 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:58.999 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-objecter_bytes": { 2024-09-12T03:03:58.999 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T03:03:58.999 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-09-12T03:03:58.999 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:03:58.999 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-09-12T03:03:58.999 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-09-12T03:03:58.999 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:58.999 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-09-12T03:03:58.999 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 69633, 2024-09-12T03:03:58.999 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 716138588, 2024-09-12T03:03:58.999 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 69626, 2024-09-12T03:03:58.999 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 716138588, 2024-09-12T03:03:59.000 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:03:59.000 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:59.000 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:59.000 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:59.000 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:59.000 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:59.000 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-objecter_ops": { 2024-09-12T03:03:59.000 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 7, 2024-09-12T03:03:59.000 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 1024, 2024-09-12T03:03:59.000 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:03:59.000 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-09-12T03:03:59.001 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-09-12T03:03:59.001 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:59.001 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-09-12T03:03:59.001 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 69633, 2024-09-12T03:03:59.001 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 69633, 2024-09-12T03:03:59.001 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 69626, 2024-09-12T03:03:59.001 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 69626, 2024-09-12T03:03:59.001 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:03:59.001 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:59.001 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:59.001 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:59.001 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:59.001 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:59.002 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-write_buf_throttle": { 2024-09-12T03:03:59.002 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T03:03:59.002 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 3758096384, 2024-09-12T03:03:59.002 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:03:59.002 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 28872, 2024-09-12T03:03:59.002 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 4369728, 2024-09-12T03:03:59.002 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:59.002 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 28872, 2024-09-12T03:03:59.002 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-09-12T03:03:59.002 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-09-12T03:03:59.002 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 525, 2024-09-12T03:03:59.002 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 4369728, 2024-09-12T03:03:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:03:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:03:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-write_buf_throttle-0x56247c0bc960": { 2024-09-12T03:03:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T03:03:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 3758096384, 2024-09-12T03:03:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:03:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 185798, 2024-09-12T03:03:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 671957912, 2024-09-12T03:03:59.003 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:03:59.004 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 185798, 2024-09-12T03:03:59.004 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-09-12T03:03:59.004 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-09-12T03:03:59.004 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 3826, 2024-09-12T03:03:59.004 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 671957912, 2024-09-12T03:03:59.004 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:03:59.004 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:03:59.004 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:03:59.004 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:03:59.004 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:59.004 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:03:59.004 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T03:03:59.005 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:03:58 smithi176 ceph-mon[35713]: pgmap v478: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 193 op/s 2024-09-12T03:03:59.802 INFO:tasks.check_counter:Daemon mds.h mds.exported=309 2024-09-12T03:03:59.802 INFO:tasks.check_counter:Daemon mds.h mds.imported=431 2024-09-12T03:03:59.802 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-09-12T03:03:59.802 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-12T03:03:59.802 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T03:03:59.802 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=150 2024-09-12T03:03:59.802 DEBUG:tasks.check_counter:Getting stats from k 2024-09-12T03:03:59.802 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-12T03:04:00.246 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T03:04:00.784 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:00 smithi062 ceph-mon[35527]: pgmap v479: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 211 op/s 2024-09-12T03:04:00.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:00 smithi018 ceph-mon[30616]: pgmap v479: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 211 op/s 2024-09-12T03:04:00.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:00 smithi176 ceph-mon[35713]: pgmap v479: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 211 op/s 2024-09-12T03:04:02.380 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T03:04:02.380 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T03:04:02.380 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 2039, 2024-09-12T03:04:02.380 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 1978, 2024-09-12T03:04:02.381 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 195560675, 2024-09-12T03:04:02.381 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 716998, 2024-09-12T03:04:02.381 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 7, 2024-09-12T03:04:02.381 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 3, 2024-09-12T03:04:02.381 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.356041612, 2024-09-12T03:04:02.382 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.062550966, 2024-09-12T03:04:02.382 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.201130978, 2024-09-12T03:04:02.382 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.097128807, 2024-09-12T03:04:02.382 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:04:02.382 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 1977, 2024-09-12T03:04:02.383 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.097950883, 2024-09-12T03:04:02.383 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000049545 2024-09-12T03:04:02.383 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.383 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:04:02.383 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.383 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.384 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.384 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 2113440, 2024-09-12T03:04:02.384 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 193888 2024-09-12T03:04:02.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.385 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T03:04:02.385 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 1294, 2024-09-12T03:04:02.385 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 1524, 2024-09-12T03:04:02.385 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 189108040, 2024-09-12T03:04:02.385 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 964571, 2024-09-12T03:04:02.385 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 9, 2024-09-12T03:04:02.386 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 7, 2024-09-12T03:04:02.386 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.224570000, 2024-09-12T03:04:02.386 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.037549312, 2024-09-12T03:04:02.386 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.142612952, 2024-09-12T03:04:02.386 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.033835405, 2024-09-12T03:04:02.386 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:04:02.387 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 1522, 2024-09-12T03:04:02.387 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.096277482, 2024-09-12T03:04:02.387 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000063257 2024-09-12T03:04:02.387 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.387 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:04:02.387 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.388 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.388 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.388 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.388 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-12T03:04:02.388 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 555248 2024-09-12T03:04:02.388 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.389 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T03:04:02.389 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 1195, 2024-09-12T03:04:02.389 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 1197, 2024-09-12T03:04:02.389 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 290676336, 2024-09-12T03:04:02.390 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 380022, 2024-09-12T03:04:02.390 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 6, 2024-09-12T03:04:02.390 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 5, 2024-09-12T03:04:02.390 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.262684158, 2024-09-12T03:04:02.390 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.023650115, 2024-09-12T03:04:02.390 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.196490360, 2024-09-12T03:04:02.390 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.034053620, 2024-09-12T03:04:02.391 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:04:02.391 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 1195, 2024-09-12T03:04:02.391 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.061754924, 2024-09-12T03:04:02.391 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000051677 2024-09-12T03:04:02.391 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.391 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:04:02.391 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.391 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.391 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.392 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.392 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T03:04:02.392 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T03:04:02.392 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.392 INFO:teuthology.orchestra.run.smithi062.stdout: "cct": { 2024-09-12T03:04:02.392 INFO:teuthology.orchestra.run.smithi062.stdout: "total_workers": 1, 2024-09-12T03:04:02.392 INFO:teuthology.orchestra.run.smithi062.stdout: "unhealthy_workers": 0 2024-09-12T03:04:02.392 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.393 INFO:teuthology.orchestra.run.smithi062.stdout: "finisher-MDSRank": { 2024-09-12T03:04:02.393 INFO:teuthology.orchestra.run.smithi062.stdout: "queue_len": 0, 2024-09-12T03:04:02.393 INFO:teuthology.orchestra.run.smithi062.stdout: "complete_latency": { 2024-09-12T03:04:02.393 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 6528, 2024-09-12T03:04:02.393 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.225640915, 2024-09-12T03:04:02.393 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000034565 2024-09-12T03:04:02.393 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:04:02.393 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.393 INFO:teuthology.orchestra.run.smithi062.stdout: "finisher-PurgeQueue": { 2024-09-12T03:04:02.393 INFO:teuthology.orchestra.run.smithi062.stdout: "queue_len": 0, 2024-09-12T03:04:02.394 INFO:teuthology.orchestra.run.smithi062.stdout: "complete_latency": { 2024-09-12T03:04:02.394 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.394 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.394 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.394 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:04:02.394 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.394 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-09-12T03:04:02.394 INFO:teuthology.orchestra.run.smithi062.stdout: "request": 0, 2024-09-12T03:04:02.394 INFO:teuthology.orchestra.run.smithi062.stdout: "reply": 0, 2024-09-12T03:04:02.394 INFO:teuthology.orchestra.run.smithi062.stdout: "reply_latency": { 2024-09-12T03:04:02.394 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.394 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.395 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.395 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.395 INFO:teuthology.orchestra.run.smithi062.stdout: "slow_reply": 0, 2024-09-12T03:04:02.395 INFO:teuthology.orchestra.run.smithi062.stdout: "forward": 0, 2024-09-12T03:04:02.395 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_fetch_complete": 0, 2024-09-12T03:04:02.395 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_fetch_keys": 0, 2024-09-12T03:04:02.395 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_commit": 0, 2024-09-12T03:04:02.395 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_split": 0, 2024-09-12T03:04:02.395 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_merge": 0, 2024-09-12T03:04:02.396 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes": 126897, 2024-09-12T03:04:02.396 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_top": 15803, 2024-09-12T03:04:02.396 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_bottom": 111094, 2024-09-12T03:04:02.396 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_pin_tail": 0, 2024-09-12T03:04:02.396 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_pinned": 104322, 2024-09-12T03:04:02.396 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_expired": 0, 2024-09-12T03:04:02.396 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_with_caps": 0, 2024-09-12T03:04:02.396 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": 0, 2024-09-12T03:04:02.396 INFO:teuthology.orchestra.run.smithi062.stdout: "subtrees": 3, 2024-09-12T03:04:02.396 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse": 0, 2024-09-12T03:04:02.397 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_hit": 0, 2024-09-12T03:04:02.397 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_forward": 0, 2024-09-12T03:04:02.397 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_discover": 0, 2024-09-12T03:04:02.397 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_dir_fetch": 0, 2024-09-12T03:04:02.397 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_remote_ino": 0, 2024-09-12T03:04:02.397 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_lock": 0, 2024-09-12T03:04:02.397 INFO:teuthology.orchestra.run.smithi062.stdout: "load_cent": 0, 2024-09-12T03:04:02.397 INFO:teuthology.orchestra.run.smithi062.stdout: "q": 0, 2024-09-12T03:04:02.397 INFO:teuthology.orchestra.run.smithi062.stdout: "exported": 0, 2024-09-12T03:04:02.397 INFO:teuthology.orchestra.run.smithi062.stdout: "exported_inodes": 0, 2024-09-12T03:04:02.397 INFO:teuthology.orchestra.run.smithi062.stdout: "imported": 0, 2024-09-12T03:04:02.397 INFO:teuthology.orchestra.run.smithi062.stdout: "imported_inodes": 0, 2024-09-12T03:04:02.398 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_dir_fetch": 0, 2024-09-12T03:04:02.398 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_backtrace_fetch": 0, 2024-09-12T03:04:02.398 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_peer_discover": 0, 2024-09-12T03:04:02.398 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rfiles": 0, 2024-09-12T03:04:02.398 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rbytes": 0, 2024-09-12T03:04:02.398 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rsnaps": 0, 2024-09-12T03:04:02.398 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T03:04:02.398 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_set_tag": 0, 2024-09-12T03:04:02.398 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T03:04:02.399 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_inotable_repaired": 0, 2024-09-12T03:04:02.399 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dir_inodes": 0, 2024-09-12T03:04:02.399 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T03:04:02.399 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T03:04:02.399 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_file_inodes": 0, 2024-09-12T03:04:02.399 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_inode_file_caps": 0, 2024-09-12T03:04:02.399 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T03:04:02.399 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_grant": 0, 2024-09-12T03:04:02.399 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T03:04:02.399 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T03:04:02.399 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T03:04:02.399 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_caps": 0, 2024-09-12T03:04:02.399 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_caps_dirty": 0, 2024-09-12T03:04:02.400 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_cap_release": 0, 2024-09-12T03:04:02.400 INFO:teuthology.orchestra.run.smithi062.stdout: "process_request_cap_release": 0 2024-09-12T03:04:02.400 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.400 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache": { 2024-09-12T03:04:02.400 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_update": 0, 2024-09-12T03:04:02.400 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_update_receipt": 0, 2024-09-12T03:04:02.400 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_try_discover": 0, 2024-09-12T03:04:02.400 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_send_discover": 0, 2024-09-12T03:04:02.400 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_handle_discover": 0, 2024-09-12T03:04:02.400 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays": 0, 2024-09-12T03:04:02.401 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays_delayed": 0, 2024-09-12T03:04:02.401 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays_enqueuing": 0, 2024-09-12T03:04:02.401 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_created": 0, 2024-09-12T03:04:02.401 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_enqueued": 0, 2024-09-12T03:04:02.401 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_reintegrated": 0, 2024-09-12T03:04:02.401 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_migrated": 0, 2024-09-12T03:04:02.401 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_processing": 0, 2024-09-12T03:04:02.401 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_enqueued": 0, 2024-09-12T03:04:02.401 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_prioritized": 0, 2024-09-12T03:04:02.401 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_started": 0, 2024-09-12T03:04:02.401 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_completed": 0, 2024-09-12T03:04:02.401 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_quiesce_path": 0, 2024-09-12T03:04:02.402 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_quiesce_inode": 0, 2024-09-12T03:04:02.402 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T03:04:02.402 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_exportdir": 0, 2024-09-12T03:04:02.402 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_flush": 0, 2024-09-12T03:04:02.402 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_fragmentdir": 0, 2024-09-12T03:04:02.402 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_fragstats": 0, 2024-09-12T03:04:02.402 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_inodestats": 0 2024-09-12T03:04:02.402 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.402 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log": { 2024-09-12T03:04:02.402 INFO:teuthology.orchestra.run.smithi062.stdout: "evlrg": 0, 2024-09-12T03:04:02.402 INFO:teuthology.orchestra.run.smithi062.stdout: "evadd": 0, 2024-09-12T03:04:02.402 INFO:teuthology.orchestra.run.smithi062.stdout: "evex": 0, 2024-09-12T03:04:02.402 INFO:teuthology.orchestra.run.smithi062.stdout: "evtrm": 0, 2024-09-12T03:04:02.402 INFO:teuthology.orchestra.run.smithi062.stdout: "ev": 185798, 2024-09-12T03:04:02.403 INFO:teuthology.orchestra.run.smithi062.stdout: "evexg": 0, 2024-09-12T03:04:02.403 INFO:teuthology.orchestra.run.smithi062.stdout: "evexd": 0, 2024-09-12T03:04:02.403 INFO:teuthology.orchestra.run.smithi062.stdout: "segadd": 0, 2024-09-12T03:04:02.403 INFO:teuthology.orchestra.run.smithi062.stdout: "segex": 0, 2024-09-12T03:04:02.403 INFO:teuthology.orchestra.run.smithi062.stdout: "segtrm": 0, 2024-09-12T03:04:02.403 INFO:teuthology.orchestra.run.smithi062.stdout: "seg": 145, 2024-09-12T03:04:02.403 INFO:teuthology.orchestra.run.smithi062.stdout: "segmjr": 17, 2024-09-12T03:04:02.403 INFO:teuthology.orchestra.run.smithi062.stdout: "segexg": 0, 2024-09-12T03:04:02.403 INFO:teuthology.orchestra.run.smithi062.stdout: "segexd": 0, 2024-09-12T03:04:02.403 INFO:teuthology.orchestra.run.smithi062.stdout: "expos": 260224420, 2024-09-12T03:04:02.403 INFO:teuthology.orchestra.run.smithi062.stdout: "wrpos": 676152216, 2024-09-12T03:04:02.403 INFO:teuthology.orchestra.run.smithi062.stdout: "rdpos": 676151642, 2024-09-12T03:04:02.404 INFO:teuthology.orchestra.run.smithi062.stdout: "jlat": { 2024-09-12T03:04:02.404 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.404 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.404 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.404 INFO:teuthology.orchestra.run.smithi062.stdout: "replayed": 185798 2024-09-12T03:04:02.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.404 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_mem": { 2024-09-12T03:04:02.404 INFO:teuthology.orchestra.run.smithi062.stdout: "ino": 44419, 2024-09-12T03:04:02.404 INFO:teuthology.orchestra.run.smithi062.stdout: "ino+": 103968, 2024-09-12T03:04:02.404 INFO:teuthology.orchestra.run.smithi062.stdout: "ino-": 59549, 2024-09-12T03:04:02.404 INFO:teuthology.orchestra.run.smithi062.stdout: "dir": 1639, 2024-09-12T03:04:02.405 INFO:teuthology.orchestra.run.smithi062.stdout: "dir+": 2965, 2024-09-12T03:04:02.405 INFO:teuthology.orchestra.run.smithi062.stdout: "dir-": 1326, 2024-09-12T03:04:02.405 INFO:teuthology.orchestra.run.smithi062.stdout: "dn": 126897, 2024-09-12T03:04:02.405 INFO:teuthology.orchestra.run.smithi062.stdout: "dn+": 184406, 2024-09-12T03:04:02.405 INFO:teuthology.orchestra.run.smithi062.stdout: "dn-": 57509, 2024-09-12T03:04:02.405 INFO:teuthology.orchestra.run.smithi062.stdout: "cap": 0, 2024-09-12T03:04:02.405 INFO:teuthology.orchestra.run.smithi062.stdout: "cap+": 0, 2024-09-12T03:04:02.405 INFO:teuthology.orchestra.run.smithi062.stdout: "cap-": 0, 2024-09-12T03:04:02.405 INFO:teuthology.orchestra.run.smithi062.stdout: "rss": 283656, 2024-09-12T03:04:02.405 INFO:teuthology.orchestra.run.smithi062.stdout: "heap": 215328 2024-09-12T03:04:02.405 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.405 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_server": { 2024-09-12T03:04:02.406 INFO:teuthology.orchestra.run.smithi062.stdout: "dispatch_client_request": 0, 2024-09-12T03:04:02.406 INFO:teuthology.orchestra.run.smithi062.stdout: "dispatch_server_request": 0, 2024-09-12T03:04:02.406 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_request": 0, 2024-09-12T03:04:02.406 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_session": 0, 2024-09-12T03:04:02.406 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_peer_request": 0, 2024-09-12T03:04:02.406 INFO:teuthology.orchestra.run.smithi062.stdout: "req_create_latency": { 2024-09-12T03:04:02.406 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.406 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.406 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.406 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.406 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getattr_latency": { 2024-09-12T03:04:02.406 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.407 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.407 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.407 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.407 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getfilelock_latency": { 2024-09-12T03:04:02.407 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.407 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.408 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.408 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.408 INFO:teuthology.orchestra.run.smithi062.stdout: "req_link_latency": { 2024-09-12T03:04:02.408 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.408 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.408 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.408 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.408 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookup_latency": { 2024-09-12T03:04:02.408 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.408 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.408 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.408 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.409 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookuphash_latency": { 2024-09-12T03:04:02.409 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.409 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.409 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.409 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.409 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupino_latency": { 2024-09-12T03:04:02.409 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.409 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.410 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.410 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.410 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupname_latency": { 2024-09-12T03:04:02.410 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.411 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.411 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.411 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupparent_latency": { 2024-09-12T03:04:02.411 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.411 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.411 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.411 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupsnap_latency": { 2024-09-12T03:04:02.411 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.411 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.411 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.412 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lssnap_latency": { 2024-09-12T03:04:02.412 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.412 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.412 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.412 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.412 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mkdir_latency": { 2024-09-12T03:04:02.412 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.412 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.412 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.412 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.412 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mknod_latency": { 2024-09-12T03:04:02.412 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.412 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.413 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.413 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.413 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mksnap_latency": { 2024-09-12T03:04:02.413 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.413 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.413 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.413 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.413 INFO:teuthology.orchestra.run.smithi062.stdout: "req_open_latency": { 2024-09-12T03:04:02.413 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.413 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.413 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.413 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.413 INFO:teuthology.orchestra.run.smithi062.stdout: "req_readdir_latency": { 2024-09-12T03:04:02.414 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.414 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.414 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.414 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.414 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rename_latency": { 2024-09-12T03:04:02.414 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.414 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.414 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.414 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.415 INFO:teuthology.orchestra.run.smithi062.stdout: "req_renamesnap_latency": { 2024-09-12T03:04:02.415 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.415 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.415 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.415 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.415 INFO:teuthology.orchestra.run.smithi062.stdout: "req_snapdiff_latency": { 2024-09-12T03:04:02.415 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.415 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.415 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.415 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.415 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmdir_latency": { 2024-09-12T03:04:02.415 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.416 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.416 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.416 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.416 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmsnap_latency": { 2024-09-12T03:04:02.416 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.416 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.416 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.416 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.416 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmxattr_latency": { 2024-09-12T03:04:02.416 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.416 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.416 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.417 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.417 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setattr_latency": { 2024-09-12T03:04:02.417 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.417 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.417 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.417 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.417 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setdirlayout_latency": { 2024-09-12T03:04:02.417 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.417 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.417 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.417 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.418 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setfilelock_latency": { 2024-09-12T03:04:02.418 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.418 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.418 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.418 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.418 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setlayout_latency": { 2024-09-12T03:04:02.418 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.418 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.418 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.418 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.418 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setxattr_latency": { 2024-09-12T03:04:02.418 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.418 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.419 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.419 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.419 INFO:teuthology.orchestra.run.smithi062.stdout: "req_symlink_latency": { 2024-09-12T03:04:02.419 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.419 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.419 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.419 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.419 INFO:teuthology.orchestra.run.smithi062.stdout: "req_unlink_latency": { 2024-09-12T03:04:02.419 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.419 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.419 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.419 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.419 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_revoke_eviction": 0, 2024-09-12T03:04:02.420 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_acquisition_throttle": 0, 2024-09-12T03:04:02.420 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getvxattr_latency": { 2024-09-12T03:04:02.420 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.420 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.420 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.420 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:04:02.420 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.420 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_sessions": { 2024-09-12T03:04:02.420 INFO:teuthology.orchestra.run.smithi062.stdout: "session_count": 1, 2024-09-12T03:04:02.420 INFO:teuthology.orchestra.run.smithi062.stdout: "session_add": 3, 2024-09-12T03:04:02.420 INFO:teuthology.orchestra.run.smithi062.stdout: "session_remove": 2, 2024-09-12T03:04:02.420 INFO:teuthology.orchestra.run.smithi062.stdout: "sessions_open": 2, 2024-09-12T03:04:02.421 INFO:teuthology.orchestra.run.smithi062.stdout: "sessions_stale": 0, 2024-09-12T03:04:02.421 INFO:teuthology.orchestra.run.smithi062.stdout: "total_load": 0, 2024-09-12T03:04:02.421 INFO:teuthology.orchestra.run.smithi062.stdout: "average_load": 0, 2024-09-12T03:04:02.421 INFO:teuthology.orchestra.run.smithi062.stdout: "avg_session_uptime": 3765, 2024-09-12T03:04:02.421 INFO:teuthology.orchestra.run.smithi062.stdout: "mdthresh_evicted": 0 2024-09-12T03:04:02.421 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.421 INFO:teuthology.orchestra.run.smithi062.stdout: "mempool": { 2024-09-12T03:04:02.421 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_bytes": 0, 2024-09-12T03:04:02.421 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_items": 0, 2024-09-12T03:04:02.421 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T03:04:02.421 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_items": 0, 2024-09-12T03:04:02.422 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T03:04:02.422 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_items": 0, 2024-09-12T03:04:02.422 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T03:04:02.422 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T03:04:02.422 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T03:04:02.422 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T03:04:02.422 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T03:04:02.422 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_items": 0, 2024-09-12T03:04:02.422 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T03:04:02.422 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T03:04:02.423 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_bytes": 0, 2024-09-12T03:04:02.423 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_items": 0, 2024-09-12T03:04:02.423 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_bytes": 0, 2024-09-12T03:04:02.423 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_items": 0, 2024-09-12T03:04:02.423 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T03:04:02.423 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T03:04:02.423 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T03:04:02.423 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T03:04:02.423 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T03:04:02.423 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_items": 0, 2024-09-12T03:04:02.423 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_bytes": 0, 2024-09-12T03:04:02.423 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_items": 0, 2024-09-12T03:04:02.423 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T03:04:02.424 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T03:04:02.424 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_bytes": 0, 2024-09-12T03:04:02.424 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_items": 0, 2024-09-12T03:04:02.424 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_bytes": 0, 2024-09-12T03:04:02.424 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_items": 0, 2024-09-12T03:04:02.424 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T03:04:02.424 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_items": 0, 2024-09-12T03:04:02.424 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T03:04:02.424 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_items": 0, 2024-09-12T03:04:02.424 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_bytes": 1919789, 2024-09-12T03:04:02.424 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_items": 45495, 2024-09-12T03:04:02.424 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_bytes": 0, 2024-09-12T03:04:02.424 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_items": 0, 2024-09-12T03:04:02.425 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bytes": 0, 2024-09-12T03:04:02.425 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_items": 0, 2024-09-12T03:04:02.425 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_bytes": 0, 2024-09-12T03:04:02.425 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_items": 0, 2024-09-12T03:04:02.425 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_bytes": 0, 2024-09-12T03:04:02.425 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_items": 0, 2024-09-12T03:04:02.425 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_bytes": 10136, 2024-09-12T03:04:02.425 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_items": 215, 2024-09-12T03:04:02.425 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T03:04:02.425 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_items": 0, 2024-09-12T03:04:02.425 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_bytes": 0, 2024-09-12T03:04:02.425 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_items": 0, 2024-09-12T03:04:02.425 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_bytes": 195819003, 2024-09-12T03:04:02.426 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_items": 1898531, 2024-09-12T03:04:02.426 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_bytes": 0, 2024-09-12T03:04:02.426 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_items": 0, 2024-09-12T03:04:02.426 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_bytes": 0, 2024-09-12T03:04:02.426 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_items": 0 2024-09-12T03:04:02.426 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.426 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter": { 2024-09-12T03:04:02.426 INFO:teuthology.orchestra.run.smithi062.stdout: "op_active": 0, 2024-09-12T03:04:02.426 INFO:teuthology.orchestra.run.smithi062.stdout: "op_laggy": 0, 2024-09-12T03:04:02.426 INFO:teuthology.orchestra.run.smithi062.stdout: "op_send": 4127, 2024-09-12T03:04:02.426 INFO:teuthology.orchestra.run.smithi062.stdout: "op_send_bytes": 21, 2024-09-12T03:04:02.426 INFO:teuthology.orchestra.run.smithi062.stdout: "op_resend": 3, 2024-09-12T03:04:02.427 INFO:teuthology.orchestra.run.smithi062.stdout: "op_reply": 4127, 2024-09-12T03:04:02.427 INFO:teuthology.orchestra.run.smithi062.stdout: "op_latency": { 2024-09-12T03:04:02.427 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 4127, 2024-09-12T03:04:02.427 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 58.552071364, 2024-09-12T03:04:02.427 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.014187562 2024-09-12T03:04:02.427 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.427 INFO:teuthology.orchestra.run.smithi062.stdout: "op_inflight": 0, 2024-09-12T03:04:02.427 INFO:teuthology.orchestra.run.smithi062.stdout: "oplen_avg": { 2024-09-12T03:04:02.427 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 4127, 2024-09-12T03:04:02.427 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 4128 2024-09-12T03:04:02.427 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.427 INFO:teuthology.orchestra.run.smithi062.stdout: "op": 4127, 2024-09-12T03:04:02.427 INFO:teuthology.orchestra.run.smithi062.stdout: "op_r": 4127, 2024-09-12T03:04:02.428 INFO:teuthology.orchestra.run.smithi062.stdout: "op_w": 0, 2024-09-12T03:04:02.428 INFO:teuthology.orchestra.run.smithi062.stdout: "op_rmw": 0, 2024-09-12T03:04:02.428 INFO:teuthology.orchestra.run.smithi062.stdout: "op_pg": 0, 2024-09-12T03:04:02.428 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_stat": 2464, 2024-09-12T03:04:02.428 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_create": 0, 2024-09-12T03:04:02.428 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_read": 1661, 2024-09-12T03:04:02.428 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_write": 0, 2024-09-12T03:04:02.428 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_writefull": 0, 2024-09-12T03:04:02.428 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_writesame": 0, 2024-09-12T03:04:02.428 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_append": 0, 2024-09-12T03:04:02.428 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_zero": 0, 2024-09-12T03:04:02.428 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_truncate": 0, 2024-09-12T03:04:02.428 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_delete": 0, 2024-09-12T03:04:02.429 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_mapext": 0, 2024-09-12T03:04:02.429 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_sparse_read": 0, 2024-09-12T03:04:02.429 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_clonerange": 0, 2024-09-12T03:04:02.429 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_getxattr": 1, 2024-09-12T03:04:02.429 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_setxattr": 0, 2024-09-12T03:04:02.429 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_cmpxattr": 0, 2024-09-12T03:04:02.429 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_rmxattr": 0, 2024-09-12T03:04:02.429 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_resetxattrs": 0, 2024-09-12T03:04:02.429 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_call": 0, 2024-09-12T03:04:02.429 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_watch": 0, 2024-09-12T03:04:02.429 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_notify": 0, 2024-09-12T03:04:02.429 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T03:04:02.430 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_pgls": 0, 2024-09-12T03:04:02.430 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_pgls_filter": 0, 2024-09-12T03:04:02.430 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_other": 0, 2024-09-12T03:04:02.430 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_active": 0, 2024-09-12T03:04:02.430 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_send": 0, 2024-09-12T03:04:02.430 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_resend": 0, 2024-09-12T03:04:02.430 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_ping": 0, 2024-09-12T03:04:02.430 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_active": 0, 2024-09-12T03:04:02.430 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_send": 0, 2024-09-12T03:04:02.430 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_resend": 0, 2024-09-12T03:04:02.430 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_active": 0, 2024-09-12T03:04:02.430 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_send": 0, 2024-09-12T03:04:02.430 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_resend": 0, 2024-09-12T03:04:02.430 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_active": 0, 2024-09-12T03:04:02.430 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_send": 0, 2024-09-12T03:04:02.431 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_resend": 0, 2024-09-12T03:04:02.431 INFO:teuthology.orchestra.run.smithi062.stdout: "command_active": 0, 2024-09-12T03:04:02.431 INFO:teuthology.orchestra.run.smithi062.stdout: "command_send": 0, 2024-09-12T03:04:02.431 INFO:teuthology.orchestra.run.smithi062.stdout: "command_resend": 0, 2024-09-12T03:04:02.431 INFO:teuthology.orchestra.run.smithi062.stdout: "map_epoch": 117, 2024-09-12T03:04:02.431 INFO:teuthology.orchestra.run.smithi062.stdout: "map_full": 0, 2024-09-12T03:04:02.431 INFO:teuthology.orchestra.run.smithi062.stdout: "map_inc": 21, 2024-09-12T03:04:02.431 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_sessions": 11, 2024-09-12T03:04:02.431 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_session_open": 11, 2024-09-12T03:04:02.431 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_session_close": 0, 2024-09-12T03:04:02.431 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_laggy": 0, 2024-09-12T03:04:02.431 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_wr": 0, 2024-09-12T03:04:02.431 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_rd": 2, 2024-09-12T03:04:02.431 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_del": 0 2024-09-12T03:04:02.432 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.432 INFO:teuthology.orchestra.run.smithi062.stdout: "oft": { 2024-09-12T03:04:02.432 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_objs": 0, 2024-09-12T03:04:02.432 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_kv_pairs": 0, 2024-09-12T03:04:02.432 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_updates": 0, 2024-09-12T03:04:02.432 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_removes": 0 2024-09-12T03:04:02.432 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.432 INFO:teuthology.orchestra.run.smithi062.stdout: "osd-slow-ops": { 2024-09-12T03:04:02.432 INFO:teuthology.orchestra.run.smithi062.stdout: "slow_ops_count": 0 2024-09-12T03:04:02.432 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.432 INFO:teuthology.orchestra.run.smithi062.stdout: "purge_queue": { 2024-09-12T03:04:02.432 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_ops": 0, 2024-09-12T03:04:02.432 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T03:04:02.432 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing": 0, 2024-09-12T03:04:02.433 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_high_water": 0, 2024-09-12T03:04:02.433 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executed_ops": 0, 2024-09-12T03:04:02.433 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executed": 0, 2024-09-12T03:04:02.433 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_item_in_journal": 0 2024-09-12T03:04:02.433 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.433 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T03:04:02.433 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T03:04:02.433 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-09-12T03:04:02.433 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:04:02.433 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 4524, 2024-09-12T03:04:02.433 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 674914943, 2024-09-12T03:04:02.434 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:02.434 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 4524, 2024-09-12T03:04:02.434 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-09-12T03:04:02.434 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-09-12T03:04:02.434 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 4524, 2024-09-12T03:04:02.434 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 674914943, 2024-09-12T03:04:02.434 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:04:02.434 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.434 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.434 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.434 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:04:02.434 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.434 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-objecter_bytes": { 2024-09-12T03:04:02.434 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T03:04:02.435 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-09-12T03:04:02.435 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:04:02.435 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-09-12T03:04:02.435 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-09-12T03:04:02.435 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:02.435 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-09-12T03:04:02.435 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 4127, 2024-09-12T03:04:02.435 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 672092309, 2024-09-12T03:04:02.435 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 4127, 2024-09-12T03:04:02.435 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 672092309, 2024-09-12T03:04:02.435 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:04:02.435 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.435 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.436 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.436 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:04:02.436 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.436 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-objecter_ops": { 2024-09-12T03:04:02.436 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T03:04:02.436 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 1024, 2024-09-12T03:04:02.436 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:04:02.436 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-09-12T03:04:02.436 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-09-12T03:04:02.436 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:02.436 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-09-12T03:04:02.436 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 4127, 2024-09-12T03:04:02.436 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 4127, 2024-09-12T03:04:02.436 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 4127, 2024-09-12T03:04:02.437 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 4127, 2024-09-12T03:04:02.437 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:04:02.437 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.437 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.437 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.437 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:04:02.437 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.437 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-write_buf_throttle": { 2024-09-12T03:04:02.437 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T03:04:02.437 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 3758096384, 2024-09-12T03:04:02.437 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:04:02.437 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-09-12T03:04:02.437 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-09-12T03:04:02.438 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:02.438 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-09-12T03:04:02.438 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-09-12T03:04:02.438 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-09-12T03:04:02.438 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 0, 2024-09-12T03:04:02.438 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 0, 2024-09-12T03:04:02.438 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:04:02.438 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.438 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.438 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.438 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:04:02.438 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T03:04:02.439 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-write_buf_throttle-0x559266532b40": { 2024-09-12T03:04:02.439 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T03:04:02.439 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 3758096384, 2024-09-12T03:04:02.439 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T03:04:02.439 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-09-12T03:04:02.439 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-09-12T03:04:02.439 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:02.439 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-09-12T03:04:02.439 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-09-12T03:04:02.439 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-09-12T03:04:02.439 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 0, 2024-09-12T03:04:02.439 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 0, 2024-09-12T03:04:02.439 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T03:04:02.440 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T03:04:02.440 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T03:04:02.440 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T03:04:02.440 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:04:02.440 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T03:04:02.440 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T03:04:02.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:02 smithi062 ceph-mon[35527]: pgmap v480: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 238 op/s 2024-09-12T03:04:02.786 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:02 smithi176 ceph-mon[35713]: pgmap v480: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 238 op/s 2024-09-12T03:04:02.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:02 smithi018 ceph-mon[30616]: pgmap v480: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 238 op/s 2024-09-12T03:04:03.326 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-12T03:04:03.326 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-12T03:04:03.326 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-09-12T03:04:03.326 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-12T03:04:03.326 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T03:04:03.326 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-09-12T03:04:03.326 DEBUG:tasks.check_counter:Getting stats from c 2024-09-12T03:04:03.327 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-12T03:04:03.839 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T03:04:04.645 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T03:04:04.646 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T03:04:04.646 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 22608, 2024-09-12T03:04:04.646 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 13503, 2024-09-12T03:04:04.646 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 9506125, 2024-09-12T03:04:04.646 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 94927856, 2024-09-12T03:04:04.646 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 11, 2024-09-12T03:04:04.646 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 4, 2024-09-12T03:04:04.646 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 1.276239667, 2024-09-12T03:04:04.646 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.573210875, 2024-09-12T03:04:04.646 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.682767131, 2024-09-12T03:04:04.647 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.181400484, 2024-09-12T03:04:04.647 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:04:04.647 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 13501, 2024-09-12T03:04:04.647 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 1.705762360, 2024-09-12T03:04:04.647 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000126343 2024-09-12T03:04:04.647 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.647 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:04:04.647 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 25720, 2024-09-12T03:04:04.647 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.003330367, 2024-09-12T03:04:04.647 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000129 2024-09-12T03:04:04.648 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.648 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 3776, 2024-09-12T03:04:04.648 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 18272 2024-09-12T03:04:04.648 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.648 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T03:04:04.648 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 18857, 2024-09-12T03:04:04.648 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 15352, 2024-09-12T03:04:04.648 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 11151837, 2024-09-12T03:04:04.648 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 110423957, 2024-09-12T03:04:04.648 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 13, 2024-09-12T03:04:04.649 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 6, 2024-09-12T03:04:04.649 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 1.560442198, 2024-09-12T03:04:04.649 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.736936344, 2024-09-12T03:04:04.649 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.644976273, 2024-09-12T03:04:04.649 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.299706909, 2024-09-12T03:04:04.649 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:04:04.649 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 15351, 2024-09-12T03:04:04.649 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 1.082743953, 2024-09-12T03:04:04.649 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000070532 2024-09-12T03:04:04.649 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.649 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:04:04.649 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 15303, 2024-09-12T03:04:04.649 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.002101918, 2024-09-12T03:04:04.650 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000137 2024-09-12T03:04:04.650 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.650 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 2132784, 2024-09-12T03:04:04.650 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 619296 2024-09-12T03:04:04.650 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.650 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T03:04:04.650 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 141707, 2024-09-12T03:04:04.651 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 205228, 2024-09-12T03:04:04.651 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 54832379, 2024-09-12T03:04:04.651 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 159466908, 2024-09-12T03:04:04.651 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 15, 2024-09-12T03:04:04.651 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 8, 2024-09-12T03:04:04.651 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 6.630681941, 2024-09-12T03:04:04.651 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 3.229142221, 2024-09-12T03:04:04.651 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 5.762105508, 2024-09-12T03:04:04.651 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.251439965, 2024-09-12T03:04:04.651 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:04:04.652 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 205226, 2024-09-12T03:04:04.652 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 15.559168935, 2024-09-12T03:04:04.652 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000075814 2024-09-12T03:04:04.652 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.652 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:04:04.652 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 142999, 2024-09-12T03:04:04.652 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.038083380, 2024-09-12T03:04:04.652 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000266 2024-09-12T03:04:04.652 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.652 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 4992, 2024-09-12T03:04:04.652 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 140064 2024-09-12T03:04:04.653 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.653 INFO:teuthology.orchestra.run.smithi176.stdout: "cct": { 2024-09-12T03:04:04.653 INFO:teuthology.orchestra.run.smithi176.stdout: "total_workers": 1, 2024-09-12T03:04:04.653 INFO:teuthology.orchestra.run.smithi176.stdout: "unhealthy_workers": 0 2024-09-12T03:04:04.653 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.653 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-MDSRank": { 2024-09-12T03:04:04.653 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-09-12T03:04:04.653 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-09-12T03:04:04.654 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 4279, 2024-09-12T03:04:04.654 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 44.607798022, 2024-09-12T03:04:04.654 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.010424818 2024-09-12T03:04:04.654 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:04.654 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.654 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-PurgeQueue": { 2024-09-12T03:04:04.654 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-09-12T03:04:04.654 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-09-12T03:04:04.654 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 16327, 2024-09-12T03:04:04.654 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 2.279773732, 2024-09-12T03:04:04.654 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000139632 2024-09-12T03:04:04.654 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:04.655 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.655 INFO:teuthology.orchestra.run.smithi176.stdout: "mds": { 2024-09-12T03:04:04.655 INFO:teuthology.orchestra.run.smithi176.stdout: "request": 51313, 2024-09-12T03:04:04.655 INFO:teuthology.orchestra.run.smithi176.stdout: "reply": 49091, 2024-09-12T03:04:04.655 INFO:teuthology.orchestra.run.smithi176.stdout: "reply_latency": { 2024-09-12T03:04:04.655 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 49091, 2024-09-12T03:04:04.655 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 1563.284165636, 2024-09-12T03:04:04.655 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.031844618 2024-09-12T03:04:04.655 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.655 INFO:teuthology.orchestra.run.smithi176.stdout: "slow_reply": 0, 2024-09-12T03:04:04.655 INFO:teuthology.orchestra.run.smithi176.stdout: "forward": 2222, 2024-09-12T03:04:04.655 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_fetch_complete": 57, 2024-09-12T03:04:04.656 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_fetch_keys": 0, 2024-09-12T03:04:04.656 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_commit": 776, 2024-09-12T03:04:04.656 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_split": 85, 2024-09-12T03:04:04.656 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_merge": 0, 2024-09-12T03:04:04.656 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes": 23568, 2024-09-12T03:04:04.656 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_top": 118, 2024-09-12T03:04:04.656 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_bottom": 3288, 2024-09-12T03:04:04.656 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_pin_tail": 20162, 2024-09-12T03:04:04.656 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_pinned": 23395, 2024-09-12T03:04:04.656 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_expired": 33379, 2024-09-12T03:04:04.656 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_with_caps": 1, 2024-09-12T03:04:04.656 INFO:teuthology.orchestra.run.smithi176.stdout: "caps": 1, 2024-09-12T03:04:04.657 INFO:teuthology.orchestra.run.smithi176.stdout: "subtrees": 6, 2024-09-12T03:04:04.657 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse": 79381, 2024-09-12T03:04:04.657 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_hit": 69074, 2024-09-12T03:04:04.657 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_forward": 2070, 2024-09-12T03:04:04.657 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_discover": 525, 2024-09-12T03:04:04.657 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_dir_fetch": 1, 2024-09-12T03:04:04.657 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_remote_ino": 0, 2024-09-12T03:04:04.657 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_lock": 406, 2024-09-12T03:04:04.657 INFO:teuthology.orchestra.run.smithi176.stdout: "load_cent": 0, 2024-09-12T03:04:04.657 INFO:teuthology.orchestra.run.smithi176.stdout: "q": 0, 2024-09-12T03:04:04.657 INFO:teuthology.orchestra.run.smithi176.stdout: "exported": 134, 2024-09-12T03:04:04.657 INFO:teuthology.orchestra.run.smithi176.stdout: "exported_inodes": 25718, 2024-09-12T03:04:04.658 INFO:teuthology.orchestra.run.smithi176.stdout: "imported": 187, 2024-09-12T03:04:04.658 INFO:teuthology.orchestra.run.smithi176.stdout: "imported_inodes": 15319, 2024-09-12T03:04:04.658 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_dir_fetch": 0, 2024-09-12T03:04:04.658 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_backtrace_fetch": 0, 2024-09-12T03:04:04.658 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_peer_discover": 1, 2024-09-12T03:04:04.658 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rfiles": 4, 2024-09-12T03:04:04.658 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rbytes": 234, 2024-09-12T03:04:04.658 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rsnaps": 0, 2024-09-12T03:04:04.659 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T03:04:04.659 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_set_tag": 0, 2024-09-12T03:04:04.659 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T03:04:04.659 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_inotable_repaired": 0, 2024-09-12T03:04:04.659 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dir_inodes": 0, 2024-09-12T03:04:04.659 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T03:04:04.659 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T03:04:04.659 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_file_inodes": 0, 2024-09-12T03:04:04.659 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_inode_file_caps": 90, 2024-09-12T03:04:04.659 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_revoke": 13452, 2024-09-12T03:04:04.659 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_grant": 23072, 2024-09-12T03:04:04.660 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T03:04:04.660 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T03:04:04.660 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T03:04:04.660 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_caps": 46735, 2024-09-12T03:04:04.660 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_caps_dirty": 20765, 2024-09-12T03:04:04.660 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_cap_release": 269, 2024-09-12T03:04:04.660 INFO:teuthology.orchestra.run.smithi176.stdout: "process_request_cap_release": 24755 2024-09-12T03:04:04.660 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.660 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_cache": { 2024-09-12T03:04:04.661 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_update": 0, 2024-09-12T03:04:04.661 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_update_receipt": 6, 2024-09-12T03:04:04.661 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_try_discover": 4, 2024-09-12T03:04:04.661 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_send_discover": 574, 2024-09-12T03:04:04.661 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_handle_discover": 462, 2024-09-12T03:04:04.661 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays": 73, 2024-09-12T03:04:04.661 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays_delayed": 0, 2024-09-12T03:04:04.661 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays_enqueuing": 0, 2024-09-12T03:04:04.661 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_created": 8314, 2024-09-12T03:04:04.661 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_enqueued": 8241, 2024-09-12T03:04:04.661 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_reintegrated": 0, 2024-09-12T03:04:04.661 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_migrated": 0, 2024-09-12T03:04:04.662 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_processing": 0, 2024-09-12T03:04:04.662 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_enqueued": 0, 2024-09-12T03:04:04.662 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_prioritized": 0, 2024-09-12T03:04:04.662 INFO:teuthology.orchestra.run.smithi176.stdout: "recovery_started": 0, 2024-09-12T03:04:04.662 INFO:teuthology.orchestra.run.smithi176.stdout: "recovery_completed": 0, 2024-09-12T03:04:04.662 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_quiesce_path": 0, 2024-09-12T03:04:04.662 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_quiesce_inode": 0, 2024-09-12T03:04:04.662 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T03:04:04.662 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_exportdir": 135, 2024-09-12T03:04:04.662 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_flush": 0, 2024-09-12T03:04:04.663 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_fragmentdir": 85, 2024-09-12T03:04:04.663 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_fragstats": 0, 2024-09-12T03:04:04.663 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_inodestats": 0 2024-09-12T03:04:04.663 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.663 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_log": { 2024-09-12T03:04:04.663 INFO:teuthology.orchestra.run.smithi176.stdout: "evlrg": 2, 2024-09-12T03:04:04.663 INFO:teuthology.orchestra.run.smithi176.stdout: "evadd": 86306, 2024-09-12T03:04:04.663 INFO:teuthology.orchestra.run.smithi176.stdout: "evex": 1, 2024-09-12T03:04:04.663 INFO:teuthology.orchestra.run.smithi176.stdout: "evtrm": 1, 2024-09-12T03:04:04.663 INFO:teuthology.orchestra.run.smithi176.stdout: "ev": 86305, 2024-09-12T03:04:04.664 INFO:teuthology.orchestra.run.smithi176.stdout: "evexg": 0, 2024-09-12T03:04:04.664 INFO:teuthology.orchestra.run.smithi176.stdout: "evexd": 1, 2024-09-12T03:04:04.664 INFO:teuthology.orchestra.run.smithi176.stdout: "segadd": 129, 2024-09-12T03:04:04.664 INFO:teuthology.orchestra.run.smithi176.stdout: "segex": 1, 2024-09-12T03:04:04.664 INFO:teuthology.orchestra.run.smithi176.stdout: "segtrm": 1, 2024-09-12T03:04:04.664 INFO:teuthology.orchestra.run.smithi176.stdout: "seg": 128, 2024-09-12T03:04:04.664 INFO:teuthology.orchestra.run.smithi176.stdout: "segmjr": 8, 2024-09-12T03:04:04.664 INFO:teuthology.orchestra.run.smithi176.stdout: "segexg": 0, 2024-09-12T03:04:04.664 INFO:teuthology.orchestra.run.smithi176.stdout: "segexd": 1, 2024-09-12T03:04:04.664 INFO:teuthology.orchestra.run.smithi176.stdout: "expos": 4194352, 2024-09-12T03:04:04.664 INFO:teuthology.orchestra.run.smithi176.stdout: "wrpos": 269326844, 2024-09-12T03:04:04.664 INFO:teuthology.orchestra.run.smithi176.stdout: "rdpos": 0, 2024-09-12T03:04:04.665 INFO:teuthology.orchestra.run.smithi176.stdout: "jlat": { 2024-09-12T03:04:04.665 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 1633, 2024-09-12T03:04:04.665 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 199.993125660, 2024-09-12T03:04:04.665 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.122469764 2024-09-12T03:04:04.665 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.665 INFO:teuthology.orchestra.run.smithi176.stdout: "replayed": 0 2024-09-12T03:04:04.665 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.665 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_mem": { 2024-09-12T03:04:04.665 INFO:teuthology.orchestra.run.smithi176.stdout: "ino": 11870, 2024-09-12T03:04:04.665 INFO:teuthology.orchestra.run.smithi176.stdout: "ino+": 37038, 2024-09-12T03:04:04.665 INFO:teuthology.orchestra.run.smithi176.stdout: "ino-": 25168, 2024-09-12T03:04:04.665 INFO:teuthology.orchestra.run.smithi176.stdout: "dir": 492, 2024-09-12T03:04:04.666 INFO:teuthology.orchestra.run.smithi176.stdout: "dir+": 1290, 2024-09-12T03:04:04.666 INFO:teuthology.orchestra.run.smithi176.stdout: "dir-": 798, 2024-09-12T03:04:04.666 INFO:teuthology.orchestra.run.smithi176.stdout: "dn": 23568, 2024-09-12T03:04:04.666 INFO:teuthology.orchestra.run.smithi176.stdout: "dn+": 67252, 2024-09-12T03:04:04.666 INFO:teuthology.orchestra.run.smithi176.stdout: "dn-": 43684, 2024-09-12T03:04:04.666 INFO:teuthology.orchestra.run.smithi176.stdout: "cap": 1, 2024-09-12T03:04:04.666 INFO:teuthology.orchestra.run.smithi176.stdout: "cap+": 20709, 2024-09-12T03:04:04.666 INFO:teuthology.orchestra.run.smithi176.stdout: "cap-": 20708, 2024-09-12T03:04:04.666 INFO:teuthology.orchestra.run.smithi176.stdout: "rss": 190100, 2024-09-12T03:04:04.666 INFO:teuthology.orchestra.run.smithi176.stdout: "heap": 223520 2024-09-12T03:04:04.666 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.666 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_server": { 2024-09-12T03:04:04.666 INFO:teuthology.orchestra.run.smithi176.stdout: "dispatch_client_request": 55680, 2024-09-12T03:04:04.666 INFO:teuthology.orchestra.run.smithi176.stdout: "dispatch_server_request": 3920, 2024-09-12T03:04:04.666 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_request": 51313, 2024-09-12T03:04:04.667 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_session": 258, 2024-09-12T03:04:04.667 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_peer_request": 7801, 2024-09-12T03:04:04.667 INFO:teuthology.orchestra.run.smithi176.stdout: "req_create_latency": { 2024-09-12T03:04:04.667 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 13925, 2024-09-12T03:04:04.667 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 48.028225797, 2024-09-12T03:04:04.667 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.003449064 2024-09-12T03:04:04.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.667 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getattr_latency": { 2024-09-12T03:04:04.667 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 170, 2024-09-12T03:04:04.667 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 3.124365463, 2024-09-12T03:04:04.667 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.018378620 2024-09-12T03:04:04.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.667 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getfilelock_latency": { 2024-09-12T03:04:04.668 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.668 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.668 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.668 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.668 INFO:teuthology.orchestra.run.smithi176.stdout: "req_link_latency": { 2024-09-12T03:04:04.668 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.668 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.668 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.668 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.668 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookup_latency": { 2024-09-12T03:04:04.668 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 9121, 2024-09-12T03:04:04.668 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 1227.861241560, 2024-09-12T03:04:04.669 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.134619147 2024-09-12T03:04:04.669 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.669 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookuphash_latency": { 2024-09-12T03:04:04.669 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.669 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.669 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.669 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.669 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupino_latency": { 2024-09-12T03:04:04.669 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.669 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.670 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.670 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.670 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupname_latency": { 2024-09-12T03:04:04.670 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.670 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.670 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.670 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.670 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupparent_latency": { 2024-09-12T03:04:04.670 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.670 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.670 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.670 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.670 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupsnap_latency": { 2024-09-12T03:04:04.670 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.671 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.671 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.671 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.671 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lssnap_latency": { 2024-09-12T03:04:04.671 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.672 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.672 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.672 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.672 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mkdir_latency": { 2024-09-12T03:04:04.672 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 105, 2024-09-12T03:04:04.672 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 14.045041853, 2024-09-12T03:04:04.672 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.133762303 2024-09-12T03:04:04.672 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.672 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mknod_latency": { 2024-09-12T03:04:04.672 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mksnap_latency": { 2024-09-12T03:04:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: "req_open_latency": { 2024-09-12T03:04:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 3895, 2024-09-12T03:04:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 7.420798650, 2024-09-12T03:04:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.001905211 2024-09-12T03:04:04.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.674 INFO:teuthology.orchestra.run.smithi176.stdout: "req_readdir_latency": { 2024-09-12T03:04:04.674 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 394, 2024-09-12T03:04:04.674 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.572653271, 2024-09-12T03:04:04.674 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.001453434 2024-09-12T03:04:04.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.674 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rename_latency": { 2024-09-12T03:04:04.674 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 13934, 2024-09-12T03:04:04.674 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 238.923027260, 2024-09-12T03:04:04.674 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.017146765 2024-09-12T03:04:04.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.674 INFO:teuthology.orchestra.run.smithi176.stdout: "req_renamesnap_latency": { 2024-09-12T03:04:04.675 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.675 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.675 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.675 INFO:teuthology.orchestra.run.smithi176.stdout: "req_snapdiff_latency": { 2024-09-12T03:04:04.675 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.675 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.675 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.675 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmdir_latency": { 2024-09-12T03:04:04.676 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 73, 2024-09-12T03:04:04.676 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 9.192489954, 2024-09-12T03:04:04.676 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.125924519 2024-09-12T03:04:04.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.676 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmsnap_latency": { 2024-09-12T03:04:04.676 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.676 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.677 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.677 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.677 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmxattr_latency": { 2024-09-12T03:04:04.677 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.677 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.677 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.678 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setattr_latency": { 2024-09-12T03:04:04.678 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.678 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.678 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.679 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setdirlayout_latency": { 2024-09-12T03:04:04.679 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.679 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.679 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.679 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.680 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setfilelock_latency": { 2024-09-12T03:04:04.680 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.680 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.680 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.680 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.680 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setlayout_latency": { 2024-09-12T03:04:04.681 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.681 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.681 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.681 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.681 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setxattr_latency": { 2024-09-12T03:04:04.681 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.682 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.682 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.682 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.682 INFO:teuthology.orchestra.run.smithi176.stdout: "req_symlink_latency": { 2024-09-12T03:04:04.682 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.682 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.683 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.683 INFO:teuthology.orchestra.run.smithi176.stdout: "req_unlink_latency": { 2024-09-12T03:04:04.683 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 7474, 2024-09-12T03:04:04.683 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 14.116321828, 2024-09-12T03:04:04.684 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.001888723 2024-09-12T03:04:04.684 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.684 INFO:teuthology.orchestra.run.smithi176.stdout: "cap_revoke_eviction": 0, 2024-09-12T03:04:04.684 INFO:teuthology.orchestra.run.smithi176.stdout: "cap_acquisition_throttle": 0, 2024-09-12T03:04:04.684 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getvxattr_latency": { 2024-09-12T03:04:04.685 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.685 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.685 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.685 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:04.685 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.685 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_sessions": { 2024-09-12T03:04:04.686 INFO:teuthology.orchestra.run.smithi176.stdout: "session_count": 2, 2024-09-12T03:04:04.686 INFO:teuthology.orchestra.run.smithi176.stdout: "session_add": 4, 2024-09-12T03:04:04.686 INFO:teuthology.orchestra.run.smithi176.stdout: "session_remove": 2, 2024-09-12T03:04:04.686 INFO:teuthology.orchestra.run.smithi176.stdout: "sessions_open": 2, 2024-09-12T03:04:04.686 INFO:teuthology.orchestra.run.smithi176.stdout: "sessions_stale": 0, 2024-09-12T03:04:04.686 INFO:teuthology.orchestra.run.smithi176.stdout: "total_load": 319, 2024-09-12T03:04:04.687 INFO:teuthology.orchestra.run.smithi176.stdout: "average_load": 159, 2024-09-12T03:04:04.687 INFO:teuthology.orchestra.run.smithi176.stdout: "avg_session_uptime": 907, 2024-09-12T03:04:04.687 INFO:teuthology.orchestra.run.smithi176.stdout: "mdthresh_evicted": 0 2024-09-12T03:04:04.687 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.687 INFO:teuthology.orchestra.run.smithi176.stdout: "mempool": { 2024-09-12T03:04:04.687 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_bytes": 0, 2024-09-12T03:04:04.688 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_items": 0, 2024-09-12T03:04:04.688 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T03:04:04.688 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_items": 0, 2024-09-12T03:04:04.688 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T03:04:04.688 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_items": 0, 2024-09-12T03:04:04.689 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T03:04:04.689 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T03:04:04.689 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T03:04:04.689 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T03:04:04.689 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T03:04:04.689 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_items": 0, 2024-09-12T03:04:04.690 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T03:04:04.690 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T03:04:04.690 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_bytes": 0, 2024-09-12T03:04:04.690 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_items": 0, 2024-09-12T03:04:04.690 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_bytes": 0, 2024-09-12T03:04:04.691 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_items": 0, 2024-09-12T03:04:04.691 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T03:04:04.691 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T03:04:04.691 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T03:04:04.691 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T03:04:04.691 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T03:04:04.692 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_items": 0, 2024-09-12T03:04:04.692 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_bytes": 0, 2024-09-12T03:04:04.692 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_items": 0, 2024-09-12T03:04:04.692 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T03:04:04.692 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T03:04:04.693 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_bytes": 0, 2024-09-12T03:04:04.693 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_items": 0, 2024-09-12T03:04:04.693 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_bytes": 0, 2024-09-12T03:04:04.693 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_items": 0, 2024-09-12T03:04:04.693 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T03:04:04.693 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_items": 0, 2024-09-12T03:04:04.694 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T03:04:04.694 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_items": 0, 2024-09-12T03:04:04.694 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_bytes": 1296184, 2024-09-12T03:04:04.694 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_items": 10220, 2024-09-12T03:04:04.694 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_bytes": 88, 2024-09-12T03:04:04.695 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_items": 1, 2024-09-12T03:04:04.695 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_bytes": 0, 2024-09-12T03:04:04.695 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_items": 0, 2024-09-12T03:04:04.695 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_bytes": 0, 2024-09-12T03:04:04.695 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_items": 0, 2024-09-12T03:04:04.695 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_bytes": 0, 2024-09-12T03:04:04.696 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_items": 0, 2024-09-12T03:04:04.696 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_bytes": 10136, 2024-09-12T03:04:04.696 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_items": 215, 2024-09-12T03:04:04.696 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T03:04:04.696 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_items": 0, 2024-09-12T03:04:04.696 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_bytes": 0, 2024-09-12T03:04:04.697 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_items": 0, 2024-09-12T03:04:04.697 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_bytes": 45392452, 2024-09-12T03:04:04.697 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_items": 463803, 2024-09-12T03:04:04.698 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_bytes": 0, 2024-09-12T03:04:04.698 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_items": 0, 2024-09-12T03:04:04.698 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_bytes": 0, 2024-09-12T03:04:04.698 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_items": 0 2024-09-12T03:04:04.698 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.698 INFO:teuthology.orchestra.run.smithi176.stdout: "objecter": { 2024-09-12T03:04:04.699 INFO:teuthology.orchestra.run.smithi176.stdout: "op_active": 0, 2024-09-12T03:04:04.699 INFO:teuthology.orchestra.run.smithi176.stdout: "op_laggy": 0, 2024-09-12T03:04:04.699 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send": 20355, 2024-09-12T03:04:04.699 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send_bytes": 282498839, 2024-09-12T03:04:04.699 INFO:teuthology.orchestra.run.smithi176.stdout: "op_resend": 30, 2024-09-12T03:04:04.700 INFO:teuthology.orchestra.run.smithi176.stdout: "op_reply": 20355, 2024-09-12T03:04:04.700 INFO:teuthology.orchestra.run.smithi176.stdout: "op_latency": { 2024-09-12T03:04:04.700 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 20355, 2024-09-12T03:04:04.700 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 797.395854579, 2024-09-12T03:04:04.700 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.039174446 2024-09-12T03:04:04.700 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.701 INFO:teuthology.orchestra.run.smithi176.stdout: "op_inflight": 0, 2024-09-12T03:04:04.701 INFO:teuthology.orchestra.run.smithi176.stdout: "oplen_avg": { 2024-09-12T03:04:04.701 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 20355, 2024-09-12T03:04:04.701 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 21869 2024-09-12T03:04:04.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.702 INFO:teuthology.orchestra.run.smithi176.stdout: "op": 20355, 2024-09-12T03:04:04.702 INFO:teuthology.orchestra.run.smithi176.stdout: "op_r": 431, 2024-09-12T03:04:04.702 INFO:teuthology.orchestra.run.smithi176.stdout: "op_w": 19924, 2024-09-12T03:04:04.702 INFO:teuthology.orchestra.run.smithi176.stdout: "op_rmw": 0, 2024-09-12T03:04:04.702 INFO:teuthology.orchestra.run.smithi176.stdout: "op_pg": 0, 2024-09-12T03:04:04.702 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_stat": 0, 2024-09-12T03:04:04.703 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_create": 10, 2024-09-12T03:04:04.703 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_read": 300, 2024-09-12T03:04:04.703 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_write": 1934, 2024-09-12T03:04:04.703 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writefull": 184, 2024-09-12T03:04:04.703 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writesame": 0, 2024-09-12T03:04:04.704 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_append": 0, 2024-09-12T03:04:04.704 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_zero": 0, 2024-09-12T03:04:04.704 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_truncate": 85, 2024-09-12T03:04:04.704 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_delete": 16557, 2024-09-12T03:04:04.704 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_mapext": 0, 2024-09-12T03:04:04.704 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_sparse_read": 0, 2024-09-12T03:04:04.705 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_clonerange": 0, 2024-09-12T03:04:04.705 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_getxattr": 0, 2024-09-12T03:04:04.705 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_setxattr": 20, 2024-09-12T03:04:04.705 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_cmpxattr": 0, 2024-09-12T03:04:04.705 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_rmxattr": 0, 2024-09-12T03:04:04.705 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_resetxattrs": 0, 2024-09-12T03:04:04.705 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_call": 0, 2024-09-12T03:04:04.706 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_watch": 0, 2024-09-12T03:04:04.706 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_notify": 0, 2024-09-12T03:04:04.706 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T03:04:04.706 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls": 0, 2024-09-12T03:04:04.707 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls_filter": 0, 2024-09-12T03:04:04.707 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_other": 0, 2024-09-12T03:04:04.707 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_active": 0, 2024-09-12T03:04:04.707 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_send": 0, 2024-09-12T03:04:04.707 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_resend": 0, 2024-09-12T03:04:04.707 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_ping": 0, 2024-09-12T03:04:04.707 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_active": 0, 2024-09-12T03:04:04.707 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_send": 0, 2024-09-12T03:04:04.707 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_resend": 0, 2024-09-12T03:04:04.707 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_active": 0, 2024-09-12T03:04:04.707 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_send": 0, 2024-09-12T03:04:04.708 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_resend": 0, 2024-09-12T03:04:04.708 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_active": 0, 2024-09-12T03:04:04.708 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_send": 0, 2024-09-12T03:04:04.708 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_resend": 0, 2024-09-12T03:04:04.708 INFO:teuthology.orchestra.run.smithi176.stdout: "command_active": 0, 2024-09-12T03:04:04.708 INFO:teuthology.orchestra.run.smithi176.stdout: "command_send": 0, 2024-09-12T03:04:04.708 INFO:teuthology.orchestra.run.smithi176.stdout: "command_resend": 0, 2024-09-12T03:04:04.708 INFO:teuthology.orchestra.run.smithi176.stdout: "map_epoch": 117, 2024-09-12T03:04:04.708 INFO:teuthology.orchestra.run.smithi176.stdout: "map_full": 0, 2024-09-12T03:04:04.709 INFO:teuthology.orchestra.run.smithi176.stdout: "map_inc": 21, 2024-09-12T03:04:04.709 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_sessions": 12, 2024-09-12T03:04:04.709 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_open": 12, 2024-09-12T03:04:04.709 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_close": 0, 2024-09-12T03:04:04.709 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_laggy": 0, 2024-09-12T03:04:04.709 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_wr": 2234, 2024-09-12T03:04:04.709 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_rd": 188, 2024-09-12T03:04:04.709 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_del": 357 2024-09-12T03:04:04.709 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.710 INFO:teuthology.orchestra.run.smithi176.stdout: "oft": { 2024-09-12T03:04:04.710 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_objs": 1, 2024-09-12T03:04:04.710 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_kv_pairs": 0, 2024-09-12T03:04:04.710 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_updates": 0, 2024-09-12T03:04:04.710 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_removes": 0 2024-09-12T03:04:04.710 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.710 INFO:teuthology.orchestra.run.smithi176.stdout: "osd-slow-ops": { 2024-09-12T03:04:04.710 INFO:teuthology.orchestra.run.smithi176.stdout: "slow_ops_count": 21 2024-09-12T03:04:04.710 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.710 INFO:teuthology.orchestra.run.smithi176.stdout: "purge_queue": { 2024-09-12T03:04:04.710 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_ops": 0, 2024-09-12T03:04:04.710 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_ops_high_water": 10, 2024-09-12T03:04:04.711 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing": 0, 2024-09-12T03:04:04.711 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_high_water": 5, 2024-09-12T03:04:04.711 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executed_ops": 16482, 2024-09-12T03:04:04.711 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executed": 8241, 2024-09-12T03:04:04.711 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_item_in_journal": 0 2024-09-12T03:04:04.711 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.711 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T03:04:04.711 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:04.711 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-09-12T03:04:04.711 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:04.711 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 183168, 2024-09-12T03:04:04.711 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 61026131, 2024-09-12T03:04:04.711 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:04.711 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 183168, 2024-09-12T03:04:04.712 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-09-12T03:04:04.712 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-09-12T03:04:04.712 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 183168, 2024-09-12T03:04:04.712 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 61026131, 2024-09-12T03:04:04.712 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:04.712 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.712 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.712 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.712 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:04.712 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.712 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_bytes": { 2024-09-12T03:04:04.712 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:04.712 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-09-12T03:04:04.713 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:04.713 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-09-12T03:04:04.713 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-09-12T03:04:04.713 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:04.713 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-09-12T03:04:04.713 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 20355, 2024-09-12T03:04:04.713 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 283658564, 2024-09-12T03:04:04.713 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 20355, 2024-09-12T03:04:04.713 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 283658564, 2024-09-12T03:04:04.713 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:04.713 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.713 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.713 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.714 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:04.714 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.714 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_ops": { 2024-09-12T03:04:04.714 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:04.714 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 1024, 2024-09-12T03:04:04.714 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:04.714 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-09-12T03:04:04.714 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-09-12T03:04:04.714 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:04.714 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-09-12T03:04:04.714 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 20355, 2024-09-12T03:04:04.714 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 20355, 2024-09-12T03:04:04.714 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 20355, 2024-09-12T03:04:04.715 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 20355, 2024-09-12T03:04:04.715 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:04.715 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.715 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.715 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.715 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:04.715 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.715 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-write_buf_throttle": { 2024-09-12T03:04:04.715 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:04.715 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 3758096384, 2024-09-12T03:04:04.715 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:04.715 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 8241, 2024-09-12T03:04:04.715 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 1163181, 2024-09-12T03:04:04.715 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:04.716 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 8241, 2024-09-12T03:04:04.716 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-09-12T03:04:04.716 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-09-12T03:04:04.716 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 301, 2024-09-12T03:04:04.716 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 1163181, 2024-09-12T03:04:04.716 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:04.716 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.716 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.716 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.716 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:04.716 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:04.716 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-write_buf_throttle-0x56140d994960": { 2024-09-12T03:04:04.716 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:04.717 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 3758096384, 2024-09-12T03:04:04.717 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:04.717 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 86306, 2024-09-12T03:04:04.717 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 265132540, 2024-09-12T03:04:04.717 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:04.717 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 86306, 2024-09-12T03:04:04.717 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-09-12T03:04:04.717 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-09-12T03:04:04.717 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 1633, 2024-09-12T03:04:04.717 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 265132540, 2024-09-12T03:04:04.717 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:04.717 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:04.717 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:04.717 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:04.718 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:04.718 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:04.718 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T03:04:04.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:04 smithi018 ceph-mon[30616]: pgmap v481: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 198 op/s 2024-09-12T03:04:04.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:04 smithi176 ceph-mon[35713]: pgmap v481: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 198 op/s 2024-09-12T03:04:05.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:04 smithi062 ceph-mon[35527]: pgmap v481: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 198 op/s 2024-09-12T03:04:05.823 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:05 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T03:04:05.833 INFO:tasks.check_counter:Daemon mds.c mds.exported=134 2024-09-12T03:04:05.833 INFO:tasks.check_counter:Daemon mds.c mds.imported=187 2024-09-12T03:04:05.833 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2024-09-12T03:04:05.833 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-12T03:04:05.833 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T03:04:05.833 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=85 2024-09-12T03:04:05.833 DEBUG:tasks.check_counter:Getting stats from f 2024-09-12T03:04:05.834 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-12T03:04:05.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:05 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T03:04:06.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:05 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T03:04:06.310 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T03:04:06.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:06 smithi176 ceph-mon[35713]: pgmap v482: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 279 op/s 2024-09-12T03:04:06.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:06 smithi018 ceph-mon[30616]: pgmap v482: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 279 op/s 2024-09-12T03:04:06.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:06 smithi062 ceph-mon[35527]: pgmap v482: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 279 op/s 2024-09-12T03:04:07.179 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T03:04:07.179 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T03:04:07.179 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 2293, 2024-09-12T03:04:07.179 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 2293, 2024-09-12T03:04:07.179 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 124891105, 2024-09-12T03:04:07.179 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 728360, 2024-09-12T03:04:07.179 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 8, 2024-09-12T03:04:07.179 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 4, 2024-09-12T03:04:07.179 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.263542232, 2024-09-12T03:04:07.180 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.058515199, 2024-09-12T03:04:07.180 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.122568046, 2024-09-12T03:04:07.180 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.064995113, 2024-09-12T03:04:07.180 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:04:07.180 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 2292, 2024-09-12T03:04:07.180 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.119421944, 2024-09-12T03:04:07.180 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000052103 2024-09-12T03:04:07.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.180 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:04:07.180 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.180 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.180 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.181 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T03:04:07.181 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T03:04:07.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.181 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T03:04:07.181 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 339, 2024-09-12T03:04:07.181 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 570, 2024-09-12T03:04:07.181 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 75602418, 2024-09-12T03:04:07.181 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 749650, 2024-09-12T03:04:07.181 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 10, 2024-09-12T03:04:07.181 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 7, 2024-09-12T03:04:07.181 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.075046658, 2024-09-12T03:04:07.181 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.016201581, 2024-09-12T03:04:07.182 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.046486639, 2024-09-12T03:04:07.182 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.008014565, 2024-09-12T03:04:07.182 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:04:07.182 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 567, 2024-09-12T03:04:07.182 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.054429130, 2024-09-12T03:04:07.182 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000095994 2024-09-12T03:04:07.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.182 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:04:07.182 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.182 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.182 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.182 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-12T03:04:07.183 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 642736 2024-09-12T03:04:07.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.183 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T03:04:07.183 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 1594, 2024-09-12T03:04:07.183 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 1533, 2024-09-12T03:04:07.183 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 90503990, 2024-09-12T03:04:07.183 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 574687, 2024-09-12T03:04:07.183 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 5, 2024-09-12T03:04:07.183 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 4, 2024-09-12T03:04:07.183 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.201337884, 2024-09-12T03:04:07.183 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.049871852, 2024-09-12T03:04:07.183 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.121881875, 2024-09-12T03:04:07.183 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.038395155, 2024-09-12T03:04:07.183 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:04:07.184 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 1532, 2024-09-12T03:04:07.184 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.074611754, 2024-09-12T03:04:07.184 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000048702 2024-09-12T03:04:07.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.184 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:04:07.184 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.184 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.184 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.184 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 2113056, 2024-09-12T03:04:07.184 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 192768 2024-09-12T03:04:07.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.184 INFO:teuthology.orchestra.run.smithi176.stdout: "cct": { 2024-09-12T03:04:07.185 INFO:teuthology.orchestra.run.smithi176.stdout: "total_workers": 1, 2024-09-12T03:04:07.185 INFO:teuthology.orchestra.run.smithi176.stdout: "unhealthy_workers": 0 2024-09-12T03:04:07.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.188 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-MDSRank": { 2024-09-12T03:04:07.188 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-09-12T03:04:07.188 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-09-12T03:04:07.188 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 6255, 2024-09-12T03:04:07.188 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.750181339, 2024-09-12T03:04:07.188 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000119933 2024-09-12T03:04:07.188 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:07.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.188 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-PurgeQueue": { 2024-09-12T03:04:07.189 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-09-12T03:04:07.189 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-09-12T03:04:07.189 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.189 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.189 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.189 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:07.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.189 INFO:teuthology.orchestra.run.smithi176.stdout: "mds": { 2024-09-12T03:04:07.189 INFO:teuthology.orchestra.run.smithi176.stdout: "request": 0, 2024-09-12T03:04:07.189 INFO:teuthology.orchestra.run.smithi176.stdout: "reply": 0, 2024-09-12T03:04:07.189 INFO:teuthology.orchestra.run.smithi176.stdout: "reply_latency": { 2024-09-12T03:04:07.189 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.190 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.190 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.190 INFO:teuthology.orchestra.run.smithi176.stdout: "slow_reply": 0, 2024-09-12T03:04:07.190 INFO:teuthology.orchestra.run.smithi176.stdout: "forward": 0, 2024-09-12T03:04:07.190 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_fetch_complete": 0, 2024-09-12T03:04:07.190 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_fetch_keys": 0, 2024-09-12T03:04:07.190 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_commit": 0, 2024-09-12T03:04:07.190 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_split": 0, 2024-09-12T03:04:07.190 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_merge": 0, 2024-09-12T03:04:07.190 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes": 68118, 2024-09-12T03:04:07.190 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_top": 46809, 2024-09-12T03:04:07.191 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_bottom": 21309, 2024-09-12T03:04:07.191 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_pin_tail": 0, 2024-09-12T03:04:07.191 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_pinned": 159, 2024-09-12T03:04:07.191 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_expired": 0, 2024-09-12T03:04:07.191 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_with_caps": 0, 2024-09-12T03:04:07.191 INFO:teuthology.orchestra.run.smithi176.stdout: "caps": 0, 2024-09-12T03:04:07.191 INFO:teuthology.orchestra.run.smithi176.stdout: "subtrees": 3, 2024-09-12T03:04:07.191 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse": 0, 2024-09-12T03:04:07.191 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_hit": 0, 2024-09-12T03:04:07.191 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_forward": 0, 2024-09-12T03:04:07.191 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_discover": 0, 2024-09-12T03:04:07.191 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_dir_fetch": 0, 2024-09-12T03:04:07.191 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_remote_ino": 0, 2024-09-12T03:04:07.191 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_lock": 0, 2024-09-12T03:04:07.192 INFO:teuthology.orchestra.run.smithi176.stdout: "load_cent": 0, 2024-09-12T03:04:07.192 INFO:teuthology.orchestra.run.smithi176.stdout: "q": 0, 2024-09-12T03:04:07.192 INFO:teuthology.orchestra.run.smithi176.stdout: "exported": 0, 2024-09-12T03:04:07.192 INFO:teuthology.orchestra.run.smithi176.stdout: "exported_inodes": 0, 2024-09-12T03:04:07.192 INFO:teuthology.orchestra.run.smithi176.stdout: "imported": 0, 2024-09-12T03:04:07.192 INFO:teuthology.orchestra.run.smithi176.stdout: "imported_inodes": 0, 2024-09-12T03:04:07.192 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_dir_fetch": 0, 2024-09-12T03:04:07.192 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_backtrace_fetch": 0, 2024-09-12T03:04:07.192 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_peer_discover": 0, 2024-09-12T03:04:07.192 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rfiles": 4, 2024-09-12T03:04:07.192 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rbytes": 234, 2024-09-12T03:04:07.192 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rsnaps": 6, 2024-09-12T03:04:07.192 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T03:04:07.193 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_set_tag": 0, 2024-09-12T03:04:07.193 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T03:04:07.193 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_inotable_repaired": 0, 2024-09-12T03:04:07.193 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dir_inodes": 0, 2024-09-12T03:04:07.193 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T03:04:07.193 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T03:04:07.193 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_file_inodes": 0, 2024-09-12T03:04:07.193 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_inode_file_caps": 0, 2024-09-12T03:04:07.193 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T03:04:07.193 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_grant": 0, 2024-09-12T03:04:07.193 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T03:04:07.193 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T03:04:07.194 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T03:04:07.194 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_caps": 0, 2024-09-12T03:04:07.194 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_caps_dirty": 0, 2024-09-12T03:04:07.194 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_cap_release": 0, 2024-09-12T03:04:07.194 INFO:teuthology.orchestra.run.smithi176.stdout: "process_request_cap_release": 0 2024-09-12T03:04:07.194 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.194 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_cache": { 2024-09-12T03:04:07.194 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_update": 0, 2024-09-12T03:04:07.194 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_update_receipt": 0, 2024-09-12T03:04:07.194 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_try_discover": 0, 2024-09-12T03:04:07.194 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_send_discover": 0, 2024-09-12T03:04:07.194 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_handle_discover": 0, 2024-09-12T03:04:07.195 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays": 0, 2024-09-12T03:04:07.195 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays_delayed": 0, 2024-09-12T03:04:07.195 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays_enqueuing": 0, 2024-09-12T03:04:07.195 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_created": 0, 2024-09-12T03:04:07.195 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_enqueued": 0, 2024-09-12T03:04:07.195 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_reintegrated": 0, 2024-09-12T03:04:07.195 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_migrated": 0, 2024-09-12T03:04:07.195 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_processing": 0, 2024-09-12T03:04:07.195 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_enqueued": 0, 2024-09-12T03:04:07.195 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_prioritized": 0, 2024-09-12T03:04:07.195 INFO:teuthology.orchestra.run.smithi176.stdout: "recovery_started": 0, 2024-09-12T03:04:07.195 INFO:teuthology.orchestra.run.smithi176.stdout: "recovery_completed": 0, 2024-09-12T03:04:07.195 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_quiesce_path": 0, 2024-09-12T03:04:07.195 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_quiesce_inode": 0, 2024-09-12T03:04:07.196 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T03:04:07.196 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_exportdir": 0, 2024-09-12T03:04:07.196 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_flush": 0, 2024-09-12T03:04:07.196 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_fragmentdir": 0, 2024-09-12T03:04:07.196 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_fragstats": 0, 2024-09-12T03:04:07.196 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_inodestats": 0 2024-09-12T03:04:07.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.196 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_log": { 2024-09-12T03:04:07.196 INFO:teuthology.orchestra.run.smithi176.stdout: "evlrg": 0, 2024-09-12T03:04:07.196 INFO:teuthology.orchestra.run.smithi176.stdout: "evadd": 0, 2024-09-12T03:04:07.196 INFO:teuthology.orchestra.run.smithi176.stdout: "evex": 0, 2024-09-12T03:04:07.196 INFO:teuthology.orchestra.run.smithi176.stdout: "evtrm": 0, 2024-09-12T03:04:07.196 INFO:teuthology.orchestra.run.smithi176.stdout: "ev": 95136, 2024-09-12T03:04:07.197 INFO:teuthology.orchestra.run.smithi176.stdout: "evexg": 0, 2024-09-12T03:04:07.197 INFO:teuthology.orchestra.run.smithi176.stdout: "evexd": 0, 2024-09-12T03:04:07.197 INFO:teuthology.orchestra.run.smithi176.stdout: "segadd": 0, 2024-09-12T03:04:07.197 INFO:teuthology.orchestra.run.smithi176.stdout: "segex": 0, 2024-09-12T03:04:07.197 INFO:teuthology.orchestra.run.smithi176.stdout: "segtrm": 0, 2024-09-12T03:04:07.197 INFO:teuthology.orchestra.run.smithi176.stdout: "seg": 3, 2024-09-12T03:04:07.197 INFO:teuthology.orchestra.run.smithi176.stdout: "segmjr": 58, 2024-09-12T03:04:07.197 INFO:teuthology.orchestra.run.smithi176.stdout: "segexg": 0, 2024-09-12T03:04:07.197 INFO:teuthology.orchestra.run.smithi176.stdout: "segexd": 0, 2024-09-12T03:04:07.197 INFO:teuthology.orchestra.run.smithi176.stdout: "expos": 291922540, 2024-09-12T03:04:07.197 INFO:teuthology.orchestra.run.smithi176.stdout: "wrpos": 291967433, 2024-09-12T03:04:07.197 INFO:teuthology.orchestra.run.smithi176.stdout: "rdpos": 291967349, 2024-09-12T03:04:07.197 INFO:teuthology.orchestra.run.smithi176.stdout: "jlat": { 2024-09-12T03:04:07.197 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.198 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.198 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.198 INFO:teuthology.orchestra.run.smithi176.stdout: "replayed": 95136 2024-09-12T03:04:07.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.198 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_mem": { 2024-09-12T03:04:07.198 INFO:teuthology.orchestra.run.smithi176.stdout: "ino": 23039, 2024-09-12T03:04:07.198 INFO:teuthology.orchestra.run.smithi176.stdout: "ino+": 53532, 2024-09-12T03:04:07.198 INFO:teuthology.orchestra.run.smithi176.stdout: "ino-": 30493, 2024-09-12T03:04:07.198 INFO:teuthology.orchestra.run.smithi176.stdout: "dir": 896, 2024-09-12T03:04:07.198 INFO:teuthology.orchestra.run.smithi176.stdout: "dir+": 1384, 2024-09-12T03:04:07.198 INFO:teuthology.orchestra.run.smithi176.stdout: "dir-": 488, 2024-09-12T03:04:07.198 INFO:teuthology.orchestra.run.smithi176.stdout: "dn": 68118, 2024-09-12T03:04:07.198 INFO:teuthology.orchestra.run.smithi176.stdout: "dn+": 96737, 2024-09-12T03:04:07.199 INFO:teuthology.orchestra.run.smithi176.stdout: "dn-": 28619, 2024-09-12T03:04:07.199 INFO:teuthology.orchestra.run.smithi176.stdout: "cap": 0, 2024-09-12T03:04:07.199 INFO:teuthology.orchestra.run.smithi176.stdout: "cap+": 0, 2024-09-12T03:04:07.199 INFO:teuthology.orchestra.run.smithi176.stdout: "cap-": 0, 2024-09-12T03:04:07.199 INFO:teuthology.orchestra.run.smithi176.stdout: "rss": 173800, 2024-09-12T03:04:07.199 INFO:teuthology.orchestra.run.smithi176.stdout: "heap": 215328 2024-09-12T03:04:07.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.199 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_server": { 2024-09-12T03:04:07.199 INFO:teuthology.orchestra.run.smithi176.stdout: "dispatch_client_request": 0, 2024-09-12T03:04:07.199 INFO:teuthology.orchestra.run.smithi176.stdout: "dispatch_server_request": 0, 2024-09-12T03:04:07.199 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_request": 0, 2024-09-12T03:04:07.199 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_session": 0, 2024-09-12T03:04:07.199 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_peer_request": 0, 2024-09-12T03:04:07.199 INFO:teuthology.orchestra.run.smithi176.stdout: "req_create_latency": { 2024-09-12T03:04:07.200 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.200 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.200 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.200 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.200 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getattr_latency": { 2024-09-12T03:04:07.200 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.200 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.200 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.200 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.200 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getfilelock_latency": { 2024-09-12T03:04:07.200 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.200 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.201 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.201 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.201 INFO:teuthology.orchestra.run.smithi176.stdout: "req_link_latency": { 2024-09-12T03:04:07.201 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.201 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.201 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.201 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.201 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookup_latency": { 2024-09-12T03:04:07.201 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.201 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.201 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.201 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.201 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookuphash_latency": { 2024-09-12T03:04:07.201 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.202 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.202 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.202 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupino_latency": { 2024-09-12T03:04:07.202 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.202 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.202 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.202 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupname_latency": { 2024-09-12T03:04:07.202 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.202 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.202 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.202 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupparent_latency": { 2024-09-12T03:04:07.202 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupsnap_latency": { 2024-09-12T03:04:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lssnap_latency": { 2024-09-12T03:04:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mkdir_latency": { 2024-09-12T03:04:07.204 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.204 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.204 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.204 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mknod_latency": { 2024-09-12T03:04:07.204 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.204 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.204 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.204 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mksnap_latency": { 2024-09-12T03:04:07.204 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.204 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.204 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.205 INFO:teuthology.orchestra.run.smithi176.stdout: "req_open_latency": { 2024-09-12T03:04:07.205 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.205 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.205 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.205 INFO:teuthology.orchestra.run.smithi176.stdout: "req_readdir_latency": { 2024-09-12T03:04:07.205 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.205 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.205 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.205 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rename_latency": { 2024-09-12T03:04:07.205 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.205 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.205 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.206 INFO:teuthology.orchestra.run.smithi176.stdout: "req_renamesnap_latency": { 2024-09-12T03:04:07.206 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.206 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.206 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.206 INFO:teuthology.orchestra.run.smithi176.stdout: "req_snapdiff_latency": { 2024-09-12T03:04:07.206 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.206 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.206 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.207 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.207 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmdir_latency": { 2024-09-12T03:04:07.207 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.207 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.207 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.207 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.207 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmsnap_latency": { 2024-09-12T03:04:07.207 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.207 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.207 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.207 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.208 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmxattr_latency": { 2024-09-12T03:04:07.208 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.208 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.208 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.208 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.208 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setattr_latency": { 2024-09-12T03:04:07.208 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.208 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.208 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.208 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.208 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setdirlayout_latency": { 2024-09-12T03:04:07.208 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.208 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.209 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.209 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setfilelock_latency": { 2024-09-12T03:04:07.209 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.209 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.209 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.209 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setlayout_latency": { 2024-09-12T03:04:07.209 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.209 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.209 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.209 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setxattr_latency": { 2024-09-12T03:04:07.209 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.210 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.210 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.210 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.210 INFO:teuthology.orchestra.run.smithi176.stdout: "req_symlink_latency": { 2024-09-12T03:04:07.210 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.210 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.210 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.210 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.210 INFO:teuthology.orchestra.run.smithi176.stdout: "req_unlink_latency": { 2024-09-12T03:04:07.210 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.210 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.210 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.210 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.211 INFO:teuthology.orchestra.run.smithi176.stdout: "cap_revoke_eviction": 0, 2024-09-12T03:04:07.211 INFO:teuthology.orchestra.run.smithi176.stdout: "cap_acquisition_throttle": 0, 2024-09-12T03:04:07.211 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getvxattr_latency": { 2024-09-12T03:04:07.211 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.211 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.211 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.211 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:07.211 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.211 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_sessions": { 2024-09-12T03:04:07.211 INFO:teuthology.orchestra.run.smithi176.stdout: "session_count": 2, 2024-09-12T03:04:07.211 INFO:teuthology.orchestra.run.smithi176.stdout: "session_add": 5, 2024-09-12T03:04:07.211 INFO:teuthology.orchestra.run.smithi176.stdout: "session_remove": 3, 2024-09-12T03:04:07.211 INFO:teuthology.orchestra.run.smithi176.stdout: "sessions_open": 3, 2024-09-12T03:04:07.211 INFO:teuthology.orchestra.run.smithi176.stdout: "sessions_stale": 0, 2024-09-12T03:04:07.212 INFO:teuthology.orchestra.run.smithi176.stdout: "total_load": 0, 2024-09-12T03:04:07.212 INFO:teuthology.orchestra.run.smithi176.stdout: "average_load": 0, 2024-09-12T03:04:07.212 INFO:teuthology.orchestra.run.smithi176.stdout: "avg_session_uptime": 3047, 2024-09-12T03:04:07.212 INFO:teuthology.orchestra.run.smithi176.stdout: "mdthresh_evicted": 0 2024-09-12T03:04:07.212 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.212 INFO:teuthology.orchestra.run.smithi176.stdout: "mempool": { 2024-09-12T03:04:07.212 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_bytes": 0, 2024-09-12T03:04:07.212 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_items": 0, 2024-09-12T03:04:07.212 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T03:04:07.212 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_items": 0, 2024-09-12T03:04:07.212 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T03:04:07.213 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_items": 0, 2024-09-12T03:04:07.213 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T03:04:07.213 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T03:04:07.213 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T03:04:07.213 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T03:04:07.213 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T03:04:07.213 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_items": 0, 2024-09-12T03:04:07.213 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T03:04:07.213 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T03:04:07.213 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_bytes": 0, 2024-09-12T03:04:07.213 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_items": 0, 2024-09-12T03:04:07.213 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_bytes": 0, 2024-09-12T03:04:07.213 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_items": 0, 2024-09-12T03:04:07.213 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T03:04:07.214 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T03:04:07.214 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T03:04:07.214 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T03:04:07.214 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T03:04:07.214 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_items": 0, 2024-09-12T03:04:07.214 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_bytes": 0, 2024-09-12T03:04:07.214 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_items": 0, 2024-09-12T03:04:07.214 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T03:04:07.214 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T03:04:07.214 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_bytes": 0, 2024-09-12T03:04:07.214 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_items": 0, 2024-09-12T03:04:07.214 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_bytes": 0, 2024-09-12T03:04:07.214 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_items": 0, 2024-09-12T03:04:07.215 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T03:04:07.215 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_items": 0, 2024-09-12T03:04:07.215 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T03:04:07.215 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_items": 0, 2024-09-12T03:04:07.215 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_bytes": 1107662, 2024-09-12T03:04:07.215 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_items": 23545, 2024-09-12T03:04:07.215 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_bytes": 0, 2024-09-12T03:04:07.215 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_items": 0, 2024-09-12T03:04:07.215 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_bytes": 0, 2024-09-12T03:04:07.215 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_items": 0, 2024-09-12T03:04:07.215 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_bytes": 0, 2024-09-12T03:04:07.215 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_items": 0, 2024-09-12T03:04:07.215 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_bytes": 0, 2024-09-12T03:04:07.215 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_items": 0, 2024-09-12T03:04:07.216 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_bytes": 10136, 2024-09-12T03:04:07.216 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_items": 215, 2024-09-12T03:04:07.216 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T03:04:07.216 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_items": 0, 2024-09-12T03:04:07.216 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_bytes": 0, 2024-09-12T03:04:07.216 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_items": 0, 2024-09-12T03:04:07.216 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_bytes": 103103681, 2024-09-12T03:04:07.216 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_items": 1034338, 2024-09-12T03:04:07.216 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_bytes": 0, 2024-09-12T03:04:07.216 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_items": 0, 2024-09-12T03:04:07.216 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_bytes": 0, 2024-09-12T03:04:07.216 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_items": 0 2024-09-12T03:04:07.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.217 INFO:teuthology.orchestra.run.smithi176.stdout: "objecter": { 2024-09-12T03:04:07.217 INFO:teuthology.orchestra.run.smithi176.stdout: "op_active": 0, 2024-09-12T03:04:07.217 INFO:teuthology.orchestra.run.smithi176.stdout: "op_laggy": 0, 2024-09-12T03:04:07.217 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send": 3826, 2024-09-12T03:04:07.217 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send_bytes": 26, 2024-09-12T03:04:07.217 INFO:teuthology.orchestra.run.smithi176.stdout: "op_resend": 4, 2024-09-12T03:04:07.217 INFO:teuthology.orchestra.run.smithi176.stdout: "op_reply": 3826, 2024-09-12T03:04:07.217 INFO:teuthology.orchestra.run.smithi176.stdout: "op_latency": { 2024-09-12T03:04:07.217 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 3826, 2024-09-12T03:04:07.217 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 24.111180832, 2024-09-12T03:04:07.217 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.006301929 2024-09-12T03:04:07.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.217 INFO:teuthology.orchestra.run.smithi176.stdout: "op_inflight": 0, 2024-09-12T03:04:07.217 INFO:teuthology.orchestra.run.smithi176.stdout: "oplen_avg": { 2024-09-12T03:04:07.218 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 3826, 2024-09-12T03:04:07.218 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 3827 2024-09-12T03:04:07.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.218 INFO:teuthology.orchestra.run.smithi176.stdout: "op": 3826, 2024-09-12T03:04:07.218 INFO:teuthology.orchestra.run.smithi176.stdout: "op_r": 3826, 2024-09-12T03:04:07.218 INFO:teuthology.orchestra.run.smithi176.stdout: "op_w": 0, 2024-09-12T03:04:07.218 INFO:teuthology.orchestra.run.smithi176.stdout: "op_rmw": 0, 2024-09-12T03:04:07.218 INFO:teuthology.orchestra.run.smithi176.stdout: "op_pg": 0, 2024-09-12T03:04:07.218 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_stat": 2260, 2024-09-12T03:04:07.218 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_create": 0, 2024-09-12T03:04:07.218 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_read": 1563, 2024-09-12T03:04:07.218 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_write": 0, 2024-09-12T03:04:07.218 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writefull": 0, 2024-09-12T03:04:07.218 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writesame": 0, 2024-09-12T03:04:07.218 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_append": 0, 2024-09-12T03:04:07.219 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_zero": 0, 2024-09-12T03:04:07.219 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_truncate": 0, 2024-09-12T03:04:07.219 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_delete": 0, 2024-09-12T03:04:07.219 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_mapext": 0, 2024-09-12T03:04:07.219 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_sparse_read": 0, 2024-09-12T03:04:07.219 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_clonerange": 0, 2024-09-12T03:04:07.219 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_getxattr": 2, 2024-09-12T03:04:07.219 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_setxattr": 0, 2024-09-12T03:04:07.219 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_cmpxattr": 0, 2024-09-12T03:04:07.219 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_rmxattr": 0, 2024-09-12T03:04:07.219 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_resetxattrs": 0, 2024-09-12T03:04:07.219 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_call": 0, 2024-09-12T03:04:07.219 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_watch": 0, 2024-09-12T03:04:07.219 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_notify": 0, 2024-09-12T03:04:07.219 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T03:04:07.220 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls": 0, 2024-09-12T03:04:07.220 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls_filter": 0, 2024-09-12T03:04:07.220 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_other": 0, 2024-09-12T03:04:07.220 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_active": 0, 2024-09-12T03:04:07.220 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_send": 0, 2024-09-12T03:04:07.220 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_resend": 0, 2024-09-12T03:04:07.220 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_ping": 0, 2024-09-12T03:04:07.220 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_active": 0, 2024-09-12T03:04:07.220 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_send": 0, 2024-09-12T03:04:07.220 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_resend": 0, 2024-09-12T03:04:07.220 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_active": 0, 2024-09-12T03:04:07.220 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_send": 0, 2024-09-12T03:04:07.220 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_resend": 0, 2024-09-12T03:04:07.220 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_active": 0, 2024-09-12T03:04:07.220 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_send": 0, 2024-09-12T03:04:07.221 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_resend": 0, 2024-09-12T03:04:07.221 INFO:teuthology.orchestra.run.smithi176.stdout: "command_active": 0, 2024-09-12T03:04:07.221 INFO:teuthology.orchestra.run.smithi176.stdout: "command_send": 0, 2024-09-12T03:04:07.221 INFO:teuthology.orchestra.run.smithi176.stdout: "command_resend": 0, 2024-09-12T03:04:07.221 INFO:teuthology.orchestra.run.smithi176.stdout: "map_epoch": 117, 2024-09-12T03:04:07.221 INFO:teuthology.orchestra.run.smithi176.stdout: "map_full": 0, 2024-09-12T03:04:07.221 INFO:teuthology.orchestra.run.smithi176.stdout: "map_inc": 21, 2024-09-12T03:04:07.221 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_sessions": 11, 2024-09-12T03:04:07.221 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_open": 11, 2024-09-12T03:04:07.221 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_close": 0, 2024-09-12T03:04:07.221 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_laggy": 0, 2024-09-12T03:04:07.221 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_wr": 0, 2024-09-12T03:04:07.221 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_rd": 2, 2024-09-12T03:04:07.222 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_del": 0 2024-09-12T03:04:07.222 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.222 INFO:teuthology.orchestra.run.smithi176.stdout: "oft": { 2024-09-12T03:04:07.222 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_objs": 0, 2024-09-12T03:04:07.222 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_kv_pairs": 0, 2024-09-12T03:04:07.222 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_updates": 0, 2024-09-12T03:04:07.222 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_removes": 0 2024-09-12T03:04:07.222 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.222 INFO:teuthology.orchestra.run.smithi176.stdout: "osd-slow-ops": { 2024-09-12T03:04:07.222 INFO:teuthology.orchestra.run.smithi176.stdout: "slow_ops_count": 0 2024-09-12T03:04:07.222 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.222 INFO:teuthology.orchestra.run.smithi176.stdout: "purge_queue": { 2024-09-12T03:04:07.222 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_ops": 0, 2024-09-12T03:04:07.222 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T03:04:07.222 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing": 0, 2024-09-12T03:04:07.223 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_high_water": 0, 2024-09-12T03:04:07.223 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executed_ops": 0, 2024-09-12T03:04:07.223 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executed": 0, 2024-09-12T03:04:07.223 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_item_in_journal": 0 2024-09-12T03:04:07.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.223 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T03:04:07.223 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:07.223 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-09-12T03:04:07.223 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:07.223 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 4222, 2024-09-12T03:04:07.223 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 290594600, 2024-09-12T03:04:07.223 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:07.223 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 4222, 2024-09-12T03:04:07.223 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-09-12T03:04:07.224 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-09-12T03:04:07.224 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 4222, 2024-09-12T03:04:07.224 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 290594600, 2024-09-12T03:04:07.224 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:07.224 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.224 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.224 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.224 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:07.224 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.224 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_bytes": { 2024-09-12T03:04:07.224 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:07.224 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-09-12T03:04:07.224 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:07.225 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-09-12T03:04:07.225 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-09-12T03:04:07.225 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:07.225 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-09-12T03:04:07.225 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 3826, 2024-09-12T03:04:07.225 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 287823193, 2024-09-12T03:04:07.225 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 3826, 2024-09-12T03:04:07.225 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 287823193, 2024-09-12T03:04:07.225 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:07.225 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.225 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.225 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.225 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:07.226 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.226 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_ops": { 2024-09-12T03:04:07.226 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:07.226 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 1024, 2024-09-12T03:04:07.226 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:07.226 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-09-12T03:04:07.226 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-09-12T03:04:07.226 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:07.226 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-09-12T03:04:07.226 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 3826, 2024-09-12T03:04:07.226 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 3826, 2024-09-12T03:04:07.226 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 3826, 2024-09-12T03:04:07.226 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 3826, 2024-09-12T03:04:07.226 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:07.227 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.227 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.227 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.227 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:07.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.227 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-write_buf_throttle": { 2024-09-12T03:04:07.227 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:07.227 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 3758096384, 2024-09-12T03:04:07.227 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:07.227 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-09-12T03:04:07.227 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-09-12T03:04:07.227 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:07.227 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-09-12T03:04:07.228 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-09-12T03:04:07.228 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-09-12T03:04:07.228 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-09-12T03:04:07.228 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-09-12T03:04:07.228 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:07.228 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.228 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.228 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.228 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:07.228 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:07.228 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-write_buf_throttle-0x55aa1b3a4b40": { 2024-09-12T03:04:07.228 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:07.228 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 3758096384, 2024-09-12T03:04:07.229 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:07.229 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-09-12T03:04:07.229 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-09-12T03:04:07.229 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:07.229 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-09-12T03:04:07.229 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-09-12T03:04:07.229 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-09-12T03:04:07.229 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-09-12T03:04:07.229 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-09-12T03:04:07.229 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:07.229 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:07.229 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:07.229 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:07.230 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:07.230 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:07.230 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T03:04:07.850 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:07 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T03:04:07.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:07 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T03:04:07.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:07 smithi018 ceph-mon[30616]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T03:04:07.947 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:07 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T03:04:07.947 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:07 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T03:04:07.947 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:07 smithi062 ceph-mon[35527]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T03:04:07.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:07 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T03:04:07.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:07 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T03:04:07.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:07 smithi176 ceph-mon[35713]: from='mgr.25213 ' entity='mgr.x' 2024-09-12T03:04:08.067 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-12T03:04:08.067 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-12T03:04:08.068 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-12T03:04:08.068 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-12T03:04:08.068 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T03:04:08.068 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-12T03:04:08.068 DEBUG:tasks.check_counter:Getting stats from i 2024-09-12T03:04:08.068 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-12T03:04:08.442 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T03:04:08.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:08 smithi062 ceph-mon[35527]: pgmap v483: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 246 op/s 2024-09-12T03:04:08.783 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:08 smithi062 ceph-mon[35527]: osdmap e118: 12 total, 12 up, 12 in 2024-09-12T03:04:08.923 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:08 smithi176 ceph-mon[35713]: pgmap v483: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 246 op/s 2024-09-12T03:04:08.923 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:08 smithi176 ceph-mon[35713]: osdmap e118: 12 total, 12 up, 12 in 2024-09-12T03:04:09.083 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T03:04:09.083 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T03:04:09.083 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 24734, 2024-09-12T03:04:09.083 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 31096, 2024-09-12T03:04:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 14258309, 2024-09-12T03:04:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 67789273, 2024-09-12T03:04:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 15, 2024-09-12T03:04:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 3, 2024-09-12T03:04:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 2.039280334, 2024-09-12T03:04:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.797020526, 2024-09-12T03:04:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.885802484, 2024-09-12T03:04:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.404915900, 2024-09-12T03:04:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:04:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 31096, 2024-09-12T03:04:09.084 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 2.052403136, 2024-09-12T03:04:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000066002 2024-09-12T03:04:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:04:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 32495, 2024-09-12T03:04:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.006125815, 2024-09-12T03:04:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000188 2024-09-12T03:04:09.085 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T03:04:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T03:04:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T03:04:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 120614, 2024-09-12T03:04:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 153343, 2024-09-12T03:04:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 40934225, 2024-09-12T03:04:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 99842883, 2024-09-12T03:04:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 13, 2024-09-12T03:04:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 7, 2024-09-12T03:04:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 5.426631143, 2024-09-12T03:04:09.086 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 2.324232646, 2024-09-12T03:04:09.087 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 3.463327445, 2024-09-12T03:04:09.087 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.444937013, 2024-09-12T03:04:09.087 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:04:09.087 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 153339, 2024-09-12T03:04:09.087 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 11.767604336, 2024-09-12T03:04:09.087 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000076742 2024-09-12T03:04:09.087 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.087 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:04:09.087 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 83800, 2024-09-12T03:04:09.087 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.026827255, 2024-09-12T03:04:09.087 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000320 2024-09-12T03:04:09.087 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.087 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 5520, 2024-09-12T03:04:09.088 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 567104 2024-09-12T03:04:09.088 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.088 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T03:04:09.088 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 31022, 2024-09-12T03:04:09.088 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 45365, 2024-09-12T03:04:09.088 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 22694890, 2024-09-12T03:04:09.088 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 52026583, 2024-09-12T03:04:09.088 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 9, 2024-09-12T03:04:09.088 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 6, 2024-09-12T03:04:09.088 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 2.506987077, 2024-09-12T03:04:09.088 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.906973679, 2024-09-12T03:04:09.088 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 1.411801593, 2024-09-12T03:04:09.089 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.256977822, 2024-09-12T03:04:09.089 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:04:09.089 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 45364, 2024-09-12T03:04:09.089 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 6.541624900, 2024-09-12T03:04:09.089 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000144203 2024-09-12T03:04:09.089 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.089 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:04:09.089 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 57612, 2024-09-12T03:04:09.089 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.015199462, 2024-09-12T03:04:09.089 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000263 2024-09-12T03:04:09.089 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.090 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 2137568, 2024-09-12T03:04:09.090 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 197168 2024-09-12T03:04:09.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.090 INFO:teuthology.orchestra.run.smithi176.stdout: "cct": { 2024-09-12T03:04:09.090 INFO:teuthology.orchestra.run.smithi176.stdout: "total_workers": 1, 2024-09-12T03:04:09.090 INFO:teuthology.orchestra.run.smithi176.stdout: "unhealthy_workers": 0 2024-09-12T03:04:09.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.090 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-MDSRank": { 2024-09-12T03:04:09.090 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-09-12T03:04:09.090 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-09-12T03:04:09.090 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 5627, 2024-09-12T03:04:09.090 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 17.534998844, 2024-09-12T03:04:09.091 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.003116225 2024-09-12T03:04:09.091 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:09.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.091 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-PurgeQueue": { 2024-09-12T03:04:09.091 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-09-12T03:04:09.091 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-09-12T03:04:09.091 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 21281, 2024-09-12T03:04:09.091 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 2.153787973, 2024-09-12T03:04:09.091 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000101207 2024-09-12T03:04:09.091 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:09.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.091 INFO:teuthology.orchestra.run.smithi176.stdout: "mds": { 2024-09-12T03:04:09.091 INFO:teuthology.orchestra.run.smithi176.stdout: "request": 45683, 2024-09-12T03:04:09.092 INFO:teuthology.orchestra.run.smithi176.stdout: "reply": 45010, 2024-09-12T03:04:09.092 INFO:teuthology.orchestra.run.smithi176.stdout: "reply_latency": { 2024-09-12T03:04:09.092 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 45010, 2024-09-12T03:04:09.092 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 767.033705312, 2024-09-12T03:04:09.092 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.017041406 2024-09-12T03:04:09.092 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.092 INFO:teuthology.orchestra.run.smithi176.stdout: "slow_reply": 0, 2024-09-12T03:04:09.092 INFO:teuthology.orchestra.run.smithi176.stdout: "forward": 673, 2024-09-12T03:04:09.092 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_fetch_complete": 115, 2024-09-12T03:04:09.092 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_fetch_keys": 0, 2024-09-12T03:04:09.092 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_commit": 280, 2024-09-12T03:04:09.093 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_split": 30, 2024-09-12T03:04:09.093 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_merge": 0, 2024-09-12T03:04:09.093 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes": 17, 2024-09-12T03:04:09.093 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_top": 2, 2024-09-12T03:04:09.093 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_bottom": 2, 2024-09-12T03:04:09.093 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_pin_tail": 13, 2024-09-12T03:04:09.093 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_pinned": 13, 2024-09-12T03:04:09.093 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_expired": 37188, 2024-09-12T03:04:09.093 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_with_caps": 0, 2024-09-12T03:04:09.093 INFO:teuthology.orchestra.run.smithi176.stdout: "caps": 0, 2024-09-12T03:04:09.093 INFO:teuthology.orchestra.run.smithi176.stdout: "subtrees": 5, 2024-09-12T03:04:09.093 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse": 95581, 2024-09-12T03:04:09.094 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_hit": 67104, 2024-09-12T03:04:09.094 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_forward": 632, 2024-09-12T03:04:09.094 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_discover": 485, 2024-09-12T03:04:09.094 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_dir_fetch": 0, 2024-09-12T03:04:09.094 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_remote_ino": 0, 2024-09-12T03:04:09.094 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_lock": 180, 2024-09-12T03:04:09.094 INFO:teuthology.orchestra.run.smithi176.stdout: "load_cent": 0, 2024-09-12T03:04:09.094 INFO:teuthology.orchestra.run.smithi176.stdout: "q": 0, 2024-09-12T03:04:09.094 INFO:teuthology.orchestra.run.smithi176.stdout: "exported": 537, 2024-09-12T03:04:09.094 INFO:teuthology.orchestra.run.smithi176.stdout: "exported_inodes": 30073, 2024-09-12T03:04:09.094 INFO:teuthology.orchestra.run.smithi176.stdout: "imported": 327, 2024-09-12T03:04:09.094 INFO:teuthology.orchestra.run.smithi176.stdout: "imported_inodes": 22878, 2024-09-12T03:04:09.095 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_dir_fetch": 0, 2024-09-12T03:04:09.095 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_backtrace_fetch": 0, 2024-09-12T03:04:09.095 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_peer_discover": 0, 2024-09-12T03:04:09.095 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rfiles": 4, 2024-09-12T03:04:09.095 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rbytes": 234, 2024-09-12T03:04:09.095 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rsnaps": 0, 2024-09-12T03:04:09.095 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T03:04:09.095 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_set_tag": 0, 2024-09-12T03:04:09.095 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T03:04:09.095 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_inotable_repaired": 0, 2024-09-12T03:04:09.095 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dir_inodes": 0, 2024-09-12T03:04:09.095 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T03:04:09.096 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T03:04:09.096 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_file_inodes": 0, 2024-09-12T03:04:09.096 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_inode_file_caps": 250, 2024-09-12T03:04:09.096 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_revoke": 4072, 2024-09-12T03:04:09.096 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_grant": 12468, 2024-09-12T03:04:09.096 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T03:04:09.096 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T03:04:09.096 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T03:04:09.096 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_caps": 12932, 2024-09-12T03:04:09.096 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_caps_dirty": 4594, 2024-09-12T03:04:09.096 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_cap_release": 368, 2024-09-12T03:04:09.096 INFO:teuthology.orchestra.run.smithi176.stdout: "process_request_cap_release": 24744 2024-09-12T03:04:09.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.096 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_cache": { 2024-09-12T03:04:09.097 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_update": 3, 2024-09-12T03:04:09.097 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_update_receipt": 3, 2024-09-12T03:04:09.097 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_try_discover": 2, 2024-09-12T03:04:09.097 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_send_discover": 493, 2024-09-12T03:04:09.097 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_handle_discover": 814, 2024-09-12T03:04:09.097 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays": 0, 2024-09-12T03:04:09.097 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays_delayed": 0, 2024-09-12T03:04:09.097 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays_enqueuing": 0, 2024-09-12T03:04:09.097 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_created": 10284, 2024-09-12T03:04:09.097 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_enqueued": 10284, 2024-09-12T03:04:09.097 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_reintegrated": 0, 2024-09-12T03:04:09.097 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_migrated": 0, 2024-09-12T03:04:09.097 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_processing": 0, 2024-09-12T03:04:09.097 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_enqueued": 0, 2024-09-12T03:04:09.098 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_prioritized": 0, 2024-09-12T03:04:09.098 INFO:teuthology.orchestra.run.smithi176.stdout: "recovery_started": 0, 2024-09-12T03:04:09.098 INFO:teuthology.orchestra.run.smithi176.stdout: "recovery_completed": 0, 2024-09-12T03:04:09.098 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_quiesce_path": 0, 2024-09-12T03:04:09.098 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_quiesce_inode": 0, 2024-09-12T03:04:09.098 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T03:04:09.098 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_exportdir": 537, 2024-09-12T03:04:09.098 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_flush": 0, 2024-09-12T03:04:09.098 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_fragmentdir": 30, 2024-09-12T03:04:09.098 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_fragstats": 0, 2024-09-12T03:04:09.098 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_inodestats": 0 2024-09-12T03:04:09.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.098 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_log": { 2024-09-12T03:04:09.098 INFO:teuthology.orchestra.run.smithi176.stdout: "evlrg": 1, 2024-09-12T03:04:09.099 INFO:teuthology.orchestra.run.smithi176.stdout: "evadd": 40498, 2024-09-12T03:04:09.099 INFO:teuthology.orchestra.run.smithi176.stdout: "evex": 0, 2024-09-12T03:04:09.099 INFO:teuthology.orchestra.run.smithi176.stdout: "evtrm": 0, 2024-09-12T03:04:09.099 INFO:teuthology.orchestra.run.smithi176.stdout: "ev": 40498, 2024-09-12T03:04:09.099 INFO:teuthology.orchestra.run.smithi176.stdout: "evexg": 0, 2024-09-12T03:04:09.099 INFO:teuthology.orchestra.run.smithi176.stdout: "evexd": 0, 2024-09-12T03:04:09.099 INFO:teuthology.orchestra.run.smithi176.stdout: "segadd": 58, 2024-09-12T03:04:09.099 INFO:teuthology.orchestra.run.smithi176.stdout: "segex": 0, 2024-09-12T03:04:09.099 INFO:teuthology.orchestra.run.smithi176.stdout: "segtrm": 0, 2024-09-12T03:04:09.099 INFO:teuthology.orchestra.run.smithi176.stdout: "seg": 58, 2024-09-12T03:04:09.099 INFO:teuthology.orchestra.run.smithi176.stdout: "segmjr": 5, 2024-09-12T03:04:09.099 INFO:teuthology.orchestra.run.smithi176.stdout: "segexg": 0, 2024-09-12T03:04:09.099 INFO:teuthology.orchestra.run.smithi176.stdout: "segexd": 0, 2024-09-12T03:04:09.099 INFO:teuthology.orchestra.run.smithi176.stdout: "expos": 4194304, 2024-09-12T03:04:09.100 INFO:teuthology.orchestra.run.smithi176.stdout: "wrpos": 109776443, 2024-09-12T03:04:09.100 INFO:teuthology.orchestra.run.smithi176.stdout: "rdpos": 0, 2024-09-12T03:04:09.100 INFO:teuthology.orchestra.run.smithi176.stdout: "jlat": { 2024-09-12T03:04:09.100 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 2301, 2024-09-12T03:04:09.100 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 102.366013288, 2024-09-12T03:04:09.100 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.044487619 2024-09-12T03:04:09.100 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.100 INFO:teuthology.orchestra.run.smithi176.stdout: "replayed": 0 2024-09-12T03:04:09.100 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.100 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_mem": { 2024-09-12T03:04:09.100 INFO:teuthology.orchestra.run.smithi176.stdout: "ino": 24, 2024-09-12T03:04:09.100 INFO:teuthology.orchestra.run.smithi176.stdout: "ino+": 27383, 2024-09-12T03:04:09.100 INFO:teuthology.orchestra.run.smithi176.stdout: "ino-": 27359, 2024-09-12T03:04:09.100 INFO:teuthology.orchestra.run.smithi176.stdout: "dir": 21, 2024-09-12T03:04:09.101 INFO:teuthology.orchestra.run.smithi176.stdout: "dir+": 753, 2024-09-12T03:04:09.101 INFO:teuthology.orchestra.run.smithi176.stdout: "dir-": 732, 2024-09-12T03:04:09.101 INFO:teuthology.orchestra.run.smithi176.stdout: "dn": 17, 2024-09-12T03:04:09.101 INFO:teuthology.orchestra.run.smithi176.stdout: "dn+": 49119, 2024-09-12T03:04:09.101 INFO:teuthology.orchestra.run.smithi176.stdout: "dn-": 49102, 2024-09-12T03:04:09.101 INFO:teuthology.orchestra.run.smithi176.stdout: "cap": 0, 2024-09-12T03:04:09.101 INFO:teuthology.orchestra.run.smithi176.stdout: "cap+": 20723, 2024-09-12T03:04:09.101 INFO:teuthology.orchestra.run.smithi176.stdout: "cap-": 20723, 2024-09-12T03:04:09.101 INFO:teuthology.orchestra.run.smithi176.stdout: "rss": 98532, 2024-09-12T03:04:09.101 INFO:teuthology.orchestra.run.smithi176.stdout: "heap": 223520 2024-09-12T03:04:09.101 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.101 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_server": { 2024-09-12T03:04:09.101 INFO:teuthology.orchestra.run.smithi176.stdout: "dispatch_client_request": 61983, 2024-09-12T03:04:09.102 INFO:teuthology.orchestra.run.smithi176.stdout: "dispatch_server_request": 2303, 2024-09-12T03:04:09.102 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_request": 45683, 2024-09-12T03:04:09.102 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_session": 231, 2024-09-12T03:04:09.102 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_peer_request": 16825, 2024-09-12T03:04:09.102 INFO:teuthology.orchestra.run.smithi176.stdout: "req_create_latency": { 2024-09-12T03:04:09.102 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 1508, 2024-09-12T03:04:09.102 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 21.455112582, 2024-09-12T03:04:09.102 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.014227528 2024-09-12T03:04:09.102 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.102 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getattr_latency": { 2024-09-12T03:04:09.102 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 139, 2024-09-12T03:04:09.102 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.799975852, 2024-09-12T03:04:09.102 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.005755221 2024-09-12T03:04:09.103 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.103 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getfilelock_latency": { 2024-09-12T03:04:09.103 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.103 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.103 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.103 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.103 INFO:teuthology.orchestra.run.smithi176.stdout: "req_link_latency": { 2024-09-12T03:04:09.103 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.103 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.103 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.103 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.103 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookup_latency": { 2024-09-12T03:04:09.103 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 30265, 2024-09-12T03:04:09.104 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 480.223699792, 2024-09-12T03:04:09.104 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.015867295 2024-09-12T03:04:09.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.104 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookuphash_latency": { 2024-09-12T03:04:09.104 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.104 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.104 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.104 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupino_latency": { 2024-09-12T03:04:09.104 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.104 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.104 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.105 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupname_latency": { 2024-09-12T03:04:09.105 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.105 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.105 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.105 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupparent_latency": { 2024-09-12T03:04:09.105 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.105 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.105 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.106 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupsnap_latency": { 2024-09-12T03:04:09.106 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.106 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.106 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.107 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:08 smithi018 ceph-mon[30616]: pgmap v483: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 246 op/s 2024-09-12T03:04:09.107 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:08 smithi018 ceph-mon[30616]: osdmap e118: 12 total, 12 up, 12 in 2024-09-12T03:04:09.107 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lssnap_latency": { 2024-09-12T03:04:09.107 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.107 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.107 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.108 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.108 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mkdir_latency": { 2024-09-12T03:04:09.108 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.108 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.108 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.108 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.108 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mknod_latency": { 2024-09-12T03:04:09.108 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.108 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.109 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.109 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.109 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mksnap_latency": { 2024-09-12T03:04:09.109 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.109 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.109 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.109 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.109 INFO:teuthology.orchestra.run.smithi176.stdout: "req_open_latency": { 2024-09-12T03:04:09.109 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 1228, 2024-09-12T03:04:09.109 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 2.255357583, 2024-09-12T03:04:09.109 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.001836610 2024-09-12T03:04:09.109 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.110 INFO:teuthology.orchestra.run.smithi176.stdout: "req_readdir_latency": { 2024-09-12T03:04:09.110 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 470, 2024-09-12T03:04:09.110 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 1.608616523, 2024-09-12T03:04:09.110 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.003422588 2024-09-12T03:04:09.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.110 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rename_latency": { 2024-09-12T03:04:09.110 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 1512, 2024-09-12T03:04:09.110 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 232.935717868, 2024-09-12T03:04:09.110 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.154058014 2024-09-12T03:04:09.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.110 INFO:teuthology.orchestra.run.smithi176.stdout: "req_renamesnap_latency": { 2024-09-12T03:04:09.110 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.110 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.110 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.111 INFO:teuthology.orchestra.run.smithi176.stdout: "req_snapdiff_latency": { 2024-09-12T03:04:09.111 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.111 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.111 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.111 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmdir_latency": { 2024-09-12T03:04:09.111 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.111 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.111 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.111 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmsnap_latency": { 2024-09-12T03:04:09.111 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.111 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.112 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.112 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmxattr_latency": { 2024-09-12T03:04:09.112 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.112 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.112 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.112 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setattr_latency": { 2024-09-12T03:04:09.112 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.112 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.113 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.113 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setdirlayout_latency": { 2024-09-12T03:04:09.113 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.113 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.113 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.113 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setfilelock_latency": { 2024-09-12T03:04:09.113 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.113 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.114 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.114 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setlayout_latency": { 2024-09-12T03:04:09.114 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.114 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.114 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.114 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setxattr_latency": { 2024-09-12T03:04:09.114 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.114 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.114 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.114 INFO:teuthology.orchestra.run.smithi176.stdout: "req_symlink_latency": { 2024-09-12T03:04:09.115 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.115 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.115 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.115 INFO:teuthology.orchestra.run.smithi176.stdout: "req_unlink_latency": { 2024-09-12T03:04:09.115 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 9888, 2024-09-12T03:04:09.115 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 27.755225112, 2024-09-12T03:04:09.115 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.002806960 2024-09-12T03:04:09.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.116 INFO:teuthology.orchestra.run.smithi176.stdout: "cap_revoke_eviction": 0, 2024-09-12T03:04:09.116 INFO:teuthology.orchestra.run.smithi176.stdout: "cap_acquisition_throttle": 0, 2024-09-12T03:04:09.116 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getvxattr_latency": { 2024-09-12T03:04:09.116 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.116 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.116 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.116 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:09.116 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.116 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_sessions": { 2024-09-12T03:04:09.116 INFO:teuthology.orchestra.run.smithi176.stdout: "session_count": 2, 2024-09-12T03:04:09.116 INFO:teuthology.orchestra.run.smithi176.stdout: "session_add": 2, 2024-09-12T03:04:09.116 INFO:teuthology.orchestra.run.smithi176.stdout: "session_remove": 0, 2024-09-12T03:04:09.117 INFO:teuthology.orchestra.run.smithi176.stdout: "sessions_open": 2, 2024-09-12T03:04:09.117 INFO:teuthology.orchestra.run.smithi176.stdout: "sessions_stale": 0, 2024-09-12T03:04:09.117 INFO:teuthology.orchestra.run.smithi176.stdout: "total_load": 3768, 2024-09-12T03:04:09.117 INFO:teuthology.orchestra.run.smithi176.stdout: "average_load": 1884, 2024-09-12T03:04:09.117 INFO:teuthology.orchestra.run.smithi176.stdout: "avg_session_uptime": 905, 2024-09-12T03:04:09.117 INFO:teuthology.orchestra.run.smithi176.stdout: "mdthresh_evicted": 0 2024-09-12T03:04:09.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.117 INFO:teuthology.orchestra.run.smithi176.stdout: "mempool": { 2024-09-12T03:04:09.117 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_bytes": 0, 2024-09-12T03:04:09.117 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_items": 0, 2024-09-12T03:04:09.117 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T03:04:09.117 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_items": 0, 2024-09-12T03:04:09.118 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T03:04:09.118 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_items": 0, 2024-09-12T03:04:09.118 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T03:04:09.118 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T03:04:09.118 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T03:04:09.118 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T03:04:09.118 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T03:04:09.118 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_items": 0, 2024-09-12T03:04:09.118 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T03:04:09.118 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T03:04:09.118 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_bytes": 0, 2024-09-12T03:04:09.118 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_items": 0, 2024-09-12T03:04:09.118 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_bytes": 0, 2024-09-12T03:04:09.119 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_items": 0, 2024-09-12T03:04:09.119 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T03:04:09.119 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T03:04:09.119 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T03:04:09.119 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T03:04:09.119 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T03:04:09.119 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_items": 0, 2024-09-12T03:04:09.119 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_bytes": 0, 2024-09-12T03:04:09.119 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_items": 0, 2024-09-12T03:04:09.119 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T03:04:09.119 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T03:04:09.120 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_bytes": 0, 2024-09-12T03:04:09.120 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_items": 0, 2024-09-12T03:04:09.120 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_bytes": 0, 2024-09-12T03:04:09.120 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_items": 0, 2024-09-12T03:04:09.120 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T03:04:09.120 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_items": 0, 2024-09-12T03:04:09.120 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T03:04:09.120 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_items": 0, 2024-09-12T03:04:09.120 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_bytes": 336266, 2024-09-12T03:04:09.120 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_items": 134, 2024-09-12T03:04:09.120 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_bytes": 0, 2024-09-12T03:04:09.120 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_items": 0, 2024-09-12T03:04:09.120 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_bytes": 0, 2024-09-12T03:04:09.121 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_items": 0, 2024-09-12T03:04:09.121 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_bytes": 0, 2024-09-12T03:04:09.121 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_items": 0, 2024-09-12T03:04:09.121 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_bytes": 0, 2024-09-12T03:04:09.121 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_items": 0, 2024-09-12T03:04:09.121 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_bytes": 10136, 2024-09-12T03:04:09.121 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_items": 215, 2024-09-12T03:04:09.122 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T03:04:09.122 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_items": 0, 2024-09-12T03:04:09.122 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_bytes": 0, 2024-09-12T03:04:09.122 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_items": 0, 2024-09-12T03:04:09.122 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_bytes": 210253, 2024-09-12T03:04:09.122 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_items": 680, 2024-09-12T03:04:09.122 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_bytes": 0, 2024-09-12T03:04:09.122 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_items": 0, 2024-09-12T03:04:09.122 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_bytes": 0, 2024-09-12T03:04:09.122 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_items": 0 2024-09-12T03:04:09.122 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.122 INFO:teuthology.orchestra.run.smithi176.stdout: "objecter": { 2024-09-12T03:04:09.122 INFO:teuthology.orchestra.run.smithi176.stdout: "op_active": 0, 2024-09-12T03:04:09.123 INFO:teuthology.orchestra.run.smithi176.stdout: "op_laggy": 0, 2024-09-12T03:04:09.123 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send": 25120, 2024-09-12T03:04:09.123 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send_bytes": 112720688, 2024-09-12T03:04:09.123 INFO:teuthology.orchestra.run.smithi176.stdout: "op_resend": 30, 2024-09-12T03:04:09.123 INFO:teuthology.orchestra.run.smithi176.stdout: "op_reply": 25120, 2024-09-12T03:04:09.123 INFO:teuthology.orchestra.run.smithi176.stdout: "op_latency": { 2024-09-12T03:04:09.123 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 25120, 2024-09-12T03:04:09.123 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 1071.332467645, 2024-09-12T03:04:09.123 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.042648585 2024-09-12T03:04:09.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.123 INFO:teuthology.orchestra.run.smithi176.stdout: "op_inflight": 0, 2024-09-12T03:04:09.123 INFO:teuthology.orchestra.run.smithi176.stdout: "oplen_avg": { 2024-09-12T03:04:09.124 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 25120, 2024-09-12T03:04:09.124 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 26212 2024-09-12T03:04:09.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.124 INFO:teuthology.orchestra.run.smithi176.stdout: "op": 25120, 2024-09-12T03:04:09.124 INFO:teuthology.orchestra.run.smithi176.stdout: "op_r": 720, 2024-09-12T03:04:09.124 INFO:teuthology.orchestra.run.smithi176.stdout: "op_w": 24400, 2024-09-12T03:04:09.124 INFO:teuthology.orchestra.run.smithi176.stdout: "op_rmw": 0, 2024-09-12T03:04:09.124 INFO:teuthology.orchestra.run.smithi176.stdout: "op_pg": 0, 2024-09-12T03:04:09.124 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_stat": 0, 2024-09-12T03:04:09.124 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_create": 10, 2024-09-12T03:04:09.124 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_read": 445, 2024-09-12T03:04:09.124 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_write": 2746, 2024-09-12T03:04:09.124 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writefull": 279, 2024-09-12T03:04:09.125 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writesame": 0, 2024-09-12T03:04:09.125 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_append": 0, 2024-09-12T03:04:09.125 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_zero": 0, 2024-09-12T03:04:09.125 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_truncate": 30, 2024-09-12T03:04:09.125 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_delete": 20605, 2024-09-12T03:04:09.125 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_mapext": 0, 2024-09-12T03:04:09.125 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_sparse_read": 0, 2024-09-12T03:04:09.125 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_clonerange": 0, 2024-09-12T03:04:09.125 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_getxattr": 1, 2024-09-12T03:04:09.125 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_setxattr": 20, 2024-09-12T03:04:09.125 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_cmpxattr": 0, 2024-09-12T03:04:09.125 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_rmxattr": 0, 2024-09-12T03:04:09.126 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_resetxattrs": 0, 2024-09-12T03:04:09.126 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_call": 0, 2024-09-12T03:04:09.126 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_watch": 0, 2024-09-12T03:04:09.126 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_notify": 0, 2024-09-12T03:04:09.126 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T03:04:09.126 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls": 0, 2024-09-12T03:04:09.126 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls_filter": 0, 2024-09-12T03:04:09.126 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_other": 0, 2024-09-12T03:04:09.126 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_active": 0, 2024-09-12T03:04:09.126 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_send": 0, 2024-09-12T03:04:09.126 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_resend": 0, 2024-09-12T03:04:09.126 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_ping": 0, 2024-09-12T03:04:09.126 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_active": 0, 2024-09-12T03:04:09.126 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_send": 0, 2024-09-12T03:04:09.126 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_resend": 0, 2024-09-12T03:04:09.127 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_active": 0, 2024-09-12T03:04:09.127 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_send": 0, 2024-09-12T03:04:09.127 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_resend": 0, 2024-09-12T03:04:09.127 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_active": 0, 2024-09-12T03:04:09.127 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_send": 0, 2024-09-12T03:04:09.127 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_resend": 0, 2024-09-12T03:04:09.127 INFO:teuthology.orchestra.run.smithi176.stdout: "command_active": 0, 2024-09-12T03:04:09.127 INFO:teuthology.orchestra.run.smithi176.stdout: "command_send": 0, 2024-09-12T03:04:09.127 INFO:teuthology.orchestra.run.smithi176.stdout: "command_resend": 0, 2024-09-12T03:04:09.127 INFO:teuthology.orchestra.run.smithi176.stdout: "map_epoch": 118, 2024-09-12T03:04:09.127 INFO:teuthology.orchestra.run.smithi176.stdout: "map_full": 0, 2024-09-12T03:04:09.127 INFO:teuthology.orchestra.run.smithi176.stdout: "map_inc": 22, 2024-09-12T03:04:09.127 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_sessions": 12, 2024-09-12T03:04:09.127 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_open": 12, 2024-09-12T03:04:09.127 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_close": 0, 2024-09-12T03:04:09.128 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_laggy": 0, 2024-09-12T03:04:09.128 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_wr": 1349, 2024-09-12T03:04:09.128 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_rd": 390, 2024-09-12T03:04:09.128 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_del": 337 2024-09-12T03:04:09.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.128 INFO:teuthology.orchestra.run.smithi176.stdout: "oft": { 2024-09-12T03:04:09.128 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_objs": 1, 2024-09-12T03:04:09.128 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_kv_pairs": 0, 2024-09-12T03:04:09.128 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_updates": 0, 2024-09-12T03:04:09.128 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_removes": 0 2024-09-12T03:04:09.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.128 INFO:teuthology.orchestra.run.smithi176.stdout: "osd-slow-ops": { 2024-09-12T03:04:09.129 INFO:teuthology.orchestra.run.smithi176.stdout: "slow_ops_count": 14 2024-09-12T03:04:09.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.129 INFO:teuthology.orchestra.run.smithi176.stdout: "purge_queue": { 2024-09-12T03:04:09.129 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_ops": 0, 2024-09-12T03:04:09.129 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_ops_high_water": 10, 2024-09-12T03:04:09.129 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing": 0, 2024-09-12T03:04:09.129 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_high_water": 5, 2024-09-12T03:04:09.129 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executed_ops": 20568, 2024-09-12T03:04:09.129 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executed": 10284, 2024-09-12T03:04:09.129 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_item_in_journal": 0 2024-09-12T03:04:09.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.129 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T03:04:09.130 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:09.130 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-09-12T03:04:09.130 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:09.130 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 176366, 2024-09-12T03:04:09.130 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 63791060, 2024-09-12T03:04:09.130 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:09.130 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 176366, 2024-09-12T03:04:09.130 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-09-12T03:04:09.130 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-09-12T03:04:09.130 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 176366, 2024-09-12T03:04:09.130 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 63791060, 2024-09-12T03:04:09.130 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:09.130 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.131 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.131 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.131 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:09.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.131 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_bytes": { 2024-09-12T03:04:09.131 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:09.131 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-09-12T03:04:09.131 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:09.131 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-09-12T03:04:09.131 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-09-12T03:04:09.131 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:09.131 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-09-12T03:04:09.132 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 25120, 2024-09-12T03:04:09.132 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 114273054, 2024-09-12T03:04:09.132 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 25120, 2024-09-12T03:04:09.132 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 114273054, 2024-09-12T03:04:09.132 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:09.132 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.132 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.132 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.132 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:09.132 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.132 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_ops": { 2024-09-12T03:04:09.132 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:09.133 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 1024, 2024-09-12T03:04:09.133 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:09.133 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-09-12T03:04:09.133 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-09-12T03:04:09.133 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:09.133 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-09-12T03:04:09.133 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 25120, 2024-09-12T03:04:09.133 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 25120, 2024-09-12T03:04:09.133 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 25120, 2024-09-12T03:04:09.133 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 25120, 2024-09-12T03:04:09.134 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:09.134 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.134 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.134 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.134 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:09.134 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.134 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-write_buf_throttle": { 2024-09-12T03:04:09.134 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:09.134 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 3758096384, 2024-09-12T03:04:09.134 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:09.134 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 10284, 2024-09-12T03:04:09.134 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 1559684, 2024-09-12T03:04:09.134 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:09.135 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 10284, 2024-09-12T03:04:09.135 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-09-12T03:04:09.135 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-09-12T03:04:09.135 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 445, 2024-09-12T03:04:09.135 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 1559684, 2024-09-12T03:04:09.135 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:09.135 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.135 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.135 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.135 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:09.135 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:09.135 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-write_buf_throttle-0x55948e8e8960": { 2024-09-12T03:04:09.135 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:09.136 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 3758096384, 2024-09-12T03:04:09.136 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:09.136 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 40498, 2024-09-12T03:04:09.136 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 105582139, 2024-09-12T03:04:09.136 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:09.136 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 40498, 2024-09-12T03:04:09.136 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-09-12T03:04:09.136 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-09-12T03:04:09.136 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 2301, 2024-09-12T03:04:09.136 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 105582139, 2024-09-12T03:04:09.137 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:09.137 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:09.137 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:09.137 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:09.137 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:09.137 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:09.137 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T03:04:09.906 INFO:tasks.check_counter:Daemon mds.i mds.exported=537 2024-09-12T03:04:09.906 INFO:tasks.check_counter:Daemon mds.i mds.imported=327 2024-09-12T03:04:09.906 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=0 2024-09-12T03:04:09.906 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-12T03:04:09.906 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T03:04:09.906 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=30 2024-09-12T03:04:09.906 DEBUG:tasks.check_counter:Getting stats from l 2024-09-12T03:04:09.907 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-12T03:04:10.311 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T03:04:10.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:10 smithi176 ceph-mon[35713]: pgmap v485: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 258 op/s 2024-09-12T03:04:10.927 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T03:04:10.927 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T03:04:10.928 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 2219, 2024-09-12T03:04:10.928 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 2219, 2024-09-12T03:04:10.928 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 113910280, 2024-09-12T03:04:10.928 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 704819, 2024-09-12T03:04:10.928 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 8, 2024-09-12T03:04:10.928 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 4, 2024-09-12T03:04:10.928 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.259825464, 2024-09-12T03:04:10.928 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.059197296, 2024-09-12T03:04:10.928 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.116053720, 2024-09-12T03:04:10.928 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.067741796, 2024-09-12T03:04:10.928 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:04:10.929 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 2218, 2024-09-12T03:04:10.929 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.266896857, 2024-09-12T03:04:10.929 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000120332 2024-09-12T03:04:10.929 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.929 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:04:10.929 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.929 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.929 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.929 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.929 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T03:04:10.930 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T03:04:10.930 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.930 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T03:04:10.930 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 1133, 2024-09-12T03:04:10.930 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 1072, 2024-09-12T03:04:10.930 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 78703357, 2024-09-12T03:04:10.930 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 429782, 2024-09-12T03:04:10.930 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 6, 2024-09-12T03:04:10.930 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 5, 2024-09-12T03:04:10.930 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.147789386, 2024-09-12T03:04:10.930 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.037064270, 2024-09-12T03:04:10.931 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.107288823, 2024-09-12T03:04:10.931 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.017709338, 2024-09-12T03:04:10.931 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:04:10.931 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 1071, 2024-09-12T03:04:10.931 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.054180813, 2024-09-12T03:04:10.931 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000050588 2024-09-12T03:04:10.931 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.931 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:04:10.931 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.931 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.931 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.931 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.931 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 2115568, 2024-09-12T03:04:10.932 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 195984 2024-09-12T03:04:10.932 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.932 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T03:04:10.932 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 616, 2024-09-12T03:04:10.932 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 851, 2024-09-12T03:04:10.932 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 75663196, 2024-09-12T03:04:10.932 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 752020, 2024-09-12T03:04:10.932 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 8, 2024-09-12T03:04:10.932 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 6, 2024-09-12T03:04:10.932 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.106667145, 2024-09-12T03:04:10.932 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.024370453, 2024-09-12T03:04:10.932 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.058441124, 2024-09-12T03:04:10.932 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.017372624, 2024-09-12T03:04:10.933 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T03:04:10.933 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 848, 2024-09-12T03:04:10.933 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.082071264, 2024-09-12T03:04:10.933 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000096782 2024-09-12T03:04:10.933 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.933 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-09-12T03:04:10.933 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.933 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.933 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.933 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.933 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T03:04:10.933 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 556768 2024-09-12T03:04:10.934 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.934 INFO:teuthology.orchestra.run.smithi176.stdout: "cct": { 2024-09-12T03:04:10.934 INFO:teuthology.orchestra.run.smithi176.stdout: "total_workers": 1, 2024-09-12T03:04:10.934 INFO:teuthology.orchestra.run.smithi176.stdout: "unhealthy_workers": 0 2024-09-12T03:04:10.934 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.934 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-MDSRank": { 2024-09-12T03:04:10.934 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-09-12T03:04:10.934 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-09-12T03:04:10.934 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 5825, 2024-09-12T03:04:10.934 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.150501720, 2024-09-12T03:04:10.934 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000025837 2024-09-12T03:04:10.934 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:10.935 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.935 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-PurgeQueue": { 2024-09-12T03:04:10.935 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-09-12T03:04:10.935 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-09-12T03:04:10.935 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.935 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.935 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.935 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:10.935 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.935 INFO:teuthology.orchestra.run.smithi176.stdout: "mds": { 2024-09-12T03:04:10.935 INFO:teuthology.orchestra.run.smithi176.stdout: "request": 0, 2024-09-12T03:04:10.935 INFO:teuthology.orchestra.run.smithi176.stdout: "reply": 0, 2024-09-12T03:04:10.935 INFO:teuthology.orchestra.run.smithi176.stdout: "reply_latency": { 2024-09-12T03:04:10.936 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.936 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.936 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.936 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.936 INFO:teuthology.orchestra.run.smithi176.stdout: "slow_reply": 0, 2024-09-12T03:04:10.936 INFO:teuthology.orchestra.run.smithi176.stdout: "forward": 0, 2024-09-12T03:04:10.936 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_fetch_complete": 0, 2024-09-12T03:04:10.936 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_fetch_keys": 0, 2024-09-12T03:04:10.937 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_commit": 0, 2024-09-12T03:04:10.937 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_split": 0, 2024-09-12T03:04:10.937 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_merge": 0, 2024-09-12T03:04:10.937 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes": 37099, 2024-09-12T03:04:10.937 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_top": 555, 2024-09-12T03:04:10.937 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_bottom": 36544, 2024-09-12T03:04:10.937 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_pin_tail": 0, 2024-09-12T03:04:10.938 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_pinned": 36306, 2024-09-12T03:04:10.938 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_expired": 0, 2024-09-12T03:04:10.938 INFO:teuthology.orchestra.run.smithi176.stdout: "inodes_with_caps": 0, 2024-09-12T03:04:10.938 INFO:teuthology.orchestra.run.smithi176.stdout: "caps": 0, 2024-09-12T03:04:10.938 INFO:teuthology.orchestra.run.smithi176.stdout: "subtrees": 1, 2024-09-12T03:04:10.938 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse": 0, 2024-09-12T03:04:10.938 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_hit": 0, 2024-09-12T03:04:10.938 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_forward": 0, 2024-09-12T03:04:10.938 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_discover": 0, 2024-09-12T03:04:10.938 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_dir_fetch": 0, 2024-09-12T03:04:10.938 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_remote_ino": 0, 2024-09-12T03:04:10.938 INFO:teuthology.orchestra.run.smithi176.stdout: "traverse_lock": 0, 2024-09-12T03:04:10.938 INFO:teuthology.orchestra.run.smithi176.stdout: "load_cent": 0, 2024-09-12T03:04:10.939 INFO:teuthology.orchestra.run.smithi176.stdout: "q": 0, 2024-09-12T03:04:10.939 INFO:teuthology.orchestra.run.smithi176.stdout: "exported": 0, 2024-09-12T03:04:10.939 INFO:teuthology.orchestra.run.smithi176.stdout: "exported_inodes": 0, 2024-09-12T03:04:10.939 INFO:teuthology.orchestra.run.smithi176.stdout: "imported": 0, 2024-09-12T03:04:10.939 INFO:teuthology.orchestra.run.smithi176.stdout: "imported_inodes": 0, 2024-09-12T03:04:10.939 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_dir_fetch": 0, 2024-09-12T03:04:10.939 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_backtrace_fetch": 0, 2024-09-12T03:04:10.939 INFO:teuthology.orchestra.run.smithi176.stdout: "openino_peer_discover": 0, 2024-09-12T03:04:10.939 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rfiles": 0, 2024-09-12T03:04:10.940 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rbytes": 0, 2024-09-12T03:04:10.940 INFO:teuthology.orchestra.run.smithi176.stdout: "root_rsnaps": 0, 2024-09-12T03:04:10.940 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T03:04:10.940 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_set_tag": 0, 2024-09-12T03:04:10.940 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T03:04:10.940 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_inotable_repaired": 0, 2024-09-12T03:04:10.940 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dir_inodes": 0, 2024-09-12T03:04:10.941 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T03:04:10.941 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T03:04:10.941 INFO:teuthology.orchestra.run.smithi176.stdout: "scrub_file_inodes": 0, 2024-09-12T03:04:10.941 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_inode_file_caps": 0, 2024-09-12T03:04:10.941 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T03:04:10.941 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_grant": 0, 2024-09-12T03:04:10.941 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T03:04:10.941 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T03:04:10.941 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T03:04:10.941 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_caps": 0, 2024-09-12T03:04:10.941 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_caps_dirty": 0, 2024-09-12T03:04:10.941 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_cap_release": 0, 2024-09-12T03:04:10.942 INFO:teuthology.orchestra.run.smithi176.stdout: "process_request_cap_release": 0 2024-09-12T03:04:10.942 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.942 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_cache": { 2024-09-12T03:04:10.942 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_update": 0, 2024-09-12T03:04:10.942 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_update_receipt": 0, 2024-09-12T03:04:10.942 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_try_discover": 0, 2024-09-12T03:04:10.942 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_send_discover": 0, 2024-09-12T03:04:10.942 INFO:teuthology.orchestra.run.smithi176.stdout: "dir_handle_discover": 0, 2024-09-12T03:04:10.942 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays": 0, 2024-09-12T03:04:10.942 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays_delayed": 0, 2024-09-12T03:04:10.942 INFO:teuthology.orchestra.run.smithi176.stdout: "num_strays_enqueuing": 0, 2024-09-12T03:04:10.942 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_created": 0, 2024-09-12T03:04:10.942 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_enqueued": 0, 2024-09-12T03:04:10.942 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_reintegrated": 0, 2024-09-12T03:04:10.943 INFO:teuthology.orchestra.run.smithi176.stdout: "strays_migrated": 0, 2024-09-12T03:04:10.943 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_processing": 0, 2024-09-12T03:04:10.943 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_enqueued": 0, 2024-09-12T03:04:10.943 INFO:teuthology.orchestra.run.smithi176.stdout: "num_recovering_prioritized": 0, 2024-09-12T03:04:10.943 INFO:teuthology.orchestra.run.smithi176.stdout: "recovery_started": 0, 2024-09-12T03:04:10.943 INFO:teuthology.orchestra.run.smithi176.stdout: "recovery_completed": 0, 2024-09-12T03:04:10.943 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_quiesce_path": 0, 2024-09-12T03:04:10.943 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_quiesce_inode": 0, 2024-09-12T03:04:10.943 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T03:04:10.943 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_exportdir": 0, 2024-09-12T03:04:10.943 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_flush": 0, 2024-09-12T03:04:10.943 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_fragmentdir": 0, 2024-09-12T03:04:10.943 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_fragstats": 0, 2024-09-12T03:04:10.944 INFO:teuthology.orchestra.run.smithi176.stdout: "ireq_inodestats": 0 2024-09-12T03:04:10.944 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.944 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_log": { 2024-09-12T03:04:10.944 INFO:teuthology.orchestra.run.smithi176.stdout: "evlrg": 0, 2024-09-12T03:04:10.944 INFO:teuthology.orchestra.run.smithi176.stdout: "evadd": 0, 2024-09-12T03:04:10.944 INFO:teuthology.orchestra.run.smithi176.stdout: "evex": 0, 2024-09-12T03:04:10.944 INFO:teuthology.orchestra.run.smithi176.stdout: "evtrm": 0, 2024-09-12T03:04:10.944 INFO:teuthology.orchestra.run.smithi176.stdout: "ev": 86306, 2024-09-12T03:04:10.944 INFO:teuthology.orchestra.run.smithi176.stdout: "evexg": 0, 2024-09-12T03:04:10.944 INFO:teuthology.orchestra.run.smithi176.stdout: "evexd": 0, 2024-09-12T03:04:10.944 INFO:teuthology.orchestra.run.smithi176.stdout: "segadd": 0, 2024-09-12T03:04:10.944 INFO:teuthology.orchestra.run.smithi176.stdout: "segex": 0, 2024-09-12T03:04:10.944 INFO:teuthology.orchestra.run.smithi176.stdout: "segtrm": 0, 2024-09-12T03:04:10.945 INFO:teuthology.orchestra.run.smithi176.stdout: "seg": 129, 2024-09-12T03:04:10.945 INFO:teuthology.orchestra.run.smithi176.stdout: "segmjr": 9, 2024-09-12T03:04:10.945 INFO:teuthology.orchestra.run.smithi176.stdout: "segexg": 0, 2024-09-12T03:04:10.945 INFO:teuthology.orchestra.run.smithi176.stdout: "segexd": 0, 2024-09-12T03:04:10.945 INFO:teuthology.orchestra.run.smithi176.stdout: "expos": 4194352, 2024-09-12T03:04:10.945 INFO:teuthology.orchestra.run.smithi176.stdout: "wrpos": 269326844, 2024-09-12T03:04:10.945 INFO:teuthology.orchestra.run.smithi176.stdout: "rdpos": 269320499, 2024-09-12T03:04:10.945 INFO:teuthology.orchestra.run.smithi176.stdout: "jlat": { 2024-09-12T03:04:10.945 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.945 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.945 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.945 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.945 INFO:teuthology.orchestra.run.smithi176.stdout: "replayed": 86306 2024-09-12T03:04:10.946 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.946 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_mem": { 2024-09-12T03:04:10.946 INFO:teuthology.orchestra.run.smithi176.stdout: "ino": 12420, 2024-09-12T03:04:10.946 INFO:teuthology.orchestra.run.smithi176.stdout: "ino+": 36321, 2024-09-12T03:04:10.946 INFO:teuthology.orchestra.run.smithi176.stdout: "ino-": 23901, 2024-09-12T03:04:10.946 INFO:teuthology.orchestra.run.smithi176.stdout: "dir": 462, 2024-09-12T03:04:10.946 INFO:teuthology.orchestra.run.smithi176.stdout: "dir+": 1206, 2024-09-12T03:04:10.946 INFO:teuthology.orchestra.run.smithi176.stdout: "dir-": 744, 2024-09-12T03:04:10.946 INFO:teuthology.orchestra.run.smithi176.stdout: "dn": 37099, 2024-09-12T03:04:10.946 INFO:teuthology.orchestra.run.smithi176.stdout: "dn+": 63666, 2024-09-12T03:04:10.946 INFO:teuthology.orchestra.run.smithi176.stdout: "dn-": 26567, 2024-09-12T03:04:10.946 INFO:teuthology.orchestra.run.smithi176.stdout: "cap": 0, 2024-09-12T03:04:10.946 INFO:teuthology.orchestra.run.smithi176.stdout: "cap+": 0, 2024-09-12T03:04:10.946 INFO:teuthology.orchestra.run.smithi176.stdout: "cap-": 0, 2024-09-12T03:04:10.946 INFO:teuthology.orchestra.run.smithi176.stdout: "rss": 136680, 2024-09-12T03:04:10.947 INFO:teuthology.orchestra.run.smithi176.stdout: "heap": 215328 2024-09-12T03:04:10.947 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.947 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_server": { 2024-09-12T03:04:10.947 INFO:teuthology.orchestra.run.smithi176.stdout: "dispatch_client_request": 0, 2024-09-12T03:04:10.947 INFO:teuthology.orchestra.run.smithi176.stdout: "dispatch_server_request": 0, 2024-09-12T03:04:10.947 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_request": 0, 2024-09-12T03:04:10.947 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_client_session": 0, 2024-09-12T03:04:10.947 INFO:teuthology.orchestra.run.smithi176.stdout: "handle_peer_request": 0, 2024-09-12T03:04:10.947 INFO:teuthology.orchestra.run.smithi176.stdout: "req_create_latency": { 2024-09-12T03:04:10.947 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.947 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.947 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.947 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.947 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getattr_latency": { 2024-09-12T03:04:10.948 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.948 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.948 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.948 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getfilelock_latency": { 2024-09-12T03:04:10.948 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.948 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.948 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.948 INFO:teuthology.orchestra.run.smithi176.stdout: "req_link_latency": { 2024-09-12T03:04:10.949 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.949 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.949 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.949 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.949 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookup_latency": { 2024-09-12T03:04:10.949 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.949 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.949 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.949 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.949 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookuphash_latency": { 2024-09-12T03:04:10.949 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.949 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.949 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.950 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.950 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupino_latency": { 2024-09-12T03:04:10.950 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.950 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.950 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.950 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.950 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupname_latency": { 2024-09-12T03:04:10.950 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.950 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.950 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.950 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.950 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupparent_latency": { 2024-09-12T03:04:10.951 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.951 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.951 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.951 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.951 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lookupsnap_latency": { 2024-09-12T03:04:10.951 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.951 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.951 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.951 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.951 INFO:teuthology.orchestra.run.smithi176.stdout: "req_lssnap_latency": { 2024-09-12T03:04:10.952 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.952 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.952 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.952 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.952 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mkdir_latency": { 2024-09-12T03:04:10.952 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.953 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.953 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.953 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.953 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mknod_latency": { 2024-09-12T03:04:10.953 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.953 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.953 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.953 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.953 INFO:teuthology.orchestra.run.smithi176.stdout: "req_mksnap_latency": { 2024-09-12T03:04:10.953 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.953 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.953 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.954 INFO:teuthology.orchestra.run.smithi176.stdout: "req_open_latency": { 2024-09-12T03:04:10.954 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.954 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.954 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.954 INFO:teuthology.orchestra.run.smithi176.stdout: "req_readdir_latency": { 2024-09-12T03:04:10.954 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.954 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.954 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.954 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rename_latency": { 2024-09-12T03:04:10.954 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.955 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.955 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.955 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.955 INFO:teuthology.orchestra.run.smithi176.stdout: "req_renamesnap_latency": { 2024-09-12T03:04:10.955 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.955 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.955 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.955 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.955 INFO:teuthology.orchestra.run.smithi176.stdout: "req_snapdiff_latency": { 2024-09-12T03:04:10.955 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.955 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.955 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.956 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.956 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmdir_latency": { 2024-09-12T03:04:10.956 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.956 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.956 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.956 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.956 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmsnap_latency": { 2024-09-12T03:04:10.956 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.956 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.956 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.957 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.957 INFO:teuthology.orchestra.run.smithi176.stdout: "req_rmxattr_latency": { 2024-09-12T03:04:10.957 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.957 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.957 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.957 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.957 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setattr_latency": { 2024-09-12T03:04:10.957 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.957 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.957 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.957 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.957 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setdirlayout_latency": { 2024-09-12T03:04:10.958 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.958 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.958 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.958 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.958 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setfilelock_latency": { 2024-09-12T03:04:10.958 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.958 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.958 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.958 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.958 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setlayout_latency": { 2024-09-12T03:04:10.958 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.958 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.959 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.959 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.959 INFO:teuthology.orchestra.run.smithi176.stdout: "req_setxattr_latency": { 2024-09-12T03:04:10.959 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.959 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.959 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.959 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.959 INFO:teuthology.orchestra.run.smithi176.stdout: "req_symlink_latency": { 2024-09-12T03:04:10.959 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.959 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.959 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.959 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.959 INFO:teuthology.orchestra.run.smithi176.stdout: "req_unlink_latency": { 2024-09-12T03:04:10.960 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.960 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.960 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.960 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.960 INFO:teuthology.orchestra.run.smithi176.stdout: "cap_revoke_eviction": 0, 2024-09-12T03:04:10.960 INFO:teuthology.orchestra.run.smithi176.stdout: "cap_acquisition_throttle": 0, 2024-09-12T03:04:10.960 INFO:teuthology.orchestra.run.smithi176.stdout: "req_getvxattr_latency": { 2024-09-12T03:04:10.960 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.960 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.960 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.960 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:10.960 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.960 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_sessions": { 2024-09-12T03:04:10.961 INFO:teuthology.orchestra.run.smithi176.stdout: "session_count": 2, 2024-09-12T03:04:10.961 INFO:teuthology.orchestra.run.smithi176.stdout: "session_add": 4, 2024-09-12T03:04:10.961 INFO:teuthology.orchestra.run.smithi176.stdout: "session_remove": 2, 2024-09-12T03:04:10.961 INFO:teuthology.orchestra.run.smithi176.stdout: "sessions_open": 3, 2024-09-12T03:04:10.961 INFO:teuthology.orchestra.run.smithi176.stdout: "sessions_stale": 0, 2024-09-12T03:04:10.961 INFO:teuthology.orchestra.run.smithi176.stdout: "total_load": 0, 2024-09-12T03:04:10.961 INFO:teuthology.orchestra.run.smithi176.stdout: "average_load": 0, 2024-09-12T03:04:10.961 INFO:teuthology.orchestra.run.smithi176.stdout: "avg_session_uptime": 3051, 2024-09-12T03:04:10.961 INFO:teuthology.orchestra.run.smithi176.stdout: "mdthresh_evicted": 0 2024-09-12T03:04:10.962 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.962 INFO:teuthology.orchestra.run.smithi176.stdout: "mempool": { 2024-09-12T03:04:10.962 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_bytes": 0, 2024-09-12T03:04:10.962 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_items": 0, 2024-09-12T03:04:10.962 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T03:04:10.962 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_items": 0, 2024-09-12T03:04:10.962 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T03:04:10.962 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_items": 0, 2024-09-12T03:04:10.962 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T03:04:10.962 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T03:04:10.962 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T03:04:10.962 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T03:04:10.962 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T03:04:10.963 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_items": 0, 2024-09-12T03:04:10.963 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T03:04:10.963 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T03:04:10.963 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_bytes": 0, 2024-09-12T03:04:10.963 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_items": 0, 2024-09-12T03:04:10.963 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_bytes": 0, 2024-09-12T03:04:10.963 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_items": 0, 2024-09-12T03:04:10.963 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T03:04:10.963 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T03:04:10.963 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T03:04:10.963 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T03:04:10.963 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T03:04:10.963 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_items": 0, 2024-09-12T03:04:10.963 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_bytes": 0, 2024-09-12T03:04:10.963 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_items": 0, 2024-09-12T03:04:10.964 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T03:04:10.964 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T03:04:10.964 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_bytes": 0, 2024-09-12T03:04:10.964 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_items": 0, 2024-09-12T03:04:10.964 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_bytes": 0, 2024-09-12T03:04:10.964 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_items": 0, 2024-09-12T03:04:10.964 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T03:04:10.964 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_items": 0, 2024-09-12T03:04:10.964 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T03:04:10.964 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_items": 0, 2024-09-12T03:04:10.964 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_bytes": 708653, 2024-09-12T03:04:10.964 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_items": 12741, 2024-09-12T03:04:10.964 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_bytes": 0, 2024-09-12T03:04:10.965 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_items": 0, 2024-09-12T03:04:10.965 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_bytes": 0, 2024-09-12T03:04:10.965 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_items": 0, 2024-09-12T03:04:10.965 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_bytes": 0, 2024-09-12T03:04:10.965 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_items": 0, 2024-09-12T03:04:10.965 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_bytes": 0, 2024-09-12T03:04:10.965 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_items": 0, 2024-09-12T03:04:10.965 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_bytes": 10352, 2024-09-12T03:04:10.965 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_items": 224, 2024-09-12T03:04:10.965 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T03:04:10.965 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_items": 0, 2024-09-12T03:04:10.966 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_bytes": 0, 2024-09-12T03:04:10.966 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_items": 0, 2024-09-12T03:04:10.966 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_bytes": 55963176, 2024-09-12T03:04:10.966 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_items": 585623, 2024-09-12T03:04:10.966 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_bytes": 0, 2024-09-12T03:04:10.966 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_items": 0, 2024-09-12T03:04:10.966 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_bytes": 0, 2024-09-12T03:04:10.966 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_items": 0 2024-09-12T03:04:10.967 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.967 INFO:teuthology.orchestra.run.smithi176.stdout: "objecter": { 2024-09-12T03:04:10.967 INFO:teuthology.orchestra.run.smithi176.stdout: "op_active": 0, 2024-09-12T03:04:10.967 INFO:teuthology.orchestra.run.smithi176.stdout: "op_laggy": 0, 2024-09-12T03:04:10.967 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send": 3564, 2024-09-12T03:04:10.967 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send_bytes": 21, 2024-09-12T03:04:10.967 INFO:teuthology.orchestra.run.smithi176.stdout: "op_resend": 3, 2024-09-12T03:04:10.967 INFO:teuthology.orchestra.run.smithi176.stdout: "op_reply": 3564, 2024-09-12T03:04:10.967 INFO:teuthology.orchestra.run.smithi176.stdout: "op_latency": { 2024-09-12T03:04:10.967 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 3564, 2024-09-12T03:04:10.967 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 20.055150093, 2024-09-12T03:04:10.967 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.005627146 2024-09-12T03:04:10.967 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.968 INFO:teuthology.orchestra.run.smithi176.stdout: "op_inflight": 0, 2024-09-12T03:04:10.968 INFO:teuthology.orchestra.run.smithi176.stdout: "oplen_avg": { 2024-09-12T03:04:10.968 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 3564, 2024-09-12T03:04:10.968 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 3565 2024-09-12T03:04:10.968 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.968 INFO:teuthology.orchestra.run.smithi176.stdout: "op": 3564, 2024-09-12T03:04:10.968 INFO:teuthology.orchestra.run.smithi176.stdout: "op_r": 3564, 2024-09-12T03:04:10.968 INFO:teuthology.orchestra.run.smithi176.stdout: "op_w": 0, 2024-09-12T03:04:10.969 INFO:teuthology.orchestra.run.smithi176.stdout: "op_rmw": 0, 2024-09-12T03:04:10.969 INFO:teuthology.orchestra.run.smithi176.stdout: "op_pg": 0, 2024-09-12T03:04:10.969 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_stat": 2165, 2024-09-12T03:04:10.969 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_create": 0, 2024-09-12T03:04:10.969 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_read": 1397, 2024-09-12T03:04:10.969 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_write": 0, 2024-09-12T03:04:10.969 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writefull": 0, 2024-09-12T03:04:10.969 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writesame": 0, 2024-09-12T03:04:10.969 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_append": 0, 2024-09-12T03:04:10.969 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_zero": 0, 2024-09-12T03:04:10.969 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_truncate": 0, 2024-09-12T03:04:10.969 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_delete": 0, 2024-09-12T03:04:10.970 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_mapext": 0, 2024-09-12T03:04:10.970 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_sparse_read": 0, 2024-09-12T03:04:10.970 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_clonerange": 0, 2024-09-12T03:04:10.970 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_getxattr": 1, 2024-09-12T03:04:10.970 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_setxattr": 0, 2024-09-12T03:04:10.970 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_cmpxattr": 0, 2024-09-12T03:04:10.970 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_rmxattr": 0, 2024-09-12T03:04:10.970 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_resetxattrs": 0, 2024-09-12T03:04:10.970 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_call": 0, 2024-09-12T03:04:10.970 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_watch": 0, 2024-09-12T03:04:10.970 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_notify": 0, 2024-09-12T03:04:10.970 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T03:04:10.970 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls": 0, 2024-09-12T03:04:10.971 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls_filter": 0, 2024-09-12T03:04:10.971 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_other": 0, 2024-09-12T03:04:10.971 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_active": 0, 2024-09-12T03:04:10.971 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_send": 0, 2024-09-12T03:04:10.971 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_resend": 0, 2024-09-12T03:04:10.971 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_ping": 0, 2024-09-12T03:04:10.971 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_active": 0, 2024-09-12T03:04:10.971 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_send": 0, 2024-09-12T03:04:10.971 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_resend": 0, 2024-09-12T03:04:10.971 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_active": 0, 2024-09-12T03:04:10.971 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_send": 0, 2024-09-12T03:04:10.971 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_resend": 0, 2024-09-12T03:04:10.972 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_active": 0, 2024-09-12T03:04:10.972 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_send": 0, 2024-09-12T03:04:10.972 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_resend": 0, 2024-09-12T03:04:10.972 INFO:teuthology.orchestra.run.smithi176.stdout: "command_active": 0, 2024-09-12T03:04:10.972 INFO:teuthology.orchestra.run.smithi176.stdout: "command_send": 0, 2024-09-12T03:04:10.972 INFO:teuthology.orchestra.run.smithi176.stdout: "command_resend": 0, 2024-09-12T03:04:10.972 INFO:teuthology.orchestra.run.smithi176.stdout: "map_epoch": 118, 2024-09-12T03:04:10.973 INFO:teuthology.orchestra.run.smithi176.stdout: "map_full": 0, 2024-09-12T03:04:10.973 INFO:teuthology.orchestra.run.smithi176.stdout: "map_inc": 22, 2024-09-12T03:04:10.973 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_sessions": 11, 2024-09-12T03:04:10.973 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_open": 11, 2024-09-12T03:04:10.973 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_close": 0, 2024-09-12T03:04:10.973 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_laggy": 0, 2024-09-12T03:04:10.973 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_wr": 0, 2024-09-12T03:04:10.973 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_rd": 2, 2024-09-12T03:04:10.973 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_del": 0 2024-09-12T03:04:10.973 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.973 INFO:teuthology.orchestra.run.smithi176.stdout: "oft": { 2024-09-12T03:04:10.974 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_objs": 0, 2024-09-12T03:04:10.974 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_kv_pairs": 0, 2024-09-12T03:04:10.974 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_updates": 0, 2024-09-12T03:04:10.974 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_total_removes": 0 2024-09-12T03:04:10.974 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.974 INFO:teuthology.orchestra.run.smithi176.stdout: "osd-slow-ops": { 2024-09-12T03:04:10.974 INFO:teuthology.orchestra.run.smithi176.stdout: "slow_ops_count": 0 2024-09-12T03:04:10.974 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.974 INFO:teuthology.orchestra.run.smithi176.stdout: "purge_queue": { 2024-09-12T03:04:10.974 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_ops": 0, 2024-09-12T03:04:10.975 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T03:04:10.975 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing": 0, 2024-09-12T03:04:10.975 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executing_high_water": 0, 2024-09-12T03:04:10.975 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executed_ops": 0, 2024-09-12T03:04:10.975 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_executed": 0, 2024-09-12T03:04:10.975 INFO:teuthology.orchestra.run.smithi176.stdout: "pq_item_in_journal": 0 2024-09-12T03:04:10.975 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.975 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T03:04:10.975 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:10.975 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-09-12T03:04:10.975 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:10.975 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 3964, 2024-09-12T03:04:10.976 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 267896919, 2024-09-12T03:04:10.976 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:10.976 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 3964, 2024-09-12T03:04:10.976 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-09-12T03:04:10.976 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-09-12T03:04:10.976 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 3964, 2024-09-12T03:04:10.976 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 267896919, 2024-09-12T03:04:10.976 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:10.976 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.976 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.976 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.976 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:10.976 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.977 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_bytes": { 2024-09-12T03:04:10.977 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:10.977 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-09-12T03:04:10.977 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:10.977 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-09-12T03:04:10.977 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-09-12T03:04:10.977 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:10.977 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-09-12T03:04:10.977 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 3564, 2024-09-12T03:04:10.977 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 265164295, 2024-09-12T03:04:10.977 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 3564, 2024-09-12T03:04:10.977 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 265164295, 2024-09-12T03:04:10.977 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:10.978 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.978 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.978 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.978 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:10.978 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.978 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_ops": { 2024-09-12T03:04:10.978 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:10.978 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 1024, 2024-09-12T03:04:10.978 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:10.978 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-09-12T03:04:10.979 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-09-12T03:04:10.979 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:10.979 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-09-12T03:04:10.979 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 3564, 2024-09-12T03:04:10.979 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 3564, 2024-09-12T03:04:10.979 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 3564, 2024-09-12T03:04:10.979 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 3564, 2024-09-12T03:04:10.979 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:10.979 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.979 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.979 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.979 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:10.980 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.980 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-write_buf_throttle": { 2024-09-12T03:04:10.980 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:10.980 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 3758096384, 2024-09-12T03:04:10.980 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:10.980 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-09-12T03:04:10.980 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-09-12T03:04:10.980 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:10.980 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-09-12T03:04:10.980 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-09-12T03:04:10.980 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-09-12T03:04:10.980 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-09-12T03:04:10.980 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-09-12T03:04:10.981 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:10.981 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.981 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.981 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.981 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:10.981 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T03:04:10.981 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-write_buf_throttle-0x55ff22796b40": { 2024-09-12T03:04:10.981 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-09-12T03:04:10.981 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 3758096384, 2024-09-12T03:04:10.981 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-09-12T03:04:10.981 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-09-12T03:04:10.981 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-09-12T03:04:10.981 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-09-12T03:04:10.982 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-09-12T03:04:10.982 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-09-12T03:04:10.982 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-09-12T03:04:10.982 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-09-12T03:04:10.982 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-09-12T03:04:10.982 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-09-12T03:04:10.982 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-09-12T03:04:10.982 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-09-12T03:04:10.982 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-09-12T03:04:10.982 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:10.983 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T03:04:10.983 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T03:04:11.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:10 smithi062 ceph-mon[35527]: pgmap v485: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 258 op/s 2024-09-12T03:04:11.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:10 smithi018 ceph-mon[30616]: pgmap v485: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 258 op/s 2024-09-12T03:04:11.860 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-12T03:04:11.860 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-12T03:04:11.860 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-09-12T03:04:11.860 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-12T03:04:11.860 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T03:04:11.860 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-09-12T03:04:11.860 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T03:04:11.875 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T03:04:11.876 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T03:04:11.876 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:04:11.963 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-12T03:04:11.963 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:04:12.037 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T03:04:12.750 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T03:04:12.928 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:12 smithi018 ceph-mon[30616]: pgmap v486: 129 pgs: 65 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 41 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 238 op/s 2024-09-12T03:04:12.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:12 smithi176 ceph-mon[35713]: pgmap v486: 129 pgs: 65 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 41 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 238 op/s 2024-09-12T03:04:13.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:12 smithi062 ceph-mon[35527]: pgmap v486: 129 pgs: 65 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 41 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 238 op/s 2024-09-12T03:04:14.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:14 smithi176 ceph-mon[35713]: pgmap v487: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 236 op/s 2024-09-12T03:04:15.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:14 smithi062 ceph-mon[35527]: pgmap v487: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 236 op/s 2024-09-12T03:04:15.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:14 smithi018 ceph-mon[30616]: pgmap v487: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 236 op/s 2024-09-12T03:04:15.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.216+0000 7fd383a00640 1 -- 172.21.15.18:0/1229254269 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37c0745c0 msgr2=0x7fd37c0749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:15.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.217+0000 7fd383a00640 1 --2- 172.21.15.18:0/1229254269 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37c0745c0 0x7fd37c0749a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd370009900 tx=0x7fd37002a4d0 comp rx=0 tx=0).stop 2024-09-12T03:04:15.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.217+0000 7fd383a00640 1 -- 172.21.15.18:0/1229254269 shutdown_connections 2024-09-12T03:04:15.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.217+0000 7fd383a00640 1 --2- 172.21.15.18:0/1229254269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd37c10e420 0x7fd37c110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:15.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.217+0000 7fd383a00640 1 --2- 172.21.15.18:0/1229254269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd37c074ee0 0x7fd37c10dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:15.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.217+0000 7fd383a00640 1 --2- 172.21.15.18:0/1229254269 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37c0745c0 0x7fd37c0749a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:15.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.217+0000 7fd383a00640 1 -- 172.21.15.18:0/1229254269 >> 172.21.15.18:0/1229254269 conn(0x7fd37c0fd8c0 msgr2=0x7fd37c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:15.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.217+0000 7fd383a00640 1 -- 172.21.15.18:0/1229254269 shutdown_connections 2024-09-12T03:04:15.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.218+0000 7fd383a00640 1 -- 172.21.15.18:0/1229254269 wait complete. 2024-09-12T03:04:15.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.219+0000 7fd383a00640 1 Processor -- start 2024-09-12T03:04:15.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.219+0000 7fd383a00640 1 -- start start 2024-09-12T03:04:15.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.220+0000 7fd383a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd37c0745c0 0x7fd37c1075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:15.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.220+0000 7fd383a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd37c074ee0 0x7fd37c107b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:15.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.220+0000 7fd383a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37c10e420 0x7fd37c1026e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:15.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.221+0000 7fd381000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd37c0745c0 0x7fd37c1075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:15.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.221+0000 7fd381a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37c10e420 0x7fd37c1026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:15.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.221+0000 7fd383a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c1142a0 con 0x7fd37c074ee0 2024-09-12T03:04:15.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.221+0000 7fd383a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c114120 con 0x7fd37c0745c0 2024-09-12T03:04:15.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.221+0000 7fd381a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37c10e420 0x7fd37c1026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:58982/0 (socket says 172.21.15.18:58982) 2024-09-12T03:04:15.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.221+0000 7fd383a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c114420 con 0x7fd37c10e420 2024-09-12T03:04:15.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.221+0000 7fd381a00640 1 -- 172.21.15.18:0/3550402963 learned_addr learned my addr 172.21.15.18:0/3550402963 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:04:15.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.221+0000 7fd381000640 1 -- 172.21.15.18:0/3550402963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37c10e420 msgr2=0x7fd37c1026e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:15.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.221+0000 7fd381000640 1 --2- 172.21.15.18:0/3550402963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37c10e420 0x7fd37c1026e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:15.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.221+0000 7fd381000640 1 -- 172.21.15.18:0/3550402963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd37c074ee0 msgr2=0x7fd37c107b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:15.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.221+0000 7fd381000640 1 --2- 172.21.15.18:0/3550402963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd37c074ee0 0x7fd37c107b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:15.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.221+0000 7fd381000640 1 -- 172.21.15.18:0/3550402963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37c102fa0 con 0x7fd37c0745c0 2024-09-12T03:04:15.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.222+0000 7fd381000640 1 --2- 172.21.15.18:0/3550402963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd37c0745c0 0x7fd37c1075c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd37002a9f0 tx=0x7fd3700055a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:15.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.222+0000 7fd379600640 1 -- 172.21.15.18:0/3550402963 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370040070 con 0x7fd37c0745c0 2024-09-12T03:04:15.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.223+0000 7fd379600640 1 -- 172.21.15.18:0/3550402963 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd37003cd30 con 0x7fd37c0745c0 2024-09-12T03:04:15.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.223+0000 7fd379600640 1 -- 172.21.15.18:0/3550402963 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370031e60 con 0x7fd37c0745c0 2024-09-12T03:04:15.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.223+0000 7fd383a00640 1 -- 172.21.15.18:0/3550402963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd37c103230 con 0x7fd37c0745c0 2024-09-12T03:04:15.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.223+0000 7fd383a00640 1 -- 172.21.15.18:0/3550402963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd37c10d2e0 con 0x7fd37c0745c0 2024-09-12T03:04:15.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.225+0000 7fd383a00640 1 -- 172.21.15.18:0/3550402963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd37c075c70 con 0x7fd37c0745c0 2024-09-12T03:04:15.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.232+0000 7fd379600640 1 -- 172.21.15.18:0/3550402963 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fd37003a040 con 0x7fd37c0745c0 2024-09-12T03:04:15.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.234+0000 7fd379600640 1 --2- 172.21.15.18:0/3550402963 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd3640a2df0 0x7fd3640a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:15.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.235+0000 7fd379600640 1 -- 172.21.15.18:0/3550402963 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9890+0+0 (secure 0 0 0) 0x7fd3700f0350 con 0x7fd37c0745c0 2024-09-12T03:04:15.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.237+0000 7fd37be00640 1 --2- 172.21.15.18:0/3550402963 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd3640a2df0 0x7fd3640a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:15.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.239+0000 7fd37be00640 1 --2- 172.21.15.18:0/3550402963 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd3640a2df0 0x7fd3640a52b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd37c103ea0 tx=0x7fd368006c90 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:15.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.239+0000 7fd379600640 1 -- 172.21.15.18:0/3550402963 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd3700bc9b0 con 0x7fd37c0745c0 2024-09-12T03:04:15.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.616+0000 7fd383a00640 1 -- 172.21.15.18:0/3550402963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd37c0749a0 con 0x7fd37c0745c0 2024-09-12T03:04:15.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.620+0000 7fd379600640 1 -- 172.21.15.18:0/3550402963 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v118) ==== 81+0+941 (secure 0 0 0) 0x7fd3700b6e20 con 0x7fd37c0745c0 2024-09-12T03:04:15.625 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/4167793150 2024-09-13T02:48:42.970169+0000 2024-09-12T03:04:15.625 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/494888664 2024-09-13T02:48:42.970169+0000 2024-09-12T03:04:15.625 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/1531572357 2024-09-13T02:37:40.790128+0000 2024-09-12T03:04:15.625 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/601880715 2024-09-13T02:37:40.790128+0000 2024-09-12T03:04:15.625 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/601880715 2024-09-13T02:37:40.790128+0000 2024-09-12T03:04:15.625 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/3024661873 2024-09-13T02:38:10.525951+0000 2024-09-12T03:04:15.625 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/3271799053 2024-09-13T02:38:10.525951+0000 2024-09-12T03:04:15.625 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/4191505851 2024-09-13T02:48:42.970169+0000 2024-09-12T03:04:15.626 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/1185819845 2024-09-13T02:48:42.970169+0000 2024-09-12T03:04:15.626 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2429098892 2024-09-13T02:37:40.790128+0000 2024-09-12T03:04:15.626 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/3271799053 2024-09-13T02:38:10.525951+0000 2024-09-12T03:04:15.626 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/4236556151 2024-09-13T02:38:10.525951+0000 2024-09-12T03:04:15.626 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/494888664 2024-09-13T02:48:42.970169+0000 2024-09-12T03:04:15.626 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/1197309398 2024-09-13T02:37:40.790128+0000 2024-09-12T03:04:15.626 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/2679362143 2024-09-13T02:38:10.525951+0000 2024-09-12T03:04:15.626 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/880406453 2024-09-13T02:48:42.970169+0000 2024-09-12T03:04:15.627 INFO:teuthology.orchestra.run.smithi018.stderr:listed 16 entries 2024-09-12T03:04:15.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.624+0000 7fd383a00640 1 -- 172.21.15.18:0/3550402963 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd3640a2df0 msgr2=0x7fd3640a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:15.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.624+0000 7fd383a00640 1 --2- 172.21.15.18:0/3550402963 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd3640a2df0 0x7fd3640a52b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd37c103ea0 tx=0x7fd368006c90 comp rx=0 tx=0).stop 2024-09-12T03:04:15.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.624+0000 7fd383a00640 1 -- 172.21.15.18:0/3550402963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd37c0745c0 msgr2=0x7fd37c1075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:15.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.624+0000 7fd383a00640 1 --2- 172.21.15.18:0/3550402963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd37c0745c0 0x7fd37c1075c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd37002a9f0 tx=0x7fd3700055a0 comp rx=0 tx=0).stop 2024-09-12T03:04:15.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.624+0000 7fd383a00640 1 -- 172.21.15.18:0/3550402963 shutdown_connections 2024-09-12T03:04:15.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.625+0000 7fd383a00640 1 --2- 172.21.15.18:0/3550402963 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fd3640a2df0 0x7fd3640a52b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:15.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.625+0000 7fd383a00640 1 --2- 172.21.15.18:0/3550402963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37c10e420 0x7fd37c1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:15.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.625+0000 7fd383a00640 1 --2- 172.21.15.18:0/3550402963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd37c074ee0 0x7fd37c107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:15.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.625+0000 7fd383a00640 1 --2- 172.21.15.18:0/3550402963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd37c0745c0 0x7fd37c1075c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:15.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.625+0000 7fd383a00640 1 -- 172.21.15.18:0/3550402963 >> 172.21.15.18:0/3550402963 conn(0x7fd37c0fd8c0 msgr2=0x7fd37c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:15.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.625+0000 7fd383a00640 1 -- 172.21.15.18:0/3550402963 shutdown_connections 2024-09-12T03:04:15.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:15.625+0000 7fd383a00640 1 -- 172.21.15.18:0/3550402963 wait complete. 2024-09-12T03:04:15.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:15 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/3550402963' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T03:04:16.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:15 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/3550402963' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T03:04:16.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:15 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/3550402963' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T03:04:16.575 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T03:04:16.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:04:16.575 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T03:04:16.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:16 smithi018 ceph-mon[30616]: pgmap v488: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 27 KiB/s wr, 187 op/s 2024-09-12T03:04:16.910 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-12T03:04:16.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:04:16.910 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T03:04:16.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:16 smithi176 ceph-mon[35713]: pgmap v488: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 27 KiB/s wr, 187 op/s 2024-09-12T03:04:17.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:04:17.010 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-12T03:04:17.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:16 smithi062 ceph-mon[35527]: pgmap v488: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 27 KiB/s wr, 187 op/s 2024-09-12T03:04:17.135 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T03:04:17.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:04:17.136 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:04:17.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:04:17.267 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-09-12T03:04:17.644 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-12T03:04:17.654 INFO:tasks.cephadm:Teardown begin 2024-09-12T03:04:17.654 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T03:04:17.654 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T03:04:18.968 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T03:04:18.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:18 smithi176 ceph-mon[35713]: pgmap v489: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 409 B/s wr, 170 op/s 2024-09-12T03:04:19.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:18 smithi018 ceph-mon[30616]: pgmap v489: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 409 B/s wr, 170 op/s 2024-09-12T03:04:19.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:18 smithi062 ceph-mon[35527]: pgmap v489: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 409 B/s wr, 170 op/s 2024-09-12T03:04:20.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.284+0000 7ff11b200640 1 -- 172.21.15.18:0/727305209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff11c10e970 msgr2=0x7ff11c115310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:20.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.284+0000 7ff11b200640 1 --2- 172.21.15.18:0/727305209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff11c10e970 0x7ff11c115310 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff114009ca0 tx=0x7ff11402a8c0 comp rx=0 tx=0).stop 2024-09-12T03:04:20.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.284+0000 7ff11b200640 1 -- 172.21.15.18:0/727305209 shutdown_connections 2024-09-12T03:04:20.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.284+0000 7ff11b200640 1 --2- 172.21.15.18:0/727305209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff11c10e970 0x7ff11c115310 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:20.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.284+0000 7ff11b200640 1 --2- 172.21.15.18:0/727305209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff11c109e00 0x7ff11c10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:20.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.284+0000 7ff11b200640 1 --2- 172.21.15.18:0/727305209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff11c109450 0x7ff11c109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:20.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.284+0000 7ff11b200640 1 -- 172.21.15.18:0/727305209 >> 172.21.15.18:0/727305209 conn(0x7ff11c073180 msgr2=0x7ff11c073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:20.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.285+0000 7ff11b200640 1 -- 172.21.15.18:0/727305209 shutdown_connections 2024-09-12T03:04:20.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.285+0000 7ff11b200640 1 -- 172.21.15.18:0/727305209 wait complete. 2024-09-12T03:04:20.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.286+0000 7ff11b200640 1 Processor -- start 2024-09-12T03:04:20.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.287+0000 7ff11b200640 1 -- start start 2024-09-12T03:04:20.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.287+0000 7ff11b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff11c109450 0x7ff11c1a8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:20.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.287+0000 7ff11b200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff11c109e00 0x7ff11c1a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:20.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.287+0000 7ff11b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff11c10e970 0x7ff11c1a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:20.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.287+0000 7ff11b200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c119550 con 0x7ff11c10e970 2024-09-12T03:04:20.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.287+0000 7ff11b200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c1193d0 con 0x7ff11c109e00 2024-09-12T03:04:20.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.287+0000 7ff11b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c1196d0 con 0x7ff11c109450 2024-09-12T03:04:20.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.288+0000 7ff113e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff11c109e00 0x7ff11c1a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:20.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.288+0000 7ff119e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff11c109450 0x7ff11c1a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:20.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.288+0000 7ff119e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff11c109450 0x7ff11c1a8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:58994/0 (socket says 172.21.15.18:58994) 2024-09-12T03:04:20.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.288+0000 7ff119e00640 1 -- 172.21.15.18:0/1345909573 learned_addr learned my addr 172.21.15.18:0/1345909573 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:04:20.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.288+0000 7ff11a800640 1 --2- 172.21.15.18:0/1345909573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff11c10e970 0x7ff11c1a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:20.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.289+0000 7ff113e00640 1 -- 172.21.15.18:0/1345909573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff11c109450 msgr2=0x7ff11c1a8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:20.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.289+0000 7ff113e00640 1 --2- 172.21.15.18:0/1345909573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff11c109450 0x7ff11c1a8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:20.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.289+0000 7ff113e00640 1 -- 172.21.15.18:0/1345909573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff11c10e970 msgr2=0x7ff11c1a2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:20.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.289+0000 7ff113e00640 1 --2- 172.21.15.18:0/1345909573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff11c10e970 0x7ff11c1a2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:20.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.289+0000 7ff113e00640 1 -- 172.21.15.18:0/1345909573 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c1a3210 con 0x7ff11c109e00 2024-09-12T03:04:20.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.290+0000 7ff113e00640 1 --2- 172.21.15.18:0/1345909573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff11c109e00 0x7ff11c1a8e60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff10400d6a0 tx=0x7ff10400db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:20.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.290+0000 7ff112a00640 1 -- 172.21.15.18:0/1345909573 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff104017070 con 0x7ff11c109e00 2024-09-12T03:04:20.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.291+0000 7ff11b200640 1 -- 172.21.15.18:0/1345909573 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff11c1a3500 con 0x7ff11c109e00 2024-09-12T03:04:20.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.291+0000 7ff112a00640 1 -- 172.21.15.18:0/1345909573 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff104009820 con 0x7ff11c109e00 2024-09-12T03:04:20.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.291+0000 7ff11b200640 1 -- 172.21.15.18:0/1345909573 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff11c1af7f0 con 0x7ff11c109e00 2024-09-12T03:04:20.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.292+0000 7ff112a00640 1 -- 172.21.15.18:0/1345909573 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff104004cd0 con 0x7ff11c109e00 2024-09-12T03:04:20.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.295+0000 7ff11b200640 1 -- 172.21.15.18:0/1345909573 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f8005290 con 0x7ff11c109e00 2024-09-12T03:04:20.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.298+0000 7ff112a00640 1 -- 172.21.15.18:0/1345909573 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7ff104005220 con 0x7ff11c109e00 2024-09-12T03:04:20.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.301+0000 7ff112a00640 1 --2- 172.21.15.18:0/1345909573 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff1000a2df0 0x7ff1000a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:20.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.301+0000 7ff119e00640 1 --2- 172.21.15.18:0/1345909573 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff1000a2df0 0x7ff1000a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:20.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.302+0000 7ff112a00640 1 -- 172.21.15.18:0/1345909573 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9890+0+0 (secure 0 0 0) 0x7ff1040cf1f0 con 0x7ff11c109e00 2024-09-12T03:04:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.305+0000 7ff112a00640 1 -- 172.21.15.18:0/1345909573 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff10409b850 con 0x7ff11c109e00 2024-09-12T03:04:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.306+0000 7ff119e00640 1 --2- 172.21.15.18:0/1345909573 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff1000a2df0 0x7ff1000a52b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009a40 tx=0x7ff10c0091c0 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.731+0000 7ff11b200640 1 -- 172.21.15.18:0/1345909573 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0f8005850 con 0x7ff11c109e00 2024-09-12T03:04:20.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.733+0000 7ff112a00640 1 -- 172.21.15.18:0/1345909573 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+11987 (secure 0 0 0) 0x7ff10409b150 con 0x7ff11c109e00 2024-09-12T03:04:20.734 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T03:04:20.734 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 77 2024-09-12T03:04:20.735 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":77,"btime":"2024-09-12T03:03:56:479520+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/747069368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":747069368},{"type":"v1","addr":"172.21.15.18:6837","nonce":747069368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/4056752027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4056752027},{"type":"v1","addr":"172.21.15.18:6839","nonce":4056752027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":77,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:45:36.564696+0000","modified":"2024-09-12T03:03:56.192675+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24527,"mds_1":24526,"mds_2":24508,"mds_3":24493,"mds_4":24488},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/43234729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":43234729},{"type":"v1","addr":"172.21.15.18:6835","nonce":43234729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6835/564392030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":564392030},{"type":"v1","addr":"172.21.15.62:6835","nonce":564392030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6835/3199321182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3199321182},{"type":"v1","addr":"172.21.15.176:6835","nonce":3199321182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.62:6837/3520593627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3520593627},{"type":"v1","addr":"172.21.15.62:6837","nonce":3520593627}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":23,"addr":"172.21.15.176:6837/4286557016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4286557016},{"type":"v1","addr":"172.21.15.176:6837","nonce":4286557016}]},"join_fscid":-1,"export_targets":[0,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.176:6839/3957634398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":3957634398},{"type":"v1","addr":"172.21.15.176:6839","nonce":3957634398}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"a","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.18:6841/823308007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":823308007},{"type":"v1","addr":"172.21.15.18:6841","nonce":823308007}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/3744347102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3744347102},{"type":"v1","addr":"172.21.15.62:6839","nonce":3744347102}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24488,24527,24493,24508,24526]},"id":1}]} 2024-09-12T03:04:20.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.739+0000 7ff11b200640 1 -- 172.21.15.18:0/1345909573 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff1000a2df0 msgr2=0x7ff1000a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:20.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.739+0000 7ff11b200640 1 --2- 172.21.15.18:0/1345909573 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff1000a2df0 0x7ff1000a52b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009a40 tx=0x7ff10c0091c0 comp rx=0 tx=0).stop 2024-09-12T03:04:20.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.739+0000 7ff11b200640 1 -- 172.21.15.18:0/1345909573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff11c109e00 msgr2=0x7ff11c1a8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:20.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.739+0000 7ff11b200640 1 --2- 172.21.15.18:0/1345909573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff11c109e00 0x7ff11c1a8e60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff10400d6a0 tx=0x7ff10400db60 comp rx=0 tx=0).stop 2024-09-12T03:04:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.740+0000 7ff11b200640 1 -- 172.21.15.18:0/1345909573 shutdown_connections 2024-09-12T03:04:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.740+0000 7ff11b200640 1 --2- 172.21.15.18:0/1345909573 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff1000a2df0 0x7ff1000a52b0 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009a40 tx=0x7ff10c0091c0 comp rx=0 tx=0).stop 2024-09-12T03:04:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.740+0000 7ff11b200640 1 --2- 172.21.15.18:0/1345909573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff11c10e970 0x7ff11c1a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.740+0000 7ff11b200640 1 --2- 172.21.15.18:0/1345909573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff11c109e00 0x7ff11c1a8e60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.740+0000 7ff11b200640 1 --2- 172.21.15.18:0/1345909573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff11c109450 0x7ff11c1a8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.740+0000 7ff11b200640 1 -- 172.21.15.18:0/1345909573 >> 172.21.15.18:0/1345909573 conn(0x7ff11c073180 msgr2=0x7ff11c06d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.740+0000 7ff11b200640 1 -- 172.21.15.18:0/1345909573 shutdown_connections 2024-09-12T03:04:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:20.740+0000 7ff11b200640 1 -- 172.21.15.18:0/1345909573 wait complete. 2024-09-12T03:04:20.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:20 smithi176 ceph-mon[35713]: pgmap v490: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 870 B/s wr, 162 op/s 2024-09-12T03:04:21.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:20 smithi062 ceph-mon[35527]: pgmap v490: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 870 B/s wr, 162 op/s 2024-09-12T03:04:21.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:20 smithi018 ceph-mon[30616]: pgmap v490: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 870 B/s wr, 162 op/s 2024-09-12T03:04:21.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:21 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1345909573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T03:04:22.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:21 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1345909573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T03:04:22.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:21 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1345909573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T03:04:22.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:22 smithi176 ceph-mon[35713]: pgmap v491: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 149 op/s 2024-09-12T03:04:22.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:22 smithi176 ceph-mon[35713]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:04:23.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:22 smithi062 ceph-mon[35527]: pgmap v491: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 149 op/s 2024-09-12T03:04:23.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:22 smithi062 ceph-mon[35527]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:04:23.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:22 smithi018 ceph-mon[30616]: pgmap v491: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 149 op/s 2024-09-12T03:04:23.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:22 smithi018 ceph-mon[30616]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T03:04:24.978 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:24 smithi176 ceph-mon[35713]: pgmap v492: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 111 op/s 2024-09-12T03:04:25.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:24 smithi062 ceph-mon[35527]: pgmap v492: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 111 op/s 2024-09-12T03:04:25.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:24 smithi018 ceph-mon[30616]: pgmap v492: 129 pgs: 72 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 111 op/s 2024-09-12T03:04:26.919 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T03:04:26.979 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:26 smithi176 ceph-mon[35713]: pgmap v493: 129 pgs: 66 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 42 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.4 KiB/s wr, 136 op/s 2024-09-12T03:04:27.022 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:26 smithi018 ceph-mon[30616]: pgmap v493: 129 pgs: 66 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 42 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.4 KiB/s wr, 136 op/s 2024-09-12T03:04:27.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:26 smithi062 ceph-mon[35527]: pgmap v493: 129 pgs: 66 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 42 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.4 KiB/s wr, 136 op/s 2024-09-12T03:04:27.661 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T03:04:28.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.575+0000 7f96dda00640 1 -- 172.21.15.18:0/3929760562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d81008c0 msgr2=0x7f96d8100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:28.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.575+0000 7f96dda00640 1 --2- 172.21.15.18:0/3929760562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d81008c0 0x7f96d8100ca0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009cd0 tx=0x7f96d002a8f0 comp rx=0 tx=0).stop 2024-09-12T03:04:28.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.576+0000 7f96dda00640 1 -- 172.21.15.18:0/3929760562 shutdown_connections 2024-09-12T03:04:28.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.576+0000 7f96dda00640 1 --2- 172.21.15.18:0/3929760562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d8105ec0 0x7f96d8106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:28.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.576+0000 7f96dda00640 1 --2- 172.21.15.18:0/3929760562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d81011e0 0x7f96d8105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:28.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.576+0000 7f96dda00640 1 --2- 172.21.15.18:0/3929760562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d81008c0 0x7f96d8100ca0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:28.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.576+0000 7f96dda00640 1 -- 172.21.15.18:0/3929760562 >> 172.21.15.18:0/3929760562 conn(0x7f96d80fc7d0 msgr2=0x7f96d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:28.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.578+0000 7f96dda00640 1 -- 172.21.15.18:0/3929760562 shutdown_connections 2024-09-12T03:04:28.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.578+0000 7f96dda00640 1 -- 172.21.15.18:0/3929760562 wait complete. 2024-09-12T03:04:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.580+0000 7f96dda00640 1 Processor -- start 2024-09-12T03:04:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.580+0000 7f96dda00640 1 -- start start 2024-09-12T03:04:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.581+0000 7f96dda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d81008c0 0x7f96d81a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.581+0000 7f96dda00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d81011e0 0x7f96d81a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.581+0000 7f96dda00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d8105ec0 0x7f96d819ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.581+0000 7f96dda00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f96d81186e0 con 0x7f96d81008c0 2024-09-12T03:04:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.581+0000 7f96dda00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f96d8118560 con 0x7f96d8105ec0 2024-09-12T03:04:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.581+0000 7f96dda00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f96d8118860 con 0x7f96d81011e0 2024-09-12T03:04:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.582+0000 7f96d6000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d81011e0 0x7f96d81a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.582+0000 7f96d7400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d8105ec0 0x7f96d819ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.582+0000 7f96d7400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d8105ec0 0x7f96d819ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:50190/0 (socket says 172.21.15.18:50190) 2024-09-12T03:04:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.582+0000 7f96d7400640 1 -- 172.21.15.18:0/1238933916 learned_addr learned my addr 172.21.15.18:0/1238933916 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:04:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.582+0000 7f96d6a00640 1 --2- 172.21.15.18:0/1238933916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d81008c0 0x7f96d81a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.583+0000 7f96d7400640 1 -- 172.21.15.18:0/1238933916 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d81011e0 msgr2=0x7f96d81a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.583+0000 7f96d7400640 1 --2- 172.21.15.18:0/1238933916 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d81011e0 0x7f96d81a4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.583+0000 7f96d7400640 1 -- 172.21.15.18:0/1238933916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d81008c0 msgr2=0x7f96d81a4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.583+0000 7f96d7400640 1 --2- 172.21.15.18:0/1238933916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d81008c0 0x7f96d81a4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.583+0000 7f96d7400640 1 -- 172.21.15.18:0/1238933916 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d819f200 con 0x7f96d8105ec0 2024-09-12T03:04:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.583+0000 7f96d6a00640 1 --2- 172.21.15.18:0/1238933916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d81008c0 0x7f96d81a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:04:28.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.583+0000 7f96d7400640 1 --2- 172.21.15.18:0/1238933916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d8105ec0 0x7f96d819ead0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f96c800d950 tx=0x7f96c800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:28.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.584+0000 7f96cf400640 1 -- 172.21.15.18:0/1238933916 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8017030 con 0x7f96d8105ec0 2024-09-12T03:04:28.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.585+0000 7f96cf400640 1 -- 172.21.15.18:0/1238933916 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96c8004020 con 0x7f96d8105ec0 2024-09-12T03:04:28.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.585+0000 7f96dda00640 1 -- 172.21.15.18:0/1238933916 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d819f4f0 con 0x7f96d8105ec0 2024-09-12T03:04:28.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.585+0000 7f96cf400640 1 -- 172.21.15.18:0/1238933916 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8003c20 con 0x7f96d8105ec0 2024-09-12T03:04:28.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.585+0000 7f96dda00640 1 -- 172.21.15.18:0/1238933916 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d8106ee0 con 0x7f96d8105ec0 2024-09-12T03:04:28.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.586+0000 7f96dda00640 1 -- 172.21.15.18:0/1238933916 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d8105980 con 0x7f96d8105ec0 2024-09-12T03:04:28.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.589+0000 7f96cf400640 1 -- 172.21.15.18:0/1238933916 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f96c801a070 con 0x7f96d8105ec0 2024-09-12T03:04:28.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.591+0000 7f96cf400640 1 --2- 172.21.15.18:0/1238933916 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f96bc0a2e40 0x7f96bc0a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:28.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.591+0000 7f96cf400640 1 -- 172.21.15.18:0/1238933916 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9890+0+0 (secure 0 0 0) 0x7f96c80cf140 con 0x7f96d8105ec0 2024-09-12T03:04:28.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.594+0000 7f96d6a00640 1 --2- 172.21.15.18:0/1238933916 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f96bc0a2e40 0x7f96bc0a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:28.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.595+0000 7f96d6a00640 1 --2- 172.21.15.18:0/1238933916 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f96bc0a2e40 0x7f96bc0a5300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009cd0 tx=0x7f96d0000f40 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:28.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:28.601+0000 7f96cf400640 1 -- 172.21.15.18:0/1238933916 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f96c8021020 con 0x7f96d8105ec0 2024-09-12T03:04:29.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:28 smithi062 ceph-mon[35527]: pgmap v494: 129 pgs: 66 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 42 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.3 KiB/s wr, 103 op/s 2024-09-12T03:04:29.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:28 smithi018 ceph-mon[30616]: pgmap v494: 129 pgs: 66 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 42 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.3 KiB/s wr, 103 op/s 2024-09-12T03:04:29.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:29.039+0000 7f96dda00640 1 -- 172.21.15.18:0/1238933916 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96d819ffc0 con 0x7f96d8105ec0 2024-09-12T03:04:29.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:29.040+0000 7f96cf400640 1 -- 172.21.15.18:0/1238933916 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+11985 (secure 0 0 0) 0x7f96d819ffc0 con 0x7f96d8105ec0 2024-09-12T03:04:29.045 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T03:04:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 78 2024-09-12T03:04:29.045 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":78,"btime":"2024-09-12T03:04:21:695636+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/747069368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":747069368},{"type":"v1","addr":"172.21.15.18:6837","nonce":747069368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/4056752027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4056752027},{"type":"v1","addr":"172.21.15.18:6839","nonce":4056752027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":78,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:45:36.564696+0000","modified":"2024-09-12T03:04:21.406478+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24527,"mds_1":24526,"mds_2":24508,"mds_3":24493,"mds_4":24488},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6833/1160389785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1160389785},{"type":"v1","addr":"172.21.15.62:6833","nonce":1160389785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6833/1988054318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1988054318},{"type":"v1","addr":"172.21.15.176:6833","nonce":1988054318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/43234729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":43234729},{"type":"v1","addr":"172.21.15.18:6835","nonce":43234729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6835/564392030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":564392030},{"type":"v1","addr":"172.21.15.62:6835","nonce":564392030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6835/3199321182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3199321182},{"type":"v1","addr":"172.21.15.176:6835","nonce":3199321182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.62:6837/3520593627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":3520593627},{"type":"v1","addr":"172.21.15.62:6837","nonce":3520593627}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":23,"addr":"172.21.15.176:6837/4286557016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4286557016},{"type":"v1","addr":"172.21.15.176:6837","nonce":4286557016}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.176:6839/3957634398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6838","nonce":3957634398},{"type":"v1","addr":"172.21.15.176:6839","nonce":3957634398}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"a","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.18:6841/823308007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":823308007},{"type":"v1","addr":"172.21.15.18:6841","nonce":823308007}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.62:6839/3744347102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3744347102},{"type":"v1","addr":"172.21.15.62:6839","nonce":3744347102}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24526,24508,24493,24527,24488]},"id":1}]} 2024-09-12T03:04:29.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:29.046+0000 7f96dda00640 1 -- 172.21.15.18:0/1238933916 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f96bc0a2e40 msgr2=0x7f96bc0a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:29.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:29.046+0000 7f96dda00640 1 --2- 172.21.15.18:0/1238933916 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f96bc0a2e40 0x7f96bc0a5300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009cd0 tx=0x7f96d0000f40 comp rx=0 tx=0).stop 2024-09-12T03:04:29.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:29.046+0000 7f96dda00640 1 -- 172.21.15.18:0/1238933916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d8105ec0 msgr2=0x7f96d819ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:29.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:29.046+0000 7f96dda00640 1 --2- 172.21.15.18:0/1238933916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d8105ec0 0x7f96d819ead0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f96c800d950 tx=0x7f96c800de10 comp rx=0 tx=0).stop 2024-09-12T03:04:29.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:29.047+0000 7f96dda00640 1 -- 172.21.15.18:0/1238933916 shutdown_connections 2024-09-12T03:04:29.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:29.047+0000 7f96dda00640 1 --2- 172.21.15.18:0/1238933916 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f96bc0a2e40 0x7f96bc0a5300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:29.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:29.047+0000 7f96dda00640 1 --2- 172.21.15.18:0/1238933916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d8105ec0 0x7f96d819ead0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:29.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:29.047+0000 7f96dda00640 1 --2- 172.21.15.18:0/1238933916 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d81011e0 0x7f96d81a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:29.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:29.047+0000 7f96dda00640 1 --2- 172.21.15.18:0/1238933916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d81008c0 0x7f96d81a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:29.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:29.047+0000 7f96dda00640 1 -- 172.21.15.18:0/1238933916 >> 172.21.15.18:0/1238933916 conn(0x7f96d80fc7d0 msgr2=0x7f96d8103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:29.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:29.048+0000 7f96dda00640 1 -- 172.21.15.18:0/1238933916 shutdown_connections 2024-09-12T03:04:29.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:29.048+0000 7f96dda00640 1 -- 172.21.15.18:0/1238933916 wait complete. 2024-09-12T03:04:29.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:28 smithi176 ceph-mon[35713]: pgmap v494: 129 pgs: 66 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 42 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.3 KiB/s wr, 103 op/s 2024-09-12T03:04:30.005 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:29 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1238933916' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T03:04:30.011 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T03:04:30.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:29 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1238933916' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T03:04:30.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:29 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1238933916' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T03:04:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T03:04:31.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:30 smithi018 ceph-mon[30616]: pgmap v495: 129 pgs: 66 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 42 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 96 op/s 2024-09-12T03:04:31.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:30 smithi062 ceph-mon[35527]: pgmap v495: 129 pgs: 66 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 42 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 96 op/s 2024-09-12T03:04:31.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:30 smithi176 ceph-mon[35713]: pgmap v495: 129 pgs: 66 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 42 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 96 op/s 2024-09-12T03:04:32.644 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-12T03:04:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.816+0000 7faa9b200640 1 -- 172.21.15.18:0/606213933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa94108e00 msgr2=0x7faa9410ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.816+0000 7faa9b200640 1 --2- 172.21.15.18:0/606213933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa94108e00 0x7faa9410ce00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faa80009900 tx=0x7faa8002a440 comp rx=0 tx=0).stop 2024-09-12T03:04:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.817+0000 7faa9b200640 1 -- 172.21.15.18:0/606213933 shutdown_connections 2024-09-12T03:04:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.817+0000 7faa9b200640 1 --2- 172.21.15.18:0/606213933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa9410d530 0x7faa941150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.818+0000 7faa9b200640 1 --2- 172.21.15.18:0/606213933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa94108e00 0x7faa9410ce00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.818+0000 7faa9b200640 1 --2- 172.21.15.18:0/606213933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa94108450 0x7faa94108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.818+0000 7faa9b200640 1 -- 172.21.15.18:0/606213933 >> 172.21.15.18:0/606213933 conn(0x7faa94077ba0 msgr2=0x7faa94079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.820+0000 7faa9b200640 1 -- 172.21.15.18:0/606213933 shutdown_connections 2024-09-12T03:04:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.820+0000 7faa9b200640 1 -- 172.21.15.18:0/606213933 wait complete. 2024-09-12T03:04:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.821+0000 7faa9b200640 1 Processor -- start 2024-09-12T03:04:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.822+0000 7faa9b200640 1 -- start start 2024-09-12T03:04:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.822+0000 7faa9b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa94108450 0x7faa94082670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.822+0000 7faa9b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa94108e00 0x7faa94082bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.822+0000 7faa9b200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa9410d530 0x7faa9407b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.823+0000 7faa93e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa94108450 0x7faa94082670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.823+0000 7faa99200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa9410d530 0x7faa9407b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.824+0000 7faa99200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa9410d530 0x7faa9407b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:50196/0 (socket says 172.21.15.18:50196) 2024-09-12T03:04:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.824+0000 7faa99200640 1 -- 172.21.15.18:0/1352810237 learned_addr learned my addr 172.21.15.18:0/1352810237 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:04:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.823+0000 7faa93400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa94108e00 0x7faa94082bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.824+0000 7faa9b200640 1 -- 172.21.15.18:0/1352810237 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa94118620 con 0x7faa94108e00 2024-09-12T03:04:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.824+0000 7faa9b200640 1 -- 172.21.15.18:0/1352810237 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7faa941184a0 con 0x7faa9410d530 2024-09-12T03:04:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.824+0000 7faa9b200640 1 -- 172.21.15.18:0/1352810237 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faa941187a0 con 0x7faa94108450 2024-09-12T03:04:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.824+0000 7faa99200640 1 -- 172.21.15.18:0/1352810237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa94108450 msgr2=0x7faa94082670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.825+0000 7faa99200640 1 --2- 172.21.15.18:0/1352810237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa94108450 0x7faa94082670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.825+0000 7faa99200640 1 -- 172.21.15.18:0/1352810237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa94108e00 msgr2=0x7faa94082bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.825+0000 7faa99200640 1 --2- 172.21.15.18:0/1352810237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa94108e00 0x7faa94082bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.825+0000 7faa99200640 1 -- 172.21.15.18:0/1352810237 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9407c040 con 0x7faa9410d530 2024-09-12T03:04:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.826+0000 7faa93400640 1 --2- 172.21.15.18:0/1352810237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa94108e00 0x7faa94082bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:04:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.826+0000 7faa93e00640 1 --2- 172.21.15.18:0/1352810237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa94108450 0x7faa94082670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:04:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.830+0000 7faa99200640 1 --2- 172.21.15.18:0/1352810237 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa9410d530 0x7faa9407b780 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00e960 tx=0x7faa8c00ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.832+0000 7faa90c00640 1 -- 172.21.15.18:0/1352810237 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c004d20 con 0x7faa9410d530 2024-09-12T03:04:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.833+0000 7faa9b200640 1 -- 172.21.15.18:0/1352810237 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9407c330 con 0x7faa9410d530 2024-09-12T03:04:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.833+0000 7faa9b200640 1 -- 172.21.15.18:0/1352810237 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa94080370 con 0x7faa9410d530 2024-09-12T03:04:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.834+0000 7faa90c00640 1 -- 172.21.15.18:0/1352810237 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa8c005020 con 0x7faa9410d530 2024-09-12T03:04:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.834+0000 7faa90c00640 1 -- 172.21.15.18:0/1352810237 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c0116d0 con 0x7faa9410d530 2024-09-12T03:04:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.835+0000 7faa9b200640 1 -- 172.21.15.18:0/1352810237 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa74005290 con 0x7faa9410d530 2024-09-12T03:04:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.843+0000 7faa90c00640 1 -- 172.21.15.18:0/1352810237 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7faa8c00cb20 con 0x7faa9410d530 2024-09-12T03:04:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.846+0000 7faa90c00640 1 --2- 172.21.15.18:0/1352810237 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7faa780a2e40 0x7faa780a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.846+0000 7faa93e00640 1 --2- 172.21.15.18:0/1352810237 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7faa780a2e40 0x7faa780a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.848+0000 7faa90c00640 1 -- 172.21.15.18:0/1352810237 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9890+0+0 (secure 0 0 0) 0x7faa8c0cf9d0 con 0x7faa9410d530 2024-09-12T03:04:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.848+0000 7faa93e00640 1 --2- 172.21.15.18:0/1352810237 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7faa780a2e40 0x7faa780a5300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faa8400a8b0 tx=0x7faa84008040 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:31.849+0000 7faa90c00640 1 -- 172.21.15.18:0/1352810237 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa8c016030 con 0x7faa9410d530 2024-09-12T03:04:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:32.176+0000 7faa9b200640 1 -- 172.21.15.18:0/1352810237 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa74005850 con 0x7faa9410d530 2024-09-12T03:04:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:32.178+0000 7faa90c00640 1 -- 172.21.15.18:0/1352810237 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+25920 (secure 0 0 0) 0x7faa8c09c190 con 0x7faa9410d530 2024-09-12T03:04:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:32.180+0000 7faa9b200640 1 -- 172.21.15.18:0/1352810237 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7faa780a2e40 msgr2=0x7faa780a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:32.180+0000 7faa9b200640 1 --2- 172.21.15.18:0/1352810237 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7faa780a2e40 0x7faa780a5300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faa8400a8b0 tx=0x7faa84008040 comp rx=0 tx=0).stop 2024-09-12T03:04:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:32.180+0000 7faa9b200640 1 -- 172.21.15.18:0/1352810237 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa9410d530 msgr2=0x7faa9407b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:32.180+0000 7faa9b200640 1 --2- 172.21.15.18:0/1352810237 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa9410d530 0x7faa9407b780 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00e960 tx=0x7faa8c00ee20 comp rx=0 tx=0).stop 2024-09-12T03:04:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:32.180+0000 7faa9b200640 1 -- 172.21.15.18:0/1352810237 shutdown_connections 2024-09-12T03:04:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:32.180+0000 7faa9b200640 1 --2- 172.21.15.18:0/1352810237 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7faa780a2e40 0x7faa780a5300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:32.180+0000 7faa9b200640 1 --2- 172.21.15.18:0/1352810237 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa9410d530 0x7faa9407b780 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:32.180+0000 7faa9b200640 1 --2- 172.21.15.18:0/1352810237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa94108e00 0x7faa94082bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:32.180+0000 7faa9b200640 1 --2- 172.21.15.18:0/1352810237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa94108450 0x7faa94082670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:32.180+0000 7faa9b200640 1 -- 172.21.15.18:0/1352810237 >> 172.21.15.18:0/1352810237 conn(0x7faa94077ba0 msgr2=0x7faa94078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:32.180+0000 7faa9b200640 1 -- 172.21.15.18:0/1352810237 shutdown_connections 2024-09-12T03:04:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:32.180+0000 7faa9b200640 1 -- 172.21.15.18:0/1352810237 wait complete. 2024-09-12T03:04:32.649 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":118,"fsid":"c7666100-70af-11ef-bcea-c7b262605968","created":"2024-09-12T02:37:14.139566+0000","modified":"2024-09-12T03:04:07.631018+0000","last_up_change":"2024-09-12T02:44:37.774835+0000","last_in_change":"2024-09-12T02:44:16.028970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:40:35.157621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:45:31.022530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:45:34.131637+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":118,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:45:43.992286+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":118,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a61ecdc1-ceb9-43cb-a67d-b197888cca42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6803","nonce":2278662522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6805","nonce":2278662522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6809","nonce":2278662522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2278662522},{"type":"v1","addr":"172.21.15.18:6807","nonce":2278662522}]},"public_addr":"172.21.15.18:6803/2278662522","cluster_addr":"172.21.15.18:6805/2278662522","heartbeat_back_addr":"172.21.15.18:6809/2278662522","heartbeat_front_addr":"172.21.15.18:6807/2278662522","state":["exists","up"]},{"osd":1,"uuid":"1b84f4be-23ce-466c-b974-b9851521785d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6801","nonce":3139630617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6803","nonce":3139630617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6807","nonce":3139630617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3139630617},{"type":"v1","addr":"172.21.15.62:6805","nonce":3139630617}]},"public_addr":"172.21.15.62:6801/3139630617","cluster_addr":"172.21.15.62:6803/3139630617","heartbeat_back_addr":"172.21.15.62:6807/3139630617","heartbeat_front_addr":"172.21.15.62:6805/3139630617","state":["exists","up"]},{"osd":2,"uuid":"f7bdf028-db32-4d92-a039-bada37c3a146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6801","nonce":2704054654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6803","nonce":2704054654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6807","nonce":2704054654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2704054654},{"type":"v1","addr":"172.21.15.176:6805","nonce":2704054654}]},"public_addr":"172.21.15.176:6801/2704054654","cluster_addr":"172.21.15.176:6803/2704054654","heartbeat_back_addr":"172.21.15.176:6807/2704054654","heartbeat_front_addr":"172.21.15.176:6805/2704054654","state":["exists","up"]},{"osd":3,"uuid":"39c1fe9b-8bcb-486d-8ef6-1b3bb56f0357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6811","nonce":3378134261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6813","nonce":3378134261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6817","nonce":3378134261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3378134261},{"type":"v1","addr":"172.21.15.18:6815","nonce":3378134261}]},"public_addr":"172.21.15.18:6811/3378134261","cluster_addr":"172.21.15.18:6813/3378134261","heartbeat_back_addr":"172.21.15.18:6817/3378134261","heartbeat_front_addr":"172.21.15.18:6815/3378134261","state":["exists","up"]},{"osd":4,"uuid":"66a2c8a0-1a99-4c6d-b56a-f1f6c3199655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6809","nonce":1416302860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6811","nonce":1416302860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6815","nonce":1416302860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1416302860},{"type":"v1","addr":"172.21.15.62:6813","nonce":1416302860}]},"public_addr":"172.21.15.62:6809/1416302860","cluster_addr":"172.21.15.62:6811/1416302860","heartbeat_back_addr":"172.21.15.62:6815/1416302860","heartbeat_front_addr":"172.21.15.62:6813/1416302860","state":["exists","up"]},{"osd":5,"uuid":"c4070ecf-703a-4f5f-9a2b-63473ff7f98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6809","nonce":2234269387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6811","nonce":2234269387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6815","nonce":2234269387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2234269387},{"type":"v1","addr":"172.21.15.176:6813","nonce":2234269387}]},"public_addr":"172.21.15.176:6809/2234269387","cluster_addr":"172.21.15.176:6811/2234269387","heartbeat_back_addr":"172.21.15.176:6815/2234269387","heartbeat_front_addr":"172.21.15.176:6813/2234269387","state":["exists","up"]},{"osd":6,"uuid":"12a08874-041e-4734-bc33-68ebfce97b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6819","nonce":3613955982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6821","nonce":3613955982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6825","nonce":3613955982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3613955982},{"type":"v1","addr":"172.21.15.18:6823","nonce":3613955982}]},"public_addr":"172.21.15.18:6819/3613955982","cluster_addr":"172.21.15.18:6821/3613955982","heartbeat_back_addr":"172.21.15.18:6825/3613955982","heartbeat_front_addr":"172.21.15.18:6823/3613955982","state":["exists","up"]},{"osd":7,"uuid":"86a5b47c-143f-4848-892f-c7b6a17a2799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6817","nonce":750933013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6819","nonce":750933013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6823","nonce":750933013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":750933013},{"type":"v1","addr":"172.21.15.62:6821","nonce":750933013}]},"public_addr":"172.21.15.62:6817/750933013","cluster_addr":"172.21.15.62:6819/750933013","heartbeat_back_addr":"172.21.15.62:6823/750933013","heartbeat_front_addr":"172.21.15.62:6821/750933013","state":["exists","up"]},{"osd":8,"uuid":"0426a455-ed11-4d6a-8e1d-c8aa2ee65cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6817","nonce":8496953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6819","nonce":8496953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6823","nonce":8496953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":8496953},{"type":"v1","addr":"172.21.15.176:6821","nonce":8496953}]},"public_addr":"172.21.15.176:6817/8496953","cluster_addr":"172.21.15.176:6819/8496953","heartbeat_back_addr":"172.21.15.176:6823/8496953","heartbeat_front_addr":"172.21.15.176:6821/8496953","state":["exists","up"]},{"osd":9,"uuid":"241aa2cf-0765-465d-b400-4911e653412a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6827","nonce":422514390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6829","nonce":422514390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6833","nonce":422514390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":422514390},{"type":"v1","addr":"172.21.15.18:6831","nonce":422514390}]},"public_addr":"172.21.15.18:6827/422514390","cluster_addr":"172.21.15.18:6829/422514390","heartbeat_back_addr":"172.21.15.18:6833/422514390","heartbeat_front_addr":"172.21.15.18:6831/422514390","state":["exists","up"]},{"osd":10,"uuid":"b1d4ab1f-0ec4-4641-bab0-f39d15857615","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6825","nonce":269877918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6827","nonce":269877918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6831","nonce":269877918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":269877918},{"type":"v1","addr":"172.21.15.62:6829","nonce":269877918}]},"public_addr":"172.21.15.62:6825/269877918","cluster_addr":"172.21.15.62:6827/269877918","heartbeat_back_addr":"172.21.15.62:6831/269877918","heartbeat_front_addr":"172.21.15.62:6829/269877918","state":["exists","up"]},{"osd":11,"uuid":"d122f1bf-bd4f-45d5-b07c-7301b005977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6825","nonce":770358485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6827","nonce":770358485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6831","nonce":770358485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":770358485},{"type":"v1","addr":"172.21.15.176:6829","nonce":770358485}]},"public_addr":"172.21.15.176:6825/770358485","cluster_addr":"172.21.15.176:6827/770358485","heartbeat_back_addr":"172.21.15.176:6831/770358485","heartbeat_front_addr":"172.21.15.176:6829/770358485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:39:42.435560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:09.100602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:40:32.884117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:01.733821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:29.812775+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:41:53.846503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:24.363464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:42:51.023614+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:15.782652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:43:45.378178+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:12.469173+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:44:36.303058+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":1,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.3","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/4167793150":"2024-09-13T02:48:42.970169+0000","172.21.15.18:6801/494888664":"2024-09-13T02:48:42.970169+0000","172.21.15.18:0/1531572357":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6800/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6801/601880715":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/3024661873":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6800/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/4191505851":"2024-09-13T02:48:42.970169+0000","172.21.15.18:0/1185819845":"2024-09-13T02:48:42.970169+0000","172.21.15.18:0/2429098892":"2024-09-13T02:37:40.790128+0000","172.21.15.18:6801/3271799053":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/4236556151":"2024-09-13T02:38:10.525951+0000","172.21.15.18:6800/494888664":"2024-09-13T02:48:42.970169+0000","172.21.15.18:0/1197309398":"2024-09-13T02:37:40.790128+0000","172.21.15.18:0/2679362143":"2024-09-13T02:38:10.525951+0000","172.21.15.18:0/880406453":"2024-09-13T02:48:42.970169+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":10,"length":1},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":17,"length":1},{"begin":19,"length":1},{"begin":21,"length":1},{"begin":23,"length":1},{"begin":25,"length":1},{"begin":27,"length":1}]},{"pool":4,"snaps":[{"begin":8,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":17,"length":1},{"begin":19,"length":1},{"begin":21,"length":1},{"begin":23,"length":1},{"begin":25,"length":1},{"begin":27,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]},{"pool":4,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:04:33.030 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:32 smithi176 ceph-mon[35713]: pgmap v496: 129 pgs: 63 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 46 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 852 B/s wr, 99 op/s 2024-09-12T03:04:33.030 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:32 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1352810237' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T03:04:33.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:32 smithi062 ceph-mon[35527]: pgmap v496: 129 pgs: 63 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 46 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 852 B/s wr, 99 op/s 2024-09-12T03:04:33.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:32 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1352810237' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T03:04:33.099 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:32 smithi018 ceph-mon[30616]: pgmap v496: 129 pgs: 63 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 46 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 852 B/s wr, 99 op/s 2024-09-12T03:04:33.099 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:32 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1352810237' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T03:04:33.700 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-12T03:04:34.413 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T03:04:34.880 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:34 smithi018 ceph-mon[30616]: pgmap v497: 129 pgs: 58 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 51 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 75 op/s 2024-09-12T03:04:35.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:34 smithi062 ceph-mon[35527]: pgmap v497: 129 pgs: 58 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 51 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 75 op/s 2024-09-12T03:04:35.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:34 smithi176 ceph-mon[35713]: pgmap v497: 129 pgs: 58 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 51 active+clean; 2.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 75 op/s 2024-09-12T03:04:35.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.286+0000 7ff934a00640 1 -- 172.21.15.18:0/1300606800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff930106f10 msgr2=0x7ff93010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:35.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.286+0000 7ff934a00640 1 --2- 172.21.15.18:0/1300606800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff930106f10 0x7ff93010ea90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff928009be0 tx=0x7ff92802a6f0 comp rx=0 tx=0).stop 2024-09-12T03:04:35.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.286+0000 7ff934a00640 1 -- 172.21.15.18:0/1300606800 shutdown_connections 2024-09-12T03:04:35.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.286+0000 7ff934a00640 1 --2- 172.21.15.18:0/1300606800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff930106f10 0x7ff93010ea90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:35.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.286+0000 7ff934a00640 1 --2- 172.21.15.18:0/1300606800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff930102790 0x7ff9301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:35.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.286+0000 7ff934a00640 1 --2- 172.21.15.18:0/1300606800 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff930101de0 0x7ff9301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:35.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.286+0000 7ff934a00640 1 -- 172.21.15.18:0/1300606800 >> 172.21.15.18:0/1300606800 conn(0x7ff9300fd8e0 msgr2=0x7ff9300ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:35.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.287+0000 7ff934a00640 1 -- 172.21.15.18:0/1300606800 shutdown_connections 2024-09-12T03:04:35.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.287+0000 7ff934a00640 1 -- 172.21.15.18:0/1300606800 wait complete. 2024-09-12T03:04:35.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.288+0000 7ff934a00640 1 Processor -- start 2024-09-12T03:04:35.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.289+0000 7ff934a00640 1 -- start start 2024-09-12T03:04:35.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.289+0000 7ff934a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff930101de0 0x7ff9301961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:35.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.289+0000 7ff934a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff930102790 0x7ff930196720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:35.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.289+0000 7ff934a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff930106f10 0x7ff93019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:35.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.289+0000 7ff934a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff93010fd60 con 0x7ff930101de0 2024-09-12T03:04:35.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.289+0000 7ff934a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff93010fbe0 con 0x7ff930102790 2024-09-12T03:04:35.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.289+0000 7ff934a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff93010fee0 con 0x7ff930106f10 2024-09-12T03:04:35.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.290+0000 7ff92e800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff930106f10 0x7ff93019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:35.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.290+0000 7ff92e800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff930106f10 0x7ff93019aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:35088/0 (socket says 172.21.15.18:35088) 2024-09-12T03:04:35.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.290+0000 7ff92e800640 1 -- 172.21.15.18:0/4072134033 learned_addr learned my addr 172.21.15.18:0/4072134033 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:04:35.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.291+0000 7ff92d400640 1 --2- 172.21.15.18:0/4072134033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff930102790 0x7ff930196720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:35.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.291+0000 7ff92e800640 1 -- 172.21.15.18:0/4072134033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff930102790 msgr2=0x7ff930196720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:35.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.291+0000 7ff92e800640 1 --2- 172.21.15.18:0/4072134033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff930102790 0x7ff930196720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:35.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.291+0000 7ff92e800640 1 -- 172.21.15.18:0/4072134033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff930101de0 msgr2=0x7ff9301961e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:35.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.291+0000 7ff92e800640 1 --2- 172.21.15.18:0/4072134033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff930101de0 0x7ff9301961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:35.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.291+0000 7ff92e800640 1 -- 172.21.15.18:0/4072134033 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93019b1b0 con 0x7ff930106f10 2024-09-12T03:04:35.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.292+0000 7ff92e800640 1 --2- 172.21.15.18:0/4072134033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff930106f10 0x7ff93019aab0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff928006010 tx=0x7ff928003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:35.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.293+0000 7ff926a00640 1 -- 172.21.15.18:0/4072134033 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff928041020 con 0x7ff930106f10 2024-09-12T03:04:35.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.293+0000 7ff926a00640 1 -- 172.21.15.18:0/4072134033 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff928031920 con 0x7ff930106f10 2024-09-12T03:04:35.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.293+0000 7ff926a00640 1 -- 172.21.15.18:0/4072134033 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff928036040 con 0x7ff930106f10 2024-09-12T03:04:35.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.294+0000 7ff934a00640 1 -- 172.21.15.18:0/4072134033 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff93019b440 con 0x7ff930106f10 2024-09-12T03:04:35.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.295+0000 7ff934a00640 1 -- 172.21.15.18:0/4072134033 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff93019b8d0 con 0x7ff930106f10 2024-09-12T03:04:35.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.297+0000 7ff934a00640 1 -- 172.21.15.18:0/4072134033 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9301021c0 con 0x7ff930106f10 2024-09-12T03:04:35.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.302+0000 7ff926a00640 1 -- 172.21.15.18:0/4072134033 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7ff928044020 con 0x7ff930106f10 2024-09-12T03:04:35.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.304+0000 7ff926a00640 1 --2- 172.21.15.18:0/4072134033 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff9140a7250 0x7ff9140a9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:35.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.305+0000 7ff926a00640 1 -- 172.21.15.18:0/4072134033 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9890+0+0 (secure 0 0 0) 0x7ff9280b87e0 con 0x7ff930106f10 2024-09-12T03:04:35.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.306+0000 7ff92de00640 1 --2- 172.21.15.18:0/4072134033 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff9140a7250 0x7ff9140a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:35.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.308+0000 7ff92de00640 1 --2- 172.21.15.18:0/4072134033 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff9140a7250 0x7ff9140a9710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff920005fd0 tx=0x7ff920005850 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:35.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.314+0000 7ff926a00640 1 -- 172.21.15.18:0/4072134033 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff92804b070 con 0x7ff930106f10 2024-09-12T03:04:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.752+0000 7ff934a00640 1 -- 172.21.15.18:0/4072134033 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff930109bc0 con 0x7ff930106f10 2024-09-12T03:04:35.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.777+0000 7ff926a00640 1 -- 172.21.15.18:0/4072134033 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) ==== 161+0+0 (secure 0 0 0) 0x7ff9280bc870 con 0x7ff930106f10 2024-09-12T03:04:35.786 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T03:04:35.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.784+0000 7ff934a00640 1 -- 172.21.15.18:0/4072134033 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff9140a7250 msgr2=0x7ff9140a9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:35.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.784+0000 7ff934a00640 1 --2- 172.21.15.18:0/4072134033 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff9140a7250 0x7ff9140a9710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff920005fd0 tx=0x7ff920005850 comp rx=0 tx=0).stop 2024-09-12T03:04:35.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.784+0000 7ff934a00640 1 -- 172.21.15.18:0/4072134033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff930106f10 msgr2=0x7ff93019aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:35.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.784+0000 7ff934a00640 1 --2- 172.21.15.18:0/4072134033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff930106f10 0x7ff93019aab0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff928006010 tx=0x7ff928003f10 comp rx=0 tx=0).stop 2024-09-12T03:04:35.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.785+0000 7ff934a00640 1 -- 172.21.15.18:0/4072134033 shutdown_connections 2024-09-12T03:04:35.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.785+0000 7ff934a00640 1 --2- 172.21.15.18:0/4072134033 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7ff9140a7250 0x7ff9140a9710 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:35.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.785+0000 7ff934a00640 1 --2- 172.21.15.18:0/4072134033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff930106f10 0x7ff93019aab0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:35.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.785+0000 7ff934a00640 1 --2- 172.21.15.18:0/4072134033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff930102790 0x7ff930196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:35.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.785+0000 7ff934a00640 1 --2- 172.21.15.18:0/4072134033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff930101de0 0x7ff9301961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:35.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.785+0000 7ff934a00640 1 -- 172.21.15.18:0/4072134033 >> 172.21.15.18:0/4072134033 conn(0x7ff9300fd8e0 msgr2=0x7ff9300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:35.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.786+0000 7ff934a00640 1 -- 172.21.15.18:0/4072134033 shutdown_connections 2024-09-12T03:04:35.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:35.786+0000 7ff934a00640 1 -- 172.21.15.18:0/4072134033 wait complete. 2024-09-12T03:04:36.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:35 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a[30612]: 2024-09-12T03:04:35.754+0000 7f9e67800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T03:04:36.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:35 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/4072134033' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T03:04:36.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:35 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T03:04:36.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:35 smithi018 ceph-mon[30616]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T03:04:36.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:35 smithi018 ceph-mon[30616]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T03:04:36.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:35 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T03:04:36.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:35 smithi018 ceph-mon[30616]: osdmap e119: 12 total, 12 up, 12 in 2024-09-12T03:04:36.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:35 smithi018 ceph-mon[30616]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T03:04:36.229 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-f[65788]: ignoring --setuser ceph since I am not root 2024-09-12T03:04:36.229 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-f[65788]: ignoring --setgroup ceph since I am not root 2024-09-12T03:04:36.229 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-f[65788]: starting mds.f at 2024-09-12T03:04:36.229 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-l[65483]: ignoring --setuser ceph since I am not root 2024-09-12T03:04:36.229 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-l[65483]: ignoring --setgroup ceph since I am not root 2024-09-12T03:04:36.230 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-mds[65487]: -- 172.21.15.176:0/1685168178 <== mon.2 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55682d449860 con 0x55682d427400 2024-09-12T03:04:36.230 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-l[65483]: starting mds.l at 2024-09-12T03:04:36.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/4072134033' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T03:04:36.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T03:04:36.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-mon[35713]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T03:04:36.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-mon[35713]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T03:04:36.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T03:04:36.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-mon[35713]: osdmap e119: 12 total, 12 up, 12 in 2024-09-12T03:04:36.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-mon[35713]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T03:04:36.231 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-i[66392]: ignoring --setuser ceph since I am not root 2024-09-12T03:04:36.231 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-i[66392]: ignoring --setgroup ceph since I am not root 2024-09-12T03:04:36.231 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-i[66392]: starting mds.i at 2024-09-12T03:04:36.231 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-c[66093]: ignoring --setuser ceph since I am not root 2024-09-12T03:04:36.231 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-c[66093]: ignoring --setgroup ceph since I am not root 2024-09-12T03:04:36.231 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 03:04:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-c[66093]: starting mds.c at 2024-09-12T03:04:36.283 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-b[65969]: ignoring --setuser ceph since I am not root 2024-09-12T03:04:36.283 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-b[65969]: ignoring --setgroup ceph since I am not root 2024-09-12T03:04:36.283 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-b[65969]: starting mds.b at 2024-09-12T03:04:36.284 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-h[65667]: ignoring --setuser ceph since I am not root 2024-09-12T03:04:36.284 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-h[65667]: ignoring --setgroup ceph since I am not root 2024-09-12T03:04:36.284 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-h[65667]: starting mds.h at 2024-09-12T03:04:36.284 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-k[65046]: ignoring --setuser ceph since I am not root 2024-09-12T03:04:36.284 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-k[65046]: ignoring --setgroup ceph since I am not root 2024-09-12T03:04:36.284 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-k[65046]: starting mds.k at 2024-09-12T03:04:36.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/4072134033' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T03:04:36.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T03:04:36.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-mon[35527]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T03:04:36.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-mon[35527]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T03:04:36.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T03:04:36.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-mon[35527]: osdmap e119: 12 total, 12 up, 12 in 2024-09-12T03:04:36.285 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-mon[35527]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T03:04:36.285 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-e[65366]: ignoring --setuser ceph since I am not root 2024-09-12T03:04:36.285 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-e[65366]: ignoring --setgroup ceph since I am not root 2024-09-12T03:04:36.286 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 03:04:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-e[65366]: starting mds.e at 2024-09-12T03:04:36.386 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 03:04:36 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-j[69791]: ignoring --setuser ceph since I am not root 2024-09-12T03:04:36.386 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 03:04:36 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-j[69791]: ignoring --setgroup ceph since I am not root 2024-09-12T03:04:36.386 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 03:04:36 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-j[69791]: starting mds.j at 2024-09-12T03:04:36.387 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 03:04:36 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-a[71320]: ignoring --setuser ceph since I am not root 2024-09-12T03:04:36.387 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 03:04:36 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-a[71320]: ignoring --setgroup ceph since I am not root 2024-09-12T03:04:36.387 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 03:04:36 smithi018 ceph-mds[71324]: -- 172.21.15.18:0/4193129178 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56034d3e1860 con 0x56034d3bf000 2024-09-12T03:04:36.387 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 03:04:36 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-a[71320]: starting mds.a at 2024-09-12T03:04:36.942 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T03:04:37.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:36 smithi018 ceph-mon[30616]: pgmap v498: 129 pgs: 58 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 51 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 76 op/s 2024-09-12T03:04:37.185 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:36 smithi062 ceph-mon[35527]: pgmap v498: 129 pgs: 58 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 51 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 76 op/s 2024-09-12T03:04:37.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:36 smithi176 ceph-mon[35713]: pgmap v498: 129 pgs: 58 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 51 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 76 op/s 2024-09-12T03:04:37.658 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T03:04:38.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.176:6832/2964463425,v1:172.21.15.176:6833/2964463425] up:boot 2024-09-12T03:04:38.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.176:6834/3665319304,v1:172.21.15.176:6836/3665319304] up:boot 2024-09-12T03:04:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.176:6835/82867066,v1:172.21.15.176:6837/82867066] up:boot 2024-09-12T03:04:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.62:6832/1721243273,v1:172.21.15.62:6833/1721243273] up:boot 2024-09-12T03:04:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.176:6838/862019960,v1:172.21.15.176:6839/862019960] up:boot 2024-09-12T03:04:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.62:6838/3541130646,v1:172.21.15.62:6839/3541130646] up:boot 2024-09-12T03:04:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.62:6834/1867531584,v1:172.21.15.62:6835/1867531584] up:boot 2024-09-12T03:04:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.62:6836/2066596719,v1:172.21.15.62:6837/2066596719] up:boot 2024-09-12T03:04:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.18:6834/507721587,v1:172.21.15.18:6835/507721587] up:boot 2024-09-12T03:04:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: mds.? [v2:172.21.15.18:6840/1829736204,v1:172.21.15.18:6841/1829736204] up:boot 2024-09-12T03:04:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T03:04:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T03:04:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T03:04:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T03:04:38.102 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T03:04:38.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T03:04:38.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T03:04:38.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T03:04:38.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T03:04:38.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T03:04:38.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:37 smithi018 ceph-mon[30616]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T03:04:38.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.176:6832/2964463425,v1:172.21.15.176:6833/2964463425] up:boot 2024-09-12T03:04:38.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.176:6834/3665319304,v1:172.21.15.176:6836/3665319304] up:boot 2024-09-12T03:04:38.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.176:6835/82867066,v1:172.21.15.176:6837/82867066] up:boot 2024-09-12T03:04:38.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.62:6832/1721243273,v1:172.21.15.62:6833/1721243273] up:boot 2024-09-12T03:04:38.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.176:6838/862019960,v1:172.21.15.176:6839/862019960] up:boot 2024-09-12T03:04:38.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.62:6838/3541130646,v1:172.21.15.62:6839/3541130646] up:boot 2024-09-12T03:04:38.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.62:6834/1867531584,v1:172.21.15.62:6835/1867531584] up:boot 2024-09-12T03:04:38.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.62:6836/2066596719,v1:172.21.15.62:6837/2066596719] up:boot 2024-09-12T03:04:38.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.18:6834/507721587,v1:172.21.15.18:6835/507721587] up:boot 2024-09-12T03:04:38.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: mds.? [v2:172.21.15.18:6840/1829736204,v1:172.21.15.18:6841/1829736204] up:boot 2024-09-12T03:04:38.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T03:04:38.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T03:04:38.200 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T03:04:38.200 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T03:04:38.200 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T03:04:38.200 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T03:04:38.200 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T03:04:38.200 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T03:04:38.200 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T03:04:38.200 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T03:04:38.200 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:37 smithi062 ceph-mon[35527]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T03:04:38.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.176:6832/2964463425,v1:172.21.15.176:6833/2964463425] up:boot 2024-09-12T03:04:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.176:6834/3665319304,v1:172.21.15.176:6836/3665319304] up:boot 2024-09-12T03:04:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.176:6835/82867066,v1:172.21.15.176:6837/82867066] up:boot 2024-09-12T03:04:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.62:6832/1721243273,v1:172.21.15.62:6833/1721243273] up:boot 2024-09-12T03:04:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.176:6838/862019960,v1:172.21.15.176:6839/862019960] up:boot 2024-09-12T03:04:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.62:6838/3541130646,v1:172.21.15.62:6839/3541130646] up:boot 2024-09-12T03:04:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.62:6834/1867531584,v1:172.21.15.62:6835/1867531584] up:boot 2024-09-12T03:04:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.62:6836/2066596719,v1:172.21.15.62:6837/2066596719] up:boot 2024-09-12T03:04:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.18:6834/507721587,v1:172.21.15.18:6835/507721587] up:boot 2024-09-12T03:04:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: mds.? [v2:172.21.15.18:6840/1829736204,v1:172.21.15.18:6841/1829736204] up:boot 2024-09-12T03:04:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T03:04:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T03:04:38.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T03:04:38.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T03:04:38.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T03:04:38.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T03:04:38.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T03:04:38.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T03:04:38.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T03:04:38.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T03:04:38.230 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:37 smithi176 ceph-mon[35713]: from='mgr.25213 172.21.15.18:0/1396522008' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T03:04:38.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.633+0000 7fea6b400640 1 -- 172.21.15.18:0/916772589 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea64109b10 msgr2=0x7fea64116960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:38.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.633+0000 7fea6b400640 1 --2- 172.21.15.18:0/916772589 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea64109b10 0x7fea64116960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fea58013150 tx=0x7fea58032780 comp rx=0 tx=0).stop 2024-09-12T03:04:38.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.634+0000 7fea6b400640 1 -- 172.21.15.18:0/916772589 shutdown_connections 2024-09-12T03:04:38.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.634+0000 7fea6b400640 1 --2- 172.21.15.18:0/916772589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea64116ea0 0x7fea64119290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:38.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.634+0000 7fea6b400640 1 --2- 172.21.15.18:0/916772589 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea64109b10 0x7fea64116960 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:38.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.634+0000 7fea6b400640 1 --2- 172.21.15.18:0/916772589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea641091f0 0x7fea641095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:38.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.634+0000 7fea6b400640 1 -- 172.21.15.18:0/916772589 >> 172.21.15.18:0/916772589 conn(0x7fea6406e140 msgr2=0x7fea6406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:38.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.636+0000 7fea6b400640 1 -- 172.21.15.18:0/916772589 shutdown_connections 2024-09-12T03:04:38.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.638+0000 7fea6b400640 1 -- 172.21.15.18:0/916772589 wait complete. 2024-09-12T03:04:38.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.639+0000 7fea6b400640 1 Processor -- start 2024-09-12T03:04:38.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.639+0000 7fea6b400640 1 -- start start 2024-09-12T03:04:38.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.640+0000 7fea6b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea641091f0 0x7fea641a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:38.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.640+0000 7fea6b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea64109b10 0x7fea641a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:38.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.640+0000 7fea6b400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea64116ea0 0x7fea6419ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:38.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.640+0000 7fea6b400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fea6410efd0 con 0x7fea641091f0 2024-09-12T03:04:38.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.640+0000 7fea6b400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fea6410ee50 con 0x7fea64109b10 2024-09-12T03:04:38.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.640+0000 7fea6b400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fea6410f150 con 0x7fea64116ea0 2024-09-12T03:04:38.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.640+0000 7fea69400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea64116ea0 0x7fea6419ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:38.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.640+0000 7fea69400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea64116ea0 0x7fea6419ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:35142/0 (socket says 172.21.15.18:35142) 2024-09-12T03:04:38.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.640+0000 7fea69400640 1 -- 172.21.15.18:0/2103909346 learned_addr learned my addr 172.21.15.18:0/2103909346 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:04:38.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.640+0000 7fea68a00640 1 --2- 172.21.15.18:0/2103909346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea641091f0 0x7fea641a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:38.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.641+0000 7fea63e00640 1 --2- 172.21.15.18:0/2103909346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea64109b10 0x7fea641a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:38.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.641+0000 7fea69400640 1 -- 172.21.15.18:0/2103909346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea64109b10 msgr2=0x7fea641a4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:38.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.641+0000 7fea69400640 1 --2- 172.21.15.18:0/2103909346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea64109b10 0x7fea641a4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:38.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.641+0000 7fea69400640 1 -- 172.21.15.18:0/2103909346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea641091f0 msgr2=0x7fea641a47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:38.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.641+0000 7fea69400640 1 --2- 172.21.15.18:0/2103909346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea641091f0 0x7fea641a47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:38.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.641+0000 7fea69400640 1 -- 172.21.15.18:0/2103909346 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6419f460 con 0x7fea64116ea0 2024-09-12T03:04:38.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.641+0000 7fea63e00640 1 --2- 172.21.15.18:0/2103909346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea64109b10 0x7fea641a4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:04:38.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.641+0000 7fea69400640 1 --2- 172.21.15.18:0/2103909346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea64116ea0 0x7fea6419ed30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00b9e0 tx=0x7fea5c00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:38.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.642+0000 7fea61600640 1 -- 172.21.15.18:0/2103909346 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c019070 con 0x7fea64116ea0 2024-09-12T03:04:38.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.642+0000 7fea61600640 1 -- 172.21.15.18:0/2103909346 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea5c014440 con 0x7fea64116ea0 2024-09-12T03:04:38.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.642+0000 7fea6b400640 1 -- 172.21.15.18:0/2103909346 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea6419f750 con 0x7fea64116ea0 2024-09-12T03:04:38.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.642+0000 7fea6b400640 1 -- 172.21.15.18:0/2103909346 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea641bc690 con 0x7fea64116ea0 2024-09-12T03:04:38.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.643+0000 7fea61600640 1 -- 172.21.15.18:0/2103909346 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c0125e0 con 0x7fea64116ea0 2024-09-12T03:04:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.645+0000 7fea6b400640 1 -- 172.21.15.18:0/2103909346 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea641095d0 con 0x7fea64116ea0 2024-09-12T03:04:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.649+0000 7fea61600640 1 -- 172.21.15.18:0/2103909346 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fea5c01c070 con 0x7fea64116ea0 2024-09-12T03:04:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.652+0000 7fea61600640 1 --2- 172.21.15.18:0/2103909346 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fea4c0a2df0 0x7fea4c0a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.652+0000 7fea61600640 1 -- 172.21.15.18:0/2103909346 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 10232+0+0 (secure 0 0 0) 0x7fea5c0cf040 con 0x7fea64116ea0 2024-09-12T03:04:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.652+0000 7fea68a00640 1 --2- 172.21.15.18:0/2103909346 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fea4c0a2df0 0x7fea4c0a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.654+0000 7fea68a00640 1 --2- 172.21.15.18:0/2103909346 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fea4c0a2df0 0x7fea4c0a52b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fea50006fd0 tx=0x7fea50008040 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:38.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:38.655+0000 7fea61600640 1 -- 172.21.15.18:0/2103909346 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea5c09b660 con 0x7fea64116ea0 2024-09-12T03:04:39.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:39.099+0000 7fea6b400640 1 -- 172.21.15.18:0/2103909346 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fea64110ed0 con 0x7fea64116ea0 2024-09-12T03:04:39.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:38 smithi176 ceph-mon[35713]: pgmap v500: 129 pgs: 58 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 51 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 41 op/s 2024-09-12T03:04:39.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:38 smithi062 ceph-mon[35527]: pgmap v500: 129 pgs: 58 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 51 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 41 op/s 2024-09-12T03:04:39.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:38 smithi018 ceph-mon[30616]: pgmap v500: 129 pgs: 58 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 51 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 41 op/s 2024-09-12T03:04:39.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:39.879+0000 7fea61600640 1 -- 172.21.15.18:0/2103909346 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v81) ==== 104+0+0 (secure 0 0 0) 0x7fea5c09af60 con 0x7fea64116ea0 2024-09-12T03:04:39.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:39.883+0000 7fea6b400640 1 -- 172.21.15.18:0/2103909346 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fea4c0a2df0 msgr2=0x7fea4c0a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:39.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:39.883+0000 7fea6b400640 1 --2- 172.21.15.18:0/2103909346 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fea4c0a2df0 0x7fea4c0a52b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fea50006fd0 tx=0x7fea50008040 comp rx=0 tx=0).stop 2024-09-12T03:04:39.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:39.883+0000 7fea6b400640 1 -- 172.21.15.18:0/2103909346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea64116ea0 msgr2=0x7fea6419ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:39.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:39.883+0000 7fea6b400640 1 --2- 172.21.15.18:0/2103909346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea64116ea0 0x7fea6419ed30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00b9e0 tx=0x7fea5c00bea0 comp rx=0 tx=0).stop 2024-09-12T03:04:39.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:39.883+0000 7fea6b400640 1 -- 172.21.15.18:0/2103909346 shutdown_connections 2024-09-12T03:04:39.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:39.883+0000 7fea6b400640 1 --2- 172.21.15.18:0/2103909346 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7fea4c0a2df0 0x7fea4c0a52b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:39.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:39.883+0000 7fea6b400640 1 --2- 172.21.15.18:0/2103909346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea64116ea0 0x7fea6419ed30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:39.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:39.883+0000 7fea6b400640 1 --2- 172.21.15.18:0/2103909346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea64109b10 0x7fea641a4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:39.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:39.883+0000 7fea6b400640 1 --2- 172.21.15.18:0/2103909346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea641091f0 0x7fea641a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:39.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:39.883+0000 7fea6b400640 1 -- 172.21.15.18:0/2103909346 >> 172.21.15.18:0/2103909346 conn(0x7fea6406e140 msgr2=0x7fea64117460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:39.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:39.886+0000 7fea6b400640 1 -- 172.21.15.18:0/2103909346 shutdown_connections 2024-09-12T03:04:39.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:39.886+0000 7fea6b400640 1 -- 172.21.15.18:0/2103909346 wait complete. 2024-09-12T03:04:40.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:39 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/2103909346' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T03:04:40.159 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:39 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T03:04:40.174 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:39 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/2103909346' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T03:04:40.174 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:39 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T03:04:40.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:39 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/2103909346' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T03:04:40.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:39 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T03:04:41.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:40 smithi176 ceph-mon[35713]: pgmap v501: 129 pgs: 58 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 51 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 102 B/s wr, 29 op/s 2024-09-12T03:04:41.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:40 smithi176 ceph-mon[35713]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T03:04:41.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:40 smithi176 ceph-mon[35713]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T03:04:41.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:40 smithi176 ceph-mon[35713]: Cluster is now healthy 2024-09-12T03:04:41.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:40 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T03:04:41.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:40 smithi176 ceph-mon[35713]: fsmap 12 up:standby 2024-09-12T03:04:41.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:40 smithi062 ceph-mon[35527]: pgmap v501: 129 pgs: 58 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 51 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 102 B/s wr, 29 op/s 2024-09-12T03:04:41.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:40 smithi062 ceph-mon[35527]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T03:04:41.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:40 smithi062 ceph-mon[35527]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T03:04:41.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:40 smithi062 ceph-mon[35527]: Cluster is now healthy 2024-09-12T03:04:41.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:40 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T03:04:41.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:40 smithi062 ceph-mon[35527]: fsmap 12 up:standby 2024-09-12T03:04:41.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:40 smithi018 ceph-mon[30616]: pgmap v501: 129 pgs: 58 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 51 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 102 B/s wr, 29 op/s 2024-09-12T03:04:41.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:40 smithi018 ceph-mon[30616]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T03:04:41.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:40 smithi018 ceph-mon[30616]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T03:04:41.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:40 smithi018 ceph-mon[30616]: Cluster is now healthy 2024-09-12T03:04:41.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:40 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T03:04:41.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:40 smithi018 ceph-mon[30616]: fsmap 12 up:standby 2024-09-12T03:04:41.632 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T03:04:42.368 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T03:04:43.092 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:42 smithi018 ceph-mon[30616]: pgmap v502: 129 pgs: 58 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 51 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-12T03:04:43.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:42 smithi176 ceph-mon[35713]: pgmap v502: 129 pgs: 58 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 51 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-12T03:04:43.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.250+0000 7f09a6200640 1 -- 172.21.15.18:0/3244130475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09a011b210 msgr2=0x7f09a011d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:43.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.250+0000 7f09a6200640 1 --2- 172.21.15.18:0/3244130475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09a011b210 0x7f09a011d600 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0998009ca0 tx=0x7f099802a980 comp rx=0 tx=0).stop 2024-09-12T03:04:43.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.251+0000 7f09a6200640 1 -- 172.21.15.18:0/3244130475 shutdown_connections 2024-09-12T03:04:43.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.251+0000 7f09a6200640 1 --2- 172.21.15.18:0/3244130475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09a011b210 0x7f09a011d600 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:43.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.251+0000 7f09a6200640 1 --2- 172.21.15.18:0/3244130475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09a007af30 0x7f09a007b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:43.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.251+0000 7f09a6200640 1 --2- 172.21.15.18:0/3244130475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09a0082c00 0x7f09a007a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:43.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.251+0000 7f09a6200640 1 -- 172.21.15.18:0/3244130475 >> 172.21.15.18:0/3244130475 conn(0x7f09a0077ba0 msgr2=0x7f09a0079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:43.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.251+0000 7f09a6200640 1 -- 172.21.15.18:0/3244130475 shutdown_connections 2024-09-12T03:04:43.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.252+0000 7f09a6200640 1 -- 172.21.15.18:0/3244130475 wait complete. 2024-09-12T03:04:43.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.253+0000 7f09a6200640 1 Processor -- start 2024-09-12T03:04:43.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.253+0000 7f09a6200640 1 -- start start 2024-09-12T03:04:43.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.254+0000 7f09a6200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09a007af30 0x7f09a01a7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:43.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.254+0000 7f09a6200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09a0082c00 0x7f09a01a77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:43.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.254+0000 7f09a6200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09a011b210 0x7f09a01abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:43.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.254+0000 7f09a6200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f09a0120e50 con 0x7f09a0082c00 2024-09-12T03:04:43.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.254+0000 7f099f400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09a007af30 0x7f09a01a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:43.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.254+0000 7f099f400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09a007af30 0x7f09a01a7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.18:35156/0 (socket says 172.21.15.18:35156) 2024-09-12T03:04:43.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.254+0000 7f099f400640 1 -- 172.21.15.18:0/1011510667 learned_addr learned my addr 172.21.15.18:0/1011510667 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:04:43.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.254+0000 7f09a6200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f09a0120cd0 con 0x7f09a011b210 2024-09-12T03:04:43.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.255+0000 7f09a6200640 1 -- 172.21.15.18:0/1011510667 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f09a0120fd0 con 0x7f09a007af30 2024-09-12T03:04:43.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.255+0000 7f099ea00640 1 --2- 172.21.15.18:0/1011510667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09a0082c00 0x7f09a01a77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:43.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.255+0000 7f099fe00640 1 --2- 172.21.15.18:0/1011510667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09a011b210 0x7f09a01abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:43.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.255+0000 7f099f400640 1 -- 172.21.15.18:0/1011510667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09a011b210 msgr2=0x7f09a01abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:43.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.255+0000 7f099f400640 1 --2- 172.21.15.18:0/1011510667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09a011b210 0x7f09a01abb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:43.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.255+0000 7f099f400640 1 -- 172.21.15.18:0/1011510667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09a0082c00 msgr2=0x7f09a01a77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:43.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.255+0000 7f099f400640 1 --2- 172.21.15.18:0/1011510667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09a0082c00 0x7f09a01a77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:43.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.255+0000 7f099f400640 1 -- 172.21.15.18:0/1011510667 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a01ac240 con 0x7f09a007af30 2024-09-12T03:04:43.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.256+0000 7f099f400640 1 --2- 172.21.15.18:0/1011510667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09a007af30 0x7f09a01a7290 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f099000d950 tx=0x7f099000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:43.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.256+0000 7f0997e00640 1 -- 172.21.15.18:0/1011510667 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0990017070 con 0x7f09a007af30 2024-09-12T03:04:43.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.256+0000 7f09a6200640 1 -- 172.21.15.18:0/1011510667 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a01ac530 con 0x7f09a007af30 2024-09-12T03:04:43.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.257+0000 7f09a6200640 1 -- 172.21.15.18:0/1011510667 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a01b3e10 con 0x7f09a007af30 2024-09-12T03:04:43.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.257+0000 7f0997e00640 1 -- 172.21.15.18:0/1011510667 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0990009c30 con 0x7f09a007af30 2024-09-12T03:04:43.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.257+0000 7f0997e00640 1 -- 172.21.15.18:0/1011510667 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099000f6b0 con 0x7f09a007af30 2024-09-12T03:04:43.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.261+0000 7f0995600640 1 -- 172.21.15.18:0/1011510667 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09a007b370 con 0x7f09a007af30 2024-09-12T03:04:43.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.268+0000 7f0997e00640 1 -- 172.21.15.18:0/1011510667 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f09900109d0 con 0x7f09a007af30 2024-09-12T03:04:43.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.270+0000 7f0997e00640 1 --2- 172.21.15.18:0/1011510667 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f09840a2d70 0x7f09840a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:43.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.271+0000 7f0997e00640 1 -- 172.21.15.18:0/1011510667 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 10232+0+0 (secure 0 0 0) 0x7f0990099430 con 0x7f09a007af30 2024-09-12T03:04:43.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.272+0000 7f099ea00640 1 --2- 172.21.15.18:0/1011510667 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f09840a2d70 0x7f09840a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:43.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.272+0000 7f0997e00640 1 -- 172.21.15.18:0/1011510667 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0990009de0 con 0x7f09a007af30 2024-09-12T03:04:43.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.273+0000 7f099ea00640 1 --2- 172.21.15.18:0/1011510667 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f09840a2d70 0x7f09840a5230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f098c006fd0 tx=0x7f098c008040 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:43.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:42 smithi062 ceph-mon[35527]: pgmap v502: 129 pgs: 58 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 51 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-12T03:04:43.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.652+0000 7f0995600640 1 -- 172.21.15.18:0/1011510667 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f09a01a85f0 con 0x7f09a007af30 2024-09-12T03:04:43.852 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 03:04:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T03:04:43.546+0000 7fea77000640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-12T03:04:43.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.888+0000 7f0997e00640 1 -- 172.21.15.18:0/1011510667 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) ==== 181+0+0 (secure 0 0 0) 0x7f099009ba90 con 0x7f09a007af30 2024-09-12T03:04:43.889 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-09-12T03:04:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.893+0000 7f0995600640 1 -- 172.21.15.18:0/1011510667 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f09840a2d70 msgr2=0x7f09840a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.893+0000 7f0995600640 1 --2- 172.21.15.18:0/1011510667 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f09840a2d70 0x7f09840a5230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f098c006fd0 tx=0x7f098c008040 comp rx=0 tx=0).stop 2024-09-12T03:04:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.893+0000 7f0995600640 1 -- 172.21.15.18:0/1011510667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09a007af30 msgr2=0x7f09a01a7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.893+0000 7f0995600640 1 --2- 172.21.15.18:0/1011510667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09a007af30 0x7f09a01a7290 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f099000d950 tx=0x7f099000de10 comp rx=0 tx=0).stop 2024-09-12T03:04:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.893+0000 7f0995600640 1 -- 172.21.15.18:0/1011510667 shutdown_connections 2024-09-12T03:04:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.893+0000 7f0995600640 1 --2- 172.21.15.18:0/1011510667 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f09840a2d70 0x7f09840a5230 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.893+0000 7f0995600640 1 --2- 172.21.15.18:0/1011510667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09a011b210 0x7f09a01abb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.893+0000 7f0995600640 1 --2- 172.21.15.18:0/1011510667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09a0082c00 0x7f09a01a77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.893+0000 7f0995600640 1 --2- 172.21.15.18:0/1011510667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09a007af30 0x7f09a01a7290 secure :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f099000d950 tx=0x7f099000de10 comp rx=0 tx=0).stop 2024-09-12T03:04:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.893+0000 7f0995600640 1 -- 172.21.15.18:0/1011510667 >> 172.21.15.18:0/1011510667 conn(0x7f09a0077ba0 msgr2=0x7f09a0080b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.894+0000 7f0995600640 1 -- 172.21.15.18:0/1011510667 shutdown_connections 2024-09-12T03:04:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:43.894+0000 7f0995600640 1 -- 172.21.15.18:0/1011510667 wait complete. 2024-09-12T03:04:44.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:43 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/1011510667' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T03:04:44.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:43 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T03:04:44.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:43 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/1011510667' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T03:04:44.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:43 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T03:04:44.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:43 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/1011510667' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T03:04:44.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:43 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T03:04:44.884 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T03:04:45.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:44 smithi018 ceph-mon[30616]: pgmap v503: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-12T03:04:45.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:44 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T03:04:45.101 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:44 smithi018 ceph-mon[30616]: osdmap e120: 12 total, 12 up, 12 in 2024-09-12T03:04:45.173 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:44 smithi176 ceph-mon[35713]: pgmap v503: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-12T03:04:45.173 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:44 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T03:04:45.173 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:44 smithi176 ceph-mon[35713]: osdmap e120: 12 total, 12 up, 12 in 2024-09-12T03:04:45.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:44 smithi062 ceph-mon[35527]: pgmap v503: 129 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 54 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-12T03:04:45.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:44 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T03:04:45.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:44 smithi062 ceph-mon[35527]: osdmap e120: 12 total, 12 up, 12 in 2024-09-12T03:04:45.566 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T03:04:47.182 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:46 smithi018 ceph-mon[30616]: pgmap v505: 97 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 22 active+clean; 1.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T03:04:47.182 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:46 smithi018 ceph-mon[30616]: osdmap e121: 12 total, 12 up, 12 in 2024-09-12T03:04:47.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.179+0000 7f42f7200640 1 -- 172.21.15.18:0/665572224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42f01079c0 msgr2=0x7f42f0107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:47.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.179+0000 7f42f7200640 1 --2- 172.21.15.18:0/665572224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42f01079c0 0x7f42f0107da0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009cd0 tx=0x7f42e802a910 comp rx=0 tx=0).stop 2024-09-12T03:04:47.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.180+0000 7f42f7200640 1 -- 172.21.15.18:0/665572224 shutdown_connections 2024-09-12T03:04:47.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.180+0000 7f42f7200640 1 --2- 172.21.15.18:0/665572224 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42f0102360 0x7f42f010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:47.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.180+0000 7f42f7200640 1 --2- 172.21.15.18:0/665572224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42f01019c0 0x7f42f0101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:47.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.180+0000 7f42f7200640 1 --2- 172.21.15.18:0/665572224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42f01079c0 0x7f42f0107da0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:47.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.180+0000 7f42f7200640 1 -- 172.21.15.18:0/665572224 >> 172.21.15.18:0/665572224 conn(0x7f42f00fd740 msgr2=0x7f42f00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:47.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.180+0000 7f42f7200640 1 -- 172.21.15.18:0/665572224 shutdown_connections 2024-09-12T03:04:47.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.180+0000 7f42f7200640 1 -- 172.21.15.18:0/665572224 wait complete. 2024-09-12T03:04:47.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.182+0000 7f42f7200640 1 Processor -- start 2024-09-12T03:04:47.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.183+0000 7f42f7200640 1 -- start start 2024-09-12T03:04:47.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.183+0000 7f42f7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42f01019c0 0x7f42f019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:47.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.183+0000 7f42f7200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42f0102360 0x7f42f019ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:47.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.184+0000 7f42f7200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42f019f010 0x7f42f019f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:47.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.184+0000 7f42f7200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f42f0111e00 con 0x7f42f01019c0 2024-09-12T03:04:47.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.184+0000 7f42f7200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f42f0111c80 con 0x7f42f0102360 2024-09-12T03:04:47.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.184+0000 7f42f7200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f42f0111f80 con 0x7f42f019f010 2024-09-12T03:04:47.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.184+0000 7f42f5400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42f0102360 0x7f42f019ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:47.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.184+0000 7f42f5400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42f0102360 0x7f42f019ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:38326/0 (socket says 172.21.15.18:38326) 2024-09-12T03:04:47.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.184+0000 7f42f5400640 1 -- 172.21.15.18:0/4207214524 learned_addr learned my addr 172.21.15.18:0/4207214524 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:04:47.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.184+0000 7f42f5e00640 1 --2- 172.21.15.18:0/4207214524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42f01019c0 0x7f42f019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:47.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.185+0000 7f42f5e00640 1 -- 172.21.15.18:0/4207214524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42f019f010 msgr2=0x7f42f019f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:47.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.185+0000 7f42f5e00640 1 --2- 172.21.15.18:0/4207214524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42f019f010 0x7f42f019f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:47.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.185+0000 7f42f5e00640 1 -- 172.21.15.18:0/4207214524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42f0102360 msgr2=0x7f42f019ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:47.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.185+0000 7f42f5e00640 1 --2- 172.21.15.18:0/4207214524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42f0102360 0x7f42f019ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:47.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.185+0000 7f42f5e00640 1 -- 172.21.15.18:0/4207214524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f019fad0 con 0x7f42f01019c0 2024-09-12T03:04:47.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.186+0000 7f42f5e00640 1 --2- 172.21.15.18:0/4207214524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42f01019c0 0x7f42f019a740 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f42e8008000 tx=0x7f42e8030ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:47.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.187+0000 7f42e6a00640 1 -- 172.21.15.18:0/4207214524 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e80307d0 con 0x7f42f01019c0 2024-09-12T03:04:47.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.187+0000 7f42f7200640 1 -- 172.21.15.18:0/4207214524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f019fd60 con 0x7f42f01019c0 2024-09-12T03:04:47.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.187+0000 7f42f7200640 1 -- 172.21.15.18:0/4207214524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f010aab0 con 0x7f42f01019c0 2024-09-12T03:04:47.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.188+0000 7f42e6a00640 1 -- 172.21.15.18:0/4207214524 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42e8040030 con 0x7f42f01019c0 2024-09-12T03:04:47.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.188+0000 7f42e6a00640 1 -- 172.21.15.18:0/4207214524 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e8004630 con 0x7f42f01019c0 2024-09-12T03:04:47.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.189+0000 7f42f7200640 1 -- 172.21.15.18:0/4207214524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f0107da0 con 0x7f42f01019c0 2024-09-12T03:04:47.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.192+0000 7f42e6a00640 1 -- 172.21.15.18:0/4207214524 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f42e8031670 con 0x7f42f01019c0 2024-09-12T03:04:47.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.194+0000 7f42e6a00640 1 --2- 172.21.15.18:0/4207214524 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f42dc0a2d70 0x7f42dc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:47.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.195+0000 7f42e6a00640 1 -- 172.21.15.18:0/4207214524 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 9711+0+0 (secure 0 0 0) 0x7f42e80f0950 con 0x7f42f01019c0 2024-09-12T03:04:47.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.195+0000 7f42f5400640 1 --2- 172.21.15.18:0/4207214524 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f42dc0a2d70 0x7f42dc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:47.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.196+0000 7f42f5400640 1 --2- 172.21.15.18:0/4207214524 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f42dc0a2d70 0x7f42dc0a5230 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f42f010ec90 tx=0x7f42e0009190 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:47.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.201+0000 7f42e6a00640 1 -- 172.21.15.18:0/4207214524 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42e804a020 con 0x7f42f01019c0 2024-09-12T03:04:47.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:46 smithi176 ceph-mon[35713]: pgmap v505: 97 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 22 active+clean; 1.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T03:04:47.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:46 smithi176 ceph-mon[35713]: osdmap e121: 12 total, 12 up, 12 in 2024-09-12T03:04:47.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:46 smithi062 ceph-mon[35527]: pgmap v505: 97 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 22 active+clean; 1.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T03:04:47.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:46 smithi062 ceph-mon[35527]: osdmap e121: 12 total, 12 up, 12 in 2024-09-12T03:04:47.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.534+0000 7f42f7200640 1 -- 172.21.15.18:0/4207214524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f42f010ae00 con 0x7f42f01019c0 2024-09-12T03:04:47.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.903+0000 7f42e6a00640 1 -- 172.21.15.18:0/4207214524 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v122) ==== 169+0+0 (secure 0 0 0) 0x7f42e80bd1e0 con 0x7f42f01019c0 2024-09-12T03:04:47.905 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-09-12T03:04:47.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.907+0000 7f42f7200640 1 -- 172.21.15.18:0/4207214524 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f42dc0a2d70 msgr2=0x7f42dc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:47.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.907+0000 7f42f7200640 1 --2- 172.21.15.18:0/4207214524 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f42dc0a2d70 0x7f42dc0a5230 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f42f010ec90 tx=0x7f42e0009190 comp rx=0 tx=0).stop 2024-09-12T03:04:47.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.907+0000 7f42f7200640 1 -- 172.21.15.18:0/4207214524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42f01019c0 msgr2=0x7f42f019a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:47.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.907+0000 7f42f7200640 1 --2- 172.21.15.18:0/4207214524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42f01019c0 0x7f42f019a740 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f42e8008000 tx=0x7f42e8030ea0 comp rx=0 tx=0).stop 2024-09-12T03:04:47.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.907+0000 7f42f7200640 1 -- 172.21.15.18:0/4207214524 shutdown_connections 2024-09-12T03:04:47.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.907+0000 7f42f7200640 1 --2- 172.21.15.18:0/4207214524 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f42dc0a2d70 0x7f42dc0a5230 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:47.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.907+0000 7f42f7200640 1 --2- 172.21.15.18:0/4207214524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42f019f010 0x7f42f019f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:47.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.907+0000 7f42f7200640 1 --2- 172.21.15.18:0/4207214524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42f0102360 0x7f42f019ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:47.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.907+0000 7f42f7200640 1 --2- 172.21.15.18:0/4207214524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42f01019c0 0x7f42f019a740 secure :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f42e8008000 tx=0x7f42e8030ea0 comp rx=0 tx=0).stop 2024-09-12T03:04:47.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.907+0000 7f42f7200640 1 -- 172.21.15.18:0/4207214524 >> 172.21.15.18:0/4207214524 conn(0x7f42f00fd740 msgr2=0x7f42f00fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:47.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.910+0000 7f42f7200640 1 -- 172.21.15.18:0/4207214524 shutdown_connections 2024-09-12T03:04:47.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:47.910+0000 7f42f7200640 1 -- 172.21.15.18:0/4207214524 wait complete. 2024-09-12T03:04:48.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:47 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/4207214524' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T03:04:48.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:47 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/4207214524' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T03:04:48.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:47 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/4207214524' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T03:04:49.015 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c7666100-70af-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-12T03:04:49.113 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:48 smithi018 ceph-mon[30616]: pgmap v507: 97 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 22 active+clean; 1.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T03:04:49.113 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:48 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/4207214524' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T03:04:49.113 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:48 smithi018 ceph-mon[30616]: osdmap e122: 12 total, 12 up, 12 in 2024-09-12T03:04:49.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:48 smithi176 ceph-mon[35713]: pgmap v507: 97 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 22 active+clean; 1.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T03:04:49.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:48 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/4207214524' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T03:04:49.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:48 smithi176 ceph-mon[35713]: osdmap e122: 12 total, 12 up, 12 in 2024-09-12T03:04:49.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:48 smithi062 ceph-mon[35527]: pgmap v507: 97 pgs: 56 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 22 active+clean; 1.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T03:04:49.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:48 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/4207214524' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T03:04:49.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:48 smithi062 ceph-mon[35527]: osdmap e122: 12 total, 12 up, 12 in 2024-09-12T03:04:49.734 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T03:04:51.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:50 smithi018 ceph-mon[30616]: pgmap v509: 33 pgs: 16 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 1 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T03:04:51.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:50 smithi176 ceph-mon[35713]: pgmap v509: 33 pgs: 16 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 1 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T03:04:51.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:50 smithi062 ceph-mon[35527]: pgmap v509: 33 pgs: 16 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 1 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T03:04:51.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.830+0000 7f0deb600640 1 -- 172.21.15.18:0/572129261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0de40ffbf0 msgr2=0x7f0de40fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:51.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.830+0000 7f0deb600640 1 --2- 172.21.15.18:0/572129261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0de40ffbf0 0x7f0de40fffd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009900 tx=0x7f0dd802a480 comp rx=0 tx=0).stop 2024-09-12T03:04:51.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.831+0000 7f0deb600640 1 -- 172.21.15.18:0/572129261 shutdown_connections 2024-09-12T03:04:51.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.831+0000 7f0deb600640 1 --2- 172.21.15.18:0/572129261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0de4112880 0x7f0de4114c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:51.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.831+0000 7f0deb600640 1 --2- 172.21.15.18:0/572129261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0de4100510 0x7f0de4112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:51.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.831+0000 7f0deb600640 1 --2- 172.21.15.18:0/572129261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0de40ffbf0 0x7f0de40fffd0 secure :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009900 tx=0x7f0dd802a480 comp rx=0 tx=0).stop 2024-09-12T03:04:51.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.831+0000 7f0deb600640 1 -- 172.21.15.18:0/572129261 >> 172.21.15.18:0/572129261 conn(0x7f0de40fba90 msgr2=0x7f0de40fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:51.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.832+0000 7f0deb600640 1 -- 172.21.15.18:0/572129261 shutdown_connections 2024-09-12T03:04:51.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.832+0000 7f0deb600640 1 -- 172.21.15.18:0/572129261 wait complete. 2024-09-12T03:04:51.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.833+0000 7f0deb600640 1 Processor -- start 2024-09-12T03:04:51.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.836+0000 7f0deb600640 1 -- start start 2024-09-12T03:04:51.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.836+0000 7f0deb600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0de4100510 0x7f0de4110b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:51.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.836+0000 7f0deb600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0de4112880 0x7f0de4109bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:51.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.836+0000 7f0deb600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0de410a110 0x7f0de410a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:51.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.836+0000 7f0deb600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0de41185e0 con 0x7f0de410a110 2024-09-12T03:04:51.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.836+0000 7f0deb600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0de4118460 con 0x7f0de4100510 2024-09-12T03:04:51.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.836+0000 7f0deb600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0de4118760 con 0x7f0de4112880 2024-09-12T03:04:51.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.837+0000 7f0de8c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0de4100510 0x7f0de4110b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:51.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.837+0000 7f0de8c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0de4100510 0x7f0de4110b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.18:38344/0 (socket says 172.21.15.18:38344) 2024-09-12T03:04:51.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.837+0000 7f0de8c00640 1 -- 172.21.15.18:0/83876495 learned_addr learned my addr 172.21.15.18:0/83876495 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-12T03:04:51.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.837+0000 7f0de3e00640 1 --2- 172.21.15.18:0/83876495 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0de4112880 0x7f0de4109bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:51.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.838+0000 7f0de8c00640 1 -- 172.21.15.18:0/83876495 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0de4112880 msgr2=0x7f0de4109bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:51.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.838+0000 7f0de9600640 1 --2- 172.21.15.18:0/83876495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0de410a110 0x7f0de410a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:51.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.838+0000 7f0de8c00640 1 --2- 172.21.15.18:0/83876495 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0de4112880 0x7f0de4109bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:51.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.838+0000 7f0de8c00640 1 -- 172.21.15.18:0/83876495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0de410a110 msgr2=0x7f0de410a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:51.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.838+0000 7f0de8c00640 1 --2- 172.21.15.18:0/83876495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0de410a110 0x7f0de410a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:51.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.838+0000 7f0de8c00640 1 -- 172.21.15.18:0/83876495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de410e7a0 con 0x7f0de4100510 2024-09-12T03:04:51.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.838+0000 7f0de8c00640 1 --2- 172.21.15.18:0/83876495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0de4100510 0x7f0de4110b40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8004770 tx=0x7f0dd8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:51.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.840+0000 7f0de1600640 1 -- 172.21.15.18:0/83876495 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd803f020 con 0x7f0de4100510 2024-09-12T03:04:51.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.840+0000 7f0de1600640 1 -- 172.21.15.18:0/83876495 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dd8031ca0 con 0x7f0de4100510 2024-09-12T03:04:51.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.841+0000 7f0de1600640 1 -- 172.21.15.18:0/83876495 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8035070 con 0x7f0de4100510 2024-09-12T03:04:51.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.841+0000 7f0deb600640 1 -- 172.21.15.18:0/83876495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0de410ea30 con 0x7f0de4100510 2024-09-12T03:04:51.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.841+0000 7f0deb600640 1 -- 172.21.15.18:0/83876495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0de410eec0 con 0x7f0de4100510 2024-09-12T03:04:51.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.843+0000 7f0deb600640 1 -- 172.21.15.18:0/83876495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0de4101080 con 0x7f0de4100510 2024-09-12T03:04:51.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.847+0000 7f0de1600640 1 -- 172.21.15.18:0/83876495 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f0dd8042020 con 0x7f0de4100510 2024-09-12T03:04:51.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.850+0000 7f0de1600640 1 --2- 172.21.15.18:0/83876495 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f0dcc0a2d70 0x7f0dcc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:04:51.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.851+0000 7f0de1600640 1 -- 172.21.15.18:0/83876495 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9066+0+0 (secure 0 0 0) 0x7f0dd80f0160 con 0x7f0de4100510 2024-09-12T03:04:51.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.851+0000 7f0de3e00640 1 --2- 172.21.15.18:0/83876495 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f0dcc0a2d70 0x7f0dcc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:04:51.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.852+0000 7f0de1600640 1 -- 172.21.15.18:0/83876495 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0dd8049070 con 0x7f0de4100510 2024-09-12T03:04:51.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:51.853+0000 7f0de3e00640 1 --2- 172.21.15.18:0/83876495 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f0dcc0a2d70 0x7f0dcc0a5230 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0de410b390 tx=0x7f0dd0008040 comp rx=0 tx=0).ready entity=mgr.25213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:04:52.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:52.226+0000 7f0deb600640 1 -- 172.21.15.18:0/83876495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0de410f1e0 con 0x7f0de4100510 2024-09-12T03:04:52.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:52.931+0000 7f0de1600640 1 -- 172.21.15.18:0/83876495 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v123) ==== 178+0+0 (secure 0 0 0) 0x7f0dd80bcb60 con 0x7f0de4100510 2024-09-12T03:04:52.934 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data_ec' removed 2024-09-12T03:04:52.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:52.935+0000 7f0deb600640 1 -- 172.21.15.18:0/83876495 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f0dcc0a2d70 msgr2=0x7f0dcc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:52.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:52.935+0000 7f0deb600640 1 --2- 172.21.15.18:0/83876495 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f0dcc0a2d70 0x7f0dcc0a5230 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0de410b390 tx=0x7f0dd0008040 comp rx=0 tx=0).stop 2024-09-12T03:04:52.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:52.935+0000 7f0deb600640 1 -- 172.21.15.18:0/83876495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0de4100510 msgr2=0x7f0de4110b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:04:52.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:52.935+0000 7f0deb600640 1 --2- 172.21.15.18:0/83876495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0de4100510 0x7f0de4110b40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8004770 tx=0x7f0dd8003c10 comp rx=0 tx=0).stop 2024-09-12T03:04:52.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:52.935+0000 7f0deb600640 1 -- 172.21.15.18:0/83876495 shutdown_connections 2024-09-12T03:04:52.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:52.935+0000 7f0deb600640 1 --2- 172.21.15.18:0/83876495 >> [v2:172.21.15.18:6800/4058201283,v1:172.21.15.18:6801/4058201283] conn(0x7f0dcc0a2d70 0x7f0dcc0a5230 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:52.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:52.935+0000 7f0deb600640 1 --2- 172.21.15.18:0/83876495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0de410a110 0x7f0de410a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:52.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:52.935+0000 7f0deb600640 1 --2- 172.21.15.18:0/83876495 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0de4112880 0x7f0de4109bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:52.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:52.935+0000 7f0deb600640 1 --2- 172.21.15.18:0/83876495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0de4100510 0x7f0de4110b40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:04:52.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:52.935+0000 7f0deb600640 1 -- 172.21.15.18:0/83876495 >> 172.21.15.18:0/83876495 conn(0x7f0de40fba90 msgr2=0x7f0de4111900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:04:52.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:52.938+0000 7f0deb600640 1 -- 172.21.15.18:0/83876495 shutdown_connections 2024-09-12T03:04:52.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-12T03:04:52.938+0000 7f0deb600640 1 -- 172.21.15.18:0/83876495 wait complete. 2024-09-12T03:04:53.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:52 smithi176 ceph-mon[35713]: pgmap v510: 33 pgs: 13 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 1 active+clean; 1.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T03:04:53.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:52 smithi176 ceph-mon[35713]: from='client.? 172.21.15.18:0/83876495' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T03:04:53.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:52 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T03:04:53.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:52 smithi062 ceph-mon[35527]: pgmap v510: 33 pgs: 13 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 1 active+clean; 1.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T03:04:53.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:52 smithi062 ceph-mon[35527]: from='client.? 172.21.15.18:0/83876495' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T03:04:53.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:52 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T03:04:53.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:52 smithi018 ceph-mon[30616]: pgmap v510: 33 pgs: 13 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 1 active+clean; 1.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T03:04:53.350 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:52 smithi018 ceph-mon[30616]: from='client.? 172.21.15.18:0/83876495' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T03:04:53.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:52 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T03:04:54.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:53 smithi176 ceph-mon[35713]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T03:04:54.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:53 smithi176 ceph-mon[35713]: osdmap e123: 12 total, 12 up, 12 in 2024-09-12T03:04:54.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:53 smithi062 ceph-mon[35527]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T03:04:54.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:53 smithi062 ceph-mon[35527]: osdmap e123: 12 total, 12 up, 12 in 2024-09-12T03:04:54.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:53 smithi018 ceph-mon[30616]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T03:04:54.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:53 smithi018 ceph-mon[30616]: osdmap e123: 12 total, 12 up, 12 in 2024-09-12T03:04:54.759 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T03:04:54.819 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T03:04:54.851 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T03:04:54.895 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-12T03:04:54.895 DEBUG:teuthology.orchestra.run.smithi018:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T03:04:54.931 DEBUG:teuthology.orchestra.run.smithi062:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T03:04:54.947 DEBUG:teuthology.orchestra.run.smithi176:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T03:04:54.969 INFO:tasks.cephadm:Stopping all daemons... 2024-09-12T03:04:54.969 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-12T03:04:54.969 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mon.a 2024-09-12T03:04:55.020 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:54 smithi018 ceph-mon[30616]: pgmap v512: 1 pgs: 1 active+clean; 577 KiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T03:04:55.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:54 smithi176 ceph-mon[35713]: pgmap v512: 1 pgs: 1 active+clean; 577 KiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T03:04:55.283 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:54 smithi062 ceph-mon[35527]: pgmap v512: 1 pgs: 1 active+clean; 577 KiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T03:04:55.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:55 smithi018 systemd[1]: Stopping Ceph mon.a for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:04:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:55 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a[30612]: 2024-09-12T03:04:55.462+0000 7f9e6e600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:04:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:55 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a[30612]: 2024-09-12T03:04:55.462+0000 7f9e6e600640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-12T03:04:55.851 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:55 smithi018 podman[97186]: 2024-09-12 03:04:55.55553423 +0000 UTC m=+0.278989512 container died 148cd232de42e3695eb17ae511afd37d6a44a0d0a9628325ba3a0d405d26007d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T03:04:56.319 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:56 smithi018 podman[97186]: 2024-09-12 03:04:56.042662274 +0000 UTC m=+0.766117556 container cleanup 148cd232de42e3695eb17ae511afd37d6a44a0d0a9628325ba3a0d405d26007d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T03:04:56.319 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:56 smithi018 bash[97186]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a 2024-09-12T03:04:56.588 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 12 03:04:56 smithi018 podman[97199]: 2024-09-12 03:04:56.31956751 +0000 UTC m=+0.760300366 container remove 148cd232de42e3695eb17ae511afd37d6a44a0d0a9628325ba3a0d405d26007d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-12T03:04:56.611 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mon.a.service' 2024-09-12T03:04:56.700 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:04:56.701 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-12T03:04:56.701 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-12T03:04:56.701 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mon.b 2024-09-12T03:04:57.033 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:56 smithi062 systemd[1]: Stopping Ceph mon.b for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:04:57.468 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:57 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-b[35523]: 2024-09-12T03:04:57.083+0000 7fb38a1f3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:04:57.468 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:57 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-b[35523]: 2024-09-12T03:04:57.083+0000 7fb38a1f3640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-12T03:04:57.468 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:57 smithi062 podman[73053]: 2024-09-12 03:04:57.165808215 +0000 UTC m=+0.211908771 container died 6ea4dc7aab4bf26c6e3ad7101557c52f54157dc5ca173c60674a35093fe257da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-b, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T03:04:57.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:57 smithi062 podman[73053]: 2024-09-12 03:04:57.568200243 +0000 UTC m=+0.614300799 container cleanup 6ea4dc7aab4bf26c6e3ad7101557c52f54157dc5ca173c60674a35093fe257da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T03:04:57.785 INFO:journalctl@ceph.mon.b.smithi062.stdout:Sep 12 03:04:57 smithi062 bash[73053]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-b 2024-09-12T03:04:57.972 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mon.b.service' 2024-09-12T03:04:58.054 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:04:58.055 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-12T03:04:58.055 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-12T03:04:58.055 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mon.c 2024-09-12T03:04:58.381 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:58 smithi176 systemd[1]: Stopping Ceph mon.c for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:04:58.728 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:58 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-c[35709]: 2024-09-12T03:04:58.379+0000 7f58cef4f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:04:58.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:58 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-c[35709]: 2024-09-12T03:04:58.379+0000 7f58cef4f640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-12T03:04:58.729 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:58 smithi176 podman[73310]: 2024-09-12 03:04:58.512951676 +0000 UTC m=+0.244817732 container died ef06237f8294cbc37ad4f89dd39b7ef2508fd90978aac2998302235db35035f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-c, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-12T03:04:59.228 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:59 smithi176 podman[73310]: 2024-09-12 03:04:59.031162321 +0000 UTC m=+0.763028377 container cleanup ef06237f8294cbc37ad4f89dd39b7ef2508fd90978aac2998302235db35035f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T03:04:59.229 INFO:journalctl@ceph.mon.c.smithi176.stdout:Sep 12 03:04:59 smithi176 bash[73310]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mon-c 2024-09-12T03:05:01.101 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 03:05:00 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T03:05:00.610+0000 7fea0da00640 -1 client.15225: SimpleRADOSStriper: lock: snap_db_v0.db: lock failed: (2) No such file or directory 2024-09-12T03:05:01.566 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mon.c.service' 2024-09-12T03:05:01.616 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:05:01.616 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-12T03:05:01.616 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-12T03:05:01.617 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mgr.x 2024-09-12T03:05:02.037 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 03:05:01 smithi018 systemd[1]: Stopping Ceph mgr.x for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:05:02.350 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 03:05:02 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T03:05:02.035+0000 7feada400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:05:02.351 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 03:05:02 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x[30842]: 2024-09-12T03:05:02.035+0000 7feada400640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-12T03:05:02.351 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 03:05:02 smithi018 podman[97306]: 2024-09-12 03:05:02.138816357 +0000 UTC m=+0.231476820 container died 4e1ebb106e6331d79cdec7c48e43776407873cdf4d38fce40c1b5080fecd35b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3) 2024-09-12T03:05:02.850 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 03:05:02 smithi018 podman[97306]: 2024-09-12 03:05:02.63230066 +0000 UTC m=+0.724961127 container cleanup 4e1ebb106e6331d79cdec7c48e43776407873cdf4d38fce40c1b5080fecd35b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T03:05:02.851 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 03:05:02 smithi018 bash[97306]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x 2024-09-12T03:05:03.281 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 12 03:05:02 smithi018 podman[97318]: 2024-09-12 03:05:02.94297399 +0000 UTC m=+0.793274128 container remove 4e1ebb106e6331d79cdec7c48e43776407873cdf4d38fce40c1b5080fecd35b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T03:05:03.309 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-12T03:05:03.383 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:05:03.383 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-12T03:05:03.383 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-12T03:05:03.383 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mgr.y 2024-09-12T03:05:03.719 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 03:05:03 smithi062 systemd[1]: Stopping Ceph mgr.y for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:05:04.008 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 03:05:03 smithi062 podman[73177]: 2024-09-12 03:05:03.719659795 +0000 UTC m=+0.138461163 container died d9c451f580aeeb779c17dce9b90fba5718fde5fc4ddaea83063be479f7e35723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T03:05:04.283 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 03:05:04 smithi062 podman[73177]: 2024-09-12 03:05:04.116085103 +0000 UTC m=+0.534886471 container cleanup d9c451f580aeeb779c17dce9b90fba5718fde5fc4ddaea83063be479f7e35723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T03:05:04.283 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Sep 12 03:05:04 smithi062 bash[73177]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-y 2024-09-12T03:05:04.561 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-12T03:05:04.595 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:05:04.596 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-12T03:05:04.596 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-12T03:05:04.596 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mgr.z 2024-09-12T03:05:04.926 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 03:05:04 smithi176 systemd[1]: Stopping Ceph mgr.z for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:05:05.207 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 03:05:04 smithi176 podman[73433]: 2024-09-12 03:05:04.926073058 +0000 UTC m=+0.138876504 container died b9cf66c81d056a38f00e0867bb58bbbf3fd264ce8239e49109d11b3fad8ec179 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-12T03:05:05.479 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 03:05:05 smithi176 podman[73433]: 2024-09-12 03:05:05.312914825 +0000 UTC m=+0.525718277 container cleanup b9cf66c81d056a38f00e0867bb58bbbf3fd264ce8239e49109d11b3fad8ec179 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T03:05:05.479 INFO:journalctl@ceph.mgr.z.smithi176.stdout:Sep 12 03:05:05 smithi176 bash[73433]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mgr-z 2024-09-12T03:05:05.777 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-12T03:05:05.815 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:05:05.815 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-12T03:05:05.815 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-12T03:05:05.815 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.0 2024-09-12T03:05:06.169 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 03:05:05 smithi018 systemd[1]: Stopping Ceph osd.0 for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:05:06.601 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 03:05:06 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-0[44604]: 2024-09-12T03:05:06.282+0000 7ff8f1800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:05:06.601 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 03:05:06 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-0[44604]: 2024-09-12T03:05:06.282+0000 7ff8f1800640 -1 osd.0 123 *** Got signal Terminated *** 2024-09-12T03:05:06.601 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 03:05:06 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-0[44604]: 2024-09-12T03:05:06.282+0000 7ff8f1800640 -1 osd.0 123 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T03:05:12.333 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 03:05:11 smithi018 podman[97434]: 2024-09-12 03:05:11.963557972 +0000 UTC m=+5.821459941 container died 1241ca70f2b987d08b3785a331a8bb7f22a264b178c1da887fc2054ede1c24be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T03:05:12.601 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 03:05:12 smithi018 podman[97434]: 2024-09-12 03:05:12.513469882 +0000 UTC m=+6.371371851 container cleanup 1241ca70f2b987d08b3785a331a8bb7f22a264b178c1da887fc2054ede1c24be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T03:05:12.601 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 03:05:12 smithi018 bash[97434]: ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-0 2024-09-12T03:05:13.100 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 03:05:12 smithi018 podman[97451]: 2024-09-12 03:05:12.779727724 +0000 UTC m=+0.807201497 container remove 1241ca70f2b987d08b3785a331a8bb7f22a264b178c1da887fc2054ede1c24be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T03:05:13.627 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 03:05:13 smithi018 podman[97538]: 2024-09-12 03:05:13.263345104 +0000 UTC m=+0.027633328 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T03:05:13.627 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 03:05:13 smithi018 podman[97538]: 2024-09-12 03:05:13.374221816 +0000 UTC m=+0.138510026 container create afcb6d2db21a25d75e2a5eaec45474ace3f95e9efabfebd5fca577fe703f901b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-12T03:05:13.627 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 03:05:13 smithi018 podman[97538]: 2024-09-12 03:05:13.626868248 +0000 UTC m=+0.391156459 container init afcb6d2db21a25d75e2a5eaec45474ace3f95e9efabfebd5fca577fe703f901b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T03:05:14.067 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 03:05:13 smithi018 podman[97538]: 2024-09-12 03:05:13.634412916 +0000 UTC m=+0.398701140 container start afcb6d2db21a25d75e2a5eaec45474ace3f95e9efabfebd5fca577fe703f901b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-12T03:05:14.067 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 03:05:13 smithi018 podman[97538]: 2024-09-12 03:05:13.743859084 +0000 UTC m=+0.508147327 container attach afcb6d2db21a25d75e2a5eaec45474ace3f95e9efabfebd5fca577fe703f901b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T03:05:14.351 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 12 03:05:14 smithi018 podman[97538]: 2024-09-12 03:05:14.067392598 +0000 UTC m=+0.831680820 container died afcb6d2db21a25d75e2a5eaec45474ace3f95e9efabfebd5fca577fe703f901b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T03:05:14.860 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.0.service' 2024-09-12T03:05:14.937 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:05:14.938 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-12T03:05:14.938 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-12T03:05:14.938 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.1 2024-09-12T03:05:15.272 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 03:05:14 smithi062 systemd[1]: Stopping Ceph osd.1 for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:05:15.533 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 03:05:15 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-1[39979]: 2024-09-12T03:05:15.271+0000 7f6ceb066640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:05:15.533 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 03:05:15 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-1[39979]: 2024-09-12T03:05:15.271+0000 7f6ceb066640 -1 osd.1 123 *** Got signal Terminated *** 2024-09-12T03:05:15.534 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 03:05:15 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-1[39979]: 2024-09-12T03:05:15.271+0000 7f6ceb066640 -1 osd.1 123 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T03:05:21.030 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 03:05:20 smithi062 podman[73315]: 2024-09-12 03:05:20.754715402 +0000 UTC m=+5.610466757 container died d99fe0e566289bfcdf842cc669e2c542697e6ced6c968300ee87130c140528e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True) 2024-09-12T03:05:21.283 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 03:05:21 smithi062 podman[73315]: 2024-09-12 03:05:21.088046044 +0000 UTC m=+5.943797388 container cleanup d99fe0e566289bfcdf842cc669e2c542697e6ced6c968300ee87130c140528e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T03:05:21.283 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 03:05:21 smithi062 bash[73315]: ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-1 2024-09-12T03:05:21.724 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 03:05:21 smithi062 podman[73332]: 2024-09-12 03:05:21.3233977 +0000 UTC m=+0.572409141 container remove d99fe0e566289bfcdf842cc669e2c542697e6ced6c968300ee87130c140528e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-12T03:05:22.033 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 03:05:21 smithi062 podman[73421]: 2024-09-12 03:05:21.724252656 +0000 UTC m=+0.112871611 container create fcd707ad17fadf3626ce7349ab6d253d60fce28206e7fa7934f5a44e0d08a2fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T03:05:22.033 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 03:05:21 smithi062 podman[73421]: 2024-09-12 03:05:21.627302635 +0000 UTC m=+0.015921614 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T03:05:22.033 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 03:05:21 smithi062 podman[73421]: 2024-09-12 03:05:21.960573635 +0000 UTC m=+0.349192591 container init fcd707ad17fadf3626ce7349ab6d253d60fce28206e7fa7934f5a44e0d08a2fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T03:05:22.033 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 03:05:21 smithi062 podman[73421]: 2024-09-12 03:05:21.963905503 +0000 UTC m=+0.352524459 container start fcd707ad17fadf3626ce7349ab6d253d60fce28206e7fa7934f5a44e0d08a2fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T03:05:22.531 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 03:05:22 smithi062 podman[73421]: 2024-09-12 03:05:22.060731829 +0000 UTC m=+0.449350799 container attach fcd707ad17fadf3626ce7349ab6d253d60fce28206e7fa7934f5a44e0d08a2fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T03:05:22.577 INFO:journalctl@ceph.osd.1.smithi062.stdout:Sep 12 03:05:22 smithi062 podman[73421]: 2024-09-12 03:05:22.208718419 +0000 UTC m=+0.597337374 container died fcd707ad17fadf3626ce7349ab6d253d60fce28206e7fa7934f5a44e0d08a2fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T03:05:22.850 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.1.service' 2024-09-12T03:05:22.890 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:05:22.891 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-12T03:05:22.891 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-12T03:05:22.891 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.2 2024-09-12T03:05:23.209 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 03:05:22 smithi176 systemd[1]: Stopping Ceph osd.2 for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:05:23.478 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 03:05:23 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-2[40704]: 2024-09-12T03:05:23.208+0000 7f0385df1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:05:23.479 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 03:05:23 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-2[40704]: 2024-09-12T03:05:23.208+0000 7f0385df1640 -1 osd.2 123 *** Got signal Terminated *** 2024-09-12T03:05:23.479 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 03:05:23 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-2[40704]: 2024-09-12T03:05:23.208+0000 7f0385df1640 -1 osd.2 123 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T03:05:29.102 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 03:05:28 smithi176 podman[73569]: 2024-09-12 03:05:28.797739654 +0000 UTC m=+5.701375064 container died e645d4778b5ae5308e267c25dc7e39906a8fb605be078d9d310f982a4bbc30a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-12T03:05:29.478 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 03:05:29 smithi176 podman[73569]: 2024-09-12 03:05:29.192362667 +0000 UTC m=+6.095998031 container cleanup e645d4778b5ae5308e267c25dc7e39906a8fb605be078d9d310f982a4bbc30a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T03:05:29.479 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 03:05:29 smithi176 bash[73569]: ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-2 2024-09-12T03:05:30.369 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 03:05:29 smithi176 podman[73585]: 2024-09-12 03:05:29.994366756 +0000 UTC m=+1.180563448 container remove e645d4778b5ae5308e267c25dc7e39906a8fb605be078d9d310f982a4bbc30a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T03:05:30.630 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 03:05:30 smithi176 podman[73673]: 2024-09-12 03:05:30.27234534 +0000 UTC m=+0.015527751 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T03:05:30.631 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 03:05:30 smithi176 podman[73673]: 2024-09-12 03:05:30.395245808 +0000 UTC m=+0.138428254 container create 7d10925b50d86646a6f39de5688213a18c806f792fc20d07d19347941a69905c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-09-12T03:05:30.910 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 03:05:30 smithi176 podman[73673]: 2024-09-12 03:05:30.631037081 +0000 UTC m=+0.374219485 container init 7d10925b50d86646a6f39de5688213a18c806f792fc20d07d19347941a69905c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-12T03:05:30.910 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 03:05:30 smithi176 podman[73673]: 2024-09-12 03:05:30.634725456 +0000 UTC m=+0.377907860 container start 7d10925b50d86646a6f39de5688213a18c806f792fc20d07d19347941a69905c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T03:05:30.910 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 03:05:30 smithi176 podman[73673]: 2024-09-12 03:05:30.731109517 +0000 UTC m=+0.474291949 container attach 7d10925b50d86646a6f39de5688213a18c806f792fc20d07d19347941a69905c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-12T03:05:31.228 INFO:journalctl@ceph.osd.2.smithi176.stdout:Sep 12 03:05:30 smithi176 podman[73673]: 2024-09-12 03:05:30.91010533 +0000 UTC m=+0.653287736 container died 7d10925b50d86646a6f39de5688213a18c806f792fc20d07d19347941a69905c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T03:05:31.578 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.2.service' 2024-09-12T03:05:31.617 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:05:31.618 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-12T03:05:31.618 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-12T03:05:31.618 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.3 2024-09-12T03:05:32.076 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 03:05:31 smithi018 systemd[1]: Stopping Ceph osd.3 for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:05:32.351 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 03:05:32 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-3[51506]: 2024-09-12T03:05:32.074+0000 7fec51e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:05:32.351 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 03:05:32 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-3[51506]: 2024-09-12T03:05:32.074+0000 7fec51e00640 -1 osd.3 123 *** Got signal Terminated *** 2024-09-12T03:05:32.351 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 03:05:32 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-3[51506]: 2024-09-12T03:05:32.074+0000 7fec51e00640 -1 osd.3 123 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T03:05:32.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:32 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:32.587+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:33.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:33 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:33.566+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:33.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:33 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:33.727+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:34.525 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 03:05:34 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-3[51506]: 2024-09-12T03:05:34.146+0000 7fec4d800640 -1 osd.3 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:10.722635+0000 front 2024-09-12T03:05:10.722672+0000 (oldest deadline 2024-09-12T03:05:33.622562+0000) 2024-09-12T03:05:34.728 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:34 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:34.477+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:34.850 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:34 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:34.720+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:34.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:34 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:34.524+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:35.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:34 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:34.838+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:35.262 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 03:05:35 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-3[51506]: 2024-09-12T03:05:35.098+0000 7fec4d800640 -1 osd.3 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:10.722635+0000 front 2024-09-12T03:05:10.722672+0000 (oldest deadline 2024-09-12T03:05:33.622562+0000) 2024-09-12T03:05:35.752 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:35.492+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:35.850 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:35 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:35.692+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:35.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:35 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:35.539+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:36.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:35.800+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:36.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:36 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:36.216+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:36.542 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 03:05:36 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-3[51506]: 2024-09-12T03:05:36.145+0000 7fec4d800640 -1 osd.3 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:10.722635+0000 front 2024-09-12T03:05:10.722672+0000 (oldest deadline 2024-09-12T03:05:33.622562+0000) 2024-09-12T03:05:36.828 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:36 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:36.524+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:36.850 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:36 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:36.671+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:36.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:36 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:36.541+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:37.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:36 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:36.827+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:37.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:37 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:37.211+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:37.819 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:37.485+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:37.850 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:37 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:37.664+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:37.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:37 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:37.522+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:38.218 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 03:05:37 smithi018 podman[97640]: 2024-09-12 03:05:37.854118392 +0000 UTC m=+5.938405045 container died 1dfb91fc26b165eaae1e58ce594f0f9de1baaba43454ef7cb6c872a078051dd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T03:05:38.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:37.818+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:38.529 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 03:05:38 smithi018 podman[97640]: 2024-09-12 03:05:38.35053891 +0000 UTC m=+6.434825562 container cleanup 1dfb91fc26b165eaae1e58ce594f0f9de1baaba43454ef7cb6c872a078051dd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-12T03:05:38.529 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 03:05:38 smithi018 bash[97640]: ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-3 2024-09-12T03:05:38.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:38 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:38.214+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:38.814 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:38 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:38.517+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:38.850 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:38 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:38.674+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:38.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:38 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:38.527+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:38.851 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 03:05:38 smithi018 podman[97672]: 2024-09-12 03:05:38.635676544 +0000 UTC m=+0.771503821 container remove 1dfb91fc26b165eaae1e58ce594f0f9de1baaba43454ef7cb6c872a078051dd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-12T03:05:39.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:38 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:38.813+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:39.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:39 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:39.167+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:39.568 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 03:05:39 smithi018 podman[97759]: 2024-09-12 03:05:39.175690977 +0000 UTC m=+0.028875695 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T03:05:39.568 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 03:05:39 smithi018 podman[97759]: 2024-09-12 03:05:39.303424588 +0000 UTC m=+0.156609295 container create fe6ab7860acbaea61617bdf5e4e386d9526bd81ce5a544b4ba24517d86a16103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T03:05:39.823 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:39 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:39.488+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:39.850 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:39.628+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:39.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:39 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:39.567+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:39.851 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 03:05:39 smithi018 podman[97759]: 2024-09-12 03:05:39.61021011 +0000 UTC m=+0.463394841 container init fe6ab7860acbaea61617bdf5e4e386d9526bd81ce5a544b4ba24517d86a16103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-12T03:05:39.851 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 03:05:39 smithi018 podman[97759]: 2024-09-12 03:05:39.616940737 +0000 UTC m=+0.470125445 container start fe6ab7860acbaea61617bdf5e4e386d9526bd81ce5a544b4ba24517d86a16103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T03:05:39.851 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 03:05:39 smithi018 podman[97759]: 2024-09-12 03:05:39.723084587 +0000 UTC m=+0.576269305 container attach fe6ab7860acbaea61617bdf5e4e386d9526bd81ce5a544b4ba24517d86a16103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T03:05:40.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:39 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:39.823+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:40.276 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 12 03:05:39 smithi018 podman[97759]: 2024-09-12 03:05:39.885883246 +0000 UTC m=+0.739067963 container died fe6ab7860acbaea61617bdf5e4e386d9526bd81ce5a544b4ba24517d86a16103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T03:05:40.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:40 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:40.119+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:40.600 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:40 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:40.517+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:40.703 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.3.service' 2024-09-12T03:05:40.784 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:05:40.784 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-12T03:05:40.784 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-12T03:05:40.784 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.4 2024-09-12T03:05:40.867 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:40.495+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:41.085 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:40 smithi062 systemd[1]: Stopping Ceph osd.4 for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:05:41.100 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:40 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:40.600+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:41.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:40.866+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:41.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:41 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:41.096+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:41.533 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:41 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4[46682]: 2024-09-12T03:05:41.084+0000 7fa9dbd8d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:05:41.533 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:41 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4[46682]: 2024-09-12T03:05:41.084+0000 7fa9dbd8d640 -1 osd.4 123 *** Got signal Terminated *** 2024-09-12T03:05:41.534 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:41 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4[46682]: 2024-09-12T03:05:41.084+0000 7fa9dbd8d640 -1 osd.4 123 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T03:05:41.728 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:41 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:41.471+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:41.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:41 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:41.575+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:41.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:41 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:41.479+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:41.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:41 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:41.479+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:42.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:41 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:41.889+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:42.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:41 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:41.889+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:42.435 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:42 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4[46682]: 2024-09-12T03:05:42.197+0000 7fa9d439b640 -1 osd.4 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.885870+0000 front 2024-09-12T03:05:18.885844+0000 (oldest deadline 2024-09-12T03:05:41.786088+0000) 2024-09-12T03:05:42.435 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:42 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:42.064+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:42.435 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:42 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:42.064+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:42.728 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:42 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:42.463+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:42.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:42 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:42.597+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:42.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:42 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:42.500+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:42.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:42 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:42.500+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:43.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:42 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:42.914+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:43.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:42 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:42.914+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:43.533 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:43 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4[46682]: 2024-09-12T03:05:43.176+0000 7fa9d439b640 -1 osd.4 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.885870+0000 front 2024-09-12T03:05:18.885844+0000 (oldest deadline 2024-09-12T03:05:41.786088+0000) 2024-09-12T03:05:43.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:43 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:43.110+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:43.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:43 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:43.110+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:43.709 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:43 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:43.414+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:43.850 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:43.626+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:43.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:43.484+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:43.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:43 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:43.484+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:43.978 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:43 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:43.709+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:05:43.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:43 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:43.887+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:43.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:43 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:43.887+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:44.533 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:44 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4[46682]: 2024-09-12T03:05:44.152+0000 7fa9d439b640 -1 osd.4 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.885870+0000 front 2024-09-12T03:05:18.885844+0000 (oldest deadline 2024-09-12T03:05:41.786088+0000) 2024-09-12T03:05:44.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:44 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:44.064+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:44.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:44 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:44.064+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:44.728 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:44 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:44.460+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:44.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:44 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:44.460+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.830382+0000 front 2024-09-12T03:05:19.830534+0000 (oldest deadline 2024-09-12T03:05:43.930584+0000) 2024-09-12T03:05:44.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:44.627+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:44.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:44.497+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:44.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:44 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:44.497+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:45.228 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:44 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:44.733+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:05:45.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:44 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:44.846+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:45.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:44 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:44.846+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:45.283 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:45 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4[46682]: 2024-09-12T03:05:45.200+0000 7fa9d439b640 -1 osd.4 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.885870+0000 front 2024-09-12T03:05:18.885844+0000 (oldest deadline 2024-09-12T03:05:41.786088+0000) 2024-09-12T03:05:45.284 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:44 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:44.954+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:05:45.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:45 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:45.083+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:45.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:45 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:45.083+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:45.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:45 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:45.419+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:45.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:45 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:45.419+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.830382+0000 front 2024-09-12T03:05:19.830534+0000 (oldest deadline 2024-09-12T03:05:43.930584+0000) 2024-09-12T03:05:45.850 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:45 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:45.593+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:45.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:45 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:45.593+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:05:45.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:45 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:45.468+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:45.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:45 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:45.468+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:46.228 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:45 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:45.783+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:05:46.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:45 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:45.865+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:46.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:45 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:45.865+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:46.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:45 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:45.985+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:05:46.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:46 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:46.052+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:46.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:46 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:46.052+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:46.568 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:46.448+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:46.568 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:46.448+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:46.728 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:46 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:46.389+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:46.728 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:46 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:46.389+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.830382+0000 front 2024-09-12T03:05:19.830534+0000 (oldest deadline 2024-09-12T03:05:43.930584+0000) 2024-09-12T03:05:46.850 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:46.567+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:46.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:46 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:46.567+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:05:47.014 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:46 smithi062 podman[73525]: 2024-09-12 03:05:46.695499694 +0000 UTC m=+5.713505300 container died cd5eded42c3545aa497882c3856f968a9115b84f517b53e5126bfa84b344c450 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T03:05:47.228 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:46 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:46.778+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:05:47.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:46 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:46.880+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:47.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:46 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:46.880+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:47.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:47 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:47.013+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:05:47.283 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:47 smithi062 podman[73525]: 2024-09-12 03:05:47.192950487 +0000 UTC m=+6.210956093 container cleanup cd5eded42c3545aa497882c3856f968a9115b84f517b53e5126bfa84b344c450 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-12T03:05:47.283 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:47 smithi062 bash[73525]: ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4 2024-09-12T03:05:47.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:47 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:47.076+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:47.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:47 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:47.076+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:47.728 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:47 smithi062 podman[73540]: 2024-09-12 03:05:47.436205569 +0000 UTC m=+0.739794302 container remove cd5eded42c3545aa497882c3856f968a9115b84f517b53e5126bfa84b344c450 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-12T03:05:47.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:47 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:47.353+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:47.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:47 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:47.353+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.830382+0000 front 2024-09-12T03:05:19.830534+0000 (oldest deadline 2024-09-12T03:05:43.930584+0000) 2024-09-12T03:05:47.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:47 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:47.602+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:47.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:47 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:47.602+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:05:47.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:47 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:47.454+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:47.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:47 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:47.454+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:47.990 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:47 smithi062 podman[73627]: 2024-09-12 03:05:47.728965207 +0000 UTC m=+0.099144303 container create aa4cf5fff755590a95f29c6509547967c3fe71199eafbfc7ba98b1974b04fba7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T03:05:47.990 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:47 smithi062 podman[73627]: 2024-09-12 03:05:47.645672843 +0000 UTC m=+0.015851943 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T03:05:47.990 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:47 smithi062 podman[73627]: 2024-09-12 03:05:47.989993223 +0000 UTC m=+0.360172328 container init aa4cf5fff755590a95f29c6509547967c3fe71199eafbfc7ba98b1974b04fba7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-12T03:05:48.228 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:47 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:47.743+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:05:48.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:47 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:47.873+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:48.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:47 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:47.873+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:48.283 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:47 smithi062 podman[73627]: 2024-09-12 03:05:47.993190587 +0000 UTC m=+0.363369684 container start aa4cf5fff755590a95f29c6509547967c3fe71199eafbfc7ba98b1974b04fba7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T03:05:48.284 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:48 smithi062 podman[73627]: 2024-09-12 03:05:48.098388963 +0000 UTC m=+0.468568071 container attach aa4cf5fff755590a95f29c6509547967c3fe71199eafbfc7ba98b1974b04fba7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-12T03:05:48.284 INFO:journalctl@ceph.osd.4.smithi062.stdout:Sep 12 03:05:48 smithi062 podman[73650]: 2024-09-12 03:05:48.21558198 +0000 UTC m=+0.016812491 container died aa4cf5fff755590a95f29c6509547967c3fe71199eafbfc7ba98b1974b04fba7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-12T03:05:48.284 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:47 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:47.991+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:05:48.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:48 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:48.061+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:48.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:48 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:48.061+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:48.728 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:48 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:48.373+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:48.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:48 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:48.373+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.830382+0000 front 2024-09-12T03:05:19.830534+0000 (oldest deadline 2024-09-12T03:05:43.930584+0000) 2024-09-12T03:05:48.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:48 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:48.458+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:48.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:48 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:48.458+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:48.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:48 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:48.557+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:48.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:48 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:48.557+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:05:48.917 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.4.service' 2024-09-12T03:05:48.958 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:05:48.958 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-12T03:05:48.959 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-12T03:05:48.959 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.5 2024-09-12T03:05:49.229 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:49 smithi176 systemd[1]: Stopping Ceph osd.5 for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:05:49.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:48 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:48.777+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:05:49.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:48 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:48.917+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:49.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:48 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:48.917+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:49.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:49 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:49.021+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:05:49.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:49 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:49.045+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:49.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:49 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:49.045+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:49.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:49 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:49.045+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:05:49.728 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:49 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:49.296+0000 7fa0f310b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:05:49.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:49 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:49.296+0000 7fa0f310b640 -1 osd.5 123 *** Got signal Terminated *** 2024-09-12T03:05:49.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:49 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:49.296+0000 7fa0f310b640 -1 osd.5 123 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T03:05:49.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:49 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:49.329+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:49.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:49 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:49.329+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.830382+0000 front 2024-09-12T03:05:19.830534+0000 (oldest deadline 2024-09-12T03:05:43.930584+0000) 2024-09-12T03:05:49.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:49 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:49.329+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:28.031454+0000 front 2024-09-12T03:05:28.031477+0000 (oldest deadline 2024-09-12T03:05:49.131588+0000) 2024-09-12T03:05:49.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:49 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:49.597+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:49.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:49 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:49.597+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:05:49.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:49 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:49.475+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:49.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:49 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:49.475+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:50.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:49 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:49.795+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:05:50.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:49 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:49.881+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:50.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:49 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:49.881+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:50.533 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:50 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:50.039+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:05:50.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:50 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:50.090+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:50.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:50 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:50.090+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:50.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:50 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:50.090+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:05:50.728 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:50 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:50.301+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:50.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:50 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:50.302+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.830382+0000 front 2024-09-12T03:05:19.830534+0000 (oldest deadline 2024-09-12T03:05:43.930584+0000) 2024-09-12T03:05:50.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:50 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:50.302+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:28.031454+0000 front 2024-09-12T03:05:28.031477+0000 (oldest deadline 2024-09-12T03:05:49.131588+0000) 2024-09-12T03:05:50.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:50 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:50.571+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:50.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:50 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:50.571+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:05:50.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:50 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:50.488+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:50.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:50 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:50.488+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:51.228 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:50 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:50.782+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:05:51.228 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:50 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:50.782+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:05:51.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:50 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:50.833+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:51.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:50 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:50.833+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:51.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:51 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:51.005+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:05:51.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:51 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:51.005+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:05:51.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:51 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:51.129+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:51.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:51 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:51.129+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:51.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:51 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:51.129+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:05:51.728 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:51 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:51.346+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:51.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:51 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:51.346+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.830382+0000 front 2024-09-12T03:05:19.830534+0000 (oldest deadline 2024-09-12T03:05:43.930584+0000) 2024-09-12T03:05:51.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:51 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:51.346+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:28.031454+0000 front 2024-09-12T03:05:28.031477+0000 (oldest deadline 2024-09-12T03:05:49.131588+0000) 2024-09-12T03:05:51.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:51 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:51.468+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:51.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:51 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:51.468+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:51.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:51 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:51.560+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:51.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:51 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:51.560+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:05:52.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:51 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:51.779+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:05:52.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:51 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:51.779+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:05:52.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:51 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:51.856+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:52.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:51 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:51.856+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:52.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:51 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:51.856+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:05:52.284 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:52 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:52.021+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:05:52.285 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:52 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:52.021+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:05:52.285 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:52 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:52.154+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:52.285 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:52 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:52.154+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:52.285 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:52 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:52.154+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:05:52.728 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:52 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:52.335+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:52.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:52 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:52.335+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.830382+0000 front 2024-09-12T03:05:19.830534+0000 (oldest deadline 2024-09-12T03:05:43.930584+0000) 2024-09-12T03:05:52.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:52 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:52.335+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:28.031454+0000 front 2024-09-12T03:05:28.031477+0000 (oldest deadline 2024-09-12T03:05:49.131588+0000) 2024-09-12T03:05:52.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:52 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:52.515+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:52.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:52 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:52.515+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:05:52.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:52 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:52.515+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.347098+0000 front 2024-09-12T03:05:26.346875+0000 (oldest deadline 2024-09-12T03:05:51.646619+0000) 2024-09-12T03:05:52.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:52 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:52.460+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:52.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:52 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:52.460+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:52.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:52 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:52.460+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:05:53.230 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:52 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:52.761+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:05:53.308 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:52 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:52.761+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:05:53.309 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:52 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:52.848+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:53.309 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:52 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:52.848+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:53.309 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:52 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:52.848+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:05:53.310 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:53 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:53.025+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:05:53.311 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:53 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:53.025+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:05:53.311 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:53 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:53.140+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:53.311 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:53 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:53.140+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:53.311 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:53 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:53.140+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:05:53.728 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:53 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:53.325+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:11.129183+0000 front 2024-09-12T03:05:11.129299+0000 (oldest deadline 2024-09-12T03:05:34.028983+0000) 2024-09-12T03:05:53.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:53 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:53.325+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.830382+0000 front 2024-09-12T03:05:19.830534+0000 (oldest deadline 2024-09-12T03:05:43.930584+0000) 2024-09-12T03:05:53.729 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:53 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5[47595]: 2024-09-12T03:05:53.325+0000 7fa0ef721640 -1 osd.5 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:28.031454+0000 front 2024-09-12T03:05:28.031477+0000 (oldest deadline 2024-09-12T03:05:49.131588+0000) 2024-09-12T03:05:53.850 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:53 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:53.493+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:53.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:53 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:53.493+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:05:53.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:53 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:53.493+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.347098+0000 front 2024-09-12T03:05:26.346875+0000 (oldest deadline 2024-09-12T03:05:51.646619+0000) 2024-09-12T03:05:53.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:53 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:53.435+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:53.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:53 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:53.435+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:53.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:53 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:53.435+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:05:54.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:53 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:53.779+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:05:54.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:53 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:53.779+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:05:54.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:53 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:53.856+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:54.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:53 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:53.856+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:54.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:53 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:53.856+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:05:54.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:53 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:53.994+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:05:54.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:53 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:53.994+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:05:54.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:54 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:54.091+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:54.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:54 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:54.091+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:54.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:54 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:54.091+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:05:54.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:54 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:54.459+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:54.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:54 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:54.459+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:54.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:54 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:54.459+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:05:54.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:54 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:54.470+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:54.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:54 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:54.470+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:05:54.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:54 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:54.470+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.347098+0000 front 2024-09-12T03:05:26.346875+0000 (oldest deadline 2024-09-12T03:05:51.646619+0000) 2024-09-12T03:05:55.072 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:54 smithi176 podman[73789]: 2024-09-12 03:05:54.783385856 +0000 UTC m=+5.617791362 container died 450ff46a2dbd6087c9b089df945a82103753269b9e254dfac405bdfe15f60d5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-12T03:05:55.072 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:54 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:54.781+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:05:55.072 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:54 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:54.781+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:05:55.072 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:54 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:54.820+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:55.073 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:54 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:54.820+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:55.073 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:54 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:54.820+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:05:55.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:54 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:54.946+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:05:55.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:54 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:54.946+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:05:55.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:55 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:55.116+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:55.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:55 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:55.116+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:55.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:55 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:55.116+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:05:55.478 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:55 smithi176 podman[73789]: 2024-09-12 03:05:55.180433673 +0000 UTC m=+6.014839178 container cleanup 450ff46a2dbd6087c9b089df945a82103753269b9e254dfac405bdfe15f60d5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T03:05:55.478 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:55 smithi176 bash[73789]: ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5 2024-09-12T03:05:55.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:55 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:55.433+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:55.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:55 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:55.433+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:05:55.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:55 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:55.433+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.347098+0000 front 2024-09-12T03:05:26.346875+0000 (oldest deadline 2024-09-12T03:05:51.646619+0000) 2024-09-12T03:05:55.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:55 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:55.413+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:55.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:55 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:55.413+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:55.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:55 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:55.413+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:05:56.228 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:55 smithi176 podman[73807]: 2024-09-12 03:05:55.840421446 +0000 UTC m=+1.042716492 container remove 450ff46a2dbd6087c9b089df945a82103753269b9e254dfac405bdfe15f60d5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-12T03:05:56.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:55 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:55.788+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:05:56.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:55 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:55.788+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:05:56.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:55 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:55.816+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:56.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:55 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:55.816+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:56.230 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:55 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:55.816+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:05:56.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:55 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:55.964+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:05:56.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:55 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:55.964+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:05:56.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:56 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:56.159+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:56.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:56 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:56.159+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:56.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:56 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:56.159+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:05:56.518 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:56 smithi176 podman[73901]: 2024-09-12 03:05:56.158869626 +0000 UTC m=+0.016105593 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T03:05:56.519 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:56 smithi176 podman[73901]: 2024-09-12 03:05:56.274950541 +0000 UTC m=+0.132186532 container create 30eeed18b5e400c464b927544efef0158066554153bb225dee4429c27fec54eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T03:05:56.795 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:56 smithi176 podman[73901]: 2024-09-12 03:05:56.518891246 +0000 UTC m=+0.376127199 container init 30eeed18b5e400c464b927544efef0158066554153bb225dee4429c27fec54eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T03:05:56.795 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:56 smithi176 podman[73901]: 2024-09-12 03:05:56.522530481 +0000 UTC m=+0.379766429 container start 30eeed18b5e400c464b927544efef0158066554153bb225dee4429c27fec54eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T03:05:56.795 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:56 smithi176 podman[73901]: 2024-09-12 03:05:56.594032865 +0000 UTC m=+0.451268821 container attach 30eeed18b5e400c464b927544efef0158066554153bb225dee4429c27fec54eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T03:05:56.795 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 12 03:05:56 smithi176 podman[73901]: 2024-09-12 03:05:56.707654779 +0000 UTC m=+0.564890727 container died 30eeed18b5e400c464b927544efef0158066554153bb225dee4429c27fec54eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-5-deactivate, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T03:05:56.850 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:56 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:56.469+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:56.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:56 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:56.469+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:05:56.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:56 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:56.469+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.347098+0000 front 2024-09-12T03:05:26.346875+0000 (oldest deadline 2024-09-12T03:05:51.646619+0000) 2024-09-12T03:05:56.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:56 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:56.370+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:56.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:56 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:56.370+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:56.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:56 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:56.370+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:05:57.097 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:56 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:56.794+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:05:57.098 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:56 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:56.794+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:05:57.098 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:56 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:56.809+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:57.098 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:56 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:56.809+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:57.098 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:56 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:56.809+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:05:57.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:56 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:56.946+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:05:57.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:56 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:56.946+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:05:57.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:57 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:57.127+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:57.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:57 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:57.127+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:57.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:57 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:57.127+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:05:57.442 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.5.service' 2024-09-12T03:05:57.482 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:05:57.482 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-12T03:05:57.483 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-12T03:05:57.483 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.6 2024-09-12T03:05:57.600 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:57 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:57.487+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:57.601 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:57 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:57.487+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:05:57.601 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:57 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:57.487+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.347098+0000 front 2024-09-12T03:05:26.346875+0000 (oldest deadline 2024-09-12T03:05:51.646619+0000) 2024-09-12T03:05:57.601 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:57 smithi018 systemd[1]: Stopping Ceph osd.6 for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:05:57.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:57 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:57.336+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:57.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:57 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:57.336+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:57.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:57 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:57.336+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:05:58.228 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:57 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:57.753+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:05:58.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:57 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:57.753+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:05:58.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:57 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:57.804+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:58.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:57 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:57.804+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:58.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:57 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:57.804+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:05:58.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:57 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:57.919+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:05:58.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:57 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:57.919+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:05:58.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:58 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:58.123+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:58.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:58 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:58.123+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:58.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:58 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:58.123+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:05:58.350 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:57 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:57.931+0000 7f5698200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:05:58.351 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:57 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:57.931+0000 7f5698200640 -1 osd.6 123 *** Got signal Terminated *** 2024-09-12T03:05:58.351 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:57 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:57.931+0000 7f5698200640 -1 osd.6 123 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T03:05:58.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:58 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:58.472+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:58.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:58 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:58.472+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:05:58.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:58 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:58.472+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.347098+0000 front 2024-09-12T03:05:26.346875+0000 (oldest deadline 2024-09-12T03:05:51.646619+0000) 2024-09-12T03:05:58.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:58 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:58.366+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:58.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:58 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:58.366+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:58.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:58 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:58.366+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:05:59.228 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:58 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:58.801+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:05:59.228 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:58 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:58.801+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:05:59.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:58 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:58.826+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:05:59.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:58 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:58.826+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:05:59.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:58 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:58.826+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:05:59.284 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:58 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:58.927+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:05:59.284 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:58 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:58.927+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:05:59.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:59 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:59.130+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:05:59.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:59 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:59.130+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:05:59.285 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:05:59 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:05:59.130+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:05:59.850 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:59 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:59.369+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:05:59.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:59 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:59.369+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:05:59.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:05:59 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:05:59.369+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:05:59.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:59 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:59.500+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:05:59.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:59 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:59.500+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:05:59.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:59 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:59.500+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.347098+0000 front 2024-09-12T03:05:26.346875+0000 (oldest deadline 2024-09-12T03:05:51.646619+0000) 2024-09-12T03:05:59.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:05:59 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:05:59.500+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:31.647129+0000 front 2024-09-12T03:05:31.647173+0000 (oldest deadline 2024-09-12T03:05:59.247821+0000) 2024-09-12T03:06:00.228 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:59 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:59.816+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:00.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:59 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:59.816+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:00.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:05:59 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:05:59.816+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:00.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:59 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:59.799+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:00.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:59 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:59.799+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:00.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:05:59 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:05:59.799+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:00.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:59 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:59.972+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:06:00.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:59 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:59.972+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:06:00.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:05:59 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:05:59.972+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.601350+0000 front 2024-09-12T03:05:34.601221+0000 (oldest deadline 2024-09-12T03:05:59.301116+0000) 2024-09-12T03:06:00.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:00 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:00.134+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:00.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:00 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:00.134+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:00.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:00 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:00.134+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:00.850 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:00 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:00.388+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:00.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:00 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:00.388+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:00.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:00 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:00.388+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:00.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:00 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:06:00.532+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:06:00.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:00 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:06:00.532+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:06:00.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:00 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:06:00.532+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.347098+0000 front 2024-09-12T03:05:26.346875+0000 (oldest deadline 2024-09-12T03:05:51.646619+0000) 2024-09-12T03:06:00.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:00 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:06:00.532+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:31.647129+0000 front 2024-09-12T03:05:31.647173+0000 (oldest deadline 2024-09-12T03:05:59.247821+0000) 2024-09-12T03:06:01.228 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:00 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:00.802+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:01.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:00 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:00.802+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:01.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:00 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:00.802+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:01.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:00 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:00.767+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:01.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:00 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:00.767+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:01.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:00 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:00.767+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:01.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:01 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:01.011+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:06:01.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:01 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:01.011+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:06:01.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:01 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:01.011+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.601350+0000 front 2024-09-12T03:05:34.601221+0000 (oldest deadline 2024-09-12T03:05:59.301116+0000) 2024-09-12T03:06:01.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:01 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:01.149+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:01.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:01 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:01.149+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:01.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:01 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:01.149+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:01.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:01 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:06:01.483+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:06:01.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:01 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:06:01.483+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:06:01.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:01 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:06:01.483+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.347098+0000 front 2024-09-12T03:05:26.346875+0000 (oldest deadline 2024-09-12T03:05:51.646619+0000) 2024-09-12T03:06:01.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:01 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:06:01.483+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:31.647129+0000 front 2024-09-12T03:05:31.647173+0000 (oldest deadline 2024-09-12T03:05:59.247821+0000) 2024-09-12T03:06:01.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:01 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:01.358+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:01.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:01 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:01.358+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:01.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:01 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:01.358+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:01.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:01 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:01.358+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:02.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:01 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:01.780+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:02.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:01 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:01.780+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:02.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:01 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:01.780+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:02.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:01 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:01.743+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:02.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:01 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:01.743+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:02.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:01 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:01.743+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:02.533 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:02 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:02.050+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:06:02.534 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:02 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:02.050+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:06:02.534 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:02 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:02.050+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.601350+0000 front 2024-09-12T03:05:34.601221+0000 (oldest deadline 2024-09-12T03:05:59.301116+0000) 2024-09-12T03:06:02.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:02 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:02.130+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:02.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:02 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:02.130+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:02.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:02 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:02.130+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:02.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:02 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:02.130+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:02.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:02 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:06:02.468+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:08.342128+0000 front 2024-09-12T03:05:08.342155+0000 (oldest deadline 2024-09-12T03:05:33.642277+0000) 2024-09-12T03:06:02.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:02 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:06:02.468+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.345101+0000 front 2024-09-12T03:05:19.345255+0000 (oldest deadline 2024-09-12T03:05:44.645252+0000) 2024-09-12T03:06:02.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:02 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:06:02.468+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.347098+0000 front 2024-09-12T03:05:26.346875+0000 (oldest deadline 2024-09-12T03:05:51.646619+0000) 2024-09-12T03:06:02.851 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:02 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6[57982]: 2024-09-12T03:06:02.468+0000 7f5693c00640 -1 osd.6 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:31.647129+0000 front 2024-09-12T03:05:31.647173+0000 (oldest deadline 2024-09-12T03:05:59.247821+0000) 2024-09-12T03:06:02.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:02 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:02.357+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:02.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:02 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:02.357+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:02.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:02 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:02.357+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:02.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:02 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:02.357+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:03.228 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:02 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:02.735+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:03.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:02 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:02.735+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:03.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:02 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:02.735+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:03.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:02 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:02.764+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:03.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:02 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:02.764+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:03.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:02 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:02.764+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:03.533 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:03 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:03.044+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:06:03.533 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:03 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:03.044+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:06:03.533 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:03 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:03.044+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.601350+0000 front 2024-09-12T03:05:34.601221+0000 (oldest deadline 2024-09-12T03:05:59.301116+0000) 2024-09-12T03:06:03.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:03 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:03.169+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:03.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:03 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:03.169+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:03.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:03 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:03.169+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:03.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:03 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:03.169+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:03.669 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:03 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:03.356+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:03.669 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:03 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:03.356+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:03.670 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:03 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:03.356+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:03.670 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:03 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:03.356+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:03.978 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:03 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:03.733+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:03.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:03 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:03.733+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:03.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:03 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:03.733+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:03.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:03 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:03.704+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:03.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:03 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:03.704+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:03.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:03 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:03.704+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:04.100 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:03 smithi018 podman[97862]: 2024-09-12 03:06:03.669019355 +0000 UTC m=+5.884249234 container died ed54eb733beb98a45c6ce4161377a9d5b4f599b2954f4ca2c4a3a2ed20adab9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-12T03:06:04.361 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:04 smithi018 podman[97862]: 2024-09-12 03:06:04.304598671 +0000 UTC m=+6.519828553 container cleanup ed54eb733beb98a45c6ce4161377a9d5b4f599b2954f4ca2c4a3a2ed20adab9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-12T03:06:04.362 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:04 smithi018 bash[97862]: ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6 2024-09-12T03:06:04.534 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:04 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:04.053+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:06:04.534 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:04 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:04.053+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:06:04.534 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:04 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:04.053+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.601350+0000 front 2024-09-12T03:05:34.601221+0000 (oldest deadline 2024-09-12T03:05:59.301116+0000) 2024-09-12T03:06:04.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:04 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:04.133+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:04.535 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:04 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:04.133+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:04.535 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:04 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:04.133+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:04.535 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:04 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:04.133+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:04.850 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:04 smithi018 podman[97882]: 2024-09-12 03:06:04.606368625 +0000 UTC m=+0.908140097 container remove ed54eb733beb98a45c6ce4161377a9d5b4f599b2954f4ca2c4a3a2ed20adab9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-12T03:06:04.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:04 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:04.360+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:04.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:04 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:04.360+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:04.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:04 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:04.360+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:04.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:04 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:04.360+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:05.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:04 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:04.772+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:05.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:04 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:04.772+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:05.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:04 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:04.772+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:05.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:04 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:04.749+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:05.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:04 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:04.749+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:05.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:04 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:04.749+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:05.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:05 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:05.033+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:06:05.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:05 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:05.033+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:06:05.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:05 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:05.033+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.601350+0000 front 2024-09-12T03:05:34.601221+0000 (oldest deadline 2024-09-12T03:05:59.301116+0000) 2024-09-12T03:06:05.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:05 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:05.142+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:05.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:05 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:05.142+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:05.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:05 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:05.142+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:05.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:05 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:05.142+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:05.600 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:05 smithi018 podman[97969]: 2024-09-12 03:06:05.091851026 +0000 UTC m=+0.027785466 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T03:06:05.601 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:05 smithi018 podman[97969]: 2024-09-12 03:06:05.223813465 +0000 UTC m=+0.159747904 container create 2f7bfa00c2f008ff9a1c3dce647ea686290a8af9a4aaadef2838e8c52eb73036 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-12T03:06:05.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:05 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:05.406+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:05.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:05 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:05.406+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:05.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:05 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:05.406+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:05.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:05 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:05.406+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:05.906 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:05 smithi018 podman[97969]: 2024-09-12 03:06:05.636754014 +0000 UTC m=+0.572688456 container init 2f7bfa00c2f008ff9a1c3dce647ea686290a8af9a4aaadef2838e8c52eb73036 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-12T03:06:05.906 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:05 smithi018 podman[97969]: 2024-09-12 03:06:05.643585162 +0000 UTC m=+0.579519596 container start 2f7bfa00c2f008ff9a1c3dce647ea686290a8af9a4aaadef2838e8c52eb73036 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T03:06:05.906 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:05 smithi018 podman[97969]: 2024-09-12 03:06:05.742837949 +0000 UTC m=+0.678772410 container attach 2f7bfa00c2f008ff9a1c3dce647ea686290a8af9a4aaadef2838e8c52eb73036 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-12T03:06:06.152 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:05 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:05.731+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:06.153 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:05 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:05.731+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:06.153 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:05 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:05.731+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:06.153 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:05 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:05.732+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:06.153 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:05 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:05.732+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:06.153 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:05 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:05.732+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:06.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:06 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:06.026+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:06:06.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:06 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:06.026+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:06:06.284 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:06 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:06.026+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.601350+0000 front 2024-09-12T03:05:34.601221+0000 (oldest deadline 2024-09-12T03:05:59.301116+0000) 2024-09-12T03:06:06.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:06 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:06.126+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:06.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:06 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:06.126+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:06.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:06 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:06.126+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:06.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:06 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:06.126+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:06.305 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 12 03:06:05 smithi018 podman[97992]: 2024-09-12 03:06:05.94709562 +0000 UTC m=+0.026854890 container died 2f7bfa00c2f008ff9a1c3dce647ea686290a8af9a4aaadef2838e8c52eb73036 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-12T03:06:06.600 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:06 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:06.406+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:06.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:06 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:06.406+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:06.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:06 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:06.406+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:06.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:06 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:06.406+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:06.740 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.6.service' 2024-09-12T03:06:06.820 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:06:06.820 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-12T03:06:06.820 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-12T03:06:06.820 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.7 2024-09-12T03:06:06.978 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:06 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:06.708+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:06.978 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:06 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:06.708+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:06.978 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:06 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:06.708+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:06.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:06 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:06.696+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:06.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:06 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:06.696+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:06.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:06 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:06.696+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:07.110 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:06 smithi062 systemd[1]: Stopping Ceph osd.7 for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:06:07.110 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:06 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:06.987+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:06:07.110 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:06 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:06.987+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:06:07.110 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:06 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:06.987+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.601350+0000 front 2024-09-12T03:05:34.601221+0000 (oldest deadline 2024-09-12T03:05:59.301116+0000) 2024-09-12T03:06:07.533 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:07 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:07.147+0000 7f54c247e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:06:07.533 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:07 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:07.147+0000 7f54c247e640 -1 osd.7 123 *** Got signal Terminated *** 2024-09-12T03:06:07.533 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:07 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:07.147+0000 7f54c247e640 -1 osd.7 123 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T03:06:07.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:07 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:07.109+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:07.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:07 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:07.109+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:07.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:07 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:07.109+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:07.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:07 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:07.109+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:07.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:07 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:07.357+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:07.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:07 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:07.357+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:07.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:07 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:07.357+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:07.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:07 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:07.357+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:07.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:07 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:07.357+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:07.978 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:07 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:07.687+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:07.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:07 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:07.687+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:07.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:07 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:07.687+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:07.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:07 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:07.651+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:07.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:07 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:07.651+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:07.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:07 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:07.651+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:08.284 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:08 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:07.999+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:06:08.284 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:08 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:07.999+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:06:08.284 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:08 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:07.999+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.601350+0000 front 2024-09-12T03:05:34.601221+0000 (oldest deadline 2024-09-12T03:05:59.301116+0000) 2024-09-12T03:06:08.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:08 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:08.154+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:08.285 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:08 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:08.154+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:08.285 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:08 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:08.154+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:08.285 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:08 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:08.154+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:08.285 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:08 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:08.154+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:08.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:08 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:08.382+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:08.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:08 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:08.382+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:08.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:08 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:08.382+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:08.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:08 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:08.382+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:08.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:08 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:08.382+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:08.978 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:08 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:08.680+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:08.978 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:08 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:08.680+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:08.978 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:08 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:08.680+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:08.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:08 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:08.654+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:08.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:08 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:08.654+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:08.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:08 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:08.654+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:08.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:08 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:08.654+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:09.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:08 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:08.972+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:06:09.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:08 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:08.972+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:06:09.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:08 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:08.972+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.601350+0000 front 2024-09-12T03:05:34.601221+0000 (oldest deadline 2024-09-12T03:05:59.301116+0000) 2024-09-12T03:06:09.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:09 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:09.118+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:09.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:09 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:09.118+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:09.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:09 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:09.118+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:09.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:09 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:09.118+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:09.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:09 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:09.118+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:09.850 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:09 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:09.404+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:09.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:09 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:09.404+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:09.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:09 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:09.404+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:09.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:09 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:09.404+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:09.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:09 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:09.404+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:09.978 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:09 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:09.723+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:09.978 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:09 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:09.723+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:09.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:09 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:09.723+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:09.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:09 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:09.723+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:43.548832+0000 front 2024-09-12T03:05:43.548848+0000 (oldest deadline 2024-09-12T03:06:09.448768+0000) 2024-09-12T03:06:09.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:09 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:09.694+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:09.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:09 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:09.694+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:09.980 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:09 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:09.694+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:09.980 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:09 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:09.694+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:10.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:09 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:09.944+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:06:10.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:09 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:09.944+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:06:10.284 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:09 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:09.944+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.601350+0000 front 2024-09-12T03:05:34.601221+0000 (oldest deadline 2024-09-12T03:05:59.301116+0000) 2024-09-12T03:06:10.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:10 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:10.118+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:10.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:10 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:10.118+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:10.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:10 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:10.118+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:10.285 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:10 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:10.118+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:10.285 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:10 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:10.118+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:10.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:10 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:10.389+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:10.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:10 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:10.389+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:10.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:10 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:10.389+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:10.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:10 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:10.389+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:10.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:10 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:10.389+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:10.978 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:10 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:10.760+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:10.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:10 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:10.760+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:10.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:10 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:10.760+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:10.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:10 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:10.760+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:43.548832+0000 front 2024-09-12T03:05:43.548848+0000 (oldest deadline 2024-09-12T03:06:09.448768+0000) 2024-09-12T03:06:10.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:10 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:10.716+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:10.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:10 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:10.716+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:10.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:10 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:10.716+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:10.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:10 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:10.716+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:11.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:10 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:10.993+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:06:11.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:10 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:10.993+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:06:11.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:10 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:10.993+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.601350+0000 front 2024-09-12T03:05:34.601221+0000 (oldest deadline 2024-09-12T03:05:59.301116+0000) 2024-09-12T03:06:11.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:11 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:11.103+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:11.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:11 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:11.103+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:11.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:11 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:11.103+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:11.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:11 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:11.103+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:11.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:11 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:11.103+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:11.850 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:11 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:11.420+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:11.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:11 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:11.420+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:11.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:11 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:11.420+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:11.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:11 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:11.420+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:11.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:11 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:11.420+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:12.228 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:11 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:11.754+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:12.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:11 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:11.754+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:12.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:11 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:11.754+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:12.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:11 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:11.754+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:43.548832+0000 front 2024-09-12T03:05:43.548848+0000 (oldest deadline 2024-09-12T03:06:09.448768+0000) 2024-09-12T03:06:12.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:11 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:11.735+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:12.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:11 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:11.735+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:12.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:11 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:11.735+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:12.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:11 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:11.735+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:12.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:12 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:12.025+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:18.298294+0000 front 2024-09-12T03:05:18.298262+0000 (oldest deadline 2024-09-12T03:05:44.198473+0000) 2024-09-12T03:06:12.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:12 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:12.025+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.499797+0000 front 2024-09-12T03:05:26.499541+0000 (oldest deadline 2024-09-12T03:05:50.599645+0000) 2024-09-12T03:06:12.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:12 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:12.025+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.601350+0000 front 2024-09-12T03:05:34.601221+0000 (oldest deadline 2024-09-12T03:05:59.301116+0000) 2024-09-12T03:06:12.283 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:12 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7[53479]: 2024-09-12T03:06:12.025+0000 7f54baa8c640 -1 osd.7 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:43.402047+0000 front 2024-09-12T03:05:43.402101+0000 (oldest deadline 2024-09-12T03:06:11.002536+0000) 2024-09-12T03:06:12.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:12 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:12.095+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:12.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:12 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:12.095+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:12.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:12 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:12.095+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:12.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:12 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:12.095+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:12.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:12 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:12.095+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:12.783 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:12 smithi062 podman[73729]: 2024-09-12 03:06:12.619472248 +0000 UTC m=+5.596207394 container died 96096859b1181ea3a956a24be114b4cdda992deec8341fcab65bf7869fc0c115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-12T03:06:12.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:12.453+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:12.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:12.453+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:12.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:12.453+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:12.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:12.453+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:12.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:12 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:12.453+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:12.978 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:12 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:12.769+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:12.978 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:12 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:12.769+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:12.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:12 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:12.769+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:12.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:12 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:12.769+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:43.548832+0000 front 2024-09-12T03:05:43.548848+0000 (oldest deadline 2024-09-12T03:06:09.448768+0000) 2024-09-12T03:06:12.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:12 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:12.695+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:12.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:12 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:12.695+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:12.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:12 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:12.695+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:12.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:12 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:12.695+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:13.240 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:13 smithi062 podman[73729]: 2024-09-12 03:06:13.022006427 +0000 UTC m=+5.998741569 container cleanup 96096859b1181ea3a956a24be114b4cdda992deec8341fcab65bf7869fc0c115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T03:06:13.240 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:13 smithi062 bash[73729]: ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7 2024-09-12T03:06:13.240 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:13 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:13.119+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:13.240 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:13 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:13.119+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:13.240 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:13 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:13.119+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:13.241 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:13 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:13.119+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:13.241 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:13 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:13.119+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:13.526 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:13 smithi062 podman[73749]: 2024-09-12 03:06:13.240033419 +0000 UTC m=+0.617598282 container remove 96096859b1181ea3a956a24be114b4cdda992deec8341fcab65bf7869fc0c115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T03:06:13.783 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:13 smithi062 podman[73844]: 2024-09-12 03:06:13.474974062 +0000 UTC m=+0.015799434 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T03:06:13.783 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:13 smithi062 podman[73844]: 2024-09-12 03:06:13.582513292 +0000 UTC m=+0.123338663 container create ce21d34ab3b3d117c19f210e7e7e5bbb580a8dbe11952da0b58caec8b272be76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-12T03:06:13.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:13 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:13.417+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:13.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:13 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:13.417+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:13.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:13 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:13.417+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:13.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:13 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:13.417+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:13.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:13 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:13.417+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:13.978 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:13 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:13.746+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:13.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:13 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:13.746+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:13.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:13 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:13.746+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:13.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:13 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:13.746+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:43.548832+0000 front 2024-09-12T03:05:43.548848+0000 (oldest deadline 2024-09-12T03:06:09.448768+0000) 2024-09-12T03:06:13.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:13 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:13.685+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:13.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:13 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:13.685+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:13.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:13 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:13.685+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:13.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:13 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:13.685+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:14.044 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:13 smithi062 podman[73844]: 2024-09-12 03:06:13.826959799 +0000 UTC m=+0.367785170 container init ce21d34ab3b3d117c19f210e7e7e5bbb580a8dbe11952da0b58caec8b272be76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-12T03:06:14.044 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:13 smithi062 podman[73844]: 2024-09-12 03:06:13.83017918 +0000 UTC m=+0.371004553 container start ce21d34ab3b3d117c19f210e7e7e5bbb580a8dbe11952da0b58caec8b272be76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T03:06:14.045 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:13 smithi062 podman[73844]: 2024-09-12 03:06:13.935511174 +0000 UTC m=+0.476336556 container attach ce21d34ab3b3d117c19f210e7e7e5bbb580a8dbe11952da0b58caec8b272be76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T03:06:14.045 INFO:journalctl@ceph.osd.7.smithi062.stdout:Sep 12 03:06:14 smithi062 podman[73844]: 2024-09-12 03:06:14.021440593 +0000 UTC m=+0.562265963 container died ce21d34ab3b3d117c19f210e7e7e5bbb580a8dbe11952da0b58caec8b272be76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T03:06:14.380 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:14 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:14.074+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:14.380 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:14 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:14.074+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:14.380 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:14 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:14.074+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:14.381 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:14 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:14.074+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:14.381 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:14 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:14.074+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:14.688 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.7.service' 2024-09-12T03:06:14.731 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:06:14.732 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-12T03:06:14.732 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-12T03:06:14.732 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.8 2024-09-12T03:06:14.850 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:14 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:14.378+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:14.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:14 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:14.378+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:14.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:14 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:14.378+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:14.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:14 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:14.378+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:14.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:14 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:14.378+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:14.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:14 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:14.736+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:14.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:14 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:14.736+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:14.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:14 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:14.736+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:14.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:14 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:14.736+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:43.548832+0000 front 2024-09-12T03:05:43.548848+0000 (oldest deadline 2024-09-12T03:06:09.448768+0000) 2024-09-12T03:06:14.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:14 smithi176 systemd[1]: Stopping Ceph osd.8 for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:06:14.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:14 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:14.686+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:14.980 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:14 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:14.686+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:14.980 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:14 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:14.686+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:14.980 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:14 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:14.687+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:15.478 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:15 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:15.042+0000 7f7662f27640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:06:15.479 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:15 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:15.042+0000 7f7662f27640 -1 osd.8 123 *** Got signal Terminated *** 2024-09-12T03:06:15.479 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:15 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:15.042+0000 7f7662f27640 -1 osd.8 123 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T03:06:15.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:15 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:15.110+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:15.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:15 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:15.110+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:15.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:15 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:15.110+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:15.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:15 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:15.110+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:15.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:15 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:15.110+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:15.850 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:15 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:15.367+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:15.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:15 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:15.367+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:15.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:15 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:15.367+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:15.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:15 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:15.367+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:15.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:15 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:15.367+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:15.978 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:15 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:15.758+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:15.978 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:15 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:15.758+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:15.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:15 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:15.758+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:15.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:15 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:15.758+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:43.548832+0000 front 2024-09-12T03:05:43.548848+0000 (oldest deadline 2024-09-12T03:06:09.448768+0000) 2024-09-12T03:06:15.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:15 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:15.716+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:15.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:15 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:15.716+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:15.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:15 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:15.716+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:15.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:15 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:15.716+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:16.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:16 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:16.124+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:16.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:16 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:16.124+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:16.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:16 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:16.124+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:16.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:16 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:16.124+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:16.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:16 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:16.124+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:16.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:16 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:16.320+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:16.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:16 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:16.320+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:16.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:16 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:16.320+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:16.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:16 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:16.320+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:16.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:16 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:16.320+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:16.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:16 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:16.320+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:51.639947+0000 front 2024-09-12T03:05:51.639836+0000 (oldest deadline 2024-09-12T03:06:15.739812+0000) 2024-09-12T03:06:16.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:16 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:16.795+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:16.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:16 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:16.795+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:16.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:16 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:16.795+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:16.979 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:16 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:16.795+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:43.548832+0000 front 2024-09-12T03:05:43.548848+0000 (oldest deadline 2024-09-12T03:06:09.448768+0000) 2024-09-12T03:06:16.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:16 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:16.755+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:16.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:16 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:16.755+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:16.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:16 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:16.755+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:16.980 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:16 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:16.755+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:17.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:17 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:17.075+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:17.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:17 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:17.075+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:17.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:17 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:17.075+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:17.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:17 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:17.075+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:17.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:17 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:17.075+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:17.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:17 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:17.296+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:17.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:17 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:17.296+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:17.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:17 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:17.296+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:17.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:17 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:17.296+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:17.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:17 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:17.296+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:17.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:17 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:17.296+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:51.639947+0000 front 2024-09-12T03:05:51.639836+0000 (oldest deadline 2024-09-12T03:06:15.739812+0000) 2024-09-12T03:06:18.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:17.753+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:18.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:17.753+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:18.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:17.753+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:18.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:17.753+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:43.548832+0000 front 2024-09-12T03:05:43.548848+0000 (oldest deadline 2024-09-12T03:06:09.448768+0000) 2024-09-12T03:06:18.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:17.753+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:49.449247+0000 front 2024-09-12T03:05:49.449262+0000 (oldest deadline 2024-09-12T03:06:17.649724+0000) 2024-09-12T03:06:18.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:17.770+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:18.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:17.770+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:18.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:17.770+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:18.230 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:17.770+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:18.230 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:17 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:17.770+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:18.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:18 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:18.108+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:18.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:18 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:18.108+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:18.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:18 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:18.108+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:18.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:18 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:18.108+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:18.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:18 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:18.108+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:18.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:18 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:18.108+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:18.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:18 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:18.300+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:18.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:18 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:18.300+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:18.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:18 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:18.300+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:18.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:18 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:18.300+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:18.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:18 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:18.300+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:18.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:18 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:18.300+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:51.639947+0000 front 2024-09-12T03:05:51.639836+0000 (oldest deadline 2024-09-12T03:06:15.739812+0000) 2024-09-12T03:06:19.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:18 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:18.749+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:19.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:18 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:18.749+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:19.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:18 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:18.749+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:19.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:18 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:18.749+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:43.548832+0000 front 2024-09-12T03:05:43.548848+0000 (oldest deadline 2024-09-12T03:06:09.448768+0000) 2024-09-12T03:06:19.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:18 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:18.749+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:49.449247+0000 front 2024-09-12T03:05:49.449262+0000 (oldest deadline 2024-09-12T03:06:17.649724+0000) 2024-09-12T03:06:19.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:18 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:18.761+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:19.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:18 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:18.761+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:19.230 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:18 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:18.761+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:19.230 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:18 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:18.761+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:19.230 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:18 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:18.761+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:19.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:19 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:19.073+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:19.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:19 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:19.073+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:19.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:19 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:19.073+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:19.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:19 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:19.073+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:19.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:19 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:19.073+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:19.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:19 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:19.073+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:19.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:19 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:19.335+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:19.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:19 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:19.335+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:19.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:19 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:19.335+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:19.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:19 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:19.335+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:19.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:19 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:19.335+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:19.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:19 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:19.335+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:51.639947+0000 front 2024-09-12T03:05:51.639836+0000 (oldest deadline 2024-09-12T03:06:15.739812+0000) 2024-09-12T03:06:19.980 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:19 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:19.737+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:20.145330+0000 front 2024-09-12T03:05:20.145097+0000 (oldest deadline 2024-09-12T03:05:43.645091+0000) 2024-09-12T03:06:19.981 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:19 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:19.737+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:25.346110+0000 front 2024-09-12T03:05:25.346178+0000 (oldest deadline 2024-09-12T03:05:50.046260+0000) 2024-09-12T03:06:19.981 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:19 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:19.737+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:34.747557+0000 front 2024-09-12T03:05:34.747530+0000 (oldest deadline 2024-09-12T03:05:58.847737+0000) 2024-09-12T03:06:19.981 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:19 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:19.737+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:43.548832+0000 front 2024-09-12T03:05:43.548848+0000 (oldest deadline 2024-09-12T03:06:09.448768+0000) 2024-09-12T03:06:19.981 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:19 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8[54219]: 2024-09-12T03:06:19.737+0000 7f765b535640 -1 osd.8 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:49.449247+0000 front 2024-09-12T03:05:49.449262+0000 (oldest deadline 2024-09-12T03:06:17.649724+0000) 2024-09-12T03:06:19.981 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:19 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:19.722+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:19.981 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:19 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:19.722+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:19.981 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:19 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:19.722+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:19.981 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:19 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:19.722+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:19.981 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:19 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:19.722+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:20.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:20 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:20.081+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:20.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:20 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:20.081+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:20.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:20 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:20.081+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:20.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:20 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:20.081+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:20.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:20 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:20.081+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:20.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:20 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:20.081+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:20.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:20 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:20.379+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:20.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:20 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:20.379+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:20.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:20 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:20.379+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:20.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:20 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:20.379+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:20.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:20 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:20.379+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:20.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:20 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:20.379+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:51.639947+0000 front 2024-09-12T03:05:51.639836+0000 (oldest deadline 2024-09-12T03:06:15.739812+0000) 2024-09-12T03:06:20.977 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:20 smithi176 podman[74016]: 2024-09-12 03:06:20.67489647 +0000 UTC m=+5.750552723 container died 4f0df3ee9568bbd352c7dc007105e24f7d6d9a16dc0d922b5df4e7a1df4171c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T03:06:20.977 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:20 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:20.741+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:20.977 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:20 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:20.741+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:20.977 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:20 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:20.741+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:20.977 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:20 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:20.741+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:20.977 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:20 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:20.741+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:21.228 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:21 smithi176 podman[74016]: 2024-09-12 03:06:21.081626232 +0000 UTC m=+6.157282495 container cleanup 4f0df3ee9568bbd352c7dc007105e24f7d6d9a16dc0d922b5df4e7a1df4171c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-12T03:06:21.228 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:21 smithi176 bash[74016]: ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8 2024-09-12T03:06:21.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:21 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:21.070+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:21.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:21 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:21.070+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:21.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:21 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:21.070+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:21.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:21 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:21.070+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:21.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:21 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:21.070+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:21.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:21 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:21.070+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:21.689 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:21 smithi176 podman[74032]: 2024-09-12 03:06:21.377001957 +0000 UTC m=+0.702672793 container remove 4f0df3ee9568bbd352c7dc007105e24f7d6d9a16dc0d922b5df4e7a1df4171c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T03:06:21.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:21 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:21.405+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:21.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:21 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:21.405+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:21.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:21 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:21.405+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:21.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:21 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:21.405+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:21.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:21 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:21.405+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:21.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:21 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:21.405+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:51.639947+0000 front 2024-09-12T03:05:51.639836+0000 (oldest deadline 2024-09-12T03:06:15.739812+0000) 2024-09-12T03:06:21.955 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:21 smithi176 podman[74120]: 2024-09-12 03:06:21.592642598 +0000 UTC m=+0.015454943 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T03:06:21.955 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:21 smithi176 podman[74120]: 2024-09-12 03:06:21.70276323 +0000 UTC m=+0.125575578 container create 3c7ab33babaf032826a888819e52537ec84d4290ef42c93c54aee3aca748d1bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-12T03:06:21.955 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:21 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:21.747+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:21.955 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:21 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:21.747+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:21.955 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:21 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:21.747+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:21.955 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:21 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:21.747+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:21.956 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:21 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:21.747+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:22.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:21 smithi176 podman[74120]: 2024-09-12 03:06:21.955208166 +0000 UTC m=+0.378020524 container init 3c7ab33babaf032826a888819e52537ec84d4290ef42c93c54aee3aca748d1bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3) 2024-09-12T03:06:22.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:21 smithi176 podman[74120]: 2024-09-12 03:06:21.958795823 +0000 UTC m=+0.381608175 container start 3c7ab33babaf032826a888819e52537ec84d4290ef42c93c54aee3aca748d1bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T03:06:22.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:22 smithi176 podman[74120]: 2024-09-12 03:06:22.038520071 +0000 UTC m=+0.461332426 container attach 3c7ab33babaf032826a888819e52537ec84d4290ef42c93c54aee3aca748d1bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-12T03:06:22.229 INFO:journalctl@ceph.osd.8.smithi176.stdout:Sep 12 03:06:22 smithi176 podman[74120]: 2024-09-12 03:06:22.145568048 +0000 UTC m=+0.568380411 container died 3c7ab33babaf032826a888819e52537ec84d4290ef42c93c54aee3aca748d1bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-12T03:06:22.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:22 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:22.043+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:22.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:22 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:22.043+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:22.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:22 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:22.043+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:22.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:22 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:22.043+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:22.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:22 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:22.043+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:22.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:22 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:22.043+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:22.776 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.8.service' 2024-09-12T03:06:22.815 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:06:22.815 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-12T03:06:22.815 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-12T03:06:22.815 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.9 2024-09-12T03:06:22.850 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:22 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:22.407+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:22.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:22 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:22.407+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:22.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:22 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:22.407+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:22.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:22 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:22.407+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:22.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:22 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:22.407+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:22.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:22 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:22.407+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:51.639947+0000 front 2024-09-12T03:05:51.639836+0000 (oldest deadline 2024-09-12T03:06:15.739812+0000) 2024-09-12T03:06:23.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:22 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:22.767+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:23.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:22 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:22.767+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:23.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:22 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:22.767+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:23.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:22 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:22.767+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:23.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:22 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:22.767+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:23.242 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:22 smithi018 systemd[1]: Stopping Ceph osd.9 for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:06:23.242 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:23 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:23.241+0000 7f3a08000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:06:23.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:23 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:23.020+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:23.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:23 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:23.020+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:23.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:23 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:23.020+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:23.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:23 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:23.020+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:23.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:23 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:23.020+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:23.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:23 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:23.020+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:23.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:23 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:23.241+0000 7f3a08000640 -1 osd.9 123 *** Got signal Terminated *** 2024-09-12T03:06:23.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:23 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:23.241+0000 7f3a08000640 -1 osd.9 123 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T03:06:23.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:23 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:23.395+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:23.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:23 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:23.395+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:23.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:23 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:23.395+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:23.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:23 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:23.395+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:23.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:23 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:23.395+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:23.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:23 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:23.395+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:51.639947+0000 front 2024-09-12T03:05:51.639836+0000 (oldest deadline 2024-09-12T03:06:15.739812+0000) 2024-09-12T03:06:24.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:23 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:23.787+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:24.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:23 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:23.787+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:24.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:23 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:23.787+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:24.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:23 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:23.787+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:24.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:23 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:23.787+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:24.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:24 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:24.050+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:24.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:24 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:24.050+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:24.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:24 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:24.050+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:24.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:24 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:24.050+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:24.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:24 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:24.050+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:24.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:24 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:24.050+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:24.850 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:24 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:24.385+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:24.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:24 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:24.385+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:24.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:24 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:24.385+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:24.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:24 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:24.385+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:24.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:24 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:24.385+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:24.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:24 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:24.385+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:51.639947+0000 front 2024-09-12T03:05:51.639836+0000 (oldest deadline 2024-09-12T03:06:15.739812+0000) 2024-09-12T03:06:25.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:24 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:24.798+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:25.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:24 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:24.798+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:25.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:24 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:24.798+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:25.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:24 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:24.798+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:25.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:24 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:24.798+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:25.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:25 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:25.052+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:25.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:25 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:25.052+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:25.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:25 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:25.052+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:25.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:25 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:25.052+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:25.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:25 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:25.052+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:25.534 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:25 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:25.052+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:25.850 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:25 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:25.374+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:25.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:25 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:25.374+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:25.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:25 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:25.374+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:25.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:25 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:25.374+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:25.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:25 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:25.374+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:25.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:25 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:25.374+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:51.639947+0000 front 2024-09-12T03:05:51.639836+0000 (oldest deadline 2024-09-12T03:06:15.739812+0000) 2024-09-12T03:06:26.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:25 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:25.770+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:26.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:25 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:25.770+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:26.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:25 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:25.770+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:26.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:25 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:25.770+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:26.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:25 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:25.770+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:26.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:26 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:26.016+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:26.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:26 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:26.016+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:26.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:26 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:26.016+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:26.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:26 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:26.016+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:26.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:26 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:26.016+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:26.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:26 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:26.016+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:26.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:26 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:26.016+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:06:02.397840+0000 front 2024-09-12T03:06:02.397966+0000 (oldest deadline 2024-09-12T03:06:25.297478+0000) 2024-09-12T03:06:26.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:26 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:26.339+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:26.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:26 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:26.339+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:26.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:26 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:26.339+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:26.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:26 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:26.339+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:26.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:26 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:26.339+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:26.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:26 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:26.339+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:51.639947+0000 front 2024-09-12T03:05:51.639836+0000 (oldest deadline 2024-09-12T03:06:15.739812+0000) 2024-09-12T03:06:27.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:26 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:26.754+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:27.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:26 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:26.754+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:27.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:26 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:26.754+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:27.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:26 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:26.754+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:27.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:26 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:26.754+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:27.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:26 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:26.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:27.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:26 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:26.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:27.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:26 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:26.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:27.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:26 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:26.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:27.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:26 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:26.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:27.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:26 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:26.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:27.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:26 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:26.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:06:02.397840+0000 front 2024-09-12T03:06:02.397966+0000 (oldest deadline 2024-09-12T03:06:25.297478+0000) 2024-09-12T03:06:27.850 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:27 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:27.357+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.131604+0000 front 2024-09-12T03:05:06.131675+0000 (oldest deadline 2024-09-12T03:05:32.031368+0000) 2024-09-12T03:06:27.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:27 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:27.357+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:19.632848+0000 front 2024-09-12T03:05:19.632888+0000 (oldest deadline 2024-09-12T03:05:41.333120+0000) 2024-09-12T03:06:27.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:27 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:27.357+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.234127+0000 front 2024-09-12T03:05:27.234184+0000 (oldest deadline 2024-09-12T03:05:51.934299+0000) 2024-09-12T03:06:27.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:27 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:27.357+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:36.436847+0000 front 2024-09-12T03:05:36.436801+0000 (oldest deadline 2024-09-12T03:06:01.137067+0000) 2024-09-12T03:06:27.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:27 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:27.357+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:41.137827+0000 front 2024-09-12T03:05:41.137746+0000 (oldest deadline 2024-09-12T03:06:06.938415+0000) 2024-09-12T03:06:27.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:27 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9[64509]: 2024-09-12T03:06:27.357+0000 7f3a03a00640 -1 osd.9 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:51.639947+0000 front 2024-09-12T03:05:51.639836+0000 (oldest deadline 2024-09-12T03:06:15.739812+0000) 2024-09-12T03:06:28.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:27 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:27.764+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:28.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:27 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:27.764+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:28.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:27 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:27.764+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:28.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:27 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:27.764+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:28.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:27 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:27.764+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:28.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:28 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:28.006+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:28.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:28 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:28.006+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:28.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:28 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:28.006+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:28.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:28 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:28.006+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:28.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:28 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:28.006+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:28.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:28 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:28.006+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:28.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:28 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:28.006+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:06:02.397840+0000 front 2024-09-12T03:06:02.397966+0000 (oldest deadline 2024-09-12T03:06:25.297478+0000) 2024-09-12T03:06:29.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:28 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:28.738+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:29.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:28 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:28.738+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:29.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:28 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:28.738+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:29.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:28 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:28.738+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:29.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:28 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:28.738+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:29.230 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:28 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:28.738+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:05:57.577348+0000 front 2024-09-12T03:05:57.577270+0000 (oldest deadline 2024-09-12T03:06:28.177862+0000) 2024-09-12T03:06:29.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:29 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:29.027+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:29.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:29 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:29.027+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:29.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:29 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:29.027+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:29.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:29 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:29.027+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:29.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:29 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:29.027+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:29.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:29 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:29.027+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:29.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:29 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:29.027+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:06:02.397840+0000 front 2024-09-12T03:06:02.397966+0000 (oldest deadline 2024-09-12T03:06:25.297478+0000) 2024-09-12T03:06:29.318 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:28 smithi018 podman[98085]: 2024-09-12 03:06:28.963619675 +0000 UTC m=+5.855366184 container died 123f0b51f1eb32ad9a4a40cc6bac1aa717ea3d30eda06003701de31466e91f69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T03:06:29.600 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:29 smithi018 podman[98085]: 2024-09-12 03:06:29.43967273 +0000 UTC m=+6.331419239 container cleanup 123f0b51f1eb32ad9a4a40cc6bac1aa717ea3d30eda06003701de31466e91f69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3) 2024-09-12T03:06:29.601 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:29 smithi018 bash[98085]: ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9 2024-09-12T03:06:30.100 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:29 smithi018 podman[98103]: 2024-09-12 03:06:29.677786633 +0000 UTC m=+0.689117841 container remove 123f0b51f1eb32ad9a4a40cc6bac1aa717ea3d30eda06003701de31466e91f69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T03:06:30.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:29 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:29.737+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:30.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:29 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:29.737+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:30.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:29 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:29.737+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:30.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:29 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:29.737+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:30.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:29 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:29.737+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:30.230 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:29 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:29.737+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:05:57.577348+0000 front 2024-09-12T03:05:57.577270+0000 (oldest deadline 2024-09-12T03:06:28.177862+0000) 2024-09-12T03:06:30.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:29 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:29.984+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:30.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:29 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:29.984+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:30.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:29 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:29.984+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:30.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:29 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:29.984+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:30.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:29 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:29.984+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:30.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:29 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:29.984+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:30.285 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:29 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:29.984+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:06:02.397840+0000 front 2024-09-12T03:06:02.397966+0000 (oldest deadline 2024-09-12T03:06:25.297478+0000) 2024-09-12T03:06:30.543 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:30 smithi018 podman[98190]: 2024-09-12 03:06:30.165509959 +0000 UTC m=+0.027877415 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T03:06:30.544 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:30 smithi018 podman[98190]: 2024-09-12 03:06:30.399035901 +0000 UTC m=+0.261403335 container create aa60d1a9f43d9e9a71619f0a0971646cd090016950bcc9f7e90420520773489c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-12T03:06:30.850 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:30 smithi018 podman[98190]: 2024-09-12 03:06:30.644950829 +0000 UTC m=+0.507318285 container init aa60d1a9f43d9e9a71619f0a0971646cd090016950bcc9f7e90420520773489c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-12T03:06:30.850 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:30 smithi018 podman[98190]: 2024-09-12 03:06:30.651878551 +0000 UTC m=+0.514245986 container start aa60d1a9f43d9e9a71619f0a0971646cd090016950bcc9f7e90420520773489c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-12T03:06:30.851 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:30 smithi018 podman[98190]: 2024-09-12 03:06:30.763916221 +0000 UTC m=+0.626283664 container attach aa60d1a9f43d9e9a71619f0a0971646cd090016950bcc9f7e90420520773489c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-12T03:06:31.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:30 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:30.780+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:31.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:30 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:30.780+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:31.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:30 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:30.780+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:31.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:30 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:30.780+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:31.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:30 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:30.780+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:31.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:30 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:30.780+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:05:57.577348+0000 front 2024-09-12T03:05:57.577270+0000 (oldest deadline 2024-09-12T03:06:28.177862+0000) 2024-09-12T03:06:31.273 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 12 03:06:30 smithi018 podman[98190]: 2024-09-12 03:06:30.910908315 +0000 UTC m=+0.773275758 container died aa60d1a9f43d9e9a71619f0a0971646cd090016950bcc9f7e90420520773489c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-12T03:06:31.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:30 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:30.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:31.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:30 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:30.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:31.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:30 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:30.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:31.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:30 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:30.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:31.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:30 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:30.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:31.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:30 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:30.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:31.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:30 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:30.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:06:02.397840+0000 front 2024-09-12T03:06:02.397966+0000 (oldest deadline 2024-09-12T03:06:25.297478+0000) 2024-09-12T03:06:31.666 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.9.service' 2024-09-12T03:06:31.786 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:06:31.786 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-12T03:06:31.786 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-12T03:06:31.786 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.10 2024-09-12T03:06:32.109 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:31 smithi062 systemd[1]: Stopping Ceph osd.10 for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:06:32.109 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:32 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:32.010+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:32.109 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:32 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:32.010+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:32.109 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:32 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:32.010+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:32.109 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:32 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:32.010+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:32.110 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:32 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:32.010+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:32.110 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:32 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:32.010+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:32.110 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:32 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:32.010+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:06:02.397840+0000 front 2024-09-12T03:06:02.397966+0000 (oldest deadline 2024-09-12T03:06:25.297478+0000) 2024-09-12T03:06:32.110 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:32 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:32.108+0000 7f61b3134640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:06:32.110 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:32 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:32.108+0000 7f61b3134640 -1 osd.10 123 *** Got signal Terminated *** 2024-09-12T03:06:32.110 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:32 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:32.108+0000 7f61b3134640 -1 osd.10 123 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T03:06:32.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:31 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:31.735+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:32.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:31 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:31.735+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:32.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:31 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:31.735+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:32.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:31 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:31.735+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:32.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:31 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:31.735+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:32.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:31 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:31.735+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:05:57.577348+0000 front 2024-09-12T03:05:57.577270+0000 (oldest deadline 2024-09-12T03:06:28.177862+0000) 2024-09-12T03:06:33.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:32 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:32.747+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:33.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:32 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:32.747+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:33.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:32 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:32.747+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:33.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:32 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:32.747+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:33.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:32 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:32.747+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:33.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:32 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:32.747+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:05:57.577348+0000 front 2024-09-12T03:05:57.577270+0000 (oldest deadline 2024-09-12T03:06:28.177862+0000) 2024-09-12T03:06:33.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:32 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:32.978+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:33.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:32 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:32.978+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:33.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:32 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:32.978+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:33.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:32 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:32.978+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:33.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:32 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:32.978+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:33.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:32 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:32.978+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:33.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:32 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:32.978+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:06:02.397840+0000 front 2024-09-12T03:06:02.397966+0000 (oldest deadline 2024-09-12T03:06:25.297478+0000) 2024-09-12T03:06:34.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:33 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:33.792+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:34.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:33 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:33.792+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:34.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:33 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:33.792+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:34.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:33 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:33.792+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:34.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:33 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:33.792+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:34.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:33 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:33.792+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:05:57.577348+0000 front 2024-09-12T03:05:57.577270+0000 (oldest deadline 2024-09-12T03:06:28.177862+0000) 2024-09-12T03:06:34.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:34 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:34.006+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:34.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:34 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:34.006+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:34.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:34 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:34.006+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:34.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:34 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:34.006+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:34.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:34 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:34.006+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:34.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:34 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:34.006+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:34.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:34 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:34.006+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:06:02.397840+0000 front 2024-09-12T03:06:02.397966+0000 (oldest deadline 2024-09-12T03:06:25.297478+0000) 2024-09-12T03:06:35.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:34 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:34.815+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:35.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:34 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:34.815+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:35.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:34 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:34.815+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:35.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:34 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:34.815+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:35.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:34 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:34.815+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:35.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:34 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:34.815+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:05:57.577348+0000 front 2024-09-12T03:05:57.577270+0000 (oldest deadline 2024-09-12T03:06:28.177862+0000) 2024-09-12T03:06:35.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:34 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:34.815+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-09-12T03:06:08.678885+0000 front 2024-09-12T03:06:08.678870+0000 (oldest deadline 2024-09-12T03:06:33.978759+0000) 2024-09-12T03:06:35.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:34 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:34.988+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:35.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:34 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:34.988+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:35.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:34 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:34.988+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:35.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:34 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:34.988+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:35.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:34 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:34.988+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:35.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:34 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:34.988+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:35.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:34 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:34.988+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:06:02.397840+0000 front 2024-09-12T03:06:02.397966+0000 (oldest deadline 2024-09-12T03:06:25.297478+0000) 2024-09-12T03:06:36.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:35.852+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:36.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:35.852+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:36.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:35.852+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:36.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:35.852+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:36.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:35.852+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:36.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:35.852+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:05:57.577348+0000 front 2024-09-12T03:05:57.577270+0000 (oldest deadline 2024-09-12T03:06:28.177862+0000) 2024-09-12T03:06:36.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:35 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:35.852+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-09-12T03:06:08.678885+0000 front 2024-09-12T03:06:08.678870+0000 (oldest deadline 2024-09-12T03:06:33.978759+0000) 2024-09-12T03:06:36.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:35.998+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:36.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:35.998+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:36.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:35.998+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:36.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:35.998+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:36.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:35.998+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:36.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:35.998+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:36.285 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:35 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:35.998+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:06:02.397840+0000 front 2024-09-12T03:06:02.397966+0000 (oldest deadline 2024-09-12T03:06:25.297478+0000) 2024-09-12T03:06:37.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:36 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:36.872+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:37.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:36 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:36.872+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:37.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:36 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:36.872+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:37.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:36 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:36.872+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:37.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:36 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:36.872+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:37.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:36 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:36.872+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:05:57.577348+0000 front 2024-09-12T03:05:57.577270+0000 (oldest deadline 2024-09-12T03:06:28.177862+0000) 2024-09-12T03:06:37.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:36 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:36.872+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-09-12T03:06:08.678885+0000 front 2024-09-12T03:06:08.678870+0000 (oldest deadline 2024-09-12T03:06:33.978759+0000) 2024-09-12T03:06:37.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:36 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:36.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:06.691214+0000 front 2024-09-12T03:05:06.691138+0000 (oldest deadline 2024-09-12T03:05:36.091521+0000) 2024-09-12T03:06:37.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:36 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:36.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:16.091885+0000 front 2024-09-12T03:05:16.091808+0000 (oldest deadline 2024-09-12T03:05:41.391929+0000) 2024-09-12T03:06:37.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:36 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:36.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:27.293043+0000 front 2024-09-12T03:05:27.292942+0000 (oldest deadline 2024-09-12T03:05:48.993072+0000) 2024-09-12T03:06:37.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:36 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:36.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-12T03:05:33.094593+0000 front 2024-09-12T03:05:33.094473+0000 (oldest deadline 2024-09-12T03:06:01.895081+0000) 2024-09-12T03:06:37.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:36 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:36.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:44.195957+0000 front 2024-09-12T03:05:44.195915+0000 (oldest deadline 2024-09-12T03:06:07.696022+0000) 2024-09-12T03:06:37.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:36 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:36.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:52.397113+0000 front 2024-09-12T03:05:52.396977+0000 (oldest deadline 2024-09-12T03:06:17.096778+0000) 2024-09-12T03:06:37.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:36 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10[60326]: 2024-09-12T03:06:36.991+0000 7f61af74a640 -1 osd.10 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:06:02.397840+0000 front 2024-09-12T03:06:02.397966+0000 (oldest deadline 2024-09-12T03:06:25.297478+0000) 2024-09-12T03:06:37.874 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:37 smithi062 podman[73950]: 2024-09-12 03:06:37.596386207 +0000 UTC m=+5.610615822 container died 2e04b9a0caa8a18cea8e5d00b01e841916fb3ff29cf5e32b85f96b6cbfb47d58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T03:06:38.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:37.856+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:38.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:37.856+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:38.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:37.856+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:38.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:37.856+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:38.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:37.857+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:38.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:37.857+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:05:57.577348+0000 front 2024-09-12T03:05:57.577270+0000 (oldest deadline 2024-09-12T03:06:28.177862+0000) 2024-09-12T03:06:38.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:37.857+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-09-12T03:06:08.678885+0000 front 2024-09-12T03:06:08.678870+0000 (oldest deadline 2024-09-12T03:06:33.978759+0000) 2024-09-12T03:06:38.244 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:37 smithi062 podman[73950]: 2024-09-12 03:06:37.985588823 +0000 UTC m=+5.999818441 container cleanup 2e04b9a0caa8a18cea8e5d00b01e841916fb3ff29cf5e32b85f96b6cbfb47d58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-12T03:06:38.245 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:37 smithi062 bash[73950]: ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10 2024-09-12T03:06:38.533 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:38 smithi062 podman[73965]: 2024-09-12 03:06:38.245079019 +0000 UTC m=+0.645249127 container remove 2e04b9a0caa8a18cea8e5d00b01e841916fb3ff29cf5e32b85f96b6cbfb47d58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T03:06:38.923 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:38 smithi062 podman[74052]: 2024-09-12 03:06:38.504916337 +0000 UTC m=+0.015823298 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T03:06:38.923 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:38 smithi062 podman[74052]: 2024-09-12 03:06:38.704190187 +0000 UTC m=+0.215097209 container create efd22dc3100d6da0d6b6e5d5062331b275406e36ed33a8b71d274637c7a37731 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T03:06:38.923 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:38 smithi062 podman[74052]: 2024-09-12 03:06:38.923270865 +0000 UTC m=+0.434177826 container init efd22dc3100d6da0d6b6e5d5062331b275406e36ed33a8b71d274637c7a37731 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T03:06:39.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:38 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:38.878+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:39.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:38 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:38.878+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:39.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:38 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:38.878+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:39.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:38 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:38.878+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:39.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:38 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:38.878+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:39.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:38 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:38.878+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:05:57.577348+0000 front 2024-09-12T03:05:57.577270+0000 (oldest deadline 2024-09-12T03:06:28.177862+0000) 2024-09-12T03:06:39.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:38 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:38.878+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-09-12T03:06:08.678885+0000 front 2024-09-12T03:06:08.678870+0000 (oldest deadline 2024-09-12T03:06:33.978759+0000) 2024-09-12T03:06:39.283 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:38 smithi062 podman[74052]: 2024-09-12 03:06:38.926543177 +0000 UTC m=+0.437450140 container start efd22dc3100d6da0d6b6e5d5062331b275406e36ed33a8b71d274637c7a37731 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10-deactivate, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T03:06:39.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:39 smithi062 podman[74052]: 2024-09-12 03:06:39.006575034 +0000 UTC m=+0.517482011 container attach efd22dc3100d6da0d6b6e5d5062331b275406e36ed33a8b71d274637c7a37731 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T03:06:39.284 INFO:journalctl@ceph.osd.10.smithi062.stdout:Sep 12 03:06:39 smithi062 podman[74052]: 2024-09-12 03:06:39.115166255 +0000 UTC m=+0.626073215 container died efd22dc3100d6da0d6b6e5d5062331b275406e36ed33a8b71d274637c7a37731 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-12T03:06:39.827 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.10.service' 2024-09-12T03:06:39.867 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:06:39.867 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-12T03:06:39.868 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-12T03:06:39.868 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.11 2024-09-12T03:06:40.162 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:39 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:39.887+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:40.162 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:39 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:39.887+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:40.162 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:39 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:39.887+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:40.162 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:39 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:39.887+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:40.162 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:39 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:39.887+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:40.162 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:39 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:39.887+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:05:57.577348+0000 front 2024-09-12T03:05:57.577270+0000 (oldest deadline 2024-09-12T03:06:28.177862+0000) 2024-09-12T03:06:40.162 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:39 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:39.887+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-09-12T03:06:08.678885+0000 front 2024-09-12T03:06:08.678870+0000 (oldest deadline 2024-09-12T03:06:33.978759+0000) 2024-09-12T03:06:40.162 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:39 smithi176 systemd[1]: Stopping Ceph osd.11 for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:06:40.163 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:40.161+0000 7f861a7b6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:06:40.163 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:40.161+0000 7f861a7b6640 -1 osd.11 123 *** Got signal Terminated *** 2024-09-12T03:06:40.163 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:40.161+0000 7f861a7b6640 -1 osd.11 123 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T03:06:41.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:40.871+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:41.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:40.871+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:41.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:40.871+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:41.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:40.871+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:41.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:40.871+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:41.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:40.871+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:05:57.577348+0000 front 2024-09-12T03:05:57.577270+0000 (oldest deadline 2024-09-12T03:06:28.177862+0000) 2024-09-12T03:06:41.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:40 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:40.871+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-09-12T03:06:08.678885+0000 front 2024-09-12T03:06:08.678870+0000 (oldest deadline 2024-09-12T03:06:33.978759+0000) 2024-09-12T03:06:42.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:41 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:41.906+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:42.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:41 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:41.906+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:42.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:41 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:41.906+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:42.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:41 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:41.906+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:42.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:41 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:41.906+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:42.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:41 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:41.906+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:05:57.577348+0000 front 2024-09-12T03:05:57.577270+0000 (oldest deadline 2024-09-12T03:06:28.177862+0000) 2024-09-12T03:06:42.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:41 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:41.906+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-09-12T03:06:08.678885+0000 front 2024-09-12T03:06:08.678870+0000 (oldest deadline 2024-09-12T03:06:33.978759+0000) 2024-09-12T03:06:43.228 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:42 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:42.920+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:43.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:42 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:42.920+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:43.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:42 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:42.920+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:43.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:42 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:42.920+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:43.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:42 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:42.920+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:43.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:42 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:42.920+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:05:57.577348+0000 front 2024-09-12T03:05:57.577270+0000 (oldest deadline 2024-09-12T03:06:28.177862+0000) 2024-09-12T03:06:43.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:42 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:42.920+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-09-12T03:06:08.678885+0000 front 2024-09-12T03:06:08.678870+0000 (oldest deadline 2024-09-12T03:06:33.978759+0000) 2024-09-12T03:06:44.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:43 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:43.924+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:44.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:43 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:43.924+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:44.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:43 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:43.924+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:44.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:43 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:43.924+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:44.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:43 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:43.924+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:44.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:43 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:43.924+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:05:57.577348+0000 front 2024-09-12T03:05:57.577270+0000 (oldest deadline 2024-09-12T03:06:28.177862+0000) 2024-09-12T03:06:44.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:43 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:43.925+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-09-12T03:06:08.678885+0000 front 2024-09-12T03:06:08.678870+0000 (oldest deadline 2024-09-12T03:06:33.978759+0000) 2024-09-12T03:06:45.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:44 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:44.944+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-12T03:05:09.369991+0000 front 2024-09-12T03:05:09.369849+0000 (oldest deadline 2024-09-12T03:05:34.669759+0000) 2024-09-12T03:06:45.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:44 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:44.944+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-09-12T03:05:15.770842+0000 front 2024-09-12T03:05:15.770946+0000 (oldest deadline 2024-09-12T03:05:41.070946+0000) 2024-09-12T03:06:45.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:44 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:44.944+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6804 osd.2 since back 2024-09-12T03:05:26.172741+0000 front 2024-09-12T03:05:26.172760+0000 (oldest deadline 2024-09-12T03:05:50.872786+0000) 2024-09-12T03:06:45.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:44 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:44.944+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-09-12T03:05:45.275824+0000 front 2024-09-12T03:05:45.275861+0000 (oldest deadline 2024-09-12T03:06:08.175798+0000) 2024-09-12T03:06:45.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:44 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:44.944+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6812 osd.5 since back 2024-09-12T03:05:53.476677+0000 front 2024-09-12T03:05:53.476695+0000 (oldest deadline 2024-09-12T03:06:17.576744+0000) 2024-09-12T03:06:45.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:44 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:44.944+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-12T03:05:57.577348+0000 front 2024-09-12T03:05:57.577270+0000 (oldest deadline 2024-09-12T03:06:28.177862+0000) 2024-09-12T03:06:45.229 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:44 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:44.944+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-09-12T03:06:08.678885+0000 front 2024-09-12T03:06:08.678870+0000 (oldest deadline 2024-09-12T03:06:33.978759+0000) 2024-09-12T03:06:45.230 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:44 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11[61167]: 2024-09-12T03:06:44.944+0000 7f8616dcc640 -1 osd.11 123 heartbeat_check: no reply from 172.21.15.176:6820 osd.8 since back 2024-09-12T03:06:18.580333+0000 front 2024-09-12T03:06:18.580349+0000 (oldest deadline 2024-09-12T03:06:44.480342+0000) 2024-09-12T03:06:45.978 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:45 smithi176 podman[74246]: 2024-09-12 03:06:45.735148342 +0000 UTC m=+5.669962349 container died bdbf878161649ce18586cc05f33806907c21b8e40327f5bf2152f4c089257c99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-12T03:06:46.261 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:46 smithi176 podman[74246]: 2024-09-12 03:06:46.077139494 +0000 UTC m=+6.011953498 container cleanup bdbf878161649ce18586cc05f33806907c21b8e40327f5bf2152f4c089257c99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T03:06:46.261 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:46 smithi176 bash[74246]: ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11 2024-09-12T03:06:46.679 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:46 smithi176 podman[74262]: 2024-09-12 03:06:46.261685288 +0000 UTC m=+0.522477557 container remove bdbf878161649ce18586cc05f33806907c21b8e40327f5bf2152f4c089257c99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-12T03:06:46.978 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:46 smithi176 podman[74350]: 2024-09-12 03:06:46.679045736 +0000 UTC m=+0.112330279 container create 214145dffd2424d629666f4521a91c4f28d11afb2b0a8999fd5bd11df484baf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T03:06:46.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:46 smithi176 podman[74350]: 2024-09-12 03:06:46.582307899 +0000 UTC m=+0.015592442 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T03:06:46.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:46 smithi176 podman[74350]: 2024-09-12 03:06:46.900574401 +0000 UTC m=+0.333858952 container init 214145dffd2424d629666f4521a91c4f28d11afb2b0a8999fd5bd11df484baf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-12T03:06:46.979 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:46 smithi176 podman[74350]: 2024-09-12 03:06:46.904323765 +0000 UTC m=+0.337608312 container start 214145dffd2424d629666f4521a91c4f28d11afb2b0a8999fd5bd11df484baf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-12T03:06:47.369 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:46 smithi176 podman[74350]: 2024-09-12 03:06:46.983357295 +0000 UTC m=+0.416641856 container attach 214145dffd2424d629666f4521a91c4f28d11afb2b0a8999fd5bd11df484baf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-12T03:06:47.370 INFO:journalctl@ceph.osd.11.smithi176.stdout:Sep 12 03:06:47 smithi176 podman[74350]: 2024-09-12 03:06:47.091433704 +0000 UTC m=+0.524718248 container died 214145dffd2424d629666f4521a91c4f28d11afb2b0a8999fd5bd11df484baf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T03:06:47.675 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@osd.11.service' 2024-09-12T03:06:47.717 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:06:47.717 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-12T03:06:47.717 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-12T03:06:47.718 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.a 2024-09-12T03:06:48.100 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 03:06:47 smithi018 systemd[1]: Stopping Ceph mds.a for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:06:48.600 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 03:06:48 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-a[71320]: 2024-09-12T03:06:48.186+0000 7f2818c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:06:48.601 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 03:06:48 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-a[71320]: 2024-09-12T03:06:48.186+0000 7f2818c00640 -1 mds.a *** got signal Terminated *** 2024-09-12T03:06:52.547 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 03:06:52 smithi018 podman[98316]: 2024-09-12 03:06:52.178290703 +0000 UTC m=+4.163752968 container died 1ee1e9374c0d463287141c0045097a3cdc9180011a99c59210e61560ce055dd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-12T03:06:52.850 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 03:06:52 smithi018 podman[98316]: 2024-09-12 03:06:52.666031607 +0000 UTC m=+4.651493877 container cleanup 1ee1e9374c0d463287141c0045097a3cdc9180011a99c59210e61560ce055dd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-12T03:06:52.850 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 03:06:52 smithi018 bash[98316]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-a 2024-09-12T03:06:53.260 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 12 03:06:53 smithi018 podman[98329]: 2024-09-12 03:06:53.00913314 +0000 UTC m=+0.814465198 container remove 1ee1e9374c0d463287141c0045097a3cdc9180011a99c59210e61560ce055dd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True) 2024-09-12T03:06:53.269 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.a.service' 2024-09-12T03:06:53.341 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:06:53.341 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-12T03:06:53.341 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-12T03:06:53.342 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.d 2024-09-12T03:06:53.601 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 12 03:06:53 smithi018 systemd[1]: Stopping Ceph mds.d for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:06:54.100 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 12 03:06:53 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-d[70199]: 2024-09-12T03:06:53.774+0000 7f1195200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:06:54.100 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 12 03:06:53 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-d[70199]: 2024-09-12T03:06:53.775+0000 7f1195200640 -1 mds.d *** got signal Terminated *** 2024-09-12T03:06:58.100 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 12 03:06:57 smithi018 podman[98434]: 2024-09-12 03:06:57.793989194 +0000 UTC m=+4.167830085 container died 04132871406c8e397602cffb91af713bbe6217c6874f49366a4c1b5a76ab8b4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-d, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T03:06:58.600 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 12 03:06:58 smithi018 podman[98434]: 2024-09-12 03:06:58.270235157 +0000 UTC m=+4.644076050 container cleanup 04132871406c8e397602cffb91af713bbe6217c6874f49366a4c1b5a76ab8b4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-d, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T03:06:58.600 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 12 03:06:58 smithi018 bash[98434]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-d 2024-09-12T03:06:58.933 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.d.service' 2024-09-12T03:06:59.003 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:06:59.004 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-12T03:06:59.004 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-12T03:06:59.004 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.g 2024-09-12T03:06:59.350 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 12 03:06:59 smithi018 systemd[1]: Stopping Ceph mds.g for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:06:59.850 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 12 03:06:59 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-g[70958]: 2024-09-12T03:06:59.521+0000 7faab7400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:06:59.850 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 12 03:06:59 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-g[70958]: 2024-09-12T03:06:59.521+0000 7faab7400640 -1 mds.g *** got signal Terminated *** 2024-09-12T03:07:03.850 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 12 03:07:03 smithi018 podman[98556]: 2024-09-12 03:07:03.53641419 +0000 UTC m=+4.250427955 container died 6383b0afb323e75cfb81903129c203e9fa38f33206ecbc5a529a0be5215e4f36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-12T03:07:04.351 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 12 03:07:04 smithi018 podman[98556]: 2024-09-12 03:07:04.015338471 +0000 UTC m=+4.729352225 container cleanup 6383b0afb323e75cfb81903129c203e9fa38f33206ecbc5a529a0be5215e4f36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-g, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-12T03:07:04.351 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 12 03:07:04 smithi018 bash[98556]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-g 2024-09-12T03:07:04.750 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 12 03:07:04 smithi018 podman[98569]: 2024-09-12 03:07:04.444880993 +0000 UTC m=+0.895703539 container remove 6383b0afb323e75cfb81903129c203e9fa38f33206ecbc5a529a0be5215e4f36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T03:07:04.772 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.g.service' 2024-09-12T03:07:04.842 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:07:04.842 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-12T03:07:04.842 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-12T03:07:04.843 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.j 2024-09-12T03:07:05.100 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 03:07:04 smithi018 systemd[1]: Stopping Ceph mds.j for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:07:05.600 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 03:07:05 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-j[69791]: 2024-09-12T03:07:05.229+0000 7f6ce2400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:07:05.600 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 03:07:05 smithi018 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-j[69791]: 2024-09-12T03:07:05.229+0000 7f6ce2400640 -1 mds.j *** got signal Terminated *** 2024-09-12T03:07:08.537 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 03:07:08 smithi018 podman[98677]: 2024-09-12 03:07:08.17295873 +0000 UTC m=+3.058579554 container died 27b489837ab4f00bd786b4d1294d7816d8d57f8945cc36ad1d664fa0aebc44fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-j, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T03:07:08.850 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 03:07:08 smithi018 podman[98677]: 2024-09-12 03:07:08.742078264 +0000 UTC m=+3.627699079 container cleanup 27b489837ab4f00bd786b4d1294d7816d8d57f8945cc36ad1d664fa0aebc44fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-j, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T03:07:08.851 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 03:07:08 smithi018 bash[98677]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-j 2024-09-12T03:07:09.350 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 12 03:07:09 smithi018 podman[98700]: 2024-09-12 03:07:09.045496053 +0000 UTC m=+0.838783635 container remove 27b489837ab4f00bd786b4d1294d7816d8d57f8945cc36ad1d664fa0aebc44fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-12T03:07:09.385 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.j.service' 2024-09-12T03:07:09.457 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:07:09.457 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-12T03:07:09.457 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-12T03:07:09.457 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.b 2024-09-12T03:07:09.777 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 03:07:09 smithi062 systemd[1]: Stopping Ceph mds.b for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:07:10.033 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 03:07:09 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-b[65969]: 2024-09-12T03:07:09.776+0000 7f1f6509e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:07:10.033 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 03:07:09 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-b[65969]: 2024-09-12T03:07:09.776+0000 7f1f6509e640 -1 mds.b *** got signal Terminated *** 2024-09-12T03:07:12.161 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 03:07:11 smithi062 podman[74154]: 2024-09-12 03:07:11.895140799 +0000 UTC m=+2.234509837 container died de9f39a716ffaaa0994b41fd5463cc8fa6b64ba540b663e88343d2d04350f20b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-12T03:07:12.519 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 03:07:12 smithi062 podman[74154]: 2024-09-12 03:07:12.25980108 +0000 UTC m=+2.599170102 container cleanup de9f39a716ffaaa0994b41fd5463cc8fa6b64ba540b663e88343d2d04350f20b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-12T03:07:12.519 INFO:journalctl@ceph.mds.b.smithi062.stdout:Sep 12 03:07:12 smithi062 bash[74154]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-b 2024-09-12T03:07:12.663 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.b.service' 2024-09-12T03:07:12.698 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:07:12.699 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-12T03:07:12.699 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-12T03:07:12.699 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.e 2024-09-12T03:07:13.283 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 03:07:12 smithi062 systemd[1]: Stopping Ceph mds.e for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:07:13.283 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 03:07:13 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-e[65366]: 2024-09-12T03:07:13.029+0000 7f0d3d9f7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:07:13.283 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 03:07:13 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-e[65366]: 2024-09-12T03:07:13.029+0000 7f0d3d9f7640 -1 mds.e *** got signal Terminated *** 2024-09-12T03:07:16.189 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 03:07:15 smithi062 podman[74286]: 2024-09-12 03:07:15.885217162 +0000 UTC m=+2.960077983 container died d964d8b0ca40d42ed720bcdd577d92adf5655c3632c16092b8fe4dea2218bb16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3) 2024-09-12T03:07:16.497 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 03:07:16 smithi062 podman[74286]: 2024-09-12 03:07:16.271921797 +0000 UTC m=+3.346782608 container cleanup d964d8b0ca40d42ed720bcdd577d92adf5655c3632c16092b8fe4dea2218bb16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T03:07:16.498 INFO:journalctl@ceph.mds.e.smithi062.stdout:Sep 12 03:07:16 smithi062 bash[74286]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-e 2024-09-12T03:07:16.635 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.e.service' 2024-09-12T03:07:16.669 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:07:16.669 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-12T03:07:16.669 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-12T03:07:16.669 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.h 2024-09-12T03:07:17.033 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 03:07:16 smithi062 systemd[1]: Stopping Ceph mds.h for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:07:17.033 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 03:07:17 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-h[65667]: 2024-09-12T03:07:17.001+0000 7f0beaeee640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:07:17.033 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 03:07:17 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-h[65667]: 2024-09-12T03:07:17.001+0000 7f0beaeee640 -1 mds.h *** got signal Terminated *** 2024-09-12T03:07:20.168 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 03:07:19 smithi062 podman[74407]: 2024-09-12 03:07:19.898736986 +0000 UTC m=+3.004938367 container died 71fddda72f21348dcfc1d9453bb505fb1360f5d0fc14cadd5f4098946880f8a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-h, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T03:07:20.521 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 03:07:20 smithi062 podman[74407]: 2024-09-12 03:07:20.267139974 +0000 UTC m=+3.373341396 container cleanup 71fddda72f21348dcfc1d9453bb505fb1360f5d0fc14cadd5f4098946880f8a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-h, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3) 2024-09-12T03:07:20.522 INFO:journalctl@ceph.mds.h.smithi062.stdout:Sep 12 03:07:20 smithi062 bash[74407]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-h 2024-09-12T03:07:20.695 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.h.service' 2024-09-12T03:07:20.729 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:07:20.729 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-12T03:07:20.730 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-12T03:07:20.730 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.k 2024-09-12T03:07:21.098 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 03:07:20 smithi062 systemd[1]: Stopping Ceph mds.k for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:07:21.533 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 03:07:21 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-k[65046]: 2024-09-12T03:07:21.171+0000 7f61831eb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:07:21.533 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 03:07:21 smithi062 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-k[65046]: 2024-09-12T03:07:21.171+0000 7f61831eb640 -1 mds.k *** got signal Terminated *** 2024-09-12T03:07:24.196 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 03:07:23 smithi062 podman[74526]: 2024-09-12 03:07:23.906598141 +0000 UTC m=+2.957784904 container died a638e8e00816f5c638829ffce8f662d79d0c4188f89a02f1ab79d58c927e3811 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-12T03:07:24.533 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 03:07:24 smithi062 podman[74526]: 2024-09-12 03:07:24.295480234 +0000 UTC m=+3.346666995 container cleanup a638e8e00816f5c638829ffce8f662d79d0c4188f89a02f1ab79d58c927e3811 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-k, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-12T03:07:24.533 INFO:journalctl@ceph.mds.k.smithi062.stdout:Sep 12 03:07:24 smithi062 bash[74526]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-k 2024-09-12T03:07:24.654 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.k.service' 2024-09-12T03:07:24.687 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:07:24.687 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-12T03:07:24.687 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-12T03:07:24.687 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.c 2024-09-12T03:07:24.978 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 03:07:24 smithi176 systemd[1]: Stopping Ceph mds.c for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:07:25.390 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 03:07:25 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-c[66093]: 2024-09-12T03:07:25.009+0000 7f4e37892640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:07:25.391 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 03:07:25 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-c[66093]: 2024-09-12T03:07:25.009+0000 7f4e37892640 -1 mds.c *** got signal Terminated *** 2024-09-12T03:07:28.152 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 03:07:27 smithi176 podman[74452]: 2024-09-12 03:07:27.868724595 +0000 UTC m=+2.985328627 container died 3e6e43c73e3a93bfb43e955f769a4b1e273c17b554ba53376bb563302c903c8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-c, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2) 2024-09-12T03:07:28.478 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 03:07:28 smithi176 podman[74452]: 2024-09-12 03:07:28.251411801 +0000 UTC m=+3.368015879 container cleanup 3e6e43c73e3a93bfb43e955f769a4b1e273c17b554ba53376bb563302c903c8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T03:07:28.479 INFO:journalctl@ceph.mds.c.smithi176.stdout:Sep 12 03:07:28 smithi176 bash[74452]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-c 2024-09-12T03:07:28.686 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.c.service' 2024-09-12T03:07:28.722 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:07:28.723 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-12T03:07:28.723 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-12T03:07:28.723 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.f 2024-09-12T03:07:29.228 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 03:07:28 smithi176 systemd[1]: Stopping Ceph mds.f for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:07:29.228 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 03:07:29 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-f[65788]: 2024-09-12T03:07:29.029+0000 7faed01e8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:07:29.228 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 03:07:29 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-f[65788]: 2024-09-12T03:07:29.029+0000 7faed01e8640 -1 mds.f *** got signal Terminated *** 2024-09-12T03:07:32.156 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 03:07:31 smithi176 podman[74586]: 2024-09-12 03:07:31.878478654 +0000 UTC m=+2.940026493 container died 5ee4c6c9ec25a8f381751a6e384c7256710f7b637e790bb9e859aa9be43a8a94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-09-12T03:07:32.478 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 03:07:32 smithi176 podman[74586]: 2024-09-12 03:07:32.23845469 +0000 UTC m=+3.300002574 container cleanup 5ee4c6c9ec25a8f381751a6e384c7256710f7b637e790bb9e859aa9be43a8a94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T03:07:32.478 INFO:journalctl@ceph.mds.f.smithi176.stdout:Sep 12 03:07:32 smithi176 bash[74586]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-f 2024-09-12T03:07:32.669 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.f.service' 2024-09-12T03:07:32.703 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:07:32.703 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-12T03:07:32.703 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-12T03:07:32.703 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.i 2024-09-12T03:07:33.228 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 03:07:32 smithi176 systemd[1]: Stopping Ceph mds.i for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:07:33.228 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 03:07:33 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-i[66392]: 2024-09-12T03:07:33.033+0000 7f0f579f9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:07:33.228 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 03:07:33 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-i[66392]: 2024-09-12T03:07:33.033+0000 7f0f579f9640 -1 mds.i *** got signal Terminated *** 2024-09-12T03:07:35.978 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 03:07:35 smithi176 podman[74707]: 2024-09-12 03:07:35.882540625 +0000 UTC m=+2.954152815 container died 5fbba7b093089e1f779d5c13f9a40afc6cf10e7678f21e6e7098b7efba1e7238 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-i, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-12T03:07:36.478 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 03:07:36 smithi176 podman[74707]: 2024-09-12 03:07:36.275677034 +0000 UTC m=+3.347289211 container cleanup 5fbba7b093089e1f779d5c13f9a40afc6cf10e7678f21e6e7098b7efba1e7238 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T03:07:36.478 INFO:journalctl@ceph.mds.i.smithi176.stdout:Sep 12 03:07:36 smithi176 bash[74707]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-i 2024-09-12T03:07:36.639 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.i.service' 2024-09-12T03:07:36.673 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:07:36.673 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-12T03:07:36.673 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-12T03:07:36.673 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.l 2024-09-12T03:07:36.978 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 03:07:36 smithi176 systemd[1]: Stopping Ceph mds.l for c7666100-70af-11ef-bcea-c7b262605968... 2024-09-12T03:07:37.478 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 03:07:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-l[65483]: 2024-09-12T03:07:37.003+0000 7f1e00aa4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T03:07:37.478 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 03:07:37 smithi176 ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-l[65483]: 2024-09-12T03:07:37.003+0000 7f1e00aa4640 -1 mds.l *** got signal Terminated *** 2024-09-12T03:07:40.163 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 03:07:39 smithi176 podman[74827]: 2024-09-12 03:07:39.883934807 +0000 UTC m=+2.994910520 container died 448d622eafb0781b1aaaa51e406979860a6dac4b10afd2d3b9f10a2914d386c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T03:07:40.478 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 03:07:40 smithi176 podman[74827]: 2024-09-12 03:07:40.254162943 +0000 UTC m=+3.365138652 container cleanup 448d622eafb0781b1aaaa51e406979860a6dac4b10afd2d3b9f10a2914d386c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-l, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T03:07:40.478 INFO:journalctl@ceph.mds.l.smithi176.stdout:Sep 12 03:07:40 smithi176 bash[74827]: ceph-c7666100-70af-11ef-bcea-c7b262605968-mds-l 2024-09-12T03:07:40.676 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c7666100-70af-11ef-bcea-c7b262605968@mds.l.service' 2024-09-12T03:07:40.708 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T03:07:40.708 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-12T03:07:40.708 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c7666100-70af-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T03:07:40.995 INFO:teuthology.orchestra.run.smithi018.stdout:Deleting cluster with fsid: c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T03:07:44.952 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c7666100-70af-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T03:07:45.159 INFO:teuthology.orchestra.run.smithi062.stdout:Deleting cluster with fsid: c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T03:07:47.671 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c7666100-70af-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T03:07:47.871 INFO:teuthology.orchestra.run.smithi176.stdout:Deleting cluster with fsid: c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T03:07:50.292 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T03:07:50.357 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T03:07:50.391 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T03:07:50.418 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-12T03:07:50.420 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901629/remote/smithi018/crash 2024-09-12T03:07:50.421 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/crash -- . 2024-09-12T03:07:50.478 INFO:teuthology.orchestra.run.smithi018.stderr:tar: /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T03:07:50.478 INFO:teuthology.orchestra.run.smithi018.stderr:tar: Error is not recoverable: exiting now 2024-09-12T03:07:50.481 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901629/remote/smithi062/crash 2024-09-12T03:07:50.482 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/crash -- . 2024-09-12T03:07:50.524 INFO:teuthology.orchestra.run.smithi062.stderr:tar: /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T03:07:50.525 INFO:teuthology.orchestra.run.smithi062.stderr:tar: Error is not recoverable: exiting now 2024-09-12T03:07:50.526 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901629/remote/smithi176/crash 2024-09-12T03:07:50.527 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/crash -- . 2024-09-12T03:07:50.562 INFO:teuthology.orchestra.run.smithi176.stderr:tar: /var/lib/ceph/c7666100-70af-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T03:07:50.562 INFO:teuthology.orchestra.run.smithi176.stderr:tar: Error is not recoverable: exiting now 2024-09-12T03:07:50.563 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-12T03:07:50.564 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-12T03:07:50.689 INFO:tasks.cephadm:Compressing logs... 2024-09-12T03:07:50.689 DEBUG:teuthology.orchestra.run.smithi018:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T03:07:50.693 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T03:07:50.695 DEBUG:teuthology.orchestra.run.smithi176:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T03:07:50.728 INFO:teuthology.orchestra.run.smithi176.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-12T03:07:50.728 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T03:07:50.730 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T03:07:50.730 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-12T03:07:50.730 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-12T03:07:50.730 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T03:07:50.731 INFO:teuthology.orchestra.run.smithi062.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-12T03:07:50.733 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.i.log: /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-12T03:07:50.733 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-12T03:07:50.733 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose --/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.11.log: /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-12T03:07:50.733 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.log 2024-09-12T03:07:50.733 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-12T03:07:50.733 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-12T03:07:50.733 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-12T03:07:50.733 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.l.log: /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-12T03:07:50.733 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-12T03:07:50.733 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T03:07:50.734 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-12T03:07:50.735 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-12T03:07:50.735 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-12T03:07:50.735 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T03:07:50.738 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-12T03:07:50.738 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-12T03:07:50.738 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-12T03:07:50.738 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T03:07:50.738 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T03:07:50.738 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-12T03:07:50.738 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.log 2024-09-12T03:07:50.738 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-12T03:07:50.738 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-12T03:07:50.739 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-12T03:07:50.739 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T03:07:50.754 INFO:teuthology.orchestra.run.smithi018.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-12T03:07:50.754 INFO:teuthology.orchestra.run.smithi018.stderr:: No such file or directory 2024-09-12T03:07:50.755 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-12T03:07:50.756 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-12T03:07:50.757 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T03:07:50.758 INFO:teuthology.orchestra.run.smithi018.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-12T03:07:50.758 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T03:07:50.759 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.9.log: /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-12T03:07:50.759 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T03:07:50.760 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-12T03:07:50.761 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-12T03:07:50.762 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-12T03:07:50.762 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.log 2024-09-12T03:07:50.763 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-12T03:07:50.764 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-12T03:07:50.766 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-12T03:07:50.767 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-12T03:07:50.768 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T03:07:50.768 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T03:07:50.769 INFO:teuthology.orchestra.run.smithi018.stderr: 94.5% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-12T03:07:50.770 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.4% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-12T03:07:50.805 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.c.log: /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 81.8% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T03:07:50.842 INFO:teuthology.orchestra.run.smithi018.stderr: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T03:07:50.882 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-12T03:07:50.888 INFO:teuthology.orchestra.run.smithi176.stderr: 92.3% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-12T03:07:50.897 INFO:teuthology.orchestra.run.smithi176.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T03:07:50.921 INFO:teuthology.orchestra.run.smithi062.stderr: 90.9% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T03:07:50.968 INFO:teuthology.orchestra.run.smithi018.stderr: 90.3% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T03:07:50.978 INFO:teuthology.orchestra.run.smithi176.stderr: 90.5% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T03:07:50.980 INFO:teuthology.orchestra.run.smithi176.stderr: 87.5% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T03:07:50.981 INFO:teuthology.orchestra.run.smithi176.stderr: 91.0% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T03:07:51.047 INFO:teuthology.orchestra.run.smithi018.stderr: 84.3% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T03:07:51.070 INFO:teuthology.orchestra.run.smithi062.stderr: 87.5% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T03:07:51.073 INFO:teuthology.orchestra.run.smithi062.stderr: 81.8% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T03:07:51.100 INFO:teuthology.orchestra.run.smithi062.stderr: 90.4% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T03:07:51.125 INFO:teuthology.orchestra.run.smithi018.stderr: 91.0% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T03:07:51.518 INFO:teuthology.orchestra.run.smithi062.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T03:07:52.751 INFO:teuthology.orchestra.run.smithi018.stderr: 90.2% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-12T03:07:53.816 INFO:teuthology.orchestra.run.smithi062.stderr: 91.6% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-12T03:07:57.895 INFO:teuthology.orchestra.run.smithi018.stderr: 90.4% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-12T03:08:07.254 INFO:teuthology.orchestra.run.smithi176.stderr: 91.7% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-12T03:08:58.830 INFO:teuthology.orchestra.run.smithi018.stderr: 94.1% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-12T03:09:02.214 INFO:teuthology.orchestra.run.smithi176.stderr: 95.7% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-12T03:09:51.149 INFO:teuthology.orchestra.run.smithi062.stderr: 95.4% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-12T03:11:32.843 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-12T03:11:44.555 INFO:teuthology.orchestra.run.smithi062.stderr: 95.4% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-12T03:12:34.492 INFO:teuthology.orchestra.run.smithi176.stderr: 95.3% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-12T03:12:47.569 INFO:teuthology.orchestra.run.smithi018.stderr: 91.0% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-12T03:13:19.621 INFO:teuthology.orchestra.run.smithi176.stderr: 91.3% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-12T03:13:27.175 INFO:teuthology.orchestra.run.smithi018.stderr: 91.0% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-12T03:14:08.129 INFO:teuthology.orchestra.run.smithi176.stderr: 94.0% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-12T03:14:42.803 INFO:teuthology.orchestra.run.smithi018.stderr: 91.0% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-12T03:15:24.713 INFO:teuthology.orchestra.run.smithi176.stderr: 91.4% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-12T03:15:44.942 INFO:teuthology.orchestra.run.smithi018.stderr: 91.1% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-12T03:15:54.693 INFO:teuthology.orchestra.run.smithi018.stderr: 93.6% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-12T03:15:54.696 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-12T03:15:54.696 INFO:teuthology.orchestra.run.smithi018.stderr:real 8m3.975s 2024-09-12T03:15:54.697 INFO:teuthology.orchestra.run.smithi018.stderr:user 5m48.928s 2024-09-12T03:15:54.697 INFO:teuthology.orchestra.run.smithi018.stderr:sys 0m37.550s 2024-09-12T03:17:49.525 INFO:teuthology.orchestra.run.smithi176.stderr: 91.3% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-12T03:18:26.658 INFO:teuthology.orchestra.run.smithi176.stderr: 93.5% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-12T03:18:36.559 INFO:teuthology.orchestra.run.smithi176.stderr: 91.2% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-12T03:18:36.562 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-09-12T03:18:36.562 INFO:teuthology.orchestra.run.smithi176.stderr:real 10m45.852s 2024-09-12T03:18:36.562 INFO:teuthology.orchestra.run.smithi176.stderr:user 5m56.407s 2024-09-12T03:18:36.563 INFO:teuthology.orchestra.run.smithi176.stderr:sys 0m15.849s 2024-09-12T03:18:47.012 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-12T03:21:45.440 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-12T03:23:27.758 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-12T03:24:32.818 INFO:teuthology.orchestra.run.smithi062.stderr: 93.5% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-12T03:26:01.611 INFO:teuthology.orchestra.run.smithi062.stderr: 93.3% -- replaced with /var/log/ceph/c7666100-70af-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-12T03:26:01.613 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T03:26:01.613 INFO:teuthology.orchestra.run.smithi062.stderr:real 18m10.903s 2024-09-12T03:26:01.613 INFO:teuthology.orchestra.run.smithi062.stderr:user 8m27.853s 2024-09-12T03:26:01.613 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m22.040s 2024-09-12T03:26:01.614 INFO:tasks.cephadm:Archiving logs... 2024-09-12T03:26:01.615 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901629/remote/smithi018/log 2024-09-12T03:26:01.615 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T03:26:58.883 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901629/remote/smithi062/log 2024-09-12T03:26:58.884 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T03:28:15.433 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901629/remote/smithi176/log 2024-09-12T03:28:15.435 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T03:29:15.631 INFO:tasks.cephadm:Removing cluster... 2024-09-12T03:29:15.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c7666100-70af-11ef-bcea-c7b262605968 --force 2024-09-12T03:29:15.999 INFO:teuthology.orchestra.run.smithi018.stdout:Deleting cluster with fsid: c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T03:29:17.767 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c7666100-70af-11ef-bcea-c7b262605968 --force 2024-09-12T03:29:17.990 INFO:teuthology.orchestra.run.smithi062.stdout:Deleting cluster with fsid: c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T03:29:18.784 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c7666100-70af-11ef-bcea-c7b262605968 --force 2024-09-12T03:29:19.147 INFO:teuthology.orchestra.run.smithi176.stdout:Deleting cluster with fsid: c7666100-70af-11ef-bcea-c7b262605968 2024-09-12T03:29:19.854 INFO:tasks.cephadm:Removing cephadm ... 2024-09-12T03:29:19.855 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T03:29:19.896 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T03:29:19.927 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T03:29:19.943 INFO:tasks.cephadm:Teardown complete 2024-09-12T03:29:19.944 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T03:29:19.956 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T03:29:19.956 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T03:29:19.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T03:29:19.971 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T03:29:20.118 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T03:29:20.129 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T03:29:20.130 DEBUG:teuthology.orchestra.run.smithi018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T03:29:20.134 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T03:29:20.136 DEBUG:teuthology.orchestra.run.smithi176:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T03:29:20.151 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-09-12T03:29:20.154 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-09-12T03:29:20.163 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T03:29:20.163 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-09-12T03:29:20.163 INFO:teuthology.orchestra.run.smithi176.stdout:^* hv01.front.sepia.ceph.com 3 6 377 62 -2953us[-2930us] +/- 49ms 2024-09-12T03:29:20.163 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 60 +1814us[+1814us] +/- 64ms 2024-09-12T03:29:20.163 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 +2508us[+2531us] +/- 74ms 2024-09-12T03:29:20.164 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T03:29:20.164 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T03:29:20.164 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-09-12T03:29:20.165 INFO:teuthology.orchestra.run.smithi062.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 -2951us[-2964us] +/- 49ms 2024-09-12T03:29:20.165 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 61 +1799us[+1786us] +/- 64ms 2024-09-12T03:29:20.165 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 +2534us[+2521us] +/- 74ms 2024-09-12T03:29:20.165 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T03:29:20.165 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-12T03:29:20.242 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T03:29:20.242 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-12T03:29:20.242 INFO:teuthology.orchestra.run.smithi018.stdout:^* hv01.front.sepia.ceph.com 3 6 377 59 -2928us[-2915us] +/- 49ms 2024-09-12T03:29:20.243 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 60 +1825us[+1837us] +/- 64ms 2024-09-12T03:29:20.243 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 +2525us[+2538us] +/- 74ms 2024-09-12T03:29:20.243 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T03:29:20.244 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T03:29:20.256 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T03:29:20.257 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T03:29:20.309 DEBUG:teuthology.orchestra.run.smithi018:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T03:29:20.457 DEBUG:teuthology.orchestra.run.smithi062:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T03:29:20.552 DEBUG:teuthology.orchestra.run.smithi176:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T03:29:20.667 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T03:29:20.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:29:20.729 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T03:29:20.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:29:20.762 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T03:29:20.790 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:29:20.790 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T03:29:20.801 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T03:29:20.825 INFO:teuthology.task.internal:Duration was 3585.412313 seconds 2024-09-12T03:29:20.826 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T03:29:20.896 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T03:29:20.896 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T03:29:20.901 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T03:29:20.904 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T03:29:20.953 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T03:29:20.973 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T03:29:20.991 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T03:29:21.441 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T03:29:21.441 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi018.front.sepia.ceph.com 2024-09-12T03:29:21.441 DEBUG:teuthology.orchestra.run.smithi018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T03:29:21.496 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T03:29:21.497 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T03:29:21.530 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi176.front.sepia.ceph.com 2024-09-12T03:29:21.530 DEBUG:teuthology.orchestra.run.smithi176:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T03:29:21.560 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T03:29:21.560 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T03:29:21.564 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T03:29:21.575 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T03:29:21.629 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T03:29:21.629 DEBUG:teuthology.orchestra.run.smithi018:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T03:29:21.634 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T03:29:21.647 DEBUG:teuthology.orchestra.run.smithi176:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T03:29:22.264 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T03:29:22.276 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T03:29:22.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T03:29:22.334 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T03:29:22.361 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T03:29:22.402 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T03:29:22.413 DEBUG:teuthology.orchestra.run.smithi018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T03:29:22.418 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T03:29:22.420 DEBUG:teuthology.orchestra.run.smithi176:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T03:29:22.454 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-09-12T03:29:22.477 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = core 2024-09-12T03:29:22.502 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = core 2024-09-12T03:29:22.547 DEBUG:teuthology.orchestra.run.smithi018:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T03:29:22.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:29:22.581 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T03:29:22.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:29:22.596 DEBUG:teuthology.orchestra.run.smithi176:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T03:29:22.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:29:22.613 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T03:29:22.624 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T03:29:22.626 DEBUG:teuthology.misc:Transferring archived files from smithi018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901629/remote/smithi018 2024-09-12T03:29:22.626 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T03:29:22.706 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901629/remote/smithi062 2024-09-12T03:29:22.706 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T03:29:22.750 DEBUG:teuthology.misc:Transferring archived files from smithi176:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901629/remote/smithi176 2024-09-12T03:29:22.750 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T03:29:22.791 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T03:29:22.791 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T03:29:22.795 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T03:29:22.801 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T03:29:22.841 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T03:29:22.855 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T03:29:22.855 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T03:29:22.918 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T03:29:22.918 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T03:29:22.923 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T03:29:22.926 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T03:29:22.938 INFO:teuthology.orchestra.run.smithi062.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 03:29 /home/ubuntu/cephtest 2024-09-12T03:29:22.942 INFO:teuthology.orchestra.run.smithi176.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 03:29 /home/ubuntu/cephtest 2024-09-12T03:29:22.953 INFO:teuthology.orchestra.run.smithi018.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 03:29 /home/ubuntu/cephtest 2024-09-12T03:29:22.956 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T03:29:22.971 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T03:29:23.065 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/blogbench}} duration: 3585.4123129844666 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T03:29:23.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T03:29:23.167 INFO:teuthology.run:pass